Page MenuHomeSoftware Heritage

Scheduler runner is slow to run tasks
Closed, MigratedEdits Locked

Description

The scheduler runner is slow to pick out tasks that need to be scheduled. This is most obvious on the origin metadata indexer tasks, where workers manage several dozen tasks per seconds, and the bottleneck is the buffer.

This is probably, in part, an issue with the schema used on the database, be that the schema itself or indexes. We should investigate (measure) and fix that.