Page MenuHomeSoftware Heritage

Scheduler runner is slow to run tasks
Open, HighPublic

Description

The scheduler runner is slow to pick out tasks that need to be scheduled. This is most obvious on the origin metadata indexer tasks, where workers manage several dozen tasks per seconds, and the bottleneck is the buffer.

This is probably, in part, an issue with the schema used on the database, be that the schema itself or indexes. We should investigate (measure) and fix that.

Event Timeline

olasd created this task.Feb 26 2019, 11:44 AM
olasd triaged this task as High priority.