Page MenuHomeSoftware Heritage

Update scheduler metrics routine is taking too long
Closed, MigratedEdits Locked

Description

It triggered yesterday and 12h later [1] [2] it's not finished. It's actually supposed
to trigger every 4h and used to take around ~20min.

That is blocking since the archive.softwareheritage.org's landing page is relying on it
to display coverage statistics.

[1] status of the service triggering the update

● swh-scheduler-update-metrics.service - Software Heritage scheduler update-metrics
     Loaded: loaded (/etc/systemd/system/swh-scheduler-update-metrics.service; disabled; vendor preset: enabled)
     Active: active (running) since Wed 2021-12-08 22:11:01 UTC; 12h ago

[2] pg_activity snapshot view at the time of the analysis

102070 softwar...eduler                      swhscheduler 192.168.100.210/   42.6  1.2   22.10M       0B 752:52.12  N    N             active   SELECT last_update, lister_id, origins_enabled, origins_known, origins_never_visited, ...

Event Timeline

ardumont changed the task status from Open to Work in Progress.Dec 9 2021, 3:13 PM
ardumont removed olasd as the assignee of this task.
ardumont triaged this task as Unbreak Now! priority.
ardumont created this task.
ardumont added a subscriber: olasd.
olasd claimed this task.

SQL schema version 32 (from D6812) with the updated update_metrics function has been deployed in staging and prod.