Page MenuHomeSoftware Heritage

Cleanup the old counters environment
Open, NormalPublic

Description

The counters are in production since a few months now and no issues were detected.

The old counters stack can be decommissioned.

After a discussion, we (sysadms) have decided to keep the counter computation in database and the export to prometheus to have a idea of the drift of the hyperloglogs counters.

However, some tasks are still needed:

  • Reduce the refresh of the database counter to once a week or month to reduce the pressure on the database
  • Cleanup the puppet code relative the plumbing around stats.softwareheritage.org (script, crons, historical data)
  • Cleanup apache the configuration to remove the unused stats.softwarehritage.org vhost
  • Remove the files on pergamon

Event Timeline

vsellier triaged this task as Normal priority.Jun 29 2021, 11:20 AM
vsellier created this task.