Page MenuHomeSoftware Heritage

Add task related metrics to swh-scheduler
Closed, ResolvedPublic

Description

Add some task related metrics to the swh-scheduler base task class (or whatever replaces it):

  • task counts (start, success, failure)
  • task durations (histogram)

Event Timeline

olasd created this task.Jan 8 2019, 11:44 AM
olasd triaged this task as High priority.
olasd added a project: Scheduling utilities.
olasd claimed this task.
olasd added a comment.Mon, Feb 25, 2:59 PM

With statsd-exporter deployed, we have a dashboard:

https://grafana.softwareheritage.org/d/b_xh3f9ik/worker-task-processing

The dashboard can be configured to display metrics about a specific task type by selecting it in the dropdown:

https://grafana.softwareheritage.org/d/b_xh3f9ik/worker-task-processing?var-task=swh.loader.git.tasks.UpdateGitRepository&orgId=1