Page MenuHomeSoftware Heritage
Create Task
Maniphest T2124

Save Code Now: monitoring of admin infra
Closed, MigratedEdits Locked
Actions

Description

Add an exporter with the:

  • number of pending save code now validations
  • date of latest save code now validation

Revisions and Commits

rDWAPPS Web applications
D2432rDWAPPS4c55d9af7b41 origin_save: Add prometheus metrics for origin save requests

Related Objects

Event Timeline

olasd created this task.Dec 2 2019, 2:17 PM
vlorentz triaged this task as High priority.Dec 3 2019, 3:17 PM
vlorentz lowered the priority of this task from High to Normal.Dec 3 2019, 5:50 PM
anlambert added a subscriber: anlambert.Dec 6 2019, 2:25 PM

We could use [[ https://github.com/prometheus/client_python | prometheus_client ]] (packaged in debian) to generate and export Prometheus metrics for swh-web.

[[ https://github.com/korfuri/django-prometheus | django-prometheus ]] seems also quite interesting to monitor the web application internals (but it is not packaged in debian).

anlambert moved this task from Backlog to in progress on the Sprint 2019/12 (Monitor and Conquer) board.Dec 9 2019, 1:54 PM
anlambert mentioned this in D2416: docker/compose: configure the statsd endpoint for most of the containers.Dec 9 2019, 4:53 PM
anlambert mentioned this in D2419: origin_save: Add some statsd monitoring metrics.Dec 9 2019, 4:55 PM
douardda added a subscriber: douardda.Dec 10 2019, 11:12 AM

prometheus_client looks quite low-level to me. We already have statsd for this kind of purpose, which does not imply having to deal with one more dedicated http server or so...

anlambert added a comment.Dec 10 2019, 11:26 AM

Yes I agree, I ended up using statsd in D2419 after all. django-prometheus could be interesting to use but it maybe redundant with the upcoming sentry integration in swh-web.

anlambert claimed this task.Dec 11 2019, 4:14 PM
anlambert mentioned this in D2432: Add prometheus metrics for origin save requests.Dec 11 2019, 6:05 PM
anlambert added a comment.EditedDec 11 2019, 6:09 PM

After second thoughts, relying on the use of prometheus_client seems a better approach for the swh-web case so D2419 is abandoned in favor of D2432.

anlambert closed this task as Resolved by committing rDWAPPS4c55d9af7b41: origin_save: Add prometheus metrics for origin save requests.Dec 12 2019, 5:41 PM
anlambert added a commit: rDWAPPS4c55d9af7b41: origin_save: Add prometheus metrics for origin save requests.
zack moved this task from in progress to done on the Sprint 2019/12 (Monitor and Conquer) board.Dec 12 2019, 5:50 PM
anlambert mentioned this in D2455: conf/prometheus: Add swh-web metrics scrapping.Dec 13 2019, 4:38 PM
anlambert mentioned this in rDENVf6fe79eaecdc: conf/prometheus: Add swh-web metrics scrapping.Dec 16 2019, 11:02 AM
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 10:00 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal