Page MenuHomeSoftware Heritage
Create Task
Maniphest T3042

swh-search: add statsd/prometheus metrics
Closed, MigratedEdits Locked
Actions

Description

There is no metrics generated by the swh-search service so we can't graph any performance statistics currently.

The only stats at the moment are on the gunicorn logs :

Feb 12 11:16:47 moma python3[2477829]: 2021-02-12 11:16:47 [2477829] elasticsearch:INFO GET http://search-esnode2.internal.softwareheritage.org:9200/origin/_search?size=100 [status:200 request:0.722s]

Revisions and Commits

rDSEA Archive search
D5103rDSEA0fa1f6deb5ab Add monitoring metrics
rDENV Development environment
D5104rDENV75ce4026f8a3 swh-search: activate metrics

Related Objects

Event Timeline

vsellier triaged this task as Normal priority.Feb 12 2021, 12:19 PM
vsellier created this task.
vsellier moved this task from Backlog to Weekly backlog on the System administration board.Feb 12 2021, 5:44 PM
vsellier added a comment.EditedFeb 12 2021, 5:53 PM

A basic dashboard [1] is created on garfana based on the number of log line.
It's too limited as it's not possible to isolate the logs per environment as the information is not available.
It will be added in T3043

[1] https://grafana.softwareheritage.org/goto/HGWyd2PGz

vsellier changed the task status from Open to Work in Progress.Feb 16 2021, 6:22 PM
vsellier moved this task from Weekly backlog to in-progress on the System administration board.
vsellier claimed this task.Feb 18 2021, 10:06 AM
vsellier added a revision: D5103: Add metrics to monitor activity.Feb 18 2021, 10:12 AM
vsellier added a commit: rDSEA0fa1f6deb5ab: Add monitoring metrics.Feb 18 2021, 11:21 AM
vsellier added a revision: D5104: swh-search: activate metrics.Feb 18 2021, 11:35 AM
vsellier added a comment.Feb 18 2021, 12:03 PM

swh-search:v0.5.0 deployed in all the environments, the metrics are correctly gathered by prometheus.
Let's create a real dashboard now [1]

[1] https://grafana.softwareheritage.org/goto/HpLMnjEGz

vsellier added a comment.Feb 18 2021, 3:07 PM

The dashboard was moved to the system directory: the new url is https://grafana.softwareheritage.org/goto/uBHBojEGz

vsellier closed this task as Resolved.Feb 18 2021, 3:07 PM
vsellier moved this task from in-progress to done on the System administration board.
vsellier added a commit: rDENV75ce4026f8a3: swh-search: activate metrics.Feb 18 2021, 3:22 PM
gitlab-migration changed the task status from Resolved to Migrated.Oct 19 2022, 6:01 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal