Page MenuHomeSoftware Heritage

swh-search: add statsd/prometheus metrics
Closed, MigratedEdits Locked

Description

There is no metrics generated by the swh-search service so we can't graph any performance statistics currently.

The only stats at the moment are on the gunicorn logs :

Feb 12 11:16:47 moma python3[2477829]: 2021-02-12 11:16:47 [2477829] elasticsearch:INFO GET http://search-esnode2.internal.softwareheritage.org:9200/origin/_search?size=100 [status:200 request:0.722s]

Event Timeline

vsellier triaged this task as Normal priority.Feb 12 2021, 12:19 PM
vsellier created this task.

A basic dashboard [1] is created on garfana based on the number of log line.
It's too limited as it's not possible to isolate the logs per environment as the information is not available.
It will be added in T3043

[1] https://grafana.softwareheritage.org/goto/HGWyd2PGz

vsellier changed the task status from Open to Work in Progress.Feb 16 2021, 6:22 PM
vsellier moved this task from Weekly backlog to in-progress on the System administration board.

swh-search:v0.5.0 deployed in all the environments, the metrics are correctly gathered by prometheus.
Let's create a real dashboard now [1]

[1] https://grafana.softwareheritage.org/goto/HpLMnjEGz

The dashboard was moved to the system directory: the new url is https://grafana.softwareheritage.org/goto/uBHBojEGz

vsellier moved this task from in-progress to done on the System administration board.