Page MenuHomeSoftware Heritage
Create Task
Maniphest T2733

Explore / install a varnish prometheus probe
Closed, ResolvedPublic
Actions

Description

To have some bits on the real-time traffic on the web app.

eg. https://github.com/jonnenauha/prometheus_varnish_exporter

Revisions and Commits

rSPSITE puppet-swh-site
D7079rSPSITE29566b79693e varnish: export the metrics to prometheus

Event Timeline

douardda triaged this task as High priority.Oct 26 2020, 11:01 AM
douardda created this task.
vsellier added a subscriber: vsellier.Oct 26 2020, 12:01 PM
vsellier added a project: Metrics/monitoring.Nov 17 2020, 11:54 AM
vsellier added a comment.Nov 17 2020, 2:42 PM

The varnish logs should be also ingested to elasticsearch to have fine grained statistics.

It seems there is not filebeat / journalbeat supported module, but it may be possible to use a combinaison of varnishncsa [1] to generate varnish logs and filebeat to ingest them. It could also allow to have statistics on the caching effectiveness per requests.

[1] https://varnish-cache.org/docs/4.0/reference/varnishncsa.html

vsellier changed the task status from Open to Work in Progress.Feb 3 2022, 7:01 PM
vsellier claimed this task.
vsellier moved this task from Backlog to in-progress on the System administration board.
vsellier added a revision: D7079: varnish: export the metrics to prometheus.Feb 3 2022, 7:04 PM
vsellier added a commit: rSPSITE29566b79693e: varnish: export the metrics to prometheus.Feb 4 2022, 9:09 AM
vsellier closed this task as Resolved.Feb 7 2022, 9:00 AM
vsellier moved this task from in-progress to done on the System administration board.

the exporter is deployed.
The varnish stats are available on this dashboard: https://grafana.softwareheritage.org/d/pE2xMZank/varnish

About · Developer information · Legal