Differential D5103

Add metrics to monitor activity
ClosedPublic
Actions

Authored by vsellier on Feb 18 2021, 10:12 AM.

Details

Reviewers

ardumont

Group Reviewers

Reviewers

Maniphest Tasks

T3042: swh-search: add statsd/prometheus metrics

Commits

rDSEA0fa1f6deb5ab: Add monitoring metrics

Summary

Add timing/count of api calls
Add statistics on indexation

It uses statsd as it's not easy to use the
prometheus client library on gunicorn server
due to the multi-process management

https://github.com/prometheus/client_python#multiprocess-mode-gunicorn

Related to T3042

Diff Detail

Repository

rDSEA Archive search

Branch

master

Lint

No Linters Available

Unit

No Unit Test Coverage

Build Status

Buildable 19316
Build 29950: Phabricator diff pipeline on jenkins	Jenkins console · Jenkins
Build 29949: arc lint + arc unit

Event Timeline

vsellier created this revision.Feb 18 2021, 10:12 AM

Herald added a reviewer: Reviewers. · View Herald TranscriptFeb 18 2021, 10:12 AM

Build has FAILED

Patch application report for D5103 (id=18218)

Rebasing onto 12a9e9610b...

Current branch diff-target is up to date.

Changes applied before test

commit d6c76c4b064e89a37780a2d2927be54fbab26b71
Author: Vincent SELLIER <vincent.sellier@softwareheritage.org>
Date:   Thu Feb 18 10:05:30 2021 +0100

    Add monitoring metrics
    
    - Add timing/count of api calls
    - Add statistic on origin indexation
    
    Related to T3042

Link to build: https://jenkins.softwareheritage.org/job/DSEA/job/tests-on-diff/83/
See console output for more information: https://jenkins.softwareheritage.org/job/DSEA/job/tests-on-diff/83/console

Harbormaster returned this revision to the author for changes because remote builds failed.Feb 18 2021, 10:12 AM

Harbormaster failed remote builds in B19316: Diff 18218!

fix tests

Build is green

Patch application report for D5103 (id=18219)

Rebasing onto 12a9e9610b...

Current branch diff-target is up to date.

Changes applied before test

commit 0fa1f6deb5ab39ae33ad479dd06660d7a74ade77
Author: Vincent SELLIER <vincent.sellier@softwareheritage.org>
Date:   Thu Feb 18 10:05:30 2021 +0100

    Add monitoring metrics
    
    - Add timing/count of api calls
    - Add statistic on origin indexation
    
    Related to T3042

See https://jenkins.softwareheritage.org/job/DSEA/job/tests-on-diff/84/ for more details.

Harbormaster completed remote builds in B19317: Diff 18219.Feb 18 2021, 10:39 AM

vsellier requested review of this revision.Feb 18 2021, 10:39 AM