Page MenuHomeSoftware Heritage

github: Export statsd metrics about API requests and token usage
ClosedPublic

Authored by vlorentz on Dec 15 2022, 12:21 PM.

Details

Summary

We will need to monitored token usage when scheduling recurring fetches
of extrinsic metadata.

Metrics on API requests and sleep time themselves are just an extra
that may be handy in the future.

This is the first half of T4728.

Diff Detail

Event Timeline

Build has FAILED

Patch application report for D8959 (id=32281)

Rebasing onto 306a74d01a...

Current branch diff-target is up to date.
Changes applied before test
commit e932c3978a51c9826c65afc34d7a5c096df63984
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Thu Dec 15 12:21:23 2022 +0100

    github: Export statsd metrics about API requests and token usage
    
    We will need to monitored token usage when scheduling recurring fetches
    of extrinsic metadata.
    
    Metrics on API requests and sleep time themselves are just an extra
    that may be handy in the future.

Link to build: https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/492/
See console output for more information: https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/492/console

Harbormaster returned this revision to the author for changes because remote builds failed.Dec 15 2022, 12:23 PM
Harbormaster failed remote builds in B33236: Diff 32281!

Build is green

Patch application report for D8959 (id=32282)

Rebasing onto 306a74d01a...

Current branch diff-target is up to date.
Changes applied before test
commit bf5d7728766aa00ad444cc8481ae333adb2c664a
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Thu Dec 15 12:21:23 2022 +0100

    github: Export statsd metrics about API requests and token usage
    
    We will need to monitored token usage when scheduling recurring fetches
    of extrinsic metadata.
    
    Metrics on API requests and sleep time themselves are just an extra
    that may be handy in the future.

See https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/493/ for more details.

swh/core/github/pytest_plugin.py
154–158

this was the branch for cases 1 and 3

160

and that was case 2

olasd added a subscriber: olasd.

Thanks.

This looks sensible. When this is deployed, we'll need to monitor how the label set grows over time, of course!

This revision is now accepted and ready to land.Dec 20 2022, 6:01 PM
This revision was landed with ongoing or failed builds.Dec 21 2022, 3:04 PM
This revision was automatically updated to reflect the committed changes.

Build is green

Patch application report for D8959 (id=32345)

Rebasing onto bff1e71c7c...

Current branch diff-target is up to date.
Changes applied before test
commit 311113c6b7f0122a9e13022fb6d7eb7ec9b23d25
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Thu Dec 15 12:21:23 2022 +0100

    github: Export statsd metrics about API requests and token usage
    
    We will need to monitored token usage when scheduling recurring fetches
    of extrinsic metadata.
    
    Metrics on API requests and sleep time themselves are just an extra
    that may be handy in the future.

See https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/494/ for more details.