Page MenuHomeSoftware Heritage

WIP - First iteration of prometheus export of the e2e metrics
Changes PlannedPublicDraft

Authored by vsellier on Wed, Jan 12, 3:07 PM.

Details

Summary

TODO:

  • generate the metrics for the vault
  • test the content of the exported file
  • add an info field containing the result of the test to help the diagnosis in the monitoring

Related to T3129

Test Plan

Example of generated metrics:

  • scn:
# HELP swh_e2e_duration_seconds 
# TYPE swh_e2e_duration_seconds gauge
swh_e2e_duration_seconds{application="scn",status="succeeded"} 30.0
# HELP swh_e2e_status 
# TYPE swh_e2e_status gauge
swh_e2e_status{application="scn"} 0.0
  • deposit:
# HELP swh_e2e_duration_seconds 
# TYPE swh_e2e_duration_seconds gauge
swh_e2e_duration_seconds{application="deposit",stage="validation",status="ok"} 10.0
swh_e2e_duration_seconds{application="deposit",stage="loading",status="failed"} 20.0
swh_e2e_duration_seconds{application="deposit",stage="total",status="failed"} 30.0
# HELP swh_e2e_status 
# TYPE swh_e2e_status gauge
swh_e2e_status{application="deposit"} 2.0

Diff Detail

Repository
rDICP Icinga plugins
Branch
master
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 25978
Build 40602: Phabricator diff pipeline on jenkinsJenkins console · Jenkins
Build 40601: arc lint + arc unit

Unit TestsFailed

TimeTest
3 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.icinga_plugins.tests.test_deposit::test_deposit_delay_critical
requests_mock = <requests_mock.mocker.Mocker object at 0x7fbee1164080> mocker = <pytest_mock.plugin.MockerFixture object at 0x7fbee11646a0> sample_archive = '/tmp/pytest-of-jenkins/pytest-0/swh.icinga_plugins.tests.test_deposit0/archive.tar.gz'
3 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.icinga_plugins.tests.test_deposit::test_deposit_delay_warning
requests_mock = <requests_mock.mocker.Mocker object at 0x7fbee0f54a20> mocker = <pytest_mock.plugin.MockerFixture object at 0x7fbee0f547b8> sample_archive = '/tmp/pytest-of-jenkins/pytest-0/swh.icinga_plugins.tests.test_deposit0/archive.tar.gz'
3 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.icinga_plugins.tests.test_deposit::test_deposit_delays
requests_mock = <requests_mock.mocker.Mocker object at 0x7fbee1224b70> mocker = <pytest_mock.plugin.MockerFixture object at 0x7fbee1224d68> sample_archive = '/tmp/pytest-of-jenkins/pytest-0/swh.icinga_plugins.tests.test_deposit0/archive.tar.gz'
3 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.icinga_plugins.tests.test_deposit::test_deposit_failed
requests_mock = <requests_mock.mocker.Mocker object at 0x7fbee0fb2f60> mocker = <pytest_mock.plugin.MockerFixture object at 0x7fbee0fb2cc0> sample_archive = '/tmp/pytest-of-jenkins/pytest-0/swh.icinga_plugins.tests.test_deposit0/archive.tar.gz'
3 msJenkins > .tox.py3.lib.python3.7.site-packages.swh.icinga_plugins.tests.test_deposit::test_deposit_rejected
requests_mock = <requests_mock.mocker.Mocker object at 0x7fbee11bc2e8> mocker = <pytest_mock.plugin.MockerFixture object at 0x7fbee11bc320> sample_archive = '/tmp/pytest-of-jenkins/pytest-0/swh.icinga_plugins.tests.test_deposit0/archive.tar.gz'
View Full Test Results (13 Failed · 9 Passed)

Event Timeline

Build has FAILED

Patch application report for D6926 (id=25102)

Rebasing onto c4f025e849...

Current branch diff-target is up to date.
Changes applied before test
commit d4d2c0449bc279618cab1f5198f8e81f52002b33
Author: Vincent SELLIER <vincent.sellier@softwareheritage.org>
Date:   Wed Jan 12 15:03:06 2022 +0100

    WIP - First iteration of prometheus export of the e2e metrics
    
    TODO:
    - generate the metrics for the vault
    - test the content of the exported file
    - add an info field containing the result of the test to help
      the diagnosis in the monitoring
    
    Related to T3129

Link to build: https://jenkins.softwareheritage.org/job/DICP/job/tests-on-diff/38/
See console output for more information: https://jenkins.softwareheritage.org/job/DICP/job/tests-on-diff/38/console

Harbormaster returned this revision to the author for changes because remote builds failed.Wed, Jan 12, 3:09 PM
Harbormaster failed remote builds in B25976: Diff 25102!

Build has FAILED

Patch application report for D6926 (id=25104)

Rebasing onto c4f025e849...

Current branch diff-target is up to date.
Changes applied before test
commit 54f100898bd6a925a02a1733d4aae187bf44d738
Author: Vincent SELLIER <vincent.sellier@softwareheritage.org>
Date:   Wed Jan 12 15:03:06 2022 +0100

    WIP - First iteration of prometheus export of the e2e metrics
    
    TODO:
    - generate the metrics for the vault
    - test the content of the exported file
    - add an info field containing the result of the test to help
      the diagnosis in the monitoring
    
    Related to T3129

Link to build: https://jenkins.softwareheritage.org/job/DICP/job/tests-on-diff/39/
See console output for more information: https://jenkins.softwareheritage.org/job/DICP/job/tests-on-diff/39/console

Harbormaster returned this revision to the author for changes because remote builds failed.Wed, Jan 12, 3:17 PM
Harbormaster failed remote builds in B25978: Diff 25104!