Page MenuHomeSoftware Heritage

sysadm: Add a "how to process add-forge-now requests"
ClosedPublic

Authored by ardumont on Dec 6 2022, 6:52 PM.

Diff Detail

Repository
rDDOC Development documentation
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

Build has FAILED

Patch application report for D8929 (id=32153)

Rebasing onto 7bfdb3d102...

Current branch diff-target is up to date.
Changes applied before test
commit 454b72733ba542668776380357b0aa08caf28dbd
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 6 18:51:38 2022 +0100

    Add a "process add-forge-now" request howto

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/282/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/282/console

Harbormaster returned this revision to the author for changes because remote builds failed.Dec 6 2022, 6:54 PM
Harbormaster failed remote builds in B33106: Diff 32153!

End the production deployment part.

Build has FAILED

Patch application report for D8929 (id=32188)

Rebasing onto 7bfdb3d102...

Current branch diff-target is up to date.
Changes applied before test
commit 2cf046da14a9637e43971bc602cb5a962ad7fcbe
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 6 18:51:38 2022 +0100

    Add a "process add-forge-now" request howto
    
    Related to https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4674

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/283/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/283/console

Harbormaster returned this revision to the author for changes because remote builds failed.Dec 7 2022, 1:07 PM
Harbormaster failed remote builds in B33142: Diff 32188!
ardumont retitled this revision from wip: Add a "process add-forge-now" request howto to sysadm: Add a "how to process add-forge-now requests".Dec 8 2022, 5:16 PM

Build has FAILED

Patch application report for D8929 (id=32234)

Rebasing onto 7bfdb3d102...

Current branch diff-target is up to date.
Changes applied before test
commit 75577d97dca000f74af046c2f529c55dc88d2437
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 6 18:51:38 2022 +0100

    sysadm/Add a "how to process add-forge-now requests"
    
    Related to https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4674

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/286/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/286/console

Harbormaster returned this revision to the author for changes because remote builds failed.Dec 8 2022, 5:18 PM
Harbormaster failed remote builds in B33189: Diff 32234!

Improve and make the build pass

Build is green

Patch application report for D8929 (id=32245)

Rebasing onto 7bfdb3d102...

Current branch diff-target is up to date.
Changes applied before test
commit 036a0ebb79df2ba6ec07e0dcc8dc966dd937cb43
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 6 18:51:38 2022 +0100

    sysadm: Add a "how to process add-forge-now requests"
    
    Related to https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4674

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/287/ for more details.

vsellier added a subscriber: vsellier.
  • Is it possible to also list this query I often use to check the status of the ingestion:

for example:
select last_visit_status, count(ovs.url) from origin_visit_stats ovs join listed_origins lo on lo.url = ovs.url and lo.visit_type = ovs.visit_type where lister_id='8d1ebad5-a2dc-482c-9b9b-188665274377' group by last_visit_status;

  • 2 remarks inline

otherwise it's ok, thanks for documenting this.

sysadm/deployment/howto-process-add-forge-now-requests.rst
113
122
This revision is now accepted and ready to land.Dec 9 2022, 5:37 PM

Build is green

Patch application report for D8929 (id=32253)

Rebasing onto b9c5018cfb...

Current branch diff-target is up to date.
Changes applied before test
commit 4c328c6e071a55acda4f6caf6f911cfc033c6ac8
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 6 18:51:38 2022 +0100

    sysadm: Add a "how to process add-forge-now requests"
    
    Related to https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4674

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/289/ for more details.

Adapt according to suggestion and rework query and query sample presentation

ardumont marked 2 inline comments as done.
  • Is it possible to also list this query I often use to check the status of the ingestion:

for example:
select last_visit_status, count(ovs.url) from origin_visit_stats ovs join listed_origins lo on lo.url = ovs.url and lo.visit_type = ovs.visit_type where lister_id='8d1ebad5-a2dc-482c-9b9b-188665274377' group by last_visit_status;

I've referenced it too, thx.

  • 2 remarks inline

adapted, thx.

Build is green

Patch application report for D8929 (id=32254)

Rebasing onto b9c5018cfb...

Current branch diff-target is up to date.
Changes applied before test
commit 5f680386c8e9cf172ce367002fbdd401a47c9026
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Tue Dec 6 18:51:38 2022 +0100

    sysadm: Add a "how to process add-forge-now requests"
    
    Related to https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4674

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/290/ for more details.