Page MenuHomeSoftware Heritage
Differential D7538

staging: Deploy maven lister
ClosedPublic
Actions

Authored by ardumont on Apr 8 2022, 2:57 PM.

Details

Reviewers
vsellier
Group Reviewers
System administrators
Maniphest Tasks
T3746: staging: Deploy maven indexer/lister/loader
Commits
rSPSITE7d4baa0d33b8: staging: Deploy maven lister
Summary

Related to T3746

Test Plan

octo-diff, expectedly on workers production this does nothing, it installs the new
lister instances on staging ones:

$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging worker03
...
*** Running octocatalog-diff on host worker03.softwareheritage.org
I, [2022-04-08T14:55:38.704903 #3092075]  INFO -- : Catalogs compiled for worker03.softwareheritage.org
I, [2022-04-08T14:55:39.088743 #3092075]  INFO -- : Diffs computed for worker03.softwareheritage.org
I, [2022-04-08T14:55:39.088778 #3092075]  INFO -- : No differences
*** End octocatalog-diff on worker03.softwareheritage.org
$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging worker0.internal.staging.swh.network
...
*** Running octocatalog-diff on host worker0.internal.staging.swh.network
I, [2022-04-08T14:55:53.083341 #3094095]  INFO -- : Catalogs compiled for worker0.internal.staging.swh.network
I, [2022-04-08T14:55:53.483571 #3094095]  INFO -- : Diffs computed for worker0.internal.staging.swh.network
diff origin/production/worker0.internal.staging.swh.network current/worker0.internal.staging.swh.network
*******************************************
  File[/etc/softwareheritage/lister.yml] =>
   parameters =>
     content =>
      @@ -35,4 +35,6 @@
         - swh.lister.sourceforge.tasks.FullSourceForgeLister
         - swh.lister.sourceforge.tasks.IncrementalSourceForgeLister
      +  - swh.lister.maven.tasks.FullMavenLister
      +  - swh.lister.maven.tasks.IncrementalMavenLister
       credentials:
         github:
*******************************************
*** End octocatalog-diff on worker0.internal.staging.swh.network

Diff Detail

Repository
rSPSITE puppet-swh-site
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

ardumont created this revision.Apr 8 2022, 2:57 PM
Herald added a reviewer: System administrators. · View Herald TranscriptApr 8 2022, 2:57 PM
ardumont requested review of this revision.Apr 8 2022, 2:57 PM
Harbormaster completed remote builds in B28267: Diff 27335.Apr 8 2022, 2:57 PM
ardumont mentioned this in T3746: staging: Deploy maven indexer/lister/loader.Apr 8 2022, 4:15 PM
vsellier added a subscriber: vsellier.Apr 8 2022, 4:47 PM
vsellier added inline comments.
data/deployments/staging/common.yaml
85

Does it need 2 queues?

ardumont added inline comments.Apr 8 2022, 4:52 PM
data/deployments/staging/common.yaml
85

No idea really.
There exists 2 tasks so i did like we always do in other listers (see sourceforge, launchpad, etc...).

vsellier accepted this revision.Apr 8 2022, 4:53 PM
vsellier added inline comments.
data/deployments/staging/common.yaml
85

ok, no idea either so let's go ;)

This revision is now accepted and ready to land.Apr 8 2022, 4:53 PM
ardumont added inline comments.Apr 8 2022, 4:55 PM
data/deployments/staging/common.yaml
85

Also as usual, i gather we'll schedule the full listing to regularly list fully (~3 months or so).
And the incremental listing will be daily.

Closed by commit rSPSITE7d4baa0d33b8: staging: Deploy maven lister (authored by ardumont). · Explain WhyApr 8 2022, 5:12 PM
This revision was automatically updated to reflect the committed changes.
ardumont added a commit: rSPSITE7d4baa0d33b8: staging: Deploy maven lister.

Revision Contents
Changeset List

PathSize
data/
deployments/
staging/
25 lines

Diff 27346

View Options

data/deployments/staging/common.yaml

Loading...
About · Developer information · Legal