Page MenuHomeSoftware Heritage

staging: Deploy maven lister
ClosedPublic

Authored by ardumont on Apr 8 2022, 2:57 PM.

Details

Summary

Related to T3746

Test Plan

octo-diff, expectedly on workers production this does nothing, it installs the new
lister instances on staging ones:

$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging worker03
...
*** Running octocatalog-diff on host worker03.softwareheritage.org
I, [2022-04-08T14:55:38.704903 #3092075]  INFO -- : Catalogs compiled for worker03.softwareheritage.org
I, [2022-04-08T14:55:39.088743 #3092075]  INFO -- : Diffs computed for worker03.softwareheritage.org
I, [2022-04-08T14:55:39.088778 #3092075]  INFO -- : No differences
*** End octocatalog-diff on worker03.softwareheritage.org
$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to staging worker0.internal.staging.swh.network
...
*** Running octocatalog-diff on host worker0.internal.staging.swh.network
I, [2022-04-08T14:55:53.083341 #3094095]  INFO -- : Catalogs compiled for worker0.internal.staging.swh.network
I, [2022-04-08T14:55:53.483571 #3094095]  INFO -- : Diffs computed for worker0.internal.staging.swh.network
diff origin/production/worker0.internal.staging.swh.network current/worker0.internal.staging.swh.network
*******************************************
  File[/etc/softwareheritage/lister.yml] =>
   parameters =>
     content =>
      @@ -35,4 +35,6 @@
         - swh.lister.sourceforge.tasks.FullSourceForgeLister
         - swh.lister.sourceforge.tasks.IncrementalSourceForgeLister
      +  - swh.lister.maven.tasks.FullMavenLister
      +  - swh.lister.maven.tasks.IncrementalMavenLister
       credentials:
         github:
*******************************************
*** End octocatalog-diff on worker0.internal.staging.swh.network

Diff Detail

Repository
rSPSITE puppet-swh-site
Branch
staging
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 28267
Build 44253: arc lint + arc unit

Event Timeline

vsellier added inline comments.
data/deployments/staging/common.yaml
86

Does it need 2 queues?

data/deployments/staging/common.yaml
86

No idea really.
There exists 2 tasks so i did like we always do in other listers (see sourceforge, launchpad, etc...).

vsellier added inline comments.
data/deployments/staging/common.yaml
86

ok, no idea either so let's go ;)

This revision is now accepted and ready to land.Apr 8 2022, 4:53 PM
data/deployments/staging/common.yaml
86

Also as usual, i gather we'll schedule the full listing to regularly list fully (~3 months or so).
And the incremental listing will be daily.

This revision was automatically updated to reflect the committed changes.