Page MenuHomeSoftware Heritage

Move archive storage to a new server
ClosedPublic

Authored by vsellier on Wed, Nov 18, 9:32 PM.

Details

Test Plan

octocatalog diffs :

diff origin/production/moma.softwareheritage.org current/moma.softwareheritage.org
*******************************************
  File[/etc/softwareheritage/storage/storage.yml] =>
   parameters =>
     content =>
      @@ -94,5 +94,5 @@
                     cls: remote
                     args:
      -                url: http://uffizi.internal.softwareheritage.org:5003/
      +                url: http://saam.internal.softwareheritage.org:5003/
                   filters_conf:
                   - type: readonly
*******************************************
  File[/etc/softwareheritage/web/web.yml] =>
   parameters =>
     content =>
      @@ -10,5 +10,5 @@
       indexer_storage:
         cls: remote
      -  url: http://uffizi.internal.softwareheritage.org:5007/
      +  url: http://saam.internal.softwareheritage.org:5007/
       scheduler:
         cls: remote
*******************************************
diff origin/production/worker01.softwareheritage.org current/worker01.softwareheritage.org
*******************************************
  File[/etc/softwareheritage/checker_deposit.yml] =>
   parameters =>
     content =>
      @@ -3,5 +3,5 @@
         cls: remote
         args:
      -    url: http://uffizi.internal.softwareheritage.org:5002/
      +    url: http://saam.internal.softwareheritage.org:5002/
       extraction_dir: "/tmp/swh.checker.deposit/"
       celery:
*******************************************
  File[/etc/softwareheritage/lister.yml] =>
   parameters =>
     content =>
      @@ -3,5 +3,5 @@
         cls: remote
         args:
      -    url: http://uffizi.internal.softwareheritage.org:5002/
      +    url: http://saam.internal.softwareheritage.org:5002/
       scheduler:
         cls: remote
*******************************************
  File[/etc/softwareheritage/loader_archive.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_cran.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_debian.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_deposit.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       extraction_dir: "/tmp/swh.loader.deposit/"
*******************************************
  File[/etc/softwareheritage/loader_git.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       save_data: false
*******************************************
  File[/etc/softwareheritage/loader_mercurial.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       reduce_effort: false
*******************************************
  File[/etc/softwareheritage/loader_nixguix.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_npm.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_pypi.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_svn.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  Mount[/srv/softwareheritage/objects] =>
   parameters =>
     device =>
      - uffizi:/srv/softwareheritage/objects
      + saam:/srv/softwareheritage/objects
*******************************************
  Mount[/srv/storage/space] =>
   parameters =>
     device =>
      - uffizi:/srv/storage/space
      + saam:/srv/storage/space
*******************************************
*** End octocatalog-diff on worker01.softwareheritage.org

Diff Detail

Repository
rSPSITE puppet-swh-site
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

vsellier created this revision.Wed, Nov 18, 9:32 PM
olasd accepted this revision.Thu, Nov 19, 9:45 AM
olasd added a subscriber: olasd.

Looks fine to me except for the vagrant bit.

I'd like to have a deeper look at the udevadm settle issues with reboots before we go ahead and deploy this, though.

data/subnets/vagrant.yaml
80–81

that looks wrong; saatchi should probably keep its original IP

This revision is now accepted and ready to land.Thu, Nov 19, 9:45 AM
vsellier updated this revision to Diff 16014.Thu, Nov 19, 9:50 AM

fix misdirected removal

Looks fine to me except for the vagrant bit.

thanks, it's fixed

I'd like to have a deeper look at the udevadm settle issues with reboots before we go ahead and deploy this, though.

ok, I will wait for your go before landing it

olasd added a comment.Thu, Nov 19, 5:42 PM

@vsellier I believe that we're good to push this now.

This revision was automatically updated to reflect the committed changes.