Page MenuHomeSoftware Heritage
Differential D4516

Move archive storage to a new server
ClosedPublic
Actions

Authored by vsellier on Nov 18 2020, 9:32 PM.

Details

Reviewers
olasd
Group Reviewers
System administrators
Maniphest Tasks
T2796: 2020-11-18 Datacenter operations in Rocquencourt
Commits
rSPSITE2830795f6f7a: Move archive storage to a new server
Test Plan

octocatalog diffs :

diff origin/production/moma.softwareheritage.org current/moma.softwareheritage.org
*******************************************
  File[/etc/softwareheritage/storage/storage.yml] =>
   parameters =>
     content =>
      @@ -94,5 +94,5 @@
                     cls: remote
                     args:
      -                url: http://uffizi.internal.softwareheritage.org:5003/
      +                url: http://saam.internal.softwareheritage.org:5003/
                   filters_conf:
                   - type: readonly
*******************************************
  File[/etc/softwareheritage/web/web.yml] =>
   parameters =>
     content =>
      @@ -10,5 +10,5 @@
       indexer_storage:
         cls: remote
      -  url: http://uffizi.internal.softwareheritage.org:5007/
      +  url: http://saam.internal.softwareheritage.org:5007/
       scheduler:
         cls: remote
*******************************************
diff origin/production/worker01.softwareheritage.org current/worker01.softwareheritage.org
*******************************************
  File[/etc/softwareheritage/checker_deposit.yml] =>
   parameters =>
     content =>
      @@ -3,5 +3,5 @@
         cls: remote
         args:
      -    url: http://uffizi.internal.softwareheritage.org:5002/
      +    url: http://saam.internal.softwareheritage.org:5002/
       extraction_dir: "/tmp/swh.checker.deposit/"
       celery:
*******************************************
  File[/etc/softwareheritage/lister.yml] =>
   parameters =>
     content =>
      @@ -3,5 +3,5 @@
         cls: remote
         args:
      -    url: http://uffizi.internal.softwareheritage.org:5002/
      +    url: http://saam.internal.softwareheritage.org:5002/
       scheduler:
         cls: remote
*******************************************
  File[/etc/softwareheritage/loader_archive.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_cran.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_debian.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_deposit.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       extraction_dir: "/tmp/swh.loader.deposit/"
*******************************************
  File[/etc/softwareheritage/loader_git.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       save_data: false
*******************************************
  File[/etc/softwareheritage/loader_mercurial.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       reduce_effort: false
*******************************************
  File[/etc/softwareheritage/loader_nixguix.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_npm.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_pypi.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  File[/etc/softwareheritage/loader_svn.yml] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
         - cls: remote
           args:
      -      url: http://uffizi.internal.softwareheritage.org:5002/
      +      url: http://saam.internal.softwareheritage.org:5002/
       max_content_size: 104857600
       celery:
*******************************************
  Mount[/srv/softwareheritage/objects] =>
   parameters =>
     device =>
      - uffizi:/srv/softwareheritage/objects
      + saam:/srv/softwareheritage/objects
*******************************************
  Mount[/srv/storage/space] =>
   parameters =>
     device =>
      - uffizi:/srv/storage/space
      + saam:/srv/storage/space
*******************************************
*** End octocatalog-diff on worker01.softwareheritage.org

Diff Detail

Repository
rSPSITE puppet-swh-site
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

vsellier created this revision.Nov 18 2020, 9:32 PM
Harbormaster completed remote builds in B17217: Diff 16010.Nov 18 2020, 9:32 PM
olasd accepted this revision.Nov 19 2020, 9:45 AM
olasd added a subscriber: olasd.

Looks fine to me except for the vagrant bit.

I'd like to have a deeper look at the udevadm settle issues with reboots before we go ahead and deploy this, though.

data/subnets/vagrant.yaml
80–81

that looks wrong; saatchi should probably keep its original IP

This revision is now accepted and ready to land.Nov 19 2020, 9:45 AM
vsellier updated this revision to Diff 16014.Nov 19 2020, 9:50 AM

fix misdirected removal

Harbormaster completed remote builds in B17221: Diff 16014.Nov 19 2020, 9:50 AM
vsellier added a comment.Nov 19 2020, 9:52 AM

Looks fine to me except for the vagrant bit.

thanks, it's fixed

I'd like to have a deeper look at the udevadm settle issues with reboots before we go ahead and deploy this, though.

ok, I will wait for your go before landing it

olasd added a task: T2796: 2020-11-18 Datacenter operations in Rocquencourt.Nov 19 2020, 3:26 PM
olasd mentioned this in T2796: 2020-11-18 Datacenter operations in Rocquencourt.Nov 19 2020, 3:30 PM
olasd added a comment.Nov 19 2020, 5:42 PM

@vsellier I believe that we're good to push this now.

vsellier updated this revision to Diff 16078.Nov 20 2020, 9:21 AM

rebase

Harbormaster completed remote builds in B17280: Diff 16078.Nov 20 2020, 9:21 AM
vsellier updated this revision to Diff 16079.Nov 20 2020, 9:24 AM

rebase

Harbormaster completed remote builds in B17281: Diff 16079.Nov 20 2020, 9:24 AM
Closed by commit rSPSITE2830795f6f7a: Move archive storage to a new server (authored by vsellier). · Explain WhyNov 20 2020, 9:24 AM
This revision was automatically updated to reflect the committed changes.
vsellier added a commit: rSPSITE2830795f6f7a: Move archive storage to a new server.

Revision Contents
Changeset List

PathSize
data/
common/
40 lines
deployments/
production/
2 lines
subnets/
4 lines
manifests/
2 lines

Diff 16080

View Options

data/common/common.yaml

Loading...
View Options

data/deployments/production/azure_euwest.yaml

Loading...
View Options

data/subnets/vagrant.yaml

Loading...
View Options

manifests/site.pp

Loading...
About · Developer information · Legal