Page MenuHomeSoftware Heritage

Deploy swh-worker@loader_bzr service to staging workers
ClosedPublic

Authored by ardumont on Feb 7 2022, 6:13 PM.

Details

Summary
  • deploy new loader
  • sentry configured as well

Related to T3915

Test Plan
  • staging worker:
    • config update adding the loader bazaar task to high priority worker
    • new swh-worker@loader_bzr deployed
  • No impact on production worker

As octo-diff:

$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff worker0.internal.staging.swh.network
...
*******************************************
+ Concat_fragment[profile::cron::swh-worker-loader_bzr-autorestart] =>
   parameters =>
     "content": "# Cron snippet swh-worker-loader_bzr-autorestart\n7-52/15 * * * ...
     "order": "10",
     "tag": "profile::cron::swh-worker",
     "target": "profile::cron::swh-worker"
*******************************************
+ File[/etc/softwareheritage/loader_bzr.yml] =>
   parameters =>
     "content": "---\nstorage:\n  cls: pipeline\n  steps:\n  - cls: buffer\n    m...
     "ensure": "present",
     "group": "swhworker",
     "mode": "0640",
     "owner": "swhworker"
*******************************************
  File[/etc/softwareheritage/loader_high_priority.yml] =>
   parameters =>
     content =>
      @@ -25,4 +25,5 @@
         task_broker: amqp://swhconsumer:swh-deploy-worker-task_broker-password@scheduler0.internal.staging.swh.network:5672/%2f
         task_queues:
      +  - save_code_now:swh.loader.bzr.tasks.LoadBazaar
         - save_code_now:swh.loader.git.tasks.UpdateGitRepository
         - save_code_now:swh.loader.mercurial.tasks.LoadMercurial
*******************************************
+ File[/etc/systemd/system/swh-worker@loader_bzr.service.d/parameters.conf] =>
   parameters =>
     "content": "# Managed by puppet - modifications will be overwritten\n# In de...
     "ensure": "file",
     "group": "root",
     "mode": "0444",
     "notify": [
       "Class[Systemd::Systemctl::Daemon_reload]"
     ],
     "owner": "root",
     "selinux_ignore_defaults": false,
     "show_diff": true
*******************************************
+ File[/etc/systemd/system/swh-worker@loader_bzr.service.d] =>
   parameters =>
     "ensure": "directory",
     "group": "root",
     "owner": "root",
     "purge": true,
     "recurse": true,
     "selinux_ignore_defaults": false
*******************************************
+ Package[python3-swh.loader.bzr] =>
   parameters =>
     "ensure": "present"
*******************************************
+ Profile::Cron::D[swh-worker-loader_bzr-autorestart] =>
   parameters =>
     "command": "chronic /usr/local/sbin/swh-worker-ping-restart loader_bzr@worke...
     "minute": "fqdn_rand/15",
     "target": "swh-worker",
     "unique_tag": "swh-worker-loader_bzr-autorestart",
     "user": "root"
*******************************************
+ Profile::Swh::Deploy::Worker::Instance[loader_bzr] =>
   parameters =>
     "ensure": "present",
     "instance_name": "loader_bzr",
     "merge_policy": "deep",
     "private_tmp": true,
     "send_task_events": false,
     "sentry_name": "loader_bzr"
*******************************************
+ Service[swh-worker@loader_bzr] =>
   parameters =>
     "enable": true
*******************************************
+ Systemd::Dropin_file[swh-worker@loader_bzr/parameters.conf] =>
   parameters =>
     "content": "# Managed by puppet - modifications will be overwritten\n# In de...
     "daemon_reload": "lazy",
     "ensure": "present",
     "filename": "parameters.conf",
     "group": "root",
     "mode": "0444",
     "owner": "root",
     "path": "/etc/systemd/system",
     "selinux_ignore_defaults": false,
     "show_diff": true,
     "unit": "swh-worker@loader_bzr.service"
*******************************************
*** End octocatalog-diff on worker0.internal.staging.swh.network

$ $SWH_PUPPET_ENVIRONMENT_HOME/bin/octocatalog-diff worker01
...
I, [2022-02-08T11:15:50.873420 #182264]  INFO -- : Catalogs compiled for worker01.softwareheritage.org
I, [2022-02-08T11:15:51.182514 #182264]  INFO -- : Diffs computed for worker01.softwareheritage.org
I, [2022-02-08T11:15:51.182547 #182264]  INFO -- : No differences
*** End octocatalog-diff on worker01.softwareheritage.org

Diff Detail

Repository
rSPSITE puppet-swh-site
Branch
staging
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 26620
Build 41629: arc lint + arc unit

Event Timeline

  • Add load bazaar task to the high priority loader as well
  • Update task name according to development
This revision is now accepted and ready to land.Feb 8 2022, 2:16 PM
ardumont edited the test plan for this revision. (Show Details)

Rebase