Add npm lister configuration
ClosedPublic
Actions

Authored by anlambert on Apr 11 2019, 10:47 AM.

Details

Reviewers

ardumont

Group Reviewers

Reviewers

Commits

rSPSITE293f12bd030f: Add npm lister configuration

Summary

Related T1632

Diff Detail

Repository

rSPSITE puppet-swh-site

Lint

Automatic diff as part of commit; lint not applicable.

Unit

Automatic diff as part of commit; unit tests not applicable.

Event Timeline

anlambert created this revision.Apr 11 2019, 10:47 AM

Herald added a reviewer: Reviewers. · View Herald TranscriptApr 11 2019, 10:47 AM

Harbormaster completed remote builds in B5322: Diff 4515.Apr 11 2019, 10:47 AM

Ok it works when finalizing it.

We need to add the lister-npm to the list of workers to deploy, /swh-site/data/location/sesi_rocquencourt.yml.

Then we are good.

This revision is now accepted and ready to land.Apr 11 2019, 10:54 AM

I did the following as requisite:

$ cd $PUPPET_SWH_ENVIRONMENT/swh-site
$ git pull 
$ arc patch D1302
$ gcob update_worker_configuration
$ gco production
$ cd $PUPPET_SWH_ENVIRONMENT

It did not work, well, it did but displayed nothing as we did not really ask to deploy the lister-npm anywwhere.
So, got back to swh-site, edited the file mentioned to add the lister npm and commit.

Then:

$ bin/octocatalog-diff --octocatalog-diff-args --no-truncate-details --to update_worker_configuration worker01
Found host worker01.softwareheritage.org
Cloning into '/tmp/swh-ocd.0DQBOt1B/environments/production/data/private'...
done.
Cloning into '/tmp/swh-ocd.0DQBOt1B/environments/update_worker_configuration/data/private'...
done.
*** Running octocatalog-diff on host worker01.softwareheritage.org
I, [2019-04-11T10:52:27.336573 #21146]  INFO -- : Catalogs compiled for worker01.softwareheritage.org
I, [2019-04-11T10:52:28.129215 #21146]  INFO -- : Diffs computed for worker01.softwareheritage.org
diff origin/production/worker01.softwareheritage.org current/worker01.softwareheritage.org
*******************************************
+ File[/etc/softwareheritage/lister_npm.yml] =>
   parameters =>
      "ensure": "present"
      "group": "swhworker"
      "mode": "0644"
      "owner": "swhworker"
      "content": >>>
---
storage:
  cls: remote
  args:
    url: http://uffizi.internal.softwareheritage.org:5002/
scheduler:
  cls: remote
  args:
    url: http://saatchi.internal.softwareheritage.org:5008/
lister:
  cls: local
  args:
    db: postgresql://lister-npm:@db/lister-npm
celery:
  task_broker: amqp://swhconsumer:swh::deploy::worker::task_broker::password@rabbitmq:5672//
  task_modules:
  - swh.lister.npm.tasks
  task_queues:
  - swh.lister.npm.tasks.NpmListerTask
<<<
*******************************************
+ File[/etc/systemd/system/swh-worker@lister_npm.service.d/parameters.conf] =>
   parameters =>
      "ensure": "file"
      "group": "root"
      "mode": "0444"
      "notify": "Class[Systemd::Systemctl::Daemon_reload]"
      "owner": "root"
      "content": >>>
# Managed by puppet - modifications will be overwritten
# In defined class profile::swh::deploy::worker::instance

[Service]
Environment=CONCURRENCY=1
Environment=MAX_TASKS_PER_CHILD=5
Environment=LOGLEVEL=warning
<<<
*******************************************
+ File[/etc/systemd/system/swh-worker@lister_npm.service.d] =>
   parameters =>
      "ensure": "directory"
      "group": "root"
      "owner": "root"
*******************************************
+ Profile::Swh::Deploy::Worker::Instance[lister_npm] =>
   parameters =>
      "ensure": "present"
      "instance_name": "lister_npm"
      "max_tasks_per_child": 5
*******************************************
+ Service[swh-worker@lister_npm] =>
   parameters =>
      "enable": true
*******************************************
+ Systemd::Dropin_file[swh-worker@lister_npm/parameters.conf] =>
   parameters =>
      "ensure": "present"
      "filename": "parameters.conf"
      "path": "/etc/systemd/system"
      "unit": "swh-worker@lister_npm.service"
      "content": >>>
# Managed by puppet - modifications will be overwritten
# In defined class profile::swh::deploy::worker::instance

[Service]
Environment=CONCURRENCY=1
Environment=MAX_TASKS_PER_CHILD=5
Environment=LOGLEVEL=warning
<<<
*******************************************
*** End octocatalog-diff on worker01.softwareheritage.org