Change Details

Plan, out of [1] diff: - [ ] scheduler-node (scheduler0.staging): stop the old journal client - [ ] Wait for all tasks to finish - [ ] Stop and remove celery workers and queues - [ ] D7928: Rework puppet manifest to drop old services + update indexer service (as journal client) - [x] ~~scheduler-nodes: Clean up old service~~ (previous diff ^ does it) - [ ] workers: Deploy new journal client service on workers [2] [1] D7899 [2] It can reuse either the group_id to avoid re-indexing, or use a new one to reindex everything (to solve old previous temporary failures we ever had)

Plan, out of [1] diff: - [X] scheduler0.staging, workers.staging: Stop puppet [2] - [X] scheduler0.staging: stop the old journal client [3] - [X] workers.staging: Wait for all tasks to finish - [X] Stop swh-worker@indexer_origin_intrinsic_metadata [4] - [X] D7928: Rework puppet manifest to drop old services + update indexer service (as journal client) - [X] ~~scheduler-nodes: Clean up old service~~ (previous diff ^ does it) - [X] Remove celery workers and queues (click-click on rabbitmq ui from scheduler0.staging [5]) - [X] pergamon: Deploy diff [6] - [X] scheduler0.staging: Apply puppet change (drop old journal client service) - [X] workers.staging: Upgrade python3-swh.indexer to v1.1.0 - [ ] workers.staging: Apply puppet change (drop old service, deploy new journal client service) [1] D7899 [2] ``` root@pergamon:~# clush -b -w scheduler0.internal.staging.swh.network -w @staging-workers 'puppet agent --disable "T4282: Migrate to origin intrinsic meta indexer as journal client"' ``` [3] ``` root@pergamon:~# clush -b -w scheduler0.internal.staging.swh.network systemctl stop swh-indexer-journal-client.service ``` [4] ``` root@pergamon:~# clush -b -w @staging-workers systemctl stop swh-worker@indexer_origin_intrinsic_metadata.service ``` [5] http://scheduler0.internal.staging.swh.network:15672/#/queues [6] ``` root@pergamon:~# /usr/local/bin/deploy.sh HEAD is now at eff3f30 Add snyk-stg-01 credentials Already up to date. HEAD is now at eff3f30 Add snyk-stg-01 credentials Already up to date. ``` [7] ``` root@scheduler0:~# puppet agent --enable; puppet agent --test ... # it passed nonetheless beyond me and applied the stuff ¯\_(ツ)_/¯ root@scheduler0:~# systemctl list-units | grep swh-indexer-journal-client.service root@scheduler0:~# # no longer present ^ vs saatchi ``` [8] prod (untouched for now) ``` root@saatchi:~# systemctl list-units | grep swh-indexer-journal-client.service swh-indexer-journal-client.service loaded active running Software Heritage Indexer Journal Client ``` [3] It can reuse either the group_id to avoid re-indexing, or use a new one to reindex everything (to solve old previous temporary failures we ever had)

Plan, out of [1] diff: - [ - [X] scheduler-node (scheduler00.staging, workers.staging): stop the old journal client: Stop puppet [2] - [ ] Wait for all tasks to finish- [X] scheduler0.staging: stop the old journal client [3] - [ ] Stop and remove celery workers and queues- [X] workers.staging: Wait for all tasks to finish - [ ] D7928: Re- [X] Stop swh-work puppet manifest to drop old services + update indexer service (as journal client)er@indexer_origin_intrinsic_metadata [4] - [x] ~~scheduler-nodes: Clean u- [X] D7928: Rework puppet manifest to drop old service~~ (previous diff ^ does its + update indexer service (as journal client) - [ ] workers: Deploy new journal client service on workers [2]X] ~~scheduler-nodes: Clean up old service~~ (previous diff ^ does it) - [X] Remove celery workers and queues (click-click on rabbitmq ui from scheduler0.staging [5]) - [X] pergamon: Deploy diff [6] - [X] scheduler0.staging: Apply puppet change (drop old journal client service) - [X] workers.staging: Upgrade python3-swh.indexer to v1.1.0 - [ ] workers.staging: Apply puppet change (drop old service, deploy new journal client service) [1] D7899 [22] ``` root@pergamon:~# clush -b -w scheduler0.internal.staging.swh.network -w @staging-workers 'puppet agent --disable "T4282: Migrate to origin intrinsic meta indexer as journal client"' ``` [3] ``` root@pergamon:~# clush -b -w scheduler0.internal.staging.swh.network systemctl stop swh-indexer-journal-client.service ``` [4] ``` root@pergamon:~# clush -b -w @staging-workers systemctl stop swh-worker@indexer_origin_intrinsic_metadata.service ``` [5] http://scheduler0.internal.staging.swh.network:15672/#/queues [6] ``` root@pergamon:~# /usr/local/bin/deploy.sh HEAD is now at eff3f30 Add snyk-stg-01 credentials Already up to date. HEAD is now at eff3f30 Add snyk-stg-01 credentials Already up to date. ``` [7] ``` root@scheduler0:~# puppet agent --enable; puppet agent --test ... # it passed nonetheless beyond me and applied the stuff ¯\_(ツ)_/¯ root@scheduler0:~# systemctl list-units | grep swh-indexer-journal-client.service root@scheduler0:~# # no longer present ^ vs saatchi ``` [8] prod (untouched for now) ``` root@saatchi:~# systemctl list-units | grep swh-indexer-journal-client.service swh-indexer-journal-client.service loaded active running Software Heritage Indexer Journal Client ``` [3] It can reuse either the group_id to avoid re-indexing, or use a new one to reindex everything (to solve old previous temporary failures we ever had)