Plan:
- [X] D7641: Unstuck master build
- [X] Tag v2.5
- [X] ~~Unstuck debian build if needed~~
staging:
- [X] Stop workers [1]
- [X] Upgrade storage node (saamstorage1.staging)'s swh.core
- [ - [X] Upgrade storage node's swh.storage v1.3.2 while at it
- [ - [X] Restart gunicorn-swh-storage, gunicorn-swh-objstorage
- [ - [X] T4189: Upgrade and restarloader dependencies, reboot workers and activate back puppet [2]
- [ - [X] Upgrade indexer node (saamtorage1.staging)'s swh.core
- [ - [X] Restart gunicorn-swh-indexer-storage
- [ - [X] Upgrade scheduler node (saatchicheduler0.staging)'s swh.core
- [ - [X] Restart gunicorn-swh-scheduler
- [ - [X] Upgrade archive node (moma, webapp1webapp.staging)'s swh.core
- [ - [X] Restart gunicorn-swh-webapp, gunicorn-swh-search, gunicorn-swh-storage
- [ - [X] Upgrade deposit node (momadeposit.staging)'s swh.core
- [ - [X] Restart gunicorn-swh-deposit
- [ - [X] Upgrade indexervault node (saamvault.staging)'s swh.core
- [ - [X] Restart gunicorn-swh-indexer-storagevault
- [ - [X] Upgrade vaultcounters node (vangoghcounters0.staging)'s swh.core
- [ - [X] Restart gunicorn-swh-vaultcounters
prod:
- [X] Stop workers [1]
- [X] Upgrade storage node (storage1.staging)saam)'s swh.core
- [X] Upgrade storage node's swh.corestorage v1.3.2 while at it
- [ ] Upgrade storage node's swh.- [X] Restart gunicorn-swh-storage v1.3.2 while at it, gunicorn-swh-objstorage
- [ ] Restart gunicorn-swh-storage- [X] T4189: Upgrade loader dependencies, gunicorn-swh-objstoragereboot workers and activate back puppet
- [ ] T4189:- [X] Upgrade and restart workersindexer node (saam)'s swh.core
- [ ] Upgrade indexer node (storage1.staging)'s swh.core- [X] Restart gunicorn-swh-indexer-storage
- [ ] Restart gunicorn-swh-indexer-storage- [X] Upgrade scheduler node (saatchi)'s swh.core
- [ ] Upgrade scheduler node (- [X] Restart gunicorn-swh-scheduler0.staging)'s swh.corer
- [ ] Restart gunicorn-swh-scheduler- [X] Upgrade archive node (moma, webapp1)'s swh.core
- [ ] Upgrade archive node (- [X] Restart gunicorn-swh-webapp.staging)'s swh.core gunicorn-swh-search gunicorn-swh-storage
- [ ] Restart gunicorn-swh-indexer-storage gunicorn-swh-webappobjstorage
- [ - [X] Upgrade deposit node (deposit.stagingmoma)'s swh.core
- [ - [X] Restart gunicorn-swh-deposit
- [ - [X] Upgrade vault node (vault.stagingngogh)'s swh.core
- [ - [X] Restart gunicorn-swh-vaultt
- [X] Upgrade counters node (counters1)'s swh.core
- [X] Restart gunicorn-swh-counters
[1]
```
# staging:
WORKERS=-w @staging-workers
# prod
# WORKERS=-w @swh-workers -w @swh-workers-large
clush -b $WORKERS 'puppet agent --disable "Deploy new swh.core version"; systemctl stop cron; cd /etc/systemd/system/multi-user.target.wants; for unit in swh-worker@*; do systemctl disable $unit; done; systemctl stop "swh-worker@*"'
```
[2]
```
# since most services are stopped
$ clush -b $WORKERS \
"DEBIAN_FRONTEND=noninteractive apt-get update && apt-get upgrade -y && reboot"
# once all booted
$ clush -b $WORKERS 'uptime'
# activate back everything
$ clush -b $WORKERS \
'puppet agent --enable; puppet agent --test; systemctl default'
```