Page MenuHomeSoftware Heritage

Clean up nodes, databases, manifests
Closed, ResolvedPublic

Description

Once the migration is done and no regression is detected [1], clean up the leftovers:

  • databases (belvedere, bardo, ...)
  • puppet manifests with no longer required db instructions...
  • intermediary dumps used to shuffle data around

Some of those may already be done.
Just make sure the rest is cleaned up as well.

[1] T3833

Event Timeline

ardumont triaged this task as Normal priority.Fri, Jan 14, 4:57 PM
ardumont created this task.
ardumont updated the task description. (Show Details)
ardumont changed the task status from Open to Work in Progress.Thu, Jan 20, 4:14 PM
ardumont moved this task from Backlog to in-progress on the System administration board.

bardo:

  • clean up postgresql server package [already done]
  • clean up /var/lib/postgresql/
  • keep postgresql-client-14 package installed
  • hedgedoc puppet manifest cleanup [already done]

belvedere:

  • stop prometheus-sql-exporter
  • for db in {sentry, keycloak}
    • drop database $db
    • drop role $db
  • start prometheus-sql-exporter
  • nothing to do in regards to puppet manifest [already done]

Clean up intermediary dumps:

  • belvedere:
root@belvedere:/srv/softwareheritage/postgres# du -sh *
...
35G     2022-01-14T14:18:48Z-sentry.sql.gz
265K    2022-01-17T14:17:50Z-keycloak.sql.gz
265K    keycloak-20220117.sql.gz
...
root@belvedere:/srv/softwareheritage/postgres# rm -vi *.gz
rm: remove regular file '2022-01-14T14:18:48Z-sentry.sql.gz'? y
removed '2022-01-14T14:18:48Z-sentry.sql.gz'
rm: remove regular file '2022-01-17T14:17:50Z-keycloak.sql.gz'? y
removed '2022-01-17T14:17:50Z-keycloak.sql.gz'
rm: remove regular file 'keycloak-20220117.sql.gz'? y
removed 'keycloak-20220117.sql.gz'
  • bardo:
root@bardo:~# ls -lah *.gz
-rw-r--r-- 1 root root 5.8M Jan 13 16:34 2022-01-13T16:33:57Z-hedgedoc.sql.gz
root@bardo:~# rm -i *.gz
rm: remove regular file '2022-01-13T16:33:57Z-hedgedoc.sql.gz'? y
  • bojimans:
root@bojimans:~# ls -lah *.gz
-rw-r--r-- 1 root root 94K Jan 13 15:11 2022-01-13T15:07:30Z-netbox.sql.gz
root@bojimans:~# rm -i *.gz
rm: remove regular file '2022-01-13T15:07:30Z-netbox.sql.gz'? y
  • dali:
root@dali:~# ls -lah *.gz
-rw-r--r-- 1 root root  94K Jan 13 15:14 2022-01-13T15:07:30Z-netbox.sql.gz
-rw-r--r-- 1 root root 5.8M Jan 13 15:18 2022-01-13T15:16:54Z-hedgedoc.sql.gz
-rw-r--r-- 1 root root 5.8M Jan 13 16:34 2022-01-13T16:33:57Z-hedgedoc.sql.gz
-rw-r--r-- 1 root root 1.2M Jan 14 11:14 2022-01-14T11:13:57Z-grafana.sql.gz
root@dali:~# rm -i *.gz
rm: remove regular file '2022-01-13T15:07:30Z-netbox.sql.gz'? y
rm: remove regular file '2022-01-13T15:16:54Z-hedgedoc.sql.gz'? y
rm: remove regular file '2022-01-13T16:33:57Z-hedgedoc.sql.gz'? y
rm: remove regular file '2022-01-14T11:13:57Z-grafana.sql.gz'? y
root@dali:~# ls -lah /srv/postgresql/14/main/*.gz
-rw-r--r-- 1 root root  35G Jan 14 14:54 /srv/postgresql/14/main/2022-01-14T14:18:48Z-sentry.sql.gz
-rw-r--r-- 1 root root 130K Jan 17 14:22 /srv/postgresql/14/main/2022-01-17T14:17:50Z-keycloak.sql.gz
-rw-r--r-- 1 root root 130K Jan 17 16:17 /srv/postgresql/14/main/keycloak-20220117.sql.gz
root@dali:~# rm -i /srv/postgresql/14/main/*.gz
rm: remove regular file '/srv/postgresql/14/main/2022-01-14T14:18:48Z-sentry.sql.gz'? y
rm: remove regular file '/srv/postgresql/14/main/2022-01-17T14:17:50Z-keycloak.sql.gz'? y
rm: remove regular file '/srv/postgresql/14/main/keycloak-20220117.sql.gz'? y
ardumont claimed this task.
ardumont updated the task description. (Show Details)
ardumont moved this task from deployed/landed/monitoring to done on the System administration board.