Page MenuHomeSoftware Heritage
Create Task
Maniphest T944

Separate indexer db to its own postgresql cluster
Closed, MigratedEdits Locked
Actions

Description

Move indexer db to its own cluster.

Unfortunately, when separated from the storage db, it has been moved to the replica cluster (T867).
As the replication tool backups the cluster fully, that would mean yet another replication of the replica db which is a nogo (due to disk space!).

That will ease its backup (T880).

Related Objects
Search...

Event Timeline

ardumont created this task.Feb 1 2018, 12:14 PM
ardumont added a parent task: T880: Add softwareheritage-indexer backup.
ardumont added a comment.Feb 6 2018, 11:51 AM

After discussion, the new cluster can stay on somerset.

ardumont claimed this task.Feb 7 2018, 9:18 AM
ardumont changed the task status from Open to Work in Progress.Feb 7 2018, 12:17 PM
ardumont renamed this task from Separate indexer db to its own cluster to Separate indexer db to its own postgresql cluster.Feb 7 2018, 12:24 PM
ardumont added a comment.EditedFeb 7 2018, 1:42 PM

Road so far:

  • somerset - Create cluster
  • somerset - Create needed roles (swhstorage, guest)
  • somerset - Create db
  • swh-workers - Stop indexers
  • Update swh-site/swh-private-data accordingly ( (local swh-site + swh-private-data commits done)
  • somerset - Migrate old db data to the new one
  • Check data consistency between dbs (content_mimetype, fossology_license, etc...)
  • Deploy changes to relevant machines: indexer storage server (uffizi)
  • swh-workers - Restart indexers
  • Ensure everything is fine regarding indexer restart (db)
  • somerset - Drop old softwareheritage-indexer db on cluster 5433 (reclaim space)
ardumont mentioned this in rSPSITE04ddebf3af1b: data/defaults: Migrate indexer storage's db to the new db.Feb 7 2018, 4:55 PM
ardumont closed this task as Resolved.Feb 7 2018, 7:28 PM
gitlab-migration changed the task status from Resolved to Migrated.Oct 19 2022, 5:53 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal