Page MenuHomeSoftware Heritage

Lister: Simplify production deployment for listers
Closed, MigratedEdits Locked

Description

As of today each lister has its own db. This is mostly irrelevant as they use one table each (except for lister-debian).

This however is a pain in the neck to deploy.
In regards to db creation for example.

  • Stop lister/loader-debian services
  • Change this to merge all dbs into one (swh-lister)
  • Grant guest user read-only access
  • Unify the rights to the one user swh-lister (with write permission)

- [ ] Rename swh-lister to swhlister (and figure out why connection refuses to work with swhlister as user)

  • Keep swh-lister for now
  • Adapt puppet manifests accordingly
    • D1518: Adapt swh-lister's base code logic to deal with merged credentials
    • Adapt credentials to target the new merged db
    • D1519: Merge systemd service into 1
  • Deploy changes on production and start listers
    • worker01 -> happy
    • other workers
  • Start back loader-debian service
  • Drop old dbs (lister-github, lister-pypi, lister-npm, lister-gitlab, lister-bitbucket)
  • Update the db inventory doc

Event Timeline

ardumont triaged this task as Normal priority.May 28 2019, 1:53 PM
ardumont created this task.
ardumont changed the task status from Open to Work in Progress.May 28 2019, 2:59 PM
ardumont updated the task description. (Show Details)
ardumont updated the task description. (Show Details)
ardumont updated the task description. (Show Details)