This wil need to move migration scripts to swh/<mod>/sql/upgrades and have a wrapper script in swh.core.db that:
- check the current dbversion;
- check the latest dbversion;
- run the migrations in between
Description
Description
Revisions and Commits
Revisions and Commits
| rDSCH Scheduling utilities | |||
| D7165 | rDSCH5cc62be1a405 Adapt to swh.core 2.0.0 | ||
| rDCIDX Metadata indexer | |||
| D7164 | rDCIDX9e89b83be455 Adapt to swh.core 2.0.0 | ||
| rDSTO Storage manager | |||
| D7160 | rDSTO215162b2c129 Update for swh.core 2.0.0 | ||
| D7160 | rDSTO386fb4d61f19 Add types-toml to requirements-test.txt | ||
| rDVAU Software Heritage Vault | |||
| D7162 | rDVAUe4c9935c1488 Adapt to swh-core 2.0.0 | ||
| rDCORE Foundations and core functionalities | |||
| D7064 | rDCORE16e2fd4992ef Add a 'swh db upgrade' command | ||
| D7063 | rDCORE7e07b1f36326 Make 'swh db init' fill the dbversion table | ||
| D7062 | rDCOREc4bd270c3000 Add support for dbversion and dbmodule handling in swh db init | ||
| D7061 | rDCORE3e43730df615 Make `swh db init` retrieve the db cnx uri from the config file | ||
| D7060 | rDCORE459da96c1e6b Move utility functions from cli.db to db.db_utils | ||
| D7060 | rDCORE932eed4863ba Remove the old and unused log-schema.sql file | ||
Event Timeline
Comment Actions
The problem with step 2. is that we do not have an API to declare the latest version, something that should come with swh.core.db is suppose.
Comment Actions
To help a bit, here is the plan:
- add helper tools in swh.core.db based datastores so that (postgresql) db version and migrations can be managed in swh.core directly:
- make all swh datastore packages provide a get_datastore factory function in the top level namespace; this is typically just an alias for get_storage, get_scheduler, etc.
- make datastore objects (the object instanciated by the get_datastore factory function) provide a get_current_version() method
- move migration sql scripts in the package (along with the initialization sal scripts).
then we should have everything we need to make swh.core.db able to manage the db versionning:
- make 'swh db init' create the dbversion table (as well as a new dbmodule table to store the actual swh package behind this database),
- add a `swh db upgrade' executing the migration scripts from "current db version' to "current datastore code version"