Paths

Table of Contentst

Diffusion Storage manager 215162b2c129

Update for swh.core 2.0.0
215162b2c129
Actions

Tags

None

Subscribers

None

Description

Update for swh.core 2.0.0

Add expected entry points for swh.core 2 db handling new features:
- add a `swh.storge.get_datastore()` function
- add `swh.storage.postgreql.storage.Storage.get_current_version()` method
- move sql migration scripts in `swh/storage/sql/upgrades`
- modify sql initialization scripts to match swh.core 2 (remove dbversion management code).

Update tests to use the new template-based database handling; this should have only minimal impact on test execution performances.

Details

Provenance

douardda	Authored on Feb 2 2022, 3:56 PM
douardda	Pushed on Feb 24 2022, 11:14 AM

Differential Revision

D7160: Update storage for swh.core 2.0.0

Parents

rDSTO386fb4d61f19: Add types-toml to requirements-test.txt

Branches

Unknown

Tags

Unknown

References

Tasks

T3894: Add a 'swh db upgrade' cli

Build Status

Buildable 27111
Build 42399: test-and-build	Jenkins console · Jenkins

Event Timeline

douardda committed rDSTO215162b2c129: Update for swh.core 2.0.0 (authored by douardda).Feb 24 2022, 11:05 AM

douardda added a task: T3894: Add a 'swh db upgrade' cli.Feb 24 2022, 11:14 AM

douardda added an edge: D7160: Update storage for swh.core 2.0.0.

Harbormaster completed building B27111: rDSTO215162b2c129: Update for swh.core 2.0.0.Feb 24 2022, 11:25 AM

swh-public-ci mentioned this in D7276: Move metrics handling from backends to RPC server.Mar 2 2022, 12:19 PM

Changes (341)
Show All Changes

Very Large Commit

This commit is very large. Load each file individually.

Path

Size

requirements-swh.txt

sql/

upgrades/

swh/

storage/

postgresql/

pytest_plugin.py

sql/

	swh/	storage/	sql/	upgrades/
			sql/	upgrades/

rDSTO215162b2c129

requirements-swh.txt

sql/upgrades/015.sql

sql/upgrades/016.sql

sql/upgrades/017.sql

sql/upgrades/018.sql

sql/upgrades/019.sql

sql/upgrades/020.sql

sql/upgrades/021.sql

sql/upgrades/022.sql

sql/upgrades/023.sql

sql/upgrades/024.sql

sql/upgrades/025.sql

sql/upgrades/026.sql

sql/upgrades/027.sql

sql/upgrades/028.sql

sql/upgrades/029.sql

sql/upgrades/030.sql

sql/upgrades/032.sql

sql/upgrades/033.sql

sql/upgrades/034.sql

sql/upgrades/035.sql

sql/upgrades/036.sql

sql/upgrades/037.sql

sql/upgrades/038.sql

sql/upgrades/039.sql

sql/upgrades/040.sql

sql/upgrades/041.sql

sql/upgrades/042.sql

sql/upgrades/043.sql

sql/upgrades/044.sql

sql/upgrades/045.sql

sql/upgrades/046.sql

sql/upgrades/047.sql

sql/upgrades/048.sql

sql/upgrades/049.sql

sql/upgrades/050.sql

sql/upgrades/051.sql

sql/upgrades/052.sql

sql/upgrades/053.sql

sql/upgrades/054.sql

sql/upgrades/055.sql

sql/upgrades/056.sql

sql/upgrades/057.sql

sql/upgrades/058.sql

sql/upgrades/059.sql

sql/upgrades/060.sql

sql/upgrades/061.sql

sql/upgrades/062.sql

sql/upgrades/063.sql

sql/upgrades/064.sql

sql/upgrades/065.sql

sql/upgrades/066.sql

sql/upgrades/067.sql

sql/upgrades/068.sql

sql/upgrades/069.sql

sql/upgrades/070.sql

sql/upgrades/071.sql

sql/upgrades/072.sql

sql/upgrades/073.sql

sql/upgrades/074.sql

sql/upgrades/075.sql

sql/upgrades/076.sql

sql/upgrades/077.sql

sql/upgrades/078.sql

sql/upgrades/079.sql

sql/upgrades/080.sql

sql/upgrades/081.sql

sql/upgrades/082.sql

sql/upgrades/083.sql

sql/upgrades/084.sql

sql/upgrades/085.sql

sql/upgrades/086.sql

sql/upgrades/087.sql

sql/upgrades/088.sql

sql/upgrades/089.sql

sql/upgrades/090.sql

sql/upgrades/091.sql

sql/upgrades/092.sql

sql/upgrades/093.sql

sql/upgrades/094.sql

sql/upgrades/095.sql

sql/upgrades/096.sql

sql/upgrades/097.sql

sql/upgrades/098.sql

sql/upgrades/099.sql

sql/upgrades/100.sql

sql/upgrades/101.sql

sql/upgrades/102.sql

sql/upgrades/103.sql

sql/upgrades/104.sql

sql/upgrades/105.sql

sql/upgrades/106.sql

sql/upgrades/107.sql

sql/upgrades/108.sql

sql/upgrades/109.sql

sql/upgrades/110.sql

sql/upgrades/111.sql

sql/upgrades/112.sql

sql/upgrades/113.sql

sql/upgrades/114.sql

sql/upgrades/115.sql

sql/upgrades/116.sql

sql/upgrades/117.sql

sql/upgrades/118.sql

sql/upgrades/119.sql

sql/upgrades/120.sql

sql/upgrades/121.sql

sql/upgrades/122.sql

sql/upgrades/123.sql

sql/upgrades/124.sql

sql/upgrades/125.sql

sql/upgrades/126.sql

sql/upgrades/127.sql

sql/upgrades/128.sql

sql/upgrades/129.sql

sql/upgrades/130.sql

sql/upgrades/131.sql

sql/upgrades/132.sql

sql/upgrades/133.sql

sql/upgrades/134.sql

sql/upgrades/135.sql

sql/upgrades/136.sql

sql/upgrades/137.sql

sql/upgrades/138.sql

sql/upgrades/139.sql

sql/upgrades/140.sql

sql/upgrades/141.sql

sql/upgrades/142.sql

sql/upgrades/143.sql

sql/upgrades/144.sql

sql/upgrades/145.sql

sql/upgrades/146.sql

sql/upgrades/147.sql

sql/upgrades/148.sql

sql/upgrades/149.sql

sql/upgrades/150.sql

sql/upgrades/151.sql

sql/upgrades/152.sql

sql/upgrades/153.sql

sql/upgrades/154.sql

sql/upgrades/155.sql

sql/upgrades/156.sql

sql/upgrades/157.sql

sql/upgrades/158.sql

sql/upgrades/159.sql

sql/upgrades/160.sql

sql/upgrades/161.sql

sql/upgrades/162.sql

sql/upgrades/163.sql

sql/upgrades/164.sql

sql/upgrades/165.sql

sql/upgrades/166.sql

sql/upgrades/167.sql

sql/upgrades/168.sql

sql/upgrades/169.sql

sql/upgrades/170.sql

sql/upgrades/171.sql

sql/upgrades/172.sql

sql/upgrades/173.sql

sql/upgrades/174.sql

sql/upgrades/175.sql

sql/upgrades/176.sql

sql/upgrades/177.sql

sql/upgrades/178.sql

sql/upgrades/179.sql

sql/upgrades/180.sql

sql/upgrades/181.sql

sql/upgrades/182.sql

swh/storage/init.py

swh/storage/postgresql/storage.py

swh/storage/pytest_plugin.py

swh/storage/sql/30-schema.sql

swh/storage/sql/upgrades/015.sql

swh/storage/sql/upgrades/016.sql

swh/storage/sql/upgrades/017.sql

swh/storage/sql/upgrades/018.sql

swh/storage/sql/upgrades/019.sql

swh/storage/sql/upgrades/020.sql

swh/storage/sql/upgrades/021.sql

swh/storage/sql/upgrades/022.sql

swh/storage/sql/upgrades/023.sql

swh/storage/sql/upgrades/024.sql

swh/storage/sql/upgrades/025.sql

swh/storage/sql/upgrades/026.sql

swh/storage/sql/upgrades/027.sql

swh/storage/sql/upgrades/028.sql

swh/storage/sql/upgrades/029.sql

swh/storage/sql/upgrades/030.sql

swh/storage/sql/upgrades/032.sql

swh/storage/sql/upgrades/033.sql

swh/storage/sql/upgrades/034.sql

swh/storage/sql/upgrades/035.sql

swh/storage/sql/upgrades/036.sql

swh/storage/sql/upgrades/037.sql

swh/storage/sql/upgrades/038.sql

swh/storage/sql/upgrades/039.sql

swh/storage/sql/upgrades/040.sql

swh/storage/sql/upgrades/041.sql

swh/storage/sql/upgrades/042.sql

swh/storage/sql/upgrades/043.sql

swh/storage/sql/upgrades/044.sql

swh/storage/sql/upgrades/045.sql

swh/storage/sql/upgrades/046.sql

swh/storage/sql/upgrades/047.sql

swh/storage/sql/upgrades/048.sql

swh/storage/sql/upgrades/049.sql

swh/storage/sql/upgrades/050.sql

swh/storage/sql/upgrades/051.sql

swh/storage/sql/upgrades/052.sql

swh/storage/sql/upgrades/053.sql

swh/storage/sql/upgrades/054.sql

swh/storage/sql/upgrades/055.sql

swh/storage/sql/upgrades/056.sql

swh/storage/sql/upgrades/057.sql

swh/storage/sql/upgrades/058.sql

swh/storage/sql/upgrades/059.sql

swh/storage/sql/upgrades/060.sql

swh/storage/sql/upgrades/061.sql

swh/storage/sql/upgrades/062.sql

swh/storage/sql/upgrades/063.sql

swh/storage/sql/upgrades/064.sql

swh/storage/sql/upgrades/065.sql

swh/storage/sql/upgrades/066.sql

swh/storage/sql/upgrades/067.sql

swh/storage/sql/upgrades/068.sql

swh/storage/sql/upgrades/069.sql

swh/storage/sql/upgrades/070.sql

swh/storage/sql/upgrades/071.sql

swh/storage/sql/upgrades/072.sql

swh/storage/sql/upgrades/073.sql

swh/storage/sql/upgrades/074.sql

swh/storage/sql/upgrades/075.sql

swh/storage/sql/upgrades/076.sql

swh/storage/sql/upgrades/077.sql

swh/storage/sql/upgrades/078.sql

swh/storage/sql/upgrades/079.sql

swh/storage/sql/upgrades/080.sql

swh/storage/sql/upgrades/081.sql

swh/storage/sql/upgrades/082.sql

swh/storage/sql/upgrades/083.sql

swh/storage/sql/upgrades/084.sql

swh/storage/sql/upgrades/085.sql

swh/storage/sql/upgrades/086.sql

swh/storage/sql/upgrades/087.sql

swh/storage/sql/upgrades/088.sql

swh/storage/sql/upgrades/089.sql

swh/storage/sql/upgrades/090.sql

swh/storage/sql/upgrades/091.sql

swh/storage/sql/upgrades/092.sql

swh/storage/sql/upgrades/093.sql

swh/storage/sql/upgrades/094.sql

swh/storage/sql/upgrades/095.sql

swh/storage/sql/upgrades/096.sql

swh/storage/sql/upgrades/097.sql

swh/storage/sql/upgrades/098.sql

swh/storage/sql/upgrades/099.sql

swh/storage/sql/upgrades/100.sql

swh/storage/sql/upgrades/101.sql

swh/storage/sql/upgrades/102.sql

swh/storage/sql/upgrades/103.sql

swh/storage/sql/upgrades/104.sql

swh/storage/sql/upgrades/105.sql

swh/storage/sql/upgrades/106.sql

swh/storage/sql/upgrades/107.sql

swh/storage/sql/upgrades/108.sql

swh/storage/sql/upgrades/109.sql

swh/storage/sql/upgrades/110.sql

swh/storage/sql/upgrades/111.sql

swh/storage/sql/upgrades/112.sql

swh/storage/sql/upgrades/113.sql

swh/storage/sql/upgrades/114.sql

swh/storage/sql/upgrades/115.sql

swh/storage/sql/upgrades/116.sql

swh/storage/sql/upgrades/117.sql

swh/storage/sql/upgrades/118.sql

swh/storage/sql/upgrades/119.sql

swh/storage/sql/upgrades/120.sql

swh/storage/sql/upgrades/121.sql

swh/storage/sql/upgrades/122.sql

swh/storage/sql/upgrades/123.sql

swh/storage/sql/upgrades/124.sql

swh/storage/sql/upgrades/125.sql

swh/storage/sql/upgrades/126.sql

swh/storage/sql/upgrades/127.sql

swh/storage/sql/upgrades/128.sql

swh/storage/sql/upgrades/129.sql

swh/storage/sql/upgrades/130.sql

swh/storage/sql/upgrades/131.sql

swh/storage/sql/upgrades/132.sql

swh/storage/sql/upgrades/133.sql

swh/storage/sql/upgrades/134.sql

swh/storage/sql/upgrades/135.sql

swh/storage/sql/upgrades/136.sql

swh/storage/sql/upgrades/137.sql

swh/storage/sql/upgrades/138.sql

swh/storage/sql/upgrades/139.sql

swh/storage/sql/upgrades/140.sql

swh/storage/sql/upgrades/141.sql

swh/storage/sql/upgrades/142.sql

swh/storage/sql/upgrades/143.sql

swh/storage/sql/upgrades/144.sql

swh/storage/sql/upgrades/145.sql

swh/storage/sql/upgrades/146.sql

swh/storage/sql/upgrades/147.sql

swh/storage/sql/upgrades/148.sql

swh/storage/sql/upgrades/149.sql

swh/storage/sql/upgrades/150.sql

swh/storage/sql/upgrades/151.sql

swh/storage/sql/upgrades/152.sql

swh/storage/sql/upgrades/153.sql

swh/storage/sql/upgrades/154.sql

swh/storage/sql/upgrades/155.sql

swh/storage/sql/upgrades/156.sql

swh/storage/sql/upgrades/157.sql

swh/storage/sql/upgrades/158.sql

swh/storage/sql/upgrades/159.sql

swh/storage/sql/upgrades/160.sql

swh/storage/sql/upgrades/161.sql

swh/storage/sql/upgrades/162.sql

swh/storage/sql/upgrades/163.sql

swh/storage/sql/upgrades/164.sql

swh/storage/sql/upgrades/165.sql

swh/storage/sql/upgrades/166.sql

swh/storage/sql/upgrades/167.sql

swh/storage/sql/upgrades/168.sql

swh/storage/sql/upgrades/169.sql

swh/storage/sql/upgrades/170.sql

swh/storage/sql/upgrades/171.sql

swh/storage/sql/upgrades/172.sql

swh/storage/sql/upgrades/173.sql

swh/storage/sql/upgrades/174.sql

swh/storage/sql/upgrades/175.sql

swh/storage/sql/upgrades/176.sql

swh/storage/sql/upgrades/177.sql

swh/storage/sql/upgrades/178.sql

swh/storage/sql/upgrades/179.sql

swh/storage/sql/upgrades/180.sql

swh/storage/sql/upgrades/181.sql

swh/storage/sql/upgrades/182.sql