This also checks the basic raw_extrinsic_metadata codepaths in the
backfiller tests.
Depends on D5226
Differential D5227
Add support for raw_extrinsic_metadata in the replayer Authored by olasd on Mar 10 2021, 9:37 AM. Tags None Subscribers None
Details This also checks the basic raw_extrinsic_metadata codepaths in the Depends on D5226 This whole pipeline has also been tested on some of the production data...
Diff Detail
Event TimelineComment Actions Build is green Patch application report for D5227 (id=18715)Could not rebase; Attempt merge onto 88ff2c2fa0... Updating 88ff2c2f..7744a288 Fast-forward swh/storage/backfill.py | 77 +++++++++++++++++++++++++ swh/storage/postgresql/converters.py | 12 +++- swh/storage/replay.py | 17 +++++- swh/storage/tests/test_backfill.py | 48 ++++++++++++++- swh/storage/tests/test_postgresql_converters.py | 36 +++++++++++- swh/storage/tests/test_replay.py | 2 + 6 files changed, 187 insertions(+), 5 deletions(-) Changes applied before testcommit 7744a28823b9919f8180cc0dda5b6824e53e447c
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date: Tue Mar 9 17:45:06 2021 +0100
Add support for raw_extrinsic_metadata in the replayer
This also checks the basic raw_extrinsic_metadata codepaths in the
backfiller tests.
commit e8c785230f9a925ba3ee2cea4405797a9254d252
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date: Tue Mar 9 17:42:18 2021 +0100
Add basic support for raw_extrinsic_metadata in the backfiller
commit 89ae0a148351c2dcb36d55f1e9cfaffa3158ec14
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date: Tue Mar 9 17:40:27 2021 +0100
Add simple unit test for the backfill.byte_ranges function
commit 0d785d239eb9a53705c9e23fa183344a2606a5a5
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date: Tue Mar 9 17:43:51 2021 +0100
Add support for reading RawExtrinsicMetadata with raw URL targets
We convert the target attribute to a hashed ExtendedSWHID before
returning the object.See https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1200/ for more details. Comment Actions Build is green Patch application report for D5227 (id=18728)Could not rebase; Attempt merge onto 89ae0a1483... Updating 89ae0a14..c4fdd6db Fast-forward swh/storage/backfill.py | 77 ++++++++++++++++++++++++++++++++++++++ swh/storage/replay.py | 17 ++++++++- swh/storage/tests/test_backfill.py | 25 +++++++++++++ swh/storage/tests/test_replay.py | 2 + 4 files changed, 120 insertions(+), 1 deletion(-) Changes applied before testcommit c4fdd6dbd0b3c04eefcdaa53a88d3aec3d0133f9
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date: Tue Mar 9 17:45:06 2021 +0100
Add support for raw_extrinsic_metadata in the replayer
This also checks the basic raw_extrinsic_metadata codepaths in the
backfiller tests.
commit 53a58fa0335f7ca4a183c0073b0f52b19aa422aa
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date: Tue Mar 9 17:42:18 2021 +0100
Add basic support for raw_extrinsic_metadata in the backfillerSee https://jenkins.softwareheritage.org/job/DSTO/job/tests-on-diff/1205/ for more details. |