Page MenuHomeSoftware Heritage
Feed Advanced Search

Aug 3 2021

aeviso updated the diff for D6026: Add test for origin-revision layer.

rebase

Aug 3 2021, 4:43 PM

Aug 2 2021

aeviso updated the diff for D6026: Add test for origin-revision layer.

rebase

Aug 2 2021, 1:56 PM

Jul 30 2021

aeviso added inline comments to D6031: Add a quick start section in the documentation and simplify the configuration file loading mechanism in the cli.
Jul 30 2021, 11:49 AM
aeviso accepted D6015: Use stored SQL functions for content_find_{all,one}() and merge Provenance*DB classes in a single ProvenanceDB.
Jul 30 2021, 11:30 AM
aeviso updated the diff for D6026: Add test for origin-revision layer.

rebase

Jul 30 2021, 11:19 AM

Jul 28 2021

aeviso added a comment to D5843: Add support for a denormalized version of the provenance DB.

It's not clear to me how the denormalized version handles the insertion of duplicated entries.

It's something I am still trying to figure also (whether this code performs as expected under heavy concurrent workload). I want to make more tests (by hand, this is hard to implement as a "unit" test) ASAP.

Just run a series of tests: I'm importing the sample_10k dataset using 16 concurrent workers in 2 databases (with and without denormalization), then I compare the content of the databases by comparing the result of content_find_all for all content objects. The results are exactly the same.
So it looks to be ok.

(I've also played a bit more with locking, I'll this in a future diff).

Jul 28 2021, 2:11 PM
aeviso requested changes to D6015: Use stored SQL functions for content_find_{all,one}() and merge Provenance*DB classes in a single ProvenanceDB.
Jul 28 2021, 11:41 AM
aeviso updated the diff for D6026: Add test for origin-revision layer.

rebase

Jul 28 2021, 11:32 AM
aeviso committed rDPROV509280132cb3: Simplify history graph creation and origin-revision algorithm (authored by aeviso).
Simplify history graph creation and origin-revision algorithm
Jul 28 2021, 11:30 AM
aeviso closed D5985: Simplify history graph creation and origin-revision algorithm.
Jul 28 2021, 11:30 AM
aeviso committed rDPROV505869054bda: Add missing case to history graph yaml test file (authored by aeviso).
Add missing case to history graph yaml test file
Jul 28 2021, 11:30 AM

Jul 27 2021

aeviso requested changes to D5843: Add support for a denormalized version of the provenance DB.
Jul 27 2021, 12:53 PM
aeviso added a comment to D5843: Add support for a denormalized version of the provenance DB.

It's not clear to me how the denormalized version handles the insertion of duplicated entries.

Jul 27 2021, 12:53 PM
aeviso added inline comments to D6015: Use stored SQL functions for content_find_{all,one}() and merge Provenance*DB classes in a single ProvenanceDB.
Jul 27 2021, 12:48 PM
aeviso requested review of D6026: Add test for origin-revision layer.
Jul 27 2021, 12:46 PM
aeviso requested changes to D6015: Use stored SQL functions for content_find_{all,one}() and merge Provenance*DB classes in a single ProvenanceDB.
Jul 27 2021, 12:43 PM

Jul 12 2021

aeviso closed D5986: Add provenance storage server/client classes.
Jul 12 2021, 11:19 AM
aeviso committed rDPROV1ae32c0a61e1: Add test to check that all storage implementations ara compliant with… (authored by aeviso).
Add test to check that all storage implementations ara compliant with…
Jul 12 2021, 11:19 AM
aeviso committed rDPROVe9d4009d0c78: Add provenance storage server/client classes (authored by aeviso).
Add provenance storage server/client classes
Jul 12 2021, 11:19 AM
aeviso committed rDPROV00fc11dfb70d: Remove `raise_on_commit` from `ProvenanceStorageInterface` (authored by aeviso).
Remove `raise_on_commit` from `ProvenanceStorageInterface`
Jul 12 2021, 11:19 AM
aeviso committed rDPROV06d0487cc7f4: Add `with_path` method to the `ProvenanceStorageInterface` (authored by aeviso).
Add `with_path` method to the `ProvenanceStorageInterface`
Jul 12 2021, 11:19 AM
aeviso closed D5973: Reorganize code.
Jul 12 2021, 11:19 AM
aeviso committed rDPROV8c240c7ff2f8: Add missing license string to several files (authored by aeviso).
Add missing license string to several files
Jul 12 2021, 11:19 AM
aeviso committed rDPROV1282b2469501: Reorganize code (authored by aeviso).
Reorganize code
Jul 12 2021, 11:19 AM
aeviso committed rDPROVcbd38f4a5b51: Improve configuration file format (authored by aeviso).
Improve configuration file format
Jul 12 2021, 11:19 AM
aeviso committed rDPROV3003b15bf120: Add parametrize `batch` option to heuristics test (authored by aeviso).
Add parametrize `batch` option to heuristics test
Jul 12 2021, 11:18 AM
aeviso committed rDPROVc96beb57884d: Add `RevisionData` and `RelationData` to improve `ProvenanceStorageInterface` (authored by aeviso).
Add `RevisionData` and `RelationData` to improve `ProvenanceStorageInterface`
Jul 12 2021, 11:18 AM
aeviso closed D5972: Improve `ProvenanceStorageInterface` for testing purposes.
Jul 12 2021, 11:18 AM
aeviso committed rDPROV9c383756bc5f: Add testing-specific methods to `ProvenanceStorageInterface` (authored by aeviso).
Add testing-specific methods to `ProvenanceStorageInterface`
Jul 12 2021, 11:18 AM
aeviso updated the diff for D5985: Simplify history graph creation and origin-revision algorithm.

rebase

Jul 12 2021, 11:09 AM
aeviso updated the diff for D5986: Add provenance storage server/client classes.

rebase

Jul 12 2021, 11:08 AM

Jul 10 2021

aeviso updated the diff for D5986: Add provenance storage server/client classes.

rebase

Jul 10 2021, 7:52 PM
aeviso added inline comments to D5986: Add provenance storage server/client classes.
Jul 10 2021, 7:38 PM

Jul 9 2021

aeviso requested review of D5986: Add provenance storage server/client classes.
Jul 9 2021, 3:07 PM
aeviso updated the diff for D5985: Simplify history graph creation and origin-revision algorithm.

rebase

Jul 9 2021, 2:44 PM
aeviso updated the diff for D5973: Reorganize code.

rebase

Jul 9 2021, 2:43 PM
aeviso updated the diff for D5972: Improve `ProvenanceStorageInterface` for testing purposes.

rebase

Jul 9 2021, 2:42 PM
aeviso requested review of D5985: Simplify history graph creation and origin-revision algorithm.
Jul 9 2021, 1:41 PM
aeviso updated the diff for D5973: Reorganize code.

rebase

Jul 9 2021, 1:34 PM

Jul 6 2021

aeviso requested review of D5973: Reorganize code.
Jul 6 2021, 2:59 PM
aeviso requested review of D5972: Improve `ProvenanceStorageInterface` for testing purposes.
Jul 6 2021, 2:55 PM

Jul 2 2021

aeviso closed D5962: Improve type annotations for test.
Jul 2 2021, 5:24 PM
aeviso committed rDPROV2e46f7c34b0b: Improve type annotations for test (authored by aeviso).
Improve type annotations for test
Jul 2 2021, 5:24 PM
aeviso closed D5961: Improve type annotations throughout the module.
Jul 2 2021, 5:24 PM
aeviso closed D5958: Improve typing annotations for `origin` and `revision` modules.
Jul 2 2021, 5:24 PM
aeviso closed D5957: Remove `db_utilis` in favour of `swh.core.db.BaseDb` methods.
Jul 2 2021, 5:24 PM
aeviso closed D5948: Force `snapshot_get_heads` to return revisions in chronological order.
Jul 2 2021, 5:24 PM
aeviso closed D5947: Add `ProvenanceStorageInterface` as discussed during backend design.
Jul 2 2021, 5:24 PM
aeviso committed rDPROV6617ca5615ec: Remove `db_utils` in favour of `swh.core.db.BaseDb` methods (authored by aeviso).
Remove `db_utils` in favour of `swh.core.db.BaseDb` methods
Jul 2 2021, 5:24 PM
aeviso committed rDPROV2483b17fb2a8: Improve typing annotations for `origin` and `revision` modules (authored by aeviso).
Improve typing annotations for `origin` and `revision` modules
Jul 2 2021, 5:24 PM
aeviso committed rDPROV43238095b057: Improve type annotations throughout the module (authored by aeviso).
Improve type annotations throughout the module
Jul 2 2021, 5:24 PM
aeviso committed rDPROV799839120cb9: Add `ProvenanceStorageInterface` as discussed during backend design (authored by aeviso).
Add `ProvenanceStorageInterface` as discussed during backend design
Jul 2 2021, 5:24 PM
aeviso committed rDPROVc72b2e2428fe: Force `snapshot_get_heads` to return revisions in chronological order (authored by aeviso).
Force `snapshot_get_heads` to return revisions in chronological order
Jul 2 2021, 5:24 PM
aeviso committed rDPROV7c0a091ce5ff: Move `ProvenanceBackend` implementation to a separate file (authored by aeviso).
Move `ProvenanceBackend` implementation to a separate file
Jul 2 2021, 5:24 PM
aeviso closed D5946: Rework `ProvenanceInterface` as discussed during backend design.
Jul 2 2021, 5:24 PM
aeviso closed D5944: Add tests for history graph topology.
Jul 2 2021, 5:24 PM
aeviso committed rDPROV34898ad3cb18: Use `RealDictCursor` in `ProvenanceDBBase` (authored by aeviso).
Use `RealDictCursor` in `ProvenanceDBBase`
Jul 2 2021, 5:24 PM
aeviso committed rDPROV721354c436b5: Rework `ProvenanceInterface` as discussed during backend design (authored by aeviso).
Rework `ProvenanceInterface` as discussed during backend design
Jul 2 2021, 5:24 PM
aeviso committed rDPROV01f8d40ffccb: Add tests for history graph topology (authored by aeviso).
Add tests for history graph topology
Jul 2 2021, 5:24 PM
aeviso closed D5943: Fix database queries related to the origin-revision layer.
Jul 2 2021, 5:24 PM
aeviso committed rDPROVb7fdcdec7ea9: Fix database queries related to the origin-revision layer (authored by aeviso).
Fix database queries related to the origin-revision layer
Jul 2 2021, 5:23 PM
aeviso committed rDPROV0e2a3c64ce3c: Add test to compare both `ArchiveInterface` implementations (authored by aeviso).
Add test to compare both `ArchiveInterface` implementations
Jul 2 2021, 5:23 PM
aeviso committed rDPROV98bba93cccec: Rename test files to keep naming convension (authored by aeviso).
Rename test files to keep naming convension
Jul 2 2021, 5:23 PM
aeviso closed D5925: Refactor ArchiveInterface to fit origin-revision layer needs.
Jul 2 2021, 5:23 PM
aeviso committed rDPROV9e0c1aa09907: Use `Sha1Git` type to explicitly state the kind of identifiers (authored by aeviso).
Use `Sha1Git` type to explicitly state the kind of identifiers
Jul 2 2021, 5:23 PM
aeviso committed rDPROVfa9198afb71b: Refactor `ArchiveInterface` to fit origin-revision layer needs (authored by aeviso).
Refactor `ArchiveInterface` to fit origin-revision layer needs
Jul 2 2021, 5:23 PM
aeviso closed D5924: Add support for sha1 identifiers for origins.
Jul 2 2021, 5:23 PM
aeviso committed rDPROVa27ffff67b6b: Add support for sha1 identifiers for origins (authored by aeviso).
Add support for sha1 identifiers for origins
Jul 2 2021, 5:23 PM
aeviso added inline comments to D5943: Fix database queries related to the origin-revision layer.
Jul 2 2021, 5:22 PM
aeviso added inline comments to D5947: Add `ProvenanceStorageInterface` as discussed during backend design.
Jul 2 2021, 5:01 PM
aeviso updated the diff for D5962: Improve type annotations for test.

rebase

Jul 2 2021, 4:31 PM
aeviso updated the diff for D5961: Improve type annotations throughout the module.

rebase

Jul 2 2021, 4:30 PM
aeviso updated the diff for D5958: Improve typing annotations for `origin` and `revision` modules.

rebase

Jul 2 2021, 4:30 PM
aeviso updated the diff for D5957: Remove `db_utilis` in favour of `swh.core.db.BaseDb` methods.

rebase

Jul 2 2021, 4:29 PM
aeviso updated the diff for D5948: Force `snapshot_get_heads` to return revisions in chronological order.

rebase

Jul 2 2021, 4:26 PM
aeviso updated the diff for D5947: Add `ProvenanceStorageInterface` as discussed during backend design.

rebase

Jul 2 2021, 4:26 PM
aeviso updated the diff for D5946: Rework `ProvenanceInterface` as discussed during backend design.

rebase

Jul 2 2021, 4:25 PM
aeviso updated the diff for D5944: Add tests for history graph topology.

rebase

Jul 2 2021, 4:24 PM
aeviso updated the diff for D5943: Fix database queries related to the origin-revision layer.

rebase

Jul 2 2021, 4:23 PM
aeviso added inline comments to D5943: Fix database queries related to the origin-revision layer.
Jul 2 2021, 3:46 PM
aeviso updated the diff for D5962: Improve type annotations for test.

rebase

Jul 2 2021, 3:22 PM
aeviso updated the diff for D5961: Improve type annotations throughout the module.

rebase

Jul 2 2021, 3:22 PM
aeviso added inline comments to D5961: Improve type annotations throughout the module.
Jul 2 2021, 3:18 PM
aeviso added inline comments to D5962: Improve type annotations for test.
Jul 2 2021, 3:14 PM
aeviso updated the diff for D5962: Improve type annotations for test.

rebase

Jul 2 2021, 2:51 PM
aeviso updated the diff for D5961: Improve type annotations throughout the module.

rebase

Jul 2 2021, 2:51 PM
aeviso updated the diff for D5958: Improve typing annotations for `origin` and `revision` modules.

rebase

Jul 2 2021, 2:50 PM
aeviso updated the diff for D5962: Improve type annotations for test.

rebase

Jul 2 2021, 11:38 AM
aeviso updated the diff for D5961: Improve type annotations throughout the module.

rebase

Jul 2 2021, 11:37 AM
aeviso updated the diff for D5958: Improve typing annotations for `origin` and `revision` modules.

rebase

Jul 2 2021, 11:37 AM
aeviso updated the diff for D5957: Remove `db_utilis` in favour of `swh.core.db.BaseDb` methods.

rebase

Jul 2 2021, 11:36 AM
aeviso updated the diff for D5948: Force `snapshot_get_heads` to return revisions in chronological order.

rebase

Jul 2 2021, 11:35 AM
aeviso updated the diff for D5947: Add `ProvenanceStorageInterface` as discussed during backend design.

rebase

Jul 2 2021, 11:34 AM
aeviso updated the diff for D5962: Improve type annotations for test.

rebase

Jul 2 2021, 10:30 AM
aeviso updated the diff for D5962: Improve type annotations for test.

rebase

Jul 2 2021, 10:21 AM
aeviso updated the diff for D5961: Improve type annotations throughout the module.

rebase

Jul 2 2021, 10:20 AM
aeviso retitled D5961: Improve type annotations throughout the module from Improve type annotations to Improve type annotations throughout the module.
Jul 2 2021, 10:19 AM
aeviso requested review of D5962: Improve type annotations for test.
Jul 2 2021, 1:12 AM

Jul 1 2021

aeviso requested review of D5961: Improve type annotations throughout the module.
Jul 1 2021, 11:03 PM
aeviso requested review of D5958: Improve typing annotations for `origin` and `revision` modules.
Jul 1 2021, 5:55 PM