Page MenuHomeSoftware Heritage
Feed Advanced Search

Mar 11 2021

douardda closed D4807: Add an ExtID object.
Mar 11 2021, 2:17 PM
douardda committed rDMOD71be46174b87: Add an ExtID object (authored by douardda).
Add an ExtID object
Mar 11 2021, 2:17 PM
douardda updated the diff for D4698: Add support for ExtID in the storage.

Make sure extid_get_from_target() is immune to murmur3 collisions

Mar 11 2021, 12:10 PM

Mar 10 2021

douardda updated the diff for D4698: Add support for ExtID in the storage.

get rid of the OBJECT_TYPE_MAP_SHORT map, as requested

Mar 10 2021, 5:21 PM
douardda updated the diff for D4698: Add support for ExtID in the storage.

Add missing support for extid in the replayer

Mar 10 2021, 4:26 PM
douardda added a comment to D4807: Add an ExtID object.
In D4807#132570, @olasd wrote:

I wonder if the TEST_OBJECTS addition will break the tests of swh.storage until D4698 lands.

Mar 10 2021, 3:55 PM
douardda updated the summary of D4698: Add support for ExtID in the storage.
Mar 10 2021, 3:54 PM
douardda updated the diff for D4698: Add support for ExtID in the storage.

Remove extid_by_extid in cassandre

Mar 10 2021, 3:52 PM
douardda added inline comments to D4698: Add support for ExtID in the storage.
Mar 10 2021, 2:21 PM
douardda updated the diff for D4807: Add an ExtID object.

Apply vlorentz and olasd's suggestions

Mar 10 2021, 10:41 AM
douardda added inline comments to D4807: Add an ExtID object.
Mar 10 2021, 10:29 AM
douardda updated the diff for D4698: Add support for ExtID in the storage.

forgot sql migration script

Mar 10 2021, 10:08 AM
douardda updated the diff for D4698: Add support for ExtID in the storage.

ExtID.target is now a CoreSWHID

Mar 10 2021, 9:56 AM

Mar 9 2021

douardda updated the diff for D4807: Add an ExtID object.

Use CoreSWHID as target

Mar 9 2021, 3:03 PM
douardda added a watcher for Documentation: douardda.
Mar 9 2021, 2:41 PM
douardda moved T2894: Restructure deposit documentation with a clearer strategy from Backlog to sponsors/clients on the Documentation board.
Mar 9 2021, 2:10 PM · SWORD deposit, Documentation
douardda updated the summary of D4698: Add support for ExtID in the storage.
Mar 9 2021, 10:22 AM
douardda retitled D4698: Add support for ExtID in the storage from [WIP][RFC] Add support for ExtID in the storage to Add support for ExtID in the storage.
Mar 9 2021, 10:22 AM
douardda updated the diff for D4698: Add support for ExtID in the storage.

All tests should now pass (with D4807)

Mar 9 2021, 10:21 AM

Mar 8 2021

douardda updated the diff for D4807: Add an ExtID object.

Rebase, make ExtID a HashableObject, and remove hypothesis strategies for ExtID

Mar 8 2021, 4:24 PM
douardda closed D5215: Fix MetadataAuthority.from_dict().
Mar 8 2021, 4:22 PM
douardda committed rDMODfca36585a39c: Fix MetadataAuthority.from_dict() (authored by douardda).
Fix MetadataAuthority.from_dict()
Mar 8 2021, 4:22 PM
douardda requested review of D5215: Fix MetadataAuthority.from_dict().
Mar 8 2021, 4:17 PM
douardda added a comment to P971 (An Untitled Masterwork).

Added test being:

Mar 8 2021, 2:15 PM
douardda created P971 (An Untitled Masterwork).
Mar 8 2021, 2:14 PM
douardda updated the diff for D4698: Add support for ExtID in the storage.

rebase, rework to use new SWHID classes/model

Mar 8 2021, 11:35 AM
douardda retitled D4807: Add an ExtID object from [WIP] Add an ExtID object to Add an ExtID object.
Mar 8 2021, 11:27 AM

Mar 5 2021

douardda abandoned D4985: [WIP] Add support for SWHID on Origin.

superseeded by new SWHID classes

Mar 5 2021, 11:28 AM
douardda updated the diff for D4807: Add an ExtID object.

adapted to nes SWHID classes

Mar 5 2021, 11:26 AM

Mar 2 2021

douardda closed D5172: Fix the db initialization stack.
Mar 2 2021, 1:57 PM
douardda committed rDPROV5380ab8fbc0b: Fix the db initialization stack (authored by douardda).
Fix the db initialization stack
Mar 2 2021, 1:57 PM
douardda updated the diff for D5172: Fix the db initialization stack.

again

Mar 2 2021, 1:53 PM
douardda updated the diff for D5172: Fix the db initialization stack.

blank, to fire jenkins

Mar 2 2021, 1:43 PM
douardda added a comment to D5172: Fix the db initialization stack.

looks like it's doing the job ;)

I was wondering if it would not be clearer to alter the schema at the end of the file
(or in a subsequent file). Kinda what's done for indexes.

\if :dbflavor_with_path
alter table content_early_in_rev
add column loc bigint not null;  -- location of the content relative to the revision root directory

comment on column content_early_in_rev.loc is 'Location of content in revision';
...
\end

But that would split the reading so let's keep it that way
¯\_(ツ)_/¯

Mar 2 2021, 1:39 PM
douardda closed D5180: jobs/swh-packages: Add swh-provenance.
Mar 2 2021, 1:36 PM
douardda committed rCJSWH1b0d0941dc6a: jobs/swh-packages: Add swh-provenance (authored by douardda).
jobs/swh-packages: Add swh-provenance
Mar 2 2021, 1:36 PM
douardda requested review of D5180: jobs/swh-packages: Add swh-provenance.
Mar 2 2021, 12:33 PM
douardda updated the diff for D5172: Fix the db initialization stack.

rebase

Mar 2 2021, 12:24 PM

Mar 1 2021

douardda requested review of D5172: Fix the db initialization stack.
Mar 1 2021, 4:07 PM

Feb 19 2021

douardda closed D5100: Refactor the FileRevisionIterator.
Feb 19 2021, 10:02 AM
douardda closed D5101: Refactor and fix the iterate_statuses function.
Feb 19 2021, 10:02 AM
douardda committed rDPROVdbda3ae1f9f8: Refactor the FileRevisionIterator (authored by douardda).
Refactor the FileRevisionIterator
Feb 19 2021, 10:02 AM
douardda closed D5099: Make ArchiveStorage() accept a StorageInterface object as argument.
Feb 19 2021, 10:02 AM
douardda committed rDPROVce0e7fe398f3: Refactor and fix the iterate_statuses function (authored by douardda).
Refactor and fix the iterate_statuses function
Feb 19 2021, 10:02 AM
douardda closed D5098: Add basic tests for the provenanceDB and archive abstraction classes.
Feb 19 2021, 10:01 AM
douardda committed rDPROV5b84f74dded5: Make ArchiveStorage() accept a StorageInterface object as argument (authored by douardda).
Make ArchiveStorage() accept a StorageInterface object as argument
Feb 19 2021, 10:01 AM
douardda closed D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.
Feb 19 2021, 10:01 AM
douardda committed rDPROV3b96ecadfa8b: Declare ArchiveInterface and ProvenanceInterface as Protocol (authored by douardda).
Declare ArchiveInterface and ProvenanceInterface as Protocol
Feb 19 2021, 10:01 AM
douardda committed rDPROV7b12ed0b3726: Add basic tests for the provenanceDB and archive abstraction classes (authored by douardda).
Add basic tests for the provenanceDB and archive abstraction classes
Feb 19 2021, 10:01 AM
douardda closed D5073: Refactor the ProvenanceDB classes.
Feb 19 2021, 10:01 AM
douardda committed rDPROV5d3ef241e86e: Refactor the db initialization scaffolding to use swh.core.db (authored by douardda).
Refactor the db initialization scaffolding to use swh.core.db
Feb 19 2021, 10:01 AM
douardda committed rDPROV36d94d1e6bcd: Refactor the ProvenanceDB classes (authored by douardda).
Refactor the ProvenanceDB classes
Feb 19 2021, 10:01 AM
douardda closed D5072: Refactor the db scaffolding to use swh.core.db.
Feb 19 2021, 10:01 AM
douardda committed rDPROVdabbd5334967: Refactor the database creation code and a test for the cli command (authored by douardda).
Refactor the database creation code and a test for the cli command
Feb 19 2021, 10:01 AM

Feb 18 2021

douardda updated the diff for D5101: Refactor and fix the iterate_statuses function.

rebase

Feb 18 2021, 5:58 PM
douardda updated the diff for D5100: Refactor the FileRevisionIterator.

rebase

Feb 18 2021, 5:58 PM
douardda updated the diff for D5099: Make ArchiveStorage() accept a StorageInterface object as argument.

rebase

Feb 18 2021, 5:58 PM
douardda updated the diff for D5098: Add basic tests for the provenanceDB and archive abstraction classes.

Rebase + better commit message + add a docstring

Feb 18 2021, 5:57 PM
douardda updated the diff for D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.

rebased

Feb 18 2021, 5:50 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebased

Feb 18 2021, 5:50 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

rebase + default to with_path=True as asked by @aeviso

Feb 18 2021, 5:49 PM
douardda committed rDPROV48b9b0354d40: Blackify, isort and fix code spells reported by pre-commit hooks (authored by douardda).
Blackify, isort and fix code spells reported by pre-commit hooks
Feb 18 2021, 5:40 PM
douardda closed D5080: Add a pre-commit config file.
Feb 18 2021, 5:40 PM
douardda committed rDPROV01b290e9a7c8: Add a pre-commit config file (authored by douardda).
Add a pre-commit config file
Feb 18 2021, 5:40 PM
douardda updated the diff for D5080: Add a pre-commit config file.

rebase

Feb 18 2021, 5:40 PM
douardda added a comment to D5098: Add basic tests for the provenanceDB and archive abstraction classes.

The swh_storage_with_objects fixtures returns a (postgresal-based) storage with some objects in it (only a few of each type). The test that given storage do indeed have at least a content, a directory and a revision. I'll improve the commit message a bit.

Feb 18 2021, 5:26 PM
douardda added inline comments to D5072: Refactor the db scaffolding to use swh.core.db.
Feb 18 2021, 5:23 PM
douardda added inline comments to D5072: Refactor the db scaffolding to use swh.core.db.
Feb 18 2021, 5:20 PM
douardda added a comment to D5072: Refactor the db scaffolding to use swh.core.db.

I'm not convinced by the flavor thing. Why not a single schema, but with empty values in loc when it's disabled?

Feb 18 2021, 5:18 PM

Feb 17 2021

douardda requested review of D5101: Refactor and fix the iterate_statuses function.
Feb 17 2021, 5:37 PM
douardda requested review of D5100: Refactor the FileRevisionIterator.
Feb 17 2021, 5:37 PM
douardda requested review of D5099: Make ArchiveStorage() accept a StorageInterface object as argument.
Feb 17 2021, 5:37 PM
douardda requested review of D5098: Add basic tests for the provenanceDB and archive abstraction classes.
Feb 17 2021, 5:36 PM
douardda added a comment to D5081: Add new class QualifiedSWHID to replace SWHID, and deprecate the latter..

(as mentioned on IRC): Since we are doing big works, I see no reason to keep the 'qualifiers' a schema-less dict-like attribute. I'd rather have them as attributes.

Feb 17 2021, 2:07 PM

Feb 16 2021

douardda updated the diff for D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.

rebase

Feb 16 2021, 5:34 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase

Feb 16 2021, 5:33 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

rebase

Feb 16 2021, 5:33 PM
douardda updated the diff for D5080: Add a pre-commit config file.

ad forgotten isorts (after proper config in pyproject.toml)

Feb 16 2021, 5:32 PM
douardda added inline comments to D5080: Add a pre-commit config file.
Feb 16 2021, 5:13 PM
douardda added inline comments to D5080: Add a pre-commit config file.
Feb 16 2021, 4:57 PM
douardda requested review of D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.
Feb 16 2021, 3:44 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase and fix db initialization in tests

Feb 16 2021, 3:44 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

rebase and fix tests

Feb 16 2021, 3:43 PM
douardda updated the diff for D5080: Add a pre-commit config file.

add missing isort config in pyproject.toml

Feb 16 2021, 3:42 PM
douardda added reviewers for D5073: Refactor the ProvenanceDB classes: aeviso, Reviewers.
Feb 16 2021, 12:15 PM
douardda added reviewers for D5072: Refactor the db scaffolding to use swh.core.db: aeviso, Reviewers.
Feb 16 2021, 12:15 PM
douardda retitled D5073: Refactor the ProvenanceDB classes from WIP Refactor the ProvenanceDB classes to Refactor the ProvenanceDB classes.
Feb 16 2021, 12:14 PM
douardda retitled D5072: Refactor the db scaffolding to use swh.core.db from WIP Refactor the db scaffolding to use swh.core.db to Refactor the db scaffolding to use swh.core.db.
Feb 16 2021, 12:14 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase and fix tests

Feb 16 2021, 12:13 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

Fix tests and properly initialize the db using swh.core.db in the pytest fixture

Feb 16 2021, 12:13 PM
douardda added reviewers for D5080: Add a pre-commit config file: aeviso, Reviewers.
Feb 16 2021, 10:56 AM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase

Feb 16 2021, 10:40 AM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

moslty rebase on D5080

Feb 16 2021, 10:39 AM
douardda requested review of D5080: Add a pre-commit config file.
Feb 16 2021, 10:38 AM

Feb 15 2021

douardda added a comment to T3034: generalize usage of SWHID for referencing SWH archive objects.
In T3034#58665, @zack wrote:

Who needs to reference REMs in the first place?

Feb 15 2021, 11:54 AM · Data Model

Feb 12 2021

douardda retitled D5073: Refactor the ProvenanceDB classes from Refactor the ProvenanceDB classes to WIP Refactor the ProvenanceDB classes.
Feb 12 2021, 5:33 PM
douardda retitled D5072: Refactor the db scaffolding to use swh.core.db from Refactor the db scaffolding to use swh.core.db to WIP Refactor the db scaffolding to use swh.core.db.
Feb 12 2021, 5:33 PM
douardda requested review of D5073: Refactor the ProvenanceDB classes.
Feb 12 2021, 4:33 PM
douardda requested review of D5072: Refactor the db scaffolding to use swh.core.db.
Feb 12 2021, 4:31 PM
douardda committed rDPROV376060a72c7a: Add missing dependency on the methodtools package (authored by douardda).
Add missing dependency on the methodtools package
Feb 12 2021, 4:28 PM