Page MenuHomeSoftware Heritage
Feed Advanced Search

Mar 8 2021

douardda committed rDMODfca36585a39c: Fix MetadataAuthority.from_dict() (authored by douardda).
Fix MetadataAuthority.from_dict()
Mar 8 2021, 4:22 PM
douardda requested review of D5215: Fix MetadataAuthority.from_dict().
Mar 8 2021, 4:17 PM
douardda added a comment to P971 (An Untitled Masterwork).

Added test being:

Mar 8 2021, 2:15 PM
douardda created P971 (An Untitled Masterwork).
Mar 8 2021, 2:14 PM
douardda updated the diff for D4698: Add support for ExtID in the storage.

rebase, rework to use new SWHID classes/model

Mar 8 2021, 11:35 AM
douardda retitled D4807: Add an ExtID object from [WIP] Add an ExtID object to Add an ExtID object.
Mar 8 2021, 11:27 AM

Mar 5 2021

douardda abandoned D4985: [WIP] Add support for SWHID on Origin.

superseeded by new SWHID classes

Mar 5 2021, 11:28 AM
douardda updated the diff for D4807: Add an ExtID object.

adapted to nes SWHID classes

Mar 5 2021, 11:26 AM

Mar 2 2021

douardda closed D5172: Fix the db initialization stack.
Mar 2 2021, 1:57 PM
douardda committed rDPROV5380ab8fbc0b: Fix the db initialization stack (authored by douardda).
Fix the db initialization stack
Mar 2 2021, 1:57 PM
douardda updated the diff for D5172: Fix the db initialization stack.

again

Mar 2 2021, 1:53 PM
douardda updated the diff for D5172: Fix the db initialization stack.

blank, to fire jenkins

Mar 2 2021, 1:43 PM
douardda added a comment to D5172: Fix the db initialization stack.

looks like it's doing the job ;)

I was wondering if it would not be clearer to alter the schema at the end of the file
(or in a subsequent file). Kinda what's done for indexes.

\if :dbflavor_with_path
alter table content_early_in_rev
add column loc bigint not null;  -- location of the content relative to the revision root directory

comment on column content_early_in_rev.loc is 'Location of content in revision';
...
\end

But that would split the reading so let's keep it that way
¯\_(ツ)_/¯

Mar 2 2021, 1:39 PM
douardda closed D5180: jobs/swh-packages: Add swh-provenance.
Mar 2 2021, 1:36 PM
douardda committed rCJSWH1b0d0941dc6a: jobs/swh-packages: Add swh-provenance (authored by douardda).
jobs/swh-packages: Add swh-provenance
Mar 2 2021, 1:36 PM
douardda requested review of D5180: jobs/swh-packages: Add swh-provenance.
Mar 2 2021, 12:33 PM
douardda updated the diff for D5172: Fix the db initialization stack.

rebase

Mar 2 2021, 12:24 PM

Mar 1 2021

douardda requested review of D5172: Fix the db initialization stack.
Mar 1 2021, 4:07 PM

Feb 19 2021

douardda closed D5100: Refactor the FileRevisionIterator.
Feb 19 2021, 10:02 AM
douardda closed D5101: Refactor and fix the iterate_statuses function.
Feb 19 2021, 10:02 AM
douardda committed rDPROVdbda3ae1f9f8: Refactor the FileRevisionIterator (authored by douardda).
Refactor the FileRevisionIterator
Feb 19 2021, 10:02 AM
douardda closed D5099: Make ArchiveStorage() accept a StorageInterface object as argument.
Feb 19 2021, 10:02 AM
douardda committed rDPROVce0e7fe398f3: Refactor and fix the iterate_statuses function (authored by douardda).
Refactor and fix the iterate_statuses function
Feb 19 2021, 10:02 AM
douardda closed D5098: Add basic tests for the provenanceDB and archive abstraction classes.
Feb 19 2021, 10:01 AM
douardda committed rDPROV5b84f74dded5: Make ArchiveStorage() accept a StorageInterface object as argument (authored by douardda).
Make ArchiveStorage() accept a StorageInterface object as argument
Feb 19 2021, 10:01 AM
douardda closed D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.
Feb 19 2021, 10:01 AM
douardda committed rDPROV3b96ecadfa8b: Declare ArchiveInterface and ProvenanceInterface as Protocol (authored by douardda).
Declare ArchiveInterface and ProvenanceInterface as Protocol
Feb 19 2021, 10:01 AM
douardda committed rDPROV7b12ed0b3726: Add basic tests for the provenanceDB and archive abstraction classes (authored by douardda).
Add basic tests for the provenanceDB and archive abstraction classes
Feb 19 2021, 10:01 AM
douardda closed D5073: Refactor the ProvenanceDB classes.
Feb 19 2021, 10:01 AM
douardda committed rDPROV5d3ef241e86e: Refactor the db initialization scaffolding to use swh.core.db (authored by douardda).
Refactor the db initialization scaffolding to use swh.core.db
Feb 19 2021, 10:01 AM
douardda committed rDPROV36d94d1e6bcd: Refactor the ProvenanceDB classes (authored by douardda).
Refactor the ProvenanceDB classes
Feb 19 2021, 10:01 AM
douardda closed D5072: Refactor the db scaffolding to use swh.core.db.
Feb 19 2021, 10:01 AM
douardda committed rDPROVdabbd5334967: Refactor the database creation code and a test for the cli command (authored by douardda).
Refactor the database creation code and a test for the cli command
Feb 19 2021, 10:01 AM

Feb 18 2021

douardda updated the diff for D5101: Refactor and fix the iterate_statuses function.

rebase

Feb 18 2021, 5:58 PM
douardda updated the diff for D5100: Refactor the FileRevisionIterator.

rebase

Feb 18 2021, 5:58 PM
douardda updated the diff for D5099: Make ArchiveStorage() accept a StorageInterface object as argument.

rebase

Feb 18 2021, 5:58 PM
douardda updated the diff for D5098: Add basic tests for the provenanceDB and archive abstraction classes.

Rebase + better commit message + add a docstring

Feb 18 2021, 5:57 PM
douardda updated the diff for D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.

rebased

Feb 18 2021, 5:50 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebased

Feb 18 2021, 5:50 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

rebase + default to with_path=True as asked by @aeviso

Feb 18 2021, 5:49 PM
douardda committed rDPROV48b9b0354d40: Blackify, isort and fix code spells reported by pre-commit hooks (authored by douardda).
Blackify, isort and fix code spells reported by pre-commit hooks
Feb 18 2021, 5:40 PM
douardda closed D5080: Add a pre-commit config file.
Feb 18 2021, 5:40 PM
douardda committed rDPROV01b290e9a7c8: Add a pre-commit config file (authored by douardda).
Add a pre-commit config file
Feb 18 2021, 5:40 PM
douardda updated the diff for D5080: Add a pre-commit config file.

rebase

Feb 18 2021, 5:40 PM
douardda added a comment to D5098: Add basic tests for the provenanceDB and archive abstraction classes.

The swh_storage_with_objects fixtures returns a (postgresal-based) storage with some objects in it (only a few of each type). The test that given storage do indeed have at least a content, a directory and a revision. I'll improve the commit message a bit.

Feb 18 2021, 5:26 PM
douardda added inline comments to D5072: Refactor the db scaffolding to use swh.core.db.
Feb 18 2021, 5:23 PM
douardda added inline comments to D5072: Refactor the db scaffolding to use swh.core.db.
Feb 18 2021, 5:20 PM
douardda added a comment to D5072: Refactor the db scaffolding to use swh.core.db.

I'm not convinced by the flavor thing. Why not a single schema, but with empty values in loc when it's disabled?

Feb 18 2021, 5:18 PM

Feb 17 2021

douardda requested review of D5101: Refactor and fix the iterate_statuses function.
Feb 17 2021, 5:37 PM
douardda requested review of D5100: Refactor the FileRevisionIterator.
Feb 17 2021, 5:37 PM
douardda requested review of D5099: Make ArchiveStorage() accept a StorageInterface object as argument.
Feb 17 2021, 5:37 PM
douardda requested review of D5098: Add basic tests for the provenanceDB and archive abstraction classes.
Feb 17 2021, 5:36 PM
douardda added a comment to D5081: Add new class QualifiedSWHID to replace SWHID, and deprecate the latter..

(as mentioned on IRC): Since we are doing big works, I see no reason to keep the 'qualifiers' a schema-less dict-like attribute. I'd rather have them as attributes.

Feb 17 2021, 2:07 PM

Feb 16 2021

douardda updated the diff for D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.

rebase

Feb 16 2021, 5:34 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase

Feb 16 2021, 5:33 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

rebase

Feb 16 2021, 5:33 PM
douardda updated the diff for D5080: Add a pre-commit config file.

ad forgotten isorts (after proper config in pyproject.toml)

Feb 16 2021, 5:32 PM
douardda added inline comments to D5080: Add a pre-commit config file.
Feb 16 2021, 5:13 PM
douardda added inline comments to D5080: Add a pre-commit config file.
Feb 16 2021, 4:57 PM
douardda requested review of D5083: Declare ArchiveInterface and ProvenanceInterface as Protocol.
Feb 16 2021, 3:44 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase and fix db initialization in tests

Feb 16 2021, 3:44 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

rebase and fix tests

Feb 16 2021, 3:43 PM
douardda updated the diff for D5080: Add a pre-commit config file.

add missing isort config in pyproject.toml

Feb 16 2021, 3:42 PM
douardda added reviewers for D5073: Refactor the ProvenanceDB classes: aeviso, Reviewers.
Feb 16 2021, 12:15 PM
douardda added reviewers for D5072: Refactor the db scaffolding to use swh.core.db: aeviso, Reviewers.
Feb 16 2021, 12:15 PM
douardda retitled D5073: Refactor the ProvenanceDB classes from WIP Refactor the ProvenanceDB classes to Refactor the ProvenanceDB classes.
Feb 16 2021, 12:14 PM
douardda retitled D5072: Refactor the db scaffolding to use swh.core.db from WIP Refactor the db scaffolding to use swh.core.db to Refactor the db scaffolding to use swh.core.db.
Feb 16 2021, 12:14 PM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase and fix tests

Feb 16 2021, 12:13 PM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

Fix tests and properly initialize the db using swh.core.db in the pytest fixture

Feb 16 2021, 12:13 PM
douardda added reviewers for D5080: Add a pre-commit config file: aeviso, Reviewers.
Feb 16 2021, 10:56 AM
douardda updated the diff for D5073: Refactor the ProvenanceDB classes.

rebase

Feb 16 2021, 10:40 AM
douardda updated the diff for D5072: Refactor the db scaffolding to use swh.core.db.

moslty rebase on D5080

Feb 16 2021, 10:39 AM
douardda requested review of D5080: Add a pre-commit config file.
Feb 16 2021, 10:38 AM

Feb 15 2021

douardda added a comment to T3034: generalize usage of SWHID for referencing SWH archive objects.
In T3034#58665, @zack wrote:

Who needs to reference REMs in the first place?

Feb 15 2021, 11:54 AM · Data Model

Feb 12 2021

douardda retitled D5073: Refactor the ProvenanceDB classes from Refactor the ProvenanceDB classes to WIP Refactor the ProvenanceDB classes.
Feb 12 2021, 5:33 PM
douardda retitled D5072: Refactor the db scaffolding to use swh.core.db from Refactor the db scaffolding to use swh.core.db to WIP Refactor the db scaffolding to use swh.core.db.
Feb 12 2021, 5:33 PM
douardda requested review of D5073: Refactor the ProvenanceDB classes.
Feb 12 2021, 4:33 PM
douardda requested review of D5072: Refactor the db scaffolding to use swh.core.db.
Feb 12 2021, 4:31 PM
douardda committed rDPROV376060a72c7a: Add missing dependency on the methodtools package (authored by douardda).
Add missing dependency on the methodtools package
Feb 12 2021, 4:28 PM

Feb 11 2021

douardda accepted D5035: package: Mark visit as not_found when relevant.

lgtm but I would wait for a green stamp from @vlorentz as well

Feb 11 2021, 10:10 AM
douardda accepted D5026: core: Mark visit status as failed when relevant.

lgtm

Feb 11 2021, 10:04 AM

Feb 10 2021

douardda added a revision to T3034: generalize usage of SWHID for referencing SWH archive objects: D4985: [WIP] Add support for SWHID on Origin.
Feb 10 2021, 9:57 AM · Data Model
douardda added a task to D4985: [WIP] Add support for SWHID on Origin: T3034: generalize usage of SWHID for referencing SWH archive objects.
Feb 10 2021, 9:57 AM
douardda added a revision to T3034: generalize usage of SWHID for referencing SWH archive objects: D4986: [WIP] Add a composite swhid type in postgresql.
Feb 10 2021, 9:56 AM · Data Model

Feb 9 2021

douardda triaged T3034: generalize usage of SWHID for referencing SWH archive objects as High priority.
Feb 9 2021, 3:37 PM · Data Model
douardda added inline comments to D5029: Add raw_extrinsic_metadata.id column in postgresql..
Feb 9 2021, 10:16 AM
douardda added a comment to D5008: identifiers: Properly define the behavior of raw_extrinsic_metadata on negative timestamps..

it would be nice to have an explanation in the commit message of why this is actually needed. Explain why the original implementation is incorrect, and how it fixes this old incorrect behavior.

Feb 9 2021, 10:14 AM

Feb 5 2021

douardda added a comment to T2912: Next generation archive counters.

@vsellier nice. Note that if we draw these with a y-axis starting from 0, the step shape will be really negligible, so IMHO it's really not a problem.

Feb 5 2021, 10:59 AM · Roadmap 2021, System administration, Monitoring, Web app
douardda triaged T3029: Add validator and tests for the espated nature of the origin URI of the SWHID context qualidier as Normal priority.
Feb 5 2021, 9:49 AM · Data Model

Feb 4 2021

douardda requested review of D4985: [WIP] Add support for SWHID on Origin.
Feb 4 2021, 3:38 PM
douardda closed D5010: Fix swh.deposit.urls typing.
Feb 4 2021, 3:08 PM
douardda committed rDDEP6275caba9314: Fix swh.deposit.urls typing (authored by douardda).
Fix swh.deposit.urls typing
Feb 4 2021, 3:08 PM
douardda updated the diff for D5010: Fix swh.deposit.urls typing.

put the deps on djangorestframework-stubs >= 1.4 in requirement-tests.txt

Feb 4 2021, 2:22 PM
douardda requested review of D5010: Fix swh.deposit.urls typing.
Feb 4 2021, 2:13 PM

Feb 2 2021

douardda accepted D4997: Remove no longer used models field in dict returned by register.
Feb 2 2021, 4:46 PM
douardda created P936 Command-Line Input.
Feb 2 2021, 3:59 PM
douardda accepted D4975: Change origin_visit_status_get_random interface to return visit_status.
Feb 2 2021, 10:53 AM
douardda accepted D4976: storage: Make origin_get_latest_visit_status return OriginVisitStatus.
Feb 2 2021, 10:52 AM
douardda accepted D4977: Update persistent identifiers doc with pip install info.

ok but see my comment

Feb 2 2021, 10:50 AM
douardda accepted D4931: Add mapping of definitions and harvests.
Feb 2 2021, 10:44 AM