Page MenuHomeSoftware Heritage
Feed Advanced Search

Jan 19 2021

douardda requested review of D4885: Make the journal-client cli subcommand automagically loaded.
Jan 19 2021, 4:21 PM
douardda updated the diff for D4881: Move the `last_scheduled` ts from ListedOrigin to OriginVisitStatus.

Use olasd's version os the SQL query

Jan 19 2021, 4:14 PM
douardda added inline comments to D4881: Move the `last_scheduled` ts from ListedOrigin to OriginVisitStatus.
Jan 19 2021, 3:50 PM
douardda added inline comments to D4881: Move the `last_scheduled` ts from ListedOrigin to OriginVisitStatus.
Jan 19 2021, 3:46 PM
douardda added inline comments to D4856: Introduce scaffolding for a scheduler simulator.
Jan 19 2021, 3:43 PM
douardda accepted D4856: Introduce scaffolding for a scheduler simulator.

overall looks good to me, but it could benefit from more comments and explanations. Not easy to get in as is.

Jan 19 2021, 3:32 PM
douardda added inline comments to D4856: Introduce scaffolding for a scheduler simulator.
Jan 19 2021, 3:28 PM
douardda closed D4739: Add a 'Data model and specifications' section in the main index.
Jan 19 2021, 3:21 PM
douardda committed rDDOC26329c513452: Add a 'Data model and specifications' section in the main index (authored by douardda).
Add a 'Data model and specifications' section in the main index
Jan 19 2021, 3:21 PM
douardda updated the diff for D4739: Add a 'Data model and specifications' section in the main index.

rebse

Jan 19 2021, 3:20 PM
douardda added inline comments to D4856: Introduce scaffolding for a scheduler simulator.
Jan 19 2021, 2:58 PM
douardda added inline comments to D4856: Introduce scaffolding for a scheduler simulator.
Jan 19 2021, 2:56 PM
douardda updated the diff for D4881: Move the `last_scheduled` ts from ListedOrigin to OriginVisitStatus.

forget the migration script

Jan 19 2021, 2:51 PM
douardda requested review of D4881: Move the `last_scheduled` ts from ListedOrigin to OriginVisitStatus.
Jan 19 2021, 2:51 PM
douardda added a revision to T2444: Implement the scheduling policy for the recurrent visit scheduler: D4881: Move the `last_scheduled` ts from ListedOrigin to OriginVisitStatus.
Jan 19 2021, 2:49 PM · Sprint 2021 01, Scheduling utilities
douardda accepted D4879: requirements: Make swh.journal and optional dependency.

lgtm

Jan 19 2021, 1:49 PM

Jan 18 2021

douardda added a comment to T2974: Define (and implement) scheduler performance metrics.

thanks, looks a good starting point.

Jan 18 2021, 4:36 PM · Sprint 2021 01, Archive coverage, Scheduling utilities

Jan 15 2021

douardda created P922 (An Untitled Masterwork).
Jan 15 2021, 11:44 AM

Jan 13 2021

douardda triaged T2970: Make swh-journal tests not depend on swh-model any more as Normal priority.
Jan 13 2021, 4:48 PM · Journal
douardda created T2970: Make swh-journal tests not depend on swh-model any more.
Jan 13 2021, 4:48 PM · Journal
douardda claimed T2964: Adapt origin_visit_status_(get|add) api to deal with the visit_type.
Jan 13 2021, 11:39 AM · Storage manager, Sprint 2021 01
douardda moved T2964: Adapt origin_visit_status_(get|add) api to deal with the visit_type from todo to in-progress on the Sprint 2021 01 board.
Jan 13 2021, 11:39 AM · Storage manager, Sprint 2021 01
douardda changed the status of T2964: Adapt origin_visit_status_(get|add) api to deal with the visit_type, a subtask of T2443: Implement a bulk-queryable cache of latest visits for use by the recurrent visit scheduler, from Open to Work in Progress.
Jan 13 2021, 11:39 AM · Sprint 2021 01, Scheduling utilities
douardda changed the status of T2964: Adapt origin_visit_status_(get|add) api to deal with the visit_type from Open to Work in Progress.
Jan 13 2021, 11:39 AM · Storage manager, Sprint 2021 01
douardda closed D4826: Allow to use the JAVA_HOME environment for cassandra tests.
Jan 13 2021, 11:05 AM
douardda committed rDSTO728c3eeaae84: Allow to use the JAVA_HOME environment for cassandra tests (authored by douardda).
Allow to use the JAVA_HOME environment for cassandra tests
Jan 13 2021, 11:05 AM
douardda triaged T2969: Make tests compatible with hypothesis 6 as Normal priority.
Jan 13 2021, 11:04 AM · Easy hack
douardda updated the diff for D4698: Add support for ExtID in the storage.

rebase

Jan 13 2021, 11:01 AM
douardda updated the diff for D4826: Allow to use the JAVA_HOME environment for cassandra tests.

rebase

Jan 13 2021, 10:57 AM
douardda closed D4850: Enforce hypothesis <6 to prevent test breakage.
Jan 13 2021, 10:55 AM
douardda committed rDSTO30945a5890d4: Enforce hypothesis <6 to prevent test breakage (authored by douardda).
Enforce hypothesis <6 to prevent test breakage
Jan 13 2021, 10:55 AM
douardda requested review of D4850: Enforce hypothesis <6 to prevent test breakage.
Jan 13 2021, 10:52 AM
douardda updated the diff for D4826: Allow to use the JAVA_HOME environment for cassandra tests.

Add a paragraph in the README file

Jan 13 2021, 9:45 AM
douardda closed D4825: Make the CREATE_TABLES_QUERIES in cassandra/schema.py an explicit list.
Jan 13 2021, 9:44 AM
douardda committed rDSTO74e6f58e2f9b: Make the CREATE_TABLES_QUERIES in cassandra/schema.py an explicit list (authored by douardda).
Make the CREATE_TABLES_QUERIES in cassandra/schema.py an explicit list
Jan 13 2021, 9:44 AM

Jan 12 2021

douardda added a project to T2961: Add a "not_found" value in OriginVisitStatus.status: Sprint 2021 01.
Jan 12 2021, 11:24 AM · Sprint 2021 01, Data Model
douardda triaged T2961: Add a "not_found" value in OriginVisitStatus.status as Normal priority.
Jan 12 2021, 11:24 AM · Sprint 2021 01, Data Model

Jan 8 2021

douardda updated the diff for D4807: Add an ExtID object.

same but with all files commited

Jan 8 2021, 3:44 PM
douardda updated the diff for D4807: Add an ExtID object.

fix hypothesis strategies tests

Jan 8 2021, 3:41 PM
douardda added inline comments to D4807: Add an ExtID object.
Jan 8 2021, 3:11 PM
douardda updated the diff for D4807: Add an ExtID object.

add a unique_key method to ExtID and some tests

Jan 8 2021, 3:08 PM
douardda requested review of D4826: Allow to use the JAVA_HOME environment for cassandra tests.
Jan 8 2021, 2:38 PM
douardda requested review of D4825: Make the CREATE_TABLES_QUERIES in cassandra/schema.py an explicit list.
Jan 8 2021, 2:26 PM

Jan 7 2021

douardda created P916 (An Untitled Masterwork).
Jan 7 2021, 3:25 PM
douardda created P915 (An Untitled Masterwork).
Jan 7 2021, 3:05 PM

Jan 6 2021

douardda updated the diff for D4698: Add support for ExtID in the storage.

Add unicity index and corresponding test

Jan 6 2021, 5:35 PM
douardda updated the diff for D4698: Add support for ExtID in the storage.

Rewrite SQL queries a bit better (thx olasd and vlorentz)

Jan 6 2021, 4:39 PM
douardda added inline comments to D4698: Add support for ExtID in the storage.
Jan 6 2021, 4:35 PM
douardda added inline comments to D4698: Add support for ExtID in the storage.
Jan 6 2021, 3:49 PM
douardda added inline comments to D4766: [WIP] git bare revision cooker.
Jan 6 2021, 10:34 AM · Vault
douardda added inline comments to D4698: Add support for ExtID in the storage.
Jan 6 2021, 10:01 AM
douardda added a comment to T2089: Write user stories entering the SWH world and its documentation .

This list of user stories is something that can be written in a wiki.
@douardda or do you prefer having this list of scenarios in the docs ( for example in: docs.softwareheritage.org/user-stories)

Jan 6 2021, 9:44 AM · Documentation
douardda added a comment to T2827: Deploy an instance of hedgedoc.

Also, how is the authentication made?

Jan 6 2021, 9:25 AM · System administration
douardda added a comment to T2827: Deploy an instance of hedgedoc.

I see in the inventory that this VM has 8GB of RAM and 64GB of storage, isn't it a bit overkill?

Jan 6 2021, 9:24 AM · System administration
douardda added a comment to T2779: Put information (client, collection and deposit-id) inside metadata for metadata-only deposit.

If we can have metadata on metadata, then we can also have metadata on metadata on metadata, and metadata on metadata on metadata on metadata, ...

Jan 6 2021, 9:17 AM · Metadata workflow, SWORD deposit

Jan 5 2021

douardda updated the summary of D4698: Add support for ExtID in the storage.
Jan 5 2021, 6:59 PM
douardda updated the summary of D4698: Add support for ExtID in the storage.
Jan 5 2021, 5:21 PM
douardda updated the summary of D4698: Add support for ExtID in the storage.
Jan 5 2021, 5:19 PM
douardda retitled D4698: Add support for ExtID in the storage from [WIP][RFC] Add a revision_id_from_vcs() method to the Storage to [WIP][RFC] Add support for ExtID in the storage.
Jan 5 2021, 5:18 PM
douardda requested review of D4807: Add an ExtID object.
Jan 5 2021, 5:18 PM
douardda added a revision to T2849: Design and implement a mapping from "original VCS ids" to SWHIDs to help incremental loaders: D4807: Add an ExtID object.
Jan 5 2021, 5:17 PM · Storage manager
douardda updated the diff for D4698: Add support for ExtID in the storage.

Refactor the API and implementation so ExtID are not created as part of revision_add()

Jan 5 2021, 5:13 PM
douardda added a comment to T2912: Next generation archive counters.

I'm also having the "full journal" approach in mind after a quick reading of this neat proposal :-)

Jan 5 2021, 4:24 PM · Roadmap 2021, System administration, Monitoring, Web app
douardda requested changes to D4731: WIP Configuration system.

not finished, but first burst of comments

Jan 5 2021, 2:42 PM · feedback-required, Core & foundations
douardda committed rDSCH619100eaf2c3: Add a cli section to the doc (authored by douardda).
Add a cli section to the doc
Jan 5 2021, 11:57 AM
douardda committed rDOBJSRPLa74defcfd8e9: Add a cli section to the doc (authored by douardda).
Add a cli section to the doc
Jan 5 2021, 11:56 AM
douardda committed rDOBJSf27f21b8bcda: Add a cli section to the doc (authored by douardda).
Add a cli section to the doc
Jan 5 2021, 11:55 AM
douardda committed rDLSb1811f9f8a06: Add a cli section to the doc (authored by douardda).
Add a cli section to the doc
Jan 5 2021, 11:53 AM
douardda committed rDDEP0dbf0282b225: Add a cli section in the doc (authored by douardda).
Add a cli section in the doc
Jan 5 2021, 11:50 AM

Jan 4 2021

douardda added a comment to T2779: Put information (client, collection and deposit-id) inside metadata for metadata-only deposit.

I don't like 1/ at all, and 2 seems indeed a burden for clients...

Jan 4 2021, 9:16 PM · Metadata workflow, SWORD deposit
douardda committed rDVAUb2e17a95fef9: Add a cli section in the doc (authored by douardda).
Add a cli section in the doc
Jan 4 2021, 12:56 PM
douardda closed D4767: Add a cli section in the doc.
Jan 4 2021, 12:53 PM
douardda committed rDSTO2b35198d3087: Add a cli section in the doc (authored by douardda).
Add a cli section in the doc
Jan 4 2021, 12:53 PM
douardda committed rDSEA7e10b4decc15: Add a cli section in the doc (authored by douardda).
Add a cli section in the doc
Jan 4 2021, 12:50 PM
douardda committed rDLDBASE6adacbdbb098: Add a cli section in the doc (authored by douardda).
Add a cli section in the doc
Jan 4 2021, 11:57 AM
douardda added a comment to D4758: serializers: Deserialize as lists instead of tuples.

Sorry @douardda, but I'm going to assume you are fine with this diff, because I'd really like this to work before Vincent goes on vacation

Jan 4 2021, 11:31 AM
douardda committed rDCIDX3baf8bb91978: Add a cli section in the doc (authored by douardda).
Add a cli section in the doc
Jan 4 2021, 10:53 AM

Dec 18 2020

douardda created D4769: Add a quick presentation/architecture doc on the mirror.
Dec 18 2020, 1:46 PM
douardda updated the diff for D4767: Add a cli section in the doc.

replace deprecated :show-nested: option by :nested:

Dec 18 2020, 1:42 PM
douardda updated the diff for D4767: Add a cli section in the doc.

and fix the click object name to document

Dec 18 2020, 12:51 PM
douardda updated the diff for D4767: Add a cli section in the doc.

fix the :prog: flag

Dec 18 2020, 12:43 PM
douardda created D4767: Add a cli section in the doc.
Dec 18 2020, 12:34 PM
douardda added a comment to D4758: serializers: Deserialize as lists instead of tuples.

It looks to me that this really about

Dec 18 2020, 10:52 AM

Dec 17 2020

douardda committed rMSLD15fd5fbdde24: Final version of the EOSC-Pillar F2F presentation (authored by douardda).
Final version of the EOSC-Pillar F2F presentation
Dec 17 2020, 2:32 PM
douardda committed rMSLDb7d1f9868e3f: Presentation for EOSC-Pillar F2F meeting (authored by douardda).
Presentation for EOSC-Pillar F2F meeting
Dec 17 2020, 2:31 PM
douardda committed rMSLDe83bf2dbfeb6: Fix indentation pb in swh-scientific-preservation.org (authored by douardda).
Fix indentation pb in swh-scientific-preservation.org
Dec 17 2020, 2:31 PM
douardda committed rMSLD5f53ad129464: Update numbers of archived objects in under-the-hood-picture.org (authored by douardda).
Update numbers of archived objects in under-the-hood-picture.org
Dec 17 2020, 2:31 PM

Dec 15 2020

douardda created D4739: Add a 'Data model and specifications' section in the main index.
Dec 15 2020, 10:32 AM
douardda committed rDDOC83a7f94474c1: Add a documentation/specification of the journal messages formats (authored by douardda).
Add a documentation/specification of the journal messages formats
Dec 15 2020, 10:32 AM
douardda closed T2818: Document the journal topics as Resolved by committing rDDOC83a7f94474c1: Add a documentation/specification of the journal messages formats.
Dec 15 2020, 10:32 AM · Documentation
douardda closed D4633: Add a documentation/specification of the journal messages formats.
Dec 15 2020, 10:32 AM
douardda updated the diff for D4633: Add a documentation/specification of the journal messages formats.

rework the specs according to zack's comments (hopefully) + rebase

Dec 15 2020, 10:27 AM

Dec 14 2020

douardda added inline comments to D4633: Add a documentation/specification of the journal messages formats.
Dec 14 2020, 10:45 AM
douardda added inline comments to D4633: Add a documentation/specification of the journal messages formats.
Dec 14 2020, 10:30 AM

Dec 11 2020

douardda added a comment to D4698: Add support for ExtID in the storage.

I completely agree with @olasd 's comment.

And why is it restricted to revisions? Why not have an endpoint that returns an arbitrary SWHID?

Dec 11 2020, 2:53 PM
douardda added a comment to D4720: developer-setup: update system dependencies.

@douardda Why the not on the version?

Dec 11 2020, 1:42 PM
douardda accepted D4720: developer-setup: update system dependencies.

do not fix the pg version otherwise ok

Dec 11 2020, 12:23 PM
douardda committed rDCORE777ea186fa8d: Encode datetime as Timestamp in msgpack (authored by douardda).
Encode datetime as Timestamp in msgpack
Dec 11 2020, 10:09 AM
douardda committed rDCOREe722afbf82e3: Split serializers ENCODERS/DECODERS to extract JSON specific ones (authored by douardda).
Split serializers ENCODERS/DECODERS to extract JSON specific ones
Dec 11 2020, 10:09 AM
douardda committed rDCORE10b997ac1c86: Use json_dumps/loads in test_serializers.py (authored by douardda).
Use json_dumps/loads in test_serializers.py
Dec 11 2020, 10:09 AM