Page MenuHomeSoftware Heritage
Feed Advanced Search

Jun 21 2021

douardda updated the diff for D5892: Add support for (topological) branches and merges in generate_repo.py.

rebase

Jun 21 2021, 4:45 PM
douardda updated the diff for D5894: Allow to add extra origins and snapshots in generated test storages.

typos

Jun 21 2021, 4:43 PM
douardda added inline comments to D5894: Allow to add extra origins and snapshots in generated test storages.
Jun 21 2021, 4:39 PM
douardda accepted D5886: Refactor origin-revision layer.

ok but some questions/remarks have not been addressed...

Jun 21 2021, 4:37 PM
douardda accepted D5880: Update methods associated to the origin-revision layer.

Thanks for the DatetimeCache & co.

Jun 21 2021, 4:32 PM
douardda added a comment to T3382: Save process seems to be stuck.

I agree having access to the logs of the task (more or less) in real-time would be very handy (as one can expect on any CI-like tool nowadays).

Jun 21 2021, 10:50 AM · Save Code Now
douardda added inline comments to D5886: Refactor origin-revision layer.
Jun 21 2021, 10:20 AM

Jun 18 2021

douardda added inline comments to D5880: Update methods associated to the origin-revision layer.
Jun 18 2021, 5:36 PM
douardda added inline comments to D5880: Update methods associated to the origin-revision layer.
Jun 18 2021, 2:49 PM
douardda accepted D5862: Rework ArchiveInterface.

but please add a comment in the ArchivePostgreSQL's version of snapshot_get_heads explaining why it's (for now) a duplication of the other implementation, thanks

Jun 18 2021, 2:34 PM
douardda added a comment to D5862: Rework ArchiveInterface.

OK for the first two items, but I don't agree on the third one. The idea is to replace one of them by a direct SQL query in the near future so reworking this will be useless. I just didn't implement the query because I needed to move forward with the other stuff

Jun 18 2021, 2:31 PM
douardda accepted D5884: Fix bugs when retrieving parents in RevisionEntry.

thanks, the diff looks much simpler now :-)

Jun 18 2021, 2:26 PM
douardda added inline comments to D5884: Fix bugs when retrieving parents in RevisionEntry.
Jun 18 2021, 2:22 PM
douardda requested changes to D5886: Refactor origin-revision layer.

I know I am rambling, but could it come with some testing?

Jun 18 2021, 2:20 PM
douardda requested review of D5892: Add support for (topological) branches and merges in generate_repo.py.
Jun 18 2021, 12:35 PM
douardda updated the diff for D5894: Allow to add extra origins and snapshots in generated test storages.

use 'branches' instead of "revisions" as section in the yaml file

Jun 18 2021, 12:35 PM
douardda requested review of D5891: Refactor the generate_storage_from_git dataset creation tool.
Jun 18 2021, 12:32 PM
douardda requested review of D5894: Allow to add extra origins and snapshots in generated test storages.
Jun 18 2021, 12:29 PM
douardda committed rDJNLa06bab98b115: Add a StreamJournalWriter backend (authored by douardda).
Add a StreamJournalWriter backend
Jun 18 2021, 11:21 AM
douardda closed D5890: Add a StreamJournalWriter backend.
Jun 18 2021, 11:21 AM
douardda committed rDJNLa4ae96d12d2c: Better annotation for InMemoryJournalWriter's value_sanitizer (authored by douardda).
Better annotation for InMemoryJournalWriter's value_sanitizer
Jun 18 2021, 11:21 AM
douardda requested changes to D5880: Update methods associated to the origin-revision layer.

Mostly nitpicking comments, but I'd really prefer that:

  • the cache is kept properly typed
  • the cache clearing thing gets its own git revision
Jun 18 2021, 11:06 AM
douardda added inline comments to D5890: Add a StreamJournalWriter backend.
Jun 18 2021, 10:49 AM
douardda updated the diff for D5890: Add a StreamJournalWriter backend.

Add a revision to fix the annotation of InMemory's value_sanitizer

Jun 18 2021, 10:48 AM
douardda added inline comments to D5890: Add a StreamJournalWriter backend.
Jun 18 2021, 10:37 AM
douardda updated the diff for D5890: Add a StreamJournalWriter backend.

small simplification in the docstring

Jun 18 2021, 10:34 AM
douardda updated the diff for D5890: Add a StreamJournalWriter backend.

use get_journal_writer in test_stream

Jun 18 2021, 10:31 AM
douardda updated the diff for D5890: Add a StreamJournalWriter backend.

fix docstring, thx ardumont

Jun 18 2021, 10:25 AM
douardda added inline comments to D5890: Add a StreamJournalWriter backend.
Jun 18 2021, 10:23 AM
douardda added inline comments to D5890: Add a StreamJournalWriter backend.
Jun 18 2021, 10:17 AM
douardda added inline comments to D5890: Add a StreamJournalWriter backend.
Jun 18 2021, 10:14 AM
douardda requested changes to D5862: Rework ArchiveInterface.

Thanks for the split. Almost there, but a few nitpicks/comments remains:

Jun 18 2021, 10:06 AM
douardda requested changes to D5884: Fix bugs when retrieving parents in RevisionEntry.

Thanks a lot for the split.

Jun 18 2021, 9:55 AM
douardda updated the diff for D5890: Add a StreamJournalWriter backend.

update the copyright in __init__.py

Jun 18 2021, 9:46 AM

Jun 17 2021

douardda committed rDPROV8ff1ab5860a6: Improve .gitignore (authored by douardda).
Improve .gitignore
Jun 17 2021, 8:47 PM
douardda retitled D5890: Add a StreamJournalWriter backend from Add a StreamJournalWrtier backend to Add a StreamJournalWriter backend.
Jun 17 2021, 8:39 PM
douardda requested review of D5890: Add a StreamJournalWriter backend.
Jun 17 2021, 7:48 PM
douardda requested review of D5885: Add support for (topological) branches and merges in generate_repo.py.
Jun 17 2021, 3:18 PM

Jun 16 2021

douardda updated the task description for T3384: create an online service allowing to compute SWHIDs of submitted content.
Jun 16 2021, 11:59 AM · Web app
douardda updated the task description for T3384: create an online service allowing to compute SWHIDs of submitted content.
Jun 16 2021, 11:59 AM · Web app
douardda triaged T3384: create an online service allowing to compute SWHIDs of submitted content as Normal priority.
Jun 16 2021, 11:52 AM · Web app
douardda closed D5872: Use the flavor in the db to choose the ProvenanceDB class to instanciate.
Jun 16 2021, 9:07 AM
douardda committed rDPROVc9d1369ba165: Use the flavor in the db to choose the ProvenanceDB class to instanciate (authored by douardda).
Use the flavor in the db to choose the ProvenanceDB class to instanciate
Jun 16 2021, 9:07 AM
douardda closed D5870: Improve DB schema naming.
Jun 16 2021, 9:07 AM
douardda closed D5842: Refactor the provenanceDB.insert_relation().
Jun 16 2021, 9:06 AM
douardda committed rDPROV8d23dac058f6: Improve DB schema naming (authored by douardda).
Improve DB schema naming
Jun 16 2021, 9:06 AM
douardda committed rDPROVe27c7d11f2ce: Refactor the provenanceDB.insert_relation() methods (authored by douardda).
Refactor the provenanceDB.insert_relation() methods
Jun 16 2021, 9:06 AM
douardda closed D5829: Refactor the cache handling in ProvenanceDB.
Jun 16 2021, 9:06 AM
douardda committed rDPROVac8dc036bcc6: Refactor the cache handling in ProvenanceDB (authored by douardda).
Refactor the cache handling in ProvenanceDB
Jun 16 2021, 9:06 AM

Jun 15 2021

douardda added inline comments to D5862: Rework ArchiveInterface.
Jun 15 2021, 4:57 PM
douardda requested review of D5872: Use the flavor in the db to choose the ProvenanceDB class to instanciate.
Jun 15 2021, 4:01 PM
douardda updated the diff for D5870: Improve DB schema naming.

improve commit message

Jun 15 2021, 3:16 PM
douardda updated the diff for D5870: Improve DB schema naming.

rebase

Jun 15 2021, 3:09 PM
douardda updated the diff for D5842: Refactor the provenanceDB.insert_relation().

rebase

Jun 15 2021, 3:08 PM
douardda updated the diff for D5829: Refactor the cache handling in ProvenanceDB.

rebase

Jun 15 2021, 3:08 PM
douardda closed D5871: Remove deprecated cli create command.
Jun 15 2021, 3:07 PM
douardda committed rDPROV8c536b8d502a: Remove deprecated cli create command (authored by douardda).
Remove deprecated cli create command
Jun 15 2021, 3:07 PM
douardda requested review of D5871: Remove deprecated cli create command.
Jun 15 2021, 3:06 PM
douardda closed D5861: Add a TimestampWithTimezone.to_datetime() method.
Jun 15 2021, 2:46 PM
douardda committed rDMOD8ec0cf685bfb: Add a TimestampWithTimezone.to_datetime() method (authored by douardda).
Add a TimestampWithTimezone.to_datetime() method
Jun 15 2021, 2:46 PM
douardda closed D5868: Fix normalize_timestamp() for datetime < epoch with microsecond>0.
Jun 15 2021, 2:46 PM
douardda committed rDMOD428c170496ef: Fix normalize_timestamp() for datetime < epoch with microsecond>0 (authored by douardda).
Fix normalize_timestamp() for datetime < epoch with microsecond>0
Jun 15 2021, 2:46 PM
douardda updated the summary of D5829: Refactor the cache handling in ProvenanceDB.
Jun 15 2021, 12:18 PM
douardda requested review of D5870: Improve DB schema naming.
Jun 15 2021, 12:15 PM
douardda retitled D5842: Refactor the provenanceDB.insert_relation() from Refactor the provenanceDB.insert_location() and insert_all() methods to Refactor the provenanceDB.insert_relation().
Jun 15 2021, 12:12 PM
douardda updated the diff for D5842: Refactor the provenanceDB.insert_relation().

rebase and adapt to current master

Jun 15 2021, 12:10 PM
douardda updated the diff for D5829: Refactor the cache handling in ProvenanceDB.

rebase on current master

Jun 15 2021, 12:09 PM
douardda requested review of D5868: Fix normalize_timestamp() for datetime < epoch with microsecond>0.
Jun 15 2021, 11:27 AM
douardda updated the diff for D5861: Add a TimestampWithTimezone.to_datetime() method.

rebase

Jun 15 2021, 11:24 AM
douardda updated the diff for D5861: Add a TimestampWithTimezone.to_datetime() method.

revert the wrong fix but make it depend on D5868 instead

Jun 15 2021, 10:49 AM

Jun 14 2021

douardda updated the diff for D5861: Add a TimestampWithTimezone.to_datetime() method.

add tests for dates < epoch and microseconds > 0...

Jun 14 2021, 5:29 PM
douardda accepted D5863: Refactor RevisionEntry's parents iterator.

please take care of not including unrelated changes in your revisions/diffs

Jun 14 2021, 2:49 PM
douardda requested changes to D5862: Rework ArchiveInterface.
Jun 14 2021, 2:45 PM
douardda updated the diff for D5861: Add a TimestampWithTimezone.to_datetime() method.

docstring, annotation and better testing

Jun 14 2021, 2:25 PM
douardda requested review of D5861: Add a TimestampWithTimezone.to_datetime() method.
Jun 14 2021, 1:52 PM
douardda accepted D5847: Improve out-of-order revision processing.
Jun 14 2021, 10:43 AM
douardda accepted D5845: Add tests for isochrone graph topology.
Jun 14 2021, 10:42 AM
douardda accepted D5822: Refactor origin-revision layer.

There is still the if revision (RevisonEntry.parents) that needs a fix, otherwise ok.

Jun 14 2021, 10:41 AM

Jun 11 2021

douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 11 2021, 3:12 PM
douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 11 2021, 3:10 PM
douardda added inline comments to D5845: Add tests for isochrone graph topology.
Jun 11 2021, 2:38 PM
douardda added inline comments to D5822: Refactor origin-revision layer.
Jun 11 2021, 2:30 PM
douardda accepted D5849: Reorganize code.
Jun 11 2021, 12:39 PM
douardda accepted D5848: First stage of refactoring for the Provenance backend.

I still disagree with some parts of this (the blob vs. blobid naming stuff, and more importantly the whole data dict being given as argument of insert_relation() when only one element of this dict is actually needed), but meh.

Jun 11 2021, 12:37 PM
douardda requested changes to D5822: Refactor origin-revision layer.

There are several comments that have not been addressed

Jun 11 2021, 12:26 PM
douardda requested changes to D5845: Add tests for isochrone graph topology.

I won't discuss more the file format for the tests, it's not that critical, but please remove the implementation of __hash__ methods if they are actually not needed, and simplify the code the the __eq__ as suggested.

Jun 11 2021, 12:22 PM
douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 11 2021, 11:25 AM
douardda added inline comments to D5845: Add tests for isochrone graph topology.
Jun 11 2021, 11:18 AM
douardda requested changes to D5847: Improve out-of-order revision processing.
Jun 11 2021, 11:11 AM
douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 11 2021, 11:09 AM
douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 11 2021, 11:06 AM
douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 11 2021, 11:04 AM
douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 11 2021, 10:56 AM
douardda added inline comments to D5842: Refactor the provenanceDB.insert_relation().
Jun 11 2021, 9:15 AM

Jun 10 2021

douardda requested changes to D5845: Add tests for isochrone graph topology.

Overall ok, but a few things:

  • I don't think we need the __hash__ methods at all (unless you want to rewrite the __eq__ ones using hash comparison)
  • we usually don't put print statement in tests
  • I'd prefer the more explicit file format (see inline comments), then it does not really need to be documented in the README file (but the comment in the code needs to be removed)
Jun 10 2021, 5:35 PM
douardda added inline comments to D5845: Add tests for isochrone graph topology.
Jun 10 2021, 5:21 PM
douardda requested changes to D5848: First stage of refactoring for the Provenance backend.

I may have other comments to make, but definitely, I'd really prefer having 3 diffs here also...

Jun 10 2021, 4:11 PM
douardda requested changes to D5847: Improve out-of-order revision processing.

Actually, I would have much preferred this diff to be 4 diffs also ;-)

Jun 10 2021, 3:04 PM
douardda added inline comments to D5847: Improve out-of-order revision processing.
Jun 10 2021, 3:02 PM
douardda updated the diff for D5843: Add support for a denormalized version of the provenance DB.

rebase

Jun 10 2021, 2:54 PM