Page MenuHomeSoftware Heritage
Feed Advanced Search

Jun 1 2021

douardda updated the diff for D5772: Add a test for the build_isochrone_graph() function.

rebase

Jun 1 2021, 11:26 AM
douardda closed D5774: Replace ProvenanceDB.remove_cache by a dict of Set.
Jun 1 2021, 11:25 AM
douardda committed rDPROV5aa0314dd72d: Replace ProvenanceDB.remove_cache by a dict of Set (authored by douardda).
Replace ProvenanceDB.remove_cache by a dict of Set
Jun 1 2021, 11:25 AM
douardda added inline comments to D5780: Add a test for content_find_all().
Jun 1 2021, 11:24 AM
douardda added a comment to D5780: Add a test for content_find_all().

what about disabling E501 for the whole file, instead of repeating the comment? https://stackoverflow.com/a/64431741

Jun 1 2021, 11:15 AM
douardda updated the diff for D5774: Replace ProvenanceDB.remove_cache by a dict of Set.

rebase

Jun 1 2021, 11:00 AM
douardda added a comment to D5772: Add a test for the build_isochrone_graph() function.

Not sure if I follow what the test is doing since it not clear to me what's the content of storage_and_CMDBTS,

Jun 1 2021, 10:55 AM
douardda closed D5771: Replace the 'dates' argument of IsochroneNode() by a simple 'date' one.
Jun 1 2021, 10:42 AM
douardda committed rDPROV113e11031aa5: Replace the 'dates' argument of IsochroneNode() by a simple 'date' one (authored by douardda).
Replace the 'dates' argument of IsochroneNode() by a simple 'date' one
Jun 1 2021, 10:42 AM

May 28 2021

douardda added inline comments to D5773: Refactor the isochrone graph computation.
May 28 2021, 11:06 AM
douardda added inline comments to D5781: Simplify DB queries in ProvenanceWithPathDB.content_find_(first|all).
May 28 2021, 10:51 AM
douardda updated subscribers of D5781: Simplify DB queries in ProvenanceWithPathDB.content_find_(first|all).
May 28 2021, 10:43 AM
douardda updated subscribers of D5780: Add a test for content_find_all().
May 28 2021, 10:42 AM
douardda updated subscribers of D5773: Refactor the isochrone graph computation.
May 28 2021, 10:42 AM
douardda updated subscribers of D5772: Add a test for the build_isochrone_graph() function.
May 28 2021, 10:41 AM
douardda added a reviewer for D5780: Add a test for content_find_all(): aeviso.
May 28 2021, 10:40 AM
douardda added inline comments to D5773: Refactor the isochrone graph computation.
May 28 2021, 10:31 AM

May 26 2021

douardda added a comment to D5773: Refactor the isochrone graph computation.

I'm not really sure this new algorithm does the same as the previous one. Some subtle things were changed and I have the filling the semantics are different now. Also, I found the previous version to be clearer, I rather stay with it

May 26 2021, 5:44 PM

May 25 2021

douardda requested review of D5781: Simplify DB queries in ProvenanceWithPathDB.content_find_(first|all).
May 25 2021, 4:52 PM
douardda requested review of D5780: Add a test for content_find_all().
May 25 2021, 4:49 PM
douardda updated the diff for D5774: Replace ProvenanceDB.remove_cache by a dict of Set.

rebase

May 25 2021, 4:34 PM
douardda updated the diff for D5773: Refactor the isochrone graph computation.

rebase

May 25 2021, 4:33 PM
douardda updated the diff for D5772: Add a test for the build_isochrone_graph() function.

rebase

May 25 2021, 4:33 PM
douardda updated the diff for D5771: Replace the 'dates' argument of IsochroneNode() by a simple 'date' one.

rebase + also apply to add_child()

May 25 2021, 4:32 PM
douardda committed rDPROV77fce4e59d41: Fix a couple of typos (authored by douardda).
Fix a couple of typos
May 25 2021, 4:31 PM
douardda updated the diff for D5774: Replace ProvenanceDB.remove_cache by a dict of Set.

rebase

May 25 2021, 3:26 PM
douardda updated the diff for D5773: Refactor the isochrone graph computation.

small improvement of a comment + type annotation for the local variable 'fdates'

May 25 2021, 3:26 PM
douardda added inline comments to D5769: client: Open a paginated list user deposits endpoint.
May 25 2021, 10:32 AM
douardda requested review of D5774: Replace ProvenanceDB.remove_cache by a dict of Set.
May 25 2021, 10:21 AM
douardda added a reviewer for D5773: Refactor the isochrone graph computation: aeviso.
May 25 2021, 10:20 AM
douardda requested review of D5773: Refactor the isochrone graph computation.
May 25 2021, 10:19 AM
douardda added a reviewer for D5772: Add a test for the build_isochrone_graph() function: aeviso.
May 25 2021, 10:19 AM
douardda requested review of D5772: Add a test for the build_isochrone_graph() function.
May 25 2021, 10:18 AM
douardda requested review of D5771: Replace the 'dates' argument of IsochroneNode() by a simple 'date' one.
May 25 2021, 10:16 AM

May 21 2021

douardda accepted D5750: cassandra: Add support for ScyllaDB.

consider the minor fix in the README file, otherwise ok, thanks!

May 21 2021, 10:27 AM
douardda added inline comments to D5743: azure: Specialize get_batch() to fetch objects concurrently.
May 21 2021, 10:23 AM

May 20 2021

douardda closed D5755: Fix snapshot entries in swh_model_data test data.
May 20 2021, 3:21 PM
douardda committed rDMOD4808fc2ae5ec: Fix snapshot entries in swh_model_data test data (authored by douardda).
Fix snapshot entries in swh_model_data test data
May 20 2021, 3:21 PM

May 19 2021

douardda requested review of D5755: Fix snapshot entries in swh_model_data test data.
May 19 2021, 3:24 PM
douardda triaged T3333: Document the different storage backends as Normal priority.
May 19 2021, 10:57 AM · Documentation, Storage manager
douardda requested changes to D5750: cassandra: Add support for ScyllaDB.

please also add a piece of documentation somewhere on this alt. "cassandra" backend config (aka. "how to use scylladb" or something).

May 19 2021, 10:51 AM
douardda added inline comments to D5743: azure: Specialize get_batch() to fetch objects concurrently.
May 19 2021, 10:42 AM

May 18 2021

douardda closed D5747: Make the TenaciousProxyStorage also handle content_add_metadata.
May 18 2021, 4:27 PM
douardda committed rDSTO0ed4a975d1d0: Make the TenaciousProxyStorage also handle content_add_metadata (authored by douardda).
Make the TenaciousProxyStorage also handle content_add_metadata
May 18 2021, 4:27 PM
douardda requested review of D5747: Make the TenaciousProxyStorage also handle content_add_metadata.
May 18 2021, 1:04 PM
douardda accepted D5746: Fix tests due to some dependencies upgrade.

tests are green, so it should be ok I guess

May 18 2021, 1:02 PM

May 17 2021

douardda accepted D5657: Spool large packfiles to disk instead of consuming tons of memory.

LGTM, any reason for not landing it?

May 17 2021, 1:53 PM

May 11 2021

douardda created P1040 (An Untitled Masterwork).
May 11 2021, 12:30 PM
douardda committed rDPROV0883791f9823: Update to swh-core 0.14 (authored by douardda).
Update to swh-core 0.14
May 11 2021, 12:18 PM
douardda accepted D5736: Stop setting MetadataAuthority.metadata and MetadataFetcher.metadata.
May 11 2021, 11:55 AM
douardda added inline comments to D5658: git_bare: Deduplicate object downloads and writes.
May 11 2021, 9:48 AM

May 10 2021

douardda created P1039 (An Untitled Masterwork).
May 10 2021, 5:43 PM
douardda committed rDSTOb487a21f2708: Deprecate the "local" storage cls in favor of "postgresql" (authored by douardda).
Deprecate the "local" storage cls in favor of "postgresql"
May 10 2021, 4:32 PM
douardda closed D5721: Move all proxy storages in swh/storage/proxies/ and deprecate "local" cls.
May 10 2021, 4:32 PM
douardda committed rDSTO910525392c51: Move all proxy storages in swh/storage/proxies/ (authored by douardda).
Move all proxy storages in swh/storage/proxies/
May 10 2021, 4:32 PM
douardda requested review of D5721: Move all proxy storages in swh/storage/proxies/ and deprecate "local" cls.
May 10 2021, 3:05 PM

May 7 2021

douardda closed D5680: Make the TenaciousProxyStorage retry when a single object add fails.
May 7 2021, 1:55 PM
douardda committed rDSTO761709957a40: Make the TenaciousProxyStorage retry when a single object add fails (authored by douardda).
Make the TenaciousProxyStorage retry when a single object add fails
May 7 2021, 1:55 PM
douardda updated the diff for D5680: Make the TenaciousProxyStorage retry when a single object add fails.

rebase

May 7 2021, 1:47 PM

May 6 2021

douardda accepted D5702: Rename pytest_postgresql_get_config; names starting with 'pytest_' in pytest plugins are reserved.
May 6 2021, 3:32 PM
douardda updated the diff for D5680: Make the TenaciousProxyStorage retry when a single object add fails.

rebase

May 6 2021, 2:48 PM
douardda updated the diff for D5680: Make the TenaciousProxyStorage retry when a single object add fails.

Make the number of (single-object insertion) retries configurable

May 6 2021, 2:47 PM
douardda added inline comments to D5680: Make the TenaciousProxyStorage retry when a single object add fails.
May 6 2021, 2:31 PM

May 5 2021

douardda requested review of D5680: Make the TenaciousProxyStorage retry when a single object add fails.
May 5 2021, 12:53 PM
douardda closed D5671: Make postgresql's origin_add not raise an error in case of conflict.
May 5 2021, 12:44 PM
douardda committed rDSTO77ef651d9582: Make postgresql's origin_add not raise an error in case of conflict (authored by douardda).
Make postgresql's origin_add not raise an error in case of conflict
May 5 2021, 12:43 PM
douardda accepted D5656: Add a naive git bare cooker.
May 5 2021, 12:40 PM
douardda accepted D5670: Stop storing authority/fetcher metadata..
May 5 2021, 12:34 PM
douardda updated the diff for D5671: Make postgresql's origin_add not raise an error in case of conflict.

rebased

May 5 2021, 12:33 PM
douardda added inline comments to D5671: Make postgresql's origin_add not raise an error in case of conflict.
May 5 2021, 12:30 PM
douardda closed D3334: Add a new TenaciousProxyStorage.
May 5 2021, 12:18 PM
douardda committed rDSTOffb38f71d9b6: Add a new TenaciousProxyStorage (authored by douardda).
Add a new TenaciousProxyStorage
May 5 2021, 12:18 PM
douardda updated the diff for D3334: Add a new TenaciousProxyStorage.

remove dead code and improve a bit the commit message

May 5 2021, 11:59 AM
douardda added inline comments to D5671: Make postgresql's origin_add not raise an error in case of conflict.
May 5 2021, 11:56 AM
douardda added inline comments to D3334: Add a new TenaciousProxyStorage.
May 5 2021, 11:49 AM
douardda created P1034 (An Untitled Masterwork).
May 5 2021, 10:05 AM

May 4 2021

douardda added inline comments to D5656: Add a naive git bare cooker.
May 4 2021, 6:17 PM
douardda accepted D5659: Make the SourceForge lister incremental.

besides the type aliasing statements that I find a bit confusing, LGTM.

May 4 2021, 5:17 PM
douardda accepted D5628: Replace old loader with the new one.

I'm not very fond of the name of all this (from_disk, HgLoaderFromDisk, etc.) since it makes people think it cannot deal with remote hg repos (which the HgLoaderFromDisk does, but this is not really advertized, as far as I can tell).

May 4 2021, 4:53 PM
douardda added inline comments to D5628: Replace old loader with the new one.
May 4 2021, 4:42 PM
douardda requested review of D5671: Make postgresql's origin_add not raise an error in case of conflict.
May 4 2021, 4:23 PM
douardda updated the diff for D3334: Add a new TenaciousProxyStorage.

Answer (most) vlorentz comments/remark

May 4 2021, 3:32 PM
douardda added inline comments to D3334: Add a new TenaciousProxyStorage.
May 4 2021, 3:00 PM
douardda updated the diff for D3334: Add a new TenaciousProxyStorage.

rebase and improve logging messages

May 4 2021, 12:10 PM
douardda triaged T3303: Replaying REMD topics is broken as High priority.
May 4 2021, 10:11 AM · Mirror

May 3 2021

douardda added inline comments to D5646: Make buffer and validate proxy storage also handle other object types.
May 3 2021, 3:34 PM
douardda added a comment to D5648: Add a bit of logging in the buffer proxy storage.

What's the motivation?

May 3 2021, 3:33 PM
douardda accepted D5582: cassandra: Add 'allow_overwrite' option, to allow updating objects.
May 3 2021, 2:14 PM

Apr 29 2021

douardda updated the diff for D5648: Add a bit of logging in the buffer proxy storage.

rebase

Apr 29 2021, 4:19 PM
douardda updated the diff for D5646: Make buffer and validate proxy storage also handle other object types.

and MetadataXXX

Apr 29 2021, 4:19 PM
douardda updated the diff for D5648: Add a bit of logging in the buffer proxy storage.

rebase

Apr 29 2021, 4:02 PM
douardda updated the diff for D5646: Make buffer and validate proxy storage also handle other object types.

and the origin_visit_status_add() specific implementation as well...

Apr 29 2021, 4:01 PM
douardda requested review of D5648: Add a bit of logging in the buffer proxy storage.
Apr 29 2021, 3:55 PM
douardda published D5646: Make buffer and validate proxy storage also handle other object types for review.
Apr 29 2021, 3:47 PM
douardda committed rDSTO92d551a4a515: Normalize all Storage.xxx_add() methods to return a summary (authored by douardda).
Normalize all Storage.xxx_add() methods to return a summary
Apr 29 2021, 3:08 PM
douardda closed D5643: Normalize all Storage.xxx_add() methods to return a summary.
Apr 29 2021, 3:08 PM
douardda committed rDSTOff7ecb4b8445: Properly annotate output of Storage.xxx_add() methods as Dict[str, int] (authored by douardda).
Properly annotate output of Storage.xxx_add() methods as Dict[str, int]
Apr 29 2021, 3:08 PM
douardda requested review of D5643: Normalize all Storage.xxx_add() methods to return a summary.
Apr 29 2021, 12:58 PM
douardda requested changes to D5582: cassandra: Add 'allow_overwrite' option, to allow updating objects.

I'm not fond of the 'check_missing' name for the argument, but would prefer 'allow_overwrite'.

Apr 29 2021, 9:53 AM

Apr 28 2021

douardda closed D5634: Add a fixer for ExtrinsicRawMetadata.
Apr 28 2021, 3:00 PM