Page MenuHomeSoftware Heritage
Feed Advanced Search

Nov 26 2021

aeviso requested review of D6697: Add tests for conflict resolution functions.
Nov 26 2021, 5:14 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Nov 26 2021, 5:07 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Nov 26 2021, 5:07 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Nov 26 2021, 4:38 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

squash commits

Nov 26 2021, 4:38 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Nov 26 2021, 4:25 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Add documentation for the remote storage backend
Nov 26 2021, 4:23 PM

Nov 24 2021

aeviso closed D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.
Nov 24 2021, 1:45 PM
aeviso committed rDPROV579c3bd35e56: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor (authored by aeviso).
Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor
Nov 24 2021, 1:45 PM
aeviso closed D6578: Add support to filter files a minimum size.
Nov 24 2021, 1:45 PM
aeviso closed D6680: Reorder flushing operations to avoid unnecessary updated in the storage.
Nov 24 2021, 1:45 PM
aeviso committed rDPROV966fe3e8d506: Reorder flushing operations to avoid unnecessary updated in the storage (authored by aeviso).
Reorder flushing operations to avoid unnecessary updated in the storage
Nov 24 2021, 1:45 PM
aeviso committed rDPROV584845d3715e: Add support to filter files a minimum size (authored by aeviso).
Add support to filter files a minimum size
Nov 24 2021, 1:45 PM
aeviso closed D6679: Rework conftest and improve type annotations.
Nov 24 2021, 1:45 PM
aeviso committed rDPROV62a31f6f986b: Rework conftest and improve type annotations (authored by aeviso).
Rework conftest and improve type annotations
Nov 24 2021, 1:45 PM
aeviso updated the summary of D6339: Add support for remote backend on existing storage tests.
Nov 24 2021, 11:25 AM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Nov 24 2021, 11:25 AM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Nov 24 2021, 11:24 AM
aeviso updated the diff for D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.

rebase

Nov 24 2021, 11:21 AM
aeviso updated the summary of D6578: Add support to filter files a minimum size.
Nov 24 2021, 11:20 AM
aeviso updated the diff for D6578: Add support to filter files a minimum size.

rebase

Nov 24 2021, 11:20 AM
aeviso requested review of D6680: Reorder flushing operations to avoid unnecessary updated in the storage.
Nov 24 2021, 11:19 AM
aeviso updated the summary of D6339: Add support for remote backend on existing storage tests.
Nov 24 2021, 11:19 AM
aeviso requested review of D6679: Rework conftest and improve type annotations.
Nov 24 2021, 11:18 AM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Nov 24 2021, 11:17 AM

Nov 23 2021

aeviso accepted D6674: Adapt fill_storage for swh.storage 0.40.

I forgot the action in the previous submit. I'm good with the revision.
I can add the implement my comments later in another diff anyway.

Nov 23 2021, 4:02 PM
aeviso added inline comments to D6674: Adapt fill_storage for swh.storage 0.40.
Nov 23 2021, 3:59 PM
aeviso committed R230:e09f2618fc33: Add latest revision date to server stats (authored by aeviso).
Add latest revision date to server stats
Nov 23 2021, 1:58 PM

Nov 10 2021

aeviso updated the diff for D6578: Add support to filter files a minimum size.

rebase

Nov 10 2021, 11:10 AM

Oct 28 2021

aeviso added a comment to D6578: Add support to filter files a minimum size.

Looks good, but could you update the diff and commit message to give the motivation for the change?

Oct 28 2021, 3:23 PM
aeviso updated the diff for D6578: Add support to filter files a minimum size.

rebase

Oct 28 2021, 3:23 PM
aeviso updated the summary of D6578: Add support to filter files a minimum size.
Oct 28 2021, 3:22 PM
aeviso closed D6577: Fix `yaml.load` deprecated warning.
Oct 28 2021, 2:48 PM
aeviso committed rDPROV30d8899bcfd6: Fix `yaml.load` deprecated warning (authored by aeviso).
Fix `yaml.load` deprecated warning
Oct 28 2021, 2:48 PM
aeviso updated the diff for D6578: Add support to filter files a minimum size.

rebase

Oct 28 2021, 2:41 PM
aeviso requested review of D6578: Add support to filter files a minimum size.
Oct 28 2021, 2:34 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Oct 28 2021, 2:26 PM
aeviso requested review of D6577: Fix `yaml.load` deprecated warning.
Oct 28 2021, 2:26 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Improve timeout logic on remote storage client side
Oct 28 2021, 2:26 PM
aeviso updated the diff for D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.

rebase

Oct 28 2021, 2:24 PM

Oct 22 2021

aeviso committed R230:b3844caaba92: Add isort configuration and make script compliant with it (authored by aeviso).
Add isort configuration and make script compliant with it
Oct 22 2021, 2:40 PM
aeviso committed R230:69cfb8771348: Simplify client logic (authored by aeviso).
Simplify client logic
Oct 22 2021, 2:40 PM
aeviso committed R230:e71621469b30: Remove persistent connection from server (authored by aeviso).
Remove persistent connection from server
Oct 22 2021, 2:40 PM
aeviso committed R230:cff60957c720: Fix provenance object initialization (authored by aeviso).
Fix provenance object initialization
Oct 22 2021, 2:40 PM
aeviso committed R230:ca22b911c3c7: Update find first/all and improve type annotations (authored by aeviso).
Update find first/all and improve type annotations
Oct 22 2021, 2:40 PM
aeviso committed R230:dc09c6af26c0: Refactor client/server to dispatch revisions in batches (authored by aeviso).
Refactor client/server to dispatch revisions in batches
Oct 22 2021, 2:40 PM

Oct 20 2021

aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Oct 20 2021, 10:50 AM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Oct 20 2021, 10:49 AM
aeviso closed D6507: Add metrics on retries when flushing cache on the provenance backend.
Oct 20 2021, 10:47 AM
aeviso committed rDPROVef49e3100cf4: Add metrics on retries when flushing cache on the provenance backend (authored by aeviso).
Add metrics on retries when flushing cache on the provenance backend
Oct 20 2021, 10:47 AM
aeviso closed D6506: Export page size as a parameter for postgresql storage.
Oct 20 2021, 10:47 AM
aeviso committed rDPROV665b8a4430cf: Export page size as a parameter for postgresql storage (authored by aeviso).
Export page size as a parameter for postgresql storage
Oct 20 2021, 10:47 AM
aeviso updated the diff for D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.

rebase

Oct 20 2021, 10:46 AM
aeviso updated the diff for D6507: Add metrics on retries when flushing cache on the provenance backend.

rebase

Oct 20 2021, 10:45 AM
aeviso updated the diff for D6506: Export page size as a parameter for postgresql storage.

rebase

Oct 20 2021, 10:41 AM

Oct 19 2021

aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Oct 19 2021, 4:32 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Fix config file parsing for server initilization
  • Send several items per message in the remote provenance storage
  • Export batch size and prefetch count as parameters for remote storage
Oct 19 2021, 4:30 PM
aeviso updated the diff for D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.

rebase

Oct 19 2021, 4:29 PM
aeviso requested review of D6507: Add metrics on retries when flushing cache on the provenance backend.
Oct 19 2021, 4:27 PM
aeviso requested review of D6506: Export page size as a parameter for postgresql storage.
Oct 19 2021, 4:26 PM
aeviso committed R230:0b732cfa737f: Improve statistics logic (authored by aeviso).
Improve statistics logic
Oct 19 2021, 2:08 PM
aeviso committed R230:2ca8e31bebaf: Move client/server config to a file (authored by aeviso).
Move client/server config to a file
Oct 19 2021, 2:08 PM
aeviso committed R230:ed4824526e80: Update revision client/server scripts (authored by aeviso).
Update revision client/server scripts
Oct 19 2021, 2:08 PM
aeviso committed R230:50ed46d1d81c: Make find first/all scripts backend agnostic (authored by aeviso).
Make find first/all scripts backend agnostic
Oct 19 2021, 2:08 PM
aeviso committed R230:128e4a53b5aa: Update auxiliar scripts and make the compliant with black and isort (authored by aeviso).
Update auxiliar scripts and make the compliant with black and isort
Oct 19 2021, 2:08 PM

Oct 15 2021

aeviso added a comment to D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.
In D6473#168303, @olasd wrote:

Looks sensible to me, thanks.

Maybe add a couple comments to explain what the conflict clause does (concatenate the loc and $entity lists, and deduplicates their entries together)?

Oct 15 2021, 4:29 PM

Oct 14 2021

aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Oct 14 2021, 1:42 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Oct 14 2021, 1:41 PM
aeviso updated the diff for D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.

rebase

Oct 14 2021, 1:39 PM
aeviso requested review of D6473: Improve PostgreSQL storage scheme for the `with-path-denormalized` flavor.
Oct 14 2021, 12:20 PM
aeviso closed D6456: Move path normalization function to `util` submodule.
Oct 14 2021, 12:16 PM
aeviso committed rDPROV3e87301a2868: Move path normalization function to `util` submodule (authored by aeviso).
Move path normalization function to `util` submodule
Oct 14 2021, 12:16 PM

Oct 11 2021

aeviso closed D6409: Remove direct dependencies on deprecated `swh.model.identifiers` module.
Oct 11 2021, 5:38 PM
aeviso committed rDPROV2c9ef5673b36: Remove direct dependencies on deprecated `swh.model.identifiers` module (authored by aeviso).
Remove direct dependencies on deprecated `swh.model.identifiers` module
Oct 11 2021, 5:38 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Oct 11 2021, 5:36 PM
aeviso requested review of D6456: Move path normalization function to `util` submodule.
Oct 11 2021, 5:36 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Add new RabbitMQ-based client/server API
  • Rework ProvenanceStorageRabbitMQWorker to handle connection loss
  • Improve server/client shoutdown logic and error handling
  • Improve routing key computation for paths
  • Fix config file parsing for server initilization
  • Send several items per message in the remote provenance storage
Oct 11 2021, 5:35 PM
aeviso updated the diff for D6409: Remove direct dependencies on deprecated `swh.model.identifiers` module.

rebase

Oct 11 2021, 5:31 PM

Oct 5 2021

aeviso added a comment to D6409: Remove direct dependencies on deprecated `swh.model.identifiers` module.

Thanks!

Sorry, I meant to do this myself, but didn't get around it yet.

Oct 5 2021, 3:02 PM
aeviso requested review of D6409: Remove direct dependencies on deprecated `swh.model.identifiers` module.
Oct 5 2021, 2:39 PM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

fix rabbitmq configuration

Oct 5 2021, 2:32 PM
aeviso closed D6272: Remove remote storage based on `swh.core.api.RPCClient`.
Oct 5 2021, 12:07 PM
aeviso closed D6358: Make old StatsD metrics style compliant with the rest of the module.
Oct 5 2021, 12:05 PM
aeviso closed D6353: Add StatsD support to graph submodule.
Oct 5 2021, 12:05 PM
aeviso committed rDPROV04ff73ea98f5: Make old StatsD metrics style compliant with the rest of the module (authored by aeviso).
Make old StatsD metrics style compliant with the rest of the module
Oct 5 2021, 12:05 PM
aeviso committed rDPROV1bd6b22aae6a: Add StatsD support to graph submodule (authored by aeviso).
Add StatsD support to graph submodule
Oct 5 2021, 12:05 PM
aeviso closed D6352: Add StatsD support to provenance storage implementations.
Oct 5 2021, 12:05 PM
aeviso closed D6351: Add StatsD support to provenance backend.
Oct 5 2021, 12:05 PM
aeviso committed rDPROV1ad78362fb41: Add StatsD support to provenance storage implementations (authored by aeviso).
Add StatsD support to provenance storage implementations
Oct 5 2021, 12:05 PM
aeviso committed rDPROVe2a1843d5ebe: Add StatsD support to provenance backend (authored by aeviso).
Add StatsD support to provenance backend
Oct 5 2021, 12:05 PM
aeviso closed D6357: Split `Provenance::flush` method in two (one per layer).
Oct 5 2021, 12:05 PM
aeviso closed D6334: Add `close` method to both `ProvenanceInterface` and `ProvenanceStorageInterface`.
Oct 5 2021, 12:05 PM
aeviso committed rDPROV246e55f9b7e3: Split `Provenance::flush` method in two (one per layer) (authored by aeviso).
Split `Provenance::flush` method in two (one per layer)
Oct 5 2021, 12:05 PM
aeviso committed rDPROVf0210c3753c3: Add `open`/`close` methods to both `ProvenanceInterface` and… (authored by aeviso).
Add `open`/`close` methods to both `ProvenanceInterface` and…
Oct 5 2021, 12:05 PM
aeviso closed D6273: Remove remote storage based on `swh.core.api.RPCClient`.
Oct 5 2021, 12:05 PM
aeviso committed rDPROV172e327c2588: Remove remote provenance storage based on `swh.core.api.RPCClient` (authored by aeviso).
Remove remote provenance storage based on `swh.core.api.RPCClient`
Oct 5 2021, 12:05 PM
aeviso added a comment to D6339: Add support for remote backend on existing storage tests.

IMHO This diff should be squashed in D6165 (it's really part of the work adding the rabbitmq-based backend).

Oct 5 2021, 11:35 AM
aeviso updated the diff for D6339: Add support for remote backend on existing storage tests.

rebase

Oct 5 2021, 11:27 AM
aeviso updated the summary of D6357: Split `Provenance::flush` method in two (one per layer).
Oct 5 2021, 11:25 AM
aeviso added a comment to D6334: Add `close` method to both `ProvenanceInterface` and `ProvenanceStorageInterface`.

looks ok to me. Just one question, why do you need __future__.annotation?

Oct 5 2021, 11:24 AM