Page MenuHomeSoftware Heritage
Feed Advanced Search

Advanced Search
Use Results
Hide Query

Sep 15 2021

aeviso retitled D6165: Add new RabbitMQ-based client/server API from [WIP] Add new RabbitMQ-based client/server API to Add new RabbitMQ-based client/server API.
Sep 15 2021, 4:26 PM
aeviso added a reviewer for D6272: Remove remote storage based on `swh.core.api.RPCClient`: olasd.
Sep 15 2021, 4:25 PM
aeviso requested review of D6272: Remove remote storage based on `swh.core.api.RPCClient`.
Sep 15 2021, 4:23 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Add new RabbitMQ-based client/server API
  • Rework ProvenanceStorageRabbitMQWorker to handle connection loss
  • Improve server/client shoutdown logic
Sep 15 2021, 4:22 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Sep 15 2021, 4:02 PM
aeviso added a reviewer for D6165: Add new RabbitMQ-based client/server API: olasd.
Sep 15 2021, 2:02 PM
aeviso added a reviewer for D6256: Add StatsD support to `ArchiveInterface` implementations: jayeshv.
Sep 15 2021, 2:01 PM
aeviso added a reviewer for D6266: Add StatsD support to the main algorithms of the module: jayeshv.
Sep 15 2021, 2:01 PM
aeviso requested review of D6266: Add StatsD support to the main algorithms of the module.
Sep 15 2021, 1:49 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Add new RabbitMQ-based client/server API
  • Split set method's requests into several queues on server side
  • Remove get queues and have client read from ProvenanceStorage directly
  • Add support for relation_add to the RabbitMQ server
  • Refactor server to use multiple sub-processes instead of threads
  • Rework ProvenanceStorageRabbitMQWorker to handle connection loss
  • Remove old client/server storage based on swh.core.api.RPCClient
  • Improve connection error handling on both client and server side
  • Switch to use a topic exchange instead of a direct one on remote backend
  • Improve timeout while waiting for response handling on client side
  • Improve server/client shoutdown logic
Sep 15 2021, 1:47 PM
aeviso updated the summary of D6165: Add new RabbitMQ-based client/server API.
Sep 15 2021, 1:45 PM
aeviso retitled D6256: Add StatsD support to `ArchiveInterface` implementations from Add StatsD support on `ArchiveInterface` implementations to Add StatsD support to `ArchiveInterface` implementations.
Sep 15 2021, 1:44 PM
aeviso updated the diff for D6256: Add StatsD support to `ArchiveInterface` implementations.

rebase

Sep 15 2021, 1:43 PM

Sep 14 2021

aeviso closed D6255: Generalize types for `content_add` and `directory_add` in the storage interface.
Sep 14 2021, 3:54 PM
aeviso committed rDPROV3383cae57ef7: Generalize types for `content_add` and `directory_add` in the storage interface (authored by aeviso).
Generalize types for `content_add` and `directory_add` in the storage interface
Sep 14 2021, 3:54 PM
aeviso requested review of D6256: Add StatsD support to `ArchiveInterface` implementations.
Sep 14 2021, 3:39 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Improve timeout while waiting for response handling on client side
Sep 14 2021, 3:23 PM
aeviso requested review of D6255: Generalize types for `content_add` and `directory_add` in the storage interface.
Sep 14 2021, 3:12 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Add new RabbitMQ-based client/server API
  • Split set method's requests into several queues on server side
  • Remove get queues and have client read from ProvenanceStorage directly
  • Add support for relation_add to the RabbitMQ server
  • Refactor server to use multiple sub-processes instead of threads
  • Rework ProvenanceStorageRabbitMQWorker to handle connection loss
  • Remove old client/server storage based on swh.core.api.RPCClient
  • Improve connection error handling on both client and server side
  • Switch to use a topic exchange instead of a direct one on remote backend
Sep 14 2021, 3:09 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Split set method's requests into several queues on server side
  • Remove get queues and have client read from ProvenanceStorage directly
  • Add support for relation_add to the RabbitMQ server
  • Refactor server to use multiple sub-processes instead of threads
  • Rework ProvenanceStorageRabbitMQWorker to handle connection loss
  • Remove old client/server storage based on swh.core.api.RPCClient
  • Improve connection error handling on both client and server side
  • Generalize types for content_add and directory_add in the storage interface
  • Switch to use a topic exchange instead of a direct one on remote backend
Sep 14 2021, 2:53 PM

Sep 13 2021

aeviso closed D6243: Change relation methods in `ProvenanceStorageInterface` to take/return denormalized data.
Sep 13 2021, 2:11 PM
aeviso committed rDPROV2e997f31039d: Change relation methods in `ProvenanceStorageInterface` to take/return… (authored by aeviso).
Change relation methods in `ProvenanceStorageInterface` to take/return…
Sep 13 2021, 2:11 PM
aeviso closed D6231: Rework `ProvenanceStorageInterface` to have a single add method per entity.
Sep 13 2021, 2:11 PM
aeviso committed rDPROV657226a87bbe: Rework `ProvenanceStorageInterface` to have a single add method per entity (authored by aeviso).
Rework `ProvenanceStorageInterface` to have a single add method per entity
Sep 13 2021, 2:11 PM
aeviso updated the diff for D6243: Change relation methods in `ProvenanceStorageInterface` to take/return denormalized data.

rebase

Sep 13 2021, 1:58 PM
aeviso updated the diff for D6231: Rework `ProvenanceStorageInterface` to have a single add method per entity.

rebase

Sep 13 2021, 1:57 PM
aeviso added inline comments to D6231: Rework `ProvenanceStorageInterface` to have a single add method per entity.
Sep 13 2021, 12:24 PM
aeviso updated the diff for D6243: Change relation methods in `ProvenanceStorageInterface` to take/return denormalized data.

rebase

Sep 13 2021, 11:16 AM
aeviso requested review of D6243: Change relation methods in `ProvenanceStorageInterface` to take/return denormalized data.
Sep 13 2021, 10:44 AM

Sep 10 2021

aeviso retitled D6231: Rework `ProvenanceStorageInterface` to have a single add method per entity from Extend `ProvenanceStorageInterface` with new methods to Rework `ProvenanceStorageInterface` to have a single add method per entity.
Sep 10 2021, 4:31 PM
aeviso updated the diff for D6231: Rework `ProvenanceStorageInterface` to have a single add method per entity.

rebase

Sep 10 2021, 4:28 PM

Sep 9 2021

aeviso requested review of D6231: Rework `ProvenanceStorageInterface` to have a single add method per entity.
Sep 9 2021, 5:04 PM
aeviso closed D6209: Remove locks from PostgreSQL backend insertions.
Sep 9 2021, 10:33 AM
aeviso committed rDPROV73dd6cb44773: Remove locks from PostgreSQL backend insertions (authored by aeviso).
Remove locks from PostgreSQL backend insertions
Sep 9 2021, 10:33 AM
aeviso committed rDPROV4c2b0907a937: Remove autocommit isolation level from `ProvenanceStoragePostgreSql` (authored by aeviso).
Remove autocommit isolation level from `ProvenanceStoragePostgreSql`
Sep 9 2021, 10:33 AM
aeviso accepted D6220: Added test only method info in the interface doc strings.

Not sure we really want to restrict this methods to test-only in the documentation. But we can change this in the future anyway

Sep 9 2021, 10:32 AM

Sep 8 2021

aeviso updated the diff for D6209: Remove locks from PostgreSQL backend insertions.
  • Remove autocommit isolation level from ProvenanceStoragePostgreSql
Sep 8 2021, 4:39 PM
aeviso committed rDPROV26061a0a15a0: Remove old debug logging and improve other's messages (authored by aeviso).
Remove old debug logging and improve other's messages
Sep 8 2021, 10:41 AM
aeviso closed D6208: Avoid flushing empty buffers in the `Provenance` backend.
Sep 8 2021, 10:41 AM
aeviso committed rDPROV00f6d9acfb2e: Avoid flushing empty buffers in the `Provenance` backend (authored by aeviso).
Avoid flushing empty buffers in the `Provenance` backend
Sep 8 2021, 10:41 AM
aeviso committed rDPROVbd6de9eaba19: Fix two minor bugs on the MongoDB backend (authored by aeviso).
Fix two minor bugs on the MongoDB backend
Sep 8 2021, 10:41 AM
aeviso closed D6205: Fix two minor bugs on the MongoDB backend.
Sep 8 2021, 10:41 AM

Sep 7 2021

aeviso added a comment to D6208: Avoid flushing empty buffers in the `Provenance` backend.
In D6208#160587, @olasd wrote:

I'm not too sure about the flat-out removal of a lot of these logging statements (rather than just turning them into logging statements with deferred formatting), but the changes to the flush() logic at least look sound.

Sep 7 2021, 5:09 PM
aeviso requested review of D6209: Remove locks from PostgreSQL backend insertions.
Sep 7 2021, 4:56 PM
aeviso requested review of D6208: Avoid flushing empty buffers in the `Provenance` backend.
Sep 7 2021, 4:55 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Add new RabbitMQ-based client/server API
  • Split set method's requests into several queues on server side
  • Remove get queues and have client read from ProvenanceStorage directly
  • Add support for relation_add to the RabbitMQ server
  • Refactor server to use multiple sub-processes instead of threads
  • Rework ProvenanceStorageRabbitMQWorker to handle connection loss
  • Remove old client/server storage based on swh.core.api.RPCClient
  • Improve connection error handling on both client and server side
Sep 7 2021, 4:53 PM
aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.

rebase

Sep 7 2021, 3:53 PM
aeviso requested review of D6205: Fix two minor bugs on the MongoDB backend.
Sep 7 2021, 3:51 PM
aeviso accepted D6204: Use a temporary table to add relations.
Sep 7 2021, 3:24 PM
aeviso committed rDPROV9076e8a1dd34: Add SQL enum for relation get filter options (authored by aeviso).
Add SQL enum for relation get filter options
Sep 7 2021, 3:15 PM
aeviso committed rDPROVec1827e6eb00: Improve denormalized PostgreSQL schema to properly check for duplicates (authored by aeviso).
Improve denormalized PostgreSQL schema to properly check for duplicates
Sep 7 2021, 3:15 PM
aeviso committed rDPROVe529372cf218: Move PosgreSQL's backend method `relation_add` to SQL function (authored by aeviso).
Move PosgreSQL's backend method `relation_add` to SQL function
Sep 7 2021, 3:14 PM
aeviso committed rDPROVb523dfd8c1f8: Refactor `relation_add` prepearing to move SQL queries into functions (authored by aeviso).
Refactor `relation_add` prepearing to move SQL queries into functions
Sep 7 2021, 3:14 PM
aeviso closed D6090: Refactor `ProvenanceStoragePostgreSql`.
Sep 7 2021, 3:14 PM
aeviso committed rDPROVacd76e442fbe: Move PosgreSQL's backend method `relation_get` to SQL function (authored by aeviso).
Move PosgreSQL's backend method `relation_get` to SQL function
Sep 7 2021, 3:14 PM

Sep 3 2021

aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Improve connection error handling on both client and server side
Sep 3 2021, 4:24 PM

Sep 1 2021

aeviso updated the diff for D6165: Add new RabbitMQ-based client/server API.
  • Remove old debug logging and improve other's messages
  • Rework ProvenanceStorageRabbitMQWorker to handle connection loss
  • Remove old client/server storage based on swh.core.api.RPCClient
Sep 1 2021, 11:34 AM

Aug 31 2021

aeviso requested review of D6165: Add new RabbitMQ-based client/server API.
Aug 31 2021, 2:08 PM

Aug 26 2021

aeviso updated the diff for D6090: Refactor `ProvenanceStoragePostgreSql`.

Re-enable provenance storage tests that were disabled by mistake

Aug 26 2021, 12:28 PM
aeviso updated the diff for D6090: Refactor `ProvenanceStoragePostgreSql`.

rebase

Aug 26 2021, 11:54 AM
aeviso updated the diff for D6090: Refactor `ProvenanceStoragePostgreSql`.
  • Add SQL enum for relation get filter options
Aug 26 2021, 11:06 AM
aeviso updated the diff for D6090: Refactor `ProvenanceStoragePostgreSql`.

rebase

Aug 26 2021, 11:05 AM

Aug 25 2021

aeviso accepted D6094: Provenance Mongo backend.
Aug 25 2021, 4:21 PM · Provenance database

Aug 24 2021

aeviso added inline comments to D6094: Provenance Mongo backend.
Aug 24 2021, 1:39 PM · Provenance database

Aug 18 2021

aeviso updated the diff for D6090: Refactor `ProvenanceStoragePostgreSql`.

rebase

Aug 18 2021, 11:58 AM
aeviso committed rDPROVe9206efef3a1: Fix origin type when querying ProstgreSQL backend (authored by aeviso).
Fix origin type when querying ProstgreSQL backend
Aug 18 2021, 11:56 AM
aeviso committed rDPROV2b62b1635651: Fix module requirements (authored by aeviso).
Fix module requirements
Aug 18 2021, 10:24 AM
aeviso committed rDPROV68e1c8ffddf6: Fix bugs in ProvenanceStoragePostgreSql class (authored by aeviso).
Fix bugs in ProvenanceStoragePostgreSql class
Aug 18 2021, 10:24 AM
aeviso closed D6084: Rename PostgreSQL backend and code styling.
Aug 18 2021, 10:24 AM
aeviso committed rDPROV2086effea842: Rename PostgreSQL backend and code styling (authored by aeviso).
Rename PostgreSQL backend and code styling
Aug 18 2021, 10:24 AM

Aug 16 2021

aeviso updated the diff for D6090: Refactor `ProvenanceStoragePostgreSql`.

rebase

Aug 16 2021, 11:42 AM
aeviso updated the diff for D6084: Rename PostgreSQL backend and code styling.

Add deprecated warning for "local" storage class

Aug 16 2021, 11:41 AM
aeviso requested review of D6090: Refactor `ProvenanceStoragePostgreSql`.
Aug 16 2021, 11:29 AM

Aug 13 2021

aeviso updated subscribers of D6084: Rename PostgreSQL backend and code styling.

For the fix of revision_get, there should be a test.

Aug 13 2021, 11:47 AM
aeviso requested review of D6084: Rename PostgreSQL backend and code styling.
Aug 13 2021, 11:10 AM
aeviso closed D6071: Revisited history graph implementation.
Aug 13 2021, 11:09 AM
aeviso committed rDPROVb0951e2e2199: Revisit history graph implementation (authored by aeviso).
Revisit history graph implementation
Aug 13 2021, 11:09 AM
aeviso updated the diff for D6071: Revisited history graph implementation.

rebase

Aug 13 2021, 11:05 AM

Aug 11 2021

aeviso updated the diff for D6071: Revisited history graph implementation.

rebase

Aug 11 2021, 2:44 PM
aeviso added a comment to D6071: Revisited history graph implementation.
  • the use of newly introduced as_dict() methods seems unrelated here; unless I'm mistaken, the purpose if this change is better assertion reports by pytest on failure; if so, it should be presented as this in a dedicated revision
Aug 11 2021, 2:39 PM

Aug 9 2021

aeviso requested review of D6071: Revisited history graph implementation.
Aug 9 2021, 3:37 PM

Aug 6 2021

aeviso committed rDPROV3431de8f4931: Add test for the different `ProvenanceStorageInterface` implementations (authored by aeviso).
Add test for the different `ProvenanceStorageInterface` implementations
Aug 6 2021, 4:00 PM
aeviso closed D6054: Add test for the different `ProvenanceStorageInterface` implementations.
Aug 6 2021, 4:00 PM
aeviso committed rDPROV0e10aa4c7098: Fix bug on `ProvenanceDB._relation_get` methods when `reverse=True` (authored by aeviso).
Fix bug on `ProvenanceDB._relation_get` methods when `reverse=True`
Aug 6 2021, 4:00 PM
aeviso closed D6053: Refactor the use of archive `Storage` object for testing.
Aug 6 2021, 4:00 PM
aeviso committed rDPROV6a207b0e6be0: Refactor the use of archive `Storage` object for testing (authored by aeviso).
Refactor the use of archive `Storage` object for testing
Aug 6 2021, 4:00 PM
aeviso committed rDPROVac6439aa7de2: Make `provenance` fixture use a fixed storage backend for testing (authored by aeviso).
Make `provenance` fixture use a fixed storage backend for testing
Aug 6 2021, 4:00 PM
aeviso committed rDPROV91e4dcd4148d: Add some missing type annotations and remove already done TODO's (authored by aeviso).
Add some missing type annotations and remove already done TODO's
Aug 6 2021, 4:00 PM
aeviso committed rDPROVbe098b32d8fb: Add test for origin-revision layer (authored by aeviso).
Add test for origin-revision layer
Aug 6 2021, 4:00 PM
aeviso closed D6026: Add test for origin-revision layer.
Aug 6 2021, 4:00 PM
aeviso committed rDPROVc58d170f7766: Fix type conversion when retrieving origins' urls from PostgreSQL backend (authored by aeviso).
Fix type conversion when retrieving origins' urls from PostgreSQL backend
Aug 6 2021, 4:00 PM
aeviso updated the diff for D6054: Add test for the different `ProvenanceStorageInterface` implementations.

rebase

Aug 6 2021, 3:50 PM
aeviso updated the diff for D6053: Refactor the use of archive `Storage` object for testing.

rebase

Aug 6 2021, 3:49 PM
aeviso updated the diff for D6054: Add test for the different `ProvenanceStorageInterface` implementations.

rebase

Aug 6 2021, 3:19 PM
aeviso updated the diff for D6053: Refactor the use of archive `Storage` object for testing.

rebase

Aug 6 2021, 3:18 PM
aeviso updated the diff for D6026: Add test for origin-revision layer.

rebae

Aug 6 2021, 3:17 PM

Aug 5 2021

aeviso updated the diff for D6054: Add test for the different `ProvenanceStorageInterface` implementations.

rebase

Aug 5 2021, 10:25 PM
aeviso updated the diff for D6054: Add test for the different `ProvenanceStorageInterface` implementations.

rebase

Aug 5 2021, 10:22 PM

Aug 3 2021

aeviso requested review of D6054: Add test for the different `ProvenanceStorageInterface` implementations.
Aug 3 2021, 4:56 PM
aeviso requested review of D6053: Refactor the use of archive `Storage` object for testing.
Aug 3 2021, 4:54 PM
First
Prev
Next
About · Developer information · Legal