Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 12 2022

douardda updated the diff for D8658: Add a journal replayer for the revision layer.

Attempt to make replaying work in the general situation

Oct 12 2022, 4:57 PM
douardda committed rDPROVb3fa1f59243a: Remove unused test data directory (authored by douardda).
Remove unused test data directory
Oct 12 2022, 4:08 PM
douardda closed D8657: Add support for kafka journalization of the ProvenanceStorageInterface.
Oct 12 2022, 4:07 PM
douardda committed rDPROV08f2e604b074: Add support for kafka journalization of the ProvenanceStorageInterface (authored by douardda).
Add support for kafka journalization of the ProvenanceStorageInterface
Oct 12 2022, 4:07 PM
douardda committed rDPROV7e6a62c990b7: Rename ProvenanceInterface.directory_xxx_flattenned as directory_xxx_flattened (authored by douardda).
Rename ProvenanceInterface.directory_xxx_flattenned as directory_xxx_flattened
Oct 12 2022, 4:07 PM
douardda closed D8656: Normalize _add() methods of the ProvenanceStorage interface.
Oct 12 2022, 4:07 PM
douardda committed rDPROV2bd74fc7d97d: Normalize _add() methods of the ProvenanceStorage interface (authored by douardda).
Normalize _add() methods of the ProvenanceStorage interface
Oct 12 2022, 4:07 PM

Oct 11 2022

douardda updated the diff for D8658: Add a journal replayer for the revision layer.

simplify a bit the code (vlorentz' suggestion)

Oct 11 2022, 5:17 PM
douardda added inline comments to D8658: Add a journal replayer for the revision layer.
Oct 11 2022, 5:13 PM
douardda updated the diff for D8658: Add a journal replayer for the revision layer.

rebase

Oct 11 2022, 5:02 PM
douardda updated the diff for D8657: Add support for kafka journalization of the ProvenanceStorageInterface.

rebase

Oct 11 2022, 4:47 PM
douardda updated the diff for D8656: Normalize _add() methods of the ProvenanceStorage interface.

also rename ProvenanceInterface.directory_xxx_flattenned as directory_xxx_flattened

Oct 11 2022, 4:38 PM
douardda added inline comments to D8657: Add support for kafka journalization of the ProvenanceStorageInterface.
Oct 11 2022, 4:25 PM
douardda updated the diff for D8657: Add support for kafka journalization of the ProvenanceStorageInterface.

rebase

Oct 11 2022, 4:12 PM
douardda updated the diff for D8656: Normalize _add() methods of the ProvenanceStorage interface.

apply vlorentz' comments

Oct 11 2022, 4:05 PM
douardda requested review of D8657: Add support for kafka journalization of the ProvenanceStorageInterface.
Oct 11 2022, 3:57 PM
douardda added inline comments to D8656: Normalize _add() methods of the ProvenanceStorage interface.
Oct 11 2022, 3:52 PM
douardda requested review of D8656: Normalize _add() methods of the ProvenanceStorage interface.
Oct 11 2022, 3:04 PM
douardda requested review of D8658: Add a journal replayer for the revision layer.
Oct 11 2022, 2:09 PM
douardda added a revision to T4616: Add kafka journal log for the revision layer : D8658: Add a journal replayer for the revision layer.
Oct 11 2022, 12:26 PM · Provenance database
douardda added a revision to T4616: Add kafka journal log for the revision layer : D8657: Add support for kafka journalization of the ProvenanceStorageInterface.
Oct 11 2022, 12:25 PM · Provenance database
douardda added a revision to T4616: Add kafka journal log for the revision layer : D8656: Normalize _add() methods of the ProvenanceStorage interface.
Oct 11 2022, 12:24 PM · Provenance database
douardda added inline comments to D8634: Prepare the tests to run in Jenkins.
Oct 11 2022, 10:43 AM
douardda accepted D8641: storage_checker: Do not re-check ranges already marked as checked.

lgtm

Oct 11 2022, 10:27 AM

Oct 10 2022

douardda triaged T4616: Add kafka journal log for the revision layer as High priority.
Oct 10 2022, 10:51 AM · Provenance database
douardda closed T3555: Re-factor the MongoDB backend, a subtask of T3431: Implement a MongoDB backend for SWH-provenance , as Wontfix.
Oct 10 2022, 10:50 AM · Provenance database
douardda closed T3555: Re-factor the MongoDB backend as Wontfix.
Oct 10 2022, 10:50 AM · Provenance database

Oct 7 2022

douardda closed T3557: Run experiments against the MongoDB backend as Wontfix.
Oct 7 2022, 6:07 PM · Provenance database
douardda closed T3557: Run experiments against the MongoDB backend , a subtask of T3431: Implement a MongoDB backend for SWH-provenance , as Wontfix.
Oct 7 2022, 6:07 PM · Provenance database
douardda closed T3431: Implement a MongoDB backend for SWH-provenance as Wontfix.
Oct 7 2022, 6:06 PM · Provenance database

Oct 3 2022

douardda closed D8593: Reorganize the code.
Oct 3 2022, 12:26 PM
douardda committed rDPROV7c882f571656: Reorganize the code (authored by douardda).
Reorganize the code
Oct 3 2022, 12:26 PM
douardda committed rDPROV6f4a193e9081: More core reorganization (authored by douardda).
More core reorganization
Oct 3 2022, 12:26 PM
douardda closed D8591: Adapt postgresql backend to swh.core.db >= 2.0.
Oct 3 2022, 12:26 PM
douardda closed D8592: Mark origin layer tests as "origin_layer".
Oct 3 2022, 12:26 PM
douardda committed rDPROV9a63bd8164af: Mark origin layer tests as "origin_layer" (authored by douardda).
Mark origin layer tests as "origin_layer"
Oct 3 2022, 12:26 PM
douardda committed rDPROV67cd713b6aca: Adapt postgresql backend to swh.core.db >= 2.0 (authored by douardda).
Adapt postgresql backend to swh.core.db >= 2.0
Oct 3 2022, 12:26 PM
douardda closed D8590: Upgrade to swh.graph 2.0.
Oct 3 2022, 12:26 PM
douardda committed rDPROVbb0574c29f91: Upgrade to swh.graph 2.0 (authored by douardda).
Upgrade to swh.graph 2.0
Oct 3 2022, 12:26 PM
douardda requested review of D8593: Reorganize the code.
Oct 3 2022, 10:44 AM
douardda requested review of D8590: Upgrade to swh.graph 2.0.
Oct 3 2022, 10:44 AM
douardda requested review of D8591: Adapt postgresql backend to swh.core.db >= 2.0.
Oct 3 2022, 10:30 AM
douardda updated the diff for D8592: Mark origin layer tests as "origin_layer".

rebase

Oct 3 2022, 10:24 AM

Sep 30 2022

douardda requested review of D8592: Mark origin layer tests as "origin_layer".
Sep 30 2022, 6:47 PM

Sep 28 2022

douardda created P1463 (An Untitled Masterwork).
Sep 28 2022, 3:37 PM

Sep 27 2022

douardda accepted D8447: Add max_matching_nodes parameter to /leaves.

lgtm

Sep 27 2022, 3:11 PM

Sep 16 2022

douardda committed rCDFPb170c1b86fee: Add testinfra based tests for the mirror deployment (authored by douardda).
Add testinfra based tests for the mirror deployment
Sep 16 2022, 3:04 PM
douardda committed rCDFP2ed2781e3386: Add the vault service in the deployment stack (authored by douardda).
Add the vault service in the deployment stack
Sep 16 2022, 3:04 PM
douardda committed rCDFP89c34192af99: Rename db services to match related secret and volume names (authored by douardda).
Rename db services to match related secret and volume names
Sep 16 2022, 3:04 PM
douardda committed rCDFPd779879b7576: web: disable indexer_storage and delete deposit config (authored by douardda).
web: disable indexer_storage and delete deposit config
Sep 16 2022, 3:04 PM
douardda committed rCDFPf0246e213836: Add a simple tool to initialize the pathslicer root from a cfg file (authored by douardda).
Add a simple tool to initialize the pathslicer root from a cfg file
Sep 16 2022, 3:04 PM
douardda committed rCDFP9cc050c487bb: deploy db services as dnsrr endpoint_mode (authored by douardda).
deploy db services as dnsrr endpoint_mode
Sep 16 2022, 3:04 PM
douardda committed rCDFPdd76d18569af: images: also build the test image (authored by douardda).
images: also build the test image
Sep 16 2022, 3:04 PM
douardda committed rCDFPa64ff1bab5bf: conf/nginx: update for recent grafana (authored by douardda).
conf/nginx: update for recent grafana
Sep 16 2022, 3:04 PM
douardda committed rCDFPc8d2c5968d00: images: do not crash entrypoint if the config file is missing (authored by douardda).
images: do not crash entrypoint if the config file is missing
Sep 16 2022, 3:04 PM

Sep 15 2022

douardda accepted D8478: Update documentation for Docker Compose V2 (i.e. compose plugin).

LGTM, thanks

Sep 15 2022, 11:02 AM

Sep 14 2022

douardda closed D8477: Bump swh dependencies.
Sep 14 2022, 5:29 PM
douardda committed rDVAUc315c245c9ff: Bump swh dependencies (authored by douardda).
Bump swh dependencies
Sep 14 2022, 5:28 PM
douardda requested review of D8477: Bump swh dependencies.
Sep 14 2022, 5:10 PM
douardda closed D8205: Instanciate the SMTP class only when needed.
Sep 14 2022, 4:26 PM
douardda committed rDVAUcab17e72537b: Instanciate the SMTP class only when needed (authored by douardda).
Instanciate the SMTP class only when needed
Sep 14 2022, 4:26 PM
douardda updated the diff for D8205: Instanciate the SMTP class only when needed.

Remove the fallback to 127.0.0.1:25 but log delivery failure instead

Sep 14 2022, 4:21 PM

Sep 13 2022

douardda closed D8464: Add a 'swh graph grpc-serve' command.
Sep 13 2022, 4:32 PM
douardda committed rDGRPH99a97d7ebaf2: Add a 'swh graph grpc-serve' command (authored by douardda).
Add a 'swh graph grpc-serve' command
Sep 13 2022, 4:32 PM
douardda added inline comments to D8205: Instanciate the SMTP class only when needed.
Sep 13 2022, 4:28 PM
douardda updated the diff for D8464: Add a 'swh graph grpc-serve' command.

apply olasd's suggestions

Sep 13 2022, 4:04 PM
douardda requested review of D8464: Add a 'swh graph grpc-serve' command.
Sep 13 2022, 3:14 PM
douardda closed D8448: Reorganize configuration of the http server building.
Sep 13 2022, 3:01 PM
douardda committed rDGRPHf294538188a8: Reorganize configuration of the http server building (authored by douardda).
Reorganize configuration of the http server building
Sep 13 2022, 3:01 PM
douardda added a comment to P1451 (An Untitled Masterwork).

FTR, using order by age():

Sep 13 2022, 1:43 PM

Sep 12 2022

douardda added a comment to T4510: [cassandra] Profile the replayer cpu consumption.

FTR here a dot export of the directory profiling file:

Sep 12 2022, 5:18 PM · Storage manager, System administration
douardda updated the diff for D8448: Reorganize configuration of the http server building.

rename http_server.py as http_rpc_server.py and use the same http_rpc_server config entry name (as suggested by vlorentz)

Sep 12 2022, 4:22 PM
douardda added inline comments to D8448: Reorganize configuration of the http server building.
Sep 12 2022, 4:09 PM
douardda added a comment to D8448: Reorganize configuration of the http server building.

what about http_rpc_server instead of rpc_server (in the config) and http_server (as module name), to remove any ambiguity?

Sep 12 2022, 4:08 PM
douardda requested review of D8448: Reorganize configuration of the http server building.
Sep 12 2022, 3:49 PM
douardda closed D8353: Move swh-graph's test fixture in a pytest_plugin module.
Sep 12 2022, 3:18 PM
douardda committed rDGRPH7049b584c24f: Move swh-graph's test fixture in a pytest_plugin module (authored by douardda).
Move swh-graph's test fixture in a pytest_plugin module
Sep 12 2022, 3:18 PM
douardda updated the diff for D8353: Move swh-graph's test fixture in a pytest_plugin module.

rebase

Sep 12 2022, 3:04 PM
douardda accepted D8438: Add field 'max_matching_nodes' to TraversalRequest.

lgtm but would it make sense to test cases with usage of this new option combined with other limiting params ({min,max}_depth and max_edges)?

Sep 12 2022, 10:28 AM

Sep 9 2022

douardda triaged T4526: New model for the origin layer as Normal priority.
Sep 9 2022, 5:47 PM · Provenance database

Sep 8 2022

douardda committed rDPROV4ee2ed21a7fa: Add a size limit for directory expansions when computing the isochrone graph (authored by douardda).
Add a size limit for directory expansions when computing the isochrone graph
Sep 8 2022, 2:57 PM

Sep 6 2022

douardda added a comment to T4472: swh-graph: Allow to specify the rpc port.

IMHO we should get rid of the java app being started from python (but for testing purpose).

Sep 6 2022, 4:50 PM · Compressed graph service

Sep 2 2022

douardda closed D8362: swhgraph: use grpc API.
Sep 2 2022, 11:21 AM
douardda committed rDPROVfa15961caf20: swhgraph: use grpc API (authored by douardda).
swhgraph: use grpc API
Sep 2 2022, 11:20 AM
douardda closed D8361: tests: add tags (Release) in the datasets.
Sep 2 2022, 11:20 AM
douardda committed rDPROV865449ec9656: tests: add tags (Release) in the datasets (authored by douardda).
tests: add tags (Release) in the datasets
Sep 2 2022, 11:20 AM
douardda accepted D8303: Add Gitea/Gogs metadata fetcher.

ok (but I have a couple of questions)

Sep 2 2022, 11:19 AM
douardda added a comment to D8362: swhgraph: use grpc API.

Can you generate these files on the fly using a pytest fixture?

Sep 2 2022, 11:08 AM

Sep 1 2022

douardda updated the diff for D8362: swhgraph: use grpc API.

rebase and add forgoten generate_graph_dataset.py tool

Sep 1 2022, 5:33 PM
douardda updated the diff for D8361: tests: add tags (Release) in the datasets.

add a forgoten dataset visit file

Sep 1 2022, 5:30 PM
douardda requested review of D8361: tests: add tags (Release) in the datasets.
Sep 1 2022, 12:39 PM
douardda updated the diff for D8362: swhgraph: use grpc API.

rebase

Sep 1 2022, 12:32 PM
douardda triaged T4479: uncouple the java grpc server from the python HTTP server as High priority.
Sep 1 2022, 11:29 AM · Compressed graph service

Aug 31 2022

douardda requested review of D8362: swhgraph: use grpc API.
Aug 31 2022, 5:40 PM
douardda closed D8346: Fix a couple of mypy issues.
Aug 31 2022, 3:11 PM
douardda committed rDPROV4a241adbab75: Fix a couple of mypy issues (authored by douardda).
Fix a couple of mypy issues
Aug 31 2022, 3:11 PM
douardda requested review of D8353: Move swh-graph's test fixture in a pytest_plugin module.
Aug 31 2022, 11:20 AM
douardda closed D8348: Add a few simple python tests for the grpc API.
Aug 31 2022, 11:14 AM
douardda committed rDGRPH7fc73d6150a7: Add a few simple python tests for the grpc API (authored by douardda).
Add a few simple python tests for the grpc API
Aug 31 2022, 11:14 AM

Aug 30 2022

douardda requested review of D8348: Add a few simple python tests for the grpc API.
Aug 30 2022, 3:15 PM