Page MenuHomeSoftware Heritage
Feed Advanced Search

Apr 29 2020

douardda added a revision to T2355: Make swh-journal independent from swh-storage or swh-objstorage: D3087: Remove the content replayer code.
Apr 29 2020, 1:47 PM · Object storage, Storage manager, Journal
douardda created D3087: Remove the content replayer code.
Apr 29 2020, 1:47 PM
douardda created D3086: Remove the backfiller and the (storage) replayer.
Apr 29 2020, 1:46 PM
douardda closed D3074: Add swh-objstorage-replayer.

closed by d33d009d1fb9b89d47df3476c7da86c88b1d4035

Apr 29 2020, 11:18 AM
douardda committed rDENV78cd7e614371: Add support for other first tag than 0.0.1 in debpkg-bootstrap-branches (authored by douardda).
Add support for other first tag than 0.0.1 in debpkg-bootstrap-branches
Apr 29 2020, 11:17 AM
douardda closed D3078: Update debpkg-bootstrap-branches script.
Apr 29 2020, 11:17 AM
douardda committed rDENVaf3a8a3ddfb1: Update debpkg-bootstrap-branches script to buster (authored by douardda).
Update debpkg-bootstrap-branches script to buster
Apr 29 2020, 11:17 AM
douardda committed rDDOCd33d009d1fb9: Add swh-objstorage-replayer (authored by douardda).
Add swh-objstorage-replayer
Apr 29 2020, 11:16 AM
douardda committed rDOBJSRPLb5b4955ca12c: Updated debian buster backport directory for version 0.1.0 (authored by douardda).
Updated debian buster backport directory for version 0.1.0
Apr 29 2020, 11:09 AM
douardda committed rDOBJSRPL6b0fdfb4ceb8: pristine-tar data for swh-objstorage-replayer_0.1.0.orig.tar.gz (authored by douardda).
pristine-tar data for swh-objstorage-replayer_0.1.0.orig.tar.gz
Apr 29 2020, 11:09 AM
douardda committed rDOBJSRPLaf2271858e8b: Updated debian directory for version 0.1.0 (authored by douardda).
Updated debian directory for version 0.1.0
Apr 29 2020, 11:09 AM
douardda committed rDOBJSRPL9ae53d30b0c8: Import upstream version 0.1.0 (authored by douardda).
Import upstream version 0.1.0
Apr 29 2020, 11:09 AM
douardda created D3078: Update debpkg-bootstrap-branches script.
Apr 29 2020, 11:07 AM
douardda committed rDOBJSRPLa4dfb2066b05: Add slightly better content in the README file (authored by douardda).
Add slightly better content in the README file
Apr 29 2020, 10:29 AM
douardda committed rDENV644799deb740: mrconfig: add swh-objstorage-replayer repository (authored by douardda).
mrconfig: add swh-objstorage-replayer repository
Apr 29 2020, 9:37 AM
douardda closed D3076: Use swh.model's sha1 hypothesis strategy in test_replay.py.
Apr 29 2020, 9:33 AM
douardda committed rDOBJSRPLafc5c84acb2f: Use swh.core's sha1 hypothesis strategy in test_replay.py (authored by douardda).
Use swh.core's sha1 hypothesis strategy in test_replay.py
Apr 29 2020, 9:33 AM
douardda committed rDDOC8fda2aea0ce7: Make the 'make' command in swh-docs run 'tox -r -e sphinx-dev' (authored by douardda).
Make the 'make' command in swh-docs run 'tox -r -e sphinx-dev'
Apr 29 2020, 9:32 AM
douardda committed rDDOC457c9f647ab4: Refactor the sphinx-dev build environment to get rid of the link-stamp step (authored by douardda).
Refactor the sphinx-dev build environment to get rid of the link-stamp step
Apr 29 2020, 9:32 AM
douardda closed D3073: Refactor the sphinx-dev build environment to get rid of the link-stamp step.
Apr 29 2020, 9:32 AM

Apr 28 2020

douardda updated the diff for D3073: Refactor the sphinx-dev build environment to get rid of the link-stamp step.

correct django pinning

Apr 28 2020, 5:48 PM
douardda updated the diff for D3073: Refactor the sphinx-dev build environment to get rid of the link-stamp step.

fixes according to comments

Apr 28 2020, 5:35 PM
douardda committed rDDOC3001e735b592: Add missing dependency in swh-scanner in requirement files (authored by douardda).
Add missing dependency in swh-scanner in requirement files
Apr 28 2020, 5:33 PM
douardda closed D3072: Add missing dependency in swh-scanner in requirement files.
Apr 28 2020, 5:33 PM
douardda added a comment to D3073: Refactor the sphinx-dev build environment to get rid of the link-stamp step.

While individual doc build can still be launched in each subproject, I am fine with it.

Apr 28 2020, 5:19 PM
douardda created D3076: Use swh.model's sha1 hypothesis strategy in test_replay.py.
Apr 28 2020, 5:15 PM
douardda committed rDOBJSRPLe9c46618fd25: Initial version of the swh.objstorage.replayer package (authored by douardda).
Initial version of the swh.objstorage.replayer package
Apr 28 2020, 5:15 PM
douardda closed D3071: Initial version of the swh.objstorage.replayer package.
Apr 28 2020, 5:15 PM
douardda updated the diff for D3071: Initial version of the swh.objstorage.replayer package.

trigger jenkins (maybe)

Apr 28 2020, 5:11 PM
douardda updated the diff for D3071: Initial version of the swh.objstorage.replayer package.

trigger jenkins

Apr 28 2020, 4:58 PM
douardda committed rCJSWH2b1ab44aed8e: Enable Jenkins for swh-objstorage-replayer. (authored by douardda).
Enable Jenkins for swh-objstorage-replayer.
Apr 28 2020, 4:51 PM
douardda closed D3075: Enable Jenkins for swh-objstorage-replayer..
Apr 28 2020, 4:51 PM
douardda created D3075: Enable Jenkins for swh-objstorage-replayer..
Apr 28 2020, 4:43 PM
douardda updated the diff for D3071: Initial version of the swh.objstorage.replayer package.

update index.rst

Apr 28 2020, 4:37 PM
douardda created D3074: Add swh-objstorage-replayer.
Apr 28 2020, 4:33 PM
douardda created D3073: Refactor the sphinx-dev build environment to get rid of the link-stamp step.
Apr 28 2020, 4:33 PM
douardda created D3072: Add missing dependency in swh-scanner in requirement files.
Apr 28 2020, 4:33 PM
douardda updated the diff for D3071: Initial version of the swh.objstorage.replayer package.

and remaining references to the storage fixture in test_cli...

Apr 28 2020, 10:11 AM
douardda updated the diff for D3071: Initial version of the swh.objstorage.replayer package.

forgot tox.ini

Apr 28 2020, 10:07 AM
douardda updated the diff for D3071: Initial version of the swh.objstorage.replayer package.

fixes according to anlambert's comments

Apr 28 2020, 10:05 AM
douardda added inline comments to D3071: Initial version of the swh.objstorage.replayer package.
Apr 28 2020, 9:51 AM

Apr 27 2020

douardda created D3071: Initial version of the swh.objstorage.replayer package.
Apr 27 2020, 5:22 PM
douardda committed rDOBJSRPL88da644b4949: import template from swh-py-template (init-py-repo) (authored by douardda).
import template from swh-py-template (init-py-repo)
Apr 27 2020, 5:16 PM
douardda closed D3063: Normalize the handling of the config file loading in cli.

closed by 3043177f79b24d2c5791c3196bd17116f83086bc

Apr 27 2020, 3:20 PM
douardda committed rDOBJS3043177f79b2: Normalize the handling of the config file loading in cli (authored by douardda).
Normalize the handling of the config file loading in cli
Apr 27 2020, 3:19 PM
douardda committed rDOBJSbd2b5e651aed: Move the content of swh/objstorage/__init__.py in swh/objstorage/factory.py (authored by douardda).
Move the content of swh/objstorage/__init__.py in swh/objstorage/factory.py
Apr 27 2020, 3:19 PM
douardda closed D3062: Move the content of swh/objstorage/__init__.py in swh/objstorage/factory.py.
Apr 27 2020, 3:19 PM
douardda added inline comments to D3063: Normalize the handling of the config file loading in cli.
Apr 27 2020, 3:01 PM
douardda added inline comments to D3063: Normalize the handling of the config file loading in cli.
Apr 27 2020, 2:58 PM
douardda added inline comments to D3063: Normalize the handling of the config file loading in cli.
Apr 27 2020, 2:50 PM
douardda added inline comments to D3063: Normalize the handling of the config file loading in cli.
Apr 27 2020, 2:48 PM
douardda updated the diff for D3062: Move the content of swh/objstorage/__init__.py in swh/objstorage/factory.py.

update copyright dates of modifed files + fix a typo

Apr 27 2020, 1:57 PM

Apr 24 2020

douardda added a task to D3062: Move the content of swh/objstorage/__init__.py in swh/objstorage/factory.py: T2355: Make swh-journal independent from swh-storage or swh-objstorage.
Apr 24 2020, 3:54 PM
douardda added a revision to T2355: Make swh-journal independent from swh-storage or swh-objstorage: D3062: Move the content of swh/objstorage/__init__.py in swh/objstorage/factory.py.
Apr 24 2020, 3:54 PM · Object storage, Storage manager, Journal
douardda created D3063: Normalize the handling of the config file loading in cli.
Apr 24 2020, 3:52 PM
douardda created D3062: Move the content of swh/objstorage/__init__.py in swh/objstorage/factory.py.
Apr 24 2020, 3:51 PM
douardda committed rDSTOecadd5373783: Remove recently added test_cli.test_rpc_serve* tests (authored by douardda).
Remove recently added test_cli.test_rpc_serve* tests
Apr 24 2020, 3:47 PM
douardda closed D3061: Remove recently added test_cli.test_rpc_serve* tests.
Apr 24 2020, 3:47 PM
douardda created D3061: Remove recently added test_cli.test_rpc_serve* tests.
Apr 24 2020, 3:19 PM
douardda created P654 (An Untitled Masterwork).
Apr 24 2020, 2:38 PM
douardda committed rDSTO038c30b40838: Adapt journal client loading to swh.journal 0.0.31 (authored by douardda).
Adapt journal client loading to swh.journal 0.0.31
Apr 24 2020, 1:37 PM
douardda closed D3058: Adapt journal client loading to swh.journal 0.0.31.
Apr 24 2020, 1:37 PM
douardda committed rDSTO4b7ba1fc6bcc: Copy the graph replayer component from swh-journal (authored by douardda).
Copy the graph replayer component from swh-journal
Apr 24 2020, 1:37 PM
douardda closed D3010: Copy the graph replayer component from swh-journal.
Apr 24 2020, 1:37 PM
douardda updated the diff for D3058: Adapt journal client loading to swh.journal 0.0.31.

rebase

Apr 24 2020, 11:59 AM
douardda updated the diff for D3010: Copy the graph replayer component from swh-journal.

clean import statements in test_cli.py

Apr 24 2020, 11:59 AM
douardda committed rDSTO5fd9b563298f: Deprecate the `config-path` argument of the `swh storage rpc-serve` command (authored by douardda).
Deprecate the `config-path` argument of the `swh storage rpc-serve` command
Apr 24 2020, 11:54 AM
douardda committed rDSTOcd32cf42538f: Normalize the configuration file handling in the `swh storage` CLI command (authored by douardda).
Normalize the configuration file handling in the `swh storage` CLI command
Apr 24 2020, 11:54 AM
douardda closed D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.
Apr 24 2020, 11:54 AM
douardda closed D3055: Normalize the configuration file handling in the `swh storage` CLI command.
Apr 24 2020, 11:54 AM
douardda committed rDSTO698af8ca0028: cli: rename the command 'backfiller' as 'backfill' (authored by douardda).
cli: rename the command 'backfiller' as 'backfill'
Apr 24 2020, 11:54 AM
douardda committed rDSTOb2bba450aaa8: Copy the backfiller component from swh-journal (authored by douardda).
Copy the backfiller component from swh-journal
Apr 24 2020, 11:54 AM
douardda closed D3008: Copy the backfiller component from swh-journal.
Apr 24 2020, 11:54 AM
douardda updated the diff for D3058: Adapt journal client loading to swh.journal 0.0.31.

rebase

Apr 24 2020, 11:31 AM
douardda updated the diff for D3010: Copy the graph replayer component from swh-journal.

rebase + add forgotten test_kafka_writer test file

Apr 24 2020, 11:31 AM
douardda updated the diff for D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.

Adapt according to ardumont's comments

Apr 24 2020, 11:29 AM
douardda added a revision to T2355: Make swh-journal independent from swh-storage or swh-objstorage: D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.
Apr 24 2020, 11:29 AM · Object storage, Storage manager, Journal
douardda added inline comments to D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.
Apr 24 2020, 11:20 AM
douardda added a comment to D3011: dataset: add graph export based on kafka.

looks fine to me, but the few minor comments. I'll let @vlorentz gives his green stamp on this.

Apr 24 2020, 11:13 AM

Apr 23 2020

douardda created D3058: Adapt journal client loading to swh.journal 0.0.31.
Apr 23 2020, 4:58 PM
douardda added a revision to T2355: Make swh-journal independent from swh-storage or swh-objstorage: D3058: Adapt journal client loading to swh.journal 0.0.31.
Apr 23 2020, 4:58 PM · Object storage, Storage manager, Journal
douardda updated the diff for D3010: Copy the graph replayer component from swh-journal.

rebased

Apr 23 2020, 4:58 PM
douardda updated the diff for D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.

yet more comments

Apr 23 2020, 4:50 PM
douardda updated the diff for D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.

Add more comments in the convoluted test code

Apr 23 2020, 4:26 PM
douardda accepted D3057: indexer.cli: Adapt get_journal_client instantiation.

ok but IMHO something should be done, some day, to "normalize" also this command so it accepts the "standard" configuration scheme (via --config-file or the SWH_CONFIG_FILE env var). But that's another task. Thanks for the fix.

Apr 23 2020, 4:24 PM
douardda added a comment to D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.
In D3056#74217, @olasd wrote:

Jeez. The check_rpc_serve context manager is so backwards it broke my brain a little. Took me quite a while to figure out that the thread actually runs the test rather than the server. I also think the synchronization between the test and the server initialization should be done more explicitly.

(but I don't really have a better thing to suggest right now)

Apr 23 2020, 4:12 PM
douardda added inline comments to D3008: Copy the backfiller component from swh-journal.
Apr 23 2020, 4:05 PM
douardda added inline comments to D3008: Copy the backfiller component from swh-journal.
Apr 23 2020, 4:02 PM
douardda created D3056: Deprecate the `config-path` argument of the `swh storage rpc-serve` command.
Apr 23 2020, 3:31 PM
douardda created D3055: Normalize the configuration file handling in the `swh storage` CLI command.
Apr 23 2020, 3:30 PM
douardda updated the diff for D3008: Copy the backfiller component from swh-journal.

rebase

Apr 23 2020, 1:32 PM
douardda committed rDJNLdc96335dbf5a: Normalize the get_journal_client() function (authored by douardda).
Normalize the get_journal_client() function
Apr 23 2020, 12:27 PM
douardda committed rDJNL72ea87ccf784: Move get_journal_client function to swh.journal.client (authored by douardda).
Move get_journal_client function to swh.journal.client
Apr 23 2020, 12:27 PM
douardda closed D3044: Move get_journal_client function to swh.journal.client.
Apr 23 2020, 12:27 PM
douardda updated the diff for D3044: Move get_journal_client function to swh.journal.client.

Add a commit to "normalize" the get_journal_client() function

Apr 23 2020, 11:54 AM
douardda added a comment to D3044: Move get_journal_client function to swh.journal.client.

I'd say it'd be neat to add some docstrings and type at the same time, don't you think?

Apr 23 2020, 9:50 AM
douardda added a comment to D3040: Add a split_content argument to object_dicts() and objects() strategies.

Technically, this sounds fine ;)

What is the new use case? Will we merge back the content topics into one or something?

Apr 23 2020, 9:47 AM

Apr 22 2020

douardda added a revision to T2355: Make swh-journal independent from swh-storage or swh-objstorage: D3044: Move get_journal_client function to swh.journal.client.
Apr 22 2020, 4:50 PM · Object storage, Storage manager, Journal
douardda created D3044: Move get_journal_client function to swh.journal.client.
Apr 22 2020, 4:50 PM
douardda committed rDJNL42f4a89abc72: Extract kafka-related pytest fixtures in a pytest plugin module (authored by douardda).
Extract kafka-related pytest fixtures in a pytest plugin module
Apr 22 2020, 4:48 PM