Page MenuHomeSoftware Heritage
Feed Advanced Search

Aug 30 2019

Herald added a reviewer for D1931: bitbucket: make BitBucketLister's api_baseurl init argument optional: Reviewers.
Aug 30 2019, 6:04 PM
Herald added a reviewer for D1930: core: make it possible to specify the api_baseurl init argument in override_config: Reviewers.
Aug 30 2019, 6:03 PM
Herald added a reviewer for D1929: cgit: rewrite the CGit lister: Reviewers.
Aug 30 2019, 6:03 PM
Herald added a reviewer for D1928: bitbucket: simplify a bit BitBucketLister's constructor: Reviewers.
Aug 30 2019, 6:02 PM
Herald added a reviewer for D1927: phabricator: randomly select the API token in the provided list: Reviewers.
Aug 30 2019, 6:02 PM
Herald added a reviewer for D1926: phabricator: small refactoring/simplification of the request_params method: Reviewers.
Aug 30 2019, 6:02 PM
Herald added a reviewer for D1925: phabricator: kill PhabricatorLister's api_token argument: Reviewers.
Aug 30 2019, 6:01 PM
Herald added a reviewer for D1924: core: move credentials' docstring from request_params to request_instance_credentials: Reviewers.
Aug 30 2019, 6:01 PM

Aug 29 2019

douardda committed rDJNL50727acccd9a: cli: rename cli command content_replay as content-replay (authored by douardda).
cli: rename cli command content_replay as content-replay
Aug 29 2019, 4:41 PM
douardda closed D1921: cli: rename cli command content_replay as content-replay.
Aug 29 2019, 4:41 PM
douardda committed rDJNLe7417989d5aa: replayer: make the replayer handle kafka message without 'metadata' field (authored by douardda).
replayer: make the replayer handle kafka message without 'metadata' field
Aug 29 2019, 4:41 PM
douardda closed D1790: replayer: make the replayer handle kafka message without 'metadata' field.
Aug 29 2019, 4:41 PM
douardda committed rDJNL094cede04a93: tests: extract most of test_*_origin_visit tests in a helper function (authored by douardda).
tests: extract most of test_*_origin_visit tests in a helper function
Aug 29 2019, 4:35 PM
douardda closed D1920: tests: extract most of test_*_origin_visit tests in a helper function.
Aug 29 2019, 4:35 PM
douardda updated the diff for D1921: cli: rename cli command content_replay as content-replay.

rebase

Aug 29 2019, 4:31 PM
douardda updated the diff for D1790: replayer: make the replayer handle kafka message without 'metadata' field.

rebase

Aug 29 2019, 4:30 PM
douardda updated the diff for D1920: tests: extract most of test_*_origin_visit tests in a helper function.

fix a typo in test_replay.py

Aug 29 2019, 4:29 PM
douardda updated the diff for D1921: cli: rename cli command content_replay as content-replay.

rebase

Aug 29 2019, 3:39 PM
douardda updated the diff for D1790: replayer: make the replayer handle kafka message without 'metadata' field.

rebase

Aug 29 2019, 3:38 PM
douardda added a comment to T1958: Performance tuning of zfs infrastructure.

Let me add this to the list:

Aug 29 2019, 3:30 PM · System administration
douardda added a comment to T1958: Performance tuning of zfs infrastructure.

have you made you mind on the storage model you want for this? Can we purchase a few of them any time soon?

Aug 29 2019, 3:24 PM · System administration
douardda accepted D1878: Make snapshot_add validate its input..
Aug 29 2019, 1:48 PM
douardda added a comment to D1918: statsd: protect access to the statsd's socket.

Why isn't the socket initialized by __init__?

Aug 29 2019, 1:45 PM
douardda added a comment to D1918: statsd: protect access to the statsd's socket.

Why isn't the socket initialized by __init__?

Aug 29 2019, 1:43 PM
douardda added inline comments to D1920: tests: extract most of test_*_origin_visit tests in a helper function.
Aug 29 2019, 1:38 PM
douardda added inline comments to D1920: tests: extract most of test_*_origin_visit tests in a helper function.
Aug 29 2019, 1:34 PM
douardda accepted D1752: Remove fallback when aiohttp_utils is not installed..
Aug 29 2019, 1:30 PM
douardda updated the diff for D1920: tests: extract most of test_*_origin_visit tests in a helper function.

rebased + changes according to volrentz' comments

Aug 29 2019, 10:44 AM
douardda added inline comments to D1920: tests: extract most of test_*_origin_visit tests in a helper function.
Aug 29 2019, 10:42 AM

Aug 28 2019

douardda updated the diff for D1504: implement listers as plugins.

rebase + changes in the plugin "API"

Aug 28 2019, 5:56 PM
douardda accepted D1919: listers: Open cli to allow a first listing pass on new forge instance.

LGTM

Aug 28 2019, 3:57 PM · Lister
douardda updated the diff for D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.

conftest: Move import statement at the top, as requested by vlorentz

Aug 28 2019, 3:54 PM
douardda requested changes to D1878: Make snapshot_add validate its input..

I'm fine with this diff but I'm a bit nitpicky...

Aug 28 2019, 3:46 PM
douardda added inline comments to D1878: Make snapshot_add validate its input..
Aug 28 2019, 3:42 PM
douardda added a comment to D1752: Remove fallback when aiohttp_utils is not installed..

FTR, and IIRC, I did write this fallback stuff because aiohttp_utils was not available on stretch.

Aug 28 2019, 3:31 PM
douardda added inline comments to D1919: listers: Open cli to allow a first listing pass on new forge instance.
Aug 28 2019, 3:06 PM · Lister
douardda added inline comments to D1919: listers: Open cli to allow a first listing pass on new forge instance.
Aug 28 2019, 2:59 PM · Lister
douardda added inline comments to D1919: listers: Open cli to allow a first listing pass on new forge instance.
Aug 28 2019, 2:57 PM · Lister
Herald added a reviewer for D1921: cli: rename cli command content_replay as content-replay: Reviewers.
Aug 28 2019, 2:25 PM
douardda updated the diff for D1790: replayer: make the replayer handle kafka message without 'metadata' field.

rebased

Aug 28 2019, 2:25 PM
douardda updated the diff for D1920: tests: extract most of test_*_origin_visit tests in a helper function.

rebased

Aug 28 2019, 2:25 PM
douardda committed rDJNLa3720aea1028: content-replayer: add a bit of resiliency when copying an object (authored by douardda).
content-replayer: add a bit of resiliency when copying an object
Aug 28 2019, 2:21 PM
douardda closed D1791: content-replayer: add a bit of resiliency when copying an object.
Aug 28 2019, 2:21 PM
douardda updated the diff for D1791: content-replayer: add a bit of resiliency when copying an object.

rebased + lower a logging statement from info to debug

Aug 28 2019, 2:20 PM
douardda updated the diff for D1791: content-replayer: add a bit of resiliency when copying an object.

rebased

Aug 28 2019, 2:10 PM
douardda updated the diff for D1790: replayer: make the replayer handle kafka message without 'metadata' field.

rebased

Aug 28 2019, 2:10 PM
Herald added a reviewer for D1920: tests: extract most of test_*_origin_visit tests in a helper function: Reviewers.
Aug 28 2019, 2:09 PM
douardda abandoned D1789: replayer: ensure the 'type' field of the origin_visit exists.

Not sure this is needed any more. The test part will be provided a a dedicated diff

Aug 28 2019, 2:08 PM
Herald added a reviewer for D1918: statsd: protect access to the statsd's socket: Reviewers.
Aug 28 2019, 10:40 AM

Aug 8 2019

douardda committed rDSTOCbc2f03cc5fba: api: use RPCServerApp and RPCClient instead of deprecated classes (authored by douardda).
api: use RPCServerApp and RPCClient instead of deprecated classes
Aug 8 2019, 4:17 PM

Jul 31 2019

douardda closed D1737: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp.

closed by b0b99b8c711583fa78cc12e1841da62aa0d4c7e4

Jul 31 2019, 4:14 PM
Herald added a reviewer for D1791: content-replayer: add a bit of resiliency when copying an object: Reviewers.
Jul 31 2019, 3:41 PM
Herald added a reviewer for D1790: replayer: make the replayer handle kafka message without 'metadata' field: Reviewers.
Jul 31 2019, 3:40 PM
Herald added a reviewer for D1789: replayer: ensure the 'type' field of the origin_visit exists: Reviewers.
Jul 31 2019, 3:39 PM
Herald added a reviewer for D1788: backfiller: include origin_visit's metadata: Reviewers.
Jul 31 2019, 3:38 PM

Jul 30 2019

douardda committed rDCOREe3a59f482122: cli/db: properly handle the SWH_CONFIG_FILENAME in 'swh db init' command (authored by douardda).
cli/db: properly handle the SWH_CONFIG_FILENAME in 'swh db init' command
Jul 30 2019, 1:54 PM
douardda committed rDCORE578fdc38e0d0: cli/db: fix a typo in 'swh db init' cli command (authored by douardda).
cli/db: fix a typo in 'swh db init' cli command
Jul 30 2019, 1:53 PM

Jul 29 2019

douardda accepted D1771: Add option --exclude-sha1-file to content-replay..

Thanks for this stack. Note my small comment about using the hardcoded value 20 in there. These values should come somehow from swh.model I guess...

Jul 29 2019, 2:07 PM
douardda accepted D1770: Add function is_hash_in_bytearray..
Jul 29 2019, 2:03 PM
douardda accepted D1769: Add test for the CLI endpoint content_replay..
Jul 29 2019, 1:57 PM
douardda accepted D1779: swh_hostname: Deal with all swh domains.

LGTM but I'm no ruby guy

Jul 29 2019, 1:48 PM
douardda requested changes to D1762: Provision staging vms through terraform (up to the first puppet run).

Looks globally ok but as discussed IRL:

  • we really do not want this hardocoded MAC address,
  • we really want this first staging vm to live in a dedicated /24 instead of prod's one (192.168.100.0/24),
  • it would be nice to check if this declared resources can be "templatized"; having to copy/paste this whole resource declaration for each and every VM we want to instantiate is the promise of a nightmare...
Jul 29 2019, 1:31 PM · Staff, System administration
douardda accepted D1778: Fix revision cooking errors with the vault for large revision log.

I'm not against this diff as quick solution for the problem, but I'm disappointed that this pagination stuff is not properly managed in the (client part) storage itself. What the point of having a client implementation of the storage if we do not abstract these kind of 'basic' behaviors?

Jul 29 2019, 10:17 AM

Jul 23 2019

douardda committed rDCIDXb0b99b8c7115: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp (authored by douardda).
api/server: use RPCServerApp instead of deprecated SWHServerAPIApp
Jul 23 2019, 4:12 PM

Jul 22 2019

douardda committed rMSLD9aeb1ec0110a: talks/PSES: final version of the slides (authored by douardda).
talks/PSES: final version of the slides
Jul 22 2019, 1:30 PM
douardda added a comment to T1382: Survey of the data stored in uffizi:/srv/storage/space and banco:/srv/storage/space..

What needs to be checked on next reboot is:

Jul 22 2019, 12:25 PM · System administration
douardda added a comment to T1382: Survey of the data stored in uffizi:/srv/storage/space and banco:/srv/storage/space..

I have moved /srv/storage/space/annex on a dedicated zfs volume.

Jul 22 2019, 11:02 AM · System administration
douardda added a comment to T1371: Move the raw imported data off uffizi/banco /srv/storage/space, which is getting full.

not sure this is the right ticket for it, but I've made a copy of the annex on a new volume (on zfs) to free a bot more of /srv/storage/space

Jul 22 2019, 10:49 AM · System administration

Jul 18 2019

douardda committed rDMOD44c962a0e147: Fix dependency on pyblake3 on stretch (authored by douardda).
Fix dependency on pyblake3 on stretch
Jul 18 2019, 5:24 PM
douardda committed rDMODa3cc381c2961: Fix for stretch: depends on python3-pyblake2 (authored by douardda).
Fix for stretch: depends on python3-pyblake2
Jul 18 2019, 4:34 PM
douardda created P476 pyblake2.
Jul 18 2019, 3:42 PM
douardda committed rDJNLe12d72a4cc9a: Update dependency on storage 0.0.147 (authored by douardda).
Update dependency on storage 0.0.147
Jul 18 2019, 1:38 PM
douardda committed rDJNL03a50738b9b1: cli: remove the bw-compat --consumer-id option of replay amd content_replay… (authored by douardda).
cli: remove the bw-compat --consumer-id option of replay amd content_replay…
Jul 18 2019, 1:34 PM
douardda closed D1747: cli: remove the bw-compat --consumer-id option of replay amd content_replay commands.
Jul 18 2019, 1:34 PM
douardda committed rDSTObc2f03cc5fba: api: use RPCServerApp and RPCClient instead of deprecated classes (authored by douardda).
api: use RPCServerApp and RPCClient instead of deprecated classes
Jul 18 2019, 1:30 PM
douardda closed D1739: api: use RPCServerApp and RPCClient instead of deprecated classes.
Jul 18 2019, 1:30 PM
douardda updated the diff for D1739: api: use RPCServerApp and RPCClient instead of deprecated classes.

rebased

Jul 18 2019, 1:30 PM
Herald added a reviewer for D1747: cli: remove the bw-compat --consumer-id option of replay amd content_replay commands: Reviewers.
Jul 18 2019, 1:25 PM
douardda accepted D1745: Make the replayer adapt from older formats..
Jul 18 2019, 12:11 PM
douardda added inline comments to D1745: Make the replayer adapt from older formats..
Jul 18 2019, 11:45 AM
douardda requested changes to D1745: Make the replayer adapt from older formats..
Jul 18 2019, 11:31 AM
douardda accepted D1745: Make the replayer adapt from older formats..

Ok with this, but it would make sense to have tests for these different configurations of 'old formats' I guess...

Jul 18 2019, 10:24 AM

Jul 16 2019

douardda committed rDCOREc66625944974: skip test_swh_db_help since it depends on click 7 to pass (authored by douardda).
skip test_swh_db_help since it depends on click 7 to pass
Jul 16 2019, 3:31 PM
douardda committed rDCORE97cafa3ab5cc: new release v0.0.65-1~swh2 (authored by douardda).
new release v0.0.65-1~swh2
Jul 16 2019, 2:50 PM
douardda committed rDCORE29f1742b8fd7: Update debian/control (authored by douardda).
Update debian/control
Jul 16 2019, 2:34 PM
douardda accepted D1740: deposit: Separate loader and checker services.
Jul 16 2019, 11:40 AM

Jul 15 2019

Herald added a reviewer for D1739: api: use RPCServerApp and RPCClient instead of deprecated classes: Reviewers.
Jul 15 2019, 5:02 PM
douardda updated the diff for D1737: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp.

depend on swh.core 0.0.65

Jul 15 2019, 4:56 PM
Herald added a reviewer for D1737: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp: Reviewers.
Jul 15 2019, 3:57 PM
douardda committed rDCORE4a20ead81216: api/async: add support for content negotiation (authored by douardda).
api/async: add support for content negotiation
Jul 15 2019, 3:53 PM
douardda closed D1688: api/async: add support for content negotiation.
Jul 15 2019, 3:53 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rebased

Jul 15 2019, 3:37 PM
douardda committed rDCORE13c18d781628: api: properly use deprecated for class renamings (authored by douardda).
api: properly use deprecated for class renamings
Jul 15 2019, 3:36 PM
douardda closed D1735: api: properly use deprecated for class renamings.
Jul 15 2019, 3:36 PM
douardda updated the diff for D1735: api: properly use deprecated for class renamings.

rebased

Jul 15 2019, 3:35 PM
douardda committed rDCORE46a9ede3b708: tests/cli: make test_swh_help ignore the 'Commands' part of the help msg (authored by douardda).
tests/cli: make test_swh_help ignore the 'Commands' part of the help msg
Jul 15 2019, 3:34 PM
douardda closed D1734: tests/cli: make test_swh_help ignore the 'Commands' part of the help msg.
Jul 15 2019, 3:34 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

oops (commit message)

Jul 15 2019, 2:46 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rework a bit the diff so that

Jul 15 2019, 12:29 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rebased

Jul 15 2019, 12:06 PM