Page MenuHomeSoftware Heritage

douardda (David Douard)
User

Projects (7)

User Details

User Since
Jul 10 2018, 12:38 PM (57 w, 4 d)

Recent Activity

Thu, Aug 8

douardda committed rDSTOCbc2f03cc5fba: api: use RPCServerApp and RPCClient instead of deprecated classes (authored by douardda).
api: use RPCServerApp and RPCClient instead of deprecated classes
Thu, Aug 8, 4:17 PM

Wed, Jul 31

douardda closed D1737: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp.

closed by b0b99b8c711583fa78cc12e1841da62aa0d4c7e4

Wed, Jul 31, 4:14 PM
Herald added a reviewer for D1791: content-replayer: add a bit of resiliency when copying an object: Reviewers.
Wed, Jul 31, 3:41 PM
Herald added a reviewer for D1790: replayer: make the replayer handle kafka message without 'metadata' field: Reviewers.
Wed, Jul 31, 3:40 PM
Herald added a reviewer for D1789: replayer: ensure the 'type' field of the origin_visit exists: Reviewers.
Wed, Jul 31, 3:39 PM
Herald added a reviewer for D1788: backfiller: include origin_visit's metadata: Reviewers.
Wed, Jul 31, 3:38 PM

Tue, Jul 30

douardda committed rDCOREe3a59f482122: cli/db: properly handle the SWH_CONFIG_FILENAME in 'swh db init' command (authored by douardda).
cli/db: properly handle the SWH_CONFIG_FILENAME in 'swh db init' command
Tue, Jul 30, 1:54 PM
douardda committed rDCORE578fdc38e0d0: cli/db: fix a typo in 'swh db init' cli command (authored by douardda).
cli/db: fix a typo in 'swh db init' cli command
Tue, Jul 30, 1:53 PM

Mon, Jul 29

douardda accepted D1771: Add option --exclude-sha1-file to content-replay..

Thanks for this stack. Note my small comment about using the hardcoded value 20 in there. These values should come somehow from swh.model I guess...

Mon, Jul 29, 2:07 PM
douardda accepted D1770: Add function is_hash_in_bytearray..
Mon, Jul 29, 2:03 PM
douardda accepted D1769: Add test for the CLI endpoint content_replay..
Mon, Jul 29, 1:57 PM
douardda accepted D1779: swh_hostname: Deal with all swh domains.

LGTM but I'm no ruby guy

Mon, Jul 29, 1:48 PM
douardda requested changes to D1762: Provision staging vms through terraform (up to the first puppet run).

Looks globally ok but as discussed IRL:

  • we really do not want this hardocoded MAC address,
  • we really want this first staging vm to live in a dedicated /24 instead of prod's one (192.168.100.0/24),
  • it would be nice to check if this declared resources can be "templatized"; having to copy/paste this whole resource declaration for each and every VM we want to instantiate is the promise of a nightmare...
Mon, Jul 29, 1:31 PM · Staff, System administration
douardda accepted D1778: Fix revision cooking errors with the vault for large revision log.

I'm not against this diff as quick solution for the problem, but I'm disappointed that this pagination stuff is not properly managed in the (client part) storage itself. What the point of having a client implementation of the storage if we do not abstract these kind of 'basic' behaviors?

Mon, Jul 29, 10:17 AM

Tue, Jul 23

douardda committed rDCIDXb0b99b8c7115: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp (authored by douardda).
api/server: use RPCServerApp instead of deprecated SWHServerAPIApp
Tue, Jul 23, 4:12 PM

Mon, Jul 22

douardda committed rMSLD9aeb1ec0110a: talks/PSES: final version of the slides (authored by douardda).
talks/PSES: final version of the slides
Mon, Jul 22, 1:30 PM
douardda added a comment to T1382: Survey of the data stored in uffizi:/srv/storage/space and banco:/srv/storage/space..

What needs to be checked on next reboot is:

Mon, Jul 22, 12:25 PM · System administration
douardda added a comment to T1382: Survey of the data stored in uffizi:/srv/storage/space and banco:/srv/storage/space..

I have moved /srv/storage/space/annex on a dedicated zfs volume.

Mon, Jul 22, 11:02 AM · System administration
douardda added a comment to T1371: Move the raw imported data off uffizi/banco /srv/storage/space, which is getting full.

not sure this is the right ticket for it, but I've made a copy of the annex on a new volume (on zfs) to free a bot more of /srv/storage/space

Mon, Jul 22, 10:49 AM · System administration

Jul 18 2019

douardda committed rDMOD44c962a0e147: Fix dependency on pyblake3 on stretch (authored by douardda).
Fix dependency on pyblake3 on stretch
Jul 18 2019, 5:24 PM
douardda committed rDMODa3cc381c2961: Fix for stretch: depends on python3-pyblake2 (authored by douardda).
Fix for stretch: depends on python3-pyblake2
Jul 18 2019, 4:34 PM
douardda created P476 pyblake2.
Jul 18 2019, 3:42 PM
douardda committed rDJNLe12d72a4cc9a: Update dependency on storage 0.0.147 (authored by douardda).
Update dependency on storage 0.0.147
Jul 18 2019, 1:38 PM
douardda committed rDJNL03a50738b9b1: cli: remove the bw-compat --consumer-id option of replay amd content_replay… (authored by douardda).
cli: remove the bw-compat --consumer-id option of replay amd content_replay…
Jul 18 2019, 1:34 PM
douardda closed D1747: cli: remove the bw-compat --consumer-id option of replay amd content_replay commands.
Jul 18 2019, 1:34 PM
douardda committed rDSTObc2f03cc5fba: api: use RPCServerApp and RPCClient instead of deprecated classes (authored by douardda).
api: use RPCServerApp and RPCClient instead of deprecated classes
Jul 18 2019, 1:30 PM
douardda closed D1739: api: use RPCServerApp and RPCClient instead of deprecated classes.
Jul 18 2019, 1:30 PM
douardda updated the diff for D1739: api: use RPCServerApp and RPCClient instead of deprecated classes.

rebased

Jul 18 2019, 1:30 PM
Herald added a reviewer for D1747: cli: remove the bw-compat --consumer-id option of replay amd content_replay commands: Reviewers.
Jul 18 2019, 1:25 PM
douardda accepted D1745: Make the replayer adapt from older formats..
Jul 18 2019, 12:11 PM
douardda added inline comments to D1745: Make the replayer adapt from older formats..
Jul 18 2019, 11:45 AM
douardda requested changes to D1745: Make the replayer adapt from older formats..
Jul 18 2019, 11:31 AM
douardda accepted D1745: Make the replayer adapt from older formats..

Ok with this, but it would make sense to have tests for these different configurations of 'old formats' I guess...

Jul 18 2019, 10:24 AM

Jul 16 2019

douardda committed rDCOREc66625944974: skip test_swh_db_help since it depends on click 7 to pass (authored by douardda).
skip test_swh_db_help since it depends on click 7 to pass
Jul 16 2019, 3:31 PM
douardda committed rDCORE97cafa3ab5cc: new release v0.0.65-1~swh2 (authored by douardda).
new release v0.0.65-1~swh2
Jul 16 2019, 2:50 PM
douardda committed rDCORE29f1742b8fd7: Update debian/control (authored by douardda).
Update debian/control
Jul 16 2019, 2:34 PM
douardda accepted D1740: deposit: Separate loader and checker services.
Jul 16 2019, 11:40 AM

Jul 15 2019

Herald added a reviewer for D1739: api: use RPCServerApp and RPCClient instead of deprecated classes: Reviewers.
Jul 15 2019, 5:02 PM
douardda updated the diff for D1737: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp.

depend on swh.core 0.0.65

Jul 15 2019, 4:56 PM
Herald added a reviewer for D1737: api/server: use RPCServerApp instead of deprecated SWHServerAPIApp: Reviewers.
Jul 15 2019, 3:57 PM
douardda committed rDCORE4a20ead81216: api/async: add support for content negotiation (authored by douardda).
api/async: add support for content negotiation
Jul 15 2019, 3:53 PM
douardda closed D1688: api/async: add support for content negotiation.
Jul 15 2019, 3:53 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rebased

Jul 15 2019, 3:37 PM
douardda committed rDCORE13c18d781628: api: properly use deprecated for class renamings (authored by douardda).
api: properly use deprecated for class renamings
Jul 15 2019, 3:36 PM
douardda closed D1735: api: properly use deprecated for class renamings.
Jul 15 2019, 3:36 PM
douardda updated the diff for D1735: api: properly use deprecated for class renamings.

rebased

Jul 15 2019, 3:35 PM
douardda committed rDCORE46a9ede3b708: tests/cli: make test_swh_help ignore the 'Commands' part of the help msg (authored by douardda).
tests/cli: make test_swh_help ignore the 'Commands' part of the help msg
Jul 15 2019, 3:34 PM
douardda closed D1734: tests/cli: make test_swh_help ignore the 'Commands' part of the help msg.
Jul 15 2019, 3:34 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

oops (commit message)

Jul 15 2019, 2:46 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rework a bit the diff so that

Jul 15 2019, 12:29 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rebased

Jul 15 2019, 12:06 PM
Herald added a reviewer for D1735: api: properly use deprecated for class renamings: Reviewers.
Jul 15 2019, 12:04 PM
Herald added a reviewer for D1734: tests/cli: make test_swh_help ignore the 'Commands' part of the help msg: Reviewers.
Jul 15 2019, 12:04 PM

Jul 11 2019

douardda accepted D1723: add code of conduct document, based on contributor covenant.

LGTM

Jul 11 2019, 4:11 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rework a bit the commit message

Jul 11 2019, 3:45 PM
douardda added a comment to D1688: api/async: add support for content negotiation.

The debian package for aiohttp_utils is now available on debian.softwareheritage.org

Jul 11 2019, 3:29 PM
douardda accepted D1719: Rename Jenkins cypress job for Phabricator Diff.
Jul 11 2019, 11:51 AM

Jul 10 2019

douardda accepted D1716: Add Jenkins jobs to run cypress tests for swh-web.
Jul 10 2019, 4:51 PM
douardda accepted D1718: Update indexer-journal-client config and entrypoint..
Jul 10 2019, 4:43 PM
douardda added a comment to T1895: De-baremetalify louvre.
In T1895#35161, @olasd wrote:

For backup centralization, it can stay there for now I guess.

Well the thing is the bare metal machine's OS will be replaced by uffizi's os when T1894 happens, so we do need to move it somewhere else.

Jul 10 2019, 4:40 PM · System administration
douardda accepted D1717: Add tests for the in-mem storage with origin ids disabled..
Jul 10 2019, 4:24 PM
douardda committed rDSCHf63274a75752: docs: very beginning of a practical documentation on the scheduler (authored by douardda).
docs: very beginning of a practical documentation on the scheduler
Jul 10 2019, 4:17 PM
douardda closed D1714: docs: very beginning of a practical documentation on the scheduler.
Jul 10 2019, 4:17 PM
douardda added inline comments to D1714: docs: very beginning of a practical documentation on the scheduler.
Jul 10 2019, 4:16 PM
douardda updated the diff for D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.

More explicit code for the loading of swh.workers entrypoint

Jul 10 2019, 4:15 PM
douardda added inline comments to D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.
Jul 10 2019, 4:11 PM
douardda updated the diff for D1503: celery: auto add tasks declared in the swh.workers entry point in task_modules.

rebased + a very small bit of doc

Jul 10 2019, 4:03 PM
Herald added a reviewer for D1714: docs: very beginning of a practical documentation on the scheduler: Reviewers.
Jul 10 2019, 4:02 PM
douardda committed rDSCH9b7407fe434d: updater: small refactoring to please codespell (authored by douardda).
updater: small refactoring to please codespell
Jul 10 2019, 4:00 PM
douardda committed rDSCH92b81f33f903: Add a pre-commit config file (authored by douardda).
Add a pre-commit config file
Jul 10 2019, 4:00 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rebased

Jul 10 2019, 12:03 PM
douardda committed rDCORE7bf33cb4b513: cli: add a new 'db' cli group with an 'init' subcommand (authored by douardda).
cli: add a new 'db' cli group with an 'init' subcommand
Jul 10 2019, 12:02 PM
douardda closed T1896: swh db-init should be able to read db cnx creds from a standard swh config file as Resolved by committing rDCORE7bf33cb4b513: cli: add a new 'db' cli group with an 'init' subcommand.
Jul 10 2019, 12:02 PM · Core & foundations
douardda closed D1703: cli: add a new 'db' cli group with an 'init' subcommand.
Jul 10 2019, 12:02 PM
douardda updated the diff for D1703: cli: add a new 'db' cli group with an 'init' subcommand.

add a couple a simple tests

Jul 10 2019, 12:01 PM
douardda added a comment to T1876: staging infra: Configure DNS zones.

my proposal:

Jul 10 2019, 11:03 AM · System administration
douardda updated the diff for D1703: cli: add a new 'db' cli group with an 'init' subcommand.

rebase

Jul 10 2019, 10:46 AM
douardda committed rDCORE0f4c2e4ff573: Add a pre-commit config file (authored by douardda).
Add a pre-commit config file
Jul 10 2019, 10:45 AM
douardda closed D1705: Add a pre-commit config file.
Jul 10 2019, 10:45 AM
douardda committed rDCORE9812fe7ed221: README: add a very short development setup guide (authored by douardda).
README: add a very short development setup guide
Jul 10 2019, 10:45 AM
douardda closed D1704: README: add a very short development setup guide.
Jul 10 2019, 10:45 AM
douardda updated the diff for D1705: Add a pre-commit config file.

rebased

Jul 10 2019, 10:39 AM
douardda updated the diff for D1704: README: add a very short development setup guide.

more typos

Jul 10 2019, 10:39 AM
douardda committed rDCORE9e29cfaec429: tarball: extract safemembers() from within _uncompress_tar() (authored by douardda).
tarball: extract safemembers() from within _uncompress_tar()
Jul 10 2019, 10:29 AM
douardda closed D1706: tarball: extract safemembers() from within _uncompress_tar().
Jul 10 2019, 10:29 AM
douardda updated the diff for D1688: api/async: add support for content negotiation.

rebased

Jul 10 2019, 10:28 AM
douardda updated the diff for D1703: cli: add a new 'db' cli group with an 'init' subcommand.

rebased

Jul 10 2019, 10:27 AM
douardda updated the diff for D1705: Add a pre-commit config file.

Depends on D1704

Jul 10 2019, 10:26 AM
douardda updated the diff for D1704: README: add a very short development setup guide.

rebased and small typo (thx ardumont)

Jul 10 2019, 10:26 AM
Herald added a reviewer for D1706: tarball: extract safemembers() from within _uncompress_tar(): Reviewers.
Jul 10 2019, 10:23 AM
douardda triaged T1896: swh db-init should be able to read db cnx creds from a standard swh config file as High priority.
Jul 10 2019, 10:02 AM · Core & foundations
douardda added a comment to T1905: lint docstrings with pydocstyle.

(and yes, reaching 0 warnings/errors it's gonna take a while…)

Jul 10 2019, 9:28 AM · Development documentation
douardda added a comment to T1895: De-baremetalify louvre.

For backup centralization, it can stay there for now I guess.

Jul 10 2019, 9:18 AM · System administration
douardda added a comment to D1688: api/async: add support for content negotiation.

I've published a new version of aiohttp_utils so this diff is no longer a wip

Jul 10 2019, 9:11 AM
douardda retitled D1688: api/async: add support for content negotiation from [WIP] api/async: add support for content negotiation to api/async: add support for content negotiation.
Jul 10 2019, 9:10 AM

Jul 9 2019

douardda updated the diff for D1688: api/async: add support for content negotiation.

fix

Jul 9 2019, 6:08 PM
douardda updated the diff for D1688: api/async: add support for content negotiation.

updated and rebased

Jul 9 2019, 6:07 PM
Herald added a reviewer for D1705: Add a pre-commit config file: Reviewers.
Jul 9 2019, 4:47 PM
Herald added a reviewer for D1704: README: add a very short development setup guide: Reviewers.
Jul 9 2019, 4:47 PM
douardda added a revision to T1896: swh db-init should be able to read db cnx creds from a standard swh config file: D1703: cli: add a new 'db' cli group with an 'init' subcommand.
Jul 9 2019, 4:46 PM · Core & foundations