Page MenuHomeSoftware Heritage

douardda (David Douard)
User

User Details

User Since
Jul 10 2018, 12:38 PM (207 w, 2 d)

Recent Activity

Yesterday

douardda created P1395 (An Untitled Masterwork).
Thu, Jun 30, 1:57 PM

Wed, Jun 29

douardda created P1394 (An Untitled Masterwork).
Wed, Jun 29, 5:32 PM

Thu, Jun 23

douardda triaged T4349: deploy docker-compose-plugin package instead of docker-compose as Normal priority.
Thu, Jun 23, 1:48 PM · System administration
douardda accepted D7987: Refactor snapshot branch functional tests.
Thu, Jun 23, 1:30 PM

Wed, Jun 22

douardda committed rDPROV346f3a575baa: wip (authored by douardda).
wip
Wed, Jun 22, 12:41 PM

Tue, Jun 21

douardda created P1389 (An Untitled Masterwork).
Tue, Jun 21, 2:31 PM

Mon, Jun 20

douardda added a subtask for T4338: mirror: k8s/terraform/hlem deployment test: T4342: Add a jenkins job for the AKS mirror deployment test.
Mon, Jun 20, 10:17 AM · Mirror
douardda added a parent task for T4342: Add a jenkins job for the AKS mirror deployment test: T4338: mirror: k8s/terraform/hlem deployment test.
Mon, Jun 20, 10:17 AM · Mirror
douardda added a parent task for T4341: Add a jenkins job for the docker E2E deployment mirror stack: T4337: mirror: docker swarm deployment test.
Mon, Jun 20, 10:17 AM · Mirror
douardda added a subtask for T4337: mirror: docker swarm deployment test: T4341: Add a jenkins job for the docker E2E deployment mirror stack.
Mon, Jun 20, 10:17 AM · Mirror
douardda renamed T4342: Add a jenkins job for the AKS mirror deployment test from Add a jankins job for the AKS mirror deployment test to Add a jenkins job for the AKS mirror deployment test.
Mon, Jun 20, 10:16 AM · Mirror
douardda triaged T4342: Add a jenkins job for the AKS mirror deployment test as High priority.
Mon, Jun 20, 10:16 AM · Mirror
douardda triaged T4341: Add a jenkins job for the docker E2E deployment mirror stack as High priority.
Mon, Jun 20, 10:16 AM · Mirror
douardda added a subtask for T4339: Write a tool to handle the kafka dataset for the mirror E2E tests: T4337: mirror: docker swarm deployment test.
Mon, Jun 20, 9:58 AM · Mirror
douardda added a parent task for T4337: mirror: docker swarm deployment test: T4339: Write a tool to handle the kafka dataset for the mirror E2E tests.
Mon, Jun 20, 9:58 AM · Mirror
douardda added a subtask for T4339: Write a tool to handle the kafka dataset for the mirror E2E tests: T4338: mirror: k8s/terraform/hlem deployment test.
Mon, Jun 20, 9:58 AM · Mirror
douardda added a parent task for T4338: mirror: k8s/terraform/hlem deployment test: T4339: Write a tool to handle the kafka dataset for the mirror E2E tests.
Mon, Jun 20, 9:58 AM · Mirror
douardda triaged T4339: Write a tool to handle the kafka dataset for the mirror E2E tests as High priority.
Mon, Jun 20, 9:57 AM · Mirror
douardda triaged T4338: mirror: k8s/terraform/hlem deployment test as High priority.
Mon, Jun 20, 9:53 AM · Mirror
douardda renamed T4336: Add deployment tests for the mirror from Add a deployment test for the mirror to Add deployment tests for the mirror.
Mon, Jun 20, 9:52 AM · Mirror
douardda triaged T4337: mirror: docker swarm deployment test as High priority.
Mon, Jun 20, 9:51 AM · Mirror
douardda triaged T4336: Add deployment tests for the mirror as High priority.
Mon, Jun 20, 9:50 AM · Mirror

Fri, Jun 17

douardda added inline comments to D7987: Refactor snapshot branch functional tests.
Fri, Jun 17, 2:29 PM
douardda added inline comments to D7987: Refactor snapshot branch functional tests.
Fri, Jun 17, 2:27 PM

Wed, Jun 15

douardda added inline comments to D7989: Refactor origin connection functional tests.
Wed, Jun 15, 3:20 PM
douardda requested changes to D7987: Refactor snapshot branch functional tests.

please explain a bit what this refactor is about in the commit message.

Wed, Jun 15, 9:59 AM
douardda added a comment to D7988: api/origin: Do not attempt to lookup similar origin URLs.

Also, this will "break the API". I am not opposed to this change, but some care should be taken when changing public's API behavior like this. (attempt to check if there are users of the behavior to be modified, document the new behavior, display/return a warning or something, etc)

Wed, Jun 15, 9:50 AM
douardda added inline comments to D7988: api/origin: Do not attempt to lookup similar origin URLs.
Wed, Jun 15, 9:46 AM
douardda closed D7982: docker: update the storage.yml config file a bit.
Wed, Jun 15, 9:41 AM
douardda closed D7981: docker: Update and normalize conf/web.yaml and conf/web-search.yml.
Wed, Jun 15, 9:41 AM
douardda committed rDENVa20102186be2: docker: update the storage.yml config file a bit (authored by douardda).
docker: update the storage.yml config file a bit
Wed, Jun 15, 9:41 AM
douardda committed rDENVc00ee6f08890: docker: Update and normalize conf/web.yaml and conf/web-search.yml (authored by douardda).
docker: Update and normalize conf/web.yaml and conf/web-search.yml
Wed, Jun 15, 9:41 AM

Tue, Jun 14

douardda added inline comments to D7980: Return origin object for analogues URLs.
Tue, Jun 14, 2:52 PM
douardda added a comment to D7980: Return origin object for analogues URLs.

Ack, I will make the change to the /api/1/origin/ endpoint to remove the URL processing then.

Tue, Jun 14, 2:47 PM
douardda added a comment to D7980: Return origin object for analogues URLs.

Why should this be implemented by the API (as opposed to UIs)?

This is part of our current REST APIs.

Tue, Jun 14, 12:39 PM

Mon, Jun 13

douardda added inline comments to D7981: docker: Update and normalize conf/web.yaml and conf/web-search.yml.
Mon, Jun 13, 3:26 PM
douardda updated the diff for D7982: docker: update the storage.yml config file a bit.

rebase

Mon, Jun 13, 3:26 PM
douardda updated the diff for D7981: docker: Update and normalize conf/web.yaml and conf/web-search.yml.

set timeout to 5s on both configs, as requested by anlambert

Mon, Jun 13, 3:25 PM
douardda requested review of D7982: docker: update the storage.yml config file a bit.
Mon, Jun 13, 3:08 PM
douardda requested review of D7981: docker: Update and normalize conf/web.yaml and conf/web-search.yml.
Mon, Jun 13, 3:07 PM

Fri, Jun 10

douardda closed T4265: Create test topics on staging's kafka for the mirror tests as Resolved.

I've added the DescribeConfigs and AlterConfigs permissions for the mirror-test-rw principal, now I can do all I need.

Fri, Jun 10, 3:41 PM · System administration
douardda triaged T4325: Remove (useless) metadata_authority and metadata_fetcher from the journal as Normal priority.
Fri, Jun 10, 2:51 PM · Storage manager

Wed, Jun 8

douardda closed D7970: Fix InMemoryJournalWriter: do not anonymize objects by default.
Wed, Jun 8, 12:30 PM
douardda committed rDJNL6b05a6c949b4: Fix InMemoryJournalWriter: do not anonymize objects by default (authored by douardda).
Fix InMemoryJournalWriter: do not anonymize objects by default
Wed, Jun 8, 12:30 PM
douardda updated the diff for D7970: Fix InMemoryJournalWriter: do not anonymize objects by default.

typos in the ci msg

Wed, Jun 8, 12:29 PM
douardda requested review of D7970: Fix InMemoryJournalWriter: do not anonymize objects by default.
Wed, Jun 8, 12:24 PM
douardda accepted D7913: db: Grant read access to guest user on all tables of the schema.

maybe only show a warning if the grant query fails (rather than crashing)?

Wed, Jun 8, 10:02 AM

Tue, Jun 7

douardda created P1379 (An Untitled Masterwork).
Tue, Jun 7, 1:29 PM
douardda committed rDJNLa208f882a7e5: Make the stream journal client accept a string as output_stream config entry (authored by douardda).
Make the stream journal client accept a string as output_stream config entry
Tue, Jun 7, 11:56 AM
douardda closed D7933: add a kafka_stream_to_value helper function in serializers.py.
Tue, Jun 7, 11:55 AM
douardda committed rDJNL903f8e601aac: Add type annotation for JournalWriter related code (authored by douardda).
Add type annotation for JournalWriter related code
Tue, Jun 7, 11:55 AM
douardda committed rDJNL0e90328a2260: Add a kafka_stream_to_value helper function in serializers.py (authored by douardda).
Add a kafka_stream_to_value helper function in serializers.py
Tue, Jun 7, 11:55 AM
douardda closed D7952: Add type annotation for JournalWriter related code.
Tue, Jun 7, 11:55 AM
douardda committed rDJNL908f015465a3: Remove unused 'privileged' argument from journal writer's write_addition(s) (authored by douardda).
Remove unused 'privileged' argument from journal writer's write_addition(s)
Tue, Jun 7, 11:55 AM

Fri, Jun 3

douardda accepted D7954: Set current_version attribute to postgresql datastore.
Fri, Jun 3, 3:30 PM
douardda accepted D7958: Remove unused get_current_version method.
Fri, Jun 3, 3:29 PM
douardda accepted D7953: Set current_version attribute to postgresql datastore.

lgtm (probably needs tedious hand-managed-db-migration-in-docker test)

Fri, Jun 3, 3:29 PM
douardda updated the diff for D7933: add a kafka_stream_to_value helper function in serializers.py.

rebase

Fri, Jun 3, 12:23 PM
douardda updated the diff for D7952: Add type annotation for JournalWriter related code.

actual fix

Fri, Jun 3, 12:23 PM
douardda updated the diff for D7933: add a kafka_stream_to_value helper function in serializers.py.

rebase

Fri, Jun 3, 12:20 PM
douardda updated the diff for D7952: Add type annotation for JournalWriter related code.

fix

Fri, Jun 3, 12:19 PM
douardda updated the diff for D7933: add a kafka_stream_to_value helper function in serializers.py.

rebase

Fri, Jun 3, 12:04 PM
douardda updated the diff for D7952: Add type annotation for JournalWriter related code.

remove TValue typevar as suggested by vlorentz

Fri, Jun 3, 12:03 PM
douardda added inline comments to D7933: add a kafka_stream_to_value helper function in serializers.py.
Fri, Jun 3, 10:49 AM
douardda added inline comments to D7933: add a kafka_stream_to_value helper function in serializers.py.
Fri, Jun 3, 10:48 AM
douardda requested review of D7952: Add type annotation for JournalWriter related code.
Fri, Jun 3, 10:33 AM
douardda accepted D7943: Revert "cli.db: Use attribute current_version instead of undeclared getter".
Fri, Jun 3, 10:31 AM
douardda updated the diff for D7933: add a kafka_stream_to_value helper function in serializers.py.

rebase and update copyrights

Fri, Jun 3, 10:28 AM
douardda updated the diff for D7933: add a kafka_stream_to_value helper function in serializers.py.

Extract the type annotation part of this diff in a dedicated one

Fri, Jun 3, 10:15 AM

Thu, Jun 2

douardda updated the diff for D7933: add a kafka_stream_to_value helper function in serializers.py.

Add type annotation in swh.journal.writer and rename the 'stream' arg as 'file_like'

Thu, Jun 2, 5:42 PM
douardda committed rDENV510f41098258: Include counters in the the main docker-compose file (authored by douardda).
Include counters in the the main docker-compose file
Thu, Jun 2, 3:54 PM
douardda closed D7851: Include counters in the the main docker-compose file.
Thu, Jun 2, 3:54 PM
douardda committed rDENVa87ff2e88774: Add missing object types in conf/counters_journal_client.yml (authored by douardda).
Add missing object types in conf/counters_journal_client.yml
Thu, Jun 2, 3:54 PM
douardda updated the diff for D7851: Include counters in the the main docker-compose file.

rebase

Thu, Jun 2, 3:53 PM
douardda added inline comments to D7933: add a kafka_stream_to_value helper function in serializers.py.
Thu, Jun 2, 3:48 PM
douardda closed T4285: Deprecate swh.core's postgresql_fact as Resolved.
Thu, Jun 2, 9:53 AM · Core & foundations
douardda committed rDCOREab2ff7434638: move initialize_database_for_module in db_utils (authored by douardda).
move initialize_database_for_module in db_utils
Thu, Jun 2, 9:53 AM
douardda committed rDCORE4fc5f601b69a: deprecate the db/pytest_plugin.py module (authored by douardda).
deprecate the db/pytest_plugin.py module
Thu, Jun 2, 9:53 AM
douardda committed rDCOREb26356329903: mark postgresql_fact fixture factory function as deprecated (authored by douardda).
mark postgresql_fact fixture factory function as deprecated
Thu, Jun 2, 9:52 AM
douardda closed D7934: deprecate the db/pytest_plugin.py module.
Thu, Jun 2, 9:52 AM
douardda committed rDCORE8523bca576b9: tests: use stock pytest_postgresql factory function (authored by douardda).
tests: use stock pytest_postgresql factory function
Thu, Jun 2, 9:52 AM

Wed, Jun 1

douardda requested review of D7934: deprecate the db/pytest_plugin.py module.
Wed, Jun 1, 3:32 PM
douardda requested changes to D7838: Add an overlay storage.
Wed, Jun 1, 1:40 PM
douardda added a comment to D7838: Add an overlay storage.

(not a surprise but) it really needs at least one test of the "overlay feature" for each method...

Wed, Jun 1, 1:40 PM
douardda added inline comments to D7838: Add an overlay storage.
Wed, Jun 1, 1:35 PM
douardda added inline comments to D7838: Add an overlay storage.
Wed, Jun 1, 1:25 PM
douardda added inline comments to D7838: Add an overlay storage.
Wed, Jun 1, 12:39 PM
douardda added a comment to T4285: Deprecate swh.core's postgresql_fact.

Actually, with a bit more work, it's the entire db/pytest_plugin.py module that can be deprecated.

Wed, Jun 1, 12:28 PM · Core & foundations
douardda added a revision to T4285: Deprecate swh.core's postgresql_fact: D7934: deprecate the db/pytest_plugin.py module.
Wed, Jun 1, 12:27 PM · Core & foundations
douardda requested review of D7933: add a kafka_stream_to_value helper function in serializers.py.
Wed, Jun 1, 11:42 AM
douardda closed T4289: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function , a subtask of T4285: Deprecate swh.core's postgresql_fact, as Resolved.
Wed, Jun 1, 11:42 AM · Core & foundations
douardda closed T4289: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Resolved.
Wed, Jun 1, 11:42 AM · Vault
douardda closed D7930: tests: use stock pytest_postgresql factory function.
Wed, Jun 1, 9:37 AM
douardda committed rDVAU2f6dedcd30a3: tests: use stock pytest_postgresql factory function (authored by douardda).
tests: use stock pytest_postgresql factory function
Wed, Jun 1, 9:37 AM
douardda closed D7929: use an in-memory storage for tests.
Wed, Jun 1, 9:37 AM
douardda committed rDVAUb7b7927ec97b: use an in-memory storage for test_cookers and test_to_disk (authored by douardda).
use an in-memory storage for test_cookers and test_to_disk
Wed, Jun 1, 9:37 AM

May 31 2022

douardda requested review of D7930: tests: use stock pytest_postgresql factory function.
May 31 2022, 7:32 PM
douardda requested review of D7929: use an in-memory storage for tests.
May 31 2022, 7:31 PM
douardda closed T4286: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Resolved.
May 31 2022, 7:28 PM · Storage manager
douardda closed T4286: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function , a subtask of T4285: Deprecate swh.core's postgresql_fact, as Resolved.
May 31 2022, 7:28 PM · Core & foundations