Page MenuHomeSoftware Heritage
Feed Advanced Search

Jun 2 2022

douardda committed rDCOREab2ff7434638: move initialize_database_for_module in db_utils (authored by douardda).
move initialize_database_for_module in db_utils
Jun 2 2022, 9:53 AM
douardda committed rDCORE4fc5f601b69a: deprecate the db/pytest_plugin.py module (authored by douardda).
deprecate the db/pytest_plugin.py module
Jun 2 2022, 9:53 AM
douardda committed rDCOREb26356329903: mark postgresql_fact fixture factory function as deprecated (authored by douardda).
mark postgresql_fact fixture factory function as deprecated
Jun 2 2022, 9:52 AM
douardda closed D7934: deprecate the db/pytest_plugin.py module.
Jun 2 2022, 9:52 AM
douardda committed rDCORE8523bca576b9: tests: use stock pytest_postgresql factory function (authored by douardda).
tests: use stock pytest_postgresql factory function
Jun 2 2022, 9:52 AM

Jun 1 2022

douardda requested review of D7934: deprecate the db/pytest_plugin.py module.
Jun 1 2022, 3:32 PM
douardda requested changes to D7838: Add an overlay storage.
Jun 1 2022, 1:40 PM
douardda added a comment to D7838: Add an overlay storage.

(not a surprise but) it really needs at least one test of the "overlay feature" for each method...

Jun 1 2022, 1:40 PM
douardda added inline comments to D7838: Add an overlay storage.
Jun 1 2022, 1:35 PM
douardda added inline comments to D7838: Add an overlay storage.
Jun 1 2022, 1:25 PM
douardda added inline comments to D7838: Add an overlay storage.
Jun 1 2022, 12:39 PM
douardda added a comment to T4285: Deprecate swh.core's postgresql_fact.

Actually, with a bit more work, it's the entire db/pytest_plugin.py module that can be deprecated.

Jun 1 2022, 12:28 PM · Core & foundations
douardda added a revision to T4285: Deprecate swh.core's postgresql_fact: D7934: deprecate the db/pytest_plugin.py module.
Jun 1 2022, 12:27 PM · Core & foundations
douardda requested review of D7933: add a kafka_stream_to_value helper function in serializers.py.
Jun 1 2022, 11:42 AM
douardda closed T4289: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function , a subtask of T4285: Deprecate swh.core's postgresql_fact, as Resolved.
Jun 1 2022, 11:42 AM · Core & foundations
douardda closed T4289: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Resolved.
Jun 1 2022, 11:42 AM · Vault
douardda closed D7930: tests: use stock pytest_postgresql factory function.
Jun 1 2022, 9:37 AM
douardda committed rDVAU2f6dedcd30a3: tests: use stock pytest_postgresql factory function (authored by douardda).
tests: use stock pytest_postgresql factory function
Jun 1 2022, 9:37 AM
douardda closed D7929: use an in-memory storage for tests.
Jun 1 2022, 9:37 AM
douardda committed rDVAUb7b7927ec97b: use an in-memory storage for test_cookers and test_to_disk (authored by douardda).
use an in-memory storage for test_cookers and test_to_disk
Jun 1 2022, 9:37 AM

May 31 2022

douardda requested review of D7930: tests: use stock pytest_postgresql factory function.
May 31 2022, 7:32 PM
douardda requested review of D7929: use an in-memory storage for tests.
May 31 2022, 7:31 PM
douardda closed T4286: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Resolved.
May 31 2022, 7:28 PM · Storage manager
douardda closed T4286: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function , a subtask of T4285: Deprecate swh.core's postgresql_fact, as Resolved.
May 31 2022, 7:28 PM · Core & foundations
douardda closed D7918: pytest_plugin: use the stock pytest_postgresql postgresql factory.
May 31 2022, 7:14 PM
douardda committed rDSTOe64d64e4daad: pytest_plugin: use the stock pytest_postgresql postgresql factory (authored by douardda).
pytest_plugin: use the stock pytest_postgresql postgresql factory
May 31 2022, 7:14 PM
douardda closed T4290: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function , a subtask of T4285: Deprecate swh.core's postgresql_fact, as Resolved.
May 31 2022, 6:47 PM · Core & foundations
douardda closed T4290: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Resolved.
May 31 2022, 6:47 PM · Indexer
douardda closed D7919: tests: use stock pytest_postgresql postgresql factory function.
May 31 2022, 6:46 PM
douardda committed rDCIDXd3f68159d2eb: tests: use stock pytest_postgresql factory function (authored by douardda).
tests: use stock pytest_postgresql factory function
May 31 2022, 6:46 PM
douardda closed T4287: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function , a subtask of T4285: Deprecate swh.core's postgresql_fact, as Resolved.
May 31 2022, 6:45 PM · Core & foundations
douardda closed T4287: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Resolved.
May 31 2022, 6:45 PM · Scheduling utilities
douardda closed D7920: tests: use stock pytest_postgresql factory function.
May 31 2022, 6:45 PM
douardda committed rDSCHef1538503dd3: tests: use stock pytest_postgresql factory function (authored by douardda).
tests: use stock pytest_postgresql factory function
May 31 2022, 6:45 PM
douardda updated the diff for D7918: pytest_plugin: use the stock pytest_postgresql postgresql factory.

update copyright

May 31 2022, 6:43 PM
douardda added a revision to T4289: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function : D7930: tests: use stock pytest_postgresql factory function.
May 31 2022, 6:39 PM · Vault
douardda added a revision to T4289: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function : D7929: use an in-memory storage for tests.
May 31 2022, 6:39 PM · Vault
douardda closed T4288: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Resolved.
May 31 2022, 4:52 PM · Datastore Scrubber
douardda closed T4288: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function , a subtask of T4285: Deprecate swh.core's postgresql_fact, as Resolved.
May 31 2022, 4:52 PM · Core & foundations
douardda closed D7926: tests: use stock pytest_postgresql factory function.
May 31 2022, 4:51 PM
douardda committed rDSCRUB3d999c512948: tests: use stock pytest_postgresql factory function (authored by douardda).
tests: use stock pytest_postgresql factory function
May 31 2022, 4:51 PM
douardda updated the diff for D7919: tests: use stock pytest_postgresql postgresql factory function.

update copyright

May 31 2022, 4:50 PM
douardda updated the diff for D7920: tests: use stock pytest_postgresql factory function.

update copyright

May 31 2022, 4:47 PM
douardda added a revision to T4286: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function : D7918: pytest_plugin: use the stock pytest_postgresql postgresql factory.
May 31 2022, 4:43 PM · Storage manager
douardda added a task to D7918: pytest_plugin: use the stock pytest_postgresql postgresql factory: T4286: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function .
May 31 2022, 4:43 PM
douardda added a revision to T4288: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function : D7926: tests: use stock pytest_postgresql factory function.
May 31 2022, 4:43 PM · Datastore Scrubber
douardda added a task to D7926: tests: use stock pytest_postgresql factory function: T4288: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function .
May 31 2022, 4:43 PM
douardda added a revision to T4287: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function : D7920: tests: use stock pytest_postgresql factory function.
May 31 2022, 4:42 PM · Scheduling utilities
douardda added a task to D7920: tests: use stock pytest_postgresql factory function: T4287: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function .
May 31 2022, 4:42 PM
douardda added a revision to T4290: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function : D7919: tests: use stock pytest_postgresql postgresql factory function.
May 31 2022, 4:42 PM · Indexer
douardda added a task to D7919: tests: use stock pytest_postgresql postgresql factory function: T4290: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function .
May 31 2022, 4:42 PM
douardda triaged T4290: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Normal priority.
May 31 2022, 4:41 PM · Indexer
douardda triaged T4289: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Normal priority.
May 31 2022, 4:41 PM · Vault
douardda triaged T4288: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Normal priority.
May 31 2022, 4:40 PM · Datastore Scrubber
douardda edited Description on Datastore Scrubber.
May 31 2022, 4:39 PM
douardda edited Description on Datastore Scrubber.
May 31 2022, 4:39 PM
douardda edited Description on Datastore Scrubber.
May 31 2022, 4:38 PM
douardda created Datastore Scrubber.
May 31 2022, 4:38 PM
douardda triaged T4287: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Normal priority.
May 31 2022, 4:24 PM · Scheduling utilities
douardda triaged T4286: Replace usage of swh.core's postgresql_fact by stock pytest_postgresql's factory function as Normal priority.
May 31 2022, 4:23 PM · Storage manager
douardda triaged T4285: Deprecate swh.core's postgresql_fact as Normal priority.
May 31 2022, 4:22 PM · Core & foundations
douardda added a comment to D7920: tests: use stock pytest_postgresql factory function.

lgtm

one remark, I'd be neat you add the related task id on those diffs (if there is one).

May 31 2022, 4:12 PM
douardda requested review of D7926: tests: use stock pytest_postgresql factory function.
May 31 2022, 4:00 PM
douardda updated the diff for D7919: tests: use stock pytest_postgresql postgresql factory function.

rebase

May 31 2022, 3:58 PM
douardda accepted D7922: Workaround mypy false positive.
May 31 2022, 2:50 PM
douardda requested review of D7920: tests: use stock pytest_postgresql factory function.
May 31 2022, 2:29 PM
douardda requested review of D7919: tests: use stock pytest_postgresql postgresql factory function.
May 31 2022, 2:23 PM
douardda updated the diff for D7918: pytest_plugin: use the stock pytest_postgresql postgresql factory.

rebase

May 31 2022, 2:14 PM
douardda added a comment to D7918: pytest_plugin: use the stock pytest_postgresql postgresql factory.

instead of swh-core's postgresql_fact one, since we actually do not
use its custom features any more in swh-storage.

Well, initially the feature used was the reset between tables to make
it faster than it was (and it worked 'cause it was hellishly slow to drop
and create tables again).

So, now storage uses the template to make the tests go as fast, is that it?

May 31 2022, 2:11 PM
douardda closed D7917: Add missing __init__.py in proxies/.
May 31 2022, 2:03 PM
douardda committed rDSTOa936cfda1f8d: Add missing __init__.py in proxies/ (authored by douardda).
Add missing __init__.py in proxies/
May 31 2022, 2:03 PM
douardda requested review of D7918: pytest_plugin: use the stock pytest_postgresql postgresql factory.
May 31 2022, 1:49 PM
douardda requested review of D7917: Add missing __init__.py in proxies/.
May 31 2022, 1:47 PM
douardda accepted D7914: Wrap query in transaction.

makes sense to me

May 31 2022, 11:06 AM
douardda added a comment to D7913: db: Grant read access to guest user on all tables of the schema.

Tests for the cli are using again the pytest-plugin db tool (i think it got removed at some point for some reason).

May 31 2022, 11:03 AM

May 25 2022

douardda accepted D7888: Represent filtered_objects_percent as a histogram rather than average.
May 25 2022, 1:53 PM

May 24 2022

douardda accepted D7859: fix mailto encoding for inbound email.
May 24 2022, 11:51 AM

May 23 2022

douardda added a comment to T4265: Create test topics on staging's kafka for the mirror tests.

topics to be created under the `swh.test' prefix (or similar).

May 23 2022, 3:26 PM · System administration

May 19 2022

douardda created P1366 (An Untitled Masterwork).
May 19 2022, 11:18 AM

May 18 2022

douardda requested review of D7851: Include counters in the the main docker-compose file.
May 18 2022, 2:58 PM
douardda closed D7845: Fix yaml syntax in conf/prometheus-statsd-exporter.yml.
May 18 2022, 2:35 PM
douardda committed rDENV492e05ce6a58: Fix yaml syntax in conf/prometheus-statsd-exporter.yml (authored by douardda).
Fix yaml syntax in conf/prometheus-statsd-exporter.yml
May 18 2022, 2:35 PM
douardda requested review of D7845: Fix yaml syntax in conf/prometheus-statsd-exporter.yml.
May 18 2022, 11:25 AM

May 16 2022

douardda added a comment to T3957: Clean sentry reports.

seems we still have a lot of NotFound error from the swh-loader-git:

May 16 2022, 3:03 PM · meta-task, Roadmap 2022

May 12 2022

douardda triaged T4235: [As a temporary solution] deploy the statsd-exporter binary published by prometheus as High priority.
May 12 2022, 11:00 AM · System administration

May 11 2022

douardda closed D7813: Make 'python -m swh' work as cli entry point.
May 11 2022, 5:47 PM
douardda committed rDCOREdae963440be5: Make 'python -m swh' work as cli entry point (authored by douardda).
Make 'python -m swh' work as cli entry point
May 11 2022, 5:47 PM
douardda requested review of D7813: Make 'python -m swh' work as cli entry point.
May 11 2022, 4:01 PM

May 10 2022

douardda committed rCDFPeeb79bed22f8: Fix a typo and add missing topics in graph-replayer.yml example file (authored by douardda).
Fix a typo and add missing topics in graph-replayer.yml example file
May 10 2022, 2:08 PM

May 9 2022

douardda committed rCDFP79db3d6ad320: Replace tabs with 4-ws in entrypoint.sh (authored by douardda).
Replace tabs with 4-ws in entrypoint.sh
May 9 2022, 3:51 PM
douardda committed rCDFPd5d075f317a8: Update base image entrypoint (authored by douardda).
Update base image entrypoint
May 9 2022, 3:48 PM
douardda committed rCDFPacdf130e2b72: Reduce replicas of the objstorage and storage services to 1 (authored by douardda).
Reduce replicas of the objstorage and storage services to 1
May 9 2022, 3:48 PM
douardda committed rCDFP6f24ff481c96: Make pgsql.sh script a bit more consistent (authored by douardda).
Make pgsql.sh script a bit more consistent
May 9 2022, 3:48 PM
douardda committed rCDFPbb5a6602ea92: Remove deprecated 'args' in config files (authored by douardda).
Remove deprecated 'args' in config files
May 9 2022, 3:48 PM
douardda committed rCDFPcdf96cda1153: Fix the nginx config for grafana 8.3.5+ (authored by douardda).
Fix the nginx config for grafana 8.3.5+
May 9 2022, 3:48 PM

Apr 26 2022

douardda closed D7647: Update the the listing and loading scheduling architecture doc.
Apr 26 2022, 6:14 PM
douardda committed rDDOCb6c59c460142: Update the the listing and loading scheduling architecture doc (authored by douardda).
Update the the listing and loading scheduling architecture doc
Apr 26 2022, 6:13 PM
douardda closed D7692: Make swh.objstorage an optional dependency, as a 'with-content' extra.
Apr 26 2022, 6:09 PM
douardda committed rDDATASET157331b9ae66: Make swh.objstorage an optional dependency, as a 'with-content' extra (authored by douardda).
Make swh.objstorage an optional dependency, as a 'with-content' extra
Apr 26 2022, 6:08 PM
douardda added inline comments to D7692: Make swh.objstorage an optional dependency, as a 'with-content' extra.
Apr 26 2022, 6:01 PM