Page MenuHomeSoftware Heritage
Feed Advanced Search

Nov 5 2019

douardda created D2218: cli: fix max-message handling in the journal-client command.
Nov 5 2019, 12:23 PM
douardda accepted D2215: debian.lister: Send origin url as load-debian task parameter.
Nov 5 2019, 10:25 AM

Nov 4 2019

douardda added inline comments to D2207: update indexer for storage 0.0.156.
Nov 4 2019, 4:18 PM
douardda committed rDCIDX03a0a3f789a4: tests: fix test_metadata.py for frozen entities in swh.model.model (authored by douardda).
tests: fix test_metadata.py for frozen entities in swh.model.model
Nov 4 2019, 4:11 PM
douardda committed rDCIDX234a7d479819: tests: update tests for storage>=0.0.155 (authored by douardda).
tests: update tests for storage>=0.0.155
Nov 4 2019, 4:11 PM
douardda closed D2206: Fix tests for latest swh.storage and swh.model.
Nov 4 2019, 4:11 PM
douardda updated the diff for D2206: Fix tests for latest swh.storage and swh.model.

messed with arc...

Nov 4 2019, 4:08 PM
douardda updated the diff for D2206: Fix tests for latest swh.storage and swh.model.

rename origin->visit in utils.py:fill_storage()

Nov 4 2019, 4:03 PM

Oct 31 2019

douardda added inline comments to D2207: update indexer for storage 0.0.156.
Oct 31 2019, 4:42 PM
douardda updated the diff for D2207: update indexer for storage 0.0.156.

fix almost all vlorentz' comments + fix in_memory's SubStorage.get_all()

Oct 31 2019, 4:40 PM
douardda created D2207: update indexer for storage 0.0.156.
Oct 31 2019, 2:08 PM
douardda updated the diff for D2206: Fix tests for latest swh.storage and swh.model.

modify utils.py + fix dependencies on storage so tests can pass as is

Oct 31 2019, 2:08 PM
douardda added a comment to D2206: Fix tests for latest swh.storage and swh.model.

This diff needs more work for storage 0.0.156
On it

Oct 31 2019, 11:43 AM
douardda created D2206: Fix tests for latest swh.storage and swh.model.
Oct 31 2019, 9:43 AM

Oct 30 2019

douardda committed rDSTOC2a6bf45cb7be: conftest: make it possible to configure SQL dump files used by… (authored by douardda).
conftest: make it possible to configure SQL dump files used by…
Oct 30 2019, 5:22 PM
douardda committed rDSTOC4ff544ae4152: tests: delete (now useless) storage_testing.py file (authored by douardda).
tests: delete (now useless) storage_testing.py file
Oct 30 2019, 5:22 PM
douardda committed rDSTOCe2402e0bfa5a: conftest: do not use hypothesis to generate origins and contents (authored by douardda).
conftest: do not use hypothesis to generate origins and contents
Oct 30 2019, 5:22 PM
douardda committed rDSTOC35bdea85a79e: make in_memory Storage compatible with frozen model entities (authored by douardda).
make in_memory Storage compatible with frozen model entities
Oct 30 2019, 5:22 PM
douardda committed rDSTOC3bb46f6438e5: test_storage: kill StorageTestDbFixture class (authored by douardda).
test_storage: kill StorageTestDbFixture class
Oct 30 2019, 5:22 PM
douardda committed rDSTOCdbea02c5f1c5: test_api_client: refactor the code for new pytest based infra (authored by douardda).
test_api_client: refactor the code for new pytest based infra
Oct 30 2019, 5:22 PM
douardda committed rDSTOC8003db6106ba: api: add (missing) refresh_stat_counters() endpoint (authored by douardda).
api: add (missing) refresh_stat_counters() endpoint
Oct 30 2019, 5:22 PM
douardda committed rDSTOC8529e7b86a69: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData (authored by douardda).
test_storage: rename TestStorageCommonProp as TestStorageGeneratedData
Oct 30 2019, 5:22 PM
douardda committed rDSTOC8a9cfebb5ccf: tests/algos: rewrite test_snapshot with pytest (authored by douardda).
tests/algos: rewrite test_snapshot with pytest
Oct 30 2019, 5:22 PM
douardda committed rDSTOCcadafefde5b8: in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests (authored by douardda).
in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests
Oct 30 2019, 5:22 PM
douardda committed rDSTOC743f9156a39e: test_storage: make test_origin_metadata_get more robust (authored by douardda).
test_storage: make test_origin_metadata_get more robust
Oct 30 2019, 5:22 PM
douardda committed rDSTOC204b9fa27009: test_storage: move db specific methods from main TestStorage to TestPgStorage (authored by douardda).
test_storage: move db specific methods from main TestStorage to TestPgStorage
Oct 30 2019, 5:22 PM
douardda committed rDSTOC9f122027e8cd: conftest: use an in memory obj storage (authored by douardda).
conftest: use an in memory obj storage
Oct 30 2019, 5:22 PM
douardda committed rDSTOCfb70f881cb37: tests: refactor main storage tests (authored by douardda).
tests: refactor main storage tests
Oct 30 2019, 5:22 PM
douardda committed rDSTOC9aa6b9d2b100: journal_writer: use journal writer from swh.journal (authored by douardda).
journal_writer: use journal writer from swh.journal
Oct 30 2019, 5:21 PM
douardda accepted D2202: Revert "deposit.signals: Scheduler load-deposit task with new endpoints".
Oct 30 2019, 4:43 PM
douardda updated subscribers of T2051: Fix loading process for deposits.

@olasd can you (if it's not too much painful) revert python3-swh.deposit to 0.0.73?

Oct 30 2019, 10:55 AM · SWORD deposit
douardda added a comment to T2051: Fix loading process for deposits.

I've created 'old-style' tasks, using swh scheduler

Oct 30 2019, 10:54 AM · SWORD deposit
douardda added a comment to T2051: Fix loading process for deposits.

Looks like swh.deposit v0.0.74 has been deployed, but it generates tasks according to T2024 which is still WIP.

Oct 30 2019, 10:49 AM · SWORD deposit
douardda committed rDSTO4ff544ae4152: tests: delete (now useless) storage_testing.py file (authored by douardda).
tests: delete (now useless) storage_testing.py file
Oct 30 2019, 10:37 AM
douardda closed D2197: tests: delete (now useless) storage_testing.py file.
Oct 30 2019, 10:37 AM
douardda added a comment to D2197: tests: delete (now useless) storage_testing.py file.

F

Oct 30 2019, 10:31 AM
douardda created D2197: tests: delete (now useless) storage_testing.py file.
Oct 30 2019, 10:27 AM
douardda committed rDSTO2a6bf45cb7be: conftest: make it possible to configure SQL dump files used by… (authored by douardda).
conftest: make it possible to configure SQL dump files used by…
Oct 30 2019, 10:24 AM
douardda closed D2184: conftest: make it possible to configure SQL dump files used by SwhDatabaseJanitor.
Oct 30 2019, 10:24 AM
douardda updated the diff for D2184: conftest: make it possible to configure SQL dump files used by SwhDatabaseJanitor.

rebased

Oct 30 2019, 10:20 AM
douardda committed rDSTOe2402e0bfa5a: conftest: do not use hypothesis to generate origins and contents (authored by douardda).
conftest: do not use hypothesis to generate origins and contents
Oct 30 2019, 10:20 AM
douardda closed D2187: conftest: do not use hypothesis to generate origins and contents.
Oct 30 2019, 10:20 AM
douardda updated the diff for D2187: conftest: do not use hypothesis to generate origins and contents.

fix dependency hell (pytz, seee requirements-test.txt)

Oct 30 2019, 10:00 AM
douardda updated the diff for D2187: conftest: do not use hypothesis to generate origins and contents.

move gen_x functions to swh.model

Oct 30 2019, 9:34 AM
douardda committed rDSTO35bdea85a79e: make in_memory Storage compatible with frozen model entities (authored by douardda).
make in_memory Storage compatible with frozen model entities
Oct 30 2019, 9:28 AM
douardda closed D2194: make in_memory Storage compatible with frozen model entities.
Oct 30 2019, 9:28 AM
douardda closed D2191: Add a test data generator module.
Oct 30 2019, 9:27 AM
douardda committed rDMODb064a0bb6eb2: Add a test data generator module (authored by douardda).
Add a test data generator module
Oct 30 2019, 9:27 AM
douardda closed D2190: model: make model entities frozen.
Oct 30 2019, 9:27 AM
douardda committed rDMOD7564596424a4: model: make model entities frozen (authored by douardda).
model: make model entities frozen
Oct 30 2019, 9:27 AM

Oct 29 2019

douardda updated the diff for D2191: Add a test data generator module.

move pyts dep in -tests req

Oct 29 2019, 4:52 PM
douardda added a comment to D2191: Add a test data generator module.

Oh and also, it would be nice of these gen_ functions to return model objects instead of dicts (as we want to get rid of these dicts as much as possible)

Oct 29 2019, 4:51 PM
douardda updated the diff for D2191: Add a test data generator module.

simplify a bit a couple of tests

Oct 29 2019, 4:30 PM
douardda added inline comments to D2191: Add a test data generator module.
Oct 29 2019, 4:28 PM
douardda added inline comments to D2191: Add a test data generator module.
Oct 29 2019, 4:27 PM
douardda created D2194: make in_memory Storage compatible with frozen model entities.
Oct 29 2019, 4:17 PM
douardda updated the diff for D2191: Add a test data generator module.

update test_gen_origins_x accorgin to vlorentz comment

Oct 29 2019, 2:56 PM
douardda added inline comments to D2191: Add a test data generator module.
Oct 29 2019, 2:52 PM
douardda updated the diff for D2191: Add a test data generator module.

rebase + add missing dep on pytz

Oct 29 2019, 2:48 PM
douardda updated the diff for D2190: model: make model entities frozen.

updated according comments

Oct 29 2019, 2:48 PM
douardda added inline comments to D2190: model: make model entities frozen.
Oct 29 2019, 2:42 PM
douardda created D2191: Add a test data generator module.
Oct 29 2019, 2:37 PM
douardda created D2190: model: make model entities frozen.
Oct 29 2019, 2:36 PM
douardda accepted D2188: tox.ini: tell the tests where to find the Kafka install..
Oct 29 2019, 12:01 PM
douardda updated the summary of D2187: conftest: do not use hypothesis to generate origins and contents.
Oct 29 2019, 10:20 AM
douardda created D2187: conftest: do not use hypothesis to generate origins and contents.
Oct 29 2019, 10:18 AM

Oct 28 2019

douardda created D2184: conftest: make it possible to configure SQL dump files used by SwhDatabaseJanitor.
Oct 28 2019, 2:15 PM

Oct 19 2019

douardda added a comment to D2162: Use the shared_task decorator instead of binding to a specific celery app.
In D2162#50822, @olasd wrote:

(of course this needs the tests/tasks.py part of D2161)

Oct 19 2019, 11:42 AM
douardda added a reverting change for D2115: tests: Explicit registering test tasks step for the swh_app: rDSCHecf38ebd67db: celery/tests: mostly revert e770eb30 to fix celery app initialization in tests.
Oct 19 2019, 11:42 AM
douardda committed rDSCHecf38ebd67db: celery/tests: mostly revert e770eb30 to fix celery app initialization in tests (authored by douardda).
celery/tests: mostly revert e770eb30 to fix celery app initialization in tests
Oct 19 2019, 11:42 AM
douardda added a reverting change for rDSCHe770eb30f085: tests: Explicit registering test tasks step for the swh_app: rDSCHecf38ebd67db: celery/tests: mostly revert e770eb30 to fix celery app initialization in tests.
Oct 19 2019, 11:42 AM
douardda closed D2161: celery/tests: mostly revert e770eb30 to fix celery app initialization in tests.
Oct 19 2019, 11:42 AM

Oct 18 2019

douardda accepted D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).

maybe rename 'primary key' as 'identity key' or similar.

Oct 18 2019, 5:05 PM
douardda accepted D2147: lister.gnu: Standardize arguments to pass to the loader tar.
Oct 18 2019, 4:59 PM · Origin-GNU, Lister
douardda added inline comments to D2147: lister.gnu: Standardize arguments to pass to the loader tar.
Oct 18 2019, 4:56 PM · Origin-GNU, Lister
douardda accepted D2155: lister-debian: Install debian model within the lister repository.
Oct 18 2019, 4:50 PM
douardda added a comment to D2155: lister-debian: Install debian model within the lister repository.

LGTM (with a ci msg stating why it's still in storage for now)

Oct 18 2019, 4:50 PM
douardda created D2161: celery/tests: mostly revert e770eb30 to fix celery app initialization in tests.
Oct 18 2019, 4:45 PM

Oct 16 2019

douardda committed rDSCHa7e15bfce7a1: add a new get_priority_ratios endpoint to the scheduler (authored by douardda).
add a new get_priority_ratios endpoint to the scheduler
Oct 16 2019, 5:55 PM
douardda committed rDSCHc2a020d471e1: tests: rewrite tests using pytest and the new rpc fixtures from swh.core (authored by douardda).
tests: rewrite tests using pytest and the new rpc fixtures from swh.core
Oct 16 2019, 5:55 PM
douardda committed rDSCHc2ccf460f552: updater/tests: rewrite updater's tests as pytest functions (authored by douardda).
updater/tests: rewrite updater's tests as pytest functions
Oct 16 2019, 5:55 PM
douardda committed rDSCH37b909e8d055: conftest: simplify the swh_scheduler() fixture (authored by douardda).
conftest: simplify the swh_scheduler() fixture
Oct 16 2019, 5:55 PM
douardda closed D2146: Update tests to pytest.
Oct 16 2019, 5:55 PM
douardda updated the diff for D2146: Update tests to pytest.

Add forgotten mypy.ini and requirements-test.txt files

Oct 16 2019, 1:22 PM
douardda added a comment to D2146: Update tests to pytest.

Build has FAILED

mypy is unhappy, don't know why though.

  flake8: commands succeeded
ERROR:   mypy: commands failed
Oct 16 2019, 1:18 PM
douardda created D2146: Update tests to pytest.
Oct 16 2019, 11:01 AM
douardda added a comment to D2025: [wip] swh.lister.functionalPackages: add lister getting sources from a JSON file.

Just one note: the name is IMHO inappropriate. This is NOT a JSON lister. JSON is nothing but the serialization format used to retrieve some (more or less) well defined structured data.

Oct 16 2019, 9:37 AM · Lister

Oct 14 2019

douardda added a comment to D2133: pytest_plugin: Add support for http request (debian lister related).

I have no strong opinion on this. olsad's idea might be an acceptable solution.

Oct 14 2019, 4:14 PM
douardda added inline comments to D2134: debian.lister: Add integration test which checks scheduled tasks.
Oct 14 2019, 4:11 PM
douardda requested changes to D2132: Enable iteration on the graph.
Oct 14 2019, 4:05 PM
douardda committed rDSTO3bb46f6438e5: test_storage: kill StorageTestDbFixture class (authored by douardda).
test_storage: kill StorageTestDbFixture class
Oct 14 2019, 3:11 PM
douardda committed rDSTOdbea02c5f1c5: test_api_client: refactor the code for new pytest based infra (authored by douardda).
test_api_client: refactor the code for new pytest based infra
Oct 14 2019, 3:11 PM
douardda closed D2091: test_storage: kill StorageTestDbFixture class.
Oct 14 2019, 3:11 PM
douardda closed D2119: test_api_client: refactor the code for new pytest based infra.
Oct 14 2019, 3:11 PM
douardda committed rDSTO8003db6106ba: api: add (missing) refresh_stat_counters() endpoint (authored by douardda).
api: add (missing) refresh_stat_counters() endpoint
Oct 14 2019, 3:11 PM
douardda closed D2118: api: add (missing) refresh_stat_counters() endpoint.
Oct 14 2019, 3:11 PM
douardda committed rDSTO8a9cfebb5ccf: tests/algos: rewrite test_snapshot with pytest (authored by douardda).
tests/algos: rewrite test_snapshot with pytest
Oct 14 2019, 3:11 PM
douardda committed rDSTOcadafefde5b8: in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests (authored by douardda).
in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests
Oct 14 2019, 3:11 PM
douardda closed D2117: tests/algos: rewrite test_snapshot with pytest.
Oct 14 2019, 3:11 PM
douardda closed D2095: test_in_memory: adapt tests for the InMemoryStorage to new storage test infra.
Oct 14 2019, 3:11 PM