rebase + keep the test_storage.py file for now
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Nov 7 2019
Nov 7 2019
douardda updated the diff for D2222: proper pagination for IndexerStorage.origin_intrinsic_metadata_search_by_producer.
use 'page_token' as (opaque) pagination argument
douardda added a comment to D2222: proper pagination for IndexerStorage.origin_intrinsic_metadata_search_by_producer.
In D2222#52502, @douardda wrote:In D2222#52362, @vlorentz wrote:I would rather we move to opaque tokens for all pagination stuff.
That's why I put a 'Note' in the Diff's description ;-)
douardda added a comment to D2222: proper pagination for IndexerStorage.origin_intrinsic_metadata_search_by_producer.
In D2222#52362, @vlorentz wrote:I would rather we move to opaque tokens for all pagination stuff.
Nov 6 2019
Nov 6 2019
Any chance we can close this now?
This might be "solved" by T2063
douardda added a comment to T2063: Investigate stream-based execution model as a replacement for current scheduler/celery/task based approach.
A few notes
This task should be completed once https://forge.softwareheritage.org/source/swh-docker/ is in a decent state.
Nov 5 2019
Nov 5 2019
update indexer for storage 0.0.156
douardda committed rDCIDXfe884ef83e9c: cli: fix max-message handling in the journal-client command (authored by douardda).
cli: fix max-message handling in the journal-client command
rebase + small fix
reformat for style consistency in the function
douardda added inline comments to D2217: lister.debian: Move parameters from `run` method to constructor.
Nov 4 2019
Nov 4 2019
douardda committed rDCIDX03a0a3f789a4: tests: fix test_metadata.py for frozen entities in swh.model.model (authored by douardda).
tests: fix test_metadata.py for frozen entities in swh.model.model
douardda committed rDCIDX234a7d479819: tests: update tests for storage>=0.0.155 (authored by douardda).
tests: update tests for storage>=0.0.155
messed with arc...
rename origin->visit in utils.py:fill_storage()
Oct 31 2019
Oct 31 2019
fix almost all vlorentz' comments + fix in_memory's SubStorage.get_all()
modify utils.py + fix dependencies on storage so tests can pass as is
This diff needs more work for storage 0.0.156
On it
Oct 30 2019
Oct 30 2019
douardda committed rDSTOC2a6bf45cb7be: conftest: make it possible to configure SQL dump files used by… (authored by douardda).
conftest: make it possible to configure SQL dump files used by…
douardda committed rDSTOC4ff544ae4152: tests: delete (now useless) storage_testing.py file (authored by douardda).
tests: delete (now useless) storage_testing.py file
douardda committed rDSTOCe2402e0bfa5a: conftest: do not use hypothesis to generate origins and contents (authored by douardda).
conftest: do not use hypothesis to generate origins and contents
douardda committed rDSTOC35bdea85a79e: make in_memory Storage compatible with frozen model entities (authored by douardda).
make in_memory Storage compatible with frozen model entities
douardda committed rDSTOC3bb46f6438e5: test_storage: kill StorageTestDbFixture class (authored by douardda).
test_storage: kill StorageTestDbFixture class
douardda committed rDSTOCdbea02c5f1c5: test_api_client: refactor the code for new pytest based infra (authored by douardda).
test_api_client: refactor the code for new pytest based infra
douardda committed rDSTOC8003db6106ba: api: add (missing) refresh_stat_counters() endpoint (authored by douardda).
api: add (missing) refresh_stat_counters() endpoint
douardda committed rDSTOC8529e7b86a69: test_storage: rename TestStorageCommonProp as TestStorageGeneratedData (authored by douardda).
test_storage: rename TestStorageCommonProp as TestStorageGeneratedData
douardda committed rDSTOC8a9cfebb5ccf: tests/algos: rewrite test_snapshot with pytest (authored by douardda).
tests/algos: rewrite test_snapshot with pytest
douardda committed rDSTOCcadafefde5b8: in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests (authored by douardda).
in_memory: fix handling of 'hidden' content in InMemoryStorage and update tests
douardda committed rDSTOC743f9156a39e: test_storage: make test_origin_metadata_get more robust (authored by douardda).
test_storage: make test_origin_metadata_get more robust
douardda committed rDSTOC204b9fa27009: test_storage: move db specific methods from main TestStorage to TestPgStorage (authored by douardda).
test_storage: move db specific methods from main TestStorage to TestPgStorage
douardda committed rDSTOC9f122027e8cd: conftest: use an in memory obj storage (authored by douardda).
conftest: use an in memory obj storage
tests: refactor main storage tests
douardda committed rDSTOC9aa6b9d2b100: journal_writer: use journal writer from swh.journal (authored by douardda).
journal_writer: use journal writer from swh.journal
@olasd can you (if it's not too much painful) revert python3-swh.deposit to 0.0.73?
I've created 'old-style' tasks, using swh scheduler
Looks like swh.deposit v0.0.74 has been deployed, but it generates tasks according to T2024 which is still WIP.
douardda committed rDSTO4ff544ae4152: tests: delete (now useless) storage_testing.py file (authored by douardda).
tests: delete (now useless) storage_testing.py file
In D2197#51623, @vlorentz wrote:F
douardda committed rDSTO2a6bf45cb7be: conftest: make it possible to configure SQL dump files used by… (authored by douardda).
conftest: make it possible to configure SQL dump files used by…
douardda updated the diff for D2184: conftest: make it possible to configure SQL dump files used by SwhDatabaseJanitor.
rebased
douardda committed rDSTOe2402e0bfa5a: conftest: do not use hypothesis to generate origins and contents (authored by douardda).
conftest: do not use hypothesis to generate origins and contents
douardda updated the diff for D2187: conftest: do not use hypothesis to generate origins and contents.
fix dependency hell (pytz, seee requirements-test.txt)
douardda updated the diff for D2187: conftest: do not use hypothesis to generate origins and contents.
move gen_x functions to swh.model
douardda committed rDSTO35bdea85a79e: make in_memory Storage compatible with frozen model entities (authored by douardda).
make in_memory Storage compatible with frozen model entities
Add a test data generator module
model: make model entities frozen
Oct 29 2019
Oct 29 2019
move pyts dep in -tests req
In D2191#51535, @vlorentz wrote:Oh and also, it would be nice of these gen_ functions to return model objects instead of dicts (as we want to get rid of these dicts as much as possible)
simplify a bit a couple of tests
update test_gen_origins_x accorgin to vlorentz comment
rebase + add missing dep on pytz
updated according comments
douardda updated the summary of D2187: conftest: do not use hypothesis to generate origins and contents.
Oct 28 2019
Oct 28 2019
Oct 19 2019
Oct 19 2019
douardda added a comment to D2162: Use the shared_task decorator instead of binding to a specific celery app.
In D2162#50822, @olasd wrote:(of course this needs the tests/tasks.py part of D2161)
douardda committed rDSCHecf38ebd67db: celery/tests: mostly revert e770eb30 to fix celery app initialization in tests (authored by douardda).
celery/tests: mostly revert e770eb30 to fix celery app initialization in tests
Oct 18 2019
Oct 18 2019
douardda accepted D2145: package.tar: Add a generic archive loader implementation (merge with gnu's).
maybe rename 'primary key' as 'identity key' or similar.
douardda added inline comments to D2147: lister.gnu: Standardize arguments to pass to the loader tar.
douardda added a comment to D2155: lister-debian: Install debian model within the lister repository.
LGTM (with a ci msg stating why it's still in storage for now)
Oct 16 2019
Oct 16 2019
douardda committed rDSCHa7e15bfce7a1: add a new get_priority_ratios endpoint to the scheduler (authored by douardda).
add a new get_priority_ratios endpoint to the scheduler