Rebase
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Aug 9 2022
Aug 9 2022
douardda updated the diff for D8213: docker: move all 'static' kafka config entries in env/kafka.env.
douardda updated the diff for D8212: docker: add a generic 'swh' command in storage and worker entrypoint scripts.
Rebase
Rebase
Rebase
apply/fix comments
Aug 8 2022
Aug 8 2022
douardda requested review of D8213: docker: move all 'static' kafka config entries in env/kafka.env.
Aug 5 2022
Aug 5 2022
Aug 4 2022
Aug 4 2022
douardda committed rDVAUca71a59eda6f: Use original attr module instead of attrs (authored by douardda).
Use original attr module instead of attrs
douardda committed rDVAU186295793d7d: Add a test for the vault db initialization command `swh db init vault` (authored by douardda).
Add a test for the vault db initialization command `swh db init vault`
douardda updated the diff for D8185: Add a test for the vault db initialization command `swh db init vault`.
apply vlorentz' comment
douardda requested review of D8185: Add a test for the vault db initialization command `swh db init vault`.
Aug 2 2022
Aug 2 2022
Jul 9 2022
Jul 9 2022
douardda committed rDPROV804c3a371eb5: Add a `swh provenance directory flatten` command (authored by douardda).
Add a `swh provenance directory flatten` command
Remove unused mongo backend
douardda committed rDPROVe30e9f68262f: Add a `swh provenance revision from-journal` command (authored by douardda).
Add a `swh provenance revision from-journal` command
douardda committed rDPROV2492c8c97a25: Rename process_journal_objects as process_journal_origins (authored by douardda).
Rename process_journal_objects as process_journal_origins
Jul 8 2022
Jul 8 2022
rebase
rebase and remove refs to mongo in config files (mypy, pytest, requirements)
fix mistakes reported by olasd (thx a lot) and handle dates in process_journal_recisions
douardda committed rDSCHd8474480aee9: Fix the load_and_check_config() function to support the "postgresql" cls value (authored by douardda).
Fix the load_and_check_config() function to support the "postgresql" cls value
douardda updated the diff for D8102: Fix the load_and_check_config() function to support the "postgresql" cls value.
minor fix (thx ardumont)
douardda added inline comments to D8102: Fix the load_and_check_config() function to support the "postgresql" cls value.
rebase
grr
rebase
add a test
douardda retitled D8098: Add a `swh provenance revision from-journal` command from Rename process_journal_objects as process_journal_origins to Add a `swh provenance revision from-journal` command.
fixes/docstrings suggested by olasd
douardda committed rDSTOd6db4e445330: cli: move an import statement in the cli command (authored by douardda).
cli: move an import statement in the cli command
Jul 7 2022
Jul 7 2022
douardda committed rCDFP6195a72ccb0a: images/base: install python3-swh.objstorage.cloud and zstd packages (authored by douardda).
images/base: install python3-swh.objstorage.cloud and zstd packages
douardda committed rCDFP17e9c5326458: images/base: upgrade the db on startup (authored by douardda).
images/base: upgrade the db on startup
Fix nginx config for newer grafana
douardda committed rDSTOe0825acb7e17: do not always auto-create an OriginVisitStatus object in origin_visit_add() (authored by douardda).
do not always auto-create an OriginVisitStatus object in origin_visit_add()
Jul 6 2022
Jul 6 2022
douardda updated the diff for D8068: Do not always auto-create an OriginVisitStatus object in origin_visit_add().
implement this behavior also in cassandra/in-memory backend
douardda updated the diff for D8068: Do not always auto-create an OriginVisitStatus object in origin_visit_add().
fix cassandra's origin_visit_add() to match pg
douardda retitled D8068: Do not always auto-create an OriginVisitStatus object in origin_visit_add() from postgresql: Do not allways auto-create an OriginVisitStatus object in origin_visit_add() to postgresql: Do not always auto-create an OriginVisitStatus object in origin_visit_add().
douardda updated the diff for D8068: Do not always auto-create an OriginVisitStatus object in origin_visit_add().
fixes suggested by vlorentz
douardda committed rDDOC975e07b6db93: adapt mirror doc: swh-docker repo has been renamed as swh-mirror (authored by douardda).
adapt mirror doc: swh-docker repo has been renamed as swh-mirror
douardda committed rDSTO47caf04ea5e9: Add a Storage.flavor property to the postgresql backend (authored by douardda).
Add a Storage.flavor property to the postgresql backend
douardda committed rDSTOa00650ea0c34: Update pytest_plugin for swh.core 2.10 (authored by douardda).
Update pytest_plugin for swh.core 2.10
Jul 5 2022
Jul 5 2022
douardda committed rDCOREb805b3106fb9: Add the 'flavor' argument to db_utils.initialize_database_for_module() (authored by douardda).
Add the 'flavor' argument to db_utils.initialize_database_for_module()
douardda added inline comments to D8066: Add the 'flavor' argument to db_utils.initialize_database_for_module().
douardda updated the diff for D8066: Add the 'flavor' argument to db_utils.initialize_database_for_module().
fix the test (op. priority...)
douardda updated the diff for D8066: Add the 'flavor' argument to db_utils.initialize_database_for_module().
add tests + rebase
Jul 4 2022
Jul 4 2022
Shouldn't there be a migration script as well?
ok but the wording of the mark_production decorator
I'm not against this, but I have my doubts on the overall "architecture".
Don't like the zz-celery hack, but well, that's life. Did not check the new test files actually correspond to old test_metadata.py content. If this only test being moved or are there other (eg new tests) coming along? If so, please specify it in the commit message.
douardda added a comment to D8066: Add the 'flavor' argument to db_utils.initialize_database_for_module().
In D8066#209725, @ardumont wrote:lgtm but it's missing the test case around it. It should not be too hard to add a scenario which lifts the flavor parameter, shouldn't it?
Jul 1 2022
Jul 1 2022
douardda triaged T4370: Refactor the origin visit data model (aka get rid of the OriginVisit model object) as High priority.
douardda requested review of D8066: Add the 'flavor' argument to db_utils.initialize_database_for_module().
douardda triaged T4368: Loosen "foreign key" validation in storages used as mirror ingestion endpoint as High priority.
douardda added a comment to T2309: Add support for other hash algo than sha1 in current objstorage implementation.
In T2309#87779, @douardda wrote:do you have in mind to make the actual hash used as primary key in an objstorage a configuration of said storage instance? e.g. create a pathslicer or s3 objstorage using sha256 is just a matter of configuration of the objstorage?
douardda added a comment to T2309: Add support for other hash algo than sha1 in current objstorage implementation.
do you have in mind to make the actual hash used as primary key in an objstorage a configuration of said storage instance? e.g. create a pathslicer or s3 objstorage using sha256 is just a matter of configuration of the objstorage?
Jun 30 2022
Jun 30 2022
Jun 29 2022
Jun 29 2022
Jun 23 2022
Jun 23 2022
douardda triaged T4349: deploy docker-compose-plugin package instead of docker-compose as Normal priority.
Jun 22 2022
Jun 22 2022
Jun 21 2022
Jun 21 2022
Jun 20 2022
Jun 20 2022
douardda renamed T4342: Add a jenkins job for the AKS mirror deployment test from Add a jankins job for the AKS mirror deployment test to Add a jenkins job for the AKS mirror deployment test.