- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Jan 8 2023
Jan 8 2023
gitlab-migration changed the status of T4642: swh.journal.indexed.origin_extrinsic_metadata topic has a single partition from Invalid to Migrated.
gitlab-migration changed the status of T3890: schema of timezones in the journal from Resolved to Migrated.
gitlab-migration changed the status of T3047: Enable to search in origin metadata with swh-search in webapp, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
gitlab-migration changed the status of T3021: Investigate why reading the journal of the content table takes so long from Resolved to Migrated.
gitlab-migration changed the status of T3012: Check all objects in the production storage/journal have a correct hash from Duplicate to Migrated.
gitlab-migration changed the status of T2936: Update the swh-search journal client to only set "has_visit" on "full" status of the visit, a subtask of T2905: Deploy swh-search for production, from Resolved to Migrated.
gitlab-migration changed the status of T2936: Update the swh-search journal client to only set "has_visit" on "full" status of the visit from Resolved to Migrated.
gitlab-migration changed the status of T2904: Create a new production webapp using the frozen index on the staging ES from Resolved to Migrated.
gitlab-migration changed the status of T2904: Create a new production webapp using the frozen index on the staging ES, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
gitlab-migration changed the status of T2876: metadata indexation : ES' dynamic mapping creation fails for field values that are of varying types, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
gitlab-migration changed the status of T2817: Enable the swh-search environment in staging, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
gitlab-migration changed the status of T2817: Enable the swh-search environment in staging from Resolved to Migrated.
gitlab-migration changed the status of T2816: Enable the journal-writer for the swh-idx-storage in staging from Resolved to Migrated.
gitlab-migration changed the status of T2816: Enable the journal-writer for the swh-idx-storage in staging, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
gitlab-migration changed the status of T2814: Fix swh indexer journal client service from Resolved to Migrated.
gitlab-migration changed the status of T2590: Finish the indexer -> swh-search pipeline from Resolved to Migrated.
gitlab-migration changed the status of T2514: Add raw_extrinsic_metadata to the journal backfiller from Resolved to Migrated.
gitlab-migration changed the status of T2355: Make swh-journal independent from swh-storage or swh-objstorage from Resolved to Migrated.
gitlab-migration changed the status of T2306: Generic storage for extrinsic, qualified metadata related to any node of the swh archive, a subtask of T2074: Publish extrinsic metadata to swh-journal/Kafka, from Resolved to Migrated.
gitlab-migration changed the status of T2074: Publish extrinsic metadata to swh-journal/Kafka from Resolved to Migrated.
gitlab-migration changed the status of T2074: Publish extrinsic metadata to swh-journal/Kafka, a subtask of T2514: Add raw_extrinsic_metadata to the journal backfiller, from Resolved to Migrated.
gitlab-migration changed the status of T1575: Kafka clients crash easily in docker-compose environment from Resolved to Migrated.
gitlab-migration changed the status of T1466: Deploy swh-indexer-journal-client from Resolved to Migrated.
gitlab-migration changed the status of T1277: swh-journal: Create a journal client for listing origin visits, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T1277: swh-journal: Create a journal client for listing origin visits from Resolved to Migrated.
gitlab-migration changed the status of T1277: swh-journal: Create a journal client for listing origin visits, a subtask of T1466: Deploy swh-indexer-journal-client, from Resolved to Migrated.
gitlab-migration changed the status of T1276: swh-journal: Add tests, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T1275: swh-journal: Complete missing snapshot insertion event from storage to journal from Resolved to Migrated.
gitlab-migration changed the status of T1275: swh-journal: Complete missing snapshot insertion event from storage to journal, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T507: document licensing of kafka and related client modules, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T494: swh-journal: archiver-client: Keep archiver table in sync with new contents from Invalid to Migrated.
gitlab-migration changed the status of T494: swh-journal: archiver-client: Keep archiver table in sync with new contents, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Invalid to Migrated.
gitlab-migration changed the status of T3191: journal-client: Add support of max message size configuration from Invalid to Migrated.
gitlab-migration changed the status of T3058: Metadata search is failing with "failed to parse date field", a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
gitlab-migration changed the status of T2970: Make swh-journal tests not depend on swh-model any more from Resolved to Migrated.
gitlab-migration changed the status of T2834: Use msgpack extension types instead of custom swh encoders/decoders from Resolved to Migrated.
gitlab-migration changed the status of T2823: Write tests for swh/journal/writer/inmemory.py from Resolved to Migrated.
gitlab-migration changed the status of T2672: Inconsistent keys between visits and origin visits in the journal from Wontfix to Migrated.
gitlab-migration changed the status of T2651: Make the indexer-storage publish its rows to Kafka, a subtask of T2590: Finish the indexer -> swh-search pipeline, from Resolved to Migrated.
gitlab-migration changed the status of T2351: Consider backfilling mistakenly rejected large objects from PostgreSQL, a subtask of T2348: swh.journal silently loses large objects instead of rejecting them, from Resolved to Migrated.
gitlab-migration changed the status of T2350: Support large messages in swh.journal / kafka, a subtask of T2348: swh.journal silently loses large objects instead of rejecting them, from Resolved to Migrated.
gitlab-migration changed the status of T2351: Consider backfilling mistakenly rejected large objects from PostgreSQL from Resolved to Migrated.
gitlab-migration changed the status of T2350: Support large messages in swh.journal / kafka from Resolved to Migrated.
gitlab-migration changed the status of T2349: Make the journal writer reliable from Resolved to Migrated.
gitlab-migration changed the status of T2350: Support large messages in swh.journal / kafka, a subtask of T2351: Consider backfilling mistakenly rejected large objects from PostgreSQL, from Resolved to Migrated.
gitlab-migration changed the status of T2349: Make the journal writer reliable, a subtask of T2348: swh.journal silently loses large objects instead of rejecting them, from Resolved to Migrated.
gitlab-migration changed the status of T2348: swh.journal silently loses large objects instead of rejecting them from Resolved to Migrated.
gitlab-migration changed the status of T2143: Journal error in production from Resolved to Migrated.
gitlab-migration changed the status of T2075: Implement metadata authority specification, a subtask of T2074: Publish extrinsic metadata to swh-journal/Kafka, from Resolved to Migrated.
gitlab-migration changed the status of T2007: Loading tasks are currently hanging from Resolved to Migrated.
gitlab-migration changed the status of T2006: backfiller is broken for revision from Resolved to Migrated.
gitlab-migration changed the status of T2003: Content replayer may try to copy objects before they are available from an objstorage from Resolved to Migrated.
gitlab-migration changed the status of T1827: Tweak content backfill order to help content replayer from Resolved to Migrated.
gitlab-migration changed the status of T1828: Improve directory journal backfill performance from Resolved to Migrated.
gitlab-migration changed the status of T1628: replayer: non reliability when fetching items from kafka from Resolved to Migrated.
gitlab-migration changed the status of T1541: journal publisher may crash on HTTP timeouts from Wontfix to Migrated.
gitlab-migration changed the status of T1468: journal: Deploy the publisher, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T1468: journal: Deploy the publisher from Resolved to Migrated.
gitlab-migration changed the status of T1468: journal: Deploy the publisher, a subtask of T1466: Deploy swh-indexer-journal-client, from Resolved to Migrated.
gitlab-migration changed the status of T1465: Journal notification of full origin visits from Resolved to Migrated.
gitlab-migration changed the status of T1455: Add a journal client that schedules oneshot tasks for metadata indexers, a subtask of T1466: Deploy swh-indexer-journal-client, from Resolved to Migrated.
gitlab-migration changed the status of T1279: swh-journal: The schema migration problem, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Wontfix to Migrated.
gitlab-migration changed the status of T1279: swh-journal: The schema migration problem from Wontfix to Migrated.
gitlab-migration changed the status of T1278: swh-journal: the monitoring tool question! from Duplicate to Migrated.
gitlab-migration changed the status of T1278: swh-journal: the monitoring tool question!, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Duplicate to Migrated.
gitlab-migration changed the status of T529: swh-journal: Create a journal checker comparing object lists between journal and database, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Wontfix to Migrated.
gitlab-migration changed the status of T528: swh-journal: Create a journal client listing objects of a given type, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T529: swh-journal: Create a journal checker comparing object lists between journal and database from Wontfix to Migrated.
gitlab-migration changed the status of T527: Insert newly created objects in the journal from Resolved to Migrated.
gitlab-migration changed the status of T527: Insert newly created objects in the journal, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T528: swh-journal: Create a journal client listing objects of a given type from Resolved to Migrated.
gitlab-migration changed the status of T525: Allow bulk-listing of objects by content-id, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Wontfix to Migrated.
gitlab-migration changed the status of T526: Add notifications support to swh.storage, a subtask of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage, from Resolved to Migrated.
gitlab-migration changed the status of T424: swh-journal: persistent journal infrastructure to record additions to the swh-storage from Resolved to Migrated.
Nov 28 2022
Nov 28 2022
In T4657#98361, @lunar wrote:[...]
@douardda: would you agree?
Nov 16 2022
Nov 16 2022
Nov 14 2022
Nov 14 2022
Nov 6 2022
Nov 6 2022
https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4658#note_12824 is the process I've followed for a (lower stakes) removal of buggy raw_extrinsic_metadata messages from swh.journal (in staging).
Nov 2 2022
Nov 2 2022
vlorentz added a comment to T4668: replayer: Crashes because of directories with duplicated entry names in journal.
New objects with duplicated entries go through this method to be fixed: https://docs.softwareheritage.org/devel/apidoc/swh.model.model.html#swh.model.model.Directory.from_possibly_duplicated_entries (currently only used by swh.storage.backfill); but old kafka messages still have duplicate entries, causing the crash above.
Oct 27 2022
Oct 27 2022
heh that's funny, olasd and I also discussed this yesterday (though we were interested in changing objects rather than deleting):
Oct 25 2022
Oct 25 2022
Oct 24 2022
Oct 24 2022
vsellier closed T4642: swh.journal.indexed.origin_extrinsic_metadata topic has a single partition as Invalid.
Task moved on gitlab: https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4653
Oct 19 2022
Oct 19 2022
gitlab-migration changed the status of T3501: Too many open files error on kafka from Resolved to Migrated.
gitlab-migration changed the status of T3083: Deploy swh-search v0.7.0/v0.7.1, a subtask of T3076: [swh-search] Improve the index/mapping migration process, from Resolved to Migrated.