This week we have conducted the first gitlab sprint.
Notes on this sprint can be found here:
https://hedgedoc.softwareheritage.org/f-lWPLL5Rei2tybmtf4oDQ
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Dec 15 2022
Dec 15 2022
vlorentz closed T4676: Add Luigi workflow in swh-dataset, a subtask of T2220: swh-graph in production, as Resolved.
Dec 6 2022
Dec 6 2022
vlorentz added a revision to T2220: swh-graph in production: D8919: Add CLI script to generate Luigi config and call it.
Nov 28 2022
Nov 28 2022
vlorentz added a revision to T2220: swh-graph in production: D8891: Add luigi task to compress the graph.
douardda triaged T4704: Publish objects that has been subject to a TDN in a (series of) kafka topic as High priority.
Nov 24 2022
Nov 24 2022
vlorentz moved T2202: Collect extrinsic metadata from Work in progress to Pending validation on the Roadmap 2022 board.
Nov 10 2022
Nov 10 2022
Nov 3 2022
Nov 3 2022
bchauvet added subtasks for T4079: Extend archive coverage: T4662: staging: Deploy nixguix lister and loader, T4555: staging: Deploy bower lister, T4545: staging: Deploy golang stack, T4517: staging: Deploy pubdev, T4478: Deploy Gogs lister to staging, T4330: Deploy maven stack in production, T4214: Production : Deploy bzr/bazaar Loader.
Oct 28 2022
Oct 28 2022
rdicosmo moved T2220: swh-graph in production from Backlog to Work in progress on the Roadmap 2022 board.
rdicosmo moved T3960: Publicly available standard for SWHID version 1 from Backlog to Work in progress on the Roadmap 2022 board.
Oct 25 2022
Oct 25 2022
Oct 24 2022
Oct 24 2022
vlorentz closed T4451: Fetch extrinsic metadata from Gitea/Gogs, a subtask of T2202: Collect extrinsic metadata, as Resolved.
Oct 21 2022
Oct 21 2022
jayeshv closed T4613: Generalize and simplify the query language, a subtask of T3952: Make the search query language a first class citizen , as Invalid.
Oct 19 2022
Oct 19 2022
gitlab-migration changed the status of T4540: staging: Migrate remaining static services to elastic workers, a subtask of T4144: Elastic worker infrastructure, from Resolved to Migrated.
gitlab-migration changed the status of T4540: staging: Migrate remaining static services to elastic workers from Resolved to Migrated.
gitlab-migration changed the status of T4532: GraphQL: staging - Deploy version v0.0.4, a subtask of T4083: New public API (GraphQL + thin layer), from Resolved to Migrated.
gitlab-migration changed the status of T4506: Use local hypervisor storage in the loader pods, a subtask of T4144: Elastic worker infrastructure, from Resolved to Migrated.
gitlab-migration changed the status of T4495: thanos querier does not see metrics pushed by the archive staging thanos gateway in the azure bucket from Invalid to Migrated.
gitlab-migration changed the status of T4495: thanos querier does not see metrics pushed by the archive staging thanos gateway in the azure bucket, a subtask of T4144: Elastic worker infrastructure, from Invalid to Migrated.
gitlab-migration changed the status of T4371: Deploy swh-scrubber on all storage instances, a subtask of T3841: regularly scrub all the data stores of swh, from Resolved to Migrated.
gitlab-migration changed the status of T4329: Deploy add-forge-now in production, a subtask of T1538: Add "forge" now, from Resolved to Migrated.
gitlab-migration changed the status of T4278: Elastic worker cluster failures to unstuck from Resolved to Migrated.
gitlab-migration changed the status of T4278: Elastic worker cluster failures to unstuck, a subtask of T4144: Elastic worker infrastructure, from Resolved to Migrated.
gitlab-migration changed the status of T4064: Test GitLab migration scripts, a subtask of T2225: Migrate to GitLab, from Resolved to Migrated.
gitlab-migration closed T4063: Deploy gitlab instance for production, a subtask of T2225: Migrate to GitLab, as Migrated.
gitlab-migration closed T3959: Create sustainable plan for hardware provisioning/rotation as Migrated.
gitlab-migration changed the status of T3592: POC elastic worker infrastructure, a subtask of T4144: Elastic worker infrastructure, from Resolved to Migrated.
gitlab-migration closed T3558: Enable the swh-search QL in production, a subtask of T3952: Make the search query language a first class citizen , as Migrated.
gitlab-migration closed T3477: Add alerting when the copy to S3 starts lagging, a subtask of T3085: Complete and updated copy of the archive on S3 (objects+graph), as Migrated.
gitlab-migration changed the status of T2937: Provide credentials to InvenioRDM for staging, a subtask of T2344: Build a connector for software deposit via Zenodo/InvenioRDM, from Resolved to Migrated.
gitlab-migration changed the status of T1954: Up-to-date objstorage mirror on S3, a subtask of T3085: Complete and updated copy of the archive on S3 (objects+graph), from Resolved to Migrated.
Oct 18 2022
Oct 18 2022
ardumont closed T4064: Test GitLab migration scripts, a subtask of T2225: Migrate to GitLab, as Resolved.
Oct 17 2022
Oct 17 2022
vlorentz added a parent task for T4081: Show metadata on Web UI: T3097: Expose metadata in the WebApp and make it searchable.
vlorentz removed a subtask for T4081: Show metadata on Web UI: T3097: Expose metadata in the WebApp and make it searchable.
Oct 12 2022
Oct 12 2022
Oct 10 2022
Oct 10 2022
vsellier changed the status of T4063: Deploy gitlab instance for production, a subtask of T2225: Migrate to GitLab, from Open to Work in Progress.
Oct 5 2022
Oct 5 2022
jayeshv closed T4554: GraphQL: Improve functional tests using GQL, a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
Oct 4 2022
Oct 4 2022
thanos exposed on the production cluster with this commit: rSPRE8fade05553ed4a01e54e1b8481150c0e055e3f34
Oct 3 2022
Oct 3 2022
Sep 30 2022
Sep 30 2022
Sep 28 2022
Sep 28 2022
ardumont closed T4540: staging: Migrate remaining static services to elastic workers, a subtask of T4144: Elastic worker infrastructure, as Resolved.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 27 2022
Sep 27 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Deposit checkers migrated. Trigger icinga alert check on deposit, it went through the elastic workers [1] so done!
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 26 2022
Sep 26 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Cookers migrated:
cookers [2022-09-26 14:48:17,948: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[722de41d-0f88-45f7-ad06-3fb65f3978e1] received cookers [2022-09-26 14:48:54,924: INFO/ForkPoolWorker-1] Task swh.vault.cooking_tasks.SWHCookingTask[722de41d-0f88-45f7-ad06-3fb65f3978e1] succeeded in 36.83566682902165s: None cookers [2022-09-26 14:54:28,340: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[0926cf58-6001-496c-99aa-d74f5c57175d] received cookers [2022-09-26 14:54:30,130: INFO/ForkPoolWorker-2] Task swh.vault.cooking_tasks.SWHCookingTask[0926cf58-6001-496c-99aa-d74f5c57175d] succeeded in 1.7597111140494235s: None cookers [2022-09-26 14:55:33,509: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[839c03c3-159f-46e9-9f19-56817866321a] received cookers [2022-09-26 14:55:33,516: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[c6ad1f3c-31aa-4ef7-9f90-093d56011ddf] received cookers [2022-09-26 14:56:34,268: INFO/ForkPoolWorker-3] Task swh.vault.cooking_tasks.SWHCookingTask[839c03c3-159f-46e9-9f19-56817866321a] succeeded in 60.72709982498782s: None cookers [2022-09-26 14:56:41,961: INFO/ForkPoolWorker-4] Task swh.vault.cooking_tasks.SWHCookingTask[c6ad1f3c-31aa-4ef7-9f90-093d56011ddf] succeeded in 3.1700519190053456s: None
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Migrate remaining static loader/lister services to elastic workers to staging: Migrate remaining static services to elastic workers.
Sep 23 2022
Sep 23 2022
Remains a bunch of services not existing yet in the elastic stack (vault cooker, deposit checkers and indexer journal clients).
So the plan would be to integrate those in the elastic stack.
Sep 22 2022
Sep 22 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Migrate remaining static loader services to elastic workers to staging: Migrate remaining static loader/lister services to elastic workers.
Sep 21 2022
Sep 21 2022
ardumont changed the status of T4540: staging: Migrate remaining static services to elastic workers, a subtask of T4144: Elastic worker infrastructure, from Open to Work in Progress.
ardumont changed the status of T4540: staging: Migrate remaining static services to elastic workers from Open to Work in Progress.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 20 2022
Sep 20 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Miagrate remaining static loader services to elastic workers to staging: Migrate remaining static loader services to elastic workers.
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Deploy remaining loaders to elastic workers to staging: Miagrate remaining static loader services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 19 2022
Sep 19 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
ardumont triaged T4540: staging: Migrate remaining static services to elastic workers as High priority.
Sep 16 2022
Sep 16 2022
anlambert closed T4398: Create one django application for each webapp feature, a subtask of T3949: Refactor swh.web, as Resolved.
anlambert added a subtask for T3949: Refactor swh.web: T4054: Better support for browsers with JS disabled.
Sep 15 2022
Sep 15 2022
vsellier closed T4506: Use local hypervisor storage in the loader pods, a subtask of T4144: Elastic worker infrastructure, as Resolved.
ardumont closed T4532: GraphQL: staging - Deploy version v0.0.4, a subtask of T4083: New public API (GraphQL + thin layer), as Resolved.
Sep 14 2022
Sep 14 2022
vsellier changed the status of T4506: Use local hypervisor storage in the loader pods, a subtask of T4144: Elastic worker infrastructure, from Open to Work in Progress.
Sep 13 2022
Sep 13 2022
ardumont changed the status of T4532: GraphQL: staging - Deploy version v0.0.4, a subtask of T4083: New public API (GraphQL + thin layer), from Open to Work in Progress.
Sep 12 2022
Sep 12 2022
Sep 9 2022
Sep 9 2022