Page MenuHomeSoftware Heritage
Feed Advanced Search

Oct 19 2022

gitlab-migration closed T3085: Complete and updated copy of the archive on S3 (objects+graph) as Migrated.

This task has been migrated to GitLab.

Oct 19 2022, 6:01 PM · Roadmap 2022, meta-task, Roadmap 2021, System administration, Object storage
gitlab-migration changed the status of T3084: Fast track save code now requests, a subtask of T3082: Improve Save Code Now handling, from Resolved to Migrated.
Oct 19 2022, 6:01 PM · Save Code Now, meta-task, Roadmap 2021, Web app
gitlab-migration changed the status of T2937: Provide credentials to InvenioRDM for staging, a subtask of T2344: Build a connector for software deposit via Zenodo/InvenioRDM, from Resolved to Migrated.
Oct 19 2022, 6:00 PM · meta-task, Roadmap 2022, Roadmap 2020, SWORD deposit, Scientific Community Building
gitlab-migration changed the status of T2891: "Save code now" may fail with "OperationalError: database is locked", a subtask of T3082: Improve Save Code Now handling, from Resolved to Migrated.
Oct 19 2022, 6:00 PM · Save Code Now, meta-task, Roadmap 2021, Web app
gitlab-migration closed T2232: More robust virtualization layer, a subtask of T2226: Sysadm / devops, as Migrated.
Oct 19 2022, 5:57 PM · meta-task, Roadmap 2020
gitlab-migration closed T2229: Backups, a subtask of T2226: Sysadm / devops, as Migrated.
Oct 19 2022, 5:57 PM · meta-task, Roadmap 2020
gitlab-migration closed T2227: Automatic Puppet deployment, a subtask of T2226: Sysadm / devops, as Migrated.
Oct 19 2022, 5:57 PM · meta-task, Roadmap 2020
gitlab-migration changed the status of T2168: Add a grafana dashboard to monitor "Save code now" requests, a subtask of T3082: Improve Save Code Now handling, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Save Code Now, meta-task, Roadmap 2021, Web app
gitlab-migration changed the status of T2117: Save Code Now: End to End monitoring, a subtask of T3082: Improve Save Code Now handling, from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Save Code Now, meta-task, Roadmap 2021, Web app
gitlab-migration changed the status of T1954: Up-to-date objstorage mirror on S3, a subtask of T3085: Complete and updated copy of the archive on S3 (objects+graph), from Resolved to Migrated.
Oct 19 2022, 5:56 PM · Roadmap 2022, meta-task, Roadmap 2021, System administration, Object storage
gitlab-migration changed the status of T1481: add metric to monitor "save code now" efficiency, a subtask of T3082: Improve Save Code Now handling, from Resolved to Migrated.
Oct 19 2022, 5:55 PM · Save Code Now, meta-task, Roadmap 2021, Web app

Oct 18 2022

ardumont closed T4064: Test GitLab migration scripts, a subtask of T2225: Migrate to GitLab, as Resolved.
Oct 18 2022, 5:59 PM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020

Oct 17 2022

vlorentz added projects to T4081: Show metadata on Web UI: Metadata workflow, Web app.
Oct 17 2022, 10:36 AM · Web app, Metadata workflow, meta-task, Roadmap 2022
vlorentz triaged T4635: Show indexed extrinsic metadata on web UI as Low priority.
Oct 17 2022, 10:36 AM · Web app, Metadata workflow
vlorentz triaged T4634: Show raw extrinsic metadata on web UI as Low priority.
Oct 17 2022, 10:36 AM · Web app, Metadata workflow
vlorentz added a parent task for T4081: Show metadata on Web UI: T3097: Expose metadata in the WebApp and make it searchable.
Oct 17 2022, 10:35 AM · Web app, Metadata workflow, meta-task, Roadmap 2022
vlorentz added a subtask for T3097: Expose metadata in the WebApp and make it searchable: T4081: Show metadata on Web UI.
Oct 17 2022, 10:35 AM · Intrinsic metadata, Extrinsic metadata, Roadmap 2021, meta-task
vlorentz removed a subtask for T4081: Show metadata on Web UI: T3097: Expose metadata in the WebApp and make it searchable.
Oct 17 2022, 10:35 AM · Web app, Metadata workflow, meta-task, Roadmap 2022
vlorentz removed a parent task for T3097: Expose metadata in the WebApp and make it searchable: T4081: Show metadata on Web UI.
Oct 17 2022, 10:35 AM · Intrinsic metadata, Extrinsic metadata, Roadmap 2021, meta-task
vlorentz claimed T4081: Show metadata on Web UI.
Oct 17 2022, 10:33 AM · Web app, Metadata workflow, meta-task, Roadmap 2022

Oct 12 2022

anlambert added a revision to T3117: Publish status of existing listers and loaders: D8669: Update user documentation for listers and loaders.
Oct 12 2022, 5:11 PM · Documentation, Roadmap 2022, meta-task, Community Building, Roadmap 2021

Oct 10 2022

vsellier changed the status of T4063: Deploy gitlab instance for production, a subtask of T2225: Migrate to GitLab, from Open to Work in Progress.
Oct 10 2022, 1:23 PM · meta-task, Roadmap 2022, GitLab migration, Roadmap 2020

Oct 7 2022

vsellier closed T4610: upgrade staging instance to 15.4, a subtask of T2221: Development workflow & code quality, as Resolved.
Oct 7 2022, 9:05 AM · meta-task, Roadmap 2020
vsellier updated the task description for T4610: upgrade staging instance to 15.4.
Oct 7 2022, 12:13 AM · System administration

Oct 6 2022

vsellier updated the task description for T4610: upgrade staging instance to 15.4.
Oct 6 2022, 9:31 PM · System administration
vsellier updated the task description for T4610: upgrade staging instance to 15.4.
Oct 6 2022, 9:30 PM · System administration
vsellier changed the status of T4610: upgrade staging instance to 15.4 from Open to Work in Progress.
Oct 6 2022, 9:17 PM · System administration

Oct 4 2022

vsellier added a revision to T4385: Federate prometheus instances through thanos: D8617: thanos: Declare archive-production thanos for live data querying.
Oct 4 2022, 6:45 PM · meta-task, System administration, Roadmap 2022
vsellier closed T4534: Evaluate MetalLB as inbound loadbalancer, a subtask of T4523: Dynamic infrastructure, as Resolved.
Oct 4 2022, 3:03 PM · meta-task, System administration
vsellier added a comment to T4385: Federate prometheus instances through thanos.

thanos exposed on the production cluster with this commit: rSPRE8fade05553ed4a01e54e1b8481150c0e055e3f34

Oct 4 2022, 2:32 PM · meta-task, System administration, Roadmap 2022

Oct 3 2022

vlorentz added a project to T3841: regularly scrub all the data stores of swh: Datastore Scrubber.
Oct 3 2022, 10:24 AM · Datastore Scrubber, meta-task, Roadmap 2022, Storage manager

Sep 30 2022

vsellier updated the task description for T4385: Federate prometheus instances through thanos.
Sep 30 2022, 3:50 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Sep 30 2022, 9:52 AM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4385: Federate prometheus instances through thanos.
Sep 30 2022, 9:52 AM · meta-task, System administration, Roadmap 2022

Sep 28 2022

ardumont closed T4540: staging: Migrate remaining static services to elastic workers as Resolved.
Sep 28 2022, 7:16 PM · meta-task, System administration, Roadmap 2022
ardumont closed T4540: staging: Migrate remaining static services to elastic workers, a subtask of T4144: Elastic worker infrastructure, as Resolved.
Sep 28 2022, 7:16 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 28 2022, 7:16 PM · meta-task, System administration, Roadmap 2022
ardumont moved T4540: staging: Migrate remaining static services to elastic workers from in-progress to deployed/landed/monitoring on the System administration board.
Sep 28 2022, 10:45 AM · meta-task, System administration, Roadmap 2022

Sep 27 2022

ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 27 2022, 7:31 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 27 2022, 7:09 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 27 2022, 12:38 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 27 2022, 12:38 PM · meta-task, System administration, Roadmap 2022
ardumont added a comment to T4540: staging: Migrate remaining static services to elastic workers.

Deposit checkers migrated. Trigger icinga alert check on deposit, it went through the elastic workers [1] so done!

Sep 27 2022, 12:32 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 27 2022, 12:31 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4540: staging: Migrate remaining static services to elastic workers: D8545: requirements-swh: Add missing dependency.
Sep 27 2022, 11:31 AM · meta-task, System administration, Roadmap 2022

Sep 26 2022

ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 26 2022, 4:50 PM · meta-task, System administration, Roadmap 2022
ardumont added a comment to T4540: staging: Migrate remaining static services to elastic workers.

Cookers migrated:

cookers [2022-09-26 14:48:17,948: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[722de41d-0f88-45f7-ad06-3fb65f3978e1] received
cookers [2022-09-26 14:48:54,924: INFO/ForkPoolWorker-1] Task swh.vault.cooking_tasks.SWHCookingTask[722de41d-0f88-45f7-ad06-3fb65f3978e1] succeeded in 36.83566682902165s: None
cookers [2022-09-26 14:54:28,340: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[0926cf58-6001-496c-99aa-d74f5c57175d] received
cookers [2022-09-26 14:54:30,130: INFO/ForkPoolWorker-2] Task swh.vault.cooking_tasks.SWHCookingTask[0926cf58-6001-496c-99aa-d74f5c57175d] succeeded in 1.7597111140494235s: None
cookers [2022-09-26 14:55:33,509: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[839c03c3-159f-46e9-9f19-56817866321a] received
cookers [2022-09-26 14:55:33,516: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHCookingTask[c6ad1f3c-31aa-4ef7-9f90-093d56011ddf] received
cookers [2022-09-26 14:56:34,268: INFO/ForkPoolWorker-3] Task swh.vault.cooking_tasks.SWHCookingTask[839c03c3-159f-46e9-9f19-56817866321a] succeeded in 60.72709982498782s: None
cookers [2022-09-26 14:56:41,961: INFO/ForkPoolWorker-4] Task swh.vault.cooking_tasks.SWHCookingTask[c6ad1f3c-31aa-4ef7-9f90-093d56011ddf] succeeded in 3.1700519190053456s: None
Sep 26 2022, 4:50 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 26 2022, 2:48 PM · meta-task, System administration, Roadmap 2022
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Migrate remaining static loader/lister services to elastic workers to staging: Migrate remaining static services to elastic workers.
Sep 26 2022, 2:46 PM · meta-task, System administration, Roadmap 2022
vsellier closed T4541: Deploy git loaders dedicated to load add forge now requests, a subtask of T4523: Dynamic infrastructure, as Resolved.
Sep 26 2022, 1:54 PM · meta-task, System administration

Sep 23 2022

vsellier changed the status of T4534: Evaluate MetalLB as inbound loadbalancer, a subtask of T4523: Dynamic infrastructure, from Open to Work in Progress.
Sep 23 2022, 7:38 PM · meta-task, System administration
ardumont added a comment to T4540: staging: Migrate remaining static services to elastic workers.

Remains a bunch of services not existing yet in the elastic stack (vault cooker, deposit checkers and indexer journal clients).
So the plan would be to integrate those in the elastic stack.

Sep 23 2022, 5:50 PM · meta-task, System administration, Roadmap 2022

Sep 22 2022

ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 22 2022, 5:32 PM · meta-task, System administration, Roadmap 2022
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Migrate remaining static loader services to elastic workers to staging: Migrate remaining static loader/lister services to elastic workers.
Sep 22 2022, 9:45 AM · meta-task, System administration, Roadmap 2022

Sep 21 2022

ardumont changed the status of T4540: staging: Migrate remaining static services to elastic workers, a subtask of T4144: Elastic worker infrastructure, from Open to Work in Progress.
Sep 21 2022, 11:23 PM · meta-task, System administration, Roadmap 2022
ardumont changed the status of T4540: staging: Migrate remaining static services to elastic workers from Open to Work in Progress.
Sep 21 2022, 11:23 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 21 2022, 11:23 PM · meta-task, System administration, Roadmap 2022

Sep 20 2022

ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 20 2022, 7:01 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 20 2022, 6:22 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 20 2022, 3:49 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 20 2022, 12:41 PM · meta-task, System administration, Roadmap 2022
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Miagrate remaining static loader services to elastic workers to staging: Migrate remaining static loader services to elastic workers.
Sep 20 2022, 12:11 PM · meta-task, System administration, Roadmap 2022
ardumont renamed T4540: staging: Migrate remaining static services to elastic workers from staging: Deploy remaining loaders to elastic workers to staging: Miagrate remaining static loader services to elastic workers.
Sep 20 2022, 12:11 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 20 2022, 12:11 PM · meta-task, System administration, Roadmap 2022

Sep 19 2022

ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 19 2022, 4:11 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 19 2022, 3:24 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4540: staging: Migrate remaining static services to elastic workers.
Sep 19 2022, 2:24 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4540: staging: Migrate remaining static services to elastic workers: D8501: staging: Deploy loader mercurial worker.
Sep 19 2022, 2:23 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4540: staging: Migrate remaining static services to elastic workers: D8500: Add new swh-loader-mercurial application.
Sep 19 2022, 2:16 PM · meta-task, System administration, Roadmap 2022
ardumont triaged T4540: staging: Migrate remaining static services to elastic workers as High priority.
Sep 19 2022, 2:02 PM · meta-task, System administration, Roadmap 2022

Sep 16 2022

anlambert closed T4398: Create one django application for each webapp feature, a subtask of T3949: Refactor swh.web, as Resolved.
Sep 16 2022, 2:12 PM · meta-task, Roadmap 2022, Web app
anlambert added a subtask for T3949: Refactor swh.web: T4054: Better support for browsers with JS disabled.
Sep 16 2022, 2:03 PM · meta-task, Roadmap 2022, Web app

Sep 15 2022

vsellier closed T4506: Use local hypervisor storage in the loader pods, a subtask of T4144: Elastic worker infrastructure, as Resolved.
Sep 15 2022, 5:25 PM · meta-task, System administration, Roadmap 2022

Sep 14 2022

vsellier changed the status of T4506: Use local hypervisor storage in the loader pods, a subtask of T4144: Elastic worker infrastructure, from Open to Work in Progress.
Sep 14 2022, 11:01 AM · meta-task, System administration, Roadmap 2022
vsellier added a subtask for T4523: Dynamic infrastructure: T4534: Evaluate MetalLB as inbound loadbalancer.
Sep 14 2022, 10:57 AM · meta-task, System administration

Sep 12 2022

anlambert added a revision to T3117: Publish status of existing listers and loaders: D8453: user/loaders: Add new loaders in development to loaders info page.
Sep 12 2022, 5:08 PM · Documentation, Roadmap 2022, meta-task, Community Building, Roadmap 2021
ardumont added a comment to T4524: Make container-based services' push their log to swh log infrastructure.

Sample of current static field in logs (target) [1] vs current dynamic (to adapt) [2]
[1]

| journald.custom.swh_logging_args_0 | 66                                       |
| journald.custom.swh_logging_args_1 | https://github.com/WohlSoft/LunaLua      |
| journald.custom.swh_num_refs       | 66                                       |
| journald.custom.swh_repo           | https://github.com/WohlSoft/LunaLua      |
| journald.custom.swh_task_id        | c46472e7-8e36-4e97-8782-42d2a37b9533     |
| journald.custom.swh_task_kwarg_url | https://github.com/WohlSoft/LunaLua      |
| journald.custom.swh_task_name      | swh.loader.git.tasks.UpdateGitRepository |
| journald.custom.swh_type           | git_repo_list_refs                       |
Sep 12 2022, 2:26 PM · meta-task, System administration

Sep 9 2022

ardumont updated the task description for T4523: Dynamic infrastructure.
Sep 9 2022, 5:27 PM · meta-task, System administration
ardumont updated the task description for T4523: Dynamic infrastructure.
Sep 9 2022, 5:27 PM · meta-task, System administration
ardumont triaged T4525: Monitoring/alerting solution for container-based services as High priority.
Sep 9 2022, 5:26 PM · meta-task, System administration
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 9 2022, 5:25 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4523: Dynamic infrastructure.
Sep 9 2022, 5:23 PM · meta-task, System administration
ardumont triaged T4524: Make container-based services' push their log to swh log infrastructure as High priority.
Sep 9 2022, 5:21 PM · meta-task, System administration
ardumont added subtasks for T4523: Dynamic infrastructure: T4385: Federate prometheus instances through thanos, T4135: staging: Deploy graphql service.
Sep 9 2022, 5:14 PM · meta-task, System administration
ardumont added a parent task for T4385: Federate prometheus instances through thanos: T4523: Dynamic infrastructure.
Sep 9 2022, 5:14 PM · meta-task, System administration, Roadmap 2022
ardumont removed a parent task for T4385: Federate prometheus instances through thanos: T4144: Elastic worker infrastructure.
Sep 9 2022, 5:13 PM · meta-task, System administration, Roadmap 2022
ardumont removed a subtask for T4144: Elastic worker infrastructure: T4385: Federate prometheus instances through thanos.
Sep 9 2022, 5:12 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4523: Dynamic infrastructure.
Sep 9 2022, 5:12 PM · meta-task, System administration
ardumont added a parent task for T2231: Continuous deployment: T4523: Dynamic infrastructure.
Sep 9 2022, 5:12 PM · meta-task, Roadmap 2022, Staging environment, Roadmap 2020
ardumont added subtasks for T4523: Dynamic infrastructure: T4144: Elastic worker infrastructure, T2231: Continuous deployment.
Sep 9 2022, 5:12 PM · meta-task, System administration
ardumont added a parent task for T4144: Elastic worker infrastructure: T4523: Dynamic infrastructure.
Sep 9 2022, 5:12 PM · meta-task, System administration, Roadmap 2022
ardumont triaged T4523: Dynamic infrastructure as High priority.
Sep 9 2022, 5:11 PM · meta-task, System administration
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 9 2022, 5:05 PM · meta-task, System administration, Roadmap 2022
anlambert added a revision to T3117: Publish status of existing listers and loaders: D8401: user/listers: Add new listers in development to listers info page.
Sep 9 2022, 4:50 PM · Documentation, Roadmap 2022, meta-task, Community Building, Roadmap 2021

Sep 8 2022

ardumont moved T4144: Elastic worker infrastructure from Weekly backlog to in-progress on the System administration board.
Sep 8 2022, 11:16 AM · meta-task, System administration, Roadmap 2022

Sep 6 2022

ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 6 2022, 3:37 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4144: Elastic worker infrastructure: D8400: archive-staging: Deploy listers in cluster.
Sep 6 2022, 3:36 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 6 2022, 2:54 PM · meta-task, System administration, Roadmap 2022
ardumont added a revision to T4144: Elastic worker infrastructure: D8398: Add new swh.lister image.
Sep 6 2022, 2:54 PM · meta-task, System administration, Roadmap 2022
ardumont updated the task description for T4144: Elastic worker infrastructure.
Sep 6 2022, 2:45 PM · meta-task, System administration, Roadmap 2022