I think just showing how many are already cooked would be a huge improvement. Then users would at least be able to observe progress happening. The current system just indicates 'processing' so it is not obvious if it is actually doing something or perhaps the task died.
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Nov 16 2021
Nov 16 2021
vlorentz triaged T3731: Try parallelizing directory_get_entries with an async swh-storage client as Normal priority.
Nov 15 2021
Nov 15 2021
they were just surprisingly long tasks; T3727 should help with this
the cooking has completed now
(marking T2220 as dependency, because we need an up-to-date graph to show an ETA on objects loaded in the last ~year)
vlorentz added a subtask for T3550: Compute and show ETA for vault tasks: T2220: swh-graph in production.
Oct 1 2021
Oct 1 2021
vlorentz changed the status of T3552: Fix corrupted releases, revisions, and directories in the storage, a subtask of T887: Vault: "snapshot" cooker, from Open to Work in Progress.
vlorentz changed the status of T3552: Fix corrupted releases, revisions, and directories in the storage, a subtask of T3551: Fix git-fsck errors in the git-bare cooker, from Open to Work in Progress.
Sep 23 2021
Sep 23 2021
vlorentz closed T3566: git-fsck errors in the git-bare cooker are not properly reported as Resolved.
vlorentz closed T3566: git-fsck errors in the git-bare cooker are not properly reported, a subtask of T3504: Make the git-bare cooker publicly available, as Resolved.
Sep 22 2021
Sep 22 2021
ardumont moved T3589: Deploy swh.vault v1.2 from code-review/await-feedback/pause to deployed/landed/monitoring on the System administration board.
Sep 21 2021
Sep 21 2021
ardumont moved T3589: Deploy swh.vault v1.2 from in-progress to code-review/await-feedback/pause on the System administration board.
Deployed in staging. @vlorentz validated it worked.
Sep 20 2021
Sep 20 2021
ardumont moved T3589: Deploy swh.vault v1.2 from Backlog to Weekly backlog on the System administration board.
Sep 17 2021
Sep 17 2021
Sep 15 2021
Sep 15 2021
Sep 12 2021
Sep 12 2021
vlorentz triaged T3566: git-fsck errors in the git-bare cooker are not properly reported as High priority.
Sep 10 2021
Sep 10 2021
vlorentz changed the status of T3504: Make the git-bare cooker publicly available from Open to Work in Progress.
vlorentz changed the status of T3504: Make the git-bare cooker publicly available, a subtask of T887: Vault: "snapshot" cooker, from Open to Work in Progress.
vlorentz changed the status of T3504: Make the git-bare cooker publicly available, a subtask of T3096: Efficient and reliable download via the Vault, from Open to Work in Progress.
vlorentz moved T3096: Efficient and reliable download via the Vault from Backlog to In progress on the Vault board.
vlorentz changed the status of T3551: Fix git-fsck errors in the git-bare cooker from Open to Work in Progress.
vlorentz changed the status of T3551: Fix git-fsck errors in the git-bare cooker, a subtask of T3504: Make the git-bare cooker publicly available, from Open to Work in Progress.
We have an icinga plugin implementing some of this: https://forge.softwareheritage.org/source/swh-icinga-plugins/browse/master/swh/icinga_plugins/vault.py
This is implemented by the git-bare cooker, but it's not publicly available for now.
vlorentz added a parent task for T3504: Make the git-bare cooker publicly available: T887: Vault: "snapshot" cooker.
vlorentz added a subtask for T887: Vault: "snapshot" cooker: T3504: Make the git-bare cooker publicly available.
vlorentz closed T3553: git_bare: Don't include submodule targets, a subtask of T3551: Fix git-fsck errors in the git-bare cooker, as Resolved.
Sep 8 2021
Sep 8 2021
vlorentz triaged T3565: Add an option in swh-web to allow git-bare cooking via the UI for beta-testers as Normal priority.
vlorentz reopened T3505: Make the git-bare cooker available to the staff and beta-testers in the production webapp as "Work in Progress".
vlorentz reopened T3505: Make the git-bare cooker available to the staff and beta-testers in the production webapp, a subtask of T3504: Make the git-bare cooker publicly available, as Work in Progress.
vlorentz renamed T3505: Make the git-bare cooker available to the staff and beta-testers in the production webapp from Make the git-bare cooker available to the staff in the production webapp to Make the git-bare cooker available to the staff and beta-testers in the production webapp.
Sep 6 2021
Sep 6 2021
Sep 3 2021
Sep 3 2021
vlorentz renamed T3550: Compute and show ETA for vault tasks from Compute and show ETA for to vault tasks to Compute and show ETA for vault tasks.
vlorentz renamed T3550: Compute and show ETA for vault tasks from Add ETA for to vault tasks to Compute and show ETA for to vault tasks.
For git-bare cooking to work, upgrade swh.storage to the latest version (> v0.35) and
restart the storage service (done).
Sep 2 2021
Sep 2 2021
Sep 1 2021
Sep 1 2021
ardumont moved T3518: Enable vault cookers to access swh-graph from in-progress to code-review/await-feedback/pause on the System administration board.
Dropping the subtask about the full packaging.
ardumont changed the status of T3518: Enable vault cookers to access swh-graph, a subtask of T3505: Make the git-bare cooker available to the staff and beta-testers in the production webapp, from Open to Work in Progress.
ardumont changed the status of T3518: Enable vault cookers to access swh-graph from Open to Work in Progress.
ardumont closed T3543: Debian package python3-swh.graph.client, a subtask of T3518: Enable vault cookers to access swh-graph, as Resolved.
Packaging ok:
Package python3-swh.graph.client built [1]
- Add 'has debian packaging branch' tag to the repository
- Install hook to cascade the debian packaging build [1]
- Ensure necessary ci jobs is installed to build package (already there)
Local build successful [1]
ardumont changed the status of T3543: Debian package python3-swh.graph.client from Open to Work in Progress.
ardumont changed the status of T3543: Debian package python3-swh.graph.client, a subtask of T3518: Enable vault cookers to access swh-graph, from Open to Work in Progress.
Aug 31 2021
Aug 31 2021
Discussing with the sysadm team, it's unnecessary to actually go up to package py4j.
What's required here for the vault the python3-swh.vault.client package with only the module swh.vault.client and swh.vault.naive_client.
Aug 30 2021
Aug 30 2021
Aug 27 2021
Aug 27 2021
might be related to T3168 for the packaging part.
vlorentz closed T3507: prod: vault: Deploy v1.0.0, a subtask of T3506: Get rid of the concept of vault "object_type", as Resolved.
And I triggered re-cooking bundles that were requested in the last month.
ardumont moved T3507: prod: vault: Deploy v1.0.0 from in-progress to deployed/landed/monitoring on the System administration board.
Note that the cache invalidation is not completely done though as the objstorage used
is an azure one.Currently investigating how to clean that up.
Note that the cache invalidation is not completely done though as the objstorage used
is an azure one.
- status.io: Open maintenance ticket to notify of the partial disruption in service
- vangogh: Stop puppet
- vangogh: Stop gunicorn-swh-vault
- vault db: Schema migration [1]
- Upgrade workers and webapp nodes with latest swh.vault and restart cooker service
- Start back gunicorn-swh-vault
- Try a cooking and check result -> ok
- Close maintenance ticket as everything is fine