Closing this, as these metrics are now visible on https://grafana.softwareheritage.org/d/FqGC4zu7z/vlorentz-loader-metrics
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Aug 4 2022
Aug 4 2022
ardumont changed the status of T4266: prod: Deploy swh-loader-core 3.5.0 on staging from Invalid to Resolved.
Jun 23 2022
Jun 23 2022
May 30 2022
May 30 2022
May 23 2022
May 23 2022
oh you're right; this time status is undefined, not success
ardumont moved T4266: prod: Deploy swh-loader-core 3.5.0 on staging from Backlog to Weekly backlog on the System administration board.
3.4.1 is deployed everywhere:
root@pergamon:~# clush -b -w @swh-workers -w @swh-workers-large -w @staging-workers 'dpkg -l python3-swh.loader.core' --------------- worker[01-18],worker[0-3].internal.staging.swh.network (22) --------------- Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-=======================-====================-============-================================= ii python3-swh.loader.core 3.4.1-1~swh1~bpo10+1 all Software Heritage Loader Core
May 13 2022
May 13 2022
ardumont moved T4238: Deploy latest loaders version (> v3.4) from in-progress to deployed/landed/monitoring on the System administration board.
ardumont moved T4238: Deploy latest loaders version (> v3.4) from Weekly backlog to in-progress on the System administration board.
ardumont moved T4238: Deploy latest loaders version (> v3.4) from Backlog to Weekly backlog on the System administration board.
May 10 2022
May 10 2022
vlorentz added a comment to T3273: Use "fork" relationships to speed-up initial load of large repositories.
Currently can't do it on GitLab while logged out: https://gitlab.com/gitlab-org/gitlab/-/issues/361952
May 3 2022
May 3 2022
Yes; and they should be already supported in SWH (if some places don't, then it's a bug)
vlorentz closed T4187: Pass forge type to loaders, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
vlorentz closed T4188: Make swh-loader-core run metadata fetchers before loading an origin, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
vlorentz closed T4188: Make swh-loader-core run metadata fetchers before loading an origin as Resolved.
Apr 29 2022
Apr 29 2022
ardumont closed T4206: prod: Deploy metadata loader v0.0.2, a subtask of T3273: Use "fork" relationships to speed-up initial load of large repositories, as Resolved.
ardumont closed T4204: prod: Deploy swh-scheduler 1.1.1, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
ardumont closed T4205: prod: Deploy swh-loader-core 3.2.1, a subtask of T4204: prod: Deploy swh-scheduler 1.1.1, as Resolved.
Apr 28 2022
Apr 28 2022
ardumont moved T4204: prod: Deploy swh-scheduler 1.1.1 from in-progress to deployed/landed/monitoring on the System administration board.
ardumont moved T4205: prod: Deploy swh-loader-core 3.2.1 from in-progress to deployed/landed/monitoring on the System administration board.
ardumont changed the status of T4206: prod: Deploy metadata loader v0.0.2, a subtask of T3273: Use "fork" relationships to speed-up initial load of large repositories, from Open to Work in Progress.
ardumont changed the status of T4205: prod: Deploy swh-loader-core 3.2.1 from Open to Work in Progress.
ardumont changed the status of T4205: prod: Deploy swh-loader-core 3.2.1, a subtask of T4204: prod: Deploy swh-scheduler 1.1.1, from Open to Work in Progress.
ardumont changed the status of T4204: prod: Deploy swh-scheduler 1.1.1, a subtask of T4186: Allow loaders to fetch extrinsic metadata, from Open to Work in Progress.
ardumont changed the status of T4204: prod: Deploy swh-scheduler 1.1.1 from Open to Work in Progress.
vlorentz edited projects for T3273: Use "fork" relationships to speed-up initial load of large repositories, added: Origin-GitHub; removed GitHub lister.
vlorentz edited projects for T3273: Use "fork" relationships to speed-up initial load of large repositories, added: Origin-GitLab; removed GitLab migration.
vlorentz added a parent task for T4204: prod: Deploy swh-scheduler 1.1.1: T4206: prod: Deploy metadata loader v0.0.2.
Apr 27 2022
Apr 27 2022
ardumont closed T4194: staging: Deploy swh-scheduler 1.1.0, a subtask of T4187: Pass forge type to loaders, as Resolved.
vlorentz added a subtask for T4187: Pass forge type to loaders: T4194: staging: Deploy swh-scheduler 1.1.0.
Apr 26 2022
Apr 26 2022
anlambert added a revision to T4187: Pass forge type to loaders: D7690: tasks: Fix and simplify implementation.
Apr 22 2022
Apr 22 2022
vlorentz renamed T4188: Make swh-loader-core run metadata fetchers before loading an origin from Make swh-loader-core run metadata fetchers after loading an origin to Make swh-loader-core run metadata fetchers before loading an origin.
Apr 21 2022
Apr 21 2022
vlorentz added revisions to T4187: Pass forge type to loaders: D7611: cvs: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7612: git: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7613: hg: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7614: bzr: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7615: svn: Update for swh.loader.core 3.0.0 and remove initialization boilerplate, D7610: BaseLoader: Add 'origin_url' argument and remove 'prepare_origin_visit' method, D7618: Make create_origin_task_dict a standalone function, D7621: Add a 'lister_name' argument to all tasks created from ListedOrigin.
vlorentz triaged T4188: Make swh-loader-core run metadata fetchers before loading an origin as Normal priority.
Feb 25 2022
Feb 25 2022
ardumont moved T3973: Deploy swh.deposit v0.17 from in-progress to deployed/landed/monitoring on the System administration board.
After upgrading pergamon and debugging through sentry and cli, the deposit icinga check is back on track.
Triggered back the icinga checks there.
- Fix loader.core debian build [1]
ardumont added a revision to T3976: opam loader: Adapt for opam > 2.1: D7256: Ignore quilt .pc/ folder.
In T3976#79630, @olasd wrote:https://opam.ocaml.org/doc/FAQ.html#Why-does-opam-require-bwrap
"If needed, for special cases like unprivileged containers, sandboxing can be disabled on opam init with the --disable-sandboxing flag (only for non-initialised opam)".
I think that would make sense, as we never execute code from the opam root, we only read metadata files.
"If needed, for special cases like unprivileged containers, sandboxing can be disabled on opam init with the --disable-sandboxing flag (only for non-initialised opam)".
Feb 24 2022
Feb 24 2022
- Fix deposit debian build