loader plumbings used by other loaders
Details
Details
Description
Thu, Aug 4
Thu, Aug 4
ardumont changed the status of T4266: prod: Deploy swh-loader-core 3.5.0 on staging from Invalid to Resolved.
Jun 23 2022
Jun 23 2022
Closing this, as these metrics are now visible on https://grafana.softwareheritage.org/d/FqGC4zu7z/vlorentz-loader-metrics
May 30 2022
May 30 2022
May 23 2022
May 23 2022
vlorentz added a comment to T4266: prod: Deploy swh-loader-core 3.5.0 on staging.
oh you're right; this time status is undefined, not success
ardumont moved T4266: prod: Deploy swh-loader-core 3.5.0 on staging from Backlog to Weekly backlog on the System administration board.
ardumont added a comment to T4266: prod: Deploy swh-loader-core 3.5.0 on staging.
3.4.1 is deployed everywhere:
root@pergamon:~# clush -b -w @swh-workers -w @swh-workers-large -w @staging-workers 'dpkg -l python3-swh.loader.core' --------------- worker[01-18],worker[0-3].internal.staging.swh.network (22) --------------- Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-=======================-====================-============-================================= ii python3-swh.loader.core 3.4.1-1~swh1~bpo10+1 all Software Heritage Loader Core
May 13 2022
May 13 2022
ardumont moved T4238: Deploy latest loaders version (> v3.4) from in-progress to deployed/landed/monitoring on the System administration board.
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
ardumont moved T4238: Deploy latest loaders version (> v3.4) from Weekly backlog to in-progress on the System administration board.
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
ardumont updated the task description for T4238: Deploy latest loaders version (> v3.4).
ardumont moved T4238: Deploy latest loaders version (> v3.4) from Backlog to Weekly backlog on the System administration board.
May 10 2022
May 10 2022
vlorentz added a comment to T3273: Use "fork" relationships to speed-up initial load of large repositories.
Currently can't do it on GitLab while logged out: https://gitlab.com/gitlab-org/gitlab/-/issues/361952
May 3 2022
May 3 2022
Yes; and they should be already supported in SWH (if some places don't, then it's a bug)
vlorentz closed T4187: Pass forge type to loaders, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
vlorentz closed T4188: Make swh-loader-core run metadata fetchers before loading an origin, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
vlorentz closed T4188: Make swh-loader-core run metadata fetchers before loading an origin as Resolved.
Apr 29 2022
Apr 29 2022
ardumont closed T4206: prod: Deploy metadata loader v0.0.2, a subtask of T3273: Use "fork" relationships to speed-up initial load of large repositories, as Resolved.
ardumont closed T4204: prod: Deploy swh-scheduler 1.1.1, a subtask of T4186: Allow loaders to fetch extrinsic metadata, as Resolved.
ardumont closed T4205: prod: Deploy swh-loader-core 3.2.1, a subtask of T4204: prod: Deploy swh-scheduler 1.1.1, as Resolved.
Apr 28 2022
Apr 28 2022
ardumont moved T4204: prod: Deploy swh-scheduler 1.1.1 from in-progress to deployed/landed/monitoring on the System administration board.
ardumont moved T4205: prod: Deploy swh-loader-core 3.2.1 from in-progress to deployed/landed/monitoring on the System administration board.
ardumont changed the status of T4206: prod: Deploy metadata loader v0.0.2, a subtask of T3273: Use "fork" relationships to speed-up initial load of large repositories, from Open to Work in Progress.
ardumont changed the status of T4205: prod: Deploy swh-loader-core 3.2.1 from Open to Work in Progress.
ardumont changed the status of T4205: prod: Deploy swh-loader-core 3.2.1, a subtask of T4204: prod: Deploy swh-scheduler 1.1.1, from Open to Work in Progress.
ardumont changed the status of T4204: prod: Deploy swh-scheduler 1.1.1, a subtask of T4186: Allow loaders to fetch extrinsic metadata, from Open to Work in Progress.
ardumont changed the status of T4204: prod: Deploy swh-scheduler 1.1.1 from Open to Work in Progress.
vlorentz edited projects for T3273: Use "fork" relationships to speed-up initial load of large repositories, added: Origin-GitHub; removed GitHub lister.
vlorentz edited projects for T3273: Use "fork" relationships to speed-up initial load of large repositories, added: Origin-GitLab; removed GitLab migration.
vlorentz added a parent task for T4204: prod: Deploy swh-scheduler 1.1.1: T4206: prod: Deploy metadata loader v0.0.2.