stuff related to https://forge.softwareheritage.org/diffusion/DLSCG/
Details
Details
Description
Jan 8 2023
Jan 8 2023
gitlab-migration changed the status of T3645: cgit: handle "429 Too Many Requests" errors from Resolved to Migrated.
gitlab-migration changed the status of T2999: Optimize the number of HTTP requests sent by the cgit lister from Resolved to Migrated.
gitlab-migration changed the status of T2988: Improve cgit lister to add last modification date of the repos from Resolved to Migrated.
gitlab-migration changed the status of T2984: Port cgit lister to the new Lister API from Resolved to Migrated.
gitlab-migration changed the status of T1861: cgit lister: Adapt lister to deal with inconsistent `git clone uri` pattern from Resolved to Migrated.
gitlab-migration changed the status of T1659: rewrite the CGit lister as a proper lister from Resolved to Migrated.
Oct 19 2022
Oct 19 2022
gitlab-migration changed the status of T4036: CGit listing of git.yoctoproject.org instance is broken from Resolved to Migrated.
May 23 2022
May 23 2022
ardumont moved T4036: CGit listing of git.yoctoproject.org instance is broken from Backlog to done on the System administration board.
Mar 11 2022
Mar 11 2022
ardumont added a comment to T4036: CGit listing of git.yoctoproject.org instance is broken.
Triggered back a run and it seemed to have run well:
Mar 11 12:23:15 worker14 python3[2494505]: [2022-03-11 12:23:15,252: INFO/MainProcess] Received task: swh.lister.cgit.tasks.CGitListerTask[e7674643-c7ca-4ae1-910e-9ea24e8c2335]
Mar 11 12:23:17 worker14 python3[2961235]: [2022-03-11 12:23:17,950: INFO/ForkPoolWorker-7] Task swh.lister.cgit.tasks.CGitListerTask[e7674643-c7ca-4ae1-910e-9ea24e8c2335] succeeded in 2.3799873050302267s: {'pages': 1, 'origins': 177}swh-sentry-integration added a comment to T4036: CGit listing of git.yoctoproject.org instance is broken.
Sentry issue: SWH-LISTER-4V
ardumont added a comment to T4036: CGit listing of git.yoctoproject.org instance is broken.
Should be a matter of updating such task with:
anlambert triaged T4036: CGit listing of git.yoctoproject.org instance is broken as Normal priority.
Oct 22 2021
Oct 22 2021
Fixed in swh-lister v2.2.0 and deployed to production, closing this.
Oct 11 2021
Oct 11 2021
Jan 29 2021
Jan 29 2021
swh-public-ci added a comment to D4968: cgit: Compute origin urls out of a base git url when provided..
Build is green
ardumont updated the diff for D4968: cgit: Compute origin urls out of a base git url when provided..
Rebase
Looks good to me !
ardumont added inline comments to D4968: cgit: Compute origin urls out of a base git url when provided..
swh-public-ci added a comment to D4968: cgit: Compute origin urls out of a base git url when provided..
Build is green
ardumont updated the diff for D4968: cgit: Compute origin urls out of a base git url when provided..
Adapt according to review:
- Add more cgit instance samples
- Rework docstring
- Rework url computation a bit
anlambert added inline comments to D4968: cgit: Compute origin urls out of a base git url when provided..
ardumont added inline comments to D4968: cgit: Compute origin urls out of a base git url when provided..
anlambert added inline comments to D4968: cgit: Compute origin urls out of a base git url when provided..
swh-public-ci added a comment to D4968: cgit: Compute origin urls out of a base git url when provided..
Build is green
ardumont updated the diff for D4968: cgit: Compute origin urls out of a base git url when provided..
Adapt according to review
ardumont added inline comments to D4968: cgit: Compute origin urls out of a base git url when provided..
anlambert requested changes to D4968: cgit: Compute origin urls out of a base git url when provided..
The current implementation will not work for most cases where the base cgit URL and the base clone URL differs (see inline comment).
ardumont updated the summary of D4968: cgit: Compute origin urls out of a base git url when provided..
ardumont added a comment to T2999: Optimize the number of HTTP requests sent by the cgit lister.
I guess you mean that some cgit origin URLs previously loaded into the archive will not be the same if
the approach in that task is implemented ?
anlambert added a comment to T2999: Optimize the number of HTTP requests sent by the cgit lister.
Analyzing further the suggestions using the deprecated swh-lister cache db table as data
point (production data) [1], 3 instances so far will generate sometimes wrong origin
urls with the suggested approach.
ardumont added a comment to T2999: Optimize the number of HTTP requests sent by the cgit lister.
Analyzing further the suggestions using the deprecated swh-lister cache db table as data
point (production data) [1], 3 instances so far will generate sometimes wrong origin
urls with the suggested approach.
ardumont updated the task description for T2999: Optimize the number of HTTP requests sent by the cgit lister.
Jan 28 2021
Jan 28 2021
Jan 27 2021
Jan 27 2021
anlambert triaged T2999: Optimize the number of HTTP requests sent by the cgit lister as Normal priority.
Jan 26 2021
Jan 26 2021
vsellier changed the status of T2988: Improve cgit lister to add last modification date of the repos from Open to Work in Progress.
Jan 25 2021
Jan 25 2021
vsellier triaged T2988: Improve cgit lister to add last modification date of the repos as Normal priority.
Jan 22 2021
Jan 22 2021
ardumont moved T2984: Port cgit lister to the new Lister API from in-progress to code review on the Sprint 2021 01 board.