It's now deployed on staging.
Some bzr origins got listed but failed on the cloning step.
This task is to track the necessary work to list valid bzr origins,
analyse the issues during loading after that through sentry [1]
[1] https://sentry.softwareheritage.org/organizations/swh/issues/?project=22
| Status | Assigned | Task | ||
|---|---|---|---|---|
| Migrated | gitlab-migration | T3610 Bazaar/Breezy loader | ||
| Migrated | gitlab-migration | T3945 staging: List and ingest bzr origins, analyse and fix paper cuts | ||
| Restricted Maniphest Task |
After ^, listing triggered again, and listing still ongoing, current status [1]
[1]
15:32:20 swh-scheduler@db1:5432=> select now(), visit_type, count(*) from listed_origins where visit_type in ('cvs', 'bzr') group by visit_type;
+-------------------------------+------------+--------+
| now | visit_type | count |
+-------------------------------+------------+--------+
| 2022-02-18 14:34:12.889045+00 | bzr | 473036 |
| 2022-02-18 14:34:12.889045+00 | cvs | 69213 |
+-------------------------------+------------+--------+
(2 rows)
Time: 969.946 msRun finished [1].
Totalling 980k bzr origins on launchpad [2]
[1]
Feb 18 23:11:18 worker3 python3[475573]: [2022-02-18 23:11:18,297: INFO/ForkPoolWorker-4] Task swh.lister.launchpad.tasks.IncrementalLaunchpadLister[e6e176ec-7c2e-4b87-9a2e-0083bf9ef8a2] succeeded in 43289.195487316s: {'pages': 2, 'origins': 792481}[2]
08:57:53 swh-scheduler@db1:5432=> select now(), visit_type, count(*) from listed_origins where visit_type in ('cvs', 'bzr') group by visit_type;
+------------------------------+------------+--------+
| now | visit_type | count |
+------------------------------+------------+--------+
| 2022-02-19 07:58:51.71787+00 | bzr | 980322 |
| 2022-02-19 07:58:51.71787+00 | cvs | 72880 |
+------------------------------+------------+--------+
(2 rows)
Time: 991.077 ms