Page MenuHomeSoftware Heritage
Create Task
Maniphest T1139

ingest major gitlab instances
Closed, MigratedEdits Locked
Actions

Description

As per comment [1], here is a limited list:

|----------------+----------------------------------------+-------------+----------------+-----------|
| listing status | url                                    | instance    | # listed repos | # origins |
|----------------+----------------------------------------+-------------+----------------+-----------|
| done           | https://gitlab.com/api/v4              | gitlab      |         964329 |    965554 |
| done           | https://salsa.debian.org/api/v4/       | debian      |          23757 |      9782 |
| done           | https://framagit.org/api/v4/           | framagit    |          12134 |     12153 |
| done           | https://gitlab.inria.fr/api/v4/        | inria       |           1606 |      1606 |
| done           | https://gitlab.gnome.org/api/v4/       | gnome       |           3825 |      3904 |
| done           | https://gitlab.freedesktop.org/api/v4/ | freedesktop |           1949 |      2849 |
| done           | https://0xacab.org/api/v4/             | riseup      |            883 |       884 |
| done           | https://gitlab.common-lisp.net/api/v4  | common-lisp |            551 |       731 |
| done           | https://gite.lirmm.fr/api/v4           | gite.lirmm  |            292 |       293 |
|----------------+----------------------------------------+-------------+----------------+-----------|

[1] https://forge.softwareheritage.org/T1111#20926

Related Objects
Search...

Event Timeline

ardumont triaged this task as Normal priority.Jul 18 2018, 12:33 PM
ardumont created this task.
ardumont closed subtask T1243: lister gitlab: Ingest inria forge instance as Resolved.Oct 5 2018, 4:19 PM
ardumont updated the task description. (Show Details)Oct 5 2018, 4:27 PM
ardumont updated the task description. (Show Details)Oct 5 2018, 4:29 PM
zack renamed this task from List other gitlab instances to ingest major gitlab instances.Oct 5 2018, 4:30 PM
zack added a project: Archive coverage.Oct 5 2018, 4:34 PM
douardda updated the task description. (Show Details)Oct 29 2018, 10:00 AM
douardda updated the task description. (Show Details)
olasd updated the task description. (Show Details)Oct 29 2018, 10:48 AM
olasd added a subscriber: olasd.

I had added framagit and 0xacab on Friday, forgot to update the task.

ardumont updated the task description. (Show Details)Nov 22 2018, 4:37 PM
katrinleinweber added a subscriber: katrinleinweber.Jan 17 2019, 3:02 PM
ardumont updated the task description. (Show Details)Mar 30 2019, 1:21 PM
ardumont updated the task description. (Show Details)Jun 12 2019, 11:01 PM
ardumont updated the task description. (Show Details)Jun 29 2019, 9:41 AM
ardumont changed the task status from Open to Work in Progress.Jun 29 2019, 9:44 AM
ardumont mentioned this in T1863: gitlab.com: Full lister fails to retrieve the range information it needs to start listing.Jun 29 2019, 9:53 AM
ardumont added a comment.EditedJun 30 2019, 11:09 AM

Heads up, listing status for all instances (included new ones added):

swh-lister=> select instance, count(*) as nb_repos_listed from gitlab_repo group by instance order by nb_repos_listed;
  instance   | nb_repos_listed
-------------+-----------------
 gite.lirmm  |             292
 common-lisp |             551
 riseup      |             883
 freedesktop |            1949
 gnome       |            3825
 inria       |            1606
 framagit    |           12134
 debian      |           23757
 gitlab      |          964329
(9 rows)
ardumont updated the task description. (Show Details)Jun 30 2019, 11:16 AM
ardumont updated the task description. (Show Details)Jun 30 2019, 11:18 AM
ardumont updated the task description. (Show Details)Jul 1 2019, 3:29 PM
ardumont updated the task description. (Show Details)
ardumont updated the task description. (Show Details)Jul 1 2019, 3:32 PM
zack mentioned this in T2793: add notable past events to the archive changelog.Dec 10 2020, 10:54 AM
zack closed this task as Resolved.Dec 11 2020, 2:35 PM
zack claimed this task.
zack added a subscriber: zack.

All instances listed in this task have been added, so I'm closing this. Other instances can be added in the future, submitting matching task for tracking reasons as needed.

anlambert mentioned this in T2994: Use keyset pagination in Gitlab lister.Jan 26 2021, 11:08 AM
gitlab-migration changed the task status from Resolved to Migrated.Jan 8 2023, 9:57 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

gitlab-migration changed the status of subtask T1243: lister gitlab: Ingest inria forge instance from Resolved to Migrated.Jan 8 2023, 9:58 PM
About · Developer information · Legal