Page MenuHomeSoftware Heritage

ingest major gitlab instances
Started, Work in Progress, NormalPublic

Description

As per comment [1], here is a limited list:

|----------------+----------------------------------------+-------------+----------------+-----------|
| listing status | url                                    | instance    | # listed repos | # origins |
|----------------+----------------------------------------+-------------+----------------+-----------|
| done           | https://gitlab.com/api/v4              | gitlab      |         964329 |    965554 |
| done           | https://salsa.debian.org/api/v4/       | debian      |          23757 |      9782 |
| done           | https://framagit.org/api/v4/           | framagit    |          12134 |     12153 |
| done           | https://gitlab.inria.fr/api/v4/        | inria       |           1606 |      1606 |
| done           | https://gitlab.gnome.org/api/v4/       | gnome       |           3825 |      3904 |
| done           | https://gitlab.freedesktop.org/api/v4/ | freedesktop |           1949 |      2849 |
| done           | https://0xacab.org/api/v4/             | riseup      |            883 |       884 |
| done           | https://gitlab.common-lisp.net/api/v4  | common-lisp |            551 |       731 |
| done           | https://gite.lirmm.fr/api/v4           | gite.lirmm  |            292 |       293 |
|----------------+----------------------------------------+-------------+----------------+-----------|

[1] https://forge.softwareheritage.org/T1111#20926

Event Timeline

ardumont triaged this task as Normal priority.
ardumont updated the task description. (Show Details)Oct 5 2018, 4:27 PM
ardumont updated the task description. (Show Details)Oct 5 2018, 4:29 PM
zack renamed this task from List other gitlab instances to ingest major gitlab instances.Oct 5 2018, 4:30 PM
douardda updated the task description. (Show Details)Oct 29 2018, 10:00 AM
douardda updated the task description. (Show Details)
olasd updated the task description. (Show Details)Oct 29 2018, 10:48 AM
olasd added a subscriber: olasd.

I had added framagit and 0xacab on Friday, forgot to update the task.

ardumont updated the task description. (Show Details)Nov 22 2018, 4:37 PM
ardumont updated the task description. (Show Details)Mar 30 2019, 1:21 PM
ardumont updated the task description. (Show Details)Jun 12 2019, 11:01 PM
ardumont updated the task description. (Show Details)Sat, Jun 29, 9:41 AM
ardumont changed the task status from Open to Work in Progress.Sat, Jun 29, 9:44 AM
ardumont added a comment.EditedSun, Jun 30, 11:09 AM

Heads up, listing status for all instances (included new ones added):

swh-lister=> select instance, count(*) as nb_repos_listed from gitlab_repo group by instance order by nb_repos_listed;
  instance   | nb_repos_listed
-------------+-----------------
 gite.lirmm  |             292
 common-lisp |             551
 riseup      |             883
 freedesktop |            1949
 gnome       |            3825
 inria       |            1606
 framagit    |           12134
 debian      |           23757
 gitlab      |          964329
(9 rows)
ardumont updated the task description. (Show Details)Sun, Jun 30, 11:16 AM
ardumont updated the task description. (Show Details)Sun, Jun 30, 11:18 AM
ardumont updated the task description. (Show Details)Mon, Jul 1, 3:29 PM
ardumont updated the task description. (Show Details)
ardumont updated the task description. (Show Details)Mon, Jul 1, 3:32 PM