• Is it possible to also list this query I often use to check the status of the ingestion:

for example:
select last_visit_status, count(ovs.url) from origin_visit_stats ovs join listed_origins lo on lo.url = ovs.url and lo.visit_type = ovs.visit_type where lister_id='8d1ebad5-a2dc-482c-9b9b-188665274377' group by last_visit_status;

Just an inline remark but otherwise it's ok.

Update according the review suggestions

migrated to gitlab MR https://gitlab.softwareheritage.org/infra/swh-sysadmin-provisioning/-/merge_requests/88

migrated to https://gitlab.softwareheritage.org/infra/puppet/puppet-swh-site/-/merge_requests/533

Task moved on gitlab: https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4653

task will be handled in gitlab: https://gitlab.softwareheritage.org/infra/sysadm-environment/-/issues/4648

LGTM

thanks, I will try to restart the loading with the patch to see how it behaves

The loading finally failed:

INFO:swh.loader.cvs.loader.CvsLoader:Load origin 'ssh://anoncvs@anoncvs.NetBSD.org:/cvsroot/src' with type 'cvs'
DEBUG:swh.loader.cvs.loader.CvsLoader:lister_not provided, skipping extrinsic origin metadata
DEBUG:swh.loader.cvs.loader.CvsLoader:prepare; origin_url=ssh://anoncvs@anoncvs.NetBSD.org:/cvsroot/src scheme=ssh path=/cvsroot/src
Warning: Permanently added 'anoncvs.netbsd.org,199.233.217.198' (RSA) to the list of known hosts.
DEBUG:swh.loader.cvs.loader.CvsLoader:Fetching CVS rlog from anoncvs.netbsd.org:/cvsroot/src

I've launched the loader on the /src subdirectory, if I follow the cvs loader documentation: https://forge.softwareheritage.org/source/swh-loader-cvs/browse/master/docs/ ,
it should also be launched on the other subdirectories:

The loader got killed after it starts to consume a lot of memory...

Warning: Permanently added 'anoncvs.netbsd.org,199.233.217.198' (RSA) to the list of known hosts.
DEBUG:swh.loader.cvs.loader.CvsLoader:Fetching CVS rlog from anoncvs.netbsd.org:/cvsroot/src
Killed
swh@loader-cvs-manual:~$

Manual loading in progress:

• pod created with P1494
• manual loading:

The first try with a oneshot task failed, the containe was killed:

swhscheduler@scheduler0:~$ swh scheduler --url http://scheduler0.internal.staging.swh.network:5008/ task add load-cvs -p oneshot ssh://anoncvs@anoncvs.NetBSD.org:/cvsroot/src
Created 1 tasks

DNS entry gitlab.softwareheritage.org declared in the dns

• gitlab production instance created:

name: euwest-gitlab-production
internal_ip: 192.168.200.4
public_ip: 20.50.42.230

• private link created: the address of the services exposed in the VPN network will be 192.168.200.5 (prometheus/...)