ingest https://cvsweb.openbsd.org/ forge
Description
Description
| Status | Assigned | Task | ||
|---|---|---|---|---|
| Migrated | gitlab-migration | T2845 Improve Subversion loader and develop CVS loader | ||
| Migrated | gitlab-migration | T3691 Implement CVS loader | ||
| Migrated | gitlab-migration | T4626 staging: ingest openbsd.org cvs forge |
Event Timeline
Comment Actions
Manual loading in progress:
- pod created with P1494
- manual loading:
swh@loader-cvs-manual:~$ swh --log-level=DEBUG loader run cvs rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7ff49a095f30>
DEBUG:swh.core.config:Loading config file /etc/swh/config.yml
DEBUG:swh.loader.cli:config_file: /etc/swh/config.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.cvs.tasks'], 'loader': <class 'swh.loader.cvs.loader.CvsLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.cvs.loader.CvsLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.cvs.loader.CvsLoader:PID 30 is live, skipping
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/add HTTP/1.1" 200 128
INFO:swh.loader.cvs.loader.CvsLoader:Load origin 'rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src' with type 'cvs'
DEBUG:swh.loader.cvs.loader.CvsLoader:lister_not provided, skipping extrinsic origin metadata
DEBUG:swh.loader.cvs.loader.CvsLoader:prepare; origin_url=rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src scheme=rsync path=/openbsd-cvs/src
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 512 2019/11/10 13:00:01 .
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 2,560 2022/10/12 08:00:07 CVSROOT
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 1,536 2022/10/12 01:12:59 ports
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 512 2022/09/27 04:05:27 src
...
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/missing HTTP/1.1" 200 3641
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/add HTTP/1.1" 200 37
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/missing HTTP/1.1" 200 11223
...loading is in progress