Page MenuHomeSoftware Heritage

staging: ingest openbsd.org cvs forge
Closed, MigratedEdits Locked

Description

Event Timeline

vsellier changed the task status from Open to Work in Progress.Oct 12 2022, 11:36 AM
vsellier triaged this task as Normal priority.
vsellier created this task.

Manual loading in progress:

  • pod created with P1494
  • manual loading:
swh@loader-cvs-manual:~$ swh --log-level=DEBUG loader run cvs rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src
DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7ff49a095f30>
DEBUG:swh.core.config:Loading config file /etc/swh/config.yml
DEBUG:swh.loader.cli:config_file: /etc/swh/config.yml
DEBUG:swh.loader.cli:config:
DEBUG:swh.loader.cli:kw: {}
DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.cvs.tasks'], 'loader': <class 'swh.loader.cvs.loader.CvsLoader'>}
DEBUG:swh.loader.cli:loader class: <class 'swh.loader.cvs.loader.CvsLoader'>
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1
DEBUG:swh.loader.cvs.loader.CvsLoader:PID 30 is live, skipping
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/add_multi HTTP/1.1" 200 13
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/add HTTP/1.1" 200 128
INFO:swh.loader.cvs.loader.CvsLoader:Load origin 'rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src' with type 'cvs'
DEBUG:swh.loader.cvs.loader.CvsLoader:lister_not provided, skipping extrinsic origin metadata
DEBUG:swh.loader.cvs.loader.CvsLoader:prepare; origin_url=rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src scheme=rsync path=/openbsd-cvs/src
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x            512 2019/11/10 13:00:01 .
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x          2,560 2022/10/12 08:00:07 CVSROOT
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x          1,536 2022/10/12 01:12:59 ports
DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x            512 2022/09/27 04:05:27 src
...
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/missing HTTP/1.1" 200 3641
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/add HTTP/1.1" 200 37
DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/missing HTTP/1.1" 200 11223
...

loading is in progress