Page MenuHomeSoftware Heritage

initial CVS loader stub
Changes PlannedPublicDraft

Authored by stsp on Mon, Jul 12, 6:38 PM.

Details

Summary

Add 'swh/loader/cvs/cvs2gitdump/'

Obtained from commit 301a72682d92b11d809eb7476a21ac354b826beb of
repository https://github.com/yasuoka/cvs2gitdump

Add 'swh/loader/cvs/rcsparse/'

Obtained from commit 206bca0b90f5780815c0b6c6cbccfd03f27f6985 of
repository https://github.com/corecode/rcsparse

rcsparse python3 support patches from OpenBSD ports

https://cvsweb.openbsd.org/cgi-bin/cvsweb/ports/devel/py-rcsparse/patches/
$OpenBSD: patch-py-rcsparse_c,v 1.4 2021/02/18 03:35:07 yasuoka Exp $
$OpenBSD: patch-testmodule_py,v 1.2 2021/02/18 03:35:07 yasuoka Exp $

compile rcsparse extension

remove the 'foo' module and references to it

rcsparse: add missing allocation failure check in parsetoken()

add stub for an initial test

remove bogus import

get the 'prepare' step working

force our local rcsparse dependency; upstream does not yet support py3

get fetch_data working

populate a work tree with files checked out from the repository

ignore ENOENT when removing files

create subdirectories in the work tree

document fetch_data() method

add converted CVS revisions to storage

the trivial first visit test is passing now

enable check_snapshot() in test_loader_cvs_visit()

test two consecutive visits

fix rsync URL processing in fetch_cvs_repo_with_rsync()

The last path component of the URL corresponds to the CVS module name,
and the CVSROOT directory is expected to be a path-wise sibling of
this module.

do not call self.storage.revision_get() more often than necessary

use an iterator to process swh revisions; reduces memory usage

change logging level of per-revision info from DEBUG to INFO

link revisions to their parents and add another small test

remove unused CvsLoader class members and constructor arguments

drop support for using previous snapshots as base for new ones

replace global self.rcs variable with use of local variables

cvs2gitdump: avoid parsing rcs files inside expand_keyword()

avoid double-parsing of rcsfiles while processing a changeset

copy over the pre_cleanup() handler from the SVN loader

remove unused imports

simply assign to empty lists in order to clear per-changeset data

switch log level of an informative progress message from debug to info

add test case doing an incremental visit

implement support for import via cvs pserver protocol

remove unused keyword parameter to fix loading of the cvs loader

update README

document how tests can be run

the loader expects a URL argument

Diff Detail

Repository
rDLDCVS CVS Loader
Branch
master
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 22607
Build 35238: Phabricator diff pipeline on jenkinsJenkins console · Jenkins
Build 35237: arc lint + arc unit

Event Timeline

Harbormaster returned this revision to the author for changes because remote builds failed.Mon, Jul 12, 6:38 PM
Harbormaster failed remote builds in B22585: Diff 21609!
  • update README
  • committing reformatting which was performed by pre-commit hooks
  • exclude upstream python code from pre-commit checks
  • urllib doesn't have stubs for mypy
  • fix myphy errors on swh/loader/__init__.py
  • wrap overlong lines
  • commit reformatting performed by pre-commit hook on setup.py
  • fix format string error found by pre-commit hook
  • the pre-commit hook complained about an unused rcsfile variable
  • fix 'ssh' protocol support

Build has FAILED

Patch application report for D5988 (id=21633)

Rebasing onto 29bd1ed54e...

Current branch diff-target is up to date.
Changes applied before test
commit 50ae8b09e12e5f4e40430b7f4ff15393e2be0a81
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:47:26 2021 +0200

    fix 'ssh' protocol support

commit d125c5c7b0f07ddf8d495d63fdc226eb57450ee6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:24 2021 +0200

    the pre-commit hook complained about an unused rcsfile variable

commit b2fb227a2cf61ecdf6b257c92b922c5cd8eec93b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:00 2021 +0200

    fix format string error found by pre-commit hook

commit 6548f6ca45dd98fdf9cf56e12fd5e7c904867359
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:40:11 2021 +0200

    commit reformatting performed by pre-commit hook on setup.py

commit 82e8d797cf0a916ada22172562bcbb122846b0f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:14:50 2021 +0200

    wrap overlong lines

commit c479b0e260068157abce5a98b1b49300c036c981
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:11:42 2021 +0200

    fix myphy errors on swh/loader/__init__.py

commit 98082f20e7e52256531b0b097f22bd8e149d64bc
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:10:48 2021 +0200

    urllib doesn't have stubs for mypy

commit 0e1e757565ac3f47e2cce72bb5538eac98a85ff7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:55:21 2021 +0200

    exclude upstream python code from pre-commit checks

commit 5e3904dd50ab76cf7383254bce1eb5c2fff96812
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:27:37 2021 +0200

    committing reformatting which was performed by pre-commit hooks

commit 07ed9fc946b1ea87e12d02fad36783d1eec38536
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 18:16:50 2021 +0200

    update README

commit c04bb816c7f8ac19a4101f5647b7de0c3f7af4a8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 16:35:01 2021 +0200

    remove unused keyword parameter to fix loading of the cvs loader

commit ba728189a3c5160c4fec39d347a13a9d676d8373
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    implement support for import via cvs pserver protocol

commit e7ba43fd93cb72ca44168317b394ebfa9076b902
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add test case doing an incremental visit

commit 4ddc08250622718702358afdcdd89edcb69f2dc8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    switch log level of an informative progress message from debug to info

commit 1eaaa52b054cd4a5411952f46054c7fccab5b64f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    simply assign to empty lists in order to clear per-changeset data

commit c721a06cb62b769b7493bd5d41d08ce7391fe784
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused imports

commit 76c249b4a8c35a3b98cd47d7e1fa7c93dcb439f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    copy over the pre_cleanup() handler from the SVN loader

commit 250bb9dbba27850ba3d16ddba10d7078063dab16
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    avoid double-parsing of rcsfiles while processing a changeset

commit 89d7b0fdd2ef1b16e5c0cbd1c83689dd9eaea623
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    cvs2gitdump: avoid parsing rcs files inside expand_keyword()

commit 092b5263f936afeb741204f7d5bc8ade69fa474b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    replace global self.rcs variable with use of local variables

commit 551a12e24cb8f5aecc1f9b0b194a7758ca041ee2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    drop support for using previous snapshots as base for new ones

commit 0424433458bd10f5d14f1bc3cc1a4ae65bb38418
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused CvsLoader class members and constructor arguments

commit cf5cf4594d05526ea872faacfa104b1d32e784b5
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    link revisions to their parents and add another small test

commit 71f22dbe195fccc9614cbd126dfcfb8f488bc0fa
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    change logging level of per-revision info from DEBUG to INFO

commit 5097bf8eaab1f583a9810dbffecabbe2146fffe6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    use an iterator to process swh revisions; reduces memory usage

commit ed460a3280fe85366581fe4ac6601cc6eb4be99e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    do not call self.storage.revision_get() more often than necessary

commit edc28c2159553bb51d5355acd903888ea120a751
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    fix rsync URL processing in fetch_cvs_repo_with_rsync()
    
    The last path component of the URL corresponds to the CVS module name,
    and the CVSROOT directory is expected to be a path-wise sibling of
    this module.

commit ae77fa16184141721d94216b024597e05dd40849
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    test two consecutive visits

commit cdbcdcc92e619be7f2f5617b35da2c6b760adb5c
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    enable check_snapshot() in test_loader_cvs_visit()

commit 496ff263546a1f037a39a9f069475a5b8787a8f2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    the trivial first visit test is passing now

commit 358a05d59956491240cccaa06fcc17db7d0e3015
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add converted CVS revisions to storage

commit 59a7ff18d6030d691ad9dd61607d7711d55c531f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    document fetch_data() method

commit 49ce9a24d6f93e20c911684826b8c625314c3020
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    create subdirectories in the work tree

commit 6a2f6e50f61e353429ed3018a3de62d0c3046147
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    ignore ENOENT when removing files

commit af30f67f740345e2d85a900c43f47690915b5b6b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    populate a work tree with files checked out from the repository

commit 799eea5a7b6830c5a38c900fdf9b1d88ccb958f4
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get fetch_data working

commit 15252a6ce822cb78a5da37745459dcd08f6e9279
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    force our local rcsparse dependency; upstream does not yet support py3

commit 605d8f5862b81a47a99db7180652fe9d2898a0e1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get the 'prepare' step working

commit 757ce82f02eba97703b7a94f44c8dfad4ce78b8e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove bogus import

commit 28cad58a0f325b977d6c2a0e3079cb74df34cad7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add stub for an initial test

commit 9dec8a2e4fdc2be70d41c992190e75fc5afa8662
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse: add missing allocation failure check in parsetoken()

commit aaec7d33bf74a83eaefaaecc914731bcbf9a1957
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 14:51:43 2021 +0200

    remove the 'foo' module and references to it

commit ecf402cf624994da6aeb21539c0dbb1efcccb57e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    compile rcsparse extension

commit 9e3170f81c2b5a7cfc93abf3358fd5e505dcc133
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse python3 support patches from OpenBSD ports
    
    https://cvsweb.openbsd.org/cgi-bin/cvsweb/ports/devel/py-rcsparse/patches/
    $OpenBSD: patch-py-rcsparse_c,v 1.4 2021/02/18 03:35:07 yasuoka Exp $
    $OpenBSD: patch-testmodule_py,v 1.2 2021/02/18 03:35:07 yasuoka Exp $

commit 75fe9f5ea285a31b234983011743bde3d10c4c97
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/rcsparse/'
    
    Obtained from commit 206bca0b90f5780815c0b6c6cbccfd03f27f6985 of
    repository https://github.com/corecode/rcsparse

commit bb436217774344e00c57bb927491af5d02526776
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/cvs2gitdump/'
    
    Obtained from commit 301a72682d92b11d809eb7476a21ac354b826beb of
    repository https://github.com/yasuoka/cvs2gitdump

commit 65995f14b4c658e3113380688f1c97ed67f22008
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    initial CVS loader stub

Link to build: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/4/
See console output for more information: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/4/console

Harbormaster returned this revision to the author for changes because remote builds failed.Wed, Jul 14, 10:54 AM
Harbormaster failed remote builds in B22605: Diff 21633!

exclude third-party sources via mypy.ini, not pre-commit conf

Build has FAILED

Patch application report for D5988 (id=21634)

Rebasing onto 29bd1ed54e...

Current branch diff-target is up to date.
Changes applied before test
commit 6840a81314dbac2604473c8d18b13f8713672e4d
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 13:34:50 2021 +0200

    exclude third-party sources via mypy.ini, not pre-commit conf

commit 50ae8b09e12e5f4e40430b7f4ff15393e2be0a81
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:47:26 2021 +0200

    fix 'ssh' protocol support

commit d125c5c7b0f07ddf8d495d63fdc226eb57450ee6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:24 2021 +0200

    the pre-commit hook complained about an unused rcsfile variable

commit b2fb227a2cf61ecdf6b257c92b922c5cd8eec93b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:00 2021 +0200

    fix format string error found by pre-commit hook

commit 6548f6ca45dd98fdf9cf56e12fd5e7c904867359
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:40:11 2021 +0200

    commit reformatting performed by pre-commit hook on setup.py

commit 82e8d797cf0a916ada22172562bcbb122846b0f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:14:50 2021 +0200

    wrap overlong lines

commit c479b0e260068157abce5a98b1b49300c036c981
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:11:42 2021 +0200

    fix myphy errors on swh/loader/__init__.py

commit 98082f20e7e52256531b0b097f22bd8e149d64bc
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:10:48 2021 +0200

    urllib doesn't have stubs for mypy

commit 0e1e757565ac3f47e2cce72bb5538eac98a85ff7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:55:21 2021 +0200

    exclude upstream python code from pre-commit checks

commit 5e3904dd50ab76cf7383254bce1eb5c2fff96812
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:27:37 2021 +0200

    committing reformatting which was performed by pre-commit hooks

commit 07ed9fc946b1ea87e12d02fad36783d1eec38536
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 18:16:50 2021 +0200

    update README

commit c04bb816c7f8ac19a4101f5647b7de0c3f7af4a8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 16:35:01 2021 +0200

    remove unused keyword parameter to fix loading of the cvs loader

commit ba728189a3c5160c4fec39d347a13a9d676d8373
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    implement support for import via cvs pserver protocol

commit e7ba43fd93cb72ca44168317b394ebfa9076b902
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add test case doing an incremental visit

commit 4ddc08250622718702358afdcdd89edcb69f2dc8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    switch log level of an informative progress message from debug to info

commit 1eaaa52b054cd4a5411952f46054c7fccab5b64f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    simply assign to empty lists in order to clear per-changeset data

commit c721a06cb62b769b7493bd5d41d08ce7391fe784
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused imports

commit 76c249b4a8c35a3b98cd47d7e1fa7c93dcb439f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    copy over the pre_cleanup() handler from the SVN loader

commit 250bb9dbba27850ba3d16ddba10d7078063dab16
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    avoid double-parsing of rcsfiles while processing a changeset

commit 89d7b0fdd2ef1b16e5c0cbd1c83689dd9eaea623
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    cvs2gitdump: avoid parsing rcs files inside expand_keyword()

commit 092b5263f936afeb741204f7d5bc8ade69fa474b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    replace global self.rcs variable with use of local variables

commit 551a12e24cb8f5aecc1f9b0b194a7758ca041ee2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    drop support for using previous snapshots as base for new ones

commit 0424433458bd10f5d14f1bc3cc1a4ae65bb38418
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused CvsLoader class members and constructor arguments

commit cf5cf4594d05526ea872faacfa104b1d32e784b5
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    link revisions to their parents and add another small test

commit 71f22dbe195fccc9614cbd126dfcfb8f488bc0fa
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    change logging level of per-revision info from DEBUG to INFO

commit 5097bf8eaab1f583a9810dbffecabbe2146fffe6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    use an iterator to process swh revisions; reduces memory usage

commit ed460a3280fe85366581fe4ac6601cc6eb4be99e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    do not call self.storage.revision_get() more often than necessary

commit edc28c2159553bb51d5355acd903888ea120a751
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    fix rsync URL processing in fetch_cvs_repo_with_rsync()
    
    The last path component of the URL corresponds to the CVS module name,
    and the CVSROOT directory is expected to be a path-wise sibling of
    this module.

commit ae77fa16184141721d94216b024597e05dd40849
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    test two consecutive visits

commit cdbcdcc92e619be7f2f5617b35da2c6b760adb5c
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    enable check_snapshot() in test_loader_cvs_visit()

commit 496ff263546a1f037a39a9f069475a5b8787a8f2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    the trivial first visit test is passing now

commit 358a05d59956491240cccaa06fcc17db7d0e3015
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add converted CVS revisions to storage

commit 59a7ff18d6030d691ad9dd61607d7711d55c531f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    document fetch_data() method

commit 49ce9a24d6f93e20c911684826b8c625314c3020
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    create subdirectories in the work tree

commit 6a2f6e50f61e353429ed3018a3de62d0c3046147
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    ignore ENOENT when removing files

commit af30f67f740345e2d85a900c43f47690915b5b6b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    populate a work tree with files checked out from the repository

commit 799eea5a7b6830c5a38c900fdf9b1d88ccb958f4
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get fetch_data working

commit 15252a6ce822cb78a5da37745459dcd08f6e9279
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    force our local rcsparse dependency; upstream does not yet support py3

commit 605d8f5862b81a47a99db7180652fe9d2898a0e1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get the 'prepare' step working

commit 757ce82f02eba97703b7a94f44c8dfad4ce78b8e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove bogus import

commit 28cad58a0f325b977d6c2a0e3079cb74df34cad7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add stub for an initial test

commit 9dec8a2e4fdc2be70d41c992190e75fc5afa8662
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse: add missing allocation failure check in parsetoken()

commit aaec7d33bf74a83eaefaaecc914731bcbf9a1957
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 14:51:43 2021 +0200

    remove the 'foo' module and references to it

commit ecf402cf624994da6aeb21539c0dbb1efcccb57e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    compile rcsparse extension

commit 9e3170f81c2b5a7cfc93abf3358fd5e505dcc133
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse python3 support patches from OpenBSD ports
    
    https://cvsweb.openbsd.org/cgi-bin/cvsweb/ports/devel/py-rcsparse/patches/
    $OpenBSD: patch-py-rcsparse_c,v 1.4 2021/02/18 03:35:07 yasuoka Exp $
    $OpenBSD: patch-testmodule_py,v 1.2 2021/02/18 03:35:07 yasuoka Exp $

commit 75fe9f5ea285a31b234983011743bde3d10c4c97
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/rcsparse/'
    
    Obtained from commit 206bca0b90f5780815c0b6c6cbccfd03f27f6985 of
    repository https://github.com/corecode/rcsparse

commit bb436217774344e00c57bb927491af5d02526776
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/cvs2gitdump/'
    
    Obtained from commit 301a72682d92b11d809eb7476a21ac354b826beb of
    repository https://github.com/yasuoka/cvs2gitdump

commit 65995f14b4c658e3113380688f1c97ed67f22008
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    initial CVS loader stub

Link to build: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/5/
See console output for more information: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/5/console

Harbormaster returned this revision to the author for changes because remote builds failed.Wed, Jul 14, 1:39 PM
Harbormaster failed remote builds in B22606: Diff 21634!
  • exclude third-party sources via mypy.ini, not pre-commit conf
  • exclude third-party sources from flake8 checks
  • commit reformatting of rlog.py done by pre-commit hook
  • Remove an unused import.
  • acknowledge code derived from ViewVC in our README file

Build has FAILED

Patch application report for D5988 (id=21635)

Rebasing onto 29bd1ed54e...

Current branch diff-target is up to date.
Changes applied before test
commit 0fe0e68f29c289743d62bef01c87ccc3d5435212
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 17:06:59 2021 +0200

    acknowledge code derived from ViewVC in our README file

commit 2a4b87f9999f6c71a6bd2e212835be8bea414637
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 16:33:04 2021 +0200

    Remove an unused import.
    
    The pre-commit hook decided to reformat of the line again after
    it was shortened. Apply this reformatting change, too.

commit 4e65e78bf0638f92e18b3530ed7b5540a076a134
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 16:24:40 2021 +0200

    commit reformatting of rlog.py done by pre-commit hook
    
    This file contains a mix of our own code and some code inherited from ViewVC.
    Parts derived from ViewVC now no longer match formatting used by upstream.
    But automatic merges from upstream were already impossible anyway.

commit ff50851e8183098a1ab33f7118c355e0c5484928
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 14:56:38 2021 +0200

    exclude third-party sources from flake8 checks

commit 0872e9e61663dd71727866d0b41f1d458aa92bf8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 13:34:50 2021 +0200

    exclude third-party sources via mypy.ini, not pre-commit conf

commit 50ae8b09e12e5f4e40430b7f4ff15393e2be0a81
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:47:26 2021 +0200

    fix 'ssh' protocol support

commit d125c5c7b0f07ddf8d495d63fdc226eb57450ee6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:24 2021 +0200

    the pre-commit hook complained about an unused rcsfile variable

commit b2fb227a2cf61ecdf6b257c92b922c5cd8eec93b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:00 2021 +0200

    fix format string error found by pre-commit hook

commit 6548f6ca45dd98fdf9cf56e12fd5e7c904867359
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:40:11 2021 +0200

    commit reformatting performed by pre-commit hook on setup.py

commit 82e8d797cf0a916ada22172562bcbb122846b0f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:14:50 2021 +0200

    wrap overlong lines

commit c479b0e260068157abce5a98b1b49300c036c981
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:11:42 2021 +0200

    fix myphy errors on swh/loader/__init__.py

commit 98082f20e7e52256531b0b097f22bd8e149d64bc
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:10:48 2021 +0200

    urllib doesn't have stubs for mypy

commit 0e1e757565ac3f47e2cce72bb5538eac98a85ff7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:55:21 2021 +0200

    exclude upstream python code from pre-commit checks

commit 5e3904dd50ab76cf7383254bce1eb5c2fff96812
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:27:37 2021 +0200

    committing reformatting which was performed by pre-commit hooks

commit 07ed9fc946b1ea87e12d02fad36783d1eec38536
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 18:16:50 2021 +0200

    update README

commit c04bb816c7f8ac19a4101f5647b7de0c3f7af4a8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 16:35:01 2021 +0200

    remove unused keyword parameter to fix loading of the cvs loader

commit ba728189a3c5160c4fec39d347a13a9d676d8373
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    implement support for import via cvs pserver protocol

commit e7ba43fd93cb72ca44168317b394ebfa9076b902
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add test case doing an incremental visit

commit 4ddc08250622718702358afdcdd89edcb69f2dc8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    switch log level of an informative progress message from debug to info

commit 1eaaa52b054cd4a5411952f46054c7fccab5b64f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    simply assign to empty lists in order to clear per-changeset data

commit c721a06cb62b769b7493bd5d41d08ce7391fe784
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused imports

commit 76c249b4a8c35a3b98cd47d7e1fa7c93dcb439f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    copy over the pre_cleanup() handler from the SVN loader

commit 250bb9dbba27850ba3d16ddba10d7078063dab16
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    avoid double-parsing of rcsfiles while processing a changeset

commit 89d7b0fdd2ef1b16e5c0cbd1c83689dd9eaea623
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    cvs2gitdump: avoid parsing rcs files inside expand_keyword()

commit 092b5263f936afeb741204f7d5bc8ade69fa474b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    replace global self.rcs variable with use of local variables

commit 551a12e24cb8f5aecc1f9b0b194a7758ca041ee2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    drop support for using previous snapshots as base for new ones

commit 0424433458bd10f5d14f1bc3cc1a4ae65bb38418
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused CvsLoader class members and constructor arguments

commit cf5cf4594d05526ea872faacfa104b1d32e784b5
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    link revisions to their parents and add another small test

commit 71f22dbe195fccc9614cbd126dfcfb8f488bc0fa
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    change logging level of per-revision info from DEBUG to INFO

commit 5097bf8eaab1f583a9810dbffecabbe2146fffe6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    use an iterator to process swh revisions; reduces memory usage

commit ed460a3280fe85366581fe4ac6601cc6eb4be99e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    do not call self.storage.revision_get() more often than necessary

commit edc28c2159553bb51d5355acd903888ea120a751
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    fix rsync URL processing in fetch_cvs_repo_with_rsync()
    
    The last path component of the URL corresponds to the CVS module name,
    and the CVSROOT directory is expected to be a path-wise sibling of
    this module.

commit ae77fa16184141721d94216b024597e05dd40849
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    test two consecutive visits

commit cdbcdcc92e619be7f2f5617b35da2c6b760adb5c
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    enable check_snapshot() in test_loader_cvs_visit()

commit 496ff263546a1f037a39a9f069475a5b8787a8f2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    the trivial first visit test is passing now

commit 358a05d59956491240cccaa06fcc17db7d0e3015
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add converted CVS revisions to storage

commit 59a7ff18d6030d691ad9dd61607d7711d55c531f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    document fetch_data() method

commit 49ce9a24d6f93e20c911684826b8c625314c3020
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    create subdirectories in the work tree

commit 6a2f6e50f61e353429ed3018a3de62d0c3046147
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    ignore ENOENT when removing files

commit af30f67f740345e2d85a900c43f47690915b5b6b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    populate a work tree with files checked out from the repository

commit 799eea5a7b6830c5a38c900fdf9b1d88ccb958f4
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get fetch_data working

commit 15252a6ce822cb78a5da37745459dcd08f6e9279
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    force our local rcsparse dependency; upstream does not yet support py3

commit 605d8f5862b81a47a99db7180652fe9d2898a0e1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get the 'prepare' step working

commit 757ce82f02eba97703b7a94f44c8dfad4ce78b8e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove bogus import

commit 28cad58a0f325b977d6c2a0e3079cb74df34cad7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add stub for an initial test

commit 9dec8a2e4fdc2be70d41c992190e75fc5afa8662
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse: add missing allocation failure check in parsetoken()

commit aaec7d33bf74a83eaefaaecc914731bcbf9a1957
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 14:51:43 2021 +0200

    remove the 'foo' module and references to it

commit ecf402cf624994da6aeb21539c0dbb1efcccb57e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    compile rcsparse extension

commit 9e3170f81c2b5a7cfc93abf3358fd5e505dcc133
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse python3 support patches from OpenBSD ports
    
    https://cvsweb.openbsd.org/cgi-bin/cvsweb/ports/devel/py-rcsparse/patches/
    $OpenBSD: patch-py-rcsparse_c,v 1.4 2021/02/18 03:35:07 yasuoka Exp $
    $OpenBSD: patch-testmodule_py,v 1.2 2021/02/18 03:35:07 yasuoka Exp $

commit 75fe9f5ea285a31b234983011743bde3d10c4c97
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/rcsparse/'
    
    Obtained from commit 206bca0b90f5780815c0b6c6cbccfd03f27f6985 of
    repository https://github.com/corecode/rcsparse

commit bb436217774344e00c57bb927491af5d02526776
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/cvs2gitdump/'
    
    Obtained from commit 301a72682d92b11d809eb7476a21ac354b826beb of
    repository https://github.com/yasuoka/cvs2gitdump

commit 65995f14b4c658e3113380688f1c97ed67f22008
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    initial CVS loader stub

Link to build: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/6/
See console output for more information: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/6/console

Harbormaster returned this revision to the author for changes because remote builds failed.Wed, Jul 14, 5:08 PM
Harbormaster failed remote builds in B22607: Diff 21635!

Build has FAILED

Patch application report for D5988 (id=21635)

Rebasing onto 29bd1ed54e...

Current branch diff-target is up to date.
Changes applied before test
commit 0fe0e68f29c289743d62bef01c87ccc3d5435212
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 17:06:59 2021 +0200

    acknowledge code derived from ViewVC in our README file

commit 2a4b87f9999f6c71a6bd2e212835be8bea414637
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 16:33:04 2021 +0200

    Remove an unused import.
    
    The pre-commit hook decided to reformat of the line again after
    it was shortened. Apply this reformatting change, too.

commit 4e65e78bf0638f92e18b3530ed7b5540a076a134
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 16:24:40 2021 +0200

    commit reformatting of rlog.py done by pre-commit hook
    
    This file contains a mix of our own code and some code inherited from ViewVC.
    Parts derived from ViewVC now no longer match formatting used by upstream.
    But automatic merges from upstream were already impossible anyway.

commit ff50851e8183098a1ab33f7118c355e0c5484928
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 14:56:38 2021 +0200

    exclude third-party sources from flake8 checks

commit 0872e9e61663dd71727866d0b41f1d458aa92bf8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 13:34:50 2021 +0200

    exclude third-party sources via mypy.ini, not pre-commit conf

commit 50ae8b09e12e5f4e40430b7f4ff15393e2be0a81
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:47:26 2021 +0200

    fix 'ssh' protocol support

commit d125c5c7b0f07ddf8d495d63fdc226eb57450ee6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:24 2021 +0200

    the pre-commit hook complained about an unused rcsfile variable

commit b2fb227a2cf61ecdf6b257c92b922c5cd8eec93b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:41:00 2021 +0200

    fix format string error found by pre-commit hook

commit 6548f6ca45dd98fdf9cf56e12fd5e7c904867359
Author: Stefan Sperling <stsp@stsp.name>
Date:   Wed Jul 14 10:40:11 2021 +0200

    commit reformatting performed by pre-commit hook on setup.py

commit 82e8d797cf0a916ada22172562bcbb122846b0f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:14:50 2021 +0200

    wrap overlong lines

commit c479b0e260068157abce5a98b1b49300c036c981
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:11:42 2021 +0200

    fix myphy errors on swh/loader/__init__.py

commit 98082f20e7e52256531b0b097f22bd8e149d64bc
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 17:10:48 2021 +0200

    urllib doesn't have stubs for mypy

commit 0e1e757565ac3f47e2cce72bb5538eac98a85ff7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:55:21 2021 +0200

    exclude upstream python code from pre-commit checks

commit 5e3904dd50ab76cf7383254bce1eb5c2fff96812
Author: Stefan Sperling <stsp@stsp.name>
Date:   Tue Jul 13 16:27:37 2021 +0200

    committing reformatting which was performed by pre-commit hooks

commit 07ed9fc946b1ea87e12d02fad36783d1eec38536
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 18:16:50 2021 +0200

    update README

commit c04bb816c7f8ac19a4101f5647b7de0c3f7af4a8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 12 16:35:01 2021 +0200

    remove unused keyword parameter to fix loading of the cvs loader

commit ba728189a3c5160c4fec39d347a13a9d676d8373
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    implement support for import via cvs pserver protocol

commit e7ba43fd93cb72ca44168317b394ebfa9076b902
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add test case doing an incremental visit

commit 4ddc08250622718702358afdcdd89edcb69f2dc8
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    switch log level of an informative progress message from debug to info

commit 1eaaa52b054cd4a5411952f46054c7fccab5b64f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    simply assign to empty lists in order to clear per-changeset data

commit c721a06cb62b769b7493bd5d41d08ce7391fe784
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused imports

commit 76c249b4a8c35a3b98cd47d7e1fa7c93dcb439f1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    copy over the pre_cleanup() handler from the SVN loader

commit 250bb9dbba27850ba3d16ddba10d7078063dab16
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    avoid double-parsing of rcsfiles while processing a changeset

commit 89d7b0fdd2ef1b16e5c0cbd1c83689dd9eaea623
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    cvs2gitdump: avoid parsing rcs files inside expand_keyword()

commit 092b5263f936afeb741204f7d5bc8ade69fa474b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    replace global self.rcs variable with use of local variables

commit 551a12e24cb8f5aecc1f9b0b194a7758ca041ee2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    drop support for using previous snapshots as base for new ones

commit 0424433458bd10f5d14f1bc3cc1a4ae65bb38418
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove unused CvsLoader class members and constructor arguments

commit cf5cf4594d05526ea872faacfa104b1d32e784b5
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    link revisions to their parents and add another small test

commit 71f22dbe195fccc9614cbd126dfcfb8f488bc0fa
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    change logging level of per-revision info from DEBUG to INFO

commit 5097bf8eaab1f583a9810dbffecabbe2146fffe6
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    use an iterator to process swh revisions; reduces memory usage

commit ed460a3280fe85366581fe4ac6601cc6eb4be99e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    do not call self.storage.revision_get() more often than necessary

commit edc28c2159553bb51d5355acd903888ea120a751
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    fix rsync URL processing in fetch_cvs_repo_with_rsync()
    
    The last path component of the URL corresponds to the CVS module name,
    and the CVSROOT directory is expected to be a path-wise sibling of
    this module.

commit ae77fa16184141721d94216b024597e05dd40849
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    test two consecutive visits

commit cdbcdcc92e619be7f2f5617b35da2c6b760adb5c
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    enable check_snapshot() in test_loader_cvs_visit()

commit 496ff263546a1f037a39a9f069475a5b8787a8f2
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    the trivial first visit test is passing now

commit 358a05d59956491240cccaa06fcc17db7d0e3015
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add converted CVS revisions to storage

commit 59a7ff18d6030d691ad9dd61607d7711d55c531f
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    document fetch_data() method

commit 49ce9a24d6f93e20c911684826b8c625314c3020
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    create subdirectories in the work tree

commit 6a2f6e50f61e353429ed3018a3de62d0c3046147
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    ignore ENOENT when removing files

commit af30f67f740345e2d85a900c43f47690915b5b6b
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    populate a work tree with files checked out from the repository

commit 799eea5a7b6830c5a38c900fdf9b1d88ccb958f4
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get fetch_data working

commit 15252a6ce822cb78a5da37745459dcd08f6e9279
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    force our local rcsparse dependency; upstream does not yet support py3

commit 605d8f5862b81a47a99db7180652fe9d2898a0e1
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    get the 'prepare' step working

commit 757ce82f02eba97703b7a94f44c8dfad4ce78b8e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    remove bogus import

commit 28cad58a0f325b977d6c2a0e3079cb74df34cad7
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    add stub for an initial test

commit 9dec8a2e4fdc2be70d41c992190e75fc5afa8662
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse: add missing allocation failure check in parsetoken()

commit aaec7d33bf74a83eaefaaecc914731bcbf9a1957
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 14:51:43 2021 +0200

    remove the 'foo' module and references to it

commit ecf402cf624994da6aeb21539c0dbb1efcccb57e
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    compile rcsparse extension

commit 9e3170f81c2b5a7cfc93abf3358fd5e505dcc133
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    rcsparse python3 support patches from OpenBSD ports
    
    https://cvsweb.openbsd.org/cgi-bin/cvsweb/ports/devel/py-rcsparse/patches/
    $OpenBSD: patch-py-rcsparse_c,v 1.4 2021/02/18 03:35:07 yasuoka Exp $
    $OpenBSD: patch-testmodule_py,v 1.2 2021/02/18 03:35:07 yasuoka Exp $

commit 75fe9f5ea285a31b234983011743bde3d10c4c97
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/rcsparse/'
    
    Obtained from commit 206bca0b90f5780815c0b6c6cbccfd03f27f6985 of
    repository https://github.com/corecode/rcsparse

commit bb436217774344e00c57bb927491af5d02526776
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    Add 'swh/loader/cvs/cvs2gitdump/'
    
    Obtained from commit 301a72682d92b11d809eb7476a21ac354b826beb of
    repository https://github.com/yasuoka/cvs2gitdump

commit 65995f14b4c658e3113380688f1c97ed67f22008
Author: Stefan Sperling <stsp@stsp.name>
Date:   Mon Jul 5 13:41:49 2021 +0200

    initial CVS loader stub

Link to build: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/7/
See console output for more information: https://jenkins.softwareheritage.org/job/DLDCVS/job/tests-on-diff/7/console