Page MenuHomeSoftware Heritage

svn.loader: Migrate away from SWHConfig mixin
ClosedPublic

Authored by ardumont on Oct 2 2020, 10:24 AM.

Details

Summary

Related to T1532
Related to T1410
Related to D3965

Test Plan

tox

and

docker run (with docker-compose.override.yml):

time doco exec swh-loader swh loader run svn svn://scm.gforge.inria.fr/svnroot/fdf/
INFO:swh.loader.svn.SvnLoader:Load origin 'svn://scm.gforge.inria.fr/svnroot/fdf/' with type 'svn'
INFO:swh.loader.svn.SvnLoader:Processing revisions [1-922] for {'swh-origin': 'svn://scm.gforge.inria.fr/svnroot/fdf/', 'remote_url': 'svn://scm.gforge.inria.fr/svnroot/fdf', 'local_url': b'/tmp/swh.loader.svn.gytutrft-204/fdf', 'uuid': b'0491c1f1-070f-0410-b5d3-808586ddf757'}
{'status': 'eventful'}
docker-compose exec swh-loader swh loader run svn   0.58s user 0.48s system 0% cpu 4:29.62 total

Diff Detail

Event Timeline

swh/loader/svn/tests/conftest.py
36

Those are defaults from the core loader, so to actually demonstrate it works, i've removed them...

Build is green

Patch application report for D4126 (id=14530)

Rebasing onto 47b03e1959...

Current branch diff-target is up to date.
Changes applied before test
commit 5110b149ed8cfb22c785dced39bd54935573ba9e
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Fri Oct 2 10:24:31 2020 +0200

    svn.loader: Migrate away from SWHConfig mixin
    
    Related to T1532
    Related to T1410
    Related to D3965

See https://jenkins.softwareheritage.org/job/DLDSVN/job/tests-on-diff/96/ for more details.

vlorentz added inline comments.
swh/loader/svn/loader.py
50

a part of the sentence is missing.

swh/loader/svn/loader.py
50

thanks, we'll probably need to rename this variable...
It's used not for logging in the end but to prevent a clean up of the disk at the end of the svn loading.

So a manual debug on disk can occur...
It's poorly named i think.

Build is green

Patch application report for D4126 (id=14546)

Rebasing onto 47b03e1959...

Current branch diff-target is up to date.
Changes applied before test
commit 87d4a7e22f632c181036455a67bdaf7646779557
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Fri Oct 2 10:24:31 2020 +0200

    svn.loader: Migrate away from SWHConfig mixin
    
    Related to T1532
    Related to T1410
    Related to D3965

See https://jenkins.softwareheritage.org/job/DLDSVN/job/tests-on-diff/97/ for more details.

Build is green

Patch application report for D4126 (id=14546)

Rebasing onto 47b03e1959...

Current branch diff-target is up to date.
Changes applied before test
commit 87d4a7e22f632c181036455a67bdaf7646779557
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Fri Oct 2 10:24:31 2020 +0200

    svn.loader: Migrate away from SWHConfig mixin
    
    Related to T1532
    Related to T1410
    Related to D3965

See https://jenkins.softwareheritage.org/job/DLDSVN/job/tests-on-diff/98/ for more details.

This revision is now accepted and ready to land.Oct 2 2020, 12:36 PM

Build is green

Patch application report for D4126 (id=14546)

Rebasing onto 47b03e1959...

Current branch diff-target is up to date.
Changes applied before test
commit 87d4a7e22f632c181036455a67bdaf7646779557
Author: Antoine R. Dumont (@ardumont) <ardumont@softwareheritage.org>
Date:   Fri Oct 2 10:24:31 2020 +0200

    svn.loader: Migrate away from SWHConfig mixin
    
    Related to T1532
    Related to T1410
    Related to D3965

See https://jenkins.softwareheritage.org/job/DLDSVN/job/tests-on-diff/99/ for more details.