Page MenuHomeSoftware Heritage

pip-install-swh-dev: install packages all at once
ClosedPublic

Authored by olasd on May 4 2022, 11:51 AM.

Details

Summary

With recent enough versions of setuptools/setuptools-scm, the pip
dependency resolver is now capable of sorting out our full dependency
tree. We can just install all packages at once (which does the
dependency resolution step once).

To speed up the process even more, inline the few "build" (setup.py)
dependencies to allow disabling build isolation (which creates a new
venv and installs setuptools-scm in it for every single package).

Test Plan

tox -r -e sphinx-dev --notest shows all depepdencies come from files in ../

Diff Detail

Repository
rDDOC Development documentation
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

Build has FAILED

Patch application report for D7736 (id=27976)

Rebasing onto 551fd26636...

Current branch diff-target is up to date.
Changes applied before test
commit f876e3a4692c7cf8cdc23ec3ebbfbe8dd3dd5dad
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed May 4 11:48:52 2022 +0200

    pip-install-swh-dev: install packages all at once
    
    With recent enough versions of setuptools/setuptools-scm, the pip
    dependency resolver is now capable of sorting out our full dependency
    tree. We can just install all packages at once (which does the
    dependency resolution step once).
    
    To speed up the process even more, inline the few "build" (setup.py)
    dependencies to allow disabling build isolation (which creates a new
    venv and installs setuptools-scm in it for every single package).

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/171/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/171/console

Harbormaster returned this revision to the author for changes because remote builds failed.May 4 2022, 11:53 AM
Harbormaster failed remote builds in B29056: Diff 27976!

Build has FAILED

Patch application report for D7736 (id=27976)

Rebasing onto 551fd26636...

Current branch diff-target is up to date.
Changes applied before test
commit f876e3a4692c7cf8cdc23ec3ebbfbe8dd3dd5dad
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed May 4 11:48:52 2022 +0200

    pip-install-swh-dev: install packages all at once
    
    With recent enough versions of setuptools/setuptools-scm, the pip
    dependency resolver is now capable of sorting out our full dependency
    tree. We can just install all packages at once (which does the
    dependency resolution step once).
    
    To speed up the process even more, inline the few "build" (setup.py)
    dependencies to allow disabling build isolation (which creates a new
    venv and installs setuptools-scm in it for every single package).

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/172/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/172/console

Build has FAILED

Patch application report for D7736 (id=27976)

Rebasing onto 551fd26636...

Current branch diff-target is up to date.
Changes applied before test
commit f876e3a4692c7cf8cdc23ec3ebbfbe8dd3dd5dad
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed May 4 11:48:52 2022 +0200

    pip-install-swh-dev: install packages all at once
    
    With recent enough versions of setuptools/setuptools-scm, the pip
    dependency resolver is now capable of sorting out our full dependency
    tree. We can just install all packages at once (which does the
    dependency resolution step once).
    
    To speed up the process even more, inline the few "build" (setup.py)
    dependencies to allow disabling build isolation (which creates a new
    venv and installs setuptools-scm in it for every single package).

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/173/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/173/console

Add missing cffi build-dep for swh.perfecthash

Harbormaster returned this revision to the author for changes because remote builds failed.May 4 2022, 12:37 PM
Harbormaster failed remote builds in B29058: Diff 27977!

Build is green

Patch application report for D7736 (id=27977)

Rebasing onto 551fd26636...

Current branch diff-target is up to date.
Changes applied before test
commit 1441d13d0194673770101a9767684f7775118fe0
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed May 4 11:48:52 2022 +0200

    pip-install-swh-dev: install packages all at once
    
    With recent enough versions of setuptools/setuptools-scm, the pip
    dependency resolver is now capable of sorting out our full dependency
    tree. We can just install all packages at once (which does the
    dependency resolution step once).
    
    To speed up the process even more, inline the few "build" (setup.py)
    dependencies to allow disabling build isolation (which creates a new
    venv and installs setuptools-scm in it for every single package).

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/175/ for more details.

Build has FAILED

Patch application report for D7736 (id=27977)

Rebasing onto 551fd26636...

Current branch diff-target is up to date.
Changes applied before test
commit 1441d13d0194673770101a9767684f7775118fe0
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed May 4 11:48:52 2022 +0200

    pip-install-swh-dev: install packages all at once
    
    With recent enough versions of setuptools/setuptools-scm, the pip
    dependency resolver is now capable of sorting out our full dependency
    tree. We can just install all packages at once (which does the
    dependency resolution step once).
    
    To speed up the process even more, inline the few "build" (setup.py)
    dependencies to allow disabling build isolation (which creates a new
    venv and installs setuptools-scm in it for every single package).

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/176/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/176/console

Build was aborted

Patch application report for D7736 (id=27977)

Rebasing onto 551fd26636...

Current branch diff-target is up to date.
Changes applied before test
commit 1441d13d0194673770101a9767684f7775118fe0
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed May 4 11:48:52 2022 +0200

    pip-install-swh-dev: install packages all at once
    
    With recent enough versions of setuptools/setuptools-scm, the pip
    dependency resolver is now capable of sorting out our full dependency
    tree. We can just install all packages at once (which does the
    dependency resolution step once).
    
    To speed up the process even more, inline the few "build" (setup.py)
    dependencies to allow disabling build isolation (which creates a new
    venv and installs setuptools-scm in it for every single package).

Link to build: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/177/
See console output for more information: https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/177/console

Coalesce some pip install calls

Build is green

Patch application report for D7736 (id=27988)

Rebasing onto 551fd26636...

Current branch diff-target is up to date.
Changes applied before test
commit 722a948a6fc175e97a8a20155a0d92bc836894f3
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Wed May 4 11:48:52 2022 +0200

    pip-install-swh-dev: install packages all at once
    
    With recent enough versions of setuptools/setuptools-scm, the pip
    dependency resolver is now capable of sorting out our full dependency
    tree. We can just install all packages at once (which does the
    dependency resolution step once).
    
    To speed up the process even more, inline the few "build" (setup.py)
    dependencies to allow disabling build isolation (which creates a new
    venv and installs setuptools-scm in it for every single package).

See https://jenkins.softwareheritage.org/job/DDOC/job/build-on-diff/178/ for more details.

olasd requested review of this revision.May 4 2022, 3:30 PM
anlambert added a subscriber: anlambert.

Great, thanks !

This revision is now accepted and ready to land.May 4 2022, 3:37 PM