Page MenuHomeSoftware Heritage

git_bare: Deduplicate object downloads and writes
Needs ReviewPublic

Authored by vlorentz on Fri, Apr 30, 10:24 PM.

Details

Reviewers
None
Group Reviewers
Reviewers

Event Timeline

Build has FAILED

Patch application report for D5658 (id=20211)

Could not rebase; Attempt merge onto f87dd54d5d...

Updating f87dd54..418db8e
Fast-forward
 swh/vault/cli.py                |   2 +-
 swh/vault/cookers/__init__.py   |   3 +
 swh/vault/cookers/base.py       |   6 +-
 swh/vault/cookers/git_bare.py   | 213 ++++++++++++++++++++++++++++++++++++++++
 swh/vault/in_memory_backend.py  |   2 +-
 swh/vault/tests/test_cookers.py | 135 ++++++++++++++++++++-----
 6 files changed, 334 insertions(+), 27 deletions(-)
 create mode 100644 swh/vault/cookers/git_bare.py
Changes applied before test
commit 418db8e87279092125c287a8f2cb528abd5d4619
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri Apr 30 22:22:17 2021 +0200

    git_bare: Deduplicate object downloads and writes

commit c3984d34c2a8cf32ff63595013b64860f1e25054
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri Apr 30 19:30:34 2021 +0200

    Add a naive git bare cooker
    
    It can cook directories (by adding a synthetic revision pointing to it)
    and revisions.
    
    Current limitations:
    
    * It does not deduplicate directories and files at all, and queries
      all objects one by one.
    * No support for missing/absent contents
    * No support for missing submodules
    
    Tests reuse existing tests of the DirectoryCooker and
    RevisionGitfastCooker using parametrized pytest fixtures.

Link to build: https://jenkins.softwareheritage.org/job/DVAU/job/tests-on-diff/73/
See console output for more information: https://jenkins.softwareheritage.org/job/DVAU/job/tests-on-diff/73/console

Harbormaster returned this revision to the author for changes because remote builds failed.Fri, Apr 30, 10:25 PM
Harbormaster failed remote builds in B21201: Diff 20211!

Build has FAILED

Patch application report for D5658 (id=20271)

Could not rebase; Attempt merge onto f87dd54d5d...

Updating f87dd54..c7f77b8
Fast-forward
 swh/vault/cli.py                |   2 +-
 swh/vault/cookers/__init__.py   |   3 +
 swh/vault/cookers/base.py       |   6 +-
 swh/vault/cookers/git_bare.py   | 213 ++++++++++++++++++++++++++++++++++++++++
 swh/vault/in_memory_backend.py  |   2 +-
 swh/vault/tests/test_cookers.py | 135 ++++++++++++++++++++-----
 6 files changed, 334 insertions(+), 27 deletions(-)
 create mode 100644 swh/vault/cookers/git_bare.py
Changes applied before test
commit c7f77b8921173b4b4f5eb18687780ace7d387237
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri Apr 30 22:22:17 2021 +0200

    git_bare: Deduplicate object downloads and writes

commit 91472855a218e6ebcd81b496936f6f8b234fde38
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri Apr 30 19:30:34 2021 +0200

    Add a naive git bare cooker
    
    It can cook directories (by adding a synthetic revision pointing to it)
    and revisions.
    
    Current limitations:
    
    * It does not deduplicate directories and files at all, and queries
      all objects one by one.
    * No support for missing/absent contents
    * No support for missing submodules
    
    Tests reuse existing tests of the DirectoryCooker and
    RevisionGitfastCooker using parametrized pytest fixtures.

Link to build: https://jenkins.softwareheritage.org/job/DVAU/job/tests-on-diff/75/
See console output for more information: https://jenkins.softwareheritage.org/job/DVAU/job/tests-on-diff/75/console