Page MenuHomeSoftware Heritage

utils: Add a new 'iter_chunks' function
ClosedPublic

Authored by vlorentz on Mar 2 2022, 11:15 AM.

Details

Reviewers
olasd
Group Reviewers
Reviewers
Maniphest Tasks
Restricted Maniphest Task
Commits
rDCORE20da92e35336: utils: Add a new 'iter_chunks' function
Summary

It will be used by the swh-objstorage client in 'list_content' to efficiently
chunk the output into sha1 digests without relying on HTTP chunking from the server.

Diff Detail

Event Timeline

Build is green

Patch application report for D7275 (id=26340)

Rebasing onto ad1572094d...

Current branch diff-target is up to date.
Changes applied before test
commit 66927d0b7372c21bf3181d74f582d9451f4de1f0
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Wed Mar 2 11:15:09 2022 +0100

    utils: Add a new 'iter_chunks' function
    
    It will be used by the swh-objstorage client in 'list_content' to efficiently
    chunk the output into sha1 digests without relying on HTTP chunking from the server.

See https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/365/ for more details.

Build is green

Patch application report for D7275 (id=26341)

Rebasing onto ad1572094d...

Current branch diff-target is up to date.
Changes applied before test
commit 8137a7b25915579d201571738206138414e4eab9
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Wed Mar 2 11:15:09 2022 +0100

    utils: Add a new 'iter_chunks' function
    
    It will be used by the swh-objstorage client in 'list_content' to efficiently
    chunk the output into sha1 digests without relying on HTTP chunking from the server.

See https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/366/ for more details.

actually, let's work directly on an iterable instead of a callable

Build is green

Patch application report for D7275 (id=26342)

Rebasing onto ad1572094d...

Current branch diff-target is up to date.
Changes applied before test
commit 20da92e35336a512069c33b83df297c40e05b119
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Wed Mar 2 11:15:09 2022 +0100

    utils: Add a new 'iter_chunks' function
    
    It will be used by the swh-objstorage client in 'list_content' to efficiently
    chunk the output into sha1 digests without relying on HTTP chunking from the server.

See https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/367/ for more details.

olasd added a subscriber: olasd.

Thanks

This revision is now accepted and ready to land.Mar 2 2022, 11:28 AM
This revision was automatically updated to reflect the committed changes.
vlorentz added a task: Restricted Maniphest Task.Mar 7 2022, 9:25 AM