Page MenuHomeSoftware Heritage

Uncompress support '.tar.zst' extension and 'application/zstd' mime type.
ClosedPublic

Authored by franckbret on Jun 16 2022, 9:03 AM.

Details

Summary

Add zstandard support to tarball.py for unpacking 'tar.zst' file archives.
It requires 'zstandard' python package as a dependency. It may require 'zstd' package on host.

Zstandard support is required by the archlinux loader.

Test Plan

Add archive example file and a test for unpacking zst file.

Event Timeline

Build has FAILED

Patch application report for D7993 (id=28799)

Rebasing onto 7f85bd7cea...

Current branch diff-target is up to date.
Changes applied before test
commit f63f4d217527ee6b2f54d994957315b1676574f1
Author: Franck Bret <franck.bret@octobus.net>
Date:   Thu Jun 16 08:44:00 2022 +0200

    Add zstandard support to tarball.py for unpacking 'tar.zst' file archives
    
    _zst_unpack method added to support '.tar.zst' extension and 'application/zstd' mime type.
    Add archive example file and a test for unpacking zst file.
    It requires 'zstandard' python package as a dependency.

Link to build: https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/450/
See console output for more information: https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/450/console

Harbormaster returned this revision to the author for changes because remote builds failed.Jun 16 2022, 9:05 AM
Harbormaster failed remote builds in B29881: Diff 28799!

Updating D7993: Uncompress support '.tar.zst' extension and 'application/zstd', 'application/x-zstd' mime type.

Add 'application/x-zstd' mimetype too.
Remove python 'zstandard' dependency from requirement as it is useless in this case.

Build is green

Patch application report for D7993 (id=28810)

Rebasing onto 7f85bd7cea...

Current branch diff-target is up to date.
Changes applied before test
commit 028facd5ce7714fc737caa5a135ac6fc3795dae7
Author: Franck Bret <franck.bret@octobus.net>
Date:   Thu Jun 16 08:44:00 2022 +0200

    Add zstandard support to tarball.py for unpacking 'tar.zst' file archives
    
    _zst_unpack method added to support '.tar.zst' extension and 'application/zstd', 'application/x-zstd' mime type.
    Add archive example file and a test for unpacking zst file.

See https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/451/ for more details.

olasd added a subscriber: olasd.

Thanks!

This revision is now accepted and ready to land.Jun 16 2022, 12:05 PM

Updating D7993: Uncompress support '.tar.zst' extension and 'application/zstd', 'application/x-zstd' mime type.

Add '.tar.zstd' extension too for 'tar.zst' group.

Build is green

Patch application report for D7993 (id=28811)

Rebasing onto 7f85bd7cea...

Current branch diff-target is up to date.
Changes applied before test
commit 87e7afab114d0333b9efa6929b867e7ad00375cd
Author: Franck Bret <franck.bret@octobus.net>
Date:   Thu Jun 16 08:44:00 2022 +0200

    Add zstandard support to tarball.py for unpacking 'tar.zst' file archives
    
    _zst_unpack method added to support '.tar.zst' extension and 'application/zstd', 'application/x-zstd' mime type.
    Add archive example file and a test for unpacking zst file.

See https://jenkins.softwareheritage.org/job/DCORE/job/tests-on-diff/452/ for more details.