Differential D6270
pypi/loader: Filter out sdist archives not of interest Authored by anlambert on Sep 15 2021, 3:39 PM.
Details
Some PyPI origins declare sdist archives that cannot be extracted This is notably the case for sdist files whose extensions are As those artifacts are not of interest to archive and generate Related to T3575
Diff Detail
Event TimelineComment Actions Build is green Patch application report for D6270 (id=22700)Rebasing onto d5e54a5eea... Current branch diff-target is up to date. Changes applied before testcommit bb0116c30e9c998d24f66760df6ff295223c65ae
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Tue Sep 14 17:39:03 2021 +0200
pypi/loader: Filter out sdist archives not of interest
Some PyPI origins declare sdist archives that cannot be extracted
by swh.core.tarball.uncompress and their content do not match
standard sdist layout.
This is notably the case for sdist files whose extensions are
.deb, .egg, .rpm or .whl.
As those artifacts are not of interest to archive and generate
errors while loading PyPI origins, filter them out from the
sdist files to process.
Related to T3575See https://jenkins.softwareheritage.org/job/DLDBASE/job/tests-on-diff/554/ for more details. Comment Actions Build is green Patch application report for D6270 (id=22705)Rebasing onto d5e54a5eea... Current branch diff-target is up to date. Changes applied before testcommit d667a10217085bc7630a21f895b52aa8e758c6fe
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Tue Sep 14 17:39:03 2021 +0200
pypi/loader: Filter out sdist archives not of interest
Some PyPI origins declare sdist archives that cannot be extracted
by swh.core.tarball.uncompress and their content do not match
standard sdist layout.
This is notably the case for sdist files whose extensions are
.deb, .egg, .rpm or .whl.
As those artifacts are not of interest to archive and generate
errors while loading PyPI origins, filter them out from the
sdist files to process.
Related to T3575See https://jenkins.softwareheritage.org/job/DLDBASE/job/tests-on-diff/555/ for more details. Comment Actions Build is green Patch application report for D6270 (id=22707)Rebasing onto d5e54a5eea... Current branch diff-target is up to date. Changes applied before testcommit 732999842159cc9f6efb01cf81e54afd8cf7be6e
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date: Tue Sep 14 17:39:03 2021 +0200
pypi/loader: Filter out sdist archives not of interest
Some PyPI origins declare sdist archives that cannot be extracted
by swh.core.tarball.uncompress and their content do not match
standard sdist layout.
This is notably the case for sdist files whose extensions are
.deb, .egg, .rpm or .whl.
As those artifacts are not of interest to archive and generate
errors while loading PyPI origins, filter them out from the
sdist files to process.
Related to T3575See https://jenkins.softwareheritage.org/job/DLDBASE/job/tests-on-diff/556/ for more details. |