Page MenuHomeSoftware Heritage
Paste P620

staging: functional loader crash
ActivePublic
Actions

Authored by ardumont on Mar 20 2020, 11:16 AM.
DEBUG:swh.loader.package.loader:Number of skipped contents: 0 [58/4699]
DEBUG:urllib3.connectionpool:http://storage0.internal.staging.swh.network:5002 "POST /content/skipped/missing HTTP/1.1" 200 1
DEBUG:swh.loader.package.loader:Number of contents: 261
DEBUG:urllib3.connectionpool:http://storage0.internal.staging.swh.network:5002 "POST /content/missing HTTP/1.1" 200 1
DEBUG:swh.loader.package.loader:Number of directories: 22
DEBUG:urllib3.connectionpool:http://storage0.internal.staging.swh.network:5002 "POST /directory/missing HTTP/1.1" 200 1
DEBUG:swh.loader.package.loader:Revision: Revision(message=b'', author=Person(fullname=b'', name=None, email=None), committer=Person(fullname=b'', name=None, email=None), date=None, committer_date=None, type=<RevisionType.TAR: 'tar'>, dire
ctory=b'\x9e\xbb\x03cO\xfd1\xb6t\x90d\xb3&c\x89\xf0E\x86Wy', synthetic=True, metadata={'extrinsic': {'provider': 'https://nix-community.github.io/nixpkgs-swh/sources.json', 'when': '2020-03-19T18:36:12.154327+00:00', 'raw': {'url': 'http:/
/common-lisp.net/project/asdf/archives/asdf-3.1.7.tar.gz'}}, 'original_artifact': [{'length': 402767, 'filename': 'asdf-3.1.7.tar.gz', 'checksums': {'sha1': 'fce15c25831fad904eabb71e9aa3ff4d83234550', 'sha256': 'f8ff852ccd66af6291763edb7e1
5aae329dcf3a6c94bfb84d099bf13f7b81cbd'}}]}, parents=[], id=b"'\x92\xbd\xed\x01\x96\xa3\xf4\xacSub\xcd;#{\xd4\x96 \x07")
DEBUG:urllib3.connectionpool:http://storage0.internal.staging.swh.network:5002 "POST /revision/missing HTTP/1.1" 200 1
DEBUG:swh.loader.package.loader:version: https://downloads.sourceforge.net//asio/asio-1.12.1.tar.bz2
DEBUG:swh.loader.package.loader:package_info: {'url': 'https://downloads.sourceforge.net//asio/asio-1.12.1.tar.bz2', 'raw': {'url': 'https://downloads.sourceforge.net//asio/asio-1.12.1.tar.bz2'}}
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): downloads.sourceforge.net:443
DEBUG:urllib3.connectionpool:https://downloads.sourceforge.net:443 "GET //asio/asio-1.12.1.tar.bz2 HTTP/1.1" 301 398
DEBUG:urllib3.connectionpool:https://downloads.sourceforge.net:443 "GET /project/asio/asio/1.12.1%20%28Stable%29/asio-1.12.1.tar.bz2 HTTP/1.1" 302 377
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): netcologne.dl.sourceforge.net:443
DEBUG:urllib3.connectionpool:https://netcologne.dl.sourceforge.net:443 "GET /project/asio/asio/1.12.1%20%28Stable%29/asio-1.12.1.tar.bz2 HTTP/1.1" 200 1444246
DEBUG:swh.loader.package.utils:filename: asio-1.12.1.tar.bz2
DEBUG:swh.loader.package.utils:filepath: /tmp/tmp4s_k898q/asio-1.12.1.tar.bz2
DEBUG:swh.loader.package.utils:extrinsic_metadata
ERROR:swh.loader.package.loader:Fail to load https://nix-community.github.io/nixpkgs-swh/sources.json
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/swh/loader/package/loader.py", line 291, in load
self._load_revision(p_info, origin)
File "/usr/lib/python3/dist-packages/swh/loader/package/loader.py", line 368, in _load_revision
uncompressed_path = self.uncompress(dl_artifacts, dest=tmpdir)
File "/usr/lib/python3/dist-packages/swh/loader/package/loader.py", line 211, in uncompress
uncompress(a_path, dest=uncompressed_path)
File "/usr/lib/python3/dist-packages/swh/core/tarball.py", line 72, in uncompress
shutil.unpack_archive(tarpath, extract_dir=dest)
File "/usr/lib/python3.7/shutil.py", line 999, in unpack_archive
func(filename, extract_dir, **kwargs)
File "/usr/lib/python3.7/shutil.py", line 934, in _unpack_tarfile
tarobj.extractall(extract_dir)
File "/usr/lib/python3.7/tarfile.py", line 2002, in extractall
numeric_owner=numeric_owner)
File "/usr/lib/python3.7/tarfile.py", line 2044, in extract
numeric_owner=numeric_owner)
File "/usr/lib/python3.7/tarfile.py", line 2114, in _extract_member
self.makefile(tarinfo, targetpath)
File "/usr/lib/python3.7/tarfile.py", line 2163, in makefile
copyfileobj(source, target, tarinfo.size, ReadError, bufsize)
File "/usr/lib/python3.7/tarfile.py", line 247, in copyfileobj
buf = src.read(bufsize)
File "/usr/lib/python3.7/bz2.py", line 178, in read
return self._buffer.read(size)
File "/usr/lib/python3.7/_compression.py", line 68, in readinto
data = self.read(len(byte_view))
File "/usr/lib/python3.7/_compression.py", line 99, in read
raise EOFError("Compressed file ended before the "
EOFError: Compressed file ended before the end-of-stream marker was reached
DEBUG:urllib3.connectionpool:Resetting dropped connection: sentry.softwareheritage.org
DEBUG:urllib3.connectionpool:Resetting dropped connection: storage0.internal.staging.swh.network
DEBUG:urllib3.connectionpool:http://storage0.internal.staging.swh.network:5002 "POST /origin/visit/update HTTP/1.1" 200 1
{'status': 'failed'}
DEBUG:urllib3.connectionpool:https://sentry.softwareheritage.org:443 "POST /api/9/store/ HTTP/1.1" 200 41
About · Developer information · Legal