Page Menu
Home
Software Heritage
Search
Configure Global Search
Log In
Paste
P970
deposit loader error in docker environment
Active
Public
Actions
Authored by
anlambert
on Mar 5 2021, 2:33 PM.
Edit Paste
Archive Paste
View Raw File
Subscribe
Mute Notifications
Award Token
Flag For Later
Tags
None
Subscribers
None
swh-loader-deposit_1 | [2021-03-05 13:29:50,864: INFO/MainProcess] Received task: swh.loader.package.deposit.tasks.LoadDeposit[29c39c67-9d10-4ee7-be6b-9a03c5dbbb8c]
swh-loader-deposit_1 | [2021-03-05 13:29:50,867: DEBUG/ForkPoolWorker-1] Loading config file /loader-deposit.yml
swh-loader-deposit_1 | [2021-03-05 13:29:51,384: DEBUG/MainProcess] heartbeat_tick : for connection 4c6e0d55bab340648017acbce1649821
swh-loader-deposit_1 | [2021-03-05 13:29:51,384: DEBUG/MainProcess] heartbeat_tick : Prev sent/recv: 39/2290, now - 41/2446, monotonic - 845447.299477598, last_heartbeat_sent - 845447.299474569, heartbeat int. - 60 for connection 4c6e0d55bab340648017acbce1649821
swh-loader-deposit_1 | [2021-03-05 13:29:52,977: DEBUG/ForkPoolWorker-1] last snapshot: None
swh-loader-deposit_1 | [2021-03-05 13:29:52,977: DEBUG/ForkPoolWorker-1] known artifacts: {}
swh-loader-deposit_1 | [2021-03-05 13:29:52,978: DEBUG/ForkPoolWorker-1] version: HEAD
swh-loader-deposit_1 | [2021-03-05 13:29:52,978: DEBUG/ForkPoolWorker-1] package_info: DepositPackageInfo(url='https://softwareheritage.org/d26cc0cf-22c8-47f6-9401-9ba95fa8438e', directory_extrinsic_metadata=[RawExtrinsicMetadataCore(format='sword-v2-atom-codemeta-v2', metadata=b'<?xml version="1.0" encoding="utf-8"?>\n<atom:entry xmlns:atom="http://www.w3.org/2005/Atom" xmlns:codemeta="https://doi.org/10.5063/SCHEMA/CODEMETA-2.0">\n\t<atom:updated>2021-03-05 13:29:35.354884+00:00</atom:updated>\n\t<atom:author>test</atom:author>\n\t<atom:title>test_deposit</atom:title>\n\t<codemeta:name>test_deposit</codemeta:name>\n\t<codemeta:author>\n\t\t<codemeta:name>somebody</codemeta:name>\n\t</codemeta:author>\n</atom:entry>', discovery_date=datetime.datetime(2021, 3, 5, 13, 29, 52, 978836, tzinfo=datetime.timezone.utc))], filename='archive.zip', raw_info={'origin': {'type': 'deposit', 'url': 'https://softwareheritage.org/d26cc0cf-22c8-47f6-9401-9ba95fa8438e'}, 'origin_metadata': {'metadata': {'atom:title': 'test_deposit', 'atom:author': 'test', 'atom:updated': '2021-03-05 13:29:35.354884+00:00', 'codemeta:name': 'test_deposit', 'codemeta:author': {'codemeta:name': 'somebody'}}, 'provider': {'provider_name': '', 'provider_url': 'https://softwareheritage.org', 'provider_type': 'deposit_client', 'metadata': {}}, 'tool': {'name': 'swh-deposit', 'version': '0.11.0', 'configuration': {'sword_version': '2'}}}}, author_date={'timestamp': {'seconds': 1614950975, 'microseconds': 684472}, 'offset': 0, 'negative_utc': False}, commit_date={'timestamp': {'seconds': 1614950975, 'microseconds': 684472}, 'offset': 0, 'negative_utc': False}, client='test', id=1, collection='test', author=Person(fullname=b'Software Heritage', name=b'Software Heritage', email=b'robot@softwareheritage.org'), committer=Person(fullname=b'Software Heritage', name=b'Software Heritage', email=b'robot@softwareheritage.org'), revision_parents=())
swh-loader-deposit_1 | [2021-03-05 13:29:53,023: DEBUG/ForkPoolWorker-1] filename: archive.zip
swh-loader-deposit_1 | [2021-03-05 13:29:53,023: DEBUG/ForkPoolWorker-1] filepath: /tmp/tmpgbjiu7wh/archive.zip
swh-loader-deposit_1 | [2021-03-05 13:29:53,024: DEBUG/ForkPoolWorker-1] extrinsic_metadata
swh-loader-deposit_1 | [2021-03-05 13:29:53,029: ERROR/ForkPoolWorker-1] Failed loading branch HEAD for https://softwareheritage.org/d26cc0cf-22c8-47f6-9401-9ba95fa8438e
swh-loader-deposit_1 | Traceback (most recent call last):
swh-loader-deposit_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/tarball.py", line 72, in uncompress
swh-loader-deposit_1 | shutil.unpack_archive(tarpath, extract_dir=dest)
swh-loader-deposit_1 | File "/usr/local/lib/python3.7/shutil.py", line 1002, in unpack_archive
swh-loader-deposit_1 | func(filename, extract_dir, **kwargs)
swh-loader-deposit_1 | File "/usr/local/lib/python3.7/shutil.py", line 899, in _unpack_zipfile
swh-loader-deposit_1 | raise ReadError("%s is not a zip file" % filename)
swh-loader-deposit_1 | shutil.ReadError: /tmp/tmpgbjiu7wh/archive.zip is not a zip file
swh-loader-deposit_1 |
swh-loader-deposit_1 | During handling of the above exception, another exception occurred:
swh-loader-deposit_1 |
swh-loader-deposit_1 | Traceback (most recent call last):
swh-loader-deposit_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/package/loader.py", line 450, in load
swh-loader-deposit_1 | res = self._load_revision(p_info, origin)
swh-loader-deposit_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/package/loader.py", line 577, in _load_revision
swh-loader-deposit_1 | (uncompressed_path, directory) = self._load_directory(dl_artifacts, tmpdir)
swh-loader-deposit_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/package/loader.py", line 540, in _load_directory
swh-loader-deposit_1 | uncompressed_path = self.uncompress(dl_artifacts, dest=tmpdir)
swh-loader-deposit_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/package/loader.py", line 284, in uncompress
swh-loader-deposit_1 | uncompress(a_path, dest=uncompressed_path)
swh-loader-deposit_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/tarball.py", line 74, in uncompress
swh-loader-deposit_1 | raise ValueError(f"Problem during unpacking {tarpath}. Reason: {e}")
swh-loader-deposit_1 | ValueError: Problem during unpacking /tmp/tmpgbjiu7wh/archive.zip. Reason: /tmp/tmpgbjiu7wh/archive.zip is not a zip file
swh-loader-deposit_1 | [2021-03-05 13:29:53,030: DEBUG/ForkPoolWorker-1] default version:
swh-loader-deposit_1 | [2021-03-05 13:29:53,031: DEBUG/ForkPoolWorker-1] extra branches: {}
swh-loader-deposit_1 | [2021-03-05 13:29:53,031: DEBUG/ForkPoolWorker-1] revisions: {'HEAD': []}
swh-loader-deposit_1 | [2021-03-05 13:29:53,031: DEBUG/ForkPoolWorker-1] snapshot: {'branches': {}}
swh-loader-deposit_1 | [2021-03-05 13:29:53,031: DEBUG/ForkPoolWorker-1] snapshot: Snapshot(branches=ImmutableDict({}), id=b'\x1a\x88\x93\xe6\xa8oDN\x8b\xe8\xe7\xbd\xa6\xcb4\xfb\x175\xa0\x0e')
swh-loader-deposit_1 | [2021-03-05 13:30:01,012: WARNING/ForkPoolWorker-1] 1 failed branches
swh-loader-deposit_1 | [2021-03-05 13:30:01,012: WARNING/ForkPoolWorker-1] Failed branches: HEAD
swh-loader-deposit_1 | [2021-03-05 13:30:01,028: INFO/ForkPoolWorker-1] Task swh.loader.package.deposit.tasks.LoadDeposit[29c39c67-9d10-4ee7-be6b-9a03c5dbbb8c] succeeded in 10.161473890999332s: {'status': 'uneventful', 'snapshot_id': '1a8893e6a86f444e8be8e7bda6cb34fb1735a00e'}
Event Timeline
anlambert
created this paste.
Mar 5 2021, 2:33 PM
2021-03-05 14:33:04 (UTC+1)
ardumont
mentioned this in
D5202: conf/loader-deposit.yml: Fix according to latest deposit server
.
Mar 5 2021, 2:43 PM
2021-03-05 14:43:35 (UTC+1)
Log In to Comment