There were two revisions for this package {'author': {'email': b'robot@softwareheritage.org', 'fullname': b'Software Heritage', 'name': b'Software Heritage'}, 'committer': {'email': b'robot@softwareheritage.org', 'fullname': b'Software Heritage', 'name': b'Software Heritage'}, 'committer_date': {'negative_utc': False, 'offset': 0, 'timestamp': {'microseconds': 0, 'seconds': 926447126}}, 'date': {'negative_utc': False, 'offset': 0, 'timestamp': {'microseconds': 0, 'seconds': 926447126}}, 'directory': b'15+\xab\x04\xf0\xd7\xd5\xec\xe5T\xaa\x85\x15\x90\xbel\xc77V', 'id': b'4r\xf8\xff\x00;+\xe5\xa1\xee\x81\x81 \xa7\xcbr\xe9\x0bx|', 'message': b'swh-loader-package: synthetic revision message', 'metadata': {'package': {'archive': 'https://ftp.gnu.org/old-gnu/avl/avl-1.2.9.tar.gz', 'date': '926447126'}}, 'parents': [], 'synthetic': True, 'type': 'tar'} {'author': {'email': b'robot@softwareheritage.org', 'fullname': b'Software Heritage', 'name': b'Software Heritage'}, 'committer': {'email': b'robot@softwareheritage.org', 'fullname': b'Software Heritage', 'name': b'Software Heritage'}, 'committer_date': {'negative_utc': False, 'offset': 0, 'timestamp': {'microseconds': 0, 'seconds': 926848728}}, 'date': {'negative_utc': False, 'offset': 0, 'timestamp': {'microseconds': 0, 'seconds': 926848728}}, 'directory': b'\x07\xc3\xf4\xfb\xd4k\xf1w\x98p\xc21g\x90\x01\xc7j\xb6\x15\xf4', 'id': b'\x1a\xe3\xec\xc6\n\x1c\n/\x1dX\x15X\x9f\xac\xe2\x18\xcb"\xfb\x8c', 'message': b'swh-loader-package: synthetic revision message', 'metadata': {'package': {'archive': 'https://ftp.gnu.org/old-gnu/avl/avl-1.3.0.tar.gz', 'date': '926848728'}}, 'parents': [], 'synthetic': True, 'type': 'tar'} Complete Logs swh-loader_1 | [2019-08-11 19:07:24,785: INFO/MainProcess] Received task: swh.loader.package.tasks.LoadGNU[39b68056-6f09-4306-886f-783b4b4b4360] swh-loader_1 | [2019-08-11 19:07:24,789: INFO/ForkPoolWorker-1] Loading config file /loader.yml swh-loader_1 | [2019-08-11 19:07:24,809: DEBUG/ForkPoolWorker-1] Creating gnu origin for https://ftp.gnu.org/gnu/avl/ swh-loader_1 | [2019-08-11 19:07:24,817: DEBUG/ForkPoolWorker-1] Done creating gnu origin for https://ftp.gnu.org/gnu/avl/ swh-loader_1 | [2019-08-11 19:07:24,817: DEBUG/ForkPoolWorker-1] Creating origin_visit for origin https://ftp.gnu.org/gnu/avl/ at time 2019-08-11 19:07:24.817780+00:00 swh-loader_1 | [2019-08-11 19:07:24,857: DEBUG/ForkPoolWorker-1] Done Creating origin_visit for origin https://ftp.gnu.org/gnu/avl/ at time 2019-08-11 19:07:24.817780+00:00 swh-loader_1 | [2019-08-11 19:07:26,419: DEBUG/ForkPoolWorker-1] {'metadata': {'package': {'date': '926447126', 'archive': 'https://ftp.gnu.org/old-gnu/avl/avl-1.2.9.tar.gz'}}, 'date': {'timestamp': {'seconds': 926447126, 'microseconds': 0}, 'offset': 0, 'negative_utc': False}, 'committer_date': {'timestamp': {'seconds': 926447126, 'microseconds': 0}, 'offset': 0, 'negative_utc': False}, 'author': {'name': b'Software Heritage', 'fullname': b'Software Heritage', 'email': b'robot@softwareheritage.org'}, 'committer': {'name': b'Software Heritage', 'fullname': b'Software Heritage', 'email': b'robot@softwareheritage.org'}, 'type': 'tar', 'message': b'swh-loader-package: synthetic revision message', 'directory': b'15+\xab\x04\xf0\xd7\xd5\xec\xe5T\xaa\x85\x15\x90\xbel\xc77V', 'synthetic': True, 'parents': [], 'id': b'4r\xf8\xff\x00;+\xe5\xa1\xee\x81\x81 \xa7\xcbr\xe9\x0bx|'} swh-loader_1 | [2019-08-11 19:07:26,419: DEBUG/ForkPoolWorker-1] Removing unpacked package files at b'/tmp/swh.loader.gnu/swh.loader.gnu.2exq1uaq-32/avl/uncompressed/avl-1.2.9.tar.gz' swh-loader_1 | [2019-08-11 19:07:26,987: DEBUG/ForkPoolWorker-1] {'metadata': {'package': {'date': '926848728', 'archive': 'https://ftp.gnu.org/old-gnu/avl/avl-1.3.0.tar.gz'}}, 'date': {'timestamp': {'seconds': 926848728, 'microseconds': 0}, 'offset': 0, 'negative_utc': False}, 'committer_date': {'timestamp': {'seconds': 926848728, 'microseconds': 0}, 'offset': 0, 'negative_utc': False}, 'author': {'name': b'Software Heritage', 'fullname': b'Software Heritage', 'email': b'robot@softwareheritage.org'}, 'committer': {'name': b'Software Heritage', 'fullname': b'Software Heritage', 'email': b'robot@softwareheritage.org'}, 'type': 'tar', 'message': b'swh-loader-package: synthetic revision message', 'directory': b'\x07\xc3\xf4\xfb\xd4k\xf1w\x98p\xc21g\x90\x01\xc7j\xb6\x15\xf4', 'synthetic': True, 'parents': [], 'id': b'\x1a\xe3\xec\xc6\n\x1c\n/\x1dX\x15X\x9f\xac\xe2\x18\xcb"\xfb\x8c'} swh-loader_1 | [2019-08-11 19:07:26,987: DEBUG/ForkPoolWorker-1] Removing unpacked package files at b'/tmp/swh.loader.gnu/swh.loader.gnu.2exq1uaq-32/avl/uncompressed/avl-1.3.0.tar.gz' swh-loader_1 | [2019-08-11 19:07:27,029: DEBUG/ForkPoolWorker-1] Sending 38 contents swh-loader_1 | [2019-08-11 19:07:29,416: DEBUG/ForkPoolWorker-1] Done sending 38 contents swh-loader_1 | [2019-08-11 19:07:29,417: DEBUG/ForkPoolWorker-1] Sending 4 directories swh-loader_1 | [2019-08-11 19:07:29,536: DEBUG/ForkPoolWorker-1] Done sending 4 directories swh-loader_1 | [2019-08-11 19:07:29,536: DEBUG/ForkPoolWorker-1] Sending 2 revisions swh-loader_1 | [2019-08-11 19:07:29,546: ERROR/ForkPoolWorker-1] Loading failure, updating to `partial` status swh-loader_1 | Traceback (most recent call last): swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 872, in load swh-loader_1 | self.store_data() swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/package/loader.py", line 380, in store_data swh-loader_1 | self.generate_and_load_snapshot() swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/package/loader.py", line 392, in generate_and_load_snapshot swh-loader_1 | self.maybe_load_snapshot(snapshot) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 644, in maybe_load_snapshot swh-loader_1 | self.bulk_send_snapshot(snapshot) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 609, in bulk_send_snapshot swh-loader_1 | self.send_batch_revisions(self.revisions.pop()) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 661, in send_batch_revisions swh-loader_1 | send_in_packets(revisions, self.send_revisions, packet_size) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 47, in send_in_packets swh-loader_1 | sender(formatted_objects) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/retrying.py", line 49, in wrapped_f swh-loader_1 | return Retrying(*dargs, **dkw).call(f, *args, **kw) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/retrying.py", line 206, in call swh-loader_1 | return attempt.get(self._wrap_exception) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/retrying.py", line 247, in get swh-loader_1 | six.reraise(self.value[0], self.value[1], self.value[2]) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/six.py", line 693, in reraise swh-loader_1 | raise value swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/retrying.py", line 200, in call swh-loader_1 | attempt = Attempt(fn(*args, **kwargs), attempt_number, False) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 452, in send_revisions swh-loader_1 | result = self.storage.revision_add(revision_list) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/storage/api/client.py", line 79, in revision_add swh-loader_1 | return self.post('revision/add', {'revisions': revisions}) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 198, in post swh-loader_1 | return self._decode_response(response) swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 230, in _decode_response swh-loader_1 | raise pickle.loads(decode_response(response)) swh-loader_1 | TypeError: Object of type bytes is not JSON serializable swh-loader_1 | [2019-08-11 19:07:29,547: DEBUG/ForkPoolWorker-1] Updating origin_visit for origin https://ftp.gnu.org/gnu/avl/ with status partial swh-loader_1 | [2019-08-11 19:07:29,583: DEBUG/ForkPoolWorker-1] Done updating origin_visit for origin https://ftp.gnu.org/gnu/avl/ with status partial swh-loader_1 | [2019-08-11 19:07:29,584: DEBUG/ForkPoolWorker-1] Clean up /tmp/swh.loader.gnu/swh.loader.gnu.2exq1uaq-32 swh-loader_1 | [2019-08-11 19:07:29,588: INFO/ForkPoolWorker-1] Task swh.loader.package.tasks.LoadGNU[39b68056-6f09-4306-886f-783b4b4b4360] succeeded in 4.797499801003141s: {'status': 'failed'}