Page MenuHomeSoftware Heritage
Paste P653

kafka error in docker
ActivePublic
Actions

Authored by anlambert on Apr 23 2020, 3:03 PM.
swh-loader_1 | Total 6363 (delta 4101), reused 1867 (delta 1059)
swh-loader_1 | [2020-04-23 12:04:33,713: INFO/ForkPoolWorker-1] Listed 307 refs for repo https://forge.softwareheritage.org/source/swh-loader-core.git
swh-loader_1 | [2020-04-23 12:05:06,623: ERROR/ForkPoolWorker-1] Loading failure, updating to `partial` status
swh-loader_1 | Traceback (most recent call last):
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 304, in load
swh-loader_1 | self.store_data()
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/loader/core/loader.py", line 415, in store_data
swh-loader_1 | self.storage.directory_add(self.get_directories())
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/storage/filter.py", line 62, in directory_add
swh-loader_1 | return self.storage.directory_add(d for d in directories if d.id in missing_ids)
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/storage/buffer.py", line 131, in object_add
swh-loader_1 | return self.flush()
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/storage/buffer.py", line 112, in flush
swh-loader_1 | s = add_fn(batch)
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 181, in meth_
swh-loader_1 | return self.post(meth._endpoint_path, post_data)
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 278, in post
swh-loader_1 | return self._decode_response(response)
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 352, in _decode_response
swh-loader_1 | self.raise_for_status(response)
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/storage/api/client.py", line 30, in raise_for_status
swh-loader_1 | super().raise_for_status(response)
swh-loader_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/api/__init__.py", line 342, in raise_for_status
swh-loader_1 | raise exception from None
swh-loader_1 | swh.core.api.RemoteException: <RemoteException 500 KafkaDeliveryError: ['Failed deliveries after flush()', [['directory', b'\xb9\x802\x7f`\x98\xa4\x97\xac\x8f\xaa\xec$\xd7\x10Pm2\xf4\xdc', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'b\xa0\xad\x03\xca\xfa5Z\xb7x\xfb\xd5r\xac\xf0\xc8F\x06?B', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'\x8c]\xbcm\x9c\x1a\xc4\xd7u\xcfh]:s\\\xcf\xb2\xca\xc6\xbf', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b"\x13'\x8f\\8<\x1b\xb0\xa0\x11T\xb5\xfc\t/4k\xc4\xf4\xc4", 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'\x822\x8f\x05\x84V\xc7gY\xc6\x05\xce\x13*%4\xd2\x0fL\xee', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'C\xa1\xd5\xa5Q\x05\xa8O=\xa5\xbcIs\xaf\xfc\xdaI\x9f\x8a\xf1', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'Na\xa7"\x87\xa3\xbei\x90\xbe\xecz^\x02\xa9\x85\x8d\xd3\xde\xfe', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'\xda^Yz\x9cS\xd7\x89\xaf1V\xf1L\xcc\xc04\x89Xa\x91', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b']5F3\xb1~\xac9\xb4\x88Z\xe3D\xc1p-\x18\x06\xa2<', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'p`\xb5M\xb9kG\xcf\x1f\x9b_.\xc8\x9e\xf6\x9a\xd8\x04nH', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'\x1c@\xae\x16\x97Y\x00\x1cX\xfc}#\xe9Z\x17&i\x0b\xa7\xba', 'Broker: Message size too large', 'MSG_SIZE_TOO_LARGE'], ['directory', b'\xdde\xc1\xbd\x05|\xcd\xd9\xf38\xe3y\xfcc\n\xfd\xd6\x1a@,', 'Broker: Message size
About · Developer information · Legal