Page MenuHomeSoftware Heritage
Paste P247

mimetype indexer error
ActivePublic

Authored by ardumont on Apr 12 2018, 9:47 AM.
worker09.euwest.azure: Apr 12 07:45:28 worker09 python3[128430]: [2018-04-12 07:45:27,737: ERROR/Worker-65266] Problem when reading contents metadata.
worker09.euwest.azure: Traceback (most recent call last):
worker09.euwest.azure: File "/usr/lib/python3/dist-packages/swh/indexer/indexer.py", line 359, in run
worker09.euwest.azure: raw_content = self.objstorage.get(sha1)
worker09.euwest.azure: File "/usr/lib/python3/dist-packages/swh/objstorage/multiplexer/multiplexer_objstorage.py", line 137, in get
worker09.euwest.azure: return storage.get(obj_id)
worker09.euwest.azure: File "/usr/lib/python3/dist-packages/swh/objstorage/multiplexer/filter/filter.py", line 69, in get
worker09.euwest.azure: return self.storage.get(obj_id, *args, **kwargs)
worker09.euwest.azure: File "/usr/lib/python3/dist-packages/swh/objstorage/api/client.py", line 40, in get
worker09.euwest.azure: ret = self.post('content/get', {'obj_id': obj_id})
worker09.euwest.azure: File "/usr/lib/python3/dist-packages/swh/core/api.py", line 62, in post
worker09.euwest.azure: return self._decode_response(response)
worker09.euwest.azure: File "/usr/lib/python3/dist-packages/swh/core/api.py", line 84, in _decode_response
worker09.euwest.azure: raise pickle.loads(data['exception_pickled'])
worker09.euwest.azure: EOFError: Compressed file ended before the end-of-stream marker was reached
worker09.euwest.azure: Apr 12 07:45:28 worker09 python3[70775]: WARNING:swh.indexer:Rescheduling batch
worker09.euwest.azure: Apr 12 07:45:28 worker09 python3[128430]: [2018-04-12 07:45:28,543: WARNING/Worker-65266] Rescheduling batch
worker09.euwest.azure: Apr 12 07:45:28 worker09 python3[70775]: [2018-04-12 07:45:28,673: INFO/MainProcess] Task swh.indexer.tasks.SWHContentMimetypeTask[62d00b50-e55c-449f-8d7a-7a648146f0ef] succeeded in 6.635315462015569s: None