Page MenuHomeSoftware Heritage
Paste P114

some erratic errors on indexer computations (orchestrator, mimetype, language)
ActivePublic
Actions

Authored by ardumont on Oct 12 2016, 1:04 AM.
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: [2016-10-11 23:03:26,156: ERROR/MainProcess] Task swh.indexer.tasks.SWHOrchestratorTask[2561d4d2-1152-46b9-ba81-a3756d8b49be] raised unexpected: StorageAPIError(ConnectionError(Protocol
Error('Connection aborted.', gaierror(-2, 'Name or service not known')),),)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: Traceback (most recent call last):
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 240, in trace_task
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: R = retval = fun(*args, **kwargs)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 437, in __protected_call__
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: return self.run(*args, **kwargs)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/indexer/tasks.py", line 20, in run
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: OrchestratorIndexer().run(*args, **kwargs)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/indexer/orchestrator.py", line 42, in run
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: sha1s_filtered = list(indexer.filter_contents(sha1s))
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/indexer/mimetype.py", line 58, in filter_contents
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: yield from self.storage.content_mimetype_missing(sha1s)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/storage/api/client.py", line 223, in content_mimetype_missing
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: return self.post('content_mimetype/missing', {'mimetypes': mimetypes})
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/storage/api/client.py", line 35, in post
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: raise StorageAPIError(e)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: swh.storage.exc.StorageAPIError: An unexpected error occurred in the api backend: ('Connection aborted.', gaierror(-2, 'Name or service not known'))
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: [2016-10-11 23:03:26,156: ERROR/MainProcess] Task swh.indexer.tasks.SWHOrchestratorTask[2561d4d2-1152-46b9-ba81-a3756d8b49be] raised unexpected: StorageAPIError(ConnectionError(ProtocolError('Connection aborted.', gaierror(-2, 'Name or service not known')),),)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: Traceback (most recent call last):
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 240, in trace_task
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: R = retval = fun(*args, **kwargs)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 437, in __protected_call__
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: return self.run(*args, **kwargs)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/indexer/tasks.py", line 20, in run
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: OrchestratorIndexer().run(*args, **kwargs)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/indexer/orchestrator.py", line 42, in run
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: sha1s_filtered = list(indexer.filter_contents(sha1s))
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/indexer/mimetype.py", line 58, in filter_contents
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: yield from self.storage.content_mimetype_missing(sha1s)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/storage/api/client.py", line 223, in content_mimetype_missing
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: return self.post('content_mimetype/missing', {'mimetypes': mimetypes})
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: File "/usr/lib/python3/dist-packages/swh/storage/api/client.py", line 35, in post
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: raise StorageAPIError(e)
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: swh.storage.exc.StorageAPIError: An unexpected error occurred in the api backend: ('Connection aborted.', gaierror(-2, 'Name or service not known'))
Oct 11 23:03:26 worker01.euwest.azure python3[49773]: [2016-10-11 23:03:26,345: INFO/MainProcess] Received task: swh.indexer.tasks.SWHOrchestratorTask[f252b2e6-4e2c-41b3-a297-a51f154720a6]
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: [2016-10-11 22:48:43,542: ERROR/MainProcess] Task swh.indexer.tasks.SWHContentLanguageTask[cab25c63-f99f-475c-8ed5-797e621aef8a] raised unexpected: StorageAPIError(ConnectionError(Proto
colError('Connection aborted.', gaierror(-2, 'Name or service not known')),),)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: Traceback (most recent call last):
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 240, in trace_task
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: R = retval = fun(*args, **kwargs)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 437, in __protected_call__
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: return self.run(*args, **kwargs)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/swh/indexer/tasks.py", line 40, in run
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: ContentLanguageIndexer().run(*args, **kwargs)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/swh/indexer/indexer.py", line 144, in run
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: self.index_contents(sha1s)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/swh/indexer/indexer.py", line 123, in index_contents
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: self.persist_index_computations(results)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/swh/indexer/language.py", line 95, in persist_index_computations
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: self.storage.content_language_add(results)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/swh/storage/api/client.py", line 226, in content_language_add
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: return self.post('content_language/add', {'languages': languages})
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: File "/usr/lib/python3/dist-packages/swh/storage/api/client.py", line 35, in post
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: raise StorageAPIError(e)
Oct 11 22:48:43 worker01.euwest.azure python3[49746]: swh.storage.exc.StorageAPIError: An unexpected error occurred in the api backend: ('Connection aborted.', gaierror(-2, 'Name or service not known'))

Event Timeline

ardumont created this paste.Oct 12 2016, 1:04 AM
ardumont changed the title of this paste from some erratic errors also on some indexer computations to some erratic errors also on some indexer computations (orchestrator, mimetype, language).
ardumont edited the content of this paste. (Show Details)
ardumont changed the title of this paste from some erratic errors also on some indexer computations (orchestrator, mimetype, language) to some erratic errors on indexer computations (orchestrator, mimetype, language).Oct 12 2016, 1:11 AM
About · Developer information · Legal