Jun 10 06:17:36 worker11 python3[57236]: [2018-06-10 06:17:36,767: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHBatchCookingTask[6a8b530a-2ae6-4d01-bc13-b04314896256] succeeded in 11380.885421179235s: None Jun 10 06:17:36 worker11 python3[57236]: [2018-06-10 06:17:36,769: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHBatchCookingTask[fd5ef220-830b-4d78-88c7-b5494ca4cd82] succeeded in 11400.2180494708s: None Jun 10 06:17:36 worker11 python3[57236]: [2018-06-10 06:17:36,771: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHBatchCookingTask[d87679ec-3ea7-4c5f-be2e-2ab71b9f92d6] succeeded in 11406.673143764958s: None Jun 10 06:17:36 worker11 python3[57236]: [2018-06-10 06:17:36,772: INFO/MainProcess] Task swh.vault.cooking_tasks.SWHBatchCookingTask[64d1ce65-bb21-40cf-bd16-89b44faa352c] succeeded in 11318.264325065073s: None Jun 10 06:17:36 worker11 python3[57236]: [2018-06-10 06:17:36,773: WARNING/MainProcess] consumer: Connection to broker lost. Trying to re-establish the connection... Traceback (most recent call last): File "/usr/lib/python3/dist-packages/celery/worker/consumer.py", line 279, in start blueprint.start(self) File "/usr/lib/python3/dist-packages/celery/bootsteps.py", line 123, in start step.start(parent) File "/usr/lib/python3/dist-packages/celery/worker/consumer.py", line 838, in start c.loop(*c.loop_args()) File "/usr/lib/python3/dist-packages/celery/worker/loops.py", line 76, in asynloop next(loop) File "/usr/lib/python3/dist-packages/kombu/async/hub.py", line 340, in create_loop cb(*cbargs) File "/usr/lib/python3/dist-packages/kombu/transport/base.py", line 164, in on_readable reader(loop) File "/usr/lib/python3/dist-packages/kombu/transport/base.py", line 144, in _read raise RecoverableConnectionError('Socket was disconnected') amqp.exceptions.RecoverableConnectionError: Socket was disconnected Jun 10 06:17:37 worker11 python3[57236]: [2018-06-10 06:17:37,295: INFO/MainProcess] Connected to amqp://swhconsumer:**@rabbitmq:5672// Jun 10 06:17:37 worker11 python3[57236]: [2018-06-10 06:17:37,686: ERROR/MainProcess] Unrecoverable error: AttributeError("'NoneType' object has no attribute 'fileno'",) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/celery/worker/__init__.py", line 206, in start self.blueprint.start(self) File "/usr/lib/python3/dist-packages/celery/bootsteps.py", line 123, in start step.start(parent) File "/usr/lib/python3/dist-packages/celery/bootsteps.py", line 374, in start return self.obj.start() File "/usr/lib/python3/dist-packages/celery/worker/consumer.py", line 279, in start blueprint.start(self) File "/usr/lib/python3/dist-packages/celery/bootsteps.py", line 123, in start step.start(parent) File "/usr/lib/python3/dist-packages/celery/worker/consumer.py", line 838, in start c.loop(*c.loop_args()) File "/usr/lib/python3/dist-packages/celery/worker/loops.py", line 41, in asynloop obj.controller.register_with_event_loop(hub) File "/usr/lib/python3/dist-packages/celery/worker/__init__.py", line 218, in register_with_event_loop description='hub.register', File "/usr/lib/python3/dist-packages/celery/bootsteps.py", line 155, in send_all fun(parent, *args) File "/usr/lib/python3/dist-packages/celery/worker/components.py", line 185, in register_with_event_loop w.pool.register_with_event_loop(hub) File "/usr/lib/python3/dist-packages/celery/concurrency/prefork.py", line 141, in register_with_event_loop return reg(loop) File "/usr/lib/python3/dist-packages/celery/concurrency/asynpool.py", line 448, in register_with_event_loop [self._track_child_process(w, hub) for w in self._pool] File "/usr/lib/python3/dist-packages/celery/concurrency/asynpool.py", line 448, in [self._track_child_process(w, hub) for w in self._pool] File "/usr/lib/python3/dist-packages/celery/concurrency/asynpool.py", line 431, in _track_child_process hub.add_reader(fd, self._event_process_exit, hub, proc) File "/usr/lib/python3/dist-packages/kombu/async/hub.py", line 210, in add_reader return self.add(fds, callback, READ | ERR, args) File "/usr/lib/python3/dist-packages/kombu/async/hub.py", line 160, in add fd = fileno(fd) File "/usr/lib/python3/dist-packages/kombu/utils/__init__.py", line 445, in fileno return f.fileno() AttributeError: 'NoneType' object has no attribute 'fileno'