Page MenuHomeSoftware Heritage
Paste P205

listener failure on connection issues with the rabbitmq instance
ActivePublic

Authored by ardumont on Dec 15 2017, 9:39 AM.
-- Unit swh-scheduler-listener.service has finished starting up.
--
-- The start-up result is done.
Nov 30 22:23:15 saatchi python3[25458]: Traceback (most recent call last):
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3.5/runpy.py", line 193, in _run_module_as_main
Nov 30 22:23:15 saatchi python3[25458]: "__main__", mod_spec)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
Nov 30 22:23:15 saatchi python3[25458]: exec(code, run_globals)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 156, in <module>
Nov 30 22:23:15 saatchi python3[25458]: event_monitor(main_app, main_backend)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 151, in event_monitor
Nov 30 22:23:15 saatchi python3[25458]: recv.capture(limit=None, timeout=None, wakeup=True)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/celery/events/__init__.py", line 339, in capture
Nov 30 22:23:15 saatchi python3[25458]: return list(self.consume(limit=limit, timeout=timeout, wakeup=wakeup))
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/kombu/mixins.py", line 199, in consume
Nov 30 22:23:15 saatchi python3[25458]: conn.drain_events(timeout=safety_interval)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/kombu/connection.py", line 275, in drain_events
Nov 30 22:23:15 saatchi python3[25458]: return self.transport.drain_events(self.connection, **kwargs)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/kombu/transport/pyamqp.py", line 95, in drain_events
Nov 30 22:23:15 saatchi python3[25458]: return connection.drain_events(**kwargs)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/amqp/connection.py", line 326, in drain_events
Nov 30 22:23:15 saatchi python3[25458]: return amqp_method(channel, args, content)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/amqp/channel.py", line 1906, in _basic_deliver
Nov 30 22:23:15 saatchi python3[25458]: fun(msg)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/kombu/messaging.py", line 598, in _receive_callback
Nov 30 22:23:15 saatchi python3[25458]: return on_m(message) if on_m else self.receive(decoded, message)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/kombu/messaging.py", line 564, in receive
Nov 30 22:23:15 saatchi python3[25458]: [callback(body, message) for callback in callbacks]
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/kombu/messaging.py", line 564, in <listcomp>
Nov 30 22:23:15 saatchi python3[25458]: [callback(body, message) for callback in callbacks]
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 38, in _receive
Nov 30 22:23:15 saatchi python3[25458]: self.process(type, body, message)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 44, in process
Nov 30 22:23:15 saatchi python3[25458]: handler and handler(event, message)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 104, in task_started
Nov 30 22:23:15 saatchi python3[25458]: 'message': message,
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 88, in queue_action
Nov 30 22:23:15 saatchi python3[25458]: try_perform_actions()
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 62, in try_perform_actions
Nov 30 22:23:15 saatchi python3[25458]: perform_actions(actions)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/swh/scheduler/celery_backend/listener.py", line 82, in perform_actions
Nov 30 22:23:15 saatchi python3[25458]: message.ack()
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/kombu/message.py", line 88, in ack
Nov 30 22:23:15 saatchi python3[25458]: self.channel.basic_ack(self.delivery_tag)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/amqp/channel.py", line 1581, in basic_ack
Nov 30 22:23:15 saatchi python3[25458]: self._send_method((60, 80), args)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/amqp/abstract_channel.py", line 56, in _send_method
Nov 30 22:23:15 saatchi python3[25458]: self.channel_id, method_sig, args, content,
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/amqp/method_framing.py", line 221, in write_method
Nov 30 22:23:15 saatchi python3[25458]: write_frame(1, channel, payload)
Nov 30 22:23:15 saatchi python3[25458]: File "/usr/lib/python3/dist-packages/amqp/transport.py", line 182, in write_frame
Nov 30 22:23:15 saatchi python3[25458]: frame_type, channel, size, payload, 0xce,
Nov 30 22:23:15 saatchi python3[25458]: ConnectionResetError: [Errno 104] Connection reset by peer
Nov 30 22:23:15 saatchi systemd[1]: swh-scheduler-listener.service: Main process exited, code=exited, status=1/FAILURE
Nov 30 22:23:15 saatchi systemd[1]: swh-scheduler-listener.service: Unit entered failed state.
Nov 30 22:23:15 saatchi systemd[1]: swh-scheduler-listener.service: Failed with result 'exit-code'.
Nov 30 22:23:15 saatchi systemd[1]: swh-scheduler-listener.service: Service hold-off time over, scheduling restart.
Nov 30 22:23:15 saatchi systemd[1]: Stopped Software Heritage scheduler listener.
-- Subject: Unit swh-scheduler-listener.service has finished shutting down