Page MenuHomeSoftware Heritage
Paste P360

deposit failure on latest production
ActivePublic
Actions

Authored by ardumont on Feb 14 2019, 7:01 PM.
Feb 14 17:46:13 worker01 python3[2344]: [2019-02-14 17:46:13,609: ERROR/ForkPoolWorker-1] Task swh.deposit.loader.tasks.ChecksDepositTsk[e201d7a8-6f19-4248-a08c-d10874c2e6a3] raised unexpected: AttributeError("'DepositChecker' object has no attribute 'log'",)
Feb 14 17:46:13 worker01 python3[2344]: Traceback (most recent call last):
Feb 14 17:46:13 worker01 python3[2344]: File "/usr/lib/python3/dist-packages/swh/deposit/loader/checker.py", line 21, in check
Feb 14 17:46:13 worker01 python3[2344]: self.client.check(deposit_check_url)
Feb 14 17:46:13 worker01 python3[2344]: File "/usr/lib/python3/dist-packages/swh/deposit/client/__init__.py", line 208, in check
Feb 14 17:46:13 worker01 python3[2344]: raise ValueError(msg)
Feb 14 17:46:13 worker01 python3[2344]: ValueError: Problem when checking deposit /1/private/hal/228/check/
Feb 14 17:46:13 worker01 python3[2344]: During handling of the above exception, another exception occurred:
Feb 14 17:46:13 worker01 python3[2344]: Traceback (most recent call last):
Feb 14 17:46:13 worker01 python3[2344]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 382, in trace_task
Feb 14 17:46:13 worker01 python3[2344]: R = retval = fun(*args, **kwargs)
Feb 14 17:46:13 worker01 python3[2344]: File "/usr/lib/python3/dist-packages/swh/scheduler/task.py", line 45, in __call__
Feb 14 17:46:13 worker01 python3[2344]: return super().__call__(*args, **kwargs)
Feb 14 17:46:13 worker01 python3[2344]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 641, in __protected_call__
Feb 14 17:46:13 worker01 python3[2344]: return self.run(*args, **kwargs)
Feb 14 17:46:13 worker01 python3[2344]: File "/usr/lib/python3/dist-packages/swh/deposit/loader/tasks.py", line 36, in check_deposit
Feb 14 17:46:13 worker01 python3[2344]: return DepositChecker().check(deposit_check_url)
Feb 14 17:46:13 worker01 python3[2344]: File "/usr/lib/python3/dist-packages/swh/deposit/loader/checker.py", line 23, in check
Feb 14 17:46:13 worker01 python3[2344]: self.log.exception("Failure during check on '%s'" % (
Feb 14 17:46:13 worker01 python3[2344]: AttributeError: 'DepositChecker' object has no attribute 'log'
Feb 14 17:46:13 worker01 python3[2348]: [2019-02-14 17:46:13,609: ERROR/ForkPoolWorker-1] Task swh.deposit.loader.tasks.ChecksDepositTsk[e201d7a8-6f19-4248-a08c-d10874c2e6a3] raised unexpected: AttributeError("'DepositChecker' object has no attribute 'log'",)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/swh/deposit/loader/checker.py", line 21, in check
self.client.check(deposit_check_url)
File "/usr/lib/python3/dist-packages/swh/deposit/client/__init__.py", line 208, in check
raise ValueError(msg)
ValueError: Problem when checking deposit /1/private/hal/228/check/
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 382, in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/lib/python3/dist-packages/swh/scheduler/task.py", line 45, in __call__
return super().__call__(*args, **kwargs)
File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 641, in __protected_call__
return self.run(*args, **kwargs)
File "/usr/lib/python3/dist-packages/swh/deposit/loader/tasks.py", line 36, in check_deposit
return DepositChecker().check(deposit_check_url)
File "/usr/lib/python3/dist-packages/swh/deposit/loader/checker.py", line 23, in check
self.log.exception("Failure during check on '%s'" % (
AttributeError: 'DepositChecker' object has no attribute 'log'

Event Timeline

ardumont created this paste.Feb 14 2019, 7:01 PM
ardumont added a comment.Feb 14 2019, 9:04 PM

dashboard: http://kibana0.internal.softwareheritage.org:5601/app/kibana#/dashboard/8af97200-3093-11e9-b8ce-cf95f437ce37

ardumont added a comment.Feb 14 2019, 9:09 PM

Tasks concerned by this error:

softwareheritage-scheduler=> select tr.id, t.id, t.type, t.arguments from task_run tr inner join task t on tr.task=t.id where backend_id in ('e201d7a8-6f19-4248-a08c-d10874c2e6a3', '6984816c-
c491-43ac-8e11-4297b696219a');
    id     |    id     |            type            |                                 arguments
-----------+-----------+----------------------------+----------------------------------------------------------------------------
 427829072 | 127305947 | swh-deposit-archive-checks | {"args": [], "kwargs": {"deposit_check_url": "/1/private/hal/227/check/"}}
 427833364 | 127305948 | swh-deposit-archive-checks | {"args": [], "kwargs": {"deposit_check_url": "/1/private/hal/228/check/"}}
(2 rows)
ardumont mentioned this in rDDEPbe7aeb9d09e0: deposit.loader.checker: Fix logger initialization.Feb 14 2019, 9:15 PM
ardumont added a comment.Feb 14 2019, 9:15 PM

Rescheduling those:

swhscheduler@saatchi:~$ swh-scheduler -C /etc/softwareheritage/scheduler.yml task respawn 127305947 127305948
[INFO] swh.core.config -- Loading config file /etc/softwareheritage/scheduler.yml
Respawn tasks ('127305947', '127305948')
About · Developer information · Legal