Page MenuHomeSoftware Heritage
Paste P359

(fixed) latest production: gitlab lister failure
ActivePublic

Authored by ardumont on Feb 14 2019, 3:39 PM.
Feb 14 14:24:05 worker01 python3[4534]: [2019-02-14 14:24:05,077: ERROR/ForkPoolWorker-1] Task swh.lister.gitlab.tasks.IncrementalGitLabLister[f7f2d92d-bfa9-4994-a637-e3859a73f432] raised unexpected: TypeError('incremental_gitlab_lister() takes 0 positional arguments but 1 was given',)
Feb 14 14:24:05 worker01 python3[4534]: Traceback (most recent call last):
Feb 14 14:24:05 worker01 python3[4534]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 382, in trace_task
Feb 14 14:24:05 worker01 python3[4534]: R = retval = fun(*args, **kwargs)
Feb 14 14:24:05 worker01 python3[4534]: File "/usr/lib/python3/dist-packages/swh/scheduler/task.py", line 45, in __call__
Feb 14 14:24:05 worker01 python3[4534]: return super().__call__(*args, **kwargs)
Feb 14 14:24:05 worker01 python3[4534]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 641, in __protected_call__
Feb 14 14:24:05 worker01 python3[4534]: return self.run(*args, **kwargs)
Feb 14 14:24:05 worker01 python3[4534]: TypeError: incremental_gitlab_lister() takes 0 positional arguments but 1 was given
Feb 14 14:24:05 worker01 python3[4538]: [2019-02-14 14:24:05,077: ERROR/ForkPoolWorker-1] Task swh.lister.gitlab.tasks.IncrementalGitLabLister[f7f2d92d-bfa9-4994-a637-e3859a73f432] raised unexpected: TypeError('incremental_gitlab_lister() takes 0 positional arguments but 1 was given',)
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 382, in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/lib/python3/dist-packages/swh/scheduler/task.py", line 45, in __call__
return super().__call__(*args, **kwargs)
File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 641, in __protected_call__
return self.run(*args, **kwargs)
TypeError: incremental_gitlab_lister() takes 0 positional arguments but 1 was given

Event Timeline

softwareheritage-scheduler=> select t.id, t.arguments, tr.status, tr.ended from task_run tr inner join task t on tr.task=t.id where t.type='swh-lister-gitlab-incremental' limit 10;
    id     |                                            arguments                                             |   status   |             ended
-----------+--------------------------------------------------------------------------------------------------+------------+-------------------------------
 104296277 | {"args": [{"instance": "framagit", "api_baseurl": "https://framagit.org/api/v4"}], "kwargs": {}} | failed     | 2019-02-14 14:24:05.082527+00

This has been fixed.
The code changed the expected input.
We adapted the content of the lister tasks.

softwareheritage-scheduler=> select arguments from task where type in ('swh-lister-gitlab-full', 'swh-lister-gitlab-incremental');
                                           arguments
------------------------------------------------------------------------------------------------
 {"args": [], "kwargs": {"instance": "gitlab", "api_baseurl": "https://gitlab.com/api/v4"}}
 {"args": [], "kwargs": {"instance": "framagit", "api_baseurl": "https://framagit.org/api/v4"}}
 {"args": [], "kwargs": {"instance": "riseup", "api_baseurl": "https://0xacab.org/api/v4"}}
 {"args": [], "kwargs": {"instance": "inria", "api_baseurl": "https://gitlab.inria.fr/api/v4"}}
 {"args": [], "kwargs": {"instance": "framagit", "api_baseurl": "https://framagit.org/api/v4"}}
 {"args": [], "kwargs": {"instance": "gitlab", "api_baseurl": "https://gitlab.com/api/v4"}}
 {"args": [], "kwargs": {"instance": "riseup", "api_baseurl": "https://0xacab.org/api/v4"}}
 {"args": [], "kwargs": {"instance": "inria", "api_baseurl": "https://gitlab.inria.fr/api/v4"}}
(8 rows)
ardumont changed the title of this paste from latest production: gitlab lister failure to (fixed) latest production: gitlab lister failure.Feb 15 2019, 6:54 PM