swh-lister_1 | [2021-07-22 11:16:22,656: DEBUG/ForkPoolWorker-1] Fetching URL https://gitlab.com/api/v4/projects?id_after=575090&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false
swh-lister_1 | [2021-07-22 11:16:23,364: WARNING/ForkPoolWorker-1] Unexpected HTTP status code 502 on https://gitlab.com/api/v4/projects?id_after=575090&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false: b'\n\n
\n \n 500 Error - GitLab\n \n\n\n\n\n\n \n 
\n
\n \n
\n
Bad gateway
\n
The web server reported a bad gateway error.
\n
\n - Ray ID: 672c41a9985d3316
\n - Your IP address: 78.192.232.58
\n - Error reference number: 502
\n - Cloudflare Location: Paris
\n
\n
\n\n
\n
Please see our status page for more information.
\n
\n\n\n'
swh-lister_1 | [2021-07-22 11:16:23,368: ERROR/ForkPoolWorker-1] Task swh.lister.gitlab.tasks.FullGitLabRelister[92b02cda-2ffe-4744-af4b-aac17c219899] raised unexpected: HTTPError('502 Server Error: Bad Gateway for url: https://gitlab.com/api/v4/projects?id_after=575090&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false')
swh-lister_1 | Traceback (most recent call last):
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/celery/app/trace.py", line 450, in trace_task
swh-lister_1 | R = retval = fun(*args, **kwargs)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/scheduler/task.py", line 55, in __call__
swh-lister_1 | result = super().__call__(*args, **kwargs)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/celery/app/trace.py", line 731, in __protected_call__
swh-lister_1 | return self.run(*args, **kwargs)
swh-lister_1 | File "/src/swh-lister/swh/lister/gitlab/tasks.py", line 21, in list_gitlab_full
swh-lister_1 | return lister.run().dict()
swh-lister_1 | File "/src/swh-lister/swh/lister/pattern.py", line 127, in run
swh-lister_1 | for page in self.get_pages():
swh-lister_1 | File "/src/swh-lister/swh/lister/gitlab/lister.py", line 178, in get_pages
swh-lister_1 | page_result = self.get_page_result(next_page)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/tenacity/__init__.py", line 324, in wrapped_f
swh-lister_1 | return self(f, *args, **kw)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/tenacity/__init__.py", line 404, in __call__
swh-lister_1 | do = self.iter(retry_state=retry_state)
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/tenacity/__init__.py", line 349, in iter
swh-lister_1 | return fut.result()
swh-lister_1 | File "/usr/local/lib/python3.7/concurrent/futures/_base.py", line 428, in result
swh-lister_1 | return self.__get_result()
swh-lister_1 | File "/usr/local/lib/python3.7/concurrent/futures/_base.py", line 384, in __get_result
swh-lister_1 | raise self._exception
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/tenacity/__init__.py", line 407, in __call__
swh-lister_1 | result = fn(*args, **kwargs)
swh-lister_1 | File "/src/swh-lister/swh/lister/gitlab/lister.py", line 150, in get_page_result
swh-lister_1 | response.raise_for_status()
swh-lister_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
swh-lister_1 | raise HTTPError(http_error_msg, response=self)
swh-lister_1 | requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: https://gitlab.com/api/v4/projects?id_after=575090&membership=false&order_by=id&owned=false&page=1&pagination=keyset&per_page=20&repository_checksum_failed=false&simple=false&sort=asc&starred=false&statistics=false&wiki_checksum_failed=false&with_custom_attributes=false&with_issues_enabled=false&with_merge_requests_enabled=false