Investigate build failures on the swh-docker and swh-environment build in the ci:
- Several segmentation fault:
15:07:10 Thread 0x00007f8b49570740 (most recent call first): 15:07:10 File "/usr/lib/python3.7/selectors.py", line 415 in select 15:07:10 File "/usr/lib/python3.7/socketserver.py", line 232 in serve_forever 15:07:10 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/werkzeug/serving.py", line 777 in serve_forever ... 15:07:10 File "/usr/lib/python3.7/multiprocessing/context.py", line 277 in _Popen 15:07:10 File "/usr/lib/python3.7/multiprocessing/context.py", line 223 in _Popen 15:07:10 File "/usr/lib/python3.7/multiprocessing/process.py", line 112 in start 15:07:10 File "/home/jenkins/workspace/DENV/tests/swh-core/swh/core/api/tests/server_testing.py", line 74 in start_server 15:07:10 File "/home/jenkins/workspace/DENV/tests/swh-core/swh/core/api/tests/server_testing.py", line 35 in setUp 15:07:10 File "/home/jenkins/workspace/DENV/tests/swh-search/swh/search/tests/test_api_client.py", line 39 in setUp ... 15:07:10 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/_pytest/config/__init__.py", line 185 in console_main 15:07:10 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pytest/__main__.py", line 5 in <module> 15:07:10 File "/usr/lib/python3.7/runpy.py", line 85 in _run_code 15:07:10 File "/usr/lib/python3.7/runpy.py", line 193 in _run_module_as_main 15:07:11 F.........s......... [ 20%] 15:07:22 [ 20%] 15:07:22 swh/search/tests/test_cli.py ..Fatal Python error: Segmentation fault
14:55:36 swh/indexer/tests/test_codemeta.py ..Fatal Python error: Segmentation fault 14:55:36 14:55:36 Current thread 0x00007fa582b57740 (most recent call first): 14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 6542 in freeze 14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 5530 in _get_initial_context 14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 855 in expand 14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 163 in expand 14:55:36 File "/home/jenkins/workspace/DENV/tests/swh-indexer/swh/indexer/codemeta.py", line 131 in expand 14:55:36 File "/home/jenkins/workspace/DENV/tests/swh-indexer/swh/indexer/codemeta.py", line 173 in merge_documents 14:55:36 File "/home/jenkins/workspace/DENV/tests/swh-indexer/swh/indexer/tests/test_codemeta.py", line 86 in test_merge_documents ... 14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pytest/__main__.py", line 5 in <module> 14:55:36 File "/usr/lib/python3.7/runpy.py", line 85 in _run_code 14:55:36 File "/usr/lib/python3.7/runpy.py", line 193 in _run_module_as_main 14:55:38 make: *** [../Makefile.python:20: test] Segmentation fault (core dumped) 14:55:38 python3 -m pytest .
- several deposit failures:
15:00:15 __________________________ test_deposit_loading_ok_2 ___________________________ 15:00:15 15:00:15 swh_storage = <swh.storage.proxies.retry.RetryingProxyStorage object at 0x7f89ac1f0240> 15:00:15 deposit_client = <swh.loader.package.deposit.loader.ApiClient object at 0x7f89ac13de80> 15:00:15 requests_mock_datadir = <requests_mock.mocker.Mocker object at 0x7f89ac13d588> ... 15:00:15 # Retrieve the release 15:00:15 release = loader.storage.release_get([hash_to_bytes(release_id)])[0] 15:00:15 assert release 15:00:15 > assert release.date.to_dict() == raw_meta["deposit"]["author_date"] 15:00:15 E AssertionError: assert {'negative_ut...: 1507389428}} == {'negative_ut...: 1507389428}} 15:00:15 E Omitting 3 identical items, use -vv to show 15:00:15 E Left contains 1 more item: 15:00:15 E {'offset_bytes': b'+0000'} 15:00:15 E Use -v to get the full diff
14:55:03 swh/deposit/tests/api/test_deposit_private_read_metadata.py:337: 14:55:03 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/test.py:289: in get 14:55:03 response = super().get(path, data=data, **extra) 14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/test.py:206: in get 14:55:03 return self.generic('GET', path, **r) 14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/test.py:235: in generic 14:55:03 method, path, data, content_type, secure, **extra) 14:55:03 ../.venv/lib/python3.7/site-packages/django/test/client.py:422: in generic ... 14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/views.py:506: in dispatch 14:55:03 response = handler(request, *args, **kwargs) 14:55:03 swh/deposit/api/private/__init__.py:86: in get 14:55:03 return super().get(request, collection_name, deposit_id) 14:55:03 swh/deposit/api/common.py:1093: in get 14:55:03 json.dumps(content), status=status, content_type=content_type 14:55:03 /usr/lib/python3.7/json/__init__.py:231: in dumps 14:55:03 return _default_encoder.encode(obj) 14:55:03 /usr/lib/python3.7/json/encoder.py:199: in encode 14:55:03 chunks = self.iterencode(o, _one_shot=True) 14:55:03 /usr/lib/python3.7/json/encoder.py:257: in iterencode 14:55:03 return _iterencode(o, 0) ... 14:55:03 > raise TypeError(f'Object of type {o.__class__.__name__} ' 14:55:03 f'is not JSON serializable') 14:55:03 E TypeError: Object of type bytes is not JSON serializable 14:55:03 14:55:03 /usr/lib/python3.7/json/encoder.py:179: TypeError
None of these problems occurs on the master builds