Page MenuHomeSoftware Heritage

docker/conf: Fix search journal client configurations
ClosedPublic

Authored by anlambert on Sep 8 2021, 4:42 PM.

Details

Summary

This fixes the following errors in related services:

swh-search-journal-client-objects_1  | Traceback (most recent call last):
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/bin/swh", line 8, in <module>
swh-search-journal-client-objects_1  |     sys.exit(main())
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/cli/__init__.py", line 185, in main
swh-search-journal-client-objects_1  |     return swh(auto_envvar_prefix="SWH")
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 829, in __call__
swh-search-journal-client-objects_1  |     return self.main(*args, **kwargs)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 782, in main
swh-search-journal-client-objects_1  |     rv = self.invoke(ctx)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
swh-search-journal-client-objects_1  |     return _process_result(sub_ctx.command.invoke(sub_ctx))
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
swh-search-journal-client-objects_1  |     return _process_result(sub_ctx.command.invoke(sub_ctx))
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
swh-search-journal-client-objects_1  |     return _process_result(sub_ctx.command.invoke(sub_ctx))
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
swh-search-journal-client-objects_1  |     return ctx.invoke(self.callback, **ctx.params)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 610, in invoke
swh-search-journal-client-objects_1  |     return callback(*args, **kwargs)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/decorators.py", line 21, in new_func
swh-search-journal-client-objects_1  |     return f(get_current_context(), *args, **kwargs)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/search/cli.py", line 136, in journal_client_objects
swh-search-journal-client-objects_1  |     storage = get_storage(**config["storage"])
swh-search-journal-client-objects_1  | KeyError: 'storage'
swh-search-journal-client-objects_1  | Traceback (most recent call last):
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/bin/swh", line 8, in <module>
swh-search-journal-client-objects_1  |     sys.exit(main())
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/core/cli/__init__.py", line 185, in main
swh-search-journal-client-objects_1  |     return swh(auto_envvar_prefix="SWH")
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 829, in __call__
swh-search-journal-client-objects_1  |     return self.main(*args, **kwargs)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 782, in main
swh-search-journal-client-objects_1  |     rv = self.invoke(ctx)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
swh-search-journal-client-objects_1  |     return _process_result(sub_ctx.command.invoke(sub_ctx))
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
swh-search-journal-client-objects_1  |     return _process_result(sub_ctx.command.invoke(sub_ctx))
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
swh-search-journal-client-objects_1  |     return _process_result(sub_ctx.command.invoke(sub_ctx))
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
swh-search-journal-client-objects_1  |     return ctx.invoke(self.callback, **ctx.params)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/core.py", line 610, in invoke
swh-search-journal-client-objects_1  |     return callback(*args, **kwargs)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/click/decorators.py", line 21, in new_func
swh-search-journal-client-objects_1  |     return f(get_current_context(), *args, **kwargs)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/search/cli.py", line 143, in journal_client_objects
swh-search-journal-client-objects_1  |     nb_messages = client.process(worker_fn)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/journal/client.py", line 265, in process
swh-search-journal-client-objects_1  |     batch_processed, at_eof = self.handle_messages(messages, worker_fn)
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/journal/client.py", line 292, in handle_messages
swh-search-journal-client-objects_1  |     worker_fn(dict(objects))
swh-search-journal-client-objects_1  |   File "/srv/softwareheritage/venv/lib/python3.7/site-packages/swh/search/journal_client.py", line 72, in process_journal_objects
swh-search-journal-client-objects_1  |     assert set(messages) <= EXPECTED_MESSAGE_TYPES, set(messages)
swh-search-journal-client-objects_1  | AssertionError: {'origin_visit'}

Diff Detail

Repository
rDENV Development environment
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.