Page MenuHomeSoftware Heritage

Fix vault end-to-end check
Open, NormalPublic

Description

Something is amiss in that check somehow [1] [2]

It's working from the main archive, taking the directory id from the stacktrace, make that a swhid, lookup for it, trigger the cooking.
Result, it's cooked and the download can happen so it works afaiui.

[1] https://icinga.softwareheritage.org/dashboard#!/monitoring/service/show?host=pergamon.softwareheritage.org&service=Check%20vault%20end-to-end

[2] Reproduced directly from the host triggering the check:

swhworker@pergamon:~$ /usr/bin/swh icinga_plugins check-vault --swh-storage-url http://uffizi.internal.softwareheritage.org:5002 --swh-web-url https://archive.softwareheritage.org directory
Traceback (most recent call last):
  File "/usr/bin/swh", line 11, in <module>
    load_entry_point('swh.core==0.8.0', 'console_scripts', 'swh')()
  File "/usr/lib/python3/dist-packages/swh/core/cli/__init__.py", line 135, in main
    return swh(auto_envvar_prefix="SWH")
  File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/lib/python3/dist-packages/swh/icinga_plugins/cli.py", line 56, in check_vault_directory
    sys.exit(VaultCheck(ctx.obj).main())
  File "/usr/lib/python3/dist-packages/swh/icinga_plugins/vault.py", line 61, in main
    assert response.status_code == 200, (response, response.text)
AssertionError: (<Response [404]>, '{"exception":"NotFoundExc","reason":"Cooking of directory \'a62945e49c922e2eeded1cbf4c957396a1e7e321\' was never requested."}')
swhworker@pergamon:~$ /usr/bin/swh icinga_plugins check-vault --swh-storage-url http://uffizi.internal.softwareheritage.org:5002 --swh-web-url https://archive.softwareheritage.org directory
Traceback (most recent call last):
  File "/usr/bin/swh", line 11, in <module>
    load_entry_point('swh.core==0.8.0', 'console_scripts', 'swh')()
  File "/usr/lib/python3/dist-packages/swh/core/cli/__init__.py", line 135, in main
    return swh(auto_envvar_prefix="SWH")
  File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/lib/python3/dist-packages/swh/icinga_plugins/cli.py", line 56, in check_vault_directory
    sys.exit(VaultCheck(ctx.obj).main())
  File "/usr/lib/python3/dist-packages/swh/icinga_plugins/vault.py", line 61, in main
    assert response.status_code == 200, (response, response.text)
AssertionError: (<Response [404]>, '{"exception":"NotFoundExc","reason":"Cooking of directory \'436807ce5f6c5e98cf05c85b1f6058db38bf1c8c\' was never requested."}')

Event Timeline

ardumont triaged this task as Normal priority.Fri, Nov 13, 12:41 PM
ardumont created this task.