HomeSoftware Heritage

swh.scheduler.backend_es: Return operation failure instead of raising

Description

swh.scheduler.backend_es: Return operation failure instead of raising

Prior to this commit, an error would raise and stop all indexation.
As the code is already waiting for a tuple (operation-status, item),
we instead leverage this and continue working on indexation.

All items whose operation-status is False (meaning failure to index,
whatever the reason) is not indexed. Another run would then pickup
the leftover and index it.

Related T986

Details

Provenance
ardumontAuthored on Apr 10 2018, 2:42 PM
ardumontPushed on Apr 10 2018, 5:47 PM
Parents
rDSCH9b9b88c62b7f: d/control: Update to recent python3-elasticsearch client
Branches
Unknown
Tags
Unknown