HomeSoftware Heritage

replay: do not crash if process_replay_objects_content() fails on one object

Description

replay: do not crash if process_replay_objects_content() fails on one object

Catch exceptions and log human readable ids of failed objects.

We do not want the whole process to stop if the copy of one object fails
(be it when reading or writing).

This is far from enough, we will have to deal with a better solution
(retry the requests to ward off temporary failures, better logging of failed
object ids, tooling for fixing these missed objects afterward...)

Details

Provenance
douarddaAuthored on Jun 11 2019, 5:34 PM
douarddaPushed on Jun 12 2019, 1:48 PM
Differential Revision
D1571: cli: fix brokers argument handling (+ a pile of small refactorings)
Parents
rDJNL7ed426b34a20: JournalClient: change the prefix init argument dafault value to None
Branches
Unknown
Tags
Unknown
Build Status
Buildable 6155
Build 8485: test-and-build