HomeSoftware Heritage

Unify retry/error handling for content replay

Description

Unify retry/error handling for content replay

This uses a custom wrapper exception and tenacity callbacks to log exceptions
when the copy of a given content fails several times. This makes the consumer
more robust (fewer crashes), which in turns allows fewer consumer rebalances,
which finally drastically reduces the consumer bandwidth consumption.

At this point, the retry of "definitely" failed content replays needs to be
handled separately.

Details

Provenance
olasdAuthored on Mar 2 2020, 5:27 PM
olasdPushed on Mar 6 2020, 4:13 PM
Differential Revision
D2782: Unify retry/error handling for content replay
Parents
rDJNL06688ba038e3: Make the flaky object storage generic
Branches
Unknown
Tags
Unknown
Build Status
Buildable 10984
Build 16531: test-and-buildJenkins