Page MenuHomeSoftware Heritage

Make the number of messages processed at a time by journal clients configurable
ClosedPublic

Authored by olasd on Mar 10 2020, 7:34 PM.

Details

Summary

This setting needs to be tuned differently for different topics, as the size of
objects varies quite wildly. Bumping the default to 200 reduces chatter in the
consumer group which should reduce the amount of bandwidth used for consumption.

Depends on D2806

Test Plan

new test added to verify use of the batch_size parameter

Diff Detail

Repository
rDJNL Journal infrastructure
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

This revision is now accepted and ready to land.Mar 10 2020, 7:47 PM
This revision was landed with ongoing or failed builds.Mar 10 2020, 7:56 PM
This revision was automatically updated to reflect the committed changes.