Page MenuHomeSoftware Heritage

Consume messages from Kafka in batches of 20.
ClosedPublic

Authored by vlorentz on Oct 28 2019, 2:19 PM.

Details

Summary

Instead of one-by-one.
It's probably more efficient, and seems to partially mitigates T2034.

Depends on D2203

Diff Detail

Repository
rDJNL Journal infrastructure
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

vlorentz created this revision.Oct 28 2019, 2:19 PM
vlorentz updated this revision to Diff 7445.Oct 28 2019, 3:16 PM

implement consume() in mock consumer.

olasd accepted this revision.Oct 29 2019, 1:33 PM
This revision is now accepted and ready to land.Oct 29 2019, 1:33 PM
vlorentz updated this revision to Diff 7513.Oct 30 2019, 3:36 PM

Fix non-deterministic test failures + make them faster.

vlorentz requested review of this revision.Oct 30 2019, 3:37 PM
vlorentz edited the summary of this revision. (Show Details)

@olasd I made some major changes, please review again

vlorentz updated this revision to Diff 7514.Oct 30 2019, 3:37 PM

fix base commit

olasd accepted this revision.Oct 30 2019, 3:59 PM
This revision is now accepted and ready to land.Oct 30 2019, 3:59 PM
This revision was automatically updated to reflect the committed changes.