Page MenuHomeSoftware Heritage

journal writer: only flush kafka once per batch
ClosedPublic

Authored by olasd on Nov 3 2022, 9:50 AM.

Details

Summary

This code was flushing kafka messages and waiting for the brokers on
every message, instead of just doing it once per batch.

Diff Detail

Repository
rDCIDX Metadata indexer
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

Build is green

Patch application report for D8803 (id=31727)

Rebasing onto 41e90e4ae6...

Current branch diff-target is up to date.
Changes applied before test
commit b7f04dd9d40dbe9463dbb1a2636d584efc82876c
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Thu Nov 3 09:49:03 2022 +0100

    journal writer: only flush kafka once per batch
    
    This code was flushing kafka messages and waiting for the brokers on
    every message, instead of just doing it once per batch.

See https://jenkins.softwareheritage.org/job/DCIDX/job/tests-on-diff/524/ for more details.

olasd requested review of this revision.Nov 3 2022, 9:55 AM
vlorentz added a subscriber: vlorentz.

aaah thanks, I meant to do that but forgot

This revision is now accepted and ready to land.Nov 3 2022, 1:01 PM