Page MenuHomeSoftware Heritage

journal writer: only flush kafka once per batch
ClosedPublic

Authored by olasd on Nov 3 2022, 9:50 AM.

Details

Summary

This code was flushing kafka messages and waiting for the brokers on
every message, instead of just doing it once per batch.

Diff Detail

Repository
rDCIDX Metadata indexer
Branch
master
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 32681
Build 51198: Phabricator diff pipeline on jenkinsJenkins console · Jenkins
Build 51197: arc lint + arc unit

Event Timeline

Build is green

Patch application report for D8803 (id=31727)

Rebasing onto 41e90e4ae6...

Current branch diff-target is up to date.
Changes applied before test
commit b7f04dd9d40dbe9463dbb1a2636d584efc82876c
Author: Nicolas Dandrimont <nicolas@dandrimont.eu>
Date:   Thu Nov 3 09:49:03 2022 +0100

    journal writer: only flush kafka once per batch
    
    This code was flushing kafka messages and waiting for the brokers on
    every message, instead of just doing it once per batch.

See https://jenkins.softwareheritage.org/job/DCIDX/job/tests-on-diff/524/ for more details.

olasd requested review of this revision.Nov 3 2022, 9:55 AM
vlorentz added a subscriber: vlorentz.

aaah thanks, I meant to do that but forgot

This revision is now accepted and ready to land.Nov 3 2022, 1:01 PM