HomeSoftware Heritage

Simplify the lo/high partition offset computation

Description

Simplify the lo/high partition offset computation

The computation of lo and high offsets used to be done in 2 steps:

  • first get the watermak offsets (thus the absolute min and max offsets of the whole partition)
  • then, as a "hook" in process(), retrieve the last committed offset for the partition and "push" these current offsets in the progress queue.

Instead, this simplifies a bit this process by quering the committed
offsets while computing the hi/low offsets.

Details

Provenance
douarddaAuthored on Sep 9 2021, 11:39 AM
douarddaPushed on Sep 13 2021, 3:33 PM
Differential Revision
D6232: Simplify the lo/high partition offset computation
Parents
rDDATASETe47a3db1287b: Use proper signature for JournalClientOffsetRanges.process()
Branches
Unknown
Tags
Unknown
Build Status
Buildable 23548
Build 36739: test-and-buildJenkins console · Jenkins