Page MenuHomeSoftware Heritage

D6233.id22615.diff
No OneTemporary

D6233.id22615.diff

diff --git a/swh/dataset/journalprocessor.py b/swh/dataset/journalprocessor.py
--- a/swh/dataset/journalprocessor.py
+++ b/swh/dataset/journalprocessor.py
@@ -89,6 +89,7 @@
if offset >= self.offset_ranges[partition_id][1] - 1:
if partition_id in self.assignment:
+ self.progress_queue.put({partition_id: offset})
self.assignment = [
pid for pid in self.assignment if pid != partition_id
]
@@ -248,7 +249,7 @@
active_workers -= 1
continue
d.update(item)
- progress = sum(n - self.offsets[p][0] for p, n in d.items())
+ progress = sum(n + 1 - self.offsets[p][0] for p, n in d.items())
pbar.set_postfix(
active_workers=active_workers, total_workers=self.processes
)

File Metadata

Mime Type
text/plain
Expires
Thu, Jul 3, 1:34 PM (6 d, 9 h ago)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
3221139

Event Timeline