Page Menu
Home
Software Heritage
Search
Configure Global Search
Log In
Files
F9343489
D6233.id22615.diff
No One
Temporary
Actions
View File
Edit File
Delete File
View Transforms
Subscribe
Mute Notifications
Award Token
Flag For Later
Size
902 B
Subscribers
None
D6233.id22615.diff
View Options
diff --git a/swh/dataset/journalprocessor.py b/swh/dataset/journalprocessor.py
--- a/swh/dataset/journalprocessor.py
+++ b/swh/dataset/journalprocessor.py
@@ -89,6 +89,7 @@
if offset >= self.offset_ranges[partition_id][1] - 1:
if partition_id in self.assignment:
+ self.progress_queue.put({partition_id: offset})
self.assignment = [
pid for pid in self.assignment if pid != partition_id
]
@@ -248,7 +249,7 @@
active_workers -= 1
continue
d.update(item)
- progress = sum(n - self.offsets[p][0] for p, n in d.items())
+ progress = sum(n + 1 - self.offsets[p][0] for p, n in d.items())
pbar.set_postfix(
active_workers=active_workers, total_workers=self.processes
)
File Metadata
Details
Attached
Mime Type
text/plain
Expires
Thu, Jul 3, 1:34 PM (6 d, 5 h ago)
Storage Engine
blob
Storage Format
Raw Data
Storage Handle
3221139
Attached To
D6233: Make sure the progress bar for the export reaches 100%
Event Timeline
Log In to Comment