Page MenuHomeSoftware Heritage

Add contextual info to compression script

Authored by haltode on Aug 5 2019, 2:37 PM.



Close T1877.

  • Show which compression step is currently being executed.
  • Time estimates are already there with webgraph environment.

Diff Detail

rDGRPH Graph service
Automatic diff as part of commit; lint not applicable.
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

haltode created this revision.Aug 5 2019, 2:37 PM
zack requested changes to this revision.Aug 5 2019, 3:26 PM
  • make the echo invocations a function, e.g., info()
  • use a common, but distinguishable prefix instead of just "#" which will allow to search for progress info in the potentially huge log-files, e.g., "* swh-graph:"
  • maybe add a step number v. total number of steps (e.g., 2/5)
This revision now requires changes to proceed.Aug 5 2019, 3:26 PM
haltode updated this revision to Diff 6122.Aug 5 2019, 3:32 PM
  • Refactor into a step_info function
  • Use "* swh-graph:" prefix
  • Add step numbering
zack accepted this revision.Aug 5 2019, 3:36 PM
This revision is now accepted and ready to land.Aug 5 2019, 3:36 PM
This revision was automatically updated to reflect the committed changes.