Page MenuHomeSoftware Heritage

Add contextual info to compression script
ClosedPublic

Authored by haltode on Aug 5 2019, 2:37 PM.

Details

Summary

Close T1877.

  • Show which compression step is currently being executed.
  • Time estimates are already there with webgraph environment.

Diff Detail

Repository
rDGRPH Compressed graph representation
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

zack requested changes to this revision.Aug 5 2019, 3:26 PM
  • make the echo invocations a function, e.g., info()
  • use a common, but distinguishable prefix instead of just "#" which will allow to search for progress info in the potentially huge log-files, e.g., "* swh-graph:"
  • maybe add a step number v. total number of steps (e.g., 2/5)
This revision now requires changes to proceed.Aug 5 2019, 3:26 PM
  • Refactor into a step_info function
  • Use "* swh-graph:" prefix
  • Add step numbering
This revision is now accepted and ready to land.Aug 5 2019, 3:36 PM
This revision was automatically updated to reflect the committed changes.