Page MenuHomeSoftware Heritage

Add contextual info to compression script
ClosedPublic

Authored by haltode on Aug 5 2019, 2:37 PM.

Details

Summary

Close T1877.

  • Show which compression step is currently being executed.
  • Time estimates are already there with webgraph environment.

Diff Detail

Repository
rDGRPH Compressed graph representation
Branch
docker-pipeline-info
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 7151
Build 10088: arc lint + arc unit

Event Timeline

zack requested changes to this revision.Aug 5 2019, 3:26 PM
  • make the echo invocations a function, e.g., info()
  • use a common, but distinguishable prefix instead of just "#" which will allow to search for progress info in the potentially huge log-files, e.g., "* swh-graph:"
  • maybe add a step number v. total number of steps (e.g., 2/5)
This revision now requires changes to proceed.Aug 5 2019, 3:26 PM
  • Refactor into a step_info function
  • Use "* swh-graph:" prefix
  • Add step numbering
This revision is now accepted and ready to land.Aug 5 2019, 3:36 PM
This revision was automatically updated to reflect the committed changes.