HomeSoftware Heritage

webgraph.py: use named pipes to read zst decompression output

Description

webgraph.py: use named pipes to read zst decompression output

This avoids that the MPH step loads the full (decompressed!) nodes file in
memory.

To achieve this, force usage of /bin/bash as shell to run the various steps.

Details

Provenance
zackAuthored on Nov 8 2019, 11:05 AM
zackPushed on Nov 8 2019, 11:06 AM
Parents
rDGRPH5027a9e44751: Setup.java: remove unused import
Branches
Unknown
Tags
Unknown
References
tag: v0.2.0
Build Status
Buildable 8892
Build 12980: test-and-buildJenkins