HomeSoftware Heritage

webgraph.py: use named pipes to read zst decompression output

This commit no longer exists in the repository. It may have been part of a branch which was deleted.

Description

webgraph.py: use named pipes to read zst decompression output

This avoids that the MPH step loads the full (decompressed!) nodes file in
memory.

To achieve this, force usage of /bin/bash as shell to run the various steps.

Details

Provenance
zackAuthored on Nov 8 2019, 11:05 AM
zackPushed on Nov 8 2019, 11:06 AM
Build Status
Buildable 8892
Build 12980: test-and-buildJenkins

Commit No Longer Exists

This commit no longer exists in the repository.