HomeSoftware Heritage

Setup.java: shell out node2pid map generation to sort

Description

Setup.java: shell out node2pid map generation to sort

This floors the maximum amount of RAM that will be used for this step, avoiding
OOM kills. By relying on GNU sort we use an industry-grade tool for this kind
of stuff, paging to disk as needed.

Closes T1950

Details

Provenance
zackAuthored on Nov 5 2019, 3:24 PM
zackPushed on Nov 5 2019, 3:46 PM
Parents
rDGRPHf246fa859213: Makefile: add generic java-* dispatcher target
Branches
Unknown
Tags
Unknown
Tasks
T1950: Reduce RAM usage for generating mapping files