Diffusion Compressed graph representation 6d2f04b4d5a4

Setup.java: shell out node2pid map generation to sort
6d2f04b4d5a4
Actions

Description

Setup.java: shell out node2pid map generation to sort

This floors the maximum amount of RAM that will be used for this step, avoiding
OOM kills. By relying on GNU sort we use an industry-grade tool for this kind
of stuff, paging to disk as needed.

Closes T1950

Details

Provenance

zack	Authored on Nov 5 2019, 3:24 PM
zack	Pushed on Nov 5 2019, 3:46 PM

Tasks

T1950: Reduce RAM usage for generating mapping files

Event Timeline

zack added a task: T1950: Reduce RAM usage for generating mapping files.Nov 5 2019, 3:46 PM

zack committed rDGRPH6d2f04b4d5a4: Setup.java: shell out node2pid map generation to sort (authored by zack).Nov 5 2019, 3:41 PM

zack mentioned this in T1950: Reduce RAM usage for generating mapping files.Nov 7 2019, 11:35 PM

Commit No Longer Exists

This commit no longer exists in the repository.