HomeSoftware Heritage

swh-dedup-blocks: multiprocess implementation

Description

swh-dedup-blocks: multiprocess implementation

down to 25m for linux.git, from 1h for the single process version, from 14h for
the sqlite3 version

Details

Provenance
zackAuthored on Jan 7 2018, 10:50 PM
zackPushed on Jan 7 2018, 10:52 PM
Parents
rDSNIPb9d742eed04f: swh-dedup-blocks: use postgres to store deduplication results
Branches
Unknown
Tags
Unknown