HomeSoftware Heritage

loader, cvsclient: Read files line by line to reduce memory consumption

This commit no longer exists in the repository. It may have been part of a branch which was deleted.

Description

loader, cvsclient: Read files line by line to reduce memory consumption

Instead of using the readlines method on file objects that retrieve all
lines of a file and store them in memory, prefer to read files line
by line by using the lazy generator of lines from file objects.

This significantly reduce loader memory consumption when processing
a large rlog output stored in a file.

Details

Provenance
anlambertAuthored on Oct 14 2022, 11:33 AM
anlambertPushed on Oct 17 2022, 10:50 AM
Differential Revision
D8683: loader, cvsclient: Read files line by line to reduce memory consumption
Build Status
Buildable 32314
Build 50614: test-and-buildJenkins console · Jenkins

Commit No Longer Exists

This commit no longer exists in the repository.