Page MenuHomeSoftware Heritage

Remove donwloaded package files once they have been processed
ClosedPublic

Authored by anlambert on May 14 2019, 5:04 PM.

Details

Summary

In order to regain some disk space while executing the npm loader, remove dowloaded package
files once they have been processed, including:

  • package version tarballs: remove them once their content have been unpacked
  • unpacked package version files: remove them once processed for their load into the archive

Diff Detail

Repository
rDLDNPM npm loader
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

anlambert created this revision.May 14 2019, 5:04 PM
olasd accepted this revision.May 14 2019, 5:08 PM
olasd added a subscriber: olasd.

Looks good, thanks!

swh/loader/npm/client.py
197

while you're moving this around you can switch the interpolation to a comma

swh/loader/npm/loader.py
247

Same remark here

This revision is now accepted and ready to land.May 14 2019, 5:08 PM
anlambert updated this revision to Diff 4803.May 14 2019, 5:15 PM

Update: use proper way for debug logs interpolation

This revision was automatically updated to reflect the committed changes.