Page MenuHomeSoftware Heritage

Make the previously loaded artifacts a list rather than an iterator
ClosedPublic

Authored by olasd on Sep 18 2018, 2:47 PM.

Details

Summary

That's needed as we check its contents once per version referenced in the list
of upstream releases.

Test Plan

Running the loader twice on the same module now only loads each artifact once

Diff Detail

Repository
rDLDPY PyPI loader
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

ardumont added a subscriber: ardumont.

Running the loader twice on the same module now only loads each artifact once

I thought i tested that though [1]

https://forge.softwareheritage.org/source/swh-loader-pypi/browse/master/swh/loader/pypi/tests/test_loader.py$228

swh/loader/pypi/loader.py
113–116

Not a blocker.

That should always be the case here. fetch_data builds the revision that way.

This revision is now accepted and ready to land.Sep 18 2018, 3:00 PM
This revision was automatically updated to reflect the committed changes.