Page MenuHomeSoftware Heritage

Send smaller batches to origin_get.

Authored by vlorentz on Jul 19 2019, 3:52 PM.



Avoids getting a timeout.

Diff Detail

rDCIDX Metadata indexer
Automatic diff as part of commit; lint not applicable.
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

vlorentz created this revision.Jul 19 2019, 3:52 PM
vlorentz updated this revision to Diff 5904.Jul 19 2019, 3:58 PM

consume the generator

ardumont accepted this revision.Jul 19 2019, 4:05 PM
ardumont added subscribers: douardda, ardumont.

It worked for revisions indeed.

I feel like this must be hidden as implementation detail in swh-storage though.

@douardda ping for when you come back ;)

I'll accept in the mean time.

This revision is now accepted and ready to land.Jul 19 2019, 4:05 PM
This revision was automatically updated to reflect the committed changes.