Page MenuHomeSoftware Heritage

Send smaller batches to revision_get
ClosedPublic

Authored by vlorentz on Jul 18 2019, 4:55 PM.

Details

Summary

to avoid getting a timeout.

Diff Detail

Repository
rDCIDX Metadata indexer
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

vlorentz created this revision.Jul 18 2019, 4:55 PM
ardumont accepted this revision.Jul 18 2019, 5:53 PM
ardumont added inline comments.
swh/indexer/metadata.py
287

i'm wondering whether that should be storage side or not ;)
(what i suggested earlier was possibly to do that storage side)

Well, we'll see what this does.

This revision is now accepted and ready to land.Jul 18 2019, 5:53 PM
vlorentz added inline comments.Jul 19 2019, 11:15 AM
swh/indexer/metadata.py
287

Doing it on the storage side is exactly the same as increasing the timeout.

This revision was automatically updated to reflect the committed changes.