When not in the direntry cache, ls history/by-date/ can still take 1-2s for ~10k commits. One idea could be to put the entries in cache (even if the directory is not yet fully populated) and update the direntry cache based on some time delay.