In the branch experiments of swh-scanner there is some benchmark code to compare various algorithms for querying the backend (the default one: "stopngo", but also others likes file and directory priorities).

We want to integrate that code into the master branch, making the algo selectable with a --policy flag.