https://archive.softwareheritage.org/browse/ is currently being crawled by a random bot.

While this bot is quite slow and therefore doesn't incur much load, I don't think being indexed is generally desirable, at least for now; We should look at what other endpoints we should add to the current robots.txt.