rebase

yes

order sounds best. Do you want to do it?

We decided to add recurring fetches, so it will take care both of backfilling now, and visiting from time to time in the future. We're going to assume 3 months for now, as it seems reasonable to not exhaust rate limits.

nice

ah, so it doesn't matter for other loaders. Phew!

Does it mean we were silently dropping data until this? Which loaders use this?

Could you add this check?

Let's see how this goes: https://github.com/hexpm/hexpm/pull/1168

You need to pass complete_qs to requests_mock to actually test the query string: https://requests-mock.readthedocs.io/en/latest/matching.html#query-strings (and then you'll need to add the sort param, because it's missing from tests).

remove logs

fix copyright header

@anlambert Shouldn't this be replaced by swh auth generate-token?

In D8906#231560, @jayeshv wrote:

Thanks, just fixed it :)

.lstrip() and .rstrip() are not .removeprefix() and .removesuffix():

fix rebase

fix incorrect decompressed path

rebase