Deployments:
Plan:
After some tampering with the actual queue in scheduler0.staging (cleaning that up, it's staging so fine).
And limiting the number to less than 10k (100 is enough, way less workers).
We now have some github origins properly scheduled with their lister_name=github and lister_instance_name=github.
This now results in extrinsic metadata being fetched for those origins [1] (without me having to trigger the swh loader run cli).
So it works!
[1]
12:20:22 swh@db1:5432=> select now(), count(*) from raw_extrinsic_metadata where target > 'swh:1:ori:' and format='application/vnd.github.v3+json' ; +-------------------------------+-------+ | now | count | +-------------------------------+-------+ | 2022-04-28 10:20:45.241842+00 | 20 | +-------------------------------+-------+ (1 row) Time: 90.914 ms 12:20:45 swh@db1:5432=> select now(), count(*) from raw_extrinsic_metadata where target > 'swh:1:ori:' and format='application/vnd.github.v3+json' ; +-------------------------------+-------+ | now | count | +-------------------------------+-------+ | 2022-04-28 10:28:09.050765+00 | 61 | +-------------------------------+-------+ (1 row) Time: 112.825 ms