Deploy loader.metadata credentials for high and oneshot loaders
Closed, MigratedEdits Locked
Actions

Assigned To

Authored By

	ardumont
	May 13 2022, 5:11 PM

Description

As well.

Otherwise, they get rate limited when triggering their loading.
That might be arguably fine for oneshot loaders which are only
helping other workers with the ingestions.

It's not fine for the high priority loaders which are expected to answer fast (save code now).

May 13 14:44:30 worker18 python3[1693713]: [2022-05-13 14:44:30,970: INFO/ForkPoolWorker-207] Rate limits exhausted for all tokens. Sleeping for 3398.029220 seconds.
May 13 14:45:21 worker18 python3[1692790]: [2022-05-13 14:45:21,137: INFO/ForkPoolWorker-197] Task swh.loader.git.tasks.UpdateGitRepository[41f1e5de-9994-43a8-88c0-1b2086b9ab76] succeeded in 239.5409866529517s: {'status': 'eventful'}
May 13 14:45:25 worker18 python3[1673353]: [2022-05-13 14:45:25,895: INFO/MainProcess] Received task: swh.loader.git.tasks.UpdateGitRepository[c6789ee1-dc72-4c55-86a9-774f7b8d8c2e]
May 13 14:45:26 worker18 python3[1694168]: [2022-05-13 14:45:26,057: INFO/ForkPoolWorker-208] Load origin 'https://github.com/nboute/fractol_new' with type 'git'
May 13 14:45:26 worker18 python3[1694168]: [2022-05-13 14:45:26,124: WARNING/ForkPoolWorker-208] No tokens set in configuration, using anonymous mode
May 13 14:45:26 worker18 python3[1694168]: [2022-05-13 14:45:26,274: INFO/ForkPoolWorker-208] Rate limits exhausted for all tokens. Sleeping for 3343.725802 seconds.

Revisions and Commits

rSPSITE puppet-swh-site
	D7832	rSPSITEb858c76b8e1d Deploy metadata loader credentials for high and oneshot loaders

Event Timeline

ardumont changed the task status from Open to Work in Progress.May 13 2022, 5:11 PM

ardumont triaged this task as Normal priority.

ardumont created this task.

ardumont moved this task from Backlog to in-progress on the System administration board.

ardumont added a revision: D7832: Deploy metadata loader credentials for high and oneshot loaders.May 13 2022, 5:13 PM

ardumont renamed this task from Deploy loader.metadata credentials for high and oneshot loader to Deploy loader.metadata credentials for high and oneshot loaders.May 13 2022, 5:16 PM

ardumont updated the task description. (Show Details)

ardumont added a commit: rSPSITEb858c76b8e1d: Deploy metadata loader credentials for high and oneshot loaders.May 13 2022, 5:22 PM

ardumont moved this task from in-progress to deployed/landed/monitoring on the System administration board.May 13 2022, 5:23 PM

ardumont closed this task as Resolved.May 13 2022, 5:59 PM

ardumont claimed this task.

ardumont moved this task from deployed/landed/monitoring to Component upgrades on the System administration board.

ardumont edited projects, added System administration (Component upgrades); removed System administration.

ardumont moved this task from Component upgrades to done on the System administration board.

ardumont edited projects, added System administration; removed System administration (Component upgrades).