HomeSoftware Heritage

worker[17-18]: Prepare workers to subside scanoss tool lag

Description

worker[17-18]: Prepare workers to subside scanoss tool lag

Dedicated queues are configured for it:

  • oneshot:... dedicated for large repositories (with extra parameters on the pack file

size limit).

  • oneshot2:... dedicated for normal repositories

Both workers are kept out of the standard consumption queues and the concurrency is
reduced to avoid out of memory issues altogether.

The messages are yet to be sent to those queues.

Related to T4400

Details

Provenance
ardumontAuthored on Jul 19 2022, 12:24 PM
ardumontPushed on Jul 19 2022, 1:48 PM
Parents
rSPSITEbbb12d649f12: Add missing dependency on azure workers
Branches
Unknown
Tags
Unknown