Page MenuHomeSoftware Heritage

docker: Install scheduler runner which deals with recurrent tasks
ClosedPublic

Authored by ardumont on Oct 22 2021, 5:19 PM.

Details

Summary

That will take care of scheduling recurring ingestion tasks (load-git, load-hg, etc...).
Those were currently no longer automatically scheduled since the scheduler/lister
refactoring. So they needed some actions from the docker environment user.

With the following, the user won't have to do anything to do anymore as it's supposed to
be started with the remaining part of the environment.

Related to T3667
Depends on D6520

Test Plan

docker-compose override to have the orchestrator code.
And then, that runs [1]

[1] P1211

Diff Detail

Repository
rDENV Development environment
Branch
master
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 24669
Build 38497: arc lint + arc unit

Event Timeline

ardumont created this revision.

Sync names with D6520's latest state

The container names derives from the cli subcommand introduced in there.

ardumont retitled this revision from docker: Install scheduler orchestrator container to docker: Install scheduler runner which deals with recurrent tasks.Oct 27 2021, 3:37 PM
ardumont edited the summary of this revision. (Show Details)

Sync commit message and diff description

Drop --period 10 which is unused.

vlorentz added inline comments.
docker/conf/storage.yml
5 ↗(On Diff #23889)

did you mean to commit this?

docker/conf/storage.yml
5 ↗(On Diff #23889)

no!
Thanks.

This revision is now accepted and ready to land.Oct 28 2021, 2:02 PM