Page MenuHomeSoftware Heritage

scheduler: Schedule tasks with priorities
Closed, MigratedEdits Locked

Description

So far, all tasks are scheduled all the same.

We will need to differentiate between those recurring tasks (coming from listers' output), and new higher prioritized oneshot tasks (coming from new origin events).

All those tasks will need to get ingested (no starvation).

For this, we introduce the priority notion in tasks (3 values: high, normal, low).
The scheduling policy will be adapted to trigger a given percentage for all sort of prioritized tasks.

We'll begin with the following percentage (which could be adapted later on):

  • 0.5: high
  • 0.3: normal
  • 0.2: low

Event Timeline

ardumont triaged this task as Normal priority.Apr 24 2018, 5:05 PM
ardumont created this task.
ardumont renamed this task from scheduler: Schedule task with priorities to scheduler: Schedule tasks with priorities.Apr 27 2018, 12:18 PM
ardumont updated the task description. (Show Details)
ardumont changed the task status from Open to Work in Progress.May 3 2018, 3:03 PM
ardumont claimed this task.