Page MenuHomeSoftware Heritage

Move scheduler task run logging to a more permanent location
Open, NormalPublic

Description

The current scheduler task run table is growing without bounds. This will cause problems sooner rather than later, so we should make sure we can keep it manageable and queryable.

We're also adding one-shot tasks to the scheduler, and it doesn't make sense to keep those around forever and bloat the live database once they've been completed.

We're now using elasticsearch for long-term structured logging. It would make sense to archive old tasks over there as well.

Event Timeline

olasd created this task.May 31 2017, 12:51 PM
olasd added a comment.Jan 23 2020, 2:00 PM

The last thing that would be nice to do would be archiving old, completed task_run entries for recurring tasks that are still active. But that can be recorded as another ticket.