Page MenuHomeSoftware Heritage
Create Task
Maniphest T2973

Implement a scheduler simulator
Closed, MigratedEdits Locked
Actions

Description

Instead of having to instrument the whole archive to test changes to the scheduling policy, implement a "time warping" scheduler simulator, comprised of a real scheduler database, and simulating the origin visit process.

Revisions and Commits

rDSCH Scheduling utilities
D4856rDSCH9468bb9384f1 simulator: add basic tests for fill_test_data and run
D4856rDSCH9ce68f8d0e0e simulator: stop using get_scheduler directly
D4856rDSCH62c6d90867bc simulator: Make min_batch_size a parameter defined in the setup.
D4856rDSCH898820fac52c simulator: collect and plot scheduler metrics over time
D4856rDSCH88e0b4280501 simulator: Add documentation.
D4856rDSCHead7b347db9d simulator: implement a simulator for the "old" task-based scheduler
D4856rDSCHaecd27eee06a Move the simulator cli to the main cli module
D4856rDSCH24922fe2d995 simulator: wrap tasks and task events in typechecked objects
D4856rDSCH05067e3ecc88 simulator: Replace attrs with dataclasses for consistency
D4856rDSCH22ebb7a9a4bc simulator: Split into smaller files in the same package
D4856rDSCHd5318aea0a93 simulator: also fill data for the task-based scheduler
D4856rDSCHad7bfbe731da simulator: Make the run time a CLI argument
D4856rDSCH21ce2c88dddc simulator: generate more origins in fill_data
D4856rDSCH29204199774b simulator: add typing for Environment.scheduler
D4856rDSCHdf34db0bfc61 simulator: tweak simulation environment constants
D4856rDSCH6433266106dd simulator: add support for a basic SimulationReport
D4856rDSCHc474a825336a simulator: refine origin model to follow an exponential distribution
D4856rDSCH2459badf0c05 simulator: Remove some debug statements and lower log level
D4856rDSCH20b7f9c68f83 simulator: generate OriginVisitStatus objects in modeled visits
D4856rDSCHcb12449e8f57 simulator: simulate the scheduler journal client
D4856rDSCH31967fa850c3 simulator: Use datetimes instead of a floating point simulated time
D4856rDSCH39ad47de2e75 simulator: Move scheduler into the simulation environment object
D4856rDSCHfc3f06bd1d77 Introduce scaffolding for a scheduler simulator

Related Objects
Search...

Event Timeline

olasd changed the task status from Open to Work in Progress.Jan 18 2021, 2:12 PM
olasd triaged this task as High priority.
olasd created this task.
olasd moved this task from Backlog to in-progress on the Sprint 2021 01 board.
olasd added a revision: D4856: Introduce scaffolding for a scheduler simulator.
vlorentz added a commit: rDSCHfc3f06bd1d77: Introduce scaffolding for a scheduler simulator.Jan 20 2021, 5:47 PM
vlorentz added a commit: rDSCH39ad47de2e75: simulator: Move scheduler into the simulation environment object.
vlorentz added a commit: rDSCH31967fa850c3: simulator: Use datetimes instead of a floating point simulated time.
vlorentz added a commit: rDSCH20b7f9c68f83: simulator: generate OriginVisitStatus objects in modeled visits.
vlorentz added a commit: rDSCH2459badf0c05: simulator: Remove some debug statements and lower log level.
vlorentz added a commit: rDSCHcb12449e8f57: simulator: simulate the scheduler journal client.
vlorentz added a commit: rDSCHc474a825336a: simulator: refine origin model to follow an exponential distribution.
vlorentz added a commit: rDSCH6433266106dd: simulator: add support for a basic SimulationReport.
vlorentz added a commit: rDSCH21ce2c88dddc: simulator: generate more origins in fill_data.
vlorentz added a commit: rDSCHdf34db0bfc61: simulator: tweak simulation environment constants.
vlorentz added a commit: rDSCH29204199774b: simulator: add typing for Environment.scheduler.
vlorentz added a commit: rDSCHad7bfbe731da: simulator: Make the run time a CLI argument.
vlorentz added a commit: rDSCH05067e3ecc88: simulator: Replace attrs with dataclasses for consistency.
vlorentz added a commit: rDSCHd5318aea0a93: simulator: also fill data for the task-based scheduler.
vlorentz added a commit: rDSCH22ebb7a9a4bc: simulator: Split into smaller files in the same package.
vlorentz added a commit: rDSCH24922fe2d995: simulator: wrap tasks and task events in typechecked objects.
vlorentz added a commit: rDSCHaecd27eee06a: Move the simulator cli to the main cli module.
vlorentz added a commit: rDSCHead7b347db9d: simulator: implement a simulator for the "old" task-based scheduler.
vlorentz added a commit: rDSCH62c6d90867bc: simulator: Make min_batch_size a parameter defined in the setup..
vlorentz added a commit: rDSCH88e0b4280501: simulator: Add documentation..
vlorentz added a commit: rDSCH898820fac52c: simulator: collect and plot scheduler metrics over time.
vlorentz added a commit: rDSCH9ce68f8d0e0e: simulator: stop using get_scheduler directly.
vlorentz added a commit: rDSCH9468bb9384f1: simulator: add basic tests for fill_test_data and run.
vlorentz reassigned this task from vlorentz to olasd.Feb 8 2021, 12:00 PM
vlorentz added a subscriber: vlorentz.
gitlab-migration closed this task as Migrated.Jan 8 2023, 5:02 PM
gitlab-migration claimed this task.
gitlab-migration added a subscriber: gitlab-migration.

This task has been migrated to GitLab.

About · Developer information · Legal