Page MenuHomeSoftware Heritage

vlorentz (Valentin Lorentz)
User

User Details

User Since
Oct 1 2018, 11:23 AM (120 w, 5 d)

Recent Activity

Yesterday

vlorentz requested review of D4928: [wip] add materialized view origins_to_schedule and use it in grab_next_visits..
Fri, Jan 22, 4:27 PM
vlorentz updated the test plan for D4912: grab_next_visits: don't re-schedule visits too fast.
Fri, Jan 22, 12:59 PM
vlorentz added inline comments to D4921: Make plotting optional in simulator cli command.
Fri, Jan 22, 12:45 PM
vlorentz accepted D4922: Simulation: log at infol level recorded metrics.
Fri, Jan 22, 12:38 PM
vlorentz added a comment to D4920: Randomize last_upadte in generated ListedOrigins in fill_test_data.

why not (cli option), but why (keep it deterministic)?

Fri, Jan 22, 12:38 PM
vlorentz updated the diff for D4917: simulator: stop validating the scheduling policy in the CLI.

rebase

Fri, Jan 22, 12:26 PM
vlorentz updated the diff for D4916: Run simulator tests on all known scheduling policies.

rebase

Fri, Jan 22, 12:26 PM
vlorentz updated the diff for D4915: simulator: record visit metrics alongside scheduler metrics.

rebase

Fri, Jan 22, 12:26 PM
vlorentz updated the diff for D4914: simulator: stop using the database as a cache for origin data.

rebase

Fri, Jan 22, 12:26 PM
vlorentz updated the diff for D4912: grab_next_visits: don't re-schedule visits too fast.

add tests

Fri, Jan 22, 12:26 PM
vlorentz abandoned D4913: simulator: add a trivial heartbeat process to show progress.

Replaced by D4922

Fri, Jan 22, 12:25 PM
vlorentz requested changes to D4920: Randomize last_upadte in generated ListedOrigins in fill_test_data.
Fri, Jan 22, 11:41 AM
vlorentz closed D4905: Make PaginatedListedOriginList a concretization of PagedResult.
Fri, Jan 22, 11:35 AM
vlorentz committed rDSCHb93aa5be2c2d: Make PaginatedListedOriginList a concretization of PagedResult (authored by vlorentz).
Make PaginatedListedOriginList a concretization of PagedResult
Fri, Jan 22, 11:35 AM
vlorentz closed D4899: Add scheduling policy for already visited origins with known last update.
Fri, Jan 22, 11:34 AM
vlorentz closed D4898: Add scheduling policy for never visited origins.
Fri, Jan 22, 11:34 AM
vlorentz committed rDSCH2f47936731cf: Add scheduling policy for already visited origins with known last update (authored by olasd).
Add scheduling policy for already visited origins with known last update
Fri, Jan 22, 11:34 AM
vlorentz committed rDSCHacad712ad3f7: Add scheduling policy for never visited origins (authored by olasd).
Add scheduling policy for never visited origins
Fri, Jan 22, 11:34 AM
vlorentz requested review of D4916: Run simulator tests on all known scheduling policies.
Fri, Jan 22, 11:31 AM
vlorentz requested review of D4911: Allow overriding the timestamp of grab_next_visits.
Fri, Jan 22, 11:29 AM
vlorentz added a comment to D4923: Simulation: allow to export results in a csv file.

No tests?

Fri, Jan 22, 11:20 AM
vlorentz requested changes to D4921: Make plotting optional in simulator cli command.

This will conflict with various other diffs, as we add other plots (that aren't histogram). Could you rebase on D4916?

Fri, Jan 22, 11:16 AM
vlorentz accepted D4919: Add a --num-origins option to the fill-test-data cli command.
Fri, Jan 22, 11:13 AM
vlorentz requested changes to D4922: Simulation: log at infol level recorded metrics.
Fri, Jan 22, 11:12 AM
vlorentz accepted D4877: npm: Reimplement lister using new Lister API.
Fri, Jan 22, 10:44 AM

Thu, Jan 21

vlorentz requested review of D4917: simulator: stop validating the scheduling policy in the CLI.
Thu, Jan 21, 6:26 PM
vlorentz requested review of D4915: simulator: record visit metrics alongside scheduler metrics.
Thu, Jan 21, 6:22 PM
vlorentz requested review of D4914: simulator: stop using the database as a cache for origin data.
Thu, Jan 21, 6:20 PM
vlorentz requested review of D4913: simulator: add a trivial heartbeat process to show progress.
Thu, Jan 21, 6:17 PM
vlorentz requested review of D4912: grab_next_visits: don't re-schedule visits too fast.
Thu, Jan 21, 6:15 PM
vlorentz requested review of D4910: Construct grab_next_visits query arguments incrementally.
Thu, Jan 21, 6:10 PM
vlorentz requested review of D4909: simulator: add lister simulation.
Thu, Jan 21, 6:08 PM
vlorentz closed D4897: Reorganize grab_next_visits tests to better check sorting behavior.
Thu, Jan 21, 5:58 PM
vlorentz committed rDSCH03460207a17d: Reorganize grab_next_visits tests to better check sorting behavior (authored by olasd).
Reorganize grab_next_visits tests to better check sorting behavior
Thu, Jan 21, 5:58 PM
vlorentz accepted D4904: browse/release: Add missing SWHIDs info.
Thu, Jan 21, 3:53 PM
vlorentz requested review of D4905: Make PaginatedListedOriginList a concretization of PagedResult.
Thu, Jan 21, 2:29 PM
vlorentz added a comment to D4904: browse/release: Add missing SWHIDs info.

As the changes are in the Python code, shouldn't there be a new (or changed) Python test?

Thu, Jan 21, 2:28 PM
vlorentz updated the diff for D4899: Add scheduling policy for already visited origins with known last update.

rebase

Thu, Jan 21, 1:04 PM
vlorentz updated the diff for D4898: Add scheduling policy for never visited origins.

rebase

Thu, Jan 21, 1:03 PM
vlorentz updated the diff for D4897: Reorganize grab_next_visits tests to better check sorting behavior.

black

Thu, Jan 21, 1:03 PM
vlorentz closed D4902: Run Black..
Thu, Jan 21, 12:20 PM
vlorentz committed rDSCHaf3789891f1e: Run Black. (authored by vlorentz).
Run Black.
Thu, Jan 21, 12:20 PM
vlorentz accepted D4903: Run pre-commit on all files, instead of flake8 and mypy.
Thu, Jan 21, 12:18 PM
vlorentz accepted D4901: scheduler: deploy journal client service.
Thu, Jan 21, 12:11 PM
vlorentz requested review of D4902: Run Black..
Thu, Jan 21, 12:07 PM
vlorentz closed D4896: Make the grab_next_visits sql query modular.
Thu, Jan 21, 11:41 AM
vlorentz committed rDSCHb641ac83ebbf: Make the grab_next_visits sql query modular (authored by olasd).
Make the grab_next_visits sql query modular
Thu, Jan 21, 11:41 AM
vlorentz updated the diff for D4899: Add scheduling policy for already visited origins with known last update.

rebase

Thu, Jan 21, 11:37 AM
vlorentz updated the diff for D4898: Add scheduling policy for never visited origins.

rebase

Thu, Jan 21, 11:37 AM
vlorentz updated the diff for D4897: Reorganize grab_next_visits tests to better check sorting behavior.

rebase

Thu, Jan 21, 11:36 AM
vlorentz updated the diff for D4896: Make the grab_next_visits sql query modular.

rebase

Thu, Jan 21, 11:36 AM
vlorentz updated the diff for D4898: Add scheduling policy for never visited origins.

rebase

Thu, Jan 21, 11:28 AM
vlorentz updated the diff for D4897: Reorganize grab_next_visits tests to better check sorting behavior.

rebase

Thu, Jan 21, 11:28 AM
vlorentz updated the diff for D4896: Make the grab_next_visits sql query modular.

rebase

Thu, Jan 21, 11:27 AM
vlorentz updated the diff for D4896: Make the grab_next_visits sql query modular.

add comment

Thu, Jan 21, 11:27 AM
vlorentz added inline comments to D4896: Make the grab_next_visits sql query modular.
Thu, Jan 21, 9:40 AM

Wed, Jan 20

vlorentz requested review of D4899: Add scheduling policy for already visited origins with known last update.
Wed, Jan 20, 5:56 PM
vlorentz requested review of D4898: Add scheduling policy for never visited origins.
Wed, Jan 20, 5:53 PM
vlorentz requested review of D4897: Reorganize grab_next_visits tests to better check sorting behavior.
Wed, Jan 20, 5:51 PM
vlorentz requested review of D4896: Make the grab_next_visits sql query modular.
Wed, Jan 20, 5:49 PM
vlorentz committed rDSCH9468bb9384f1: simulator: add basic tests for fill_test_data and run (authored by olasd).
simulator: add basic tests for fill_test_data and run
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH9ce68f8d0e0e: simulator: stop using get_scheduler directly (authored by vlorentz).
simulator: stop using get_scheduler directly
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH88e0b4280501: simulator: Add documentation. (authored by vlorentz).
simulator: Add documentation.
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH62c6d90867bc: simulator: Make min_batch_size a parameter defined in the setup. (authored by vlorentz).
simulator: Make min_batch_size a parameter defined in the setup.
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH898820fac52c: simulator: collect and plot scheduler metrics over time (authored by olasd).
simulator: collect and plot scheduler metrics over time
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCHead7b347db9d: simulator: implement a simulator for the "old" task-based scheduler (authored by olasd).
simulator: implement a simulator for the "old" task-based scheduler
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCHaecd27eee06a: Move the simulator cli to the main cli module (authored by olasd).
Move the simulator cli to the main cli module
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH24922fe2d995: simulator: wrap tasks and task events in typechecked objects (authored by olasd).
simulator: wrap tasks and task events in typechecked objects
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH22ebb7a9a4bc: simulator: Split into smaller files in the same package (authored by vlorentz).
simulator: Split into smaller files in the same package
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCHd5318aea0a93: simulator: also fill data for the task-based scheduler (authored by olasd).
simulator: also fill data for the task-based scheduler
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH05067e3ecc88: simulator: Replace attrs with dataclasses for consistency (authored by olasd).
simulator: Replace attrs with dataclasses for consistency
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCHad7bfbe731da: simulator: Make the run time a CLI argument (authored by olasd).
simulator: Make the run time a CLI argument
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH29204199774b: simulator: add typing for Environment.scheduler (authored by olasd).
simulator: add typing for Environment.scheduler
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCHdf34db0bfc61: simulator: tweak simulation environment constants (authored by olasd).
simulator: tweak simulation environment constants
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH21ce2c88dddc: simulator: generate more origins in fill_data (authored by olasd).
simulator: generate more origins in fill_data
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH6433266106dd: simulator: add support for a basic SimulationReport (authored by olasd).
simulator: add support for a basic SimulationReport
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCHc474a825336a: simulator: refine origin model to follow an exponential distribution (authored by olasd).
simulator: refine origin model to follow an exponential distribution
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCHcb12449e8f57: simulator: simulate the scheduler journal client (authored by vlorentz).
simulator: simulate the scheduler journal client
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH2459badf0c05: simulator: Remove some debug statements and lower log level (authored by olasd).
simulator: Remove some debug statements and lower log level
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH20b7f9c68f83: simulator: generate OriginVisitStatus objects in modeled visits (authored by vlorentz).
simulator: generate OriginVisitStatus objects in modeled visits
Wed, Jan 20, 5:48 PM
vlorentz committed rDSCH31967fa850c3: simulator: Use datetimes instead of a floating point simulated time (authored by vlorentz).
simulator: Use datetimes instead of a floating point simulated time
Wed, Jan 20, 5:47 PM
vlorentz committed rDSCH39ad47de2e75: simulator: Move scheduler into the simulation environment object (authored by vlorentz).
simulator: Move scheduler into the simulation environment object
Wed, Jan 20, 5:47 PM
vlorentz closed D4856: Introduce scaffolding for a scheduler simulator.
Wed, Jan 20, 5:47 PM
vlorentz committed rDSCHfc3f06bd1d77: Introduce scaffolding for a scheduler simulator (authored by olasd).
Introduce scaffolding for a scheduler simulator
Wed, Jan 20, 5:47 PM
vlorentz added a revision to T2444: Implement the scheduling policy for the recurrent visit scheduler: D4899: Add scheduling policy for already visited origins with known last update.
Wed, Jan 20, 5:46 PM · Sprint 2021 01, Scheduling utilities
vlorentz added a revision to T2444: Implement the scheduling policy for the recurrent visit scheduler: D4898: Add scheduling policy for never visited origins.
Wed, Jan 20, 5:46 PM · Sprint 2021 01, Scheduling utilities
vlorentz updated the diff for D4856: Introduce scaffolding for a scheduler simulator.

One last rebase for the road

Wed, Jan 20, 5:44 PM
vlorentz closed D4889: Add a cli for the scheduler metrics update endpoint.
Wed, Jan 20, 5:39 PM
vlorentz committed rDSCH7905a6bea4ba: Add a cli for the scheduler metrics update endpoint (authored by vlorentz).
Add a cli for the scheduler metrics update endpoint
Wed, Jan 20, 5:39 PM
vlorentz updated the diff for D4889: Add a cli for the scheduler metrics update endpoint.

Rebase

Wed, Jan 20, 5:35 PM
vlorentz added a comment to T2974: Define (and implement) scheduler performance metrics.
  • "'outdatedest' origin": excluding disabled origins and origins visited after their last_activity (if any), the min(current_time - last_visit) (lower is better)
Wed, Jan 20, 5:33 PM · Sprint 2021 01, Archive coverage, Scheduling utilities
vlorentz resigned from D4843: Reimplement Bitbucket lister using new Lister API.
Wed, Jan 20, 3:26 PM · Lister, Bitbucket lister
vlorentz accepted D4891: model: Allow new status values not_found and failed to OriginVisitStatus.

thx. don't forget to update the diff title

Wed, Jan 20, 2:04 PM
vlorentz added inline comments to D4888: scheduler: Make origin_visit_stats_get read multiple entries.
Wed, Jan 20, 11:31 AM
vlorentz requested changes to D4891: model: Allow new status values not_found and failed to OriginVisitStatus.

missing an update to hypothesis_strategies.py

Wed, Jan 20, 11:28 AM
vlorentz closed D4887: Introduce a new lister_get endpoint.
Wed, Jan 20, 11:26 AM
vlorentz committed rDSCH737d12e5b9e6: Introduce a new lister_get endpoint (authored by olasd).
Introduce a new lister_get endpoint
Wed, Jan 20, 11:26 AM
vlorentz closed D4880: Implement some basic aggregated metrics on listed origins.
Wed, Jan 20, 11:26 AM
vlorentz committed rDSCH114ed952e513: Implement some basic aggregated metrics on listed origins (authored by olasd).
Implement some basic aggregated metrics on listed origins
Wed, Jan 20, 11:25 AM
vlorentz updated the diff for D4856: Introduce scaffolding for a scheduler simulator.

Rebase on top of D4889

Wed, Jan 20, 11:05 AM