Page MenuHomeSoftware Heritage
Differential D4922

Simulation: log at infol level recorded metrics
ClosedPublic
Actions

Authored by douardda on Jan 22 2021, 10:51 AM.

Details

Reviewers
vlorentz
Group Reviewers
Reviewers
Commits
rDSCHabb513ca7d09: Simulation: log at info level recorded metrics
Summary

this allows to follows what the simulation is doing.

Diff Detail

Event Timeline

douardda created this revision.Jan 22 2021, 10:51 AM
Herald added a reviewer: Reviewers. · View Herald TranscriptJan 22 2021, 10:51 AM
douardda added a child revision: D4923: Simulation: allow to export results in a csv file.Jan 22 2021, 10:51 AM
swh-public-ci added a comment.Jan 22 2021, 10:59 AM

Build is green

Patch application report for D4922 (id=17507)

Could not rebase; Attempt merge onto 03460207a1...

Updating 0346020..6ef3d21
Fast-forward
 swh/scheduler/cli/simulator.py      | 20 +++++++++---
 swh/scheduler/simulator/__init__.py | 61 ++++++++++++++++++++++---------------
 swh/scheduler/simulator/common.py   | 34 +++++++++++----------
 3 files changed, 70 insertions(+), 45 deletions(-)
Changes applied before test
commit 6ef3d2177ca00e5f42885eaf6a37ecd0c94df7ac
Author: David Douard <david.douard@sdfa3.org>
Date:   Fri Jan 22 10:47:18 2021 +0100

    Simulation: log at infol level recorded metrics
    
    this allows to follows what the simulation is doing.

commit 6698e51903bfdfcc00cfc55be3056c25c8cb270f
Author: David Douard <david.douard@sdfa3.org>
Date:   Fri Jan 22 09:07:22 2021 +0100

    Make plotting histograms optional in simulator cli command

commit 1c069ca34add6b26d060588abb7958a089cb0735
Author: David Douard <david.douard@sdfa3.org>
Date:   Thu Jan 21 11:33:19 2021 +0100

    Randomize last_upadte in generated ListedOrigins in fill_test_data
    
    also insert objects by batches of 10k to make it nicer with ram usage.

commit 8a9aaf3942d5585e6af038ebced3cde6faf27c7e
Author: David Douard <david.douard@sdfa3.org>
Date:   Thu Jan 21 11:30:21 2021 +0100

    Add a --num-origins option to the fill-test-data cli command

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/247/ for more details.

Harbormaster completed remote builds in B18639: Diff 17507.Jan 22 2021, 10:59 AM
douardda requested review of this revision.Jan 22 2021, 10:59 AM
vlorentz requested changes to this revision.Jan 22 2021, 11:11 AM
vlorentz added a subscriber: vlorentz.
vlorentz added inline comments.
swh/scheduler/simulator/__init__.py
39
This revision now requires changes to proceed.Jan 22 2021, 11:11 AM
douardda edited the summary of this revision. (Show Details)Jan 22 2021, 11:19 AM
douardda removed a parent revision: D4921: Make plotting optional in simulator cli command.
douardda updated this revision to Diff 17511.Jan 22 2021, 11:21 AM
douardda edited the summary of this revision. (Show Details)

type + vorentz' comment

douardda updated this revision to Diff 17512.Jan 22 2021, 11:22 AM

with the commit...

swh-public-ci added a comment.Jan 22 2021, 11:23 AM

Build is green

Patch application report for D4922 (id=17511)

Rebasing onto 03460207a1...

Current branch diff-target is up to date.
Changes applied before test
commit be0847aff4509a7dd61ccd169eb55f5910721c2d
Author: David Douard <david.douard@sdfa3.org>
Date:   Fri Jan 22 10:47:18 2021 +0100

    Simulation: log at info level recorded metrics
    
    this allows to follows what the simulation is doing.

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/249/ for more details.

Harbormaster completed remote builds in B18643: Diff 17511.Jan 22 2021, 11:23 AM
swh-public-ci added a comment.Jan 22 2021, 11:25 AM

Build is green

Patch application report for D4922 (id=17512)

Rebasing onto 03460207a1...

Current branch diff-target is up to date.
Changes applied before test
commit 09922622a55740698ea93c1deae2c6bac4019a96
Author: David Douard <david.douard@sdfa3.org>
Date:   Fri Jan 22 10:47:18 2021 +0100

    Simulation: log at info level recorded metrics
    
    this allows to follows what the simulation is doing.

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/250/ for more details.

Harbormaster completed remote builds in B18644: Diff 17512.Jan 22 2021, 11:25 AM
douardda removed a child revision: D4923: Simulation: allow to export results in a csv file.Jan 22 2021, 12:23 PM
vlorentz mentioned this in D4913: simulator: add a trivial heartbeat process to show progress.Jan 22 2021, 12:25 PM
vlorentz accepted this revision.Jan 22 2021, 12:38 PM
This revision is now accepted and ready to land.Jan 22 2021, 12:38 PM
douardda updated this revision to Diff 17529.Jan 22 2021, 2:10 PM

rebased

This revision was landed with ongoing or failed builds.Jan 22 2021, 2:10 PM
Closed by commit rDSCHabb513ca7d09: Simulation: log at info level recorded metrics (authored by douardda). · Explain Why
This revision was automatically updated to reflect the committed changes.
douardda added a commit: rDSCHabb513ca7d09: Simulation: log at info level recorded metrics.
swh-public-ci added a comment.Jan 22 2021, 2:12 PM

Build is green

Patch application report for D4922 (id=17529)

Rebasing onto b93aa5be2c...

Current branch diff-target is up to date.
Changes applied before test
commit abb513ca7d09afb228ed9da7316994ede8429573
Author: David Douard <david.douard@sdfa3.org>
Date:   Fri Jan 22 10:47:18 2021 +0100

    Simulation: log at info level recorded metrics
    
    this allows to follows what the simulation is doing.

See https://jenkins.softwareheritage.org/job/DSCH/job/tests-on-diff/265/ for more details.

Harbormaster completed remote builds in B18661: Diff 17529.Jan 22 2021, 2:12 PM

Revision Contents
Changeset List

PathSizeCoverage (All)Coverage (Touched)
swh/
scheduler/
simulator/
8 lines93%
Loading...

Diff 17529

View Options

swh/scheduler/simulator/__init__.py

Loading...
About · Developer information · Legal