Page MenuHomeSoftware Heritage

Log summary of filtered objects in store_data
ClosedPublic

Authored by vlorentz on May 20 2022, 3:53 PM.

Diff Detail

Repository
rDLDG Git loader
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

Build is green

Patch application report for D7876 (id=28426)

Could not rebase; Attempt merge onto 85a4794094...

Updating 85a4794..356b554
Fast-forward
 requirements-swh.txt                |   2 +-
 swh/loader/git/base.py              | 134 ++++++++++++++++++++++++++++++++++++
 swh/loader/git/from_disk.py         |   4 +-
 swh/loader/git/loader.py            |   4 +-
 swh/loader/git/tests/test_loader.py |  99 +++++++++++++++++++++++++-
 5 files changed, 236 insertions(+), 7 deletions(-)
 create mode 100644 swh/loader/git/base.py
Changes applied before test
commit 356b5542852baff2bd5eb616703ff74566506f95
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri May 20 15:53:41 2022 +0200

    Log summary of filtered objects in store_data

commit 5ced09db7e6636c0959cca2bb36088b2e3a86e4f
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri May 20 15:10:55 2022 +0200

    Add an unweighted average for filtered_objects + fix existing metric name

commit f45ca1c2c0fac2f57cd1b43af984251078c89169
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri May 20 13:46:58 2022 +0200

    Add metrics in store_data on ratios of objects already stored

commit 083e1aa18e24cd3311162e259b15c1867b313060
Author: Valentin Lorentz <vlorentz@softwareheritage.org>
Date:   Fri May 20 12:16:23 2022 +0200

    Move store_data from DVCSLoader to a new BaseGitLoader
    
    In preparation for the removal of DVCSLoader from swh.loader.core,
    as the git loader is the only one to use it anymore.

See https://jenkins.softwareheritage.org/job/DLDG/job/tests-on-diff/221/ for more details.

This revision is now accepted and ready to land.May 20 2022, 4:03 PM