Page MenuHomeSoftware Heritage
Differential D6706

Add test for range splitting function
ClosedPublic
Actions

Authored by aeviso on Nov 29 2021, 2:48 PM.

Details

Reviewers
vlorentz
Group Reviewers
Reviewers
Commits
rDPROVdd1d7aa233a6: Add test for range splitting function
Summary

Depends on D6705.

Diff Detail

Repository
rDPROV Provenance database
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

aeviso created this revision.Nov 29 2021, 2:48 PM
Herald added a reviewer: Reviewers. · View Herald TranscriptNov 29 2021, 2:48 PM
swh-public-ci added a comment.Nov 29 2021, 2:56 PM

Build is green

Patch application report for D6706 (id=24362)

Could not rebase; Attempt merge onto 579c3bd35e...

Updating 579c3bd..1c4fb0f
Fast-forward
 .gitignore                                       |   4 +-
 docs/storage/remote.rst                          | 720 +++++++++++++++++++++++
 mypy.ini                                         |   3 +
 pytest.ini                                       |   2 +
 requirements-test.txt                            |   1 +
 requirements.txt                                 |   1 +
 swh/provenance/__init__.py                       |   8 +
 swh/provenance/api/client.py                     | 466 +++++++++++++++
 swh/provenance/api/server.py                     | 666 ++++++++++++++++++++-
 swh/provenance/cli.py                            |  31 +-
 swh/provenance/tests/conftest.py                 |  24 +-
 swh/provenance/tests/test_conflict_resolution.py | 158 +++++
 swh/provenance/tests/test_routing_keys.py        |  78 +++
 swh/provenance/tests/test_split_ranges.py        | 137 +++++
 swh/provenance/util.py                           |   5 +
 tox.ini                                          |   3 +-
 16 files changed, 2293 insertions(+), 14 deletions(-)
 create mode 100644 docs/storage/remote.rst
 create mode 100644 swh/provenance/tests/test_conflict_resolution.py
 create mode 100644 swh/provenance/tests/test_routing_keys.py
 create mode 100644 swh/provenance/tests/test_split_ranges.py
Changes applied before test
commit 1c4fb0fa12b5c4ca6512ed8595662734fa45122e
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Mon Nov 29 14:42:11 2021 +0100

    Add test for range splitting function

commit 904329450ffd5fa9c6ddb5d4c9192b572656ab5e
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Mon Nov 29 14:41:28 2021 +0100

    Add test for routing key calculation

commit e4d097695294def8d809fbce6455b3c8712735dc
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Tue Sep 28 10:01:43 2021 +0200

    Add tests for conflict resolution functions

commit 4eecec5edb9139e945912ff39c7d0f412d3c9977
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Tue Sep 21 16:13:53 2021 +0200

    Add support for remote backend on existing storage tests

commit f8411a522e937b961d7fc8270c653d83039268fd
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Fri Aug 20 12:21:27 2021 +0200

    Add new RabbitMQ-based client/server API
    
    Write methods in the `ProvenanceStorageInterface` are called through a server that
    guarantees conflict-free writings to the underlying database.
    
    Read methods are called directly from the client to avoid RCP overhead for reads.
    
    The server spawns multiple sub-processes to handle independent requests concurrently.

See https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/503/ for more details.

Harbormaster completed remote builds in B25234: Diff 24362.Nov 29 2021, 2:56 PM
aeviso requested review of this revision.Nov 29 2021, 2:56 PM
aeviso updated this revision to Diff 24370.Nov 29 2021, 4:02 PM

rebase

swh-public-ci added a comment.Nov 29 2021, 4:15 PM

Build is green

Patch application report for D6706 (id=24370)

Could not rebase; Attempt merge onto 579c3bd35e...

Updating 579c3bd..034b507
Fast-forward
 .gitignore                                       |   4 +-
 docs/storage/remote.rst                          | 724 +++++++++++++++++++++++
 mypy.ini                                         |   3 +
 pytest.ini                                       |   2 +
 requirements-test.txt                            |   1 +
 requirements.txt                                 |   1 +
 swh/provenance/__init__.py                       |   8 +
 swh/provenance/api/client.py                     | 466 +++++++++++++++
 swh/provenance/api/server.py                     | 666 ++++++++++++++++++++-
 swh/provenance/cli.py                            |  31 +-
 swh/provenance/tests/conftest.py                 |  24 +-
 swh/provenance/tests/test_conflict_resolution.py | 158 +++++
 swh/provenance/tests/test_routing_keys.py        |  78 +++
 swh/provenance/tests/test_split_ranges.py        | 137 +++++
 swh/provenance/util.py                           |   5 +
 tox.ini                                          |  38 +-
 16 files changed, 2332 insertions(+), 14 deletions(-)
 create mode 100644 docs/storage/remote.rst
 create mode 100644 swh/provenance/tests/test_conflict_resolution.py
 create mode 100644 swh/provenance/tests/test_routing_keys.py
 create mode 100644 swh/provenance/tests/test_split_ranges.py
Changes applied before test
commit 034b507deb49cdae09ea6b89db56fd24d37dd956
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Mon Nov 29 14:42:11 2021 +0100

    Add test for range splitting function

commit 21abd9134e5fa0bca687cffa530a3f73be6a7c0c
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Mon Nov 29 14:41:28 2021 +0100

    Add test for routing key calculation

commit 6306b44896c1775aef49b8840464efd80df9e648
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Tue Sep 28 10:01:43 2021 +0200

    Add tests for conflict resolution functions

commit e649205e258980cafbeb1db7d18f9c6efb1a8e76
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Tue Sep 21 16:13:53 2021 +0200

    Add support for remote backend on existing storage tests

commit a6cc3e4daf228ce9c124712b93c4749b16e65ce1
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Fri Aug 20 12:21:27 2021 +0200

    Add new RabbitMQ-based client/server API
    
    Write methods in the `ProvenanceStorageInterface` are called through a server that
    guarantees conflict-free writings to the underlying database.
    
    Read methods are called directly from the client to avoid RCP overhead for reads.
    
    The server spawns multiple sub-processes to handle independent requests concurrently.

See https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/508/ for more details.

Harbormaster completed remote builds in B25244: Diff 24370.Nov 29 2021, 4:15 PM
aeviso updated this revision to Diff 24391.Dec 1 2021, 3:52 PM

rebase

aeviso added a child revision: D6712: Add explicit flag for flattenned directories to `ProvenanceStorageInterface`.Dec 1 2021, 3:53 PM
swh-public-ci added a comment.Dec 1 2021, 4:04 PM

Build is green

Patch application report for D6706 (id=24391)

Could not rebase; Attempt merge onto 6306b44896...

Updating 6306b44..ea4a856
Fast-forward
 swh/provenance/tests/test_routing_keys.py |  66 ++++++++++++++
 swh/provenance/tests/test_split_ranges.py | 137 ++++++++++++++++++++++++++++++
 2 files changed, 203 insertions(+)
 create mode 100644 swh/provenance/tests/test_routing_keys.py
 create mode 100644 swh/provenance/tests/test_split_ranges.py
Changes applied before test
commit ea4a856c71d00bfd315890a317af38351d5f7ebb
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Mon Nov 29 14:42:11 2021 +0100

    Add test for range splitting function

commit 247574bec84d471a6e78721d02b115b6017d2f9d
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Mon Nov 29 14:41:28 2021 +0100

    Add test for routing key calculation

See https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/510/ for more details.

Harbormaster completed remote builds in B25268: Diff 24391.Dec 1 2021, 4:04 PM
vlorentz added a subscriber: vlorentz.Dec 1 2021, 5:08 PM
vlorentz added inline comments.
swh/provenance/tests/test_split_ranges.py
66

Same comment as the other diff

76

ditto

aeviso updated this revision to Diff 24405.Dec 1 2021, 5:13 PM

rebase

swh-public-ci added a comment.Dec 1 2021, 5:21 PM

Build is green

Patch application report for D6706 (id=24405)

Rebasing onto 247574bec8...

Current branch diff-target is up to date.
Changes applied before test
commit dd1d7aa233a69fa87b16a361b12ae255605c6899
Author: Andres Ezequiel Viso <aeviso@softwareheritage.org>
Date:   Mon Nov 29 14:42:11 2021 +0100

    Add test for range splitting function

See https://jenkins.softwareheritage.org/job/DPROV/job/tests-on-diff/518/ for more details.

Harbormaster completed remote builds in B25282: Diff 24405.Dec 1 2021, 5:21 PM
vlorentz accepted this revision.Dec 2 2021, 11:10 AM
This revision is now accepted and ready to land.Dec 2 2021, 11:10 AM
Closed by commit rDPROVdd1d7aa233a6: Add test for range splitting function (authored by aeviso). · Explain WhyDec 2 2021, 12:03 PM
This revision was automatically updated to reflect the committed changes.
aeviso added a commit: rDPROVdd1d7aa233a6: Add test for range splitting function.
aeviso removed a child revision: D6712: Add explicit flag for flattenned directories to `ProvenanceStorageInterface`.Dec 2 2021, 12:03 PM

Revision Contents
Changeset List

PathSize
swh/
provenance/
tests/
137 lines

Diff 24437

View Options

swh/provenance/tests/test_split_ranges.py

Loading...
About · Developer information · Legal