Diffusion Provenance database fa15961caf20

swhgraph: use grpc API
fa15961caf20
Actions

Description

swhgraph: use grpc API

replace the (deprecated) HTTP RCP API to access the swh-graph service,
in favor of the grpc server.

To be able to test the (now) grpc-based ArchiveGraph, compressed graph
datasets for all 3 common datasets (cmdbts2, out-of-order and with-merges)
have been generated and included in this revision.

swhgraph: use grpc APIfa15961caf20Actions

Description

Details

Event Timeline

Changes (293)Show All Changes

Very Large Commit

rDPROVfa15961caf20

requirements-test.txt

swh/provenance/__init__.py

swh/provenance/swhgraph/archive.py

swh/provenance/tests/conftest.py

swh/provenance/tests/data/README.md

swh/provenance/tests/data/generate_graph_dataset.py

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-labelled.labelobl

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-labelled.labeloffsets

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-labelled.labels

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-labelled.properties

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed-labelled.labelobl

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed-labelled.labeloffsets

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed-labelled.labels

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed-labelled.properties

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed.graph

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed.obl

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed.offsets

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example-transposed.properties

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.edges.count.txt

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.edges.stats.txt

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.graph

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.indegree

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.labels.count.txt

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.labels.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.labels.fcl.bytearray

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.labels.fcl.pointers

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.labels.fcl.properties

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.labels.mph

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.mph

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.node2swhid.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.node2type.map

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.nodes.count.txt

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.nodes.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.nodes.stats.txt

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.obl

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.offsets

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.order

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.outdegree

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.persons.count.txt

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.persons.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.persons.mph

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.properties

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.author_id.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.author_timestamp.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.author_timestamp_offset.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.committer_id.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.committer_timestamp.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.committer_timestamp_offset.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.content.is_skipped.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.content.length.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.message.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.message.offset.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.tag_name.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.property.tag_name.offset.bin

swh/provenance/tests/data/swhgraph/cmdbts2/compressed/example.stats

swh/provenance/tests/data/swhgraph/cmdbts2/edges/content/graph-all.edges.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/content/graph-all.nodes.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/directory/graph-all.edges.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/directory/graph-all.nodes.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/origin/graph-all.edges.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/origin/graph-all.nodes.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/release/graph-all.edges.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/release/graph-all.nodes.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/revision/graph-all.edges.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/revision/graph-all.nodes.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/snapshot/graph-all.edges.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/edges/snapshot/graph-all.nodes.csv.zst

swh/provenance/tests/data/swhgraph/cmdbts2/orc/content/content-all.orc

swh/provenance/tests/data/swhgraph/cmdbts2/orc/directory/directory-all.orc

swh/provenance/tests/data/swhgraph/cmdbts2/orc/directory_entry/directory_entry-all.orc

swh/provenance/tests/data/swhgraph/cmdbts2/orc/origin/origin-all.orc

swh/provenance/tests/data/swhgraph/cmdbts2/orc/origin_visit/origin_visit-all.orc

swh/provenance/tests/data/swhgraph/cmdbts2/orc/origin_visit_status/origin_visit_status-all.orc

swhgraph: use grpc API
fa15961caf20
Actions

Changes (293)
Show All Changes

swh/provenance/init.py