Copying my comment from a linked diff:
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Jan 4 2022
Jan 4 2022
zack changed the status of T3768: Read compression input from ORC instead of the edges file from Open to Work in Progress.
Dec 14 2021
Dec 14 2021
zack raised the priority of T3161: graph service: add anti-DoS limit on the number of edges traversed from Normal to High.
Dec 10 2021
Dec 10 2021
seirl closed T2647: add LLP support to graph compression pipeline as Resolved by committing rDGRPH00112952614e: Add LLP compression to the WebGraph pipeline.
Dec 6 2021
Dec 6 2021
Dec 1 2021
Dec 1 2021
zack moved T2595: Add a default configuration based on graph size (eg: batch_size) from Backlog to Deployed on the Compressed graph service board.
zack changed the status of T2113: swh-graph: add support to optionally resolve ori PIDs to origin URLs from Wontfix to Resolved.
zack moved T2112: make "swh graph map lookup" accept lists of identifiers from Backlog to Deployed on the Compressed graph service board.
zack moved T2096: CNAME for graph service: graph.internal.softwareheritage.org (?) from Backlog to Deployed on the Compressed graph service board.
zack moved T2083: provide systemd service file for swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1933: bad invocation of o.s.graph.backend.Setup in docker doc from Backlog to Deployed on the Compressed graph service board.
zack moved T1898: swh-graph: refactor algo implementations to not forcibly memoize results from Backlog to Deployed on the Compressed graph service board.
zack moved T1884: python bindings for compressed graph access from Backlog to Deployed on the Compressed graph service board.
zack moved T1937: nicer landing page for the swh-graph REST API from Backlog to Deployed on the Compressed graph service board.
zack changed the status of T1968: existing graph endpoints should not return 404 upon missing arguments from Invalid to Resolved.
zack moved T1936: integrate swh-graph into the docker environment from Backlog to Deployed on the Compressed graph service board.
zack changed the status of T1930: swh-graph: ship swh-graph.jar in the docker container from Wontfix to Resolved.
zack moved T1887: publish swh-graph documentation at docs.s.o from Backlog to Deployed on the Compressed graph service board.
zack moved T1851: Integrate graph-compression git repo in swh-environment from Backlog to Deployed on the Compressed graph service board.
zack moved T1877: Add contextual info to compression pipeline from Backlog to Deployed on the Compressed graph service board.
zack moved T1878: Write documentation on compression process from Backlog to Deployed on the Compressed graph service board.
zack moved T1879: Write documentation on compression Docker env from Backlog to Deployed on the Compressed graph service board.
zack moved T1889: graph API: add endpoint to return the leaves of a subgraph from Backlog to Deployed on the Compressed graph service board.
zack moved T1886: graph API: add endpoint to return the adjacency list of a node from Backlog to Deployed on the Compressed graph service board.
zack moved T1904: build developer documentation for swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1920: graph service: add tests for the python client from Backlog to Deployed on the Compressed graph service board.
zack moved T1938: swh-graph: NullPointerException upon (wrong) /walk from cnt to snp from Backlog to Deployed on the Compressed graph service board.
zack moved T1945: Return timings instead of simply logging them from Backlog to Deployed on the Compressed graph service board.
zack moved T1952: Log raw datapoint in graph benchmarks from Backlog to Deployed on the Compressed graph service board.
zack moved T2053: support graph export for the cassandra backend from Backlog to Deployed on the Compressed graph service board.
zack moved T2072: common configuration file for swh graph rpc-serve, compress, … from Backlog to Deployed on the Compressed graph service board.
zack moved T2077: add random walk endpoint with limited retries from Backlog to Deployed on the Compressed graph service board.
zack moved T2084: swh-graph: add /last endpoint variants to the REST API from Backlog to Deployed on the Compressed graph service board.
zack moved T2114: swh-graph API: add ?limit=N method variants to return first N results from Backlog to Deployed on the Compressed graph service board.
zack moved T2589: expose swh-graph API at archive.s.o/api/1/graph/ from Backlog to Deployed on the Compressed graph service board.
zack moved T2900: Public graph/ API does not handle streaming results from endpoints from Backlog to Deployed on the Compressed graph service board.
zack moved T1862: Implement new graph API specifications from Backlog to Deployed on the Compressed graph service board.
zack moved T1902: Use in-memory bitmap to store node->types relations in graph API from Backlog to Deployed on the Compressed graph service board.
zack moved T1903: Add graph service README files from Backlog to Deployed on the Compressed graph service board.
zack moved T1915: Add support for origin nodes in graph service API from Backlog to Deployed on the Compressed graph service board.
zack moved T1867: compress Merkle DAG and origin nodes together from Backlog to Deployed on the Compressed graph service board.
zack moved T1921: swh-graph: add logging of endpoint timing from Backlog to Deployed on the Compressed graph service board.
zack moved T1922: swh-graph optimization: bypass edge restriction checks when edges=* from Backlog to Deployed on the Compressed graph service board.
zack moved T1939: Measure memory needs for a swh-graph Azure VM from Backlog to Deployed on the Compressed graph service board.
zack moved T1941: Automatically generate mapping files after compressing graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1944: use a compact, binary format for node ids mapping files from Backlog to Deployed on the Compressed graph service board.
zack moved T1950: Reduce RAM usage for generating mapping files from Backlog to Deployed on the Compressed graph service board.
zack moved T2045: add support for reverse lookup from swh:1:ori:... PIDs to origin URLs from Backlog to Deployed on the Compressed graph service board.
zack moved T1951: Reduce RAM usage in graph API endpoints from Backlog to Deployed on the Compressed graph service board.
zack moved T1885: benchmark swh-graph use cases on the full graph from Backlog to Deployed on the Compressed graph service board.
zack moved T2054: CI: ImportMismatchError when running on swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T2055: swh-graph CI hangs badly when py4j doesn't find needed files from Backlog to Deployed on the Compressed graph service board.
zack moved T1868: refresh compressed representation of the archive from Backlog to Deployed on the Compressed graph service board.
zack moved T2530: Write a simple "quick start" for swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T2768: unbreak swh-graph CI from Backlog to Deployed on the Compressed graph service board.
zack moved T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet from Backlog to Deployed on the Compressed graph service board.
zack moved T3564: Puppetize graph service and add icinga alert from Backlog to Deployed on the Compressed graph service board.
zack raised the priority of T2647: add LLP support to graph compression pipeline from Normal to High.
zack moved T1967: REST server hangs when loading entire graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1943: Publish swh-graph to PyPI from Backlog to Deployed on the Compressed graph service board.
zack moved T3740: swh-graph: Translate node IDs on the Java side, not Python side from In progress to Implemented on the Compressed graph service board.
Nov 26 2021
Nov 26 2021
seirl closed T3740: swh-graph: Translate node IDs on the Java side, not Python side, a subtask of T3739: swh-graph: Remove SWHID -> Node ID mapping, use MPH instead, as Resolved.
Nov 23 2021
Nov 23 2021
zack changed the status of T2647: add LLP support to graph compression pipeline from Open to Work in Progress.
zack changed the status of T3161: graph service: add anti-DoS limit on the number of edges traversed, a subtask of T2220: swh-graph in production, from Open to Work in Progress.
zack changed the status of T3161: graph service: add anti-DoS limit on the number of edges traversed from Open to Work in Progress.
zack changed the status of T3739: swh-graph: Remove SWHID -> Node ID mapping, use MPH instead from Open to Work in Progress.
zack changed the status of T3740: swh-graph: Translate node IDs on the Java side, not Python side from Open to Work in Progress.
zack changed the status of T3740: swh-graph: Translate node IDs on the Java side, not Python side, a subtask of T3739: swh-graph: Remove SWHID -> Node ID mapping, use MPH instead, from Open to Work in Progress.
Nov 19 2021
Nov 19 2021
seirl triaged T3740: swh-graph: Translate node IDs on the Java side, not Python side as High priority.
Nov 15 2021
Nov 15 2021
vlorentz added a parent task for T2220: swh-graph in production: T3550: Compute and show ETA for vault tasks.
Nov 2 2021
Nov 2 2021
seirl added a comment to T2983: graph service: allow loading in memory only one direction of the graph.
Oct 31 2021
Oct 31 2021
zack added a comment to T2983: graph service: allow loading in memory only one direction of the graph.
Nope, if loaded with only one direction, traversals will only be possible in the loaded direction.
This will essentially be a trade-off setting for people who cannot (or doesn't want to) load both direction.
It is fine to fail (gracefully, with an error) traversals requested in a direction that corresponds to a non-loaded graph.
andrey-star added a comment to T2983: graph service: allow loading in memory only one direction of the graph.
Should this still allow the possibility of browsing both directions?
Oct 18 2021
Oct 18 2021
vlorentz added a comment to T3623: Run swh-graph with gunicorn to support multiple/parallel requests.
actually, before it starts leaking RAM, the Java process only uses 10% of the memory, so there is room to start a few more.
seirl closed T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet, a subtask of T3623: Run swh-graph with gunicorn to support multiple/parallel requests, as Resolved.
Done
Oct 14 2021
Oct 14 2021
ardumont renamed T1969: graph: reduce RAM usage for /walk from reduce RAM usage for /walk to graph: reduce RAM usage for /walk.
Oct 2 2021
Oct 2 2021
zack raised the priority of T3623: Run swh-graph with gunicorn to support multiple/parallel requests from Normal to High.
zack raised the priority of T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet from Normal to High.
zack renamed T3623: Run swh-graph with gunicorn to support multiple/parallel requests from Run swh-graph with gunicorn to Run swh-graph with gunicorn to support multiple/parallel requests.
Oct 1 2021
Oct 1 2021
Sep 30 2021
Sep 30 2021
cc @seirl
vlorentz lowered the priority of T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet from High to Normal.