In T3887#77949, @olasd wrote:Now that I've written it out loud, of course, Releases don't have extra_headers so the package loaders can't make use of this workaround/hack for now.
- Queries
- All Stories
- Search
- Advanced Search
- Transactions
- Transaction Logs
Feed Advanced Search
Advanced Search
Advanced Search
Jan 27 2022
Jan 27 2022
check in recent presentations
Jan 25 2022
Jan 25 2022
Jan 10 2022
Jan 10 2022
zack committed R183:6b876e2ac76b: add several entries about reproducibility, FOSS geography, and diversity (authored by zack).
add several entries about reproducibility, FOSS geography, and diversity
Jan 4 2022
Jan 4 2022
zack changed the status of T3768: Read compression input from ORC instead of the edges file from Open to Work in Progress.
Jan 3 2022
Jan 3 2022
@marla.dasilva @anlambert: let's go for "Until Jan 30th" then. (I'll also ping you about this in the chat, just in case.)
Jan 3 2022, 3:43 PM · Unknown Object (Project)
Thanks Marla, I also planned to raise this.
Jan 3 2022, 11:13 AM · Unknown Object (Project)
Dec 16 2021
Dec 16 2021
zack renamed T2400: Ingest current and historical Ubuntu releases from Ingest current and history Ubuntu releases to Ingest current and historical Ubuntu releases.
Dec 14 2021
Dec 14 2021
zack raised the priority of T3161: graph service: add anti-DoS limit on the number of edges traversed from Normal to High.
Dec 6 2021
Dec 6 2021
Just to be sure: test_pipeline() from test_cli.py is now run with all new passes as well, and as such it also testes the LLP step(s), correct?
It seems that way to me because test_pipeline() seems to be running all passes, but I'd like this to be double-checked before landing.
Dec 4 2021
Dec 4 2021
zack committed rMSLDfc9bffe30c07: check-in slides for tech presentation at #swh5years sponsors meeting (authored by zack).
check-in slides for tech presentation at #swh5years sponsors meeting
Dec 1 2021
Dec 1 2021
zack moved T2595: Add a default configuration based on graph size (eg: batch_size) from Backlog to Deployed on the Compressed graph service board.
zack changed the status of T2113: swh-graph: add support to optionally resolve ori PIDs to origin URLs from Wontfix to Resolved.
zack moved T2112: make "swh graph map lookup" accept lists of identifiers from Backlog to Deployed on the Compressed graph service board.
zack moved T2096: CNAME for graph service: graph.internal.softwareheritage.org (?) from Backlog to Deployed on the Compressed graph service board.
zack moved T2083: provide systemd service file for swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1933: bad invocation of o.s.graph.backend.Setup in docker doc from Backlog to Deployed on the Compressed graph service board.
zack moved T1898: swh-graph: refactor algo implementations to not forcibly memoize results from Backlog to Deployed on the Compressed graph service board.
zack moved T1884: python bindings for compressed graph access from Backlog to Deployed on the Compressed graph service board.
zack moved T1937: nicer landing page for the swh-graph REST API from Backlog to Deployed on the Compressed graph service board.
zack changed the status of T1968: existing graph endpoints should not return 404 upon missing arguments from Invalid to Resolved.
zack moved T1936: integrate swh-graph into the docker environment from Backlog to Deployed on the Compressed graph service board.
zack changed the status of T1930: swh-graph: ship swh-graph.jar in the docker container from Wontfix to Resolved.
zack moved T1887: publish swh-graph documentation at docs.s.o from Backlog to Deployed on the Compressed graph service board.
zack moved T1851: Integrate graph-compression git repo in swh-environment from Backlog to Deployed on the Compressed graph service board.
zack moved T1877: Add contextual info to compression pipeline from Backlog to Deployed on the Compressed graph service board.
zack moved T1878: Write documentation on compression process from Backlog to Deployed on the Compressed graph service board.
zack moved T1879: Write documentation on compression Docker env from Backlog to Deployed on the Compressed graph service board.
zack moved T1889: graph API: add endpoint to return the leaves of a subgraph from Backlog to Deployed on the Compressed graph service board.
zack moved T1886: graph API: add endpoint to return the adjacency list of a node from Backlog to Deployed on the Compressed graph service board.
zack moved T1904: build developer documentation for swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1920: graph service: add tests for the python client from Backlog to Deployed on the Compressed graph service board.
zack moved T1938: swh-graph: NullPointerException upon (wrong) /walk from cnt to snp from Backlog to Deployed on the Compressed graph service board.
zack moved T1945: Return timings instead of simply logging them from Backlog to Deployed on the Compressed graph service board.
zack moved T1952: Log raw datapoint in graph benchmarks from Backlog to Deployed on the Compressed graph service board.
zack moved T2053: support graph export for the cassandra backend from Backlog to Deployed on the Compressed graph service board.
zack moved T2072: common configuration file for swh graph rpc-serve, compress, … from Backlog to Deployed on the Compressed graph service board.
zack moved T2077: add random walk endpoint with limited retries from Backlog to Deployed on the Compressed graph service board.
zack moved T2084: swh-graph: add /last endpoint variants to the REST API from Backlog to Deployed on the Compressed graph service board.
zack moved T2114: swh-graph API: add ?limit=N method variants to return first N results from Backlog to Deployed on the Compressed graph service board.
zack moved T2589: expose swh-graph API at archive.s.o/api/1/graph/ from Backlog to Deployed on the Compressed graph service board.
zack moved T2900: Public graph/ API does not handle streaming results from endpoints from Backlog to Deployed on the Compressed graph service board.
zack moved T1862: Implement new graph API specifications from Backlog to Deployed on the Compressed graph service board.
zack moved T1902: Use in-memory bitmap to store node->types relations in graph API from Backlog to Deployed on the Compressed graph service board.
zack moved T1903: Add graph service README files from Backlog to Deployed on the Compressed graph service board.
zack moved T1915: Add support for origin nodes in graph service API from Backlog to Deployed on the Compressed graph service board.
zack moved T1867: compress Merkle DAG and origin nodes together from Backlog to Deployed on the Compressed graph service board.
zack moved T1921: swh-graph: add logging of endpoint timing from Backlog to Deployed on the Compressed graph service board.
zack moved T1922: swh-graph optimization: bypass edge restriction checks when edges=* from Backlog to Deployed on the Compressed graph service board.
zack moved T1939: Measure memory needs for a swh-graph Azure VM from Backlog to Deployed on the Compressed graph service board.
zack moved T1941: Automatically generate mapping files after compressing graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1944: use a compact, binary format for node ids mapping files from Backlog to Deployed on the Compressed graph service board.
zack moved T1950: Reduce RAM usage for generating mapping files from Backlog to Deployed on the Compressed graph service board.
zack moved T2045: add support for reverse lookup from swh:1:ori:... PIDs to origin URLs from Backlog to Deployed on the Compressed graph service board.
zack moved T1951: Reduce RAM usage in graph API endpoints from Backlog to Deployed on the Compressed graph service board.
zack moved T1885: benchmark swh-graph use cases on the full graph from Backlog to Deployed on the Compressed graph service board.
zack moved T2054: CI: ImportMismatchError when running on swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T2055: swh-graph CI hangs badly when py4j doesn't find needed files from Backlog to Deployed on the Compressed graph service board.
zack moved T1868: refresh compressed representation of the archive from Backlog to Deployed on the Compressed graph service board.
zack moved T2530: Write a simple "quick start" for swh-graph from Backlog to Deployed on the Compressed graph service board.
zack moved T2768: unbreak swh-graph CI from Backlog to Deployed on the Compressed graph service board.
zack moved T3624: Update swh-graph from 0.3.0 to 0.5.0 on granet from Backlog to Deployed on the Compressed graph service board.
zack moved T3564: Puppetize graph service and add icinga alert from Backlog to Deployed on the Compressed graph service board.
zack raised the priority of T2647: add LLP support to graph compression pipeline from Normal to High.
zack moved T1967: REST server hangs when loading entire graph from Backlog to Deployed on the Compressed graph service board.
zack moved T1943: Publish swh-graph to PyPI from Backlog to Deployed on the Compressed graph service board.
zack moved T3740: swh-graph: Translate node IDs on the Java side, not Python side from In progress to Implemented on the Compressed graph service board.
zack raised the priority of T2400: Ingest current and historical Ubuntu releases from Normal to High.
Nov 29 2021
Nov 29 2021
I've tried replacing the content of foo.txt with something unknown to the archive (random garbage) and the sunburst rendering still shows 100.0%.
So it could also be a rounding error instead.
Either way, it is misleading and should be fixed.
zack triaged T3754: scanning sunburst rendering fail with "ValueError: Empty data passed with indices specified." as Normal priority.
Nov 23 2021
Nov 23 2021
zack changed the status of T2647: add LLP support to graph compression pipeline from Open to Work in Progress.
zack changed the status of T3161: graph service: add anti-DoS limit on the number of edges traversed, a subtask of T2220: swh-graph in production, from Open to Work in Progress.
zack changed the status of T3161: graph service: add anti-DoS limit on the number of edges traversed from Open to Work in Progress.
zack changed the status of T3739: swh-graph: Remove SWHID -> Node ID mapping, use MPH instead from Open to Work in Progress.
zack changed the status of T3740: swh-graph: Translate node IDs on the Java side, not Python side from Open to Work in Progress.
zack changed the status of T3740: swh-graph: Translate node IDs on the Java side, not Python side, a subtask of T3739: swh-graph: Remove SWHID -> Node ID mapping, use MPH instead, from Open to Work in Progress.
Nov 18 2021
Nov 18 2021
<3
zack triaged T3737: documentation sidebar: group swh.* module doc under a "API reference" heading as Low priority.
Nov 15 2021
Nov 15 2021
the cooking has completed now
Nov 11 2021
Nov 11 2021
check in slides for SFScon 2021 talk
status module: update total size figure
Nov 9 2021
Nov 9 2021
In T1538#73659, @moranegg wrote:Is the request for regular pulling?
If yes, it should be added for visibility on the home page of the archive.
If no, it should be clear this is a one shot thing.
Nov 8 2021
Nov 8 2021
zack updated the task description for T3717: Ingest opam instance https://coq.inria.fr/opam/released/.
zack added a project to T3717: Ingest opam instance https://coq.inria.fr/opam/released/: Archive coverage.
Nov 3 2021
Nov 3 2021
Where is the documentation on how to access the new read-only object storage?
(hint hint :-))
Nov 2 2021
Nov 2 2021
Oct 31 2021
Oct 31 2021
zack added a comment to T2983: graph service: allow loading in memory only one direction of the graph.
Nope, if loaded with only one direction, traversals will only be possible in the loaded direction.
This will essentially be a trade-off setting for people who cannot (or doesn't want to) load both direction.
It is fine to fail (gracefully, with an error) traversals requested in a direction that corresponds to a non-loaded graph.
zack added a comment to T3627: Consider dropping pull request references from the git loader ingestion.
Thanks for the summaries @olasd, both here and on list.
I've followed up on list.
Oct 28 2021
Oct 28 2021