Page MenuHomeSoftware Heritage
Feed Advanced Search

Jul 28 2019

zack created D1780: REST API doc: drop heading /graph.
Jul 28 2019, 7:11 PM
zack updated the diff for D1768: docker setup: simplify and uniform to SWH path conventions.
  • docker doc: add --publish to the run invocation
Jul 28 2019, 7:05 PM
zack triaged T1937: nicer landing page for the swh-graph REST API as Low priority.
Jul 28 2019, 7:04 PM · Compressed graph service
zack triaged T1936: integrate swh-graph into the docker environment as Wishlist priority.
Jul 28 2019, 6:56 PM · Docker environment, Compressed graph service
zack updated the diff for D1768: docker setup: simplify and uniform to SWH path conventions.
  • docker doc: drop the list of files generated by Setup class
Jul 28 2019, 5:37 PM

Jul 25 2019

zack updated the diff for D1768: docker setup: simplify and uniform to SWH path conventions.
  • docker doc: further shorten CLI examples using relative paths
Jul 25 2019, 5:02 PM
zack added a parent task for T1915: Add support for origin nodes in graph service API: T1867: compress Merkle DAG and origin nodes together.
Jul 25 2019, 4:58 PM · Compressed graph service
zack added a subtask for T1867: compress Merkle DAG and origin nodes together: T1915: Add support for origin nodes in graph service API.
Jul 25 2019, 4:58 PM · Compressed graph service
zack raised the priority of T1915: Add support for origin nodes in graph service API from Normal to High.

due to this bug (I suppose), trying to generate the various mapping files for a compressed graph that also includes swh:1:ori:... PIDs fails with:

Pre-computing node id maps...
Exception in thread "main" java.lang.IllegalArgumentException: Unknown SWH ID type in: swh:1:ori:4135fe80baeff9983f73e94b02da92f618cbb6c7
	at org.softwareheritage.graph.SwhId.<init>(SwhId.java:44)
	at org.softwareheritage.graph.backend.Setup.precomputeNodeIdMap(Setup.java:108)
	at org.softwareheritage.graph.backend.Setup.main(Setup.java:47)
Jul 25 2019, 4:57 PM · Compressed graph service
zack triaged T1933: bad invocation of o.s.graph.backend.Setup in docker doc as Low priority.
Jul 25 2019, 4:55 PM · Compressed graph service

Jul 24 2019

zack edited reviewers for D1768: docker setup: simplify and uniform to SWH path conventions, added: seirl, haltode; removed: Reviewers.
Jul 24 2019, 6:49 PM
Herald added a reviewer for D1768: docker setup: simplify and uniform to SWH path conventions: Reviewers.
Jul 24 2019, 6:49 PM
zack updated the task description for T1930: swh-graph: ship swh-graph.jar in the docker container.
Jul 24 2019, 7:54 AM · Compressed graph service
zack committed rDGRPHed0a948477c4: docker doc: update names of mapping files (authored by zack).
docker doc: update names of mapping files
Jul 24 2019, 7:54 AM
zack triaged T1930: swh-graph: ship swh-graph.jar in the docker container as Low priority.
Jul 24 2019, 7:51 AM · Compressed graph service

Jul 21 2019

zack updated the task description for T1927: Web app: rate limiting based on per-client API tokens.
Jul 21 2019, 4:11 PM · Web app
zack updated the task description for T1927: Web app: rate limiting based on per-client API tokens.
Jul 21 2019, 4:10 PM · Web app
zack updated the task description for T1927: Web app: rate limiting based on per-client API tokens.
Jul 21 2019, 4:10 PM · Web app
zack triaged T1927: Web app: rate limiting based on per-client API tokens as Normal priority.
Jul 21 2019, 4:10 PM · Web app
zack updated subscribers of T1884: python bindings for compressed graph access.

Here's a first stab at an API for the py4j bindings that would be nice to use.

Jul 21 2019, 2:31 PM · Compressed graph service
zack triaged T1926: FUSE filesystem to navigate the archive as Wishlist priority.
Jul 21 2019, 2:05 PM · Software Heritage filesystem

Jul 19 2019

zack requested changes to D1753: Bypass edge restriction checks when edges=*.
Jul 19 2019, 5:13 PM
zack requested changes to D1755: Add logging of endpoint timing.
Jul 19 2019, 5:04 PM
zack added inline comments to D1755: Add logging of endpoint timing.
Jul 19 2019, 4:20 PM
zack requested changes to D1755: Add logging of endpoint timing.

Instead of this, please add a pair of private methods to the Endpoint class, one to start timing (e.g., this.startTiming()), one to end it and return the diff w.r.t. the start time (e.g., this.stopTiming()) , and make all endpoint methods invoke the two methods and log the result.

Jul 19 2019, 4:13 PM
zack requested changes to D1753: Bypass edge restriction checks when edges=*.

I was more thinking of lifting this up to the traversal algo, ideally not having to do a test at every edge that is followed.
Done this way, this is not gonna gain you much, only a couple of array lookup per edge.

Jul 19 2019, 3:42 PM
zack updated subscribers of T1921: swh-graph: add logging of endpoint timing.
Jul 19 2019, 10:08 AM · Compressed graph service
zack updated the task description for T1922: swh-graph optimization: bypass edge restriction checks when edges=*.
Jul 19 2019, 10:08 AM · Compressed graph service
zack triaged T1922: swh-graph optimization: bypass edge restriction checks when edges=* as High priority.
Jul 19 2019, 10:06 AM · Compressed graph service
zack updated the task description for T1885: benchmark swh-graph use cases on the full graph.
Jul 19 2019, 10:06 AM · Compressed graph service
zack triaged T1921: swh-graph: add logging of endpoint timing as High priority.
Jul 19 2019, 10:05 AM · Compressed graph service

Jul 18 2019

zack triaged T1920: graph service: add tests for the python client as Normal priority.
Jul 18 2019, 4:27 PM · Compressed graph service
zack committed rDGRPHb60f3aca7402: add code of conduct (authored by zack).
add code of conduct
Jul 18 2019, 4:22 PM
zack changed the status of T1851: Integrate graph-compression git repo in swh-environment from Open to Work in Progress.

in f13a43d697eb0d10ba59a4789847742607c49aaa I've added swh-graph to the mrconfig of swh-environment, let's see what the CI has to say about that… (cc: @douardda)

Jul 18 2019, 10:26 AM · Compressed graph service
zack changed the status of T1851: Integrate graph-compression git repo in swh-environment, a subtask of T1887: publish swh-graph documentation at docs.s.o, from Open to Work in Progress.
Jul 18 2019, 10:26 AM · Documentation, Compressed graph service
zack committed rDENVf13a43d697eb: mrconfig: add shw-graph (authored by zack).
mrconfig: add shw-graph
Jul 18 2019, 10:24 AM
zack accepted D1743: New structure for the git repo.
Jul 18 2019, 10:21 AM
zack updated the summary of D1743: New structure for the git repo.
Jul 18 2019, 10:21 AM

Jul 17 2019

zack accepted D1741: Add javadoc documentation in graph service.
Jul 17 2019, 3:23 PM
zack added a comment to D1741: Add javadoc documentation in graph service.

Concerning links to swh-graph/docs it needs to wait for integration with swh-docs and then add external html links.

Jul 17 2019, 3:21 PM
zack requested changes to D1741: Add javadoc documentation in graph service.
Jul 17 2019, 2:51 PM
zack added a comment to D1741: Add javadoc documentation in graph service.

in addition to the comments below, a general issue is that all verbs are in the third person (e.g., "returns foo", "converts bla"), while it is more idiomatic to use the infinitive in API documentation (e.g., "return foo", "convert bla").

Jul 17 2019, 2:51 PM
zack committed rDGRPH3a6a78e961cd: use case doc: use more telling node identifiers where possible (authored by zack).
use case doc: use more telling node identifiers where possible
Jul 17 2019, 9:21 AM
zack committed rDGRPH2e9a8e071499: use case doc: add missing edge restrictions on a provenance example (authored by zack).
use case doc: add missing edge restrictions on a provenance example
Jul 17 2019, 9:21 AM
zack committed rDGRPHc40334767d1c: experiments report: standardize LaTeX conventions and packages (authored by zack).
experiments report: standardize LaTeX conventions and packages
Jul 17 2019, 8:51 AM
zack committed rDGRPHbd9243310d02: experiments report: use 3-letter node types everywhere (authored by zack).
experiments report: use 3-letter node types everywhere
Jul 17 2019, 8:51 AM

Jul 16 2019

zack added a comment to T1904: build developer documentation for swh-graph.

*SAD TROMBONE*.

Jul 16 2019, 4:06 PM · Documentation, Compressed graph service
zack added a comment to T1832: create a mailing list swh-user-announce.

If we agree that the status page is the way forward (and that clients interested in swh can use it to subscribe to update), i think we could close this current task now.

Jul 16 2019, 12:06 PM · SWORD deposit
zack committed rDGRPHbbbb898dedaf: doc: add use cases and benchmark description (authored by zack).
doc: add use cases and benchmark description
Jul 16 2019, 11:52 AM
zack closed D1738: doc: add use cases and benchmark description.
Jul 16 2019, 11:52 AM
zack updated the diff for D1738: doc: add use cases and benchmark description.
  • use case doc: update edge restrictions for provenance use cases
Jul 16 2019, 11:42 AM
zack updated the diff for D1738: doc: add use cases and benchmark description.
  • doc: add use cases and benchmark description
  • use cases doc: fix typo and remove out-of-scope comments
  • use case doc: update edge restrictions for provenance use cases
Jul 16 2019, 11:40 AM
zack added inline comments to D1738: doc: add use cases and benchmark description.
Jul 16 2019, 11:37 AM
zack triaged T1919: ingest the OW2 GitLab instance as Normal priority.
Jul 16 2019, 10:54 AM · Origin-GitLab, Archive coverage
zack accepted D1736: Separate id mapping from traversals using node2type map.

as a minor point on the commit message, I think you need separate Closes lines to close several bugs with a commit at once

Jul 16 2019, 9:37 AM

Jul 15 2019

zack added inline comments to D1738: doc: add use cases and benchmark description.
Jul 15 2019, 5:06 PM
zack updated the diff for D1738: doc: add use cases and benchmark description.
  • use cases doc: fix typo and remove out-of-scope comments
Jul 15 2019, 5:06 PM
zack added a project to T1917: status.softwareheritage.org: Define communication policy behind downtime per service: System administration.
Jul 15 2019, 4:23 PM · System administration
zack updated the summary of D1738: doc: add use cases and benchmark description.
Jul 15 2019, 4:22 PM
zack created D1738: doc: add use cases and benchmark description.
Jul 15 2019, 4:22 PM
zack edited P461 swh-graph use cases.
Jul 15 2019, 4:19 PM · Compressed graph service
zack accepted D1726: Add node id -> node types bitmap.
Jul 15 2019, 10:01 AM

Jul 14 2019

zack renamed T1914: Keep mirror of contents on S3 up to date from synchronously write content objects to AWS to synchronously write content objects to AWS during ingestion.
Jul 14 2019, 4:48 PM · Mirror, Datasets
zack triaged T1914: Keep mirror of contents on S3 up to date as High priority.
Jul 14 2019, 4:47 PM · Mirror, Datasets

Jul 12 2019

zack committed rDSTOCb27fcd1b4374: add code of conduct document (authored by zack).
add code of conduct document
Jul 12 2019, 12:15 PM
zack added inline comments to D1726: Add node id -> node types bitmap.
Jul 12 2019, 9:43 AM

Jul 11 2019

zack requested changes to D1726: Add node id -> node types bitmap.
Jul 11 2019, 5:09 PM
zack committed rSPUWSGIe5bb26934b32: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:41 PM
zack committed rSPSITE9fe9ad8f1e45: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:41 PM
zack committed rSPSYSDf83087814648: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:41 PM
zack committed rSPMW90ae189d53f9: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:41 PM
zack committed rSPPFIX4311d7226120: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:41 PM
zack committed rSPGUNIa6e2d045fd62: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:41 PM
zack committed rSPDARb9d67edbcc0f: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:41 PM
zack committed rDWAPPS4040ec657a6c: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:32 PM
zack committed rDVAU3d06845d2780: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDSCHcc1b590c1c9c: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDSTOb27fcd1b4374: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDBASE68a55399da6f: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDOBJS69fa2cc17860: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDMIRFOR3ad80b0e9a19: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDMOD68142a78889d: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDSVN1bcde16c4605: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDTARd78481e751f7: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDPY95a43c08954a: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDNPMdc5c9293c969: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDHGa9ca3039fc45: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDG123a86e12187: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDDIRd6e0f6ce69b8: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLDDEBc99399928f12: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDJNLbe2d71068b10: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDLS9c97291abdb1: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDCIDXd17cc016ec25: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDDOC338ff3e6168b: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rCDFD2edb4967a9f7: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDDEP5bb3e2184f7e: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDSNIP0e8cf90b815b: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDCORE433048e69426: add code of conduct document (authored by zack).
add code of conduct document
Jul 11 2019, 4:31 PM
zack committed rDTPL796dd5b33fdb: CoC: update to match current version of contributor covenant 1.4 (authored by zack).
CoC: update to match current version of contributor covenant 1.4
Jul 11 2019, 4:12 PM
zack committed rDTPLf4b32b7b8114: add code of conduct document, based on contributor covenant (authored by zack).
add code of conduct document, based on contributor covenant
Jul 11 2019, 4:12 PM