Page MenuHomeSoftware Heritage
Feed Advanced Search

Sep 18 2020

haltode updated the diff for D3990: Replace deprecated "SWH PID" naming with "SWHID".

Rename SWHIDS variable to swhids.

Sep 18 2020, 4:07 PM
haltode added inline comments to D3990: Replace deprecated "SWH PID" naming with "SWHID".
Sep 18 2020, 3:43 PM
haltode created D3990: Replace deprecated "SWH PID" naming with "SWHID".
Sep 18 2020, 3:27 PM
haltode updated the diff for D3974: WIP: fuse design doc.

Fix zack comments.

Sep 18 2020, 1:26 PM
haltode committed rDGRPHbc5614a2c6fa: docs: quickstart: add compression instructions (authored by haltode).
docs: quickstart: add compression instructions
Sep 18 2020, 1:02 PM
haltode closed D3945: docs: quickstart: add compression instructions.
Sep 18 2020, 1:02 PM
haltode updated the diff for D3945: docs: quickstart: add compression instructions.

Rebase on master.

Sep 18 2020, 1:00 PM
haltode closed D3944: test_cli.py: fix passing custom config to CLI.

Merged in a0f17b471ced.

Sep 18 2020, 12:02 PM
haltode updated the diff for D3944: test_cli.py: fix passing custom config to CLI.

Rebase on master.

Sep 18 2020, 11:57 AM
haltode updated the diff for D3944: test_cli.py: fix passing custom config to CLI.

Remove unnecessary Path call

Sep 18 2020, 11:53 AM
haltode updated the diff for D3944: test_cli.py: fix passing custom config to CLI.

Fix import yaml and use Pathlib write_text method.

Sep 18 2020, 11:49 AM
haltode committed rDWCLI17ff20ffaf34: Replace deprecated PersistentID class with SWHID (authored by haltode).
Replace deprecated PersistentID class with SWHID
Sep 18 2020, 10:10 AM
haltode closed D3982: Replace deprecated PersistentID class with SWHID.
Sep 18 2020, 10:10 AM
haltode updated the diff for D3982: Replace deprecated PersistentID class with SWHID.

Rebase on master (new isort hook)

Sep 18 2020, 10:09 AM
haltode updated the diff for D3982: Replace deprecated PersistentID class with SWHID.

Simplify Generator type hints with Iterator.

Sep 18 2020, 9:52 AM
haltode updated the diff for D3982: Replace deprecated PersistentID class with SWHID.

Missed one occurrence of PersistentId in documentation.

Sep 18 2020, 9:45 AM
haltode created D3982: Replace deprecated PersistentID class with SWHID.
Sep 18 2020, 9:42 AM

Sep 17 2020

haltode updated the diff for D3974: WIP: fuse design doc.

Add more context information on swh-graph.

Sep 17 2020, 1:51 PM
haltode created D3974: WIP: fuse design doc.
Sep 17 2020, 1:28 PM

Sep 16 2020

haltode created D3962: WIP: add permissions on edge labels.
Sep 16 2020, 11:28 AM

Sep 15 2020

haltode added a comment to T2595: Add a default configuration based on graph size (eg: batch_size).

Must update the quickstart documentation guide once implemented.

Sep 15 2020, 11:32 AM · Compressed graph service
haltode updated the diff for D3945: docs: quickstart: add compression instructions.

Fix wording suggestions from zack.

Sep 15 2020, 11:30 AM
haltode added inline comments to D3945: docs: quickstart: add compression instructions.
Sep 15 2020, 11:28 AM
haltode triaged T2595: Add a default configuration based on graph size (eg: batch_size) as Low priority.
Sep 15 2020, 11:27 AM · Compressed graph service
haltode created D3945: docs: quickstart: add compression instructions.
Sep 15 2020, 10:41 AM
haltode created D3944: test_cli.py: fix passing custom config to CLI.
Sep 15 2020, 10:01 AM

Sep 3 2020

haltode accepted D3878: Large unreviewable swh-graph refactor.

This is a "light" approval since I did not get to play with the diff/code locally, but it's pretty good-looking! \o/

Sep 3 2020, 10:53 PM

Feb 24 2020

haltode created D2711: gsoc-epita: add 2020 slides.
Feb 24 2020, 3:07 PM

Nov 16 2019

haltode accepted D2290: REST API doc: clarify edge restriciton semantics for the backward graph.
Nov 16 2019, 4:03 PM

Sep 19 2019

haltode added inline comments to D1991: Reimplement REST API in Python with Py4J + aiohttp.
Sep 19 2019, 10:04 AM

Sep 6 2019

haltode accepted D1956: docs: fix toc.
Sep 6 2019, 11:57 AM

Sep 3 2019

haltode added inline comments to D1944: binary (de)serialiazer for more compact PID<->int maps.
Sep 3 2019, 11:19 PM

Aug 27 2019

haltode created P516 Updated README for compressed graph on annex in the S1 Public space.
Aug 27 2019, 9:20 PM · Compressed graph service
haltode created P514 haltode swh-graph commits list in the S1 Public space.
Aug 27 2019, 2:02 PM · Compressed graph service

Aug 26 2019

haltode triaged T1971: Integrate swh-graph javadoc in swh-docs as Low priority.
Aug 26 2019, 10:25 PM · Documentation, Compressed graph service

Aug 25 2019

haltode committed rDGRPH0b46253799f4: reports: benchmarks: add machine specs (authored by haltode).
reports: benchmarks: add machine specs
Aug 25 2019, 5:39 PM
haltode committed rDGRPHb31d2e86a80c: reports: benchmarks: add unit in tables (authored by haltode).
reports: benchmarks: add unit in tables
Aug 25 2019, 5:39 PM
haltode closed T1851: Integrate graph-compression git repo in swh-environment as Resolved.

The swh-graph repo is now fully integrated and has CI

Aug 25 2019, 2:56 PM · Compressed graph service
haltode closed T1851: Integrate graph-compression git repo in swh-environment, a subtask of T1887: publish swh-graph documentation at docs.s.o, as Resolved.
Aug 25 2019, 2:56 PM · Documentation, Compressed graph service
haltode placed T1904: build developer documentation for swh-graph up for grabs.
Aug 25 2019, 2:55 PM · Documentation, Compressed graph service
haltode placed T1941: Automatically generate mapping files after compressing graph up for grabs.
Aug 25 2019, 2:55 PM · Compressed graph service
haltode closed T1951: Reduce RAM usage in graph API endpoints as Resolved.

This was fixed with in 87192dfddd4b by using a hash map. See T1969 for long term solution.

Aug 25 2019, 2:54 PM · Compressed graph service
haltode triaged T1969: graph: reduce RAM usage for /walk as Normal priority.
Aug 25 2019, 2:54 PM · Compressed graph service
haltode closed T1885: benchmark swh-graph use cases on the full graph as Resolved.

Done, see latex report in https://forge.softwareheritage.org/source/swh-graph/browse/master/reports/benchmarks/benchmarks.tex

Aug 25 2019, 2:40 PM · Compressed graph service
haltode updated subscribers of T1943: Publish swh-graph to PyPI.

However in swh-docs the java version is 8 which is not compatible to generate the javadoc (it should be >= 9), see https://jenkins.softwareheritage.org/view/all/job/DDOC/job/publish/lastFailedBuild/console

Aug 25 2019, 2:36 PM · Compressed graph service

Aug 24 2019

haltode closed T1967: REST server hangs when loading entire graph as Resolved.

I recompiled from scratch the Java server, rebooted the Azure vm and everything works as expected, no more query hanging.

Aug 24 2019, 8:35 PM · Compressed graph service

Aug 23 2019

haltode committed rDGRPHc7363b064ae1: reports: add benchmarks (authored by haltode).
reports: add benchmarks
Aug 23 2019, 8:28 PM
haltode added a project to T1967: REST server hangs when loading entire graph: Compressed graph service.
Aug 23 2019, 8:11 PM · Compressed graph service
haltode triaged T1967: REST server hangs when loading entire graph as High priority.
Aug 23 2019, 8:11 PM · Compressed graph service
haltode committed rDGRPHb6c6e1eec131: release 0.0.2 (authored by haltode).
release 0.0.2
Aug 23 2019, 7:10 PM
haltode closed D1908: Release swh-graph 0.0.2.
Aug 23 2019, 7:10 PM
haltode added a comment to D1908: Release swh-graph 0.0.2.

For the symlink part, the stackoverflow post I linked was only for the jar without dependencies so it could not work. I tried with exec-maven-plugin but could not get it to bind at the end of Maven lifecycle...

Aug 23 2019, 7:09 PM
haltode updated the diff for D1908: Release swh-graph 0.0.2.

Remove @version and @since tags

Aug 23 2019, 7:08 PM
haltode added a comment to D1908: Release swh-graph 0.0.2.
In D1908#44068, @zack wrote:

We certainly don't want to modify all Java files at each release.
So please either fix it the right way (which would probably mean some git subst var hackery) or at least for now just get rid of the version numbers from all Java source code - it's useless information anyway, as it belongs to the underlying VCS.

Aug 23 2019, 12:58 PM
haltode created D1908: Release swh-graph 0.0.2.
Aug 23 2019, 11:59 AM
haltode committed rDGRPHd5dcbfcdf245: server: test: fix tests using same Endpoint multiple times (authored by haltode).
server: test: fix tests using same Endpoint multiple times
Aug 23 2019, 10:43 AM
haltode closed D1906: Fix tests using same Endpoint multiple times.
Aug 23 2019, 10:43 AM

Aug 22 2019

haltode created D1906: Fix tests using same Endpoint multiple times.
Aug 22 2019, 8:14 PM
haltode committed rDGRPH493a3b007b1f: server: benchmark: add nbEdgesAccessed in stats output (authored by haltode).
server: benchmark: add nbEdgesAccessed in stats output
Aug 22 2019, 7:34 PM
haltode closed D1900: server: benchmark: add nbEdgesAccessed in stats output.
Aug 22 2019, 7:34 PM
haltode added reviewers for D1900: server: benchmark: add nbEdgesAccessed in stats output: zack, seirl.
Aug 22 2019, 4:59 PM
Herald added a reviewer for D1900: server: benchmark: add nbEdgesAccessed in stats output: Reviewers.
Aug 22 2019, 4:59 PM

Aug 21 2019

haltode committed rDGRPH7705d1c8b8cc: client: tests: add longer delay for server startup (authored by haltode).
client: tests: add longer delay for server startup
Aug 21 2019, 9:23 PM
haltode closed D1868: client: tests: add longer delay for server startup.
Aug 21 2019, 9:23 PM
haltode updated the diff for D1868: client: tests: add longer delay for server startup.

Rebasing on master.

Aug 21 2019, 9:19 PM

Aug 19 2019

haltode closed D1867: server: remove unnecessary 'visited.fill(false)' call.
Aug 19 2019, 5:40 PM
haltode committed rDGRPH101c50f2f10e: server: remove unnecessary 'visited.fill(false)' call (authored by haltode).
server: remove unnecessary 'visited.fill(false)' call
Aug 19 2019, 5:40 PM
haltode created D1868: client: tests: add longer delay for server startup.
Aug 19 2019, 4:03 PM
haltode created D1867: server: remove unnecessary 'visited.fill(false)' call.
Aug 19 2019, 3:44 PM
haltode committed rDGRPHb1fdd018fd5a: client: tests add missing 'meta' information (authored by haltode).
client: tests add missing 'meta' information
Aug 19 2019, 3:37 PM
haltode closed D1866: client: tests add missing 'meta' information.
Aug 19 2019, 3:37 PM
haltode updated the diff for D1866: client: tests add missing 'meta' information.

Rename assert_endpoint_result to assert_endpoint_output.

Aug 19 2019, 3:25 PM
haltode created D1866: client: tests add missing 'meta' information.
Aug 19 2019, 3:21 PM
haltode committed rDGRPHb0bcbe039d19: server: add missing 'meta' information when not using '--timings' (authored by haltode).
server: add missing 'meta' information when not using '--timings'
Aug 19 2019, 11:47 AM
haltode committed rDGRPH2bc36b702416: server: fix naming convention (authored by haltode).
server: fix naming convention
Aug 19 2019, 11:30 AM
haltode closed D1859: Benchmark: fix CSV log overwriting.
Aug 19 2019, 11:22 AM
haltode committed rDGRPH468a99dc4dd3: server: benchmark: fix CSV log overwriting (authored by haltode).
server: benchmark: fix CSV log overwriting
Aug 19 2019, 11:22 AM
haltode updated the diff for D1859: Benchmark: fix CSV log overwriting.

Amend commit to explain in more details why the fix is necessary.

Aug 19 2019, 11:21 AM
haltode created D1859: Benchmark: fix CSV log overwriting.
Aug 19 2019, 11:04 AM
haltode created P509 (An Untitled Masterwork) in the S1 Public space.
Aug 19 2019, 10:44 AM

Aug 18 2019

haltode added a comment to D1857: Remove swh.graph from swh.docs' dependencies..

Yes, totally, I was waiting on olasd return to see with him how to add Maven to the Jenkins environment. We should have some news about this on Tuesday! ;)

Aug 18 2019, 10:49 AM

Aug 16 2019

haltode closed D1856: Benchmark: add median value in stats.
Aug 16 2019, 6:21 PM
haltode committed rDGRPHd9e93fb46f5e: server: benchmark: add median value in stats (authored by haltode).
server: benchmark: add median value in stats
Aug 16 2019, 6:21 PM
haltode created D1856: Benchmark: add median value in stats.
Aug 16 2019, 6:14 PM
haltode committed rDGRPH30218b7dc68f: server: benchmark: output raw datapoints in CSV log file (authored by haltode).
server: benchmark: output raw datapoints in CSV log file
Aug 16 2019, 6:12 PM
haltode closed D1855: Benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 6:12 PM
haltode closed T1952: Log raw datapoint in graph benchmarks as Resolved by committing rDGRPH30218b7dc68f: server: benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 6:12 PM · Compressed graph service
haltode updated the diff for D1855: Benchmark: output raw datapoints in CSV log file.
  • Add CSV header line
  • Use ; as a CSV separator
Aug 16 2019, 4:18 PM
haltode added a revision to T1952: Log raw datapoint in graph benchmarks: D1855: Benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 12:14 PM · Compressed graph service
haltode created D1855: Benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 12:14 PM
haltode committed rDGRPHb46335c0e772: server: traversal: use node degree to count number of accessed edges (authored by haltode).
server: traversal: use node degree to count number of accessed edges
Aug 16 2019, 11:07 AM

Aug 15 2019

haltode triaged T1952: Log raw datapoint in graph benchmarks as Normal priority.
Aug 15 2019, 9:49 PM · Compressed graph service
haltode created P507 Graph benchmarks: vault use-case in the S1 Public space.
Aug 15 2019, 9:46 PM · Compressed graph service
haltode added a project to P505 Browsing benchmarks early results: Compressed graph service.
Aug 15 2019, 9:46 PM · Compressed graph service
haltode committed rDGRPH4c0846228465: server: benchmark: move random generator code to Common.java (authored by haltode).
server: benchmark: move random generator code to Common.java
Aug 15 2019, 6:53 PM
haltode committed rDGRPH87192dfddd4b: server: use hash map instead of LongBigArray to backtrack (authored by haltode).
server: use hash map instead of LongBigArray to backtrack
Aug 15 2019, 6:44 PM
haltode closed D1854: Use hash map instead of LongBigArray to backtrack.
Aug 15 2019, 6:44 PM
haltode created D1854: Use hash map instead of LongBigArray to backtrack.
Aug 15 2019, 5:44 PM

Aug 14 2019

haltode added a comment to T1951: Reduce RAM usage in graph API endpoints.

From Javalin documentation [1]:

Aug 14 2019, 9:52 PM · Compressed graph service
haltode added a comment to T1951: Reduce RAM usage in graph API endpoints.

Both big arrays are meant to be used with all the graph nodes, here is their RAM usage:

Aug 14 2019, 9:47 PM · Compressed graph service