Page MenuHomeSoftware Heritage

haltode (Thibault Allançon)
User

Projects

User Details

User Since
Mar 1 2019, 4:40 AM (40 w, 4 d)

Recent Activity

Sat, Nov 16

haltode accepted D2290: REST API doc: clarify edge restriciton semantics for the backward graph.
Sat, Nov 16, 4:03 PM

Sep 19 2019

haltode added inline comments to D1991: Reimplement REST API in Python with Py4J + aiohttp.
Sep 19 2019, 10:04 AM

Sep 6 2019

haltode accepted D1956: docs: fix toc.
Sep 6 2019, 11:57 AM

Sep 3 2019

haltode added inline comments to D1944: binary (de)serialiazer for more compact PID<->int maps.
Sep 3 2019, 11:19 PM

Aug 27 2019

haltode created P516 Updated README for compressed graph on annex in the S1 Public space.
Aug 27 2019, 9:20 PM · Graph service
haltode created P514 haltode swh-graph commits list in the S1 Public space.
Aug 27 2019, 2:02 PM · Graph service

Aug 26 2019

haltode triaged T1971: Integrate swh-graph javadoc in swh-docs as Low priority.
Aug 26 2019, 10:25 PM · Development documentation, Graph service

Aug 25 2019

haltode committed rDGRPH0b46253799f4: reports: benchmarks: add machine specs (authored by haltode).
reports: benchmarks: add machine specs
Aug 25 2019, 5:39 PM
haltode committed rDGRPHb31d2e86a80c: reports: benchmarks: add unit in tables (authored by haltode).
reports: benchmarks: add unit in tables
Aug 25 2019, 5:39 PM
haltode closed T1851: Integrate graph-compression git repo in swh-environment as Resolved.

The swh-graph repo is now fully integrated and has CI

Aug 25 2019, 2:56 PM · Graph service
haltode closed T1851: Integrate graph-compression git repo in swh-environment, a subtask of T1887: publish swh-graph documentation at docs.s.o, as Resolved.
Aug 25 2019, 2:56 PM · Development documentation, Graph service
haltode placed T1904: build developer documentation for swh-graph up for grabs.
Aug 25 2019, 2:55 PM · Development documentation, Graph service
haltode placed T1941: Automatically generate mapping files after compressing graph up for grabs.
Aug 25 2019, 2:55 PM · Graph service
haltode closed T1951: Reduce RAM usage in graph API endpoints as Resolved.

This was fixed with in 87192dfddd4b by using a hash map. See T1969 for long term solution.

Aug 25 2019, 2:54 PM · Graph service
haltode triaged T1969: reduce RAM usage for /walk as Normal priority.
Aug 25 2019, 2:54 PM · Graph service
haltode closed T1885: benchmark swh-graph use cases on the full graph as Resolved.

Done, see latex report in https://forge.softwareheritage.org/source/swh-graph/browse/master/reports/benchmarks/benchmarks.tex

Aug 25 2019, 2:40 PM · Graph service
haltode updated subscribers of T1943: Publish swh-graph to PyPI.

However in swh-docs the java version is 8 which is not compatible to generate the javadoc (it should be >= 9), see https://jenkins.softwareheritage.org/view/all/job/DDOC/job/publish/lastFailedBuild/console

Aug 25 2019, 2:36 PM · Graph service

Aug 24 2019

haltode closed T1967: REST server hangs when loading entire graph as Resolved.

I recompiled from scratch the Java server, rebooted the Azure vm and everything works as expected, no more query hanging.

Aug 24 2019, 8:35 PM · Graph service

Aug 23 2019

haltode committed rDGRPHc7363b064ae1: reports: add benchmarks (authored by haltode).
reports: add benchmarks
Aug 23 2019, 8:28 PM
haltode added a project to T1967: REST server hangs when loading entire graph: Graph service.
Aug 23 2019, 8:11 PM · Graph service
haltode triaged T1967: REST server hangs when loading entire graph as High priority.
Aug 23 2019, 8:11 PM · Graph service
haltode committed rDGRPHb6c6e1eec131: release 0.0.2 (authored by haltode).
release 0.0.2
Aug 23 2019, 7:10 PM
haltode closed D1908: Release swh-graph 0.0.2.
Aug 23 2019, 7:10 PM
haltode added a comment to D1908: Release swh-graph 0.0.2.

For the symlink part, the stackoverflow post I linked was only for the jar without dependencies so it could not work. I tried with exec-maven-plugin but could not get it to bind at the end of Maven lifecycle...

Aug 23 2019, 7:09 PM
haltode updated the diff for D1908: Release swh-graph 0.0.2.

Remove @version and @since tags

Aug 23 2019, 7:08 PM
haltode added a comment to D1908: Release swh-graph 0.0.2.
In D1908#44068, @zack wrote:

We certainly don't want to modify all Java files at each release.
So please either fix it the right way (which would probably mean some git subst var hackery) or at least for now just get rid of the version numbers from all Java source code - it's useless information anyway, as it belongs to the underlying VCS.

Aug 23 2019, 12:58 PM
haltode created D1908: Release swh-graph 0.0.2.
Aug 23 2019, 11:59 AM
haltode committed rDGRPHd5dcbfcdf245: server: test: fix tests using same Endpoint multiple times (authored by haltode).
server: test: fix tests using same Endpoint multiple times
Aug 23 2019, 10:43 AM
haltode closed D1906: Fix tests using same Endpoint multiple times.
Aug 23 2019, 10:43 AM

Aug 22 2019

haltode created D1906: Fix tests using same Endpoint multiple times.
Aug 22 2019, 8:14 PM
haltode committed rDGRPH493a3b007b1f: server: benchmark: add nbEdgesAccessed in stats output (authored by haltode).
server: benchmark: add nbEdgesAccessed in stats output
Aug 22 2019, 7:34 PM
haltode closed D1900: server: benchmark: add nbEdgesAccessed in stats output.
Aug 22 2019, 7:34 PM
haltode added reviewers for D1900: server: benchmark: add nbEdgesAccessed in stats output: zack, seirl.
Aug 22 2019, 4:59 PM
Herald added a reviewer for D1900: server: benchmark: add nbEdgesAccessed in stats output: Reviewers.
Aug 22 2019, 4:59 PM

Aug 21 2019

haltode committed rDGRPH7705d1c8b8cc: client: tests: add longer delay for server startup (authored by haltode).
client: tests: add longer delay for server startup
Aug 21 2019, 9:23 PM
haltode closed D1868: client: tests: add longer delay for server startup.
Aug 21 2019, 9:23 PM
haltode updated the diff for D1868: client: tests: add longer delay for server startup.

Rebasing on master.

Aug 21 2019, 9:19 PM

Aug 19 2019

haltode closed D1867: server: remove unnecessary 'visited.fill(false)' call.
Aug 19 2019, 5:40 PM
haltode committed rDGRPH101c50f2f10e: server: remove unnecessary 'visited.fill(false)' call (authored by haltode).
server: remove unnecessary 'visited.fill(false)' call
Aug 19 2019, 5:40 PM
haltode created D1868: client: tests: add longer delay for server startup.
Aug 19 2019, 4:03 PM
haltode created D1867: server: remove unnecessary 'visited.fill(false)' call.
Aug 19 2019, 3:44 PM
haltode committed rDGRPHb1fdd018fd5a: client: tests add missing 'meta' information (authored by haltode).
client: tests add missing 'meta' information
Aug 19 2019, 3:37 PM
haltode closed D1866: client: tests add missing 'meta' information.
Aug 19 2019, 3:37 PM
haltode updated the diff for D1866: client: tests add missing 'meta' information.

Rename assert_endpoint_result to assert_endpoint_output.

Aug 19 2019, 3:25 PM
haltode created D1866: client: tests add missing 'meta' information.
Aug 19 2019, 3:21 PM
haltode committed rDGRPHb0bcbe039d19: server: add missing 'meta' information when not using '--timings' (authored by haltode).
server: add missing 'meta' information when not using '--timings'
Aug 19 2019, 11:47 AM
haltode committed rDGRPH2bc36b702416: server: fix naming convention (authored by haltode).
server: fix naming convention
Aug 19 2019, 11:30 AM
haltode closed D1859: Benchmark: fix CSV log overwriting.
Aug 19 2019, 11:22 AM
haltode committed rDGRPH468a99dc4dd3: server: benchmark: fix CSV log overwriting (authored by haltode).
server: benchmark: fix CSV log overwriting
Aug 19 2019, 11:22 AM
haltode updated the diff for D1859: Benchmark: fix CSV log overwriting.

Amend commit to explain in more details why the fix is necessary.

Aug 19 2019, 11:21 AM
haltode created D1859: Benchmark: fix CSV log overwriting.
Aug 19 2019, 11:04 AM
haltode created P509 (An Untitled Masterwork) in the S1 Public space.
Aug 19 2019, 10:44 AM

Aug 18 2019

haltode added a comment to D1857: Remove swh.graph from swh.docs' dependencies..

Yes, totally, I was waiting on olasd return to see with him how to add Maven to the Jenkins environment. We should have some news about this on Tuesday! ;)

Aug 18 2019, 10:49 AM

Aug 16 2019

haltode closed D1856: Benchmark: add median value in stats.
Aug 16 2019, 6:21 PM
haltode committed rDGRPHd9e93fb46f5e: server: benchmark: add median value in stats (authored by haltode).
server: benchmark: add median value in stats
Aug 16 2019, 6:21 PM
haltode created D1856: Benchmark: add median value in stats.
Aug 16 2019, 6:14 PM
haltode committed rDGRPH30218b7dc68f: server: benchmark: output raw datapoints in CSV log file (authored by haltode).
server: benchmark: output raw datapoints in CSV log file
Aug 16 2019, 6:12 PM
haltode closed D1855: Benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 6:12 PM
haltode closed T1952: Log raw datapoint in graph benchmarks as Resolved by committing rDGRPH30218b7dc68f: server: benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 6:12 PM · Graph service
haltode updated the diff for D1855: Benchmark: output raw datapoints in CSV log file.
  • Add CSV header line
  • Use ; as a CSV separator
Aug 16 2019, 4:18 PM
haltode added a revision to T1952: Log raw datapoint in graph benchmarks: D1855: Benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 12:14 PM · Graph service
haltode created D1855: Benchmark: output raw datapoints in CSV log file.
Aug 16 2019, 12:14 PM
haltode committed rDGRPHb46335c0e772: server: traversal: use node degree to count number of accessed edges (authored by haltode).
server: traversal: use node degree to count number of accessed edges
Aug 16 2019, 11:07 AM

Aug 15 2019

haltode triaged T1952: Log raw datapoint in graph benchmarks as Normal priority.
Aug 15 2019, 9:49 PM · Graph service
haltode created P507 Graph benchmarks: vault use-case in the S1 Public space.
Aug 15 2019, 9:46 PM · Graph service
haltode added a project to P505 Browsing benchmarks early results: Graph service.
Aug 15 2019, 9:46 PM · Graph service
haltode committed rDGRPH4c0846228465: server: benchmark: move random generator code to Common.java (authored by haltode).
server: benchmark: move random generator code to Common.java
Aug 15 2019, 6:53 PM
haltode committed rDGRPH87192dfddd4b: server: use hash map instead of LongBigArray to backtrack (authored by haltode).
server: use hash map instead of LongBigArray to backtrack
Aug 15 2019, 6:44 PM
haltode closed D1854: Use hash map instead of LongBigArray to backtrack.
Aug 15 2019, 6:44 PM
haltode created D1854: Use hash map instead of LongBigArray to backtrack.
Aug 15 2019, 5:44 PM

Aug 14 2019

haltode added a comment to T1951: Reduce RAM usage in graph API endpoints.

From Javalin documentation [1]:

Aug 14 2019, 9:52 PM · Graph service
haltode added a comment to T1951: Reduce RAM usage in graph API endpoints.

Both big arrays are meant to be used with all the graph nodes, here is their RAM usage:

Aug 14 2019, 9:47 PM · Graph service
haltode updated the task description for T1951: Reduce RAM usage in graph API endpoints.
Aug 14 2019, 9:47 PM · Graph service
haltode committed rDGRPH6a84a51b6f6a: server: benchmark: add proper CLI args management (authored by haltode).
server: benchmark: add proper CLI args management
Aug 14 2019, 9:39 PM
haltode closed D1852: Add proper CLI args management in benchmarking tools.
Aug 14 2019, 9:39 PM
haltode updated subscribers of T1951: Reduce RAM usage in graph API endpoints.
Aug 14 2019, 9:33 PM · Graph service
haltode updated the diff for D1852: Add proper CLI args management in benchmarking tools.

Use null instead of -1 value.

Aug 14 2019, 9:32 PM
haltode added inline comments to D1852: Add proper CLI args management in benchmarking tools.
Aug 14 2019, 9:27 PM
haltode triaged T1951: Reduce RAM usage in graph API endpoints as High priority.
Aug 14 2019, 9:26 PM · Graph service
haltode updated the diff for D1852: Add proper CLI args management in benchmarking tools.

Use default Random constructor if no seed is passed by CLI argument.

Aug 14 2019, 9:08 PM
haltode created D1852: Add proper CLI args management in benchmarking tools.
Aug 14 2019, 2:53 PM
haltode committed rDGRPH9b02f4137cb6: server: benchmark: point to specific section in docs URL (authored by haltode).
server: benchmark: point to specific section in docs URL
Aug 14 2019, 2:14 PM
haltode committed rDGRPH2da9b1a05395: server: add provenance use-cases benchmarks (authored by haltode).
server: add provenance use-cases benchmarks
Aug 14 2019, 2:09 PM
haltode closed D1851: Add provenance use-cases benchmarks.
Aug 14 2019, 2:09 PM
haltode created D1851: Add provenance use-cases benchmarks.
Aug 14 2019, 2:06 PM
haltode committed rDGRPH258aaf24354a: server: add input wrapper class for endpoints methods (authored by haltode).
server: add input wrapper class for endpoints methods
Aug 14 2019, 2:05 PM
haltode closed D1850: Add input wrapper class for endpoints methods.
Aug 14 2019, 2:05 PM
haltode updated the diff for D1850: Add input wrapper class for endpoints methods.

Remove useless comment.

Aug 14 2019, 1:31 PM
haltode created D1850: Add input wrapper class for endpoints methods.
Aug 14 2019, 1:27 PM
haltode added a comment to D1849: Add vault use-case benchmark.

As told on IRC, I was waiting on adding all benchmarking interfaces before implementing the CLI options.

Aug 14 2019, 1:25 PM
haltode closed D1849: Add vault use-case benchmark.
Aug 14 2019, 1:24 PM
haltode committed rDGRPH9ca54a873d7a: server: add vault use-case benchmark (authored by haltode).
server: add vault use-case benchmark
Aug 14 2019, 1:24 PM
haltode created P505 Browsing benchmarks early results in the S1 Public space.
Aug 14 2019, 11:22 AM · Graph service
haltode created D1849: Add vault use-case benchmark.
Aug 14 2019, 10:55 AM

Aug 13 2019

haltode committed rDGRPH9ea36f08ce24: server: move utils/ into benchmark/utils (authored by haltode).
server: move utils/ into benchmark/utils
Aug 13 2019, 3:05 PM
haltode closed D1846: Add browsing use-cases benchmarks.
Aug 13 2019, 3:05 PM
haltode committed rDGRPH6aee508c4cdf: server: add browsing use-cases benchmarks (authored by haltode).
server: add browsing use-cases benchmarks
Aug 13 2019, 3:05 PM
haltode updated the diff for D1846: Add browsing use-cases benchmarks.
  • Add a new meta info nbEdgesAccessed
  • Move utils/ into benchmark/utils/
Aug 13 2019, 2:24 PM
haltode added inline comments to D1846: Add browsing use-cases benchmarks.
Aug 13 2019, 11:33 AM
haltode added inline comments to D1846: Add browsing use-cases benchmarks.
Aug 13 2019, 10:41 AM