Page MenuHomeSoftware Heritage

swh-graph: configure the max heap allocated to the java backend
ClosedPublic

Authored by vsellier on Sep 8 2022, 5:48 PM.

Details

Summary

The default 90% of the server's memory is too high when other services
are running.

Related to T4509

Test Plan

After having difficult times to deploy the graph on a vagrant VM, the configuration is working well:

-- The job identifier is 2654.
Sep 08 15:38:37 granet swh[7728]: INFO:root:using swh-graph JAR: /opt/swhgraph_venv/share/swh-graph/swh-graph-1.0.2.jar
Sep 08 15:38:37 granet swh[7728]: INFO:root:Starting RPC server: java -cp /opt/swhgraph_venv/share/swh-graph/swh-graph-1.0.2.jar -Xmx500m -XX:PretenureSizeThreshold=512M -XX:MaxNewSize=4G -XX:+UseLargePages -XX:+UseTransparentHugePages -XX:+UseNUMA -XX:+UseTLAB -XX:+ResizeTLAB org.softwareheritage.graph.rpc.GraphServer --port 50091 /dev/shm/swh-graph/default/graph
`

Octocatalog-diff:

diff origin/production/granet.internal.softwareheritage.org current/granet.internal.softwareheritage.org
*******************************************
+ File[/etc/softwareheritage/graph/graph.yml] =>
   parameters =>
     "content": "---\nmax_ram: 500g\n\n",
     "ensure": "present",
     "group": "swhworker",
     "mode": "0640",
     "notify": "Service[swh-graph]",
     "owner": "root"
*******************************************
+ File[/etc/softwareheritage/graph] =>
   parameters =>
     "ensure": "directory",
     "group": "swhworker",
     "mode": "0650",
     "owner": "root"
*******************************************
  File[/etc/systemd/system/swh-graph.service] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
       User=swhworker
       Group=swhworker
      -ExecStart=/opt/swhgraph_venv/bin/swh graph rpc-serve -g /dev/shm/swh-graph/default/graph
      +ExecStart=/opt/swhgraph_venv/bin/swh graph -C /etc/softwareheritage/graph/graph.yml rpc-serve -g /dev/shm/swh-graph/default/graph
      _
       [Install]
*******************************************
  Systemd::Unit_file[swh-graph.service] =>
   parameters =>
     content =>
      @@ -14,5 +14,5 @@
       User=swhworker
       Group=swhworker
      -ExecStart=/opt/swhgraph_venv/bin/swh graph rpc-serve -g /dev/shm/swh-graph/default/graph
      +ExecStart=/opt/swhgraph_venv/bin/swh graph -C /etc/softwareheritage/graph/graph.yml rpc-serve -g /dev/shm/swh-graph/default/graph
      _
       [Install]
*******************************************
*** End octocatalog-diff on granet.internal.softwareheritage.org

Diff Detail

Repository
rSPSITE puppet-swh-site
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.