Changeset View
Changeset View
Standalone View
Standalone View
docs/compression.rst
Show First 20 Lines • Show All 115 Lines • ▼ Show 20 Lines | |||||
It is also possible to run single steps or step ranges from the CLI: | It is also possible to run single steps or step ranges from the CLI: | ||||
.. code:: bash | .. code:: bash | ||||
swh graph compress -i orc/ -o compressed/ --steps mph-bfs | swh graph compress -i orc/ -o compressed/ --steps mph-bfs | ||||
See ``swh graph compress --help`` for syntax and usage details. | See ``swh graph compress --help`` for syntax and usage details. | ||||
anlambert: `will allocate` or `will try to allocate` I guess | |||||
For some steps, Java will try to allocate terabytes of memory in sub-gigabyte | |||||
segments, so you should increase the number of allowed allocations first: | |||||
.. code:: bash | |||||
sudo sysctl -w vm.max_map_count=1966080 | |||||
Compression steps | Compression steps | ||||
================= | ================= | ||||
The compression pipeline consists of the following steps: | The compression pipeline consists of the following steps: | ||||
.. figure:: images/compression_steps.png | .. figure:: images/compression_steps.png | ||||
:align: center | :align: center | ||||
▲ Show 20 Lines • Show All 479 Lines • Show Last 20 Lines |
will allocate or will try to allocate I guess