Changeset View
Changeset View
Standalone View
Standalone View
docs/mirror.rst
Show First 20 Lines • Show All 63 Lines • ▼ Show 20 Lines | |||||
- `swh.journal.objects.raw_extrinsic_metadata` | - `swh.journal.objects.raw_extrinsic_metadata` | ||||
- `swh.journal.objects.release` | - `swh.journal.objects.release` | ||||
- `swh.journal.objects.revision` | - `swh.journal.objects.revision` | ||||
- `swh.journal.objects.skipped_content` | - `swh.journal.objects.skipped_content` | ||||
- `swh.journal.objects.snapshot` | - `swh.journal.objects.snapshot` | ||||
In order to set up a mirror of the graph, one needs to deploy a stack capable | In order to set up a mirror of the graph, one needs to deploy a stack capable | ||||
of retrieving all these topics and store their content reliably. For example a | of retrieving all these topics and store their content reliably. For example a | ||||
kafka cluster configured as a replica of the main kafka broker hosted by |swh| | Kafka cluster configured as a replica of the main Kafka broker hosted by |swh| | ||||
would do the job (albeit not in a very useful manner by itself). | would do the job (albeit not in a very useful manner by itself). | ||||
A more useful mirror can be set up using the :ref:`storage <swh-storage>` | A more useful mirror can be set up using the :ref:`storage <swh-storage>` | ||||
component with the help of the special service named `replayer` provided by the | component with the help of the special service named `replayer` provided by the | ||||
:doc:`apidoc/swh.storage.replay` module. | :doc:`apidoc/swh.storage.replay` module. | ||||
.. TODO: replace this previous link by a link to the 'swh storage replay' | .. TODO: replace this previous link by a link to the 'swh storage replay' | ||||
command once available, and ideally once | command once available, and ideally once | ||||
▲ Show 20 Lines • Show All 42 Lines • ▼ Show 20 Lines | |||||
It is strongly recommended to start from there before planning a | It is strongly recommended to start from there before planning a | ||||
production-like deployment. | production-like deployment. | ||||
See the `README <https://forge.softwareheritage.org/source/swh-docker/browse/master/README.md>`_ | See the `README <https://forge.softwareheritage.org/source/swh-docker/browse/master/README.md>`_ | ||||
file of the `swh-docker <https://forge.softwareheritage.org/source/swh-docker>`_ | file of the `swh-docker <https://forge.softwareheritage.org/source/swh-docker>`_ | ||||
repository for details. | repository for details. | ||||
.. _kafka: https://kafka.apache.org/ | .. _Kafka: https://kafka.apache.org/ | ||||
.. _msgpack: https://msgpack.org | .. _msgpack: https://msgpack.org |