Changeset View
Changeset View
Standalone View
Standalone View
docs/architecture.rst
Show All 24 Lines | |||||
- :ref:`Scheduler API <swh-scheduler>` | - :ref:`Scheduler API <swh-scheduler>` | ||||
On the back stage of this show, a celery_ based game of tasks and workers | On the back stage of this show, a celery_ based game of tasks and workers | ||||
occurs to perform all the required work to fill, maintain and update the |swh| | occurs to perform all the required work to fill, maintain and update the |swh| | ||||
:term:`archive`. | :term:`archive`. | ||||
The main components involved in this choreography are: | The main components involved in this choreography are: | ||||
- :term:`Listers <lister>`: a lister is a type of task aiming at scrapping a | - :term:`Listers <lister>`: a lister is a type of task aiming at scraping a | ||||
web site, a forge, etc. to gather all the source code repositories it can | web site, a forge, etc. to gather all the source code repositories it can | ||||
find. For each found source code repository, a :term:`loader` task is | find. For each found source code repository, a :term:`loader` task is | ||||
created. | created. | ||||
- :term:`Loaders <loader>`: a loader is a type of task aiming at importing or | - :term:`Loaders <loader>`: a loader is a type of task aiming at importing or | ||||
updating a source code repository. It is the one that inserts :term:`blob` | updating a source code repository. It is the one that inserts :term:`blob` | ||||
objects in the :term:`object storage`, and inserts nodes and edges in the | objects in the :term:`object storage`, and inserts nodes and edges in the | ||||
:ref:`graph <swh-merkle-dag>`. | :ref:`graph <swh-merkle-dag>`. | ||||
Show All 33 Lines |