Page MenuHomeSoftware Heritage

swh-docs: Add storage sites documentation (v2)
AbandonedPublic

Authored by ftigeot on Tue, Nov 5, 4:14 PM.

Details

Reviewers
None
Group Reviewers
Reviewers
Summary

Indicate where Softwareheritage stores its data, organize by
big storage locations:

  • Rocquencourt physical machines
  • Rocquencourt virtual machines
  • Azure-euwest
  • Amazon web services
  • Object storage is important and gets its own dedicated document
  • So do the hypervisors

Also link to the existing Elasticsearch document

Reviewed-by: ardumont

Diff Detail

Repository
rDDOC Development documentation
Branch
swh-docs-9d0294153acfa1a9a08548e109641b16a93be1de
Lint
No Linters Available
Unit
No Unit Test Coverage
Build Status
Buildable 8827
Build 12875: arc lint + arc unit

Event Timeline

ftigeot created this revision.Tue, Nov 5, 4:14 PM

Some nitpicks:

docs/index.rst
143

It should link to <infrastructure/index>

docs/infrastructure/object_storage.rst
39

It's not (yet). T1954

and content_replayer should be a ref to the section below

docs/infrastructure/storage_site_rocquencourt_physical.rst
16

NFS-exported data is present under these local filesystem paths::

32–33

It also uses a single NFS volume::

docs/infrastructure/storage_site_rocquencourt_virtual.rst
31–33

These VMs access one or more of these NFS volumes located on uffizi::

ftigeot abandoned this revision.Fri, Nov 8, 3:17 PM

Thanks for this review, changes have been incorporated in D2240.