Change Details

[Parent task for all related tasks] # Current status An object storage design was [discussed](https://sympa.inria.fr/sympa/arc/swh-devel/2021-02/msg00079.html) and [described](https://hedgedoc.softwareheritage.org/EBmGBSMpS1esahFRASggFg?view). Benchmarks need to be written to verify it is efficient (space and speed) for the intended use cases. The [hardware to run the benchmarks has to be secured](https://sympa.inria.fr/sympa/arc/swh-devel/2021-03/msg00007.html). # Design The draft of the design for the object storage can be found [here](https://hedgedoc.softwareheritage.org/EBmGBSMpS1esahFRASggFg#) # Discussions (TBD)

[Parent task for all related tasks] # Current status An object storage design was [described](https://wiki.softwareheritage.org/wiki/A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph) and is [discussed](https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/DRZ6XP45PEXKMYJSSYSDXC2RGJ3BW75H/) . Benchmarks need to be written to verify it is efficient (space and speed) for the intended use cases. # Design * [Design document for the object storage](https://wiki.softwareheritage.org/wiki/A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph) * [Implementation notes](https://hedgedoc.softwareheritage.org/NK1sq6dmS2uvtmtHP4wFKg?view) # Discussions * (A practical approach to efficiently store 100 billions small objects in Ceph)[https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/DRZ6XP45PEXKMYJSSYSDXC2RGJ3BW75H/]

[Parent task for all related tasks] # Current status An object storage design was [discussed](https://sympa.inria.fr/sympa/arc/swh-devel/2021-02/msg00079.html) and [described](https://hedgedoc.softwareheritage.org/EBmGBSMpS1esahFRASggFg?view)escribed](https://wiki.softwareheritage.org/wiki/A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph) and is [discussed](https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/DRZ6XP45PEXKMYJSSYSDXC2RGJ3BW75H/) . Benchmarks need to be written to verify it is efficient (space and speed) for the intended use cases. The [hardware to run the benchmarks has to be secured](https://sympa.inria.fr/sympa/arc/swh-devel/2021-03/msg00007.html). # Design The draft of the design for the object storage can be found [here* [Design document for the object storage](https://wiki.softwareheritage.org/wiki/A_practical_approach_to_efficiently_store_100_billions_small_objects_in_Ceph) * [Implementation notes](https://hedgedoc.softwareheritage.org/EBmGBSMpS1esahFRASggFg#NK1sq6dmS2uvtmtHP4wFKg?view) # Discussions (TBD)* (A practical approach to efficiently store 100 billions small objects in Ceph)[https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/DRZ6XP45PEXKMYJSSYSDXC2RGJ3BW75H/]