Small RGW objects and RADOS 64KB minimun size
https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/AEMW6O7WVJFMUIX7QGI2KM7HKDSTNIYT/
Not much interest for this thread on the mailing list so far. If it was not for this overhead, every Software Heritage object could be stored in a RADOS object and the scale out problem would be solved (i.e. no need for T3049). Maybe there is a not-so-complicated fix and set it to 4K ? What is the limit imposed by rocksdb ? I don't see any reason why bluestore would be crossed if the limit is low. What about the overhead of a 4+2 erasure coding ? What were the followups of last year decision to go back to 64K because of allocation / performances problems ( https://github.com/ceph/ceph/pull/32809 ) ?
It is worth looking into