Small RGW objects and RADOS 64KB minimun size
Not much interest for this thread on the mailing list so far. If it was not for this overhead, every Software Heritage object could be stored in a RADOS object and the problem would be solved. Maybe there is a not-so-complicated fix and set it to 4K ? What is the limit imposed by rocksdb ? I don't see any reason why bluestore would be crossed if the limit is low. What about the overhead of a 4+2 erasure coding ? What were the followups of last year decision to go back to 64K because of allocation / performances problems ( https://github.com/ceph/ceph/pull/32809 ) ?
It is worth looking into