Using Sorted String Tables as a file format
Closed, MigratedEdits Locked
Actions

Assigned To

Authored By

	dachary
	Feb 23 2021, 12:04 PM

Description

jumpDB

jumpDB and on pypi "The design is essentially a simplified version of levelDB."

RocksDB

See T3066

mtbl

mtbl has a python module but it is not in Debian GNU/Linux buster. The library is not in buster either but appears to be re-introduced in bulseye.

ambry

https://engineering.linkedin.com/blog/2019/05/introducing-data-compaction-in-ambry not usable independently

Related Objects
Search...

Status	Assigned	Task
Migrated	gitlab-migration	T3116 Roll out at least one operational mirror
Migrated	gitlab-migration	T3054 Scale out object storage design
Migrated	gitlab-migration	T3068 Using Sorted String Tables as a file format

Event Timeline

dachary changed the task status from Open to Work in Progress.Feb 23 2021, 12:04 PM

dachary triaged this task as Normal priority.

dachary created this task.

dachary created this object in space S1 Public.

dachary added a parent task: T3054: Scale out object storage design.

dachary updated the task description. (Show Details)

dachary updated the task description. (Show Details)Feb 23 2021, 12:13 PM

jumpDB is 100% python therefore less than ideal for CPU performance but for the purpose of benchmarking I/O and space usage it is conveniently ready to use.

dachary mentioned this in T3054: Scale out object storage design.Feb 23 2021, 1:51 PM

dachary updated the task description. (Show Details)

dachary mentioned this in T3048: Using a custom Sorted String Table format.Feb 23 2021, 11:22 PM

dachary mentioned this in T3107: Scale out object storage explorations.Mar 9 2021, 1:09 PM

Using a hash table is a better option because it is O(1) instead of O(log(n))

dachary closed this task as Wontfix.Jul 6 2021, 8:24 AM