Publication

SpanDB: A Fast, Cost-Effective LSM-tree Based KV Store on Hybrid Storage

SpanDB proposes an LSM-tree-based KV store that adapts RocksDB to utilize selective deployment of high-speed SSDs. It allows users to store large volumes of data on cheaper SSDs while relocating the WAL and top LSM-tree levels to faster NVMe SSDs, and provides high-speed parallel WAL writes via SPDK with asynchronous request processing.

USENIX FAST 2021 / February 2021
key-value storeLSM-treeNVMe SSDstorage

Authors

Hao Chen, Chaoyi Ruan, Cheng Li, Xiaosong Ma, Yinlong Xu

Abstract

SpanDB selectively deploys high-speed NVMe SSDs for WAL and top-level LSM-tree data in RocksDB, enabling high-speed parallel WAL writes via SPDK and significantly improving KV store throughput and latency.