USDB: Scaling Storage for Next-Generation Recommender Systems at ByteDance
Summary
A CS arXiv paper presenting USDB, ByteDance's unified storage system for next-generation recommender workloads. It introduces time-based CascadeLSM compaction, differentiated replicas sharing persistent files, partial dumps, and a hybrid columnar format to accelerate reads, with negative-cost and latency improvements reported for production workloads.