Cosine: A Cloud-Cost Optimized Self-Designing Key-Value Storage Engine

Summary: Cosine automatically synthesizes cloud-cost/performance-optimized key-value engines from a 10^36-design space spanning LSMs, B-trees, hash tables, and hybrids. Distribution-aware I/O and learned CPU models enable second-scale search and Rust code generation, yielding up to 53× gains over established engines. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 12812
Venue: VLDB
Year: 2022
Pagerank: 7.2930211e-05
Overall Rank: 3,577 | 75.46%
DOI: 10.14778/3485450.3485461

Incoming Non-self Citations Over Time

Authors

1. Subarna Chatterjee (Harvard University)
2. Meena Jagadeesan (Harvard University)
3. Wilson Qin (Harvard University)
4. Stratos Idreos (Harvard University)

BibTeX Citation

@article{chatterjee_vldb22,
        title = {{Cosine: A Cloud-Cost Optimized Self-Designing Key-Value Storage Engine}},
        author = {Chatterjee, Subarna and Jagadeesan, Meena and Qin, Wilson and Idreos, Stratos},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {1},
        pages = {112--126},
        doi = {10.14778/3485450.3485461},
        url = {https://doi.org/10.14778/3485450.3485461},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 20 of 20 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,535	TreeLine: An Update-In-Place Key-Value Store for Modern Storage	2023	VLDB	7.3333933e-05
4,664	GRF: A Global Range Filter for LSM-Trees with Shape Encoding	2024	SIGMOD	6.5787544e-05
5,229	Dissecting, Designing, and Optimizing LSM-based Data Stores	2022	SIGMOD	6.307514e-05
6,843	Learning to Optimize LSM-trees: Towards A Reinforcement Learning based Key-Value Store for Dynamic Workloads	2023	SIGMOD	5.7573899e-05
7,757	CAMAL: Optimizing LSM-trees via Active Learning	2024	SIGMOD	5.5508469e-05
7,760	NOCAP: Near-Optimal Correlation-Aware Partitioning Joins	2023	SIGMOD	5.5505651e-05
8,156	How to Grow an LSM-tree? Towards Bridging the Gap Between Theory and Practice	2025	SIGMOD	5.4765648e-05
8,323	SageDB: An Instance-Optimized Data Analytics System	2022	VLDB	5.4539294e-05
8,463	Limousine: Blending Learned and Classical Indexes to Self-Design Larger-than-Memory Cloud Storage Engines	2024	SIGMOD	5.4205593e-05
8,811	ArceKV: Towards Workload-driven LSM-compactions for Key-Value Store Under Dynamic Workloads	2026	VLDB	5.3652966e-05
8,919	MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying	2023	SIGMOD	5.3483178e-05
8,988	Towards Systematic Index Dynamization	2024	VLDB	5.3384135e-05
9,021	Structural Designs Meet Optimality: Exploring Optimized LSM-tree Structures in A Colossal Configuration Space	2024	SIGMOD	5.3305499e-05
9,457	Rethinking The Compaction Policies in LSM-trees	2025	SIGMOD	5.2642945e-05
9,465	Are Joins over LSM-trees Ready? Take RocksDB as an Example	2025	VLDB	5.2634238e-05
9,536	Database Gyms	2023	CIDR	5.2529727e-05
9,881	The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format	2024	SIGMOD	5.2040783e-05
11,073	AXE: A Task Decomposition Approach to Learned LSM Tuning	2025	VLDB	5.093636e-05
11,218	Breathing New Life into An Old Tree: Resolving Logging Dilemma of B+-tree on Modern Computational Storage Drives	2024	VLDB	5.093636e-05
11,554	Workload-Adaptive Filtering in Storage Engines	2022	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 29 of 29 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0024089429
43	The Case for Learned Index Structures	2018	SIGMOD	0.00046060254
86	Automatic Database Management System Tuning Through Large-scale Machine Learning	2017	SIGMOD	0.00035316107
232	LinkBench: a Database Benchmark Based on the Facebook Social Graph	2013	SIGMOD	0.00023830978
234	Self-Driving Database Management Systems	2017	CIDR	0.00023810722
259	Database Cracking	2007	CIDR	0.00023119313
290	An Overview of Query Optimization in Relational Systems	1998	PODS	0.0002227038
446	Monkey: Optimal Navigable Key-Value Store	2017	SIGMOD	0.00018332392
568	SageDB: A Learned Database System	2019	CIDR	0.0001641553
614	Faster: A Concurrent Key-Value Store with In-Place Updates	2018	SIGMOD	0.00015720975
1,548	Automatically Indexing Millions of Databases in Microsoft Azure SQL Database	2019	SIGMOD	0.00010392475
1,591	SQLGraph: An Efficient Relational-Based Property Graph Store	2015	SIGMOD	0.00010255536
1,616	The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models	2018	SIGMOD	0.00010213691
1,942	Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn	2019	CIDR	9.4451535e-05
2,698	Rosetta: A Robust Space-Time Optimized Range Filter for Key-Value Stores	2020	SIGMOD	8.2450522e-05
2,755	Lethe: A Tunable Delete-Aware LSM Engine	2020	SIGMOD	8.163097e-05
3,005	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB	7.8608206e-05
3,071	Choosing A Cloud DBMS: Architectures and Tradeoffs	2019	VLDB	7.7885156e-05
3,208	ForkBase: An Efficient Storage Engine for Blockchain and Forkable Applications	2018	VLDB	7.635872e-05
3,219	iBTune: Individualized Buffer Tuning for Large-scale Cloud Databases	2019	VLDB	7.6283153e-05
3,320	Autoscaling Tiered Cloud Storage in Anna	2019	VLDB	7.5223482e-05
3,598	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	7.2718988e-05
3,758	Nova-LSM: A Distributed, Component-based LSM-tree Key-value Store	2021	SIGMOD	7.1471346e-05
4,779	LogKV: Exploiting Key-Value Stores for Event Log Processing	2013	CIDR	6.5125667e-05
4,993	Key-Value Storage Engines	2020	SIGMOD	6.4096682e-05
5,285	Order-Preserving Key Compression for In-Memory Search Trees	2020	SIGMOD	6.2821588e-05
5,978	From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems	2019	SIGMOD	6.0212877e-05
7,274	LSM-Trees and B-Trees: The Best of Both Worlds	2019	SIGMOD	5.658769e-05
7,997	nKV in Action: Accelerating KV-Stores on Native Computational Storage with Near-Data Processing	2020	VLDB	5.5095061e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,632	LogStore: A Cloud-Native and Multi-Tenant Log Database	2021	SIGMOD
2	857	SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data	2017	VLDB
3	8,919	MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying	2023	SIGMOD
4	10,471	Making LSM-Tree-based Key-Value Store Practical and Efficient for Multi-Tenant Serverless Cloud Databases	2026	SIGMOD
5	2,822	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD
6	12,243	COCCUS: Self-Configured Cost-Based Query Services in the Cloud	2013	SIGMOD
7	11,766	From Worst-Case to Average-Case Analysis: Accurate Latency Predictions for Key-Value Storage Engines	2020	SIGMOD
8	7,693	CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure	2024	SIGMOD
9	4,993	Key-Value Storage Engines	2020	SIGMOD
10	8,463	Limousine: Blending Learned and Classical Indexes to Self-Design Larger-than-Memory Cloud Storage Engines	2024	SIGMOD