Toto - Benchmarking the Efficiency of a Cloud Service

Summary: Toto: a benchmark framework to measure cloud-service efficiency under co-location and contention with scalable, repeatable production workloads. Implemented in SQL DB staging clusters; enables density–QoS tradeoffs across Kubernetes/Service Fabric. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h7a0cfc905e70b799
Venue: SIGMOD
Year: 2021
Pagerank: 4.9769913e-05
Overall Rank: 11,998 | 19.36%
DOI: 10.1145/3448016.3457555

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Justin Moeller (Microsoft)
2. Zi Ye (Microsoft)
3. Katherine Lin (Microsoft)
4. Willis Lang (Microsoft)

BibTeX Citation

@inproceedings{moeller_sigmod21,
        title = {{Toto - Benchmarking the Efficiency of a Cloud Service}},
        author = {Moeller, Justin and Ye, Zi and Lin, Katherine and Lang, Willis},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457555},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457555},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,996	Moneyball: Proactive Auto-Scaling in Microsoft Azure SQL Database Serverless	2022	VLDB	9.213369e-05
5,396	Flexible Resource Allocation for Relational Database-as-a-Service	2023	VLDB	6.1482118e-05
5,838	Tenant Placement in Over-subscribed Database-as-a-Service Clusters	2022	VLDB	5.9726313e-05
11,504	Proactive Resume and Pause of Resources for Microsoft Azure SQL Database Serverless	2024	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
148	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.00029001141
235	OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases	2014	VLDB	0.00023689995
314	An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning	2019	SIGMOD	0.00021276452
543	Socrates: The New SQL Server in the Cloud	2019	SIGMOD	0.00016624903
932	Starling: A Scalable Query Engine on Cloud Functions	2020	SIGMOD	0.00013002837
1,068	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD	0.00012186505
1,153	Data Management Challenges in Production Machine Learning	2017	SIGMOD	0.00011793347
1,338	SQLVM: Performance Isolation in Multi-Tenant Relational Database-as-a-Service	2013	CIDR	0.00010974439
1,425	Amazon Aurora: On Avoiding Distributed Consensus for I/Os, Commits, and Membership Changes	2018	SIGMOD	0.00010709627
1,764	Lambada: Interactive Data Analytics on Cold Data Using Serverless Cloud Infrastructure	2020	SIGMOD	9.6959345e-05
2,028	Database Learning: Toward a Database that Becomes Smarter Every Time	2017	SIGMOD	9.1584244e-05
2,286	CPU Sharing Techniques for Performance Isolation in Multi-tenant Relational Database-as-a-Service	2014	VLDB	8.6920821e-05
2,671	Taurus Database: How to be Fast, Available, and Frugal in the Cloud	2020	SIGMOD	8.1464332e-05
2,983	WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases	2016	VLDB	7.7831414e-05
3,001	Sharing Buffer Pool Memory in Multi-Tenant Relational Database-as-a-Service	2015	VLDB	7.7640097e-05
3,239	Characterizing Tenant Behavior for Placement and Crisis Mitigation in Multitenant DBMSs	2013	SIGMOD	7.4983062e-05
3,987	Revenue Maximization for Query Pricing	2020	VLDB	6.8697118e-05
5,308	Probabilistic Demand Forecasting at Scale	2017	VLDB	6.1844285e-05
5,767	Survivability of Cloud Databases - Factors and Prediction	2018	SIGMOD	5.9997338e-05
6,903	Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation	2021	VLDB	5.6493582e-05
6,960	JetScope: Reliable and Interactive Analytics at Cloud Scale	2015	VLDB	5.6313571e-05
10,069	Reliability Analytics for Cloud Based Distributed Databases	2020	SIGMOD	5.0851868e-05
10,326	Not for the Timid: On the Impact of Aggressive Over-booking in the Cloud	2016	VLDB	5.0327532e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,956	Tao: Improving Resource Utilization while Guaranteeing SLO in Multi-tenant Relational Database-as-a-Service	2024	SIGMOD
2	7,677	Towards Cost-Effective Storage Provisioning for DBMSs	2012	VLDB
3	10,326	Not for the Timid: On the Impact of Aggressive Over-booking in the Cloud	2016	VLDB
4	1,068	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD
5	4,820	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB
6	5,767	Survivability of Cloud Databases - Factors and Prediction	2018	SIGMOD
7	7,820	CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance	2023	VLDB
8	3,311	Cloud Analytics Benchmark	2023	VLDB
9	5,838	Tenant Placement in Over-subscribed Database-as-a-Service Clusters	2022	VLDB
10	5,396	Flexible Resource Allocation for Relational Database-as-a-Service	2023	VLDB