Toto - Benchmarking the Efficiency of a Cloud Service

Summary: Toto: a benchmark framework to measure cloud-service efficiency under co-location and contention with scalable, repeatable production workloads. Implemented in SQL DB staging clusters; enables density–QoS tradeoffs across Kubernetes/Service Fabric. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h7a0cfc905e70b799
Venue: SIGMOD
Year: 2021
Pagerank: 4.9793485e-05
Overall Rank: 11,992 | 19.38%
DOI: 10.1145/3448016.3457555

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Justin Moeller (Microsoft)
2. Zi Ye (Microsoft)
3. Katherine Lin (Microsoft)
4. Willis Lang (Microsoft)

BibTeX Citation

@inproceedings{moeller_sigmod21,
        title = {{Toto - Benchmarking the Efficiency of a Cloud Service}},
        author = {Moeller, Justin and Ye, Zi and Lin, Katherine and Lang, Willis},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457555},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457555},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,994	Moneyball: Proactive Auto-Scaling in Microsoft Azure SQL Database Serverless	2022	VLDB	9.2176321e-05
5,389	Flexible Resource Allocation for Relational Database-as-a-Service	2023	VLDB	6.1511236e-05
5,836	Tenant Placement in Over-subscribed Database-as-a-Service Clusters	2022	VLDB	5.97546e-05
11,498	Proactive Resume and Pause of Resources for Microsoft Azure SQL Database Serverless	2024	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
148	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.0002900671
235	OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases	2014	VLDB	0.00023697028
314	An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning	2019	SIGMOD	0.00021282642
543	Socrates: The New SQL Server in the Cloud	2019	SIGMOD	0.0001663263
932	Starling: A Scalable Query Engine on Cloud Functions	2020	SIGMOD	0.00013008551
1,067	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD	0.0001219157
1,153	Data Management Challenges in Production Machine Learning	2017	SIGMOD	0.00011798912
1,338	SQLVM: Performance Isolation in Multi-Tenant Relational Database-as-a-Service	2013	CIDR	0.00010979494
1,425	Amazon Aurora: On Avoiding Distributed Consensus for I/Os, Commits, and Membership Changes	2018	SIGMOD	0.00010714536
1,763	Lambada: Interactive Data Analytics on Cold Data Using Serverless Cloud Infrastructure	2020	SIGMOD	9.7003359e-05
2,027	Database Learning: Toward a Database that Becomes Smarter Every Time	2017	SIGMOD	9.1618139e-05
2,283	CPU Sharing Techniques for Performance Isolation in Multi-tenant Relational Database-as-a-Service	2014	VLDB	8.6961837e-05
2,671	Taurus Database: How to be Fast, Available, and Frugal in the Cloud	2020	SIGMOD	8.15025e-05
2,981	WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases	2016	VLDB	7.7851845e-05
2,999	Sharing Buffer Pool Memory in Multi-Tenant Relational Database-as-a-Service	2015	VLDB	7.7676694e-05
3,237	Characterizing Tenant Behavior for Placement and Crisis Mitigation in Multitenant DBMSs	2013	SIGMOD	7.5017163e-05
3,986	Revenue Maximization for Query Pricing	2020	VLDB	6.8729654e-05
5,304	Probabilistic Demand Forecasting at Scale	2017	VLDB	6.1873575e-05
5,766	Survivability of Cloud Databases - Factors and Prediction	2018	SIGMOD	6.0025753e-05
6,901	Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation	2021	VLDB	5.6520335e-05
6,958	JetScope: Reliable and Interactive Analytics at Cloud Scale	2015	VLDB	5.634024e-05
10,064	Reliability Analytics for Cloud Based Distributed Databases	2020	SIGMOD	5.0875952e-05
10,319	Not for the Timid: On the Impact of Aggressive Over-booking in the Cloud	2016	VLDB	5.0351368e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,948	Tao: Improving Resource Utilization while Guaranteeing SLO in Multi-tenant Relational Database-as-a-Service	2024	SIGMOD
2	7,671	Towards Cost-Effective Storage Provisioning for DBMSs	2012	VLDB
3	10,319	Not for the Timid: On the Impact of Aggressive Over-booking in the Cloud	2016	VLDB
4	1,067	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD
5	4,818	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB
6	5,766	Survivability of Cloud Databases - Factors and Prediction	2018	SIGMOD
7	7,813	CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance	2023	VLDB
8	3,316	Cloud Analytics Benchmark	2023	VLDB
9	5,836	Tenant Placement in Over-subscribed Database-as-a-Service Clusters	2022	VLDB
10	5,389	Flexible Resource Allocation for Relational Database-as-a-Service	2023	VLDB