Toto - Benchmarking the Efficiency of a Cloud Service

Summary: Toto: a benchmark framework to measure cloud-service efficiency under co-location and contention with scalable, repeatable production workloads. Implemented in SQL DB staging clusters; enables density–QoS tradeoffs across Kubernetes/Service Fabric. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6306
Venue: SIGMOD
Year: 2021
Pagerank: 5.093636e-05
Overall Rank: 11,685 | 19.84%
DOI: 10.1145/3448016.3457555

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Justin Moeller (Microsoft)
2. Zi Ye (Microsoft)
3. Katherine Lin (Microsoft)
4. Willis Lang (Microsoft)

BibTeX Citation

@inproceedings{moeller_sigmod21,
        title = {{Toto - Benchmarking the Efficiency of a Cloud Service}},
        author = {Moeller, Justin and Ye, Zi and Lin, Katherine and Lang, Willis},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457555},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457555},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,226	Moneyball: Proactive Auto-Scaling in Microsoft Azure SQL Database Serverless	2022	VLDB	8.9174082e-05
5,591	Flexible Resource Allocation for Relational Database-as-a-Service	2023	VLDB	6.1556906e-05
6,518	Tenant Placement in Over-subscribed Database-as-a-Service Clusters	2022	VLDB	5.8538324e-05
11,150	Proactive Resume and Pause of Resources for Microsoft Azure SQL Database Serverless	2024	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
148	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.00029250767
226	OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases	2014	VLDB	0.00024027277
334	An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning	2019	SIGMOD	0.00020875082
604	Socrates: The New SQL Server in the Cloud	2019	SIGMOD	0.0001584774
939	Starling: A Scalable Query Engine on Cloud Functions	2020	SIGMOD	0.00013083524
1,092	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD	0.00012221946
1,147	Data Management Challenges in Production Machine Learning	2017	SIGMOD	0.00011974846
1,335	SQLVM: Performance Isolation in Multi-Tenant Relational Database-as-a-Service	2013	CIDR	0.00011122853
1,463	Amazon Aurora: On Avoiding Distributed Consensus for I/Os, Commits, and Membership Changes	2018	SIGMOD	0.00010700936
1,784	Lambada: Interactive Data Analytics on Cold Data Using Serverless Cloud Infrastructure	2020	SIGMOD	9.7726335e-05
1,995	Database Learning: Toward a Database that Becomes Smarter Every Time	2017	SIGMOD	9.3403665e-05
2,381	CPU Sharing Techniques for Performance Isolation in Multi-tenant Relational Database-as-a-Service	2014	VLDB	8.6607625e-05
2,958	WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases	2016	VLDB	7.9197796e-05
3,226	Taurus Database: How to be Fast, Available, and Frugal in the Cloud	2020	SIGMOD	7.6231159e-05
3,236	Sharing Buffer Pool Memory in Multi-Tenant Relational Database-as-a-Service	2015	VLDB	7.6108467e-05
3,259	Characterizing Tenant Behavior for Placement and Crisis Mitigation in Multitenant DBMSs	2013	SIGMOD	7.5892257e-05
3,927	Revenue Maximization for Query Pricing	2020	VLDB	7.012417e-05
5,182	Probabilistic Demand Forecasting at Scale	2017	VLDB	6.3287692e-05
5,681	Survivability of Cloud Databases - Factors and Prediction	2018	SIGMOD	6.1237253e-05
6,781	Seagull: An Infrastructure for Load Prediction and Optimized Resource Allocation	2021	VLDB	5.7764885e-05
6,822	JetScope: Reliable and Interactive Analytics at Cloud Scale	2015	VLDB	5.7627651e-05
9,875	Reliability Analytics for Cloud Based Distributed Databases	2020	SIGMOD	5.2043672e-05
10,098	Not for the Timid: On the Impact of Aggressive Over-booking in the Cloud	2016	VLDB	5.1498503e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,785	Tao: Improving Resource Utilization while Guaranteeing SLO in Multi-tenant Relational Database-as-a-Service	2024	SIGMOD
2	7,525	Towards Cost-Effective Storage Provisioning for DBMSs	2012	VLDB
3	10,098	Not for the Timid: On the Impact of Aggressive Over-booking in the Cloud	2016	VLDB
4	1,092	Automated Demand-driven Resource Scaling in Relational Database-as-a-Service	2016	SIGMOD
5	5,681	Survivability of Cloud Databases - Factors and Prediction	2018	SIGMOD
6	4,742	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB
7	9,768	CDSBen: Benchmarking the Performance of Storage Services in Cloud-native Database System at ByteDance	2023	VLDB
8	3,838	Cloud Analytics Benchmark	2023	VLDB
9	6,518	Tenant Placement in Over-subscribed Database-as-a-Service Clusters	2022	VLDB
10	5,591	Flexible Resource Allocation for Relational Database-as-a-Service	2023	VLDB