Data Warehousing and Analytics Infrastructure at Facebook
Summary: Facebook's scalable data warehouse uses Scribe, Hadoop, Hive to unify log collection, storage, and analytics for BI dashboards and feature services. Stores >15PB (2.5PB compressed), ingests ~60TB/day (10TB compressed); discusses design choices, day-to-day operations, and planned improvements. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Ashish Thusoo (Meta)
- 2. Zheng Shao (Meta)
- 3. Suresh Anthony (Meta)
- 4. Dhruba Borthakur (Meta)
- 5. Namit Jain (Meta)
- 6. Joydeep Sen Sarma (Meta)
- 7. Raghotham Murthy (Meta)
- 8. Hao Liu (Meta)
BibTeX Citation
@inproceedings{thusoo_sigmod10,
title = {{Data Warehousing and Analytics Infrastructure at Facebook}},
author = {Thusoo, Ashish and Shao, Zheng and Anthony, Suresh and Borthakur, Dhruba and Jain, Namit and Sarma, Joydeep Sen and Murthy, Raghotham and Liu, Hao},
series = {{SIGMOD} '10},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/1807167.1807278},
url = {https://dl.acm.org/doi/10.1145/1807167.1807278},
year = {2010}
}
Incoming Citations (Sorted by Pagerank)
Showing 17 of 17 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 1 of 1 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 49 | Weaving Relations for Cache Performance | 2001 | VLDB | 0.00043781096 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 2,159 | Efficient Processing of Data Warehousing Queries in a Split Execution Environment | 2011 | SIGMOD |
| 2 | 3,714 | Large-Scale Machine Learning at Twitter | 2012 | SIGMOD |
| 3 | 120 | HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads | 2009 | VLDB |
| 4 | 2,265 | A Platform for Scalable One-Pass Analytics using MapReduce | 2011 | SIGMOD |
| 5 | 7,965 | Emerging Trends in the Enterprise Data Analytics: Connecting Hadoop and DB2 Warehouse | 2011 | SIGMOD |
| 6 | 1,324 | Apache Hadoop Goes Realtime at Facebook | 2011 | SIGMOD |
| 7 | 4,595 | The "Big Data" Ecosystem at LinkedIn | 2013 | SIGMOD |
| 8 | 3,555 | Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing | 2019 | SIGMOD |
| 9 | 6,676 | Petabyte Scale Databases and Storage Systems at Facebook | 2013 | SIGMOD |
| 10 | 32 | Hive - A Warehousing Solution Over a Map-Reduce Framework | 2009 | VLDB |