Apache Hadoop Goes Realtime at Facebook
Summary: Facebook Messages runs on Hadoop with HBase to scale to billions of messages daily, arguing Hadoop/HBase beat Cassandra and Voldemort for realtime and scalability. It outlines Hadoop enhancements, configuration tradeoffs, and positions Hadoop-based solutions as a model over sharded MySQL for web-scale apps. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Dhruba Borthakur (Meta)
- 2. Kannan Muthukkaruppan (Meta)
- 3. Karthik Ranganathan (Meta)
- 4. Samuel Rash (Meta)
- 5. Joydeep Sen Sarma (Meta)
- 6. Nicolas Spiegelberg (Meta)
- 7. Dmytro Molkov (Meta)
- 8. Rodrigo Schmidt (Meta)
- 9. Jonathan Gray (Meta)
- 10. Hairong Kuang (Meta)
- 11. Aravind Menon (Meta)
- 12. Amitanand Aiyer (Meta)
BibTeX Citation
@inproceedings{borthakur_sigmod11,
title = {{Apache Hadoop Goes Realtime at Facebook}},
author = {Borthakur, Dhruba and Muthukkaruppan, Kannan and Ranganathan, Karthik and Rash, Samuel and Sarma, Joydeep Sen and Spiegelberg, Nicolas and Molkov, Dmytro and Schmidt, Rodrigo and Gray, Jonathan and Kuang, Hairong and Menon, Aravind and Aiyer, Amitanand},
series = {{SIGMOD} '11},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/1989323.1989438},
url = {https://dl.acm.org/doi/10.1145/1989323.1989438},
year = {2011}
}
Incoming Citations (Sorted by Pagerank)
Showing 19 of 19 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 0 of 0 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 1,889 | SQL-on-Hadoop: Full Circle Back to Shared-Nothing Database Architectures | 2014 | VLDB |
| 2 | 2,265 | A Platform for Scalable One-Pass Analytics using MapReduce | 2011 | SIGMOD |
| 3 | 32 | Hive - A Warehousing Solution Over a Map-Reduce Framework | 2009 | VLDB |
| 4 | 11,885 | Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology | 2019 | VLDB |
| 5 | 1,389 | Realtime Data Processing at Facebook | 2016 | SIGMOD |
| 6 | 2,159 | Efficient Processing of Data Warehousing Queries in a Split Execution Environment | 2011 | SIGMOD |
| 7 | 120 | HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads | 2009 | VLDB |
| 8 | 6,147 | HadoopDB in Action: Building Real World Applications | 2010 | SIGMOD |
| 9 | 2,191 | Data Warehousing and Analytics Infrastructure at Facebook | 2010 | SIGMOD |
| 10 | 6,676 | Petabyte Scale Databases and Storage Systems at Facebook | 2013 | SIGMOD |