DBScholar

Back to papers

Data Warehousing and Analytics Infrastructure at Facebook

Summary: Facebook's scalable data warehouse uses Scribe, Hadoop, Hive to unify log collection, storage, and analytics for BI dashboards and feature services. Stores >15PB (2.5PB compressed), ingests ~60TB/day (10TB compressed); discusses design choices, day-to-day operations, and planned improvements. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hc3368bcd4a144ea6
Venue
SIGMOD
Year
2010
Pagerank
8.799877e-05
Overall Rank
2,230 | 85.01%
DOI
10.1145/1807167.1807278

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{thusoo_sigmod10,
        title = {{Data Warehousing and Analytics Infrastructure at Facebook}},
        author = {Thusoo, Ashish and Shao, Zheng and Anthony, Suresh and Borthakur, Dhruba and Jain, Namit and Sarma, Joydeep Sen and Murthy, Raghotham and Liu, Hao},
        series = {{SIGMOD} '10},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1807167.1807278},
        url = {https://dl.acm.org/doi/10.1145/1807167.1807278},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 17 of 17 citing papers.

Rank Citing Paper Year Venue Pagerank
1,303 Realtime Data Processing at Facebook 2016 SIGMOD 0.0001110427
1,622 Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing 2014 VLDB 0.00010051462
1,924 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3687009e-05
3,556 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.2084485e-05
4,249 The Unified Logging Infrastructure for Data Analytics at Twitter 2012 VLDB 6.7037533e-05
4,691 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD 6.4685355e-05
5,274 Only Aggressive Elephants are Fast Elephants 2012 VLDB 6.2005706e-05
5,828 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD 5.9786171e-05
5,958 Cheetah: Accelerating Database Queries with Switch Pruning 2020 SIGMOD 5.9338314e-05
6,245 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.837329e-05
6,819 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.672617e-05
7,404 Compliant Geo-distributed Query Processing 2021 SIGMOD 5.5357067e-05
8,177 Data Management for Social Networking 2016 PODS 5.3829638e-05
9,693 Efficient Big Data Processing in Hadoop MapReduce 2012 VLDB 5.1399537e-05
11,135 Unified Lineage System: Tracking Data Provenance at Scale 2025 SIGMOD 4.9793485e-05
12,345 The Challenges of Global-scale Data Management 2016 SIGMOD 4.9793485e-05
12,447 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
48 Weaving Relations for Cache Performance 2001 VLDB 0.00043805923
Previous Page 1 / 1 Next

Semantically Similar Papers