DBScholar

Back to papers

Data Warehousing and Analytics Infrastructure at Facebook

Summary: Facebook's scalable data warehouse uses Scribe, Hadoop, Hive to unify log collection, storage, and analytics for BI dashboards and feature services. Stores >15PB (2.5PB compressed), ingests ~60TB/day (10TB compressed); discusses design choices, day-to-day operations, and planned improvements. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hc3368bcd4a144ea6
Venue
SIGMOD
Year
2010
Pagerank
8.767428e-05
Overall Rank
2,243 | 84.97%
DOI
10.1145/1807167.1807278

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{thusoo_sigmod10,
        title = {{Data Warehousing and Analytics Infrastructure at Facebook}},
        author = {Thusoo, Ashish and Shao, Zheng and Anthony, Suresh and Borthakur, Dhruba and Jain, Namit and Sarma, Joydeep Sen and Murthy, Raghotham and Liu, Hao},
        series = {{SIGMOD} '10},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1807167.1807278},
        url = {https://dl.acm.org/doi/10.1145/1807167.1807278},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 17 of 17 citing papers.

Rank Citing Paper Year Venue Pagerank
1,310 Realtime Data Processing at Facebook 2016 SIGMOD 0.00011065568
1,625 Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing 2014 VLDB 0.00010028153
1,936 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3375824e-05
3,565 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.183429e-05
4,266 The Unified Logging Infrastructure for Data Analytics at Twitter 2012 VLDB 6.6787601e-05
4,705 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD 6.4443767e-05
5,297 Only Aggressive Elephants are Fast Elephants 2012 VLDB 6.1773472e-05
5,842 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD 5.9568426e-05
5,972 Cheetah: Accelerating Database Queries with Switch Pruning 2020 SIGMOD 5.9114227e-05
6,260 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.815273e-05
6,834 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.6528857e-05
7,425 Compliant Geo-distributed Query Processing 2021 SIGMOD 5.5147937e-05
8,200 Data Management for Social Networking 2016 PODS 5.3626246e-05
9,728 Efficient Big Data Processing in Hadoop MapReduce 2012 VLDB 5.1205326e-05
11,203 Unified Lineage System: Tracking Data Provenance at Scale 2025 SIGMOD 4.9605343e-05
12,394 The Challenges of Global-scale Data Management 2016 SIGMOD 4.9605343e-05
12,496 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
48 Weaving Relations for Cache Performance 2001 VLDB 0.00043770511
Previous Page 1 / 1 Next

Semantically Similar Papers