DBScholar

Back to papers

Data Warehousing and Analytics Infrastructure at Facebook

Summary: Facebook's scalable data warehouse uses Scribe, Hadoop, Hive to unify log collection, storage, and analytics for BI dashboards and feature services. Stores >15PB (2.5PB compressed), ingests ~60TB/day (10TB compressed); discusses design choices, day-to-day operations, and planned improvements. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4376
Venue
SIGMOD
Year
2010
Pagerank
8.9780154e-05
Overall Rank
2,191 | 84.97%
DOI
10.1145/1807167.1807278

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{thusoo_sigmod10,
        title = {{Data Warehousing and Analytics Infrastructure at Facebook}},
        author = {Thusoo, Ashish and Shao, Zheng and Anthony, Suresh and Borthakur, Dhruba and Jain, Namit and Sarma, Joydeep Sen and Murthy, Raghotham and Liu, Hao},
        series = {{SIGMOD} '10},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1807167.1807278},
        url = {https://dl.acm.org/doi/10.1145/1807167.1807278},
        year = {2010}
}

Incoming Citations (Sorted by Pagerank)

Showing 17 of 17 citing papers.

Rank Citing Paper Year Venue Pagerank
1,389 Realtime Data Processing at Facebook 2016 SIGMOD 0.00010943767
1,606 Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing 2014 VLDB 0.00010228576
1,883 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.5421713e-05
3,494 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.3642231e-05
4,169 The Unified Logging Infrastructure for Data Analytics at Twitter 2012 VLDB 6.8561463e-05
4,595 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD 6.6137084e-05
5,156 Only Aggressive Elephants are Fast Elephants 2012 VLDB 6.3410921e-05
5,748 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD 6.1014813e-05
5,871 Cheetah: Accelerating Database Queries with Switch Pruning 2020 SIGMOD 6.0604381e-05
6,121 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.9688569e-05
6,734 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.7879923e-05
7,258 Compliant Geo-distributed Query Processing 2021 SIGMOD 5.6614636e-05
8,017 Data Management for Social Networking 2016 PODS 5.5064531e-05
9,510 Efficient Big Data Processing in Hadoop MapReduce 2012 VLDB 5.2576928e-05
10,701 Unified Lineage System: Tracking Data Provenance at Scale 2025 SIGMOD 5.093636e-05
12,050 The Challenges of Global-scale Data Management 2016 SIGMOD 5.093636e-05
12,156 Shared Execution of Recurring Workloads in MapReduce 2015 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
49 Weaving Relations for Cache Performance 2001 VLDB 0.00043781096
Previous Page 1 / 1 Next

Semantically Similar Papers