DBScholar

Back to papers

The Unified Logging Infrastructure for Data Analytics at Twitter

Summary: Twitter’s production logging system unifies heterogeneous application logs into flexible, well-structured Thrift client events. It also pre-materializes compact session sequences, accelerating common analytics and enabling faster service experimentation. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
10602
Venue
VLDB
Year
2012
Pagerank
6.8561463e-05
Overall Rank
4,169 | 71.40%
DOI
10.14778/2367502.2367518

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{lee_vldb12,
        title = {{The Unified Logging Infrastructure for Data Analytics at Twitter}},
        author = {Lee, George and Lin, Jimmy and Liu, Chuang and Lorek, Andrew and Ryaboy, Dmitriy},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {5},
        number = {12},
        pages = {1771--1780},
        doi = {10.14778/2367502.2367518},
        url = {https://doi.org/10.14778/2367502.2367518},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank Citing Paper Year Venue Pagerank
1,606 Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing 2014 VLDB 0.00010228576
1,639 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010155021
3,494 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.3642231e-05
4,254 GraphJet: Real-Time Content Recommendations at Twitter 2016 VLDB 6.8024576e-05
4,595 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD 6.6137084e-05
5,713 PreLog: A Pre-trained Model for Log Analytics 2024 SIGMOD 6.1123632e-05
5,748 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD 6.1014813e-05
6,121 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.9688569e-05
7,258 Compliant Geo-distributed Query Processing 2021 SIGMOD 5.6614636e-05
8,017 Data Management for Social Networking 2016 PODS 5.5064531e-05
10,956 CoLA: Model Collaboration for Log-based Anomaly Detection 2025 VLDB 5.093636e-05
11,914 Robust, Scalable, Real-Time Event Time Series Aggregation at Twitter 2018 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010686205
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031680027
642 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015395331
660 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00015198804
1,324 Apache Hadoop Goes Realtime at Facebook 2011 SIGMOD 0.00011149314
2,159 Efficient Processing of Data Warehousing Queries in a Split Execution Environment 2011 SIGMOD 9.061086e-05
2,191 Data Warehousing and Analytics Infrastructure at Facebook 2010 SIGMOD 8.9780154e-05
2,942 Llama: Leveraging Columnar Storage for Scalable Join Processing in the MapReduce Framework 2011 SIGMOD 7.9358593e-05
3,714 Large-Scale Machine Learning at Twitter 2012 SIGMOD 7.1764857e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,595 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD
2 1,054 Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads 2012 VLDB
3 2,642 CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop 2011 VLDB
4 612 Twitter Heron: Stream Processing at Scale 2015 SIGMOD
5 769 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD
6 2,191 Data Warehousing and Analytics Infrastructure at Facebook 2010 SIGMOD
7 9,640 Supporting Scalable Analytics with Latency Constraints 2015 VLDB
8 2,265 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD
9 3,714 Large-Scale Machine Learning at Twitter 2012 SIGMOD
10 5,748 Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture 2013 SIGMOD