Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture
Summary: Twitter’s real-time related query suggestion and spelling correction, delivering results within minutes after breaking news. From Hadoop batch analytics to a custom in-memory engine, enabling low-latency results and shaping data-platform design. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Gilad Mishne (Twitter)
- 2. Jeff Dalton (Twitter)
- 3. Zhenghua Li (Twitter)
- 4. Aneesh Sharma (Twitter)
- 5. Jimmy Lin (Twitter)
BibTeX Citation
@inproceedings{mishne_sigmod13,
title = {{Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture}},
author = {Mishne, Gilad and Dalton, Jeff and Li, Zhenghua and Sharma, Aneesh and Lin, Jimmy},
series = {{SIGMOD} '13},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/2463676.2465290},
url = {https://dl.acm.org/doi/10.1145/2463676.2465290},
year = {2013}
}
Incoming Citations (Sorted by Pagerank)
Showing 6 of 6 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,639 | Summingbird: A Framework for Integrating Batch and Online MapReduce Computations | 2014 | VLDB | 0.00010155021 |
| 5,477 | PolarDB-IMCI: A Cloud-Native HTAP Database System at Alibaba | 2023 | SIGMOD | 6.2051869e-05 |
| 7,971 | Modernization of Databases in the Cloud Era: Building Databases that Run like Legos | 2023 | VLDB | 5.5160445e-05 |
| 9,640 | Supporting Scalable Analytics with Latency Constraints | 2015 | VLDB | 5.2434488e-05 |
| 12,006 | Query-able Kafka: An agile data analytics pipeline for mobile wireless networks | 2017 | VLDB | 5.093636e-05 |
| 12,049 | Microblogs Data Management Systems: Querying, Analysis, and Visualization | 2016 | SIGMOD | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 12 of 12 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 8,033 | TI: An Efficient Indexing Mechanism for Real-Time Search on Tweets | 2011 | SIGMOD |
| 2 | 8,072 | Operational Analytics Data Management Systems | 2016 | VLDB |
| 3 | 3,714 | Large-Scale Machine Learning at Twitter | 2012 | SIGMOD |
| 4 | 2,265 | A Platform for Scalable One-Pass Analytics using MapReduce | 2011 | SIGMOD |
| 5 | 612 | Twitter Heron: Stream Processing at Scale | 2015 | SIGMOD |
| 6 | 4,254 | GraphJet: Real-Time Content Recommendations at Twitter | 2016 | VLDB |
| 7 | 1,944 | Real-Time Twitter Recommendation: Online Motif Detection in Large Dynamic Graphs | 2014 | VLDB |
| 8 | 2,390 | Streaming Similarity Search over one Billion Tweets using Parallel Locality-Sensitive Hashing | 2013 | VLDB |
| 9 | 4,169 | The Unified Logging Infrastructure for Data Analytics at Twitter | 2012 | VLDB |
| 10 | 9,640 | Supporting Scalable Analytics with Latency Constraints | 2015 | VLDB |