Fast Data in the Era of Big Data: Twitter's Real-Time Related Query Suggestion Architecture

Summary: Twitter’s real-time related query suggestion and spelling correction, delivering results within minutes after breaking news. From Hadoop batch analytics to a custom in-memory engine, enabling low-latency results and shaping data-platform design. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4699
Venue: SIGMOD
Year: 2013
Pagerank: 5.1956688e-05
Overall Rank: 6,131 | 57.35%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,794	Summingbird: A Framework for Integrating Batch and Online MapReduce Computations	2014	VLDB	0.00010532024
6,170	PolarDB-IMCI: A Cloud-Native HTAP Database System at Alibaba	2023	SIGMOD	5.171601e-05
8,658	Modernization of Databases in the Cloud Era: Building Databases that Run like Legos	2023	VLDB	4.4729338e-05
9,504	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3341665e-05
11,802	Query-able Kafka: An agile data analytics pipeline for mobile wireless networks	2017	VLDB	4.1945683e-05
11,848	Microblogs Data Management Systems: Querying, Analysis, and Visualization	2016	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024183614
205	Monitoring Streams – A New Class of Data Management Applications	2002	VLDB	0.00034731577
780	Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience	2009	VLDB	0.00016775082
1,334	SkewTune: Mitigating Skew in MapReduce Applications	2012	SIGMOD	0.0001250413
1,467	SPADE: The System S Declarative Stream Processing Engine	2008	SIGMOD	0.00011849864
1,499	Apache Hadoop Goes Realtime at Facebook	2011	SIGMOD	0.00011675192
2,198	Continuous Analytics Over Discontinuous Streams	2010	SIGMOD	9.308495e-05
2,477	Identifying Similarities, Periodicities and Bursts for Online Search Queries	2004	SIGMOD	8.6941234e-05
2,605	Muppet: MapReduce-Style Processing of Fast Data	2012	VLDB	8.4646171e-05
2,658	Data Warehousing and Analytics Infrastructure at Facebook	2010	SIGMOD	8.3607429e-05
3,601	Large-Scale Machine Learning at Twitter	2012	SIGMOD	6.9315087e-05
4,572	The Unified Logging Infrastructure for Data Analytics at Twitter	2012	VLDB	6.0760183e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
7,999	TI: An Efficient Indexing Mechanism for Real-Time Search on Tweets	2011	SIGMOD	4.6100392e-05
7,866	Operational Analytics Data Management Systems	2016	VLDB	4.6321795e-05
3,601	Large-Scale Machine Learning at Twitter	2012	SIGMOD	6.9315087e-05
2,476	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD	8.6960139e-05
4,885	GraphJet: Real-Time Content Recommendations at Twitter	2016	VLDB	5.8534354e-05
824	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.0001623129
2,228	Real-Time Twitter Recommendation: Online Motif Detection in Large Dynamic Graphs	2014	VLDB	9.2385241e-05
2,870	Streaming Similarity Search over one Billion Tweets using Parallel Locality-Sensitive Hashing	2013	VLDB	7.9799783e-05
4,572	The Unified Logging Infrastructure for Data Analytics at Twitter	2012	VLDB	6.0760183e-05
9,504	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3341665e-05