Streaming Similarity Search over one Billion Tweets using Parallel Locality-Sensitive Hashing

Summary: Parallel LSH for streaming similarity search on >1B tweets; scalable across nodes and cores. Innovations: cache-conscious hash tables, 2-level merge for construction, duplicate-elimination during querying, insert-optimized structures and streaming expiration, plus a performance model; yields 1–2.5 ms queries and ~8x speedups over basic LSH and inverted indexes. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10679
Venue: VLDB
Year: 2013
Pagerank: 7.9799783e-05
Overall Rank: 2,870 | 80.04%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
867	SRS: Solving c-Approximate Nearest Neighbor Queries in High Dimensional Euclidean Space with a Tiny Index	2015	VLDB	0.00015792021
2,181	PM-LSH: A Fast and Accurate LSH Framework for High-Dimensional Approximate NN Search	2020	VLDB	9.3451821e-05
2,523	ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data	2024	SIGMOD	8.604576e-05
2,641	Locality-Sensitive Hashing for Earthquake Detection: A Case Study of Scaling Data-Driven Science	2018	VLDB	8.3905374e-05
5,224	Neighbor-Sensitive Hashing	2016	VLDB	5.6197981e-05
7,301	Randomized Algorithms Accelerated over CPU-GPU for Ultra-High Dimensional Similarity Search	2018	SIGMOD	4.768971e-05
7,606	Tribase: A Vector Data Query Engine for Reliable and Lossless Pruning Compression using Triangle Inequalities	2025	SIGMOD	4.6967106e-05
8,439	Accelerating Graph Indexing for ANNS on Modern CPUs	2025	SIGMOD	4.5128946e-05
8,899	Fast Approximate Similarity Join in Vector Databases	2025	SIGMOD	4.427232e-05
9,881	VStream: A Distributed Streaming Vector Search System	2025	VLDB	4.2643674e-05
10,146	CANDOR-Bench: Benchmarking In-Memory Continuous ANNS under Dynamic Open-World Streams [Experiments & Analysis]	2026	SIGMOD	4.1945683e-05
10,409	MicroNN: An On-device Disk-resident Updatable Vector Database	2025	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
233	A Study of Index Structures for Main Memory Database Management Systems	1986	VLDB	0.00032021526
251	Robust and Fast Similarity Search for Moving Object Trajectories	2005	SIGMOD	0.00030644658
351	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.0002636504
572	Substructure Similarity Search in Graph Databases	2005	SIGMOD	0.00019887011
877	Effective Keyword Search in Relational Databases	2006	SIGMOD	0.00015714014
930	Fast Sort on CPUs and GPUs: A Case for Bandwidth Oblivious SIMD Sort	2010	SIGMOD	0.00015238545
1,944	WHAM: A High-throughput Sequence Alignment Method	2011	SIGMOD	0.00010004608

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,971	Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional Spaces	2023	VLDB	7.7970531e-05
4,485	Parallel Index-Based Structural Graph Clustering and Its Approximation	2021	SIGMOD	6.1458149e-05
682	Quality and Efficiency in High Dimensional Nearest Neighbor Search	2009	SIGMOD	0.00018201541
3,555	Fast Parallel Similarity Search in Multimedia Databases	1997	SIGMOD	6.9772546e-05
3,609	Similarity search in the blink of an eye with compressed indices	2023	VLDB	6.9215236e-05
8,635	Bidirectionally Densifying LSH Sketches with Empty Bins	2021	SIGMOD	4.4801584e-05
6,399	Similarity Search and Locality Sensitive Hashing using Ternary Content Addressable Memories	2010	SIGMOD	5.0818596e-05
8,763	Smooth Tradeoffs between Insert and Query Complexity in Nearest Neighbor Search	2015	PODS	4.456315e-05
400	Multi-Probe LSH: Efficient Indexing for High-Dimensional Similarity Search	2007	VLDB	0.0002427237
34	Similarity Search in High Dimensions via Hashing	1999	VLDB	0.00076637636