Scalable Distributed Stream Join Processing

Summary: Proposes join-biclique, a scalable stream-join model mapping a cluster to a bipartite graph; enables BiStream for full-history and window joins. Adaptive resource management, cost analysis, and experiments show efficiency and scalability. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h87ca9c386d096bc9
Venue: SIGMOD
Year: 2015
Pagerank: 7.173496e-05
Overall Rank: 3,603 | 75.78%
DOI: 10.1145/2723372.2746485

Incoming Non-self Citations Over Time

Authors

1. Qian Lin (National University of Singapore)
2. Beng Chin Ooi (National University of Singapore)
3. Zhengkui Wang (National University of Singapore)
4. Cui Yu (Monmouth University)

BibTeX Citation

@inproceedings{lin_sigmod15,
        title = {{Scalable Distributed Stream Join Processing}},
        author = {Lin, Qian and Ooi, Beng Chin and Wang, Zhengkui and Yu, Cui},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2746485},
        url = {https://dl.acm.org/doi/10.1145/2723372.2746485},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 13 of 13 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,057	Change Propagation Without Joins	2023	VLDB	6.2927647e-05
6,123	Parallel Index-based Stream Join on a Multicore CPU	2020	SIGMOD	5.8789534e-05
6,225	Providing Streaming Joins as a Service at Facebook	2018	VLDB	5.8455305e-05
6,541	A Holistic View of Stream Partitioning Costs	2017	VLDB	5.7523608e-05
7,964	Parallelizing Intra-Window Join on Multicores: An Experimental Study	2021	SIGMOD	5.4165494e-05
8,769	CLASH: A High-Level Abstraction for Optimized, Multi-Way Stream Joins over Apache Storm	2019	SIGMOD	5.2814045e-05
8,899	HYPERSONIC: A Hybrid Parallelization Approach for Scalable Complex Event Processing	2022	SIGMOD	5.2559789e-05
9,363	Complex Event Recognition meets Hierarchical Conjunctive Queries	2024	PODS	5.1868213e-05
9,807	INEv: In-Network Evaluation for Event Stream Processing	2023	SIGMOD	5.1257999e-05
10,329	Distributed Stream KNN Join	2021	SIGMOD	5.0333462e-05
11,525	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD	4.9793485e-05
11,536	Enabling Adaptive Sampling for Intra-Window Join: Simultaneously Optimizing Quantity and Quality	2024	SIGMOD	4.9793485e-05
11,865	Scaling Equi-Joins	2022	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076195956
26	Models and Issues in Data Stream Systems	2002	PODS	0.00052121228
135	Ripple Joins for Online Aggregation	1999	SIGMOD	0.00029866033
361	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00020006406
566	On Computing Correlated Aggregates Over Continual Data Streams	2001	SIGMOD	0.00016295476
865	Processing Theta-Joins using MapReduce*	2011	SIGMOD	0.0001338765
1,175	Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams	2013	SIGMOD	0.00011649474
1,243	Blink and It's Done: Interactive Queries on Very Large Data	2012	VLDB	0.0001135375
1,387	How Soccer Players Would do Stream Joins	2011	SIGMOD	0.00010825457
1,628	Adaptive Parallel Aggregation Algorithms	1995	SIGMOD	0.00010037937
1,666	Characterizing Memory Requirements for Queries over Continuous Data Streams	2002	PODS	9.9382031e-05
1,736	Using Segmented Right-Deep Trees for the Execution of Pipelined Hash Joins	1992	VLDB	9.7507905e-05
1,820	A Scalable Hash Ripple Join Algorithm	2002	SIGMOD	9.5690887e-05
2,696	Executing Stream Joins on the Cell Processor	2007	VLDB	8.1205649e-05
2,753	Processing Sliding Window Multi-Joins in Continuous Queries over Data Streams	2003	VLDB	8.0549317e-05
2,953	Scalable and Adaptive Online Joins	2014	VLDB	7.8137255e-05
3,727	Memory-Limited Execution of Windowed Stream Joins	2004	VLDB	7.0696489e-05
5,434	Low-Latency Handshake Join	2014	VLDB	6.1305768e-05
9,184	PR-Join: A Non-Blocking Join Achieving Higher Early Result Rate with Statistical Guarantees	2010	SIGMOD	5.211541e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,383	On-the-Fly Sharing for Streamed Aggregation	2006	SIGMOD
2	1,292	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
3	12,383	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR
4	6,225	Providing Streaming Joins as a Service at Facebook	2018	VLDB
5	6,123	Parallel Index-based Stream Join on a Multicore CPU	2020	SIGMOD
6	8,014	AJoin: Ad-hoc Stream Joins at Scale	2020	VLDB
7	1,431	Approximate Join Processing Over Data Streams	2003	SIGMOD
8	2,953	Scalable and Adaptive Online Joins	2014	VLDB
9	3,636	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB
10	11,525	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD