Scalable Distributed Stream Join Processing

Summary: Proposes join-biclique, a scalable stream-join model mapping a cluster to a bipartite graph; enables BiStream for full-history and window joins. Adaptive resource management, cost analysis, and experiments show efficiency and scalability. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h87ca9c386d096bc9
Venue: SIGMOD
Year: 2015
Pagerank: 7.1463915e-05
Overall Rank: 3,610 | 75.81%
DOI: 10.1145/2723372.2746485

Incoming Non-self Citations Over Time

Authors

1. Qian Lin (National University of Singapore)
2. Beng Chin Ooi (National University of Singapore)
3. Zhengkui Wang (National University of Singapore)
4. Cui Yu (Monmouth University)

BibTeX Citation

@inproceedings{lin_sigmod15,
        title = {{Scalable Distributed Stream Join Processing}},
        author = {Lin, Qian and Ooi, Beng Chin and Wang, Zhengkui and Yu, Cui},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2746485},
        url = {https://dl.acm.org/doi/10.1145/2723372.2746485},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 13 of 13 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,080	Change Propagation Without Joins	2023	VLDB	6.2689958e-05
6,139	Parallel Index-based Stream Join on a Multicore CPU	2020	SIGMOD	5.8567401e-05
6,240	Providing Streaming Joins as a Service at Facebook	2018	VLDB	5.8234435e-05
6,553	A Holistic View of Stream Partitioning Costs	2017	VLDB	5.7306258e-05
7,985	Parallelizing Intra-Window Join on Multicores: An Experimental Study	2021	SIGMOD	5.3960833e-05
8,797	CLASH: A High-Level Abstraction for Optimized, Multi-Way Stream Joins over Apache Storm	2019	SIGMOD	5.261449e-05
8,927	HYPERSONIC: A Hybrid Parallelization Approach for Scalable Complex Event Processing	2022	SIGMOD	5.2361195e-05
9,398	Complex Event Recognition meets Hierarchical Conjunctive Queries	2024	PODS	5.1672232e-05
9,848	INEv: In-Network Evaluation for Event Stream Processing	2023	SIGMOD	5.1064323e-05
10,362	Distributed Stream KNN Join	2021	SIGMOD	5.014328e-05
11,580	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD	4.9605343e-05
11,591	Enabling Adaptive Sampling for Intra-Window Join: Simultaneously Optimizing Quantity and Quality	2024	SIGMOD	4.9605343e-05
11,915	Scaling Equi-Joins	2022	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076079812
26	Models and Issues in Data Stream Systems	2002	PODS	0.00051942573
135	Ripple Joins for Online Aggregation	1999	SIGMOD	0.00029805026
360	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00019959166
566	On Computing Correlated Aggregates Over Continual Data Streams	2001	SIGMOD	0.00016236872
867	Processing Theta-Joins using MapReduce*	2011	SIGMOD	0.00013342302
1,178	Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams	2013	SIGMOD	0.00011605998
1,254	Blink and It's Done: Interactive Queries on Very Large Data	2012	VLDB	0.00011314204
1,391	How Soccer Players Would do Stream Joins	2011	SIGMOD	0.00010790581
1,633	Adaptive Parallel Aggregation Algorithms	1995	SIGMOD	0.00010002415
1,674	Characterizing Memory Requirements for Queries over Continuous Data Streams	2002	PODS	9.9008287e-05
1,746	Using Segmented Right-Deep Trees for the Execution of Pipelined Hash Joins	1992	VLDB	9.718559e-05
1,832	A Scalable Hash Ripple Join Algorithm	2002	SIGMOD	9.5365548e-05
2,704	Executing Stream Joins on the Cell Processor	2007	VLDB	8.0950719e-05
2,762	Processing Sliding Window Multi-Joins in Continuous Queries over Data Streams	2003	VLDB	8.025285e-05
2,972	Scalable and Adaptive Online Joins	2014	VLDB	7.7844791e-05
3,735	Memory-Limited Execution of Windowed Stream Joins	2004	VLDB	7.0431286e-05
5,455	Low-Latency Handshake Join	2014	VLDB	6.107413e-05
9,218	PR-Join: A Non-Blocking Join Achieving Higher Early Result Rate with Statistical Guarantees	2010	SIGMOD	5.1918495e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,388	On-the-Fly Sharing for Streamed Aggregation	2006	SIGMOD
2	1,296	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
3	12,432	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR
4	6,240	Providing Streaming Joins as a Service at Facebook	2018	VLDB
5	6,139	Parallel Index-based Stream Join on a Multicore CPU	2020	SIGMOD
6	8,035	AJoin: Ad-hoc Stream Joins at Scale	2020	VLDB
7	1,439	Approximate Join Processing Over Data Streams	2003	SIGMOD
8	2,972	Scalable and Adaptive Online Joins	2014	VLDB
9	3,638	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB
10	11,580	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD