Providing Streaming Joins as a Service at Facebook

Summary: Streaming join service for Facebook enabling joins across streams with varying out-of-order characteristics. Adaptive synchronization paces parsing to lower memory use while preserving accuracy, integrated with streaming SQL to reduce latency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11850
Venue: VLDB
Year: 2018
Pagerank: 5.9730511e-05
Overall Rank: 6,108 | 58.10%
DOI: 10.14778/3229863.3229869

Incoming Non-self Citations Over Time

Authors

1. Gabriela Jacques-Silva (Meta)
2. Ran Lei (Meta)
3. Luwei Cheng (Meta)
4. Guoqiang Jerry Chen (Meta)
5. Kuen Ching (Meta)
6. Tanji Hu (Meta)
7. Yuan Mei (Meta)
8. Kevin Wilfong (Meta)
9. Rithin Shetty (Meta)
10. Serhat Yilmaz (Meta)
11. Anirban Banerjee (Meta)
12. Benjamin Heintz (Meta)
13. Shridar Iyer (Meta)
14. Anshul Jaiswal (Meta)

BibTeX Citation

@article{jacquessilva_vldb18,
        title = {{Providing Streaming Joins as a Service at Facebook}},
        author = {Jacques-Silva, Gabriela and Lei, Ran and Cheng, Luwei and Chen, Guoqiang Jerry and Ching, Kuen and Hu, Tanji and Mei, Yuan and Wilfong, Kevin and Shetty, Rithin and Yilmaz, Serhat and Banerjee, Anirban and Heintz, Benjamin and Iyer, Shridar and Jaiswal, Anshul},
        journal = {PVLDB},
        series = {{VLDB} '18},
        volume = {11},
        number = {12},
        pages = {1809--1821},
        doi = {10.14778/3229863.3229869},
        url = {https://doi.org/10.14778/3229863.3229869},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
4,279	Rhino: Efficient Management of Very Large Distributed State for Stream Processing Engines	2020	SIGMOD	6.7865878e-05
7,814	Rethinking Stateful Stream Processing with RDMA	2022	SIGMOD	5.5389009e-05
7,820	Parallelizing Intra-Window Join on Multicores: An Experimental Study	2021	SIGMOD	5.5373345e-05
7,856	AJoin: Ad-hoc Stream Joins at Scale	2020	VLDB	5.5306709e-05
11,181	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD	5.093636e-05
11,665	Klink: Progress-Aware Scheduling for Streaming Data Systems	2021	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
224	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00024130894
361	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020138717
1,171	Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams	2013	SIGMOD	0.00011826434
1,190	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011743246
1,352	Scuba: Diving into Data at Facebook	2013	VLDB	0.00011064595
1,369	How Soccer Players Would do Stream Joins	2011	SIGMOD	0.0001099892
1,389	Realtime Data Processing at Facebook	2016	SIGMOD	0.00010943767
1,397	Approximate Join Processing Over Data Streams	2003	SIGMOD	0.00010906135
1,422	State Management in Apache Flink: Consistent Stateful Distributed Stream Processing	2017	VLDB	0.00010823039
1,895	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.5260291e-05
2,655	Executing Stream Joins on the Cell Processor	2007	VLDB	8.2888851e-05
3,532	Scalable Distributed Stream Join Processing	2015	SIGMOD	7.3369085e-05
4,278	Consistent Regions: Guaranteed Tuple Processing in IBM Streams	2016	VLDB	6.7871785e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,911	RPJ: Producing Fast Join Results on Streams through Rate-based Optimization	2005	SIGMOD
2	1,389	Realtime Data Processing at Facebook	2016	SIGMOD
3	6,012	Parallel Index-based Stream Join on a Multicore CPU	2020	SIGMOD
4	7,856	AJoin: Ad-hoc Stream Joins at Scale	2020	VLDB
5	1,093	Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources	2003	VLDB
6	2,892	Scalable and Adaptive Online Joins	2014	VLDB
7	3,657	Memory-Limited Execution of Windowed Stream Joins	2004	VLDB
8	1,397	Approximate Join Processing Over Data Streams	2003	SIGMOD
9	3,532	Scalable Distributed Stream Join Processing	2015	SIGMOD
10	11,181	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD