Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark
Summary: Declarative Spark Structured Streaming; incrementalizes SQL/DataFrame queries, not user-built DAG. End-to-end real-time apps unifying streaming with batch analytics; code generation yields high performance; rollbacks and mixed execution in production. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Michael Armbrust (Databricks)
- 2. Tathagata Das (Databricks)
- 3. Joseph Torres (Databricks)
- 4. Burak Yavuz (Databricks)
- 5. Shixiong Zhu (Databricks)
- 6. Reynold Xin (Databricks)
- 7. Ali Ghodsi (Databricks)
- 8. Ion Stoica (Databricks)
- 9. Matei Zaharia (Stanford University)
BibTeX Citation
@inproceedings{armbrust_sigmod18,
title = {{Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark}},
author = {Armbrust, Michael and Das, Tathagata and Torres, Joseph and Yavuz, Burak and Zhu, Shixiong and Xin, Reynold and Ghodsi, Ali and Stoica, Ion and Zaharia, Matei},
series = {{SIGMOD} '18},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/3183713.3190664},
url = {https://dl.acm.org/doi/10.1145/3183713.3190664},
year = {2018}
}Incoming Citations (Sorted by Pagerank)
Showing 39 of 39 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 10 of 10 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 23 | Spark SQL: Relational Data Processing in Spark | 2015 | SIGMOD | 0.00055523999 |
| 39 | Efficiently Updating Materialized Views | 1986 | SIGMOD | 0.00046445099 |
| 128 | The Design of the Borealis Stream Processing Engine | 2005 | CIDR | 0.00030317705 |
| 328 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB | 0.00020889528 |
| 400 | View Maintenance in a Warehousing Environment | 1995 | SIGMOD | 0.00019089369 |
| 444 | Differential dataflow | 2013 | CIDR | 0.0001815754 |
| 514 | TelegraphCQ: Continuous Dataflow Processing | 2003 | SIGMOD | 0.00017005839 |
| 688 | Trill: A High-Performance Incremental Query Processor for Diverse Analytics | 2015 | VLDB | 0.00014736145 |
| 1,255 | Consistency Analysis in Bloom: a CALM and Collected Approach | 2011 | CIDR | 0.00011313104 |
| 1,997 | Continuous Analytics Over Discontinuous Streams | 2010 | SIGMOD | 9.217553e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 2,240 | Spinning Fast Iterative Data Flows | 2012 | VLDB |
| 2 | 4,422 | Shared Arrangements: practical inter-query sharing for streaming dataflows | 2020 | VLDB |
| 3 | 6,635 | Watermarks in Stream Processing Systems: Semantics and Comparative Analysis of Apache Flink and Google Cloud Dataflow | 2021 | VLDB |
| 4 | 9,356 | Dynamic Speculative Optimizations for SQL Compilation in Apache Spark | 2020 | VLDB |
| 5 | 415 | SystemML: Declarative Machine Learning on Spark | 2016 | VLDB |
| 6 | 8,449 | Correctness in Stream Processing: Challenges and Opportunities | 2022 | CIDR |
| 7 | 3,466 | Scaling Spark in the Real World: Performance and Usability | 2015 | VLDB |
| 8 | 12,281 | Challenges and Experiences in Building an Efficient Apache Beam Runner For IBM Streams | 2018 | VLDB |
| 9 | 4,908 | One SQL to Rule Them All – an Efficient and Syntactically Idiomatic Approach to Management of Streams and Tables | 2019 | SIGMOD |
| 10 | 10,997 | A Decade of Apache Spark Structured Streaming: How We Evolved The Architecture To Meet Real-World Needs | 2026 | VLDB |