Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing

Summary: Executor-centric elasticity for realtime stateful stream processing; avoids operator-level repartitioning for rapid elasticity. Elasticutor uses elastic executors with intra-executor load balancing and a global scheduler that maps cores to current workload; prototype achieves ~2× throughput and up to 2 orders of magnitude lower latency on dynamic real-world workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5742
Venue: SIGMOD
Year: 2019
Pagerank: 5.2878276e-05
Overall Rank: 9,336 | 35.95%
DOI: 10.1145/3299869.3319868

Incoming Non-self Citations Over Time

Authors

1. Li Wang (Yitu Technology)
2. Tom Z. J. Fu (Advanced Digital Sciences Center)
3. Richard T. B. Ma (National University of Singapore)
4. Marianne Winslett (University of Illinois Urbana-Champaign)
5. Zhenjie Zhang (Yitu Technology)

BibTeX Citation

@inproceedings{wang_sigmod19,
        title = {{Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing}},
        author = {Wang, Li and Fu, Tom Z. J. and Ma, Richard T. B. and Winslett, Marianne and Zhang, Zhenjie},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3319868},
        url = {https://dl.acm.org/doi/10.1145/3299869.3319868},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,494	POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance	2024	VLDB	5.4142129e-05
10,337	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
127	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00030738755
220	Storm @Twitter	2014	SIGMOD	0.00024244587
224	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00024130894
361	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020138717
505	TelegraphCQ: Continuous Dataflow Processing	2003	SIGMOD	0.00017285498
612	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.0001573018
710	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014715033
887	E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems	2015	VLDB	0.00013403455
983	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.0001283214
1,224	Dhalion: Self-Regulating Stream Processing in Heron	2017	VLDB	0.00011596911
1,422	State Management in Apache Flink: Consistent Stateful Distributed Stream Processing	2017	VLDB	0.00010823039
1,895	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.5260291e-05
2,357	Muppet: MapReduce-Style Processing of Fast Data	2012	VLDB	8.7013171e-05
2,447	Operator Scheduling in a Data Stream Manager	2003	VLDB	8.5728111e-05
3,117	Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems	2018	VLDB	7.7382559e-05
6,255	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	5.9399698e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,640	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
2	3,851	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB
3	11,181	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD
4	983	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD
5	8,568	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD
6	6,410	A Holistic View of Stream Partitioning Costs	2017	VLDB
7	8,386	A system design for elastically scaling transaction processing engines in virtualized servers	2020	VLDB
8	6,255	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD
9	10,337	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD
10	9,460	Providing Resiliency to Load Variations in Distributed Stream Processing	2006	VLDB