Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing

Summary: Executor-centric elasticity for realtime stateful stream processing; avoids operator-level repartitioning for rapid elasticity. Elasticutor uses elastic executors with intra-executor load balancing and a global scheduler that maps cores to current workload; prototype achieves ~2× throughput and up to 2 orders of magnitude lower latency on dynamic real-world workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h3dd646c7524808cf
Venue: SIGMOD
Year: 2019
Pagerank: 5.1687151e-05
Overall Rank: 9,482 | 36.28%
DOI: 10.1145/3299869.3319868

Incoming Non-self Citations Over Time

Authors

1. Li Wang (Yitu Technology)
2. Tom Z. J. Fu (Advanced Digital Sciences Center)
3. Richard T. B. Ma (National University of Singapore)
4. Marianne Winslett (University of Illinois Urbana-Champaign)
5. Zhenjie Zhang (Yitu Technology)

BibTeX Citation

@inproceedings{wang_sigmod19,
        title = {{Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing}},
        author = {Wang, Li and Fu, Tom Z. J. and Ma, Richard T. B. and Winslett, Marianne and Zhang, Zhenjie},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3319868},
        url = {https://dl.acm.org/doi/10.1145/3299869.3319868},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,413	POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance	2024	VLDB	5.5316834e-05
10,552	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
127	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00030414379
218	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00024379041
231	Storm @Twitter	2014	SIGMOD	0.00023830094
325	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.0002095522
511	TelegraphCQ: Continuous Dataflow Processing	2003	SIGMOD	0.00017058115
606	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00015627966
685	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014778299
891	E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems	2015	VLDB	0.00013241227
970	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00012776109
1,236	Dhalion: Self-Regulating Stream Processing in Heron	2017	VLDB	0.00011400483
1,402	State Management in Apache Flink: Consistent Stateful Distributed Stream Processing	2017	VLDB	0.00010766851
1,771	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.6757926e-05
2,398	Muppet: MapReduce-Style Processing of Fast Data	2012	VLDB	8.5187919e-05
2,502	Operator Scheduling in a Data Stream Manager	2003	VLDB	8.3769557e-05
3,034	Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems	2018	VLDB	7.7301387e-05
6,291	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	5.8200348e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,823	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
2	3,923	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB
3	11,531	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD
4	970	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD
5	8,686	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD
6	6,543	A Holistic View of Stream Partitioning Costs	2017	VLDB
7	8,375	A system design for elastically scaling transaction processing engines in virtualized servers	2020	VLDB
8	6,291	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD
9	10,552	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD
10	9,648	Providing Resiliency to Load Variations in Distributed Stream Processing	2006	VLDB