Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing

Summary: Executor-centric elasticity for realtime stateful stream processing; avoids operator-level repartitioning for rapid elasticity. Elasticutor uses elastic executors with intra-executor load balancing and a global scheduler that maps cores to current workload; prototype achieves ~2× throughput and up to 2 orders of magnitude lower latency on dynamic real-world workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h3dd646c7524808cf
Venue: SIGMOD
Year: 2019
Pagerank: 5.1516241e-05
Overall Rank: 9,511 | 36.25%
DOI: 10.1145/3299869.3319868

Incoming Non-self Citations Over Time

Authors

1. Li Wang (Yitu Technology)
2. Tom Z. J. Fu (Advanced Digital Sciences Center)
3. Richard T. B. Ma (National University of Singapore)
4. Marianne Winslett (University of Illinois Urbana-Champaign)
5. Zhenjie Zhang (Yitu Technology)

BibTeX Citation

@inproceedings{wang_sigmod19,
        title = {{Elasticutor: Rapid Elasticity for Realtime Stateful Stream Processing}},
        author = {Wang, Li and Fu, Tom Z. J. and Ma, Richard T. B. and Winslett, Marianne and Zhang, Zhenjie},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3319868},
        url = {https://dl.acm.org/doi/10.1145/3299869.3319868},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,432	POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance	2024	VLDB	5.5133928e-05
10,617	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
128	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00030317705
219	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.0002429959
233	Storm @Twitter	2014	SIGMOD	0.00023754096
328	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020889528
514	TelegraphCQ: Continuous Dataflow Processing	2003	SIGMOD	0.00017005839
607	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00015577054
688	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014736145
891	E-Store: Fine-Grained Elastic Partitioning for Distributed Transaction Processing Systems	2015	VLDB	0.00013211469
973	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00012734154
1,244	Dhalion: Self-Regulating Stream Processing in Heron	2017	VLDB	0.00011363001
1,409	State Management in Apache Flink: Consistent Stateful Distributed Stream Processing	2017	VLDB	0.00010732706
1,785	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.6438157e-05
2,409	Muppet: MapReduce-Style Processing of Fast Data	2012	VLDB	8.4908118e-05
2,510	Operator Scheduling in a Data Stream Manager	2003	VLDB	8.3492737e-05
3,043	Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems	2018	VLDB	7.7045781e-05
6,302	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD	5.8013694e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,857	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
2	11,580	Low-Latency Adaptive Distributed Stream Join System Based on a Flexible Join Model	2024	SIGMOD
3	3,939	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB
4	973	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD
5	8,705	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD
6	6,553	A Holistic View of Stream Partitioning Costs	2017	VLDB
7	8,370	A system design for elastically scaling transaction processing engines in virtualized servers	2020	VLDB
8	6,302	Elastic Pipelining in an In-Memory Database Cluster	2016	SIGMOD
9	10,617	Accelerating Stream Processing Engines via Hardware Offloading	2026	SIGMOD
10	9,675	Providing Resiliency to Load Variations in Distributed Stream Processing	2006	VLDB