Spur: Mitigating Slow Instances in Large-Scale Streaming Pipelines

Summary: A 3500-container streaming pipeline with SLO on tail latency contends with co-tenant load, stalls, and resource delays. Spur detects slow instances with pruning to drive speculative replication, yielding 10–38% p99 gains using 0.5% extra resources. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5902
Venue: SIGMOD
Year: 2020
Pagerank: 4.5568298e-05
Overall Rank: 8,217 | 42.84%
DOI: 10.1145/3318464.3386142

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,373	Hazelcast Jet: Low-latency Stream Processing at the 99.99th Percentile	2021	VLDB	4.7494183e-05
7,655	Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward	2021	VLDB	4.6872456e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
22	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.0008456613
288	Storm @Twitter	2014	SIGMOD	0.00028939871
538	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020678804
824	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.0001623129
1,084	Dhalion: Self-Regulating Stream Processing in Heron	2017	VLDB	0.00014209714
1,098	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014114442
1,548	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011431383
2,338	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.00711e-05
9,501	Dhalion in Action: Automatic Management of Streaming Applications	2018	VLDB	4.3341665e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
9,302	Shrink – Prescribing Resiliency Solutions for Streaming	2017	VLDB	4.3587156e-05
1,226	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00013180799
9,313	Providing Resiliency to Load Variations in Distributed Stream Processing	2006	VLDB	4.3565355e-05
5,675	Staying FIT: Efficient Load Shedding Techniques for Distributed Stream Processing	2007	VLDB	5.3766e-05
6,629	A Holistic View of Stream Partitioning Costs	2017	VLDB	4.9880986e-05
11,011	Intelligent Pooling: Proactive Resource Provisioning in Large-scale Cloud Service	2024	VLDB	4.1945683e-05
5,297	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB	5.5801669e-05
8,596	Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems	2020	SIGMOD	4.4887993e-05
8,150	Parallelism-Optimizing Data Placement for Faster Data-Parallel Computations	2023	VLDB	4.5746638e-05
9,504	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3341665e-05