Pandora: An Efficient and Rapid Solution for Persistence-Based Tasks in High-Speed Data Streams

Summary: Pandora offers an approximate data structure for persistence-based tasks in high-speed streams, enabling fast persistence detection and estimation under tight memory. It evicts long-absent items to protect persistent ones, provides formal error bounds, SIMD-accelerated updates, and outperforms state-of-the-art on trace-driven data; open-source. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 7116
Venue: SIGMOD
Year: 2025
Pagerank: 5.093636e-05
Overall Rank: 10,673 | 26.78%
DOI: 10.1145/3709711

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Weihe Li (University of Edinburgh)

BibTeX Citation

@inproceedings{li_sigmod25,
        title = {{Pandora: An Efficient and Rapid Solution for Persistence-Based Tasks in High-Speed Data Streams}},
        author = {Li, Weihe},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3709711},
        url = {https://dl.acm.org/doi/10.1145/3709711},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1,905	Cold Filter: A Meta-Framework for Faster and More Accurate Stream Processing	2018	SIGMOD	9.5034849e-05
2,878	Data Sketches for Disaggregated Subset Sum and Frequent Item Estimation	2018	SIGMOD	8.0058242e-05
3,898	BurstSketch: Finding Bursts in Data Streams	2021	SIGMOD	7.0367583e-05
4,863	Pyramid Sketch: a Sketch Framework for Frequency Estimation of Data Streams	2017	VLDB	6.4740702e-05
4,898	Finding Persistent Items in Data Streams	2017	VLDB	6.454197e-05
6,685	Out of Many We are One: Measuring Item Batch with Clock-Sketch	2021	SIGMOD	5.8034001e-05
7,036	On-Off Sketch: A Fast and Accurate Sketch on Persistence	2021	VLDB	5.7212447e-05
7,091	Simple & Optimal Quantile Sketch: Combining Greenwald-Khanna with Khanna-Greenwald	2024	PODS	5.7062634e-05
7,110	PR-Sketch: Monitoring Per-key Aggregation of Streaming Data with Nearly Full Accuracy	2021	VLDB	5.7000212e-05
7,860	LadderFilter: Filtering Infrequent Items with Small Memory and Time Overhead	2023	SIGMOD	5.5302333e-05
8,851	Memory-Efficient and Flexible Detection of Heavy Hitters in High-Speed Networks	2023	SIGMOD	5.357707e-05
9,386	Determining Exact Quantiles with Randomized Summaries	2024	SIGMOD	5.2755515e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,385	Randomized Error Removal for Online Spread Estimation in Data Streaming	2021	VLDB
2	3,533	Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters	2006	SIGMOD
3	12,025	Anti-Persistence on Persistent Storage: History-Independent Sparse Tables and Dictionaries	2016	PODS
4	7,695	A Shared Execution Strategy for Multiple Pattern Mining Requests over Streaming Data	2009	VLDB
5	5,335	Clustering Stream Data by Exploring the Evolution of Density Mountain	2018	VLDB
6	7,110	PR-Sketch: Monitoring Per-key Aggregation of Streaming Data with Nearly Full Accuracy	2021	VLDB
7	2,716	Space- and Time-Efficient Deterministic Algorithms for Biased Quantiles over Data Streams	2006	PODS
8	7,036	On-Off Sketch: A Fast and Accurate Sketch on Persistence	2021	VLDB
9	9,329	Panakos: Chasing the Tails for Multidimensional Data Streams	2023	VLDB
10	3,023	Persistent Data Sketching	2015	SIGMOD