Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters

Summary: Proposes Stable Bloom Filter (SBF), a fixed-space bitmap-sketch for approximate duplicate detection in streams by evicting stale entries. Analytical FPR bound is tight; experiments show SBF outperforms baselines in accuracy and speed at small space. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 3799
Venue: SIGMOD
Year: 2006
Pagerank: 7.3366144e-05
Overall Rank: 3,533 | 75.77%
DOI: 10.1145/1142473.1142477

Incoming Non-self Citations Over Time

Authors

1. Fan Deng (University of Alberta)
2. Davood Rafiei (University of Alberta)

BibTeX Citation

@inproceedings{deng_sigmod06,
        title = {{Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters}},
        author = {Deng, Fan and Rafiei, Davood},
        series = {{SIGMOD} '06},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1142473.1142477},
        url = {https://dl.acm.org/doi/10.1145/1142473.1142477},
        year = {2006}
}

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,975	Morton Filters: Faster, Space-Efficient Cuckoo Filters via Biasing, Compression, and Decoupled Logical Sparsity	2018	VLDB	9.3645236e-05
4,073	Stable Learned Bloom Filters for Data Streams	2020	VLDB	6.9242783e-05
4,532	Stacked Filters: Learning to Filter by Structure	2021	VLDB	6.6436681e-05
8,020	Streaming Quotient Filter: A Near Optimal Approximate Duplicate Detection Approach for Data Streams	2013	VLDB	5.5059287e-05
8,612	Building Fast and Compact Sketches for Approximately Multi-Set Multi-Membership Querying	2021	SIGMOD	5.4012878e-05
11,423	A Learned Cuckoo Filter for Approximate Membership Queries over Variable-sized Sliding Windows on Data Streams	2023	SIGMOD	5.093636e-05
12,149	Tracking the Conductance of Rapidly Evolving Topic-Subgraphs	2015	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00054667018
26	Models and Issues in Data Stream Systems	2002	PODS	0.00052982574
111	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032990214
122	Approximate Frequency Counts over Data Streams	2002	VLDB	0.00031260115
167	Monitoring Streams – A New Class of Data Management Applications	2002	VLDB	0.0002757283
230	Gigascope: A Stream Database for Network Applications	2003	SIGMOD	0.00023891474
306	Eliminating Fuzzy Duplicates in Data Warehouses	2002	VLDB	0.00021839661
671	Load Shedding in a Data Stream Manager	2003	VLDB	0.00015154516
862	Spectral Bloom Filters	2003	SIGMOD	0.00013532857
2,531	DogmatiX Tracks down Duplicates in XML	2005	SIGMOD	8.4574631e-05
2,610	Maintaining Time-Decaying Stream Aggregates	2003	PODS	8.347507e-05
3,150	Comparing Data Streams Using Hamming Norms (How to Zero In)	2002	VLDB	7.7055991e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,500	Approximately Counting Triangles in Large Graph Streams Including Edge Duplicates with a Fixed Memory Usage	2018	VLDB
2	885	Finding Frequent Items in Data Streams	2008	VLDB
3	8,408	A Shifting Bloom Filter Framework for Set Queries	2016	VLDB
4	12,034	Streaming Algorithms for Robust Distinct Elements	2016	SIGMOD
5	4,532	Stacked Filters: Learning to Filter by Structure	2021	VLDB
6	4,971	Persistent Bloom Filter: Membership Testing for the Entire History	2018	SIGMOD
7	11,897	Distinct Sampling on Streaming Data with Near-Duplicates	2018	PODS
8	862	Spectral Bloom Filters	2003	SIGMOD
9	4,073	Stable Learned Bloom Filters for Data Streams	2020	VLDB
10	8,020	Streaming Quotient Filter: A Near Optimal Approximate Duplicate Detection Approach for Data Streams	2013	VLDB