Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters

Summary: Proposes Stable Bloom Filter (SBF), a fixed-space bitmap-sketch for approximate duplicate detection in streams by evicting stale entries. Analytical FPR bound is tight; experiments show SBF outperforms baselines in accuracy and speed at small space. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hc40763bee777d8be
Venue: SIGMOD
Year: 2006
Pagerank: 7.2088273e-05
Overall Rank: 3,547 | 76.17%
DOI: 10.1145/1142473.1142477

Incoming Non-self Citations Over Time

Authors

1. Fan Deng (University of Alberta)
2. Davood Rafiei (University of Alberta)

BibTeX Citation

@inproceedings{deng_sigmod06,
        title = {{Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters}},
        author = {Deng, Fan and Rafiei, Davood},
        series = {{SIGMOD} '06},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1142473.1142477},
        url = {https://dl.acm.org/doi/10.1145/1142473.1142477},
        year = {2006}
}

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,846	Morton Filters: Faster, Space-Efficient Cuckoo Filters via Biasing, Compression, and Decoupled Logical Sparsity	2018	VLDB	9.511501e-05
3,701	Stable Learned Bloom Filters for Data Streams	2020	VLDB	7.0820503e-05
4,627	Stacked Filters: Learning to Filter by Structure	2021	VLDB	6.4939164e-05
7,186	Building Fast and Compact Sketches for Approximately Multi-Set Multi-Membership Querying	2021	SIGMOD	5.5886598e-05
8,145	Streaming Quotient Filter: A Near Optimal Approximate Duplicate Detection Approach for Data Streams	2013	VLDB	5.3897281e-05
11,743	A Learned Cuckoo Filter for Approximate Membership Queries over Variable-sized Sliding Windows on Data Streams	2023	SIGMOD	4.9769913e-05
12,447	Tracking the Conductance of Rapidly Evolving Topic-Subgraphs	2015	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00053906051
26	Models and Issues in Data Stream Systems	2002	PODS	0.00052097907
112	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032445088
124	Approximate Frequency Counts over Data Streams	2002	VLDB	0.00030586757
171	Monitoring Streams – A New Class of Data Management Applications	2002	VLDB	0.00026999348
240	Gigascope: A Stream Database for Network Applications	2003	SIGMOD	0.00023425462
307	Eliminating Fuzzy Duplicates in Data Warehouses	2002	VLDB	0.00021489374
677	Load Shedding in a Data Stream Manager	2003	VLDB	0.0001484703
872	Spectral Bloom Filters	2003	SIGMOD	0.00013338
2,555	DogmatiX Tracks down Duplicates in XML	2005	SIGMOD	8.3009957e-05
2,659	Maintaining Time-Decaying Stream Aggregates	2003	PODS	8.1581032e-05
3,212	Comparing Data Streams Using Hamming Norms (How to Zero In)	2002	VLDB	7.5324957e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,490	Approximately Counting Triangles in Large Graph Streams Including Edge Duplicates with a Fixed Memory Usage	2018	VLDB
2	911	Finding Frequent Items in Data Streams	2008	VLDB
3	6,938	A Shifting Bloom Filter Framework for Set Queries	2016	VLDB
4	12,335	Streaming Algorithms for Robust Distinct Elements	2016	SIGMOD
5	4,627	Stacked Filters: Learning to Filter by Structure	2021	VLDB
6	5,096	Persistent Bloom Filter: Membership Testing for the Entire History	2018	SIGMOD
7	12,203	Distinct Sampling on Streaming Data with Near-Duplicates	2018	PODS
8	872	Spectral Bloom Filters	2003	SIGMOD
9	3,701	Stable Learned Bloom Filters for Data Streams	2020	VLDB
10	8,145	Streaming Quotient Filter: A Near Optimal Approximate Duplicate Detection Approach for Data Streams	2013	VLDB