Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters

Summary: Proposes Stable Bloom Filter (SBF), a fixed-space bitmap-sketch for approximate duplicate detection in streams by evicting stale entries. Analytical FPR bound is tight; experiments show SBF outperforms baselines in accuracy and speed at small space. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hc40763bee777d8be
Venue: SIGMOD
Year: 2006
Pagerank: 7.1850048e-05
Overall Rank: 3,559 | 76.15%
DOI: 10.1145/1142473.1142477

Incoming Non-self Citations Over Time

Authors

1. Fan Deng (University of Alberta)
2. Davood Rafiei (University of Alberta)

BibTeX Citation

@inproceedings{deng_sigmod06,
        title = {{Approximately Detecting Duplicates for Streaming Data using Stable Bloom Filters}},
        author = {Deng, Fan and Rafiei, Davood},
        series = {{SIGMOD} '06},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1142473.1142477},
        url = {https://dl.acm.org/doi/10.1145/1142473.1142477},
        year = {2006}
}

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,856	Morton Filters: Faster, Space-Efficient Cuckoo Filters via Biasing, Compression, and Decoupled Logical Sparsity	2018	VLDB	9.4802321e-05
3,709	Stable Learned Bloom Filters for Data Streams	2020	VLDB	7.0586477e-05
4,646	Stacked Filters: Learning to Filter by Structure	2021	VLDB	6.4725846e-05
7,208	Building Fast and Compact Sketches for Approximately Multi-Set Multi-Membership Querying	2021	SIGMOD	5.5701802e-05
8,162	Streaming Quotient Filter: A Near Optimal Approximate Duplicate Detection Approach for Data Streams	2013	VLDB	5.3719068e-05
11,787	A Learned Cuckoo Filter for Approximate Membership Queries over Variable-sized Sliding Windows on Data Streams	2023	SIGMOD	4.9605343e-05
12,490	Tracking the Conductance of Rapidly Evolving Topic-Subgraphs	2015	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00053734242
26	Models and Issues in Data Stream Systems	2002	PODS	0.00051942573
112	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032341214
124	Approximate Frequency Counts over Data Streams	2002	VLDB	0.00030503973
173	Monitoring Streams – A New Class of Data Management Applications	2002	VLDB	0.0002691472
240	Gigascope: A Stream Database for Network Applications	2003	SIGMOD	0.00023371986
308	Eliminating Fuzzy Duplicates in Data Warehouses	2002	VLDB	0.0002143466
680	Load Shedding in a Data Stream Manager	2003	VLDB	0.00014799878
874	Spectral Bloom Filters	2003	SIGMOD	0.00013298839
2,558	DogmatiX Tracks down Duplicates in XML	2005	SIGMOD	8.2766441e-05
2,670	Maintaining Time-Decaying Stream Aggregates	2003	PODS	8.131182e-05
3,219	Comparing Data Streams Using Hamming Norms (How to Zero In)	2002	VLDB	7.50928e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,511	Approximately Counting Triangles in Large Graph Streams Including Edge Duplicates with a Fixed Memory Usage	2018	VLDB
2	911	Finding Frequent Items in Data Streams	2008	VLDB
3	6,958	A Shifting Bloom Filter Framework for Set Queries	2016	VLDB
4	12,378	Streaming Algorithms for Robust Distinct Elements	2016	SIGMOD
5	4,646	Stacked Filters: Learning to Filter by Structure	2021	VLDB
6	5,119	Persistent Bloom Filter: Membership Testing for the Entire History	2018	SIGMOD
7	12,246	Distinct Sampling on Streaming Data with Near-Duplicates	2018	PODS
8	874	Spectral Bloom Filters	2003	SIGMOD
9	3,709	Stable Learned Bloom Filters for Data Streams	2020	VLDB
10	8,162	Streaming Quotient Filter: A Near Optimal Approximate Duplicate Detection Approach for Data Streams	2013	VLDB