DBScholar

Back to papers

The Merge/Purge Problem for Large Databases

Summary: Defines the merge/purge problem for large multi-source databases, identifying the same individuals across inconsistent records. Compares sorted-neighborhood blocking and clustering; a multi-pass transitive closure over alternate keys improves accuracy at the cost of efficiency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h0d20773e058ed519
Venue
SIGMOD
Year
1995
Pagerank
0.00039440583
Overall Rank
60 | 99.60%
DOI
10.1145/223784.223807

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{hernandez_sigmod95,
        title = {{The Merge/Purge Problem for Large Databases}},
        author = {Hernández, Mauricio A. and Stolfo, Salvatore J.},
        series = {{SIGMOD} '95},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/223784.223807},
        url = {https://dl.acm.org/doi/10.1145/223784.223807},
        year = {1995}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 56 citing papers.

Rank Citing Paper Year Venue Pagerank
161 Robust and Efficient Fuzzy Match for Online Data Cleaning 2003 SIGMOD 0.00027705594
162 Integration of Heterogeneous Databases Without Common Domains Using Queries Based on Textual Similarity 1998 SIGMOD 0.00027524669
168 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027151132
204 Declarative Data Cleaning: Language, Model, and Algorithms 2001 VLDB 0.00025179068
230 Reference Reconciliation in Complex Information Spaces 2005 SIGMOD 0.00023861741
244 Evaluation of entity resolution approaches on real-world match problems 2010 VLDB 0.00023307564
307 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.00021489374
534 On Active Learning of Record Matching Packages 2010 SIGMOD 0.00016799
587 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00015927027
618 Reasoning about Record Matching Rules 2009 VLDB 0.0001553004
623 Entity Resolution: Theory, Practice & Open Challenges 2012 VLDB 0.00015477107
718 Finding Related Tables 2012 SIGMOD 0.00014526813
736 Automatic segmentation of text into structured records 2001 SIGMOD 0.0001436639
934 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00012998402
1,163 Estimating Alphanumeric Selectivity in the Presence of Wildcards 1996 SIGMOD 0.0001174542
1,249 Entity Matching: How Similar Is Similar 2011 VLDB 0.00011342019
1,307 Entity Resolution with Iterative Blocking 2009 SIGMOD 0.00011078699
1,462 Substring Selectivity Estimation 1999 PODS 0.00010578962
1,581 Example-driven Design of Efficient Record Matching Queries 2007 VLDB 0.0001017553
1,785 Approximate Lineage for Probabilistic Databases 2008 VLDB 9.6438009e-05
1,970 Information-Theoretic Tools for Mining Database Structure from Large Data Sets 2004 SIGMOD 9.2892451e-05
2,111 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB 9.0194027e-05
2,461 Leveraging Aggregate Constraints For Deduplication 2007 SIGMOD 8.4279724e-05
2,555 DogmatiX Tracks down Duplicates in XML 2005 SIGMOD 8.3009957e-05
2,645 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.173459e-05
2,949 Distributed Data Deduplication 2016 VLDB 7.8193962e-05
3,240 Evaluating Entity Resolution Results 2010 VLDB 7.4979039e-05
3,594 Merging the Results of Approximate Match Operations 2004 VLDB 7.180109e-05
3,622 MOMA - A Mapping-based Object Matching System 2007 CIDR 7.1507704e-05
3,787 Entity Resolution with Evolving Rules 2010 VLDB 7.0179617e-05
4,053 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.8253348e-05
4,118 Selectivity Estimation for Fuzzy String Predicates in Large Data Sets 2005 VLDB 6.7927394e-05
4,538 Power-Law Based Estimation of Set Similarity Join Size 2009 VLDB 6.5526273e-05
4,941 Deep Indexed Active Learning for Matching Heterogeneous Entity Representations 2022 VLDB 6.3428387e-05
5,052 BEER: Blocking for Effective Entity Resolution 2021 SIGMOD 6.2949299e-05
5,067 Supervised Meta-blocking 2014 VLDB 6.2877137e-05
5,145 Schema-agnostic vs Schema-based Configurations for Blocking Methods on Homogeneous Data 2016 VLDB 6.2539412e-05
5,199 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 6.2309669e-05
5,324 Object-level Vertical Search 2007 CIDR 6.180179e-05
5,852 Industry-Scale Duplicate Detection 2008 VLDB 5.9691287e-05
5,946 Exploiting Context Analysis for Combining Multiple Entity Resolution Systems 2009 SIGMOD 5.9352297e-05
6,014 Query-Driven Approach to Entity Resolution 2013 VLDB 5.9112242e-05
6,592 Telcordia's Database Reconciliation and Data Quality Analysis Tool 2000 VLDB 5.7399018e-05
6,844 Serving Deep Learning Models with Deduplication from Relational Databases 2022 VLDB 5.6647722e-05
7,228 Certus: An Effective Entity Resolution Approach with Graph Differential Dependencies (GDDs) 2019 VLDB 5.5783924e-05
7,880 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 5.4330096e-05
7,883 Data Cleaning in Microsoft SQL Server 2005 2005 SIGMOD 5.4319595e-05
8,251 Indexing Mixed Types for Approximate Retrieval 2005 VLDB 5.3669582e-05
9,050 Measuring the Structural Similarity of Semistructured Documents Using Entropy 2007 VLDB 5.2293617e-05
9,080 Privacy and Accuracy-Aware AI/ML Model Deduplication 2025 SIGMOD 5.2258409e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
220 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024333068
223 AlphaSort: A RISC Machine Sort 1994 SIGMOD 0.00024120979
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,968 Sampling Dirty Data for Matching Attributes 2010 SIGMOD
2 1,110 New Strategies for Computing the Transitive Closure of a Database Relation 1987 VLDB
3 7,275 An Algorithm For Servicing Multi-Relational Queries 1977 SIGMOD
4 2,845 Progressive Merge Join: A Generic and Non-Blocking Sort-Based Join Algorithm 2002 VLDB
5 1,181 An In-depth Comparison of Subgraph Isomorphism Algorithms in Graph Databases 2013 VLDB
6 2,111 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB
7 75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
8 8,020 Optimization of Multiple-Relation Multiple-Disjunct Queries 1988 PODS
9 6,853 Record Linkage with Uniqueness Constraints and Erroneous Values 2010 VLDB
10 3,594 Merging the Results of Approximate Match Operations 2004 VLDB