DBScholar

Back to papers

The Merge/Purge Problem for Large Databases

Summary: Defines the merge/purge problem for large multi-source databases, identifying the same individuals across inconsistent records. Compares sorted-neighborhood blocking and clustering; a multi-pass transitive closure over alternate keys improves accuracy at the cost of efficiency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h0d20773e058ed519
Venue
SIGMOD
Year
1995
Pagerank
0.00039343755
Overall Rank
60 | 99.60%
DOI
10.1145/223784.223807

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{hernandez_sigmod95,
        title = {{The Merge/Purge Problem for Large Databases}},
        author = {Hernández, Mauricio A. and Stolfo, Salvatore J.},
        series = {{SIGMOD} '95},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/223784.223807},
        url = {https://dl.acm.org/doi/10.1145/223784.223807},
        year = {1995}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 56 citing papers.

Rank Citing Paper Year Venue Pagerank
162 Robust and Efficient Fuzzy Match for Online Data Cleaning 2003 SIGMOD 0.00027626077
164 Integration of Heterogeneous Databases Without Common Domains Using Queries Based on Textual Similarity 1998 SIGMOD 0.00027451323
169 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027077763
206 Declarative Data Cleaning: Language, Model, and Algorithms 2001 VLDB 0.00025121652
231 Reference Reconciliation in Complex Information Spaces 2005 SIGMOD 0.00023797615
244 Evaluation of entity resolution approaches on real-world match problems 2010 VLDB 0.00023265795
308 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.0002143466
535 On Active Learning of Record Matching Packages 2010 SIGMOD 0.00016768308
590 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00015876538
619 Reasoning about Record Matching Rules 2009 VLDB 0.00015503747
621 Entity Resolution: Theory, Practice & Open Challenges 2012 VLDB 0.00015460277
705 Finding Related Tables 2012 SIGMOD 0.00014626858
737 Automatic segmentation of text into structured records 2001 SIGMOD 0.00014327386
932 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00012981731
1,164 Estimating Alphanumeric Selectivity in the Presence of Wildcards 1996 SIGMOD 0.0001170903
1,251 Entity Matching: How Similar Is Similar 2011 VLDB 0.0001132553
1,309 Entity Resolution with Iterative Blocking 2009 SIGMOD 0.00011068452
1,466 Substring Selectivity Estimation 1999 PODS 0.00010546176
1,582 Example-driven Design of Efficient Record Matching Queries 2007 VLDB 0.0001015019
1,795 Approximate Lineage for Probabilistic Databases 2008 VLDB 9.6147575e-05
1,979 Information-Theoretic Tools for Mining Database Structure from Large Data Sets 2004 SIGMOD 9.2615384e-05
2,120 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB 8.9985078e-05
2,469 Leveraging Aggregate Constraints For Deduplication 2007 SIGMOD 8.401808e-05
2,558 DogmatiX Tracks down Duplicates in XML 2005 SIGMOD 8.2766441e-05
2,641 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.1723025e-05
2,954 Distributed Data Deduplication 2016 VLDB 7.8045942e-05
3,253 Evaluating Entity Resolution Results 2010 VLDB 7.4750552e-05
3,596 Merging the Results of Approximate Match Operations 2004 VLDB 7.1625707e-05
3,631 MOMA - A Mapping-based Object Matching System 2007 CIDR 7.1281012e-05
3,795 Entity Resolution with Evolving Rules 2010 VLDB 6.9962459e-05
4,074 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.8062505e-05
4,138 Selectivity Estimation for Fuzzy String Predicates in Large Data Sets 2005 VLDB 6.7706361e-05
4,551 Power-Law Based Estimation of Set Similarity Join Size 2009 VLDB 6.5314641e-05
4,948 Deep Indexed Active Learning for Matching Heterogeneous Entity Representations 2022 VLDB 6.3276067e-05
5,070 BEER: Blocking for Effective Entity Resolution 2021 SIGMOD 6.2760011e-05
5,085 Supervised Meta-blocking 2014 VLDB 6.2672402e-05
5,167 Schema-agnostic vs Schema-based Configurations for Blocking Methods on Homogeneous Data 2016 VLDB 6.2335794e-05
5,206 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 6.2160113e-05
5,333 Object-level Vertical Search 2007 CIDR 6.1620895e-05
5,859 Industry-Scale Duplicate Detection 2008 VLDB 5.9508297e-05
5,961 Exploiting Context Analysis for Combining Multiple Entity Resolution Systems 2009 SIGMOD 5.9157271e-05
6,026 Query-Driven Approach to Entity Resolution 2013 VLDB 5.891678e-05
6,596 Telcordia's Database Reconciliation and Data Quality Analysis Tool 2000 VLDB 5.7220924e-05
6,861 Serving Deep Learning Models with Deduplication from Relational Databases 2022 VLDB 5.6460409e-05
7,244 Certus: An Effective Entity Resolution Approach with Graph Differential Dependencies (GDDs) 2019 VLDB 5.5606514e-05
7,884 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 5.4169982e-05
7,900 Data Cleaning in Microsoft SQL Server 2005 2005 SIGMOD 5.4139981e-05
8,267 Indexing Mixed Types for Approximate Retrieval 2005 VLDB 5.3492332e-05
9,070 Measuring the Structural Similarity of Semistructured Documents Using Entropy 2007 VLDB 5.2121357e-05
9,101 Privacy and Accuracy-Aware AI/ML Model Deduplication 2025 SIGMOD 5.208561e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
220 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024275691
223 AlphaSort: A RISC Machine Sort 1994 SIGMOD 0.00024059196
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,988 Sampling Dirty Data for Matching Attributes 2010 SIGMOD
2 1,112 New Strategies for Computing the Transitive Closure of a Database Relation 1987 VLDB
3 7,294 An Algorithm For Servicing Multi-Relational Queries 1977 SIGMOD
4 2,853 Progressive Merge Join: A Generic and Non-Blocking Sort-Based Join Algorithm 2002 VLDB
5 1,180 An In-depth Comparison of Subgraph Isomorphism Algorithms in Graph Databases 2013 VLDB
6 2,120 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB
7 76 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
8 8,036 Optimization of Multiple-Relation Multiple-Disjunct Queries 1988 PODS
9 6,869 Record Linkage with Uniqueness Constraints and Erroneous Values 2010 VLDB
10 3,596 Merging the Results of Approximate Match Operations 2004 VLDB