DBScholar

Back to papers

The Merge/Purge Problem for Large Databases

Summary: Defines the merge/purge problem for large multi-source databases, identifying the same individuals across inconsistent records. Compares sorted-neighborhood blocking and clustering; a multi-pass transitive closure over alternate keys improves accuracy at the cost of efficiency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h0d20773e058ed519
Venue
SIGMOD
Year
1995
Pagerank
0.000394583
Overall Rank
60 | 99.60%
DOI
10.1145/223784.223807

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{hernandez_sigmod95,
        title = {{The Merge/Purge Problem for Large Databases}},
        author = {Hernández, Mauricio A. and Stolfo, Salvatore J.},
        series = {{SIGMOD} '95},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/223784.223807},
        url = {https://dl.acm.org/doi/10.1145/223784.223807},
        year = {1995}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 56 citing papers.

Rank Citing Paper Year Venue Pagerank
161 Robust and Efficient Fuzzy Match for Online Data Cleaning 2003 SIGMOD 0.00027718195
162 Integration of Heterogeneous Databases Without Common Domains Using Queries Based on Textual Similarity 1998 SIGMOD 0.00027536748
168 Efficient Exact Set-Similarity Joins 2006 VLDB 0.00027163517
204 Declarative Data Cleaning: Language, Model, and Algorithms 2001 VLDB 0.00025190386
230 Reference Reconciliation in Complex Information Spaces 2005 SIGMOD 0.00023871933
244 Evaluation of entity resolution approaches on real-world match problems 2010 VLDB 0.00023314591
307 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.00021499031
534 On Active Learning of Record Matching Packages 2010 SIGMOD 0.0001680637
587 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00015933201
618 Reasoning about Record Matching Rules 2009 VLDB 0.00015536912
623 Entity Resolution: Theory, Practice & Open Challenges 2012 VLDB 0.00015483844
717 Finding Related Tables 2012 SIGMOD 0.00014532116
735 Automatic segmentation of text into structured records 2001 SIGMOD 0.00014373044
933 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00013004422
1,163 Estimating Alphanumeric Selectivity in the Presence of Wildcards 1996 SIGMOD 0.00011750813
1,247 Entity Matching: How Similar Is Similar 2011 VLDB 0.00011346515
1,307 Entity Resolution with Iterative Blocking 2009 SIGMOD 0.000110838
1,461 Substring Selectivity Estimation 1999 PODS 0.00010583833
1,581 Example-driven Design of Efficient Record Matching Queries 2007 VLDB 0.00010180038
1,785 Approximate Lineage for Probabilistic Databases 2008 VLDB 9.6482655e-05
1,969 Information-Theoretic Tools for Mining Database Structure from Large Data Sets 2004 SIGMOD 9.2935435e-05
2,110 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB 9.0233278e-05
2,461 Leveraging Aggregate Constraints For Deduplication 2007 SIGMOD 8.4319356e-05
2,555 DogmatiX Tracks down Duplicates in XML 2005 SIGMOD 8.3046884e-05
2,645 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.177221e-05
2,948 Distributed Data Deduplication 2016 VLDB 7.8230494e-05
3,238 Evaluating Entity Resolution Results 2010 VLDB 7.5014275e-05
3,593 Merging the Results of Approximate Match Operations 2004 VLDB 7.183446e-05
3,621 MOMA - A Mapping-based Object Matching System 2007 CIDR 7.1539025e-05
3,785 Entity Resolution with Evolving Rules 2010 VLDB 7.0212807e-05
4,051 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.8285415e-05
4,117 Selectivity Estimation for Fuzzy String Predicates in Large Data Sets 2005 VLDB 6.7958711e-05
4,536 Power-Law Based Estimation of Set Similarity Join Size 2009 VLDB 6.5557137e-05
4,939 Deep Indexed Active Learning for Matching Heterogeneous Entity Representations 2022 VLDB 6.3458427e-05
5,049 BEER: Blocking for Effective Entity Resolution 2021 SIGMOD 6.297901e-05
5,064 Supervised Meta-blocking 2014 VLDB 6.2906903e-05
5,143 Schema-agnostic vs Schema-based Configurations for Blocking Methods on Homogeneous Data 2016 VLDB 6.2569019e-05
5,198 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 6.2338998e-05
5,319 Object-level Vertical Search 2007 CIDR 6.182759e-05
5,849 Industry-Scale Duplicate Detection 2008 VLDB 5.9719289e-05
5,946 Exploiting Context Analysis for Combining Multiple Entity Resolution Systems 2009 SIGMOD 5.9379643e-05
6,014 Query-Driven Approach to Entity Resolution 2013 VLDB 5.9140238e-05
6,590 Telcordia's Database Reconciliation and Data Quality Analysis Tool 2000 VLDB 5.7425968e-05
6,844 Serving Deep Learning Models with Deduplication from Relational Databases 2022 VLDB 5.6664512e-05
7,226 Certus: An Effective Entity Resolution Approach with Graph Differential Dependencies (GDDs) 2019 VLDB 5.5810344e-05
7,875 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 5.4355826e-05
7,878 Data Cleaning in Microsoft SQL Server 2005 2005 SIGMOD 5.4345321e-05
8,245 Indexing Mixed Types for Approximate Retrieval 2005 VLDB 5.3694945e-05
9,042 Measuring the Structural Similarity of Semistructured Documents Using Entropy 2007 VLDB 5.2318346e-05
9,071 Privacy and Accuracy-Aware AI/ML Model Deduplication 2025 SIGMOD 5.2283159e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
220 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024344086
223 AlphaSort: A RISC Machine Sort 1994 SIGMOD 0.0002412513
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,110 New Strategies for Computing the Transitive Closure of a Database Relation 1987 VLDB
2 6,967 Sampling Dirty Data for Matching Attributes 2010 SIGMOD
3 7,272 An Algorithm For Servicing Multi-Relational Queries 1977 SIGMOD
4 2,845 Progressive Merge Join: A Generic and Non-Blocking Sort-Based Join Algorithm 2002 VLDB
5 1,181 An In-depth Comparison of Subgraph Isomorphism Algorithms in Graph Databases 2013 VLDB
6 2,110 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB
7 75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
8 8,015 Optimization of Multiple-Relation Multiple-Disjunct Queries 1988 PODS
9 6,849 Record Linkage with Uniqueness Constraints and Erroneous Values 2010 VLDB
10 3,593 Merging the Results of Approximate Match Operations 2004 VLDB