DBScholar

Back to papers

The Merge/Purge Problem for Large Databases

Summary: Defines the merge/purge problem for large multi-source databases, identifying the same individuals across inconsistent records. Compares sorted-neighborhood blocking and clustering; a multi-pass transitive closure over alternate keys improves accuracy at the cost of efficiency. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
2856
Venue
SIGMOD
Year
1995
Pagerank
0.00040116748
Overall Rank
58 | 99.61%
DOI
10.1145/223784.223807

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{hernandez_sigmod95,
        title = {{The Merge/Purge Problem for Large Databases}},
        author = {Hernández, Mauricio A. and Stolfo, Salvatore J.},
        series = {{SIGMOD} '95},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/223784.223807},
        url = {https://dl.acm.org/doi/10.1145/223784.223807},
        year = {1995}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 56 citing papers.

Rank Citing Paper Year Venue Pagerank
158 Robust and Efficient Fuzzy Match for Online Data Cleaning 2003 SIGMOD 0.00028199923
160 Integration of Heterogeneous Databases Without Common Domains Using Queries Based on Textual Similarity 1998 SIGMOD 0.0002802209
169 Efficient Exact Set-Similarity Joins 2006 VLDB 0.0002743469
201 Declarative Data Cleaning: Language, Model, and Algorithms 2001 VLDB 0.00025558602
228 Reference Reconciliation in Complex Information Spaces 2005 SIGMOD 0.00023941271
248 Evaluation of entity resolution approaches on real-world match problems 2010 VLDB 0.00023278354
306 Eliminating Fuzzy Duplicates in Data Warehouses 2002 VLDB 0.00021839661
528 On Active Learning of Record Matching Packages 2010 SIGMOD 0.00017100838
574 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00016278855
619 Reasoning about Record Matching Rules 2009 VLDB 0.00015707247
626 Entity Resolution: Theory, Practice & Open Challenges 2012 VLDB 0.00015656958
717 Automatic segmentation of text into structured records 2001 SIGMOD 0.00014649121
739 Finding Related Tables 2012 SIGMOD 0.0001448231
933 Question Selection for Crowd Entity Resolution 2013 VLDB 0.00013111293
1,140 Estimating Alphanumeric Selectivity in the Presence of Wildcards 1996 SIGMOD 0.0001200574
1,248 Entity Matching: How Similar Is Similar 2011 VLDB 0.00011498301
1,293 Entity Resolution with Iterative Blocking 2009 SIGMOD 0.00011292804
1,427 Substring Selectivity Estimation 1999 PODS 0.00010812749
1,560 Example-driven Design of Efficient Record Matching Queries 2007 VLDB 0.00010361222
1,752 Approximate Lineage for Probabilistic Databases 2008 VLDB 9.8358116e-05
1,913 Information-Theoretic Tools for Mining Database Structure from Large Data Sets 2004 SIGMOD 9.4928569e-05
2,120 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB 9.1406654e-05
2,410 Leveraging Aggregate Constraints For Deduplication 2007 SIGMOD 8.6126774e-05
2,531 DogmatiX Tracks down Duplicates in XML 2005 SIGMOD 8.4574631e-05
2,711 Progressive Approach to Relational Entity Resolution 2014 VLDB 8.2178865e-05
2,893 Distributed Data Deduplication 2016 VLDB 7.983961e-05
3,184 Evaluating Entity Resolution Results 2010 VLDB 7.6575598e-05
3,568 MOMA - A Mapping-based Object Matching System 2007 CIDR 7.3021209e-05
3,610 Merging the Results of Approximate Match Operations 2004 VLDB 7.2593873e-05
3,732 Entity Resolution with Evolving Rules 2010 VLDB 7.1655038e-05
3,983 Crowd-Based Deduplication: An Adaptive Approach 2015 SIGMOD 6.9739851e-05
4,035 Selectivity Estimation for Fuzzy String Predicates in Large Data Sets 2005 VLDB 6.9439151e-05
4,450 Power-Law Based Estimation of Set Similarity Join Size 2009 VLDB 6.6972929e-05
4,824 Deep Indexed Active Learning for Matching Heterogeneous Entity Representations 2022 VLDB 6.4914944e-05
4,938 Supervised Meta-blocking 2014 VLDB 6.4338718e-05
4,940 BEER: Blocking for Effective Entity Resolution 2021 SIGMOD 6.4336209e-05
5,018 Schema-agnostic vs Schema-based Configurations for Blocking Methods on Homogeneous Data 2016 VLDB 6.3993079e-05
5,204 QuERy: A Framework for Integrating Entity Resolution with Query Processing 2016 VLDB 6.3187983e-05
5,235 Object-level Vertical Search 2007 CIDR 6.3047329e-05
5,754 Industry-Scale Duplicate Detection 2008 VLDB 6.0977946e-05
5,830 Exploiting Context Analysis for Combining Multiple Entity Resolution Systems 2009 SIGMOD 6.0734178e-05
5,972 Query-Driven Approach to Entity Resolution 2013 VLDB 6.0237003e-05
6,474 Telcordia's Database Reconciliation and Data Quality Analysis Tool 2000 VLDB 5.8697885e-05
6,708 Serving Deep Learning Models with Deduplication from Relational Databases 2022 VLDB 5.7964983e-05
7,083 Certus: An Effective Entity Resolution Approach with Graph Differential Dependencies (GDDs) 2019 VLDB 5.7075402e-05
7,719 Data Cleaning in Microsoft SQL Server 2005 2005 SIGMOD 5.55926e-05
7,880 Learning Over Dirty Data Without Cleaning 2020 SIGMOD 5.5244204e-05
8,078 Indexing Mixed Types for Approximate Retrieval 2005 VLDB 5.492543e-05
8,882 Measuring the Structural Similarity of Semistructured Documents Using Entropy 2007 VLDB 5.3516704e-05
8,908 Privacy and Accuracy-Aware AI/ML Model Deduplication 2025 SIGMOD 5.3483178e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
210 An Evaluation of Non-Equijoin Algorithms 1991 VLDB 0.00024797689
215 AlphaSort: A RISC Machine Sort 1994 SIGMOD 0.00024507963
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,086 New Strategies for Computing the Transitive Closure of a Database Relation 1987 VLDB
2 6,827 Sampling Dirty Data for Matching Attributes 2010 SIGMOD
3 7,120 An Algorithm For Servicing Multi-Relational Queries 1977 SIGMOD
4 2,787 Progressive Merge Join: A Generic and Non-Blocking Sort-Based Join Algorithm 2002 VLDB
5 1,181 An In-depth Comparison of Subgraph Isomorphism Algorithms in Graph Databases 2013 VLDB
6 2,120 Comparative Analysis of Approximate Blocking Techniques for Entity Resolution 2016 VLDB
7 72 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD
8 7,858 Optimization of Multiple-Relation Multiple-Disjunct Queries 1988 PODS
9 6,723 Record Linkage with Uniqueness Constraints and Erroneous Values 2010 VLDB
10 3,610 Merging the Results of Approximate Match Operations 2004 VLDB