Back to papers
How do Categorical Duplicates Affect ML? A New Benchmark and Empirical Analyses
Summary: First systematic empirical study of categorical duplicates (e.g., "CA" vs "California") on ML classification: labeled corpus of 1,262 categorical columns and a 16-dataset benchmark across five classifiers and five encoders. Finds logistic regression and similarity encoding robust to duplicates while one-hot with high-capacity models degrade; provides benchmarks and actionable takeaways for AutoML and data-prep.
(summarized by gpt-5-mini on Feb 09 2026)
- Paper ID
- 13384
- Venue
- VLDB
- Year
- 2024
- Pagerank
- 5.0109216e-05
- Overall Rank
- 6,552 | 54.47%
- DOI
-
10.14778/3648160.3648178
Incoming Non-self Citations Over Time
Incoming Citations (Sorted by Pagerank)
Showing 2 of 2 citing papers.
Outgoing Citations (Sorted by Pagerank)
Showing 19 of 19 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 192 |
HoloClean: Holistic Data Repairs with Probabilistic Inference |
2017 |
VLDB |
0.00035692958 |
| 219 |
Deep Entity Matching with Pre-Trained Language Models |
2021 |
VLDB |
0.00033354456 |
| 293 |
Deep Learning for Entity Matching: A Design Space Exploration |
2018 |
SIGMOD |
0.00028661817 |
| 516 |
Can Foundation Models Wrangle Your Data? |
2023 |
VLDB |
0.00021194444 |
| 705 |
Magellan: Toward Building Entity Matching Management Systems |
2016 |
VLDB |
0.00017779048 |
| 1,629 |
Data Cleaning: Overview and Emerging Challenges |
2016 |
SIGMOD |
0.00011073148 |
| 1,821 |
Synthesizing Entity Matching Rules by Examples |
2018 |
VLDB |
0.00010406856 |
| 2,348 |
RPT: Relational Pre-trained Transformer Is Almost All You Need towards Democratizing Data Preparation |
2021 |
VLDB |
8.9903659e-05 |
| 2,758 |
A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching |
2020 |
SIGMOD |
8.1668285e-05 |
| 3,057 |
ZeroER: Entity Resolution using Zero Labeled Examples |
2020 |
SIGMOD |
7.6458287e-05 |
| 3,483 |
Transform-Data-by-Example (TDE): An Extensible Search Engine for Data Transformations |
2018 |
VLDB |
7.0493668e-05 |
| 3,854 |
Generating Concise Entity Matching Rules |
2017 |
SIGMOD |
6.697423e-05 |
| 4,211 |
Unicorn: A Unified Multi-tasking Model for Supporting Matching Tasks in Data Integration |
2023 |
SIGMOD |
6.3495931e-05 |
| 4,397 |
Smurf: Self-Service String Matching Using Random Forests |
2019 |
VLDB |
6.2142485e-05 |
| 5,244 |
Towards Benchmarking Feature Type Inference for AutoML Platforms |
2021 |
SIGMOD |
5.6021738e-05 |
| 5,388 |
Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples |
2021 |
SIGMOD |
5.5342724e-05 |
| 5,930 |
ActiveClean: An Interactive Data Cleaning Framework For Modern Machine Learning |
2016 |
SIGMOD |
5.2632185e-05 |
| 5,984 |
DataPrep.EDA: Task-Centric Exploratory Data Analysis for Statistical Modeling in Python |
2021 |
SIGMOD |
5.2400405e-05 |
| 7,818 |
Foofah: A Programming-By-Example System for Synthesizing Data Transformation Programs |
2017 |
SIGMOD |
4.6398687e-05 |
Semantically Similar Papers