Dedoop: Efficient Deduplication with Hadoop

Summary: Dedoop offers browser-based specification of complex ER workflows (blocking, similarity functions, ML-generated classifiers) for MapReduce-based deduplication on Hadoop. It auto-translates workflows into MapReduce jobs, visualizes results and workload, and uses blocking-aware load balancing to minimize comparisons and balance cluster usage. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10425
Venue: VLDB
Year: 2012
Pagerank: 9.2304499e-05
Overall Rank: 2,231 | 84.49%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 14 of 14 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
712	Magellan: Toward Building Entity Matching Management Systems	2016	VLDB	0.00017732426
1,627	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011086905
2,946	BigDansing: A System for Big Data Cleansing	2015	SIGMOD	7.8372441e-05
3,528	Distributed Data Deduplication	2016	VLDB	7.0066139e-05
3,582	NADEEF/ER: Generic and Interactive Entity Resolution	2014	SIGMOD	6.9479263e-05
3,694	Keys for Graphs	2015	VLDB	6.8345712e-05
6,099	WOO: A Scalable and Multi-tenant Platform for Continuous Knowledge Base Synthesis	2013	VLDB	5.2104516e-05
6,690	Parallel Discrepancy Detection and Incremental Detection	2021	VLDB	4.9621556e-05
7,013	Qualitative Data Cleaning	2016	VLDB	4.8619024e-05
7,061	Serving Deep Learning Models with Deduplication from Relational Databases	2022	VLDB	4.8463881e-05
7,237	CleanM: An Optimizable Query Language for Unified Scale-Out Data Cleaning	2017	VLDB	4.7928651e-05
9,487	Making It Tractable to Catch Duplicates and Conflicts in Graphs	2023	SIGMOD	4.3341665e-05
9,846	HyperBlocker: Accelerating Rule-based Blocking in Entity Resolution using GPUs	2025	VLDB	4.2721228e-05
10,499	Privacy and Accuracy-Aware AI/ML Model Deduplication	2025	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 1 of 1 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
319	Evaluation of entity resolution approaches on real-world match problems	2010	VLDB	0.00027781866

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
9,375	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB	4.347384e-05
9,115	MapReduce Algorithms for Big Data Analysis	2012	VLDB	4.3932167e-05
5,838	HadoopDB in Action: Building Real World Applications	2010	SIGMOD	5.3059032e-05
4,147	Exploiting MapReduce-based Similarity Joins	2012	SIGMOD	6.4096022e-05
5,236	Online Deduplication for Databases	2017	SIGMOD	5.611324e-05
6,042	MDedup: Duplicate Detection with Matching Dependencies	2020	VLDB	5.2405269e-05
794	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.00016605103
3,528	Distributed Data Deduplication	2016	VLDB	7.0066139e-05
13,508	MapDupReducer: Detecting Near Duplicates over Massive Datasets	2010	SIGMOD	-
9,266	Redoop Infrastructure for Recurring Big Data Queries	2014	VLDB	4.3667196e-05