MapDupReducer: Detecting Near Duplicates over Massive Datasets
Summary: MapDupReducer, a MapReduce-based system for near-duplicate detection on massive datasets. Demonstrates design and implementation enabling efficient, scalable duplicate discovery for Web-scale corpora. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Authors
- 1. Chaokun Wang (Tsinghua University)
- 2. Jianmin Wang (Tsinghua University)
- 3. Xuemin Lin (National ICT Australia; University of New South Wales)
- 4. Wei Wang (National ICT Australia; University of New South Wales)
- 5. Haixun Wang (Microsoft)
- 6. Hongsong Li (Microsoft)
- 7. Wanpeng Tian (Tsinghua University)
- 8. Jun Xu (Tsinghua University)
- 9. Rui Li (Tsinghua University)
BibTeX Citation
@inproceedings{wang_sigmod10,
title = {{MapDupReducer: Detecting Near Duplicates over Massive Datasets}},
author = {Wang, Chaokun and Wang, Jianmin and Lin, Xuemin and Wang, Wei and Wang, Haixun and Li, Hongsong and Tian, Wanpeng and Xu, Jun and Li, Rui},
series = {{SIGMOD} '10},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/1807167.1807296},
url = {https://dl.acm.org/doi/10.1145/1807167.1807296},
year = {2010}
}
Incoming Citations (Sorted by Pagerank)
Showing 2 of 2 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,211 | Vertex Priority Based Butterfly Counting for Large-scale Bipartite Networks | 2019 | VLDB | 0.00011648789 |
| 1,552 | Scalable Subgraph Enumeration in MapReduce | 2015 | VLDB | 0.00010379532 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 0 of 0 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 5,021 | Online Deduplication for Databases | 2017 | SIGMOD |
| 2 | 9,510 | Efficient Big Data Processing in Hadoop MapReduce | 2012 | VLDB |
| 3 | 3,983 | Crowd-Based Deduplication: An Adaptive Approach | 2015 | SIGMOD |
| 4 | 3,671 | Exploiting MapReduce-based Similarity Joins | 2012 | SIGMOD |
| 5 | 9,369 | Redoop Infrastructure for Recurring Big Data Queries | 2014 | VLDB |
| 6 | 72 | Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters | 2007 | SIGMOD |
| 7 | 2,539 | Minimal MapReduce Algorithms | 2013 | SIGMOD |
| 8 | 2,893 | Distributed Data Deduplication | 2016 | VLDB |
| 9 | 9,263 | MapReduce Algorithms for Big Data Analysis | 2012 | VLDB |
| 10 | 2,055 | Dedoop: Efficient Deduplication with Hadoop | 2012 | VLDB |