Sparkly: A Simple yet Surprisingly Strong TF/IDF Blocker for Entity Matching

Summary: Sparkly: a distributed, share-nothing top-k TF/IDF blocker built on Lucene/Spark with automatic attribute and tokenizer selection for entity matching. Outperforms eight state-of-the-art blockers on recall/output-size/runtime, advocating TF/IDF and top-k blocking as strong, scalable baselines. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13201
Venue: VLDB
Year: 2023
Pagerank: 5.9524736e-05
Overall Rank: 6,167 | 57.69%
DOI: 10.14778/3583140.3583163

Incoming Non-self Citations Over Time

Authors

1. Derek Paulsen (Informatica; University of Wisconsin)
2. Yash Govind (Apple)
3. AnHai Doan (Informatica; University of Wisconsin)

BibTeX Citation

@article{paulsen_vldb23,
        title = {{Sparkly: A Simple yet Surprisingly Strong TF/IDF Blocker for Entity Matching}},
        author = {Paulsen, Derek and Govind, Yash and Doan, AnHai},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {6},
        pages = {1507--1519},
        doi = {10.14778/3583140.3583163},
        url = {https://doi.org/10.14778/3583140.3583163},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,381	Deduplicated Sampling On-Demand	2025	VLDB	5.2755515e-05
9,992	Progressive Entity Matching: A Design Space Exploration	2025	SIGMOD	5.1815618e-05
10,248	Generalized Entity Matching with Adaptivity via Large Language Models	2026	SIGMOD	5.093636e-05
10,334	3dSAGER: Geospatial Entity Resolution over 3D Objects	2026	SIGMOD	5.093636e-05
10,563	Balancing the Blend: An Experimental Analysis of Trade-offs in Hybrid Search	2026	VLDB	5.093636e-05
10,566	ALER: An Active Learning Hybrid System for Efficient Entity Resolution	2026	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
141	Deep Entity Matching with Pre-Trained Language Models	2021	VLDB	0.0002964847
158	Robust and Efficient Fuzzy Match for Online Data Cleaning	2003	SIGMOD	0.00028199923
176	Deep Learning for Entity Matching: A Design Space Exploration	2018	SIGMOD	0.00027191081
439	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018464913
489	Distributed Representations of Tuples for Entity Resolution	2018	VLDB	0.0001761456
529	Magellan: Toward Building Entity Matching Management Systems	2016	VLDB	0.00017096361
1,643	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	0.00010134956
2,475	Deep Learning for Blocking in Entity Matching: A Design Space Exploration	2021	VLDB	8.5277654e-05
4,244	Algorithmic Aspects of Parallel Query Processing	2018	SIGMOD	6.8062787e-05
5,134	Auto-FuzzyJoin: Auto-Program Fuzzy Similarity Joins Without Labeled Examples	2021	SIGMOD	6.3532024e-05
7,373	Entity Matching Meets Data Science: A Progress Report from the Magellan Project	2019	SIGMOD	5.6311132e-05
11,945	CloudMatcher: A Hands-Off Cloud/Crowd Service for Entity Matching	2018	VLDB	5.093636e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,480	LocationSpark: A Distributed In-Memory Data Management System for Big Spatial Data	2016	VLDB
2	9,997	HyperBlocker: Accelerating Rule-based Blocking in Entity Resolution using GPUs	2025	VLDB
3	11,571	Generalized Supervised Meta-blocking	2022	VLDB
4	930	SPARK: Top-k Keyword Query in Relational Databases	2007	SIGMOD
5	5,018	Schema-agnostic vs Schema-based Configurations for Blocking Methods on Homogeneous Data	2016	VLDB
6	1,293	Entity Resolution with Iterative Blocking	2009	SIGMOD
7	4,938	Supervised Meta-blocking	2014	VLDB
8	2,475	Deep Learning for Blocking in Entity Matching: A Design Space Exploration	2021	VLDB
9	3,665	BLAST: a Loosely Schema-aware Meta-blocking Approach for Entity Resolution	2016	VLDB
10	2,120	Comparative Analysis of Approximate Blocking Techniques for Entity Resolution	2016	VLDB