Human-in-the-loop Data Integration

Summary: Hybrid human–machine data integration for entity matching: learned similarity/knowledge rules and distributed in-memory candidate generation (DIMA) precede crowd verification. CDB selects, infers via transitivity/partial orders, and refines uncertain judgments through SQL-like crowd queries. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: ha0e4f42f243ca4f6
Venue: VLDB
Year: 2017
Pagerank: 5.7989499e-05
Overall Rank: 6,397 | 57.00%
DOI: 10.14778/3137765.3137833

Incoming Non-self Citations Over Time

Authors

1. Guoliang Li (Tsinghua University)

BibTeX Citation

@article{li_vldb17,
        title = {{Human-in-the-loop Data Integration}},
        author = {Li, Guoliang},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {12},
        pages = {2006--2009},
        doi = {10.14778/3137765.3137833},
        url = {https://doi.org/10.14778/3137765.3137833},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
437	QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning	2019	VLDB	0.00018315867
2,158	Open Data Integration	2018	VLDB	8.941016e-05
2,908	AI Meets Database: AI4DB and DB4AI	2021	SIGMOD	7.8742664e-05
7,052	Cost-Effective Data Annotation using Game-Based Crowdsourcing	2019	VLDB	5.6127577e-05
7,260	Entity Resolution On-Demand	2022	VLDB	5.571581e-05
9,565	Deduplicated Sampling On-Demand	2025	VLDB	5.1571823e-05
10,244	Towards Interpretable and Learnable Risk Analysis for Entity Resolution	2020	SIGMOD	5.0525742e-05
10,691	The Case For Language Model Approximated LIKE Predicate	2026	SIGMOD	4.9793485e-05
10,772	Human-Centered Exploration of Table Unionability	2026	VLDB	4.9793485e-05
12,212	A Rating-Ranking Method for Crowdsourced Top-k Computation	2018	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 43 of 43 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034672523
168	Efficient Exact Set-Similarity Joins	2006	VLDB	0.00027163517
198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025555196
201	Efficient set joins on similarity predicates	2004	SIGMOD	0.00025331535
257	Crowdsourced Databases: Query Processing with People	2011	CIDR	0.00022962347
266	Human-powered Sorts and Joins	2012	VLDB	0.00022739124
360	Efficient Parallel Set-Similarity Joins Using MapReduce	2010	SIGMOD	0.00020009936
433	Corleone: Hands-Off Crowdsourcing for Entity Matching	2014	SIGMOD	0.00018332741
530	Magellan: Toward Building Entity Matching Management Systems	2016	VLDB	0.00016855162
749	So Who Won? Dynamic Max Discovery with the Crowd	2012	SIGMOD	0.00014265279
871	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD	0.00013343705
929	Ed-Join: An Efficient Algorithm for Similarity Joins With Edit Distance Constraints	2008	VLDB	0.00013020115
933	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00013004422
963	Can We Beat the Prefix Filtering? An Adaptive Framework for Similarity Join and Search	2012	SIGMOD	0.00012816649
987	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012660627
992	Bayesian Locality Sensitive Hashing for Fast Similarity Search	2012	VLDB	0.00012646771
1,247	Entity Matching: How Similar Is Similar	2011	VLDB	0.00011346515
1,307	Entity Resolution with Iterative Blocking	2009	SIGMOD	0.000110838
1,421	V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors	2012	VLDB	0.00010726757
1,654	Falcon: Scaling Up Hands-Off Crowdsourced Entity Matching to Build Cloud Services	2017	SIGMOD	9.9739611e-05
1,923	ATLAS: A Probabilistic Algorithm for High Dimensional Similarity Search	2011	SIGMOD	9.3750526e-05
1,926	Counting with the Crowd	2013	VLDB	9.3637786e-05
1,933	Pass-Join: A Partition-based Method for Similarity Joins	2012	VLDB	9.3459285e-05
2,220	String Similarity Joins: An Experimental Evaluation	2014	VLDB	8.8146984e-05
2,272	Resolving Conflicts in Heterogeneous Data by Truth Discovery and Source Reliability Estimation	2014	SIGMOD	8.7121962e-05
2,429	Deco: A System for Declarative Crowdsourcing	2012	VLDB	8.4801295e-05
2,653	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.1732164e-05
3,171	Truth Inference in Crowdsourcing: Is the Problem Solved?	2017	VLDB	7.5691557e-05
3,197	iCrowd: An Adaptive Crowdsourcing Framework	2015	SIGMOD	7.5455503e-05
3,273	Large-Scale Collective Entity Matching	2011	VLDB	7.471033e-05
3,323	A Confidence-Aware Approach for Truth Discovery on Long-Tail Data	2015	VLDB	7.4291935e-05
3,350	An Efficient Partition Based Method for Exact Set Similarity Joins	2016	VLDB	7.3910669e-05
3,738	BLAST: a Loosely Schema-aware Meta-blocking Approach for Entity Resolution	2016	VLDB	7.0627813e-05
3,839	QASCA: A Quality-Aware Task Assignment System for Crowdsourcing Applications	2015	SIGMOD	6.9921604e-05
4,051	Crowd-Based Deduplication: An Adaptive Approach	2015	SIGMOD	6.8285415e-05
4,602	Reducing Uncertainty of Schema Matching via Crowdsourcing	2013	VLDB	6.5072085e-05
4,623	Cost-Effective Crowdsourced Entity Resolution: A Partial-Order Approach	2016	SIGMOD	6.4978811e-05
5,912	Dima: A Distributed In-Memory Similarity-Based Query Processing System	2017	VLDB	5.9501002e-05
6,312	Putting Context into Schema Matching	2006	VLDB	5.8171904e-05
7,030	Efficient Similarity Join and Search on Multi-Attribute Data	2015	SIGMOD	5.6173605e-05
7,709	Scalable Column Concept Determination for Web Tables Using Large Knowledge Bases	2013	VLDB	5.4717883e-05
9,583	CDB: Optimizing Queries with Crowd-Based Selections and Joins	2017	SIGMOD	5.1571823e-05
9,879	META: An Efficient Matching-Based Method for Error-Tolerant Autocompletion	2016	VLDB	5.1176637e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	92	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD
2	12,203	(Artificial) Mind over Matter: Integrating Humans and Algorithms in Solving Matching Problems	2018	SIGMOD
3	871	Leveraging Transitive Relations for Crowdsourced Joins	2013	SIGMOD
4	814	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD
5	1,391	Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks	2020	SIGMOD
6	5,614	CrowdQ: Crowdsourced Query Understanding	2013	CIDR
7	4,602	Reducing Uncertainty of Schema Matching via Crowdsourcing	2013	VLDB
8	198	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB
9	1,472	Crowdsourcing Algorithms for Entity Resolution	2014	VLDB
10	4,661	CrowdMatcher: Crowd-Assisted Schema Matching	2014	SIGMOD