Query-Oriented Data Cleaning with Oracles

Summary: QOCO: query-oriented data cleaning via edits to the DB driven by domain-expert oracle crowds, to improve query results. NP-hardness of minimizing interactions, heuristics, and a prototype with experiments on correcting incorrect and missing tuples. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5062
Venue: SIGMOD
Year: 2015
Pagerank: 8.4061164e-05
Overall Rank: 2,570 | 82.37%
DOI: 10.1145/2723372.2737786

Incoming Non-self Citations Over Time

Authors

1. Moria Bergman (Tel Aviv University)
2. Tova Milo (Tel Aviv University)
3. Slava Novgorodov (Tel Aviv University)
4. Wang-Chiew Tan (University of California Santa Cruz)

BibTeX Citation

@inproceedings{bergman_sigmod15,
        title = {{Query-Oriented Data Cleaning with Oracles}},
        author = {Bergman, Moria and Milo, Tova and Novgorodov, Slava and Tan, Wang-Chiew},
        series = {{SIGMOD} '15},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2723372.2737786},
        url = {https://dl.acm.org/doi/10.1145/2723372.2737786},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 13 of 13 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
582	ActiveClean: Interactive Data Cleaning For Statistical Modeling	2016	VLDB	0.00016148948
1,323	Data Cleaning: Overview and Emerging Challenges	2016	SIGMOD	0.00011152602
3,004	SCODED: Statistical Constraint Oriented Data Error Detection	2020	SIGMOD	7.8608629e-05
3,281	Cleaning Crowdsourced Labels Using Oracles for Statistical Classification	2019	VLDB	7.5706653e-05
3,496	Waldo: An Adaptive Human Interface for Crowd Entity Resolution	2017	SIGMOD	7.3634471e-05
6,471	QOCO: A Query Oriented Data Cleaning System with Oracles	2015	VLDB	5.8702801e-05
6,899	Human-in-the-loop Outlier Detection	2020	SIGMOD	5.7431609e-05
8,160	ICARUS: Minimizing Human Effort in Iterative Data Completion	2018	VLDB	5.4754476e-05
9,193	Query-Guided Resolution in Uncertain Databases	2023	SIGMOD	5.3058708e-05
9,298	VisClean: Interactive Cleaning for Progressive Visualization	2020	VLDB	5.2901384e-05
11,384	LinCQA: Faster Consistent Query Answering with Linear Time Guarantees	2023	SIGMOD	5.093636e-05
11,597	ActivePDB: Active Probabilistic Databases	2022	VLDB	5.093636e-05
11,875	WiClean: A System for Fixing Wikipedia Interlinks Using Revision History Patterns	2019	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
17	Provenance Semirings	2007	PODS	0.00059843817
90	CrowdDB: Answering Queries with Crowdsourcing	2011	SIGMOD	0.00034951786
94	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00034616103
180	Schema Mapping as Query Discovery	2000	VLDB	0.00026772368
196	CrowdER: Crowdsourcing Entity Resolution	2012	VLDB	0.00025780596
288	Towards Estimation Error Guarantees for Distinct Values	2000	PODS	0.00022296371
385	Why Not?	2009	SIGMOD	0.00019455743
454	Using Schema Matching to Simplify Heterogeneous Data Translation	1998	VLDB	0.00018133578
605	The Complexity of Causality and Responsibility for Query Answers and non-Answers	2011	VLDB	0.00015839628
620	On Propagation of Deletions and Annotations Through Views	2002	PODS	0.00015703409
628	On the Provenance of Non-Answers to Queries over Extracted Data	2008	VLDB	0.00015630285
700	Explaining differences in multidimensional aggregates	1999	VLDB	0.00014871032
856	How to ConQueR Why-Not Questions	2010	SIGMOD	0.00013573466
933	Question Selection for Crowd Entity Resolution	2013	VLDB	0.00013111293
997	CrowdScreen: Algorithms for Filtering Data with Humans	2012	SIGMOD	0.00012755983
1,060	Curated Databases	2008	PODS	0.00012371807
1,594	Sensitivity Analysis and Explanations for Robust Query Evaluation in Probabilistic Databases	2011	SIGMOD	0.00010252583
1,736	A Sample-and-Clean Framework for Fast and Accurate Query Processing on Dirty Data	2014	SIGMOD	9.8984415e-05
1,910	Counting with the Crowd	2013	VLDB	9.4972788e-05
2,032	Explaining Missing Answers to SPJUA Queries	2010	VLDB	9.2828822e-05
2,358	Artemis: A System for Analyzing Missing Answers	2009	VLDB	8.6996414e-05
2,636	CrowdFill: Collecting Structured Data from the Crowd	2014	SIGMOD	8.31868e-05
2,711	Progressive Approach to Relational Entity Resolution	2014	VLDB	8.2178865e-05
2,789	Crowd Mining	2013	SIGMOD	8.1203892e-05
3,914	Optimal Crowd-Powered Rating and Filtering Algorithms	2014	VLDB	7.0204052e-05
4,568	CrowdMatcher: Crowd-Assisted Schema Matching	2014	SIGMOD	6.625684e-05
4,901	Maximizing Conjunctive Views in Deletion Propagation	2011	PODS	6.4528526e-05
9,030	CerFix: A System for Cleaning Data with Certain Fixes	2011	VLDB	5.3286356e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,038	QFix: Demonstrating Error Diagnosis in Query Histories	2016	SIGMOD
2	143	Optimization of Nonrecursive Queries	1986	VLDB
3	9,442	Interactive and Deterministic Data Cleaning: A Tossed Stone Raises a Thousand Ripples	2016	SIGMOD
4	4,959	QFix: Diagnosing Errors through Query Histories	2017	SIGMOD
5	533	Improving Data Quality: Consistency and Accuracy	2007	VLDB
6	6,764	Keyword Query Cleaning	2008	VLDB
7	6,548	Query Optimization over Crowdsourced Data	2013	VLDB
8	9,353	On Efficient Approximate Queries over Machine Learning Models	2023	VLDB
9	9,193	Query-Guided Resolution in Uncertain Databases	2023	SIGMOD
10	6,471	QOCO: A Query Oriented Data Cleaning System with Oracles	2015	VLDB