Incremental Knowledge Base Construction Using DeepDive

Summary: DeepDive fuses DB and ML ideas to accelerate knowledge-base construction from unstructured data. Proposes incremental inference via sampling and variational methods, plus a rule-based optimizer, achieving 100x speedups with negligible quality impact on 5 KBC workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11198
Venue: VLDB
Year: 2015
Pagerank: 0.00016217563
Overall Rank: 579 | 96.03%
DOI: 10.14778/2809975.2809984

Incoming Non-self Citations Over Time

Authors

1. Jaeho Shin (Stanford University)
2. Sen Wu (Stanford University)
3. Feiran Wang (Stanford University)
4. Christopher De Sa (Stanford University)
5. Ce Zhang (Stanford University; University of Wisconsin)
6. Christopher Ré (Stanford University)

BibTeX Citation

@article{shin_vldb15,
        title = {{Incremental Knowledge Base Construction Using DeepDive}},
        author = {Shin, Jaeho and Wu, Sen and Wang, Feiran and De Sa, Christopher and Zhang, Ce and Ré, Christopher},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {11},
        pages = {1310--1321},
        doi = {10.14778/2809975.2809984},
        url = {https://doi.org/10.14778/2809975.2809984},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 43 of 43 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
112	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00032801121
536	Learning Linear Regression Models over Factorized Joins	2016	SIGMOD	0.0001693369
713	Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes	2024	VLDB	0.00014672521
963	The Data Civilizer System	2017	CIDR	0.00012935145
1,250	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011485301
1,528	Joining Extractions of Regular Expressions	2018	PODS	0.00010486718
2,298	GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization	2024	VLDB	8.7886538e-05
2,917	Query-Driven On-The-Fly Knowledge Base Construction	2018	VLDB	7.9661816e-05
3,192	Fonduer: Knowledge Base Construction from Richly Formatted Data	2018	SIGMOD	7.65035e-05
3,536	How Large Language Models Will Disrupt Data Management	2023	VLDB	7.3297343e-05
3,580	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.2888516e-05
3,715	SLiMFast: Guaranteed Results for Data Fusion and Source Reliability	2017	SIGMOD	7.1763559e-05
3,822	Split-Correctness in Information Extraction	2019	PODS	7.0925799e-05
3,947	Overton: A Data System for Monitoring and Improving Machine-Learned Products	2020	CIDR	7.0040437e-05
4,240	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	6.809685e-05
4,490	SlimShot: In-Database Probabilistic Inference for Knowledge Bases	2016	VLDB	6.6666905e-05
4,687	Knowledge Graphs 2021: A Data Odyssey	2021	VLDB	6.5620198e-05
4,834	KBPearl: A Knowledge Base Population System Supported by Joint Entity and Relation Linking	2020	VLDB	6.4866871e-05
5,130	Natural Language Data Management and Interfaces: Recent Development and Open Challenges	2017	SIGMOD	6.354484e-05
5,785	BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees	2019	SIGMOD	6.0892672e-05
5,804	A Relational Framework for Classifier Engineering	2017	PODS	6.0829486e-05
6,118	ELEET: Efficient Learned Query Execution over Text and Tables	2024	VLDB	5.9698795e-05
6,309	Materialization and Reuse Optimizations for Production Data Science Pipelines	2022	SIGMOD	5.9189554e-05
6,538	UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads	2022	VLDB	5.8477764e-05
6,664	On Multiple Semantics for Declarative Database Repairs	2020	SIGMOD	5.8090585e-05
7,000	A Cost-based Optimizer for Gradient Descent Optimization	2017	SIGMOD	5.7287645e-05
7,687	ExDRa: Exploratory Data Science on Federated Raw Data	2021	SIGMOD	5.5671645e-05
7,878	Dependency-Driven Analytics: a Compass for Uncharted Data Oceans	2017	CIDR	5.5246167e-05
8,265	RuDiK: Rule Discovery in Knowledge Bases	2018	VLDB	5.4574671e-05
8,476	Anytime Approximation in Probabilistic Databases via Scaled Dissociations	2019	SIGMOD	5.4170414e-05
8,722	Machine Learning Meets Big Spatial Data	2019	VLDB	5.3769871e-05
8,724	FastPDB: Towards Bag-Probabilistic Queries at Interactive Speeds	2025	SIGMOD	5.3766157e-05
9,121	Entity Matching in the Wild: A Consistent and Versatile Framework to Unify Data in Industrial Applications	2020	SIGMOD	5.3193511e-05
9,124	Ontological Pathfinding: Mining First-Order Knowledge from Large Knowledge Bases	2016	SIGMOD	5.319248e-05
9,316	Automatically Generating Interesting Facts from Wikipedia Tables	2019	SIGMOD	5.289545e-05
9,560	Ground Truth Inference for Weakly Supervised Entity Matching	2023	SIGMOD	5.2528121e-05
11,385	Probabilistic Reasoning at Scale: Trigger Graphs to the Rescue	2023	SIGMOD	5.093636e-05
11,718	Wikinegata: a Knowledge Base with Interesting Negative Statements	2021	VLDB	5.093636e-05
11,873	Flash in Action: Scalable Spatial Data Analysis Using Markov Logic Networks	2019	VLDB	5.093636e-05
11,923	A Demonstration of Sya: A Spatial Probabilistic Knowledge Base Construction System	2018	SIGMOD	5.093636e-05
11,953	Holistic Query Evaluation over Information Extraction Pipelines	2018	VLDB	5.093636e-05
11,980	Building Structured Databases of Factual Knowledge from Massive Text Corpora	2017	SIGMOD	5.093636e-05
12,135	Mindtagger: A Demonstration of Data Labeling in Knowledge Base Construction	2015	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
61	Maintaining Views Incrementally	1993	SIGMOD	0.00039026867
238	MCDB: A Monte Carlo Approach to Managing Uncertain Data	2008	SIGMOD	0.0002369322
319	Declarative Information Extraction Using Datalog with Embedded Extraction Predicates	2007	VLDB	0.00021377065
969	Web-scale Data Integration: You can only afford to Pay As You Go	2007	CIDR	0.00012892148
1,043	Tuffy: Scaling up Statistical Inference in Markov Logic Networks using an RDBMS	2011	VLDB	0.0001244565
1,131	The Lixto Data Extraction Project - Back and Forth between Theory and Practice	2004	PODS	0.00012044716
1,150	DimmWitted: A Study of Main-Memory Statistical Analytics	2014	VLDB	0.00011943462
1,986	Scalable Probabilistic Databases with Factor Graphs and MCMC	2010	VLDB	9.3519536e-05
2,351	From Data Fusion to Knowledge Fusion	2014	VLDB	8.7099618e-05
2,990	Knowledge Expansion over Probabilistic Knowledge Bases	2014	SIGMOD	7.8883704e-05
3,952	Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers	2013	SIGMOD	6.9967272e-05
5,695	Incrementally Maintaining Classification using an RDBMS	2011	VLDB	6.1183313e-05
6,011	From Information to Knowledge: Harvesting Entities and Relationships from Web Sources	2010	PODS	6.0105397e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,055	Hybrid In-Database Inference for Declarative Information Extraction	2011	SIGMOD
2	4,420	Optimization for Active Learning-based Interactive Database Exploration	2019	VLDB
3	11,927	Deeper: A Data Enrichment System Powered by Deep Web	2018	SIGMOD
4	349	Knowledge Discovery in Databases: An Attribute-Oriented Approach	1992	VLDB
5	7,268	Cardinality Estimation of Approximate Substring Queries using Deep Learning	2022	VLDB
6	9,215	Deep Query Optimization	2019	SIGMOD
7	10,572	Relational Deep Dive: Error-Aware Queries Over Unstructured Data	2026	VLDB
8	2,990	Knowledge Expansion over Probabilistic Knowledge Bases	2014	SIGMOD
9	323	DeepDB: Learn from Data, not from Queries!	2020	VLDB
10	4,410	Extracting Databases from Dark Data with DeepDive	2016	SIGMOD