Incremental Knowledge Base Construction Using DeepDive

Summary: DeepDive fuses DB and ML ideas to accelerate knowledge-base construction from unstructured data. Proposes incremental inference via sampling and variational methods, plus a rule-based optimizer, achieving 100x speedups with negligible quality impact on 5 KBC workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h76c4b10e2d94c6a8
Venue: VLDB
Year: 2015
Pagerank: 0.00016212139
Overall Rank: 569 | 96.19%
DOI: 10.14778/2809975.2809984
PDF: Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

1. Jaeho Shin (Stanford University)
2. Sen Wu (Stanford University)
3. Feiran Wang (Stanford University)
4. Christopher De Sa (Stanford University)
5. Ce Zhang (Stanford University; University of Wisconsin)
6. Christopher Ré (Stanford University)

BibTeX Citation

@article{shin_vldb15,
        title = {{Incremental Knowledge Base Construction Using DeepDive}},
        author = {Shin, Jaeho and Wu, Sen and Wang, Feiran and De Sa, Christopher and Zhang, Ce and Ré, Christopher},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {11},
        pages = {1310--1321},
        doi = {10.14778/2809975.2809984},
        url = {https://doi.org/10.14778/2809975.2809984},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 45 of 45 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
100	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033951027
494	Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes	2024	VLDB	0.00017350554
522	Learning Linear Regression Models over Factorized Joins	2016	SIGMOD	0.00016893112
972	The Data Civilizer System	2017	CIDR	0.00012742827
1,226	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011432354
1,560	Joining Extractions of Regular Expressions	2018	PODS	0.00010212902
2,227	GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization	2024	VLDB	8.7924681e-05
2,942	Fonduer: Knowledge Base Construction from Richly Formatted Data	2018	SIGMOD	7.8171618e-05
2,970	Query-Driven On-The-Fly Knowledge Base Construction	2018	VLDB	7.7863288e-05
3,223	How Large Language Models Will Disrupt Data Management	2023	VLDB	7.5043163e-05
3,277	Automatic Data Repair: Are We Ready to Deploy?	2024	VLDB	7.4527106e-05
3,797	SLiMFast: Guaranteed Results for Data Fusion and Source Reliability	2017	SIGMOD	6.9951279e-05
3,918	Split-Correctness in Information Extraction	2019	PODS	6.9072438e-05
4,009	Overton: A Data System for Monitoring and Improving Machine-Learned Products	2020	CIDR	6.8427225e-05
4,354	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	6.6318545e-05
4,384	Knowledge Graphs 2021: A Data Odyssey	2021	VLDB	6.6139064e-05
4,530	KBPearl: A Knowledge Base Population System Supported by Joint Entity and Relation Linking	2020	VLDB	6.543674e-05
4,590	SlimShot: In-Database Probabilistic Inference for Knowledge Bases	2016	VLDB	6.5029123e-05
5,234	ELEET: Efficient Learned Query Execution over Text and Tables	2024	VLDB	6.204849e-05
5,251	Natural Language Data Management and Interfaces: Recent Development and Open Challenges	2017	SIGMOD	6.1977414e-05
5,885	BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees	2019	SIGMOD	5.9421702e-05
5,934	A Relational Framework for Classifier Engineering	2017	PODS	5.925278e-05
6,234	Materialization and Reuse Optimizations for Production Data Science Pipelines	2022	SIGMOD	5.825343e-05
6,679	UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads	2022	VLDB	5.6956362e-05
6,753	On Multiple Semantics for Declarative Database Repairs	2020	SIGMOD	5.673161e-05
7,168	A Cost-based Optimizer for Gradient Descent Optimization	2017	SIGMOD	5.5794432e-05
7,860	ExDRa: Exploratory Data Science on Federated Raw Data	2021	SIGMOD	5.422643e-05
8,048	Dependency-Driven Analytics: a Compass for Uncharted Data Oceans	2017	CIDR	5.3842397e-05
8,456	RuDiK: Rule Discovery in Knowledge Bases	2018	VLDB	5.3148581e-05
8,669	Anytime Approximation in Probabilistic Databases via Scaled Dissociations	2019	SIGMOD	5.2754888e-05
8,878	Machine Learning Meets Big Spatial Data	2019	VLDB	5.2449044e-05
8,915	FastPDB: Towards Bag-Probabilistic Queries at Interactive Speeds	2025	SIGMOD	5.2361195e-05
9,214	Entity Matching in the Wild: A Consistent and Versatile Framework to Unify Data in Industrial Applications	2020	SIGMOD	5.1924903e-05
9,310	Ontological Pathfinding: Mining First-Order Knowledge from Large Knowledge Bases	2016	SIGMOD	5.1843936e-05
9,534	Automatically Generating Interesting Facts from Wikipedia Tables	2019	SIGMOD	5.151324e-05
9,744	Ground Truth Inference for Weakly Supervised Entity Matching	2023	SIGMOD	5.1180929e-05
10,412	Taxonomy Maintenance in the Wild over Evolving Scholarly Data: Reliability, Efficiency, and Cost-Effectiveness	2027	SIGMOD	4.9605343e-05
10,875	Document-to-Database: Extraction Meets Relational Semantics	2026	VLDB	4.9605343e-05
11,752	Probabilistic Reasoning at Scale: Trigger Graphs to the Rescue	2023	SIGMOD	4.9605343e-05
12,071	Wikinegata: a Knowledge Base with Interesting Negative Statements	2021	VLDB	4.9605343e-05
12,222	Flash in Action: Scalable Spatial Data Analysis Using Markov Logic Networks	2019	VLDB	4.9605343e-05
12,271	A Demonstration of Sya: A Spatial Probabilistic Knowledge Base Construction System	2018	SIGMOD	4.9605343e-05
12,300	Holistic Query Evaluation over Information Extraction Pipelines	2018	VLDB	4.9605343e-05
12,327	Building Structured Databases of Factual Knowledge from Massive Text Corpora	2017	SIGMOD	4.9605343e-05
12,477	Mindtagger: A Demonstration of Data Labeling in Knowledge Base Construction	2015	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
62	Maintaining Views Incrementally	1993	SIGMOD	0.00038944207
245	MCDB: A Monte Carlo Approach to Managing Uncertain Data	2008	SIGMOD	0.00023188414
330	Declarative Information Extraction Using Datalog with Embedded Extraction Predicates	2007	VLDB	0.00020870379
994	Web-scale Data Integration: You can only afford to Pay As You Go	2007	CIDR	0.00012610224
1,067	Tuffy: Scaling up Statistical Inference in Markov Logic Networks using an RDBMS	2011	VLDB	0.00012170631
1,155	The Lixto Data Extraction Project - Back and Forth between Theory and Practice	2004	PODS	0.00011759744
1,169	DimmWitted: A Study of Main-Memory Statistical Analytics	2014	VLDB	0.00011690039
2,027	Scalable Probabilistic Databases with Factor Graphs and MCMC	2010	VLDB	9.1511498e-05
2,396	From Data Fusion to Knowledge Fusion	2014	VLDB	8.5109743e-05
3,042	Knowledge Expansion over Probabilistic Knowledge Bases	2014	SIGMOD	7.7063913e-05
4,046	Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers	2013	SIGMOD	6.8182709e-05
5,822	Incrementally Maintaining Classification using an RDBMS	2011	VLDB	5.9655757e-05
6,091	From Information to Knowledge: Harvesting Entities and Relationships from Web Sources	2010	PODS	5.8724947e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,162	Hybrid In-Database Inference for Declarative Information Extraction	2011	SIGMOD
2	4,526	Optimization for Active Learning-based Interactive Database Exploration	2019	VLDB
3	12,275	Deeper: A Data Enrichment System Powered by Deep Web	2018	SIGMOD
4	362	Knowledge Discovery in Databases: An Attribute-Oriented Approach	1992	VLDB
5	7,440	Cardinality Estimation of Approximate Substring Queries using Deep Learning	2022	VLDB
6	9,365	Deep Query Optimization	2019	SIGMOD
7	8,707	Relational Deep Dive: Error-Aware Queries Over Unstructured Data	2026	VLDB
8	3,042	Knowledge Expansion over Probabilistic Knowledge Bases	2014	SIGMOD
9	320	DeepDB: Learn from Data, not from Queries!	2020	VLDB
10	4,403	Extracting Databases from Dark Data with DeepDive	2016	SIGMOD