DBScholar

Back to papers

Incremental Knowledge Base Construction Using DeepDive

Summary: DeepDive fuses DB and ML ideas to accelerate knowledge-base construction from unstructured data. Proposes incremental inference via sampling and variational methods, plus a rule-based optimizer, achieving 100x speedups with negligible quality impact on 5 KBC workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h76c4b10e2d94c6a8
Venue
VLDB
Year
2015
Pagerank
0.00016083582
Overall Rank
579 | 96.12%
DOI
10.14778/2809975.2809984
PDF
Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{shin_vldb15,
        title = {{Incremental Knowledge Base Construction Using DeepDive}},
        author = {Shin, Jaeho and Wu, Sen and Wang, Feiran and De Sa, Christopher and Zhang, Ce and Ré, Christopher},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {11},
        pages = {1310--1321},
        doi = {10.14778/2809975.2809984},
        url = {https://doi.org/10.14778/2809975.2809984},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 44 of 44 citing papers.

Rank Citing Paper Year Venue Pagerank
104 HoloClean: Holistic Data Repairs with Probabilistic Inference 2017 VLDB 0.00033676943
496 Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes 2024 VLDB 0.00017318538
521 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016923519
972 The Data Civilizer System 2017 CIDR 0.00012757732
1,223 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011468426
1,560 Joining Extractions of Regular Expressions 2018 PODS 0.00010246783
2,227 GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization 2024 VLDB 8.8007923e-05
2,982 Query-Driven On-The-Fly Knowledge Base Construction 2018 VLDB 7.7838352e-05
3,063 Fonduer: Knowledge Base Construction from Richly Formatted Data 2018 SIGMOD 7.689108e-05
3,236 How Large Language Models Will Disrupt Data Management 2023 VLDB 7.4996147e-05
3,264 Automatic Data Repair: Are We Ready to Deploy? 2024 VLDB 7.4774357e-05
3,793 SLiMFast: Guaranteed Results for Data Fusion and Source Reliability 2017 SIGMOD 7.0156889e-05
3,907 Split-Correctness in Information Extraction 2019 PODS 6.9301592e-05
3,998 Overton: A Data System for Monitoring and Improving Machine-Learned Products 2020 CIDR 6.862274e-05
4,334 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 6.6537801e-05
4,578 SlimShot: In-Database Probabilistic Inference for Knowledge Bases 2016 VLDB 6.5215127e-05
4,674 Knowledge Graphs 2021: A Data Odyssey 2021 VLDB 6.4731383e-05
4,954 KBPearl: A Knowledge Base Population System Supported by Joint Entity and Relation Linking 2020 VLDB 6.3387793e-05
5,208 ELEET: Efficient Learned Query Execution over Text and Tables 2024 VLDB 6.2254341e-05
5,231 Natural Language Data Management and Interfaces: Recent Development and Open Challenges 2017 SIGMOD 6.2170025e-05
5,877 BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees 2019 SIGMOD 5.9599042e-05
5,922 A Relational Framework for Classifier Engineering 2017 PODS 5.9442275e-05
6,222 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.8446676e-05
6,666 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7144587e-05
6,734 On Multiple Semantics for Declarative Database Repairs 2020 SIGMOD 5.6919385e-05
7,144 A Cost-based Optimizer for Gradient Descent Optimization 2017 SIGMOD 5.5979118e-05
7,843 ExDRa: Exploratory Data Science on Federated Raw Data 2021 SIGMOD 5.4406331e-05
8,033 Dependency-Driven Analytics: a Compass for Uncharted Data Oceans 2017 CIDR 5.4017733e-05
8,440 RuDiK: Rule Discovery in Knowledge Bases 2018 VLDB 5.3324907e-05
8,650 Anytime Approximation in Probabilistic Databases via Scaled Dissociations 2019 SIGMOD 5.2929907e-05
8,857 Machine Learning Meets Big Spatial Data 2019 VLDB 5.2621882e-05
8,895 FastPDB: Towards Bag-Probabilistic Queries at Interactive Speeds 2025 SIGMOD 5.2534908e-05
9,215 Entity Matching in the Wild: A Consistent and Versatile Framework to Unify Data in Industrial Applications 2020 SIGMOD 5.2051923e-05
9,287 Ontological Pathfinding: Mining First-Order Knowledge from Large Knowledge Bases 2016 SIGMOD 5.2015703e-05
9,505 Automatically Generating Interesting Facts from Wikipedia Tables 2019 SIGMOD 5.168414e-05
9,713 Ground Truth Inference for Weakly Supervised Entity Matching 2023 SIGMOD 5.1350726e-05
10,814 Document-to-Database: Extraction Meets Relational Semantics 2026 VLDB 4.9769913e-05
11,706 Probabilistic Reasoning at Scale: Trigger Graphs to the Rescue 2023 SIGMOD 4.9769913e-05
12,027 Wikinegata: a Knowledge Base with Interesting Negative Statements 2021 VLDB 4.9769913e-05
12,179 Flash in Action: Scalable Spatial Data Analysis Using Markov Logic Networks 2019 VLDB 4.9769913e-05
12,228 A Demonstration of Sya: A Spatial Probabilistic Knowledge Base Construction System 2018 SIGMOD 4.9769913e-05
12,257 Holistic Query Evaluation over Information Extraction Pipelines 2018 VLDB 4.9769913e-05
12,284 Building Structured Databases of Factual Knowledge from Massive Text Corpora 2017 SIGMOD 4.9769913e-05
12,434 Mindtagger: A Demonstration of Data Labeling in Knowledge Base Construction 2015 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
62 Maintaining Views Incrementally 1993 SIGMOD 0.00039040346
245 MCDB: A Monte Carlo Approach to Managing Uncertain Data 2008 SIGMOD 0.00023251151
328 Declarative Information Extraction Using Datalog with Embedded Extraction Predicates 2007 VLDB 0.00020921862
992 Web-scale Data Integration: You can only afford to Pay As You Go 2007 CIDR 0.00012641942
1,063 Tuffy: Scaling up Statistical Inference in Markov Logic Networks using an RDBMS 2011 VLDB 0.00012208
1,154 The Lixto Data Extraction Project - Back and Forth between Theory and Practice 2004 PODS 0.0001178814
1,167 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.0001172597
2,021 Scalable Probabilistic Databases with Factor Graphs and MCMC 2010 VLDB 9.171164e-05
2,394 From Data Fusion to Knowledge Fusion 2014 VLDB 8.529467e-05
3,040 Knowledge Expansion over Probabilistic Knowledge Bases 2014 SIGMOD 7.7229256e-05
4,029 Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers 2013 SIGMOD 6.840359e-05
5,809 Incrementally Maintaining Classification using an RDBMS 2011 VLDB 5.9848544e-05
6,105 From Information to Knowledge: Harvesting Entities and Relationships from Web Sources 2010 PODS 5.8836889e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,143 Hybrid In-Database Inference for Declarative Information Extraction 2011 SIGMOD
2 4,509 Optimization for Active Learning-based Interactive Database Exploration 2019 VLDB
3 12,232 Deeper: A Data Enrichment System Powered by Deep Web 2018 SIGMOD
4 359 Knowledge Discovery in Databases: An Attribute-Oriented Approach 1992 VLDB
5 7,420 Cardinality Estimation of Approximate Substring Queries using Deep Learning 2022 VLDB
6 9,342 Deep Query Optimization 2019 SIGMOD
7 8,687 Relational Deep Dive: Error-Aware Queries Over Unstructured Data 2026 VLDB
8 3,040 Knowledge Expansion over Probabilistic Knowledge Bases 2014 SIGMOD
9 318 DeepDB: Learn from Data, not from Queries! 2020 VLDB
10 4,395 Extracting Databases from Dark Data with DeepDive 2016 SIGMOD