Back to papers
SMOKE: Fine-grained Lineage at Interactive Speed
Summary: SMOKE is an in-memory engine that integrates fine-grained lineage capture into physical operators, using compact representations and workload-aware optimizations. It delivers orders-of-magnitude lower capture/query costs, enabling interactive (<150 ms) lineage analytics.
(summarized by gpt-5.6-luna on Jul 24 2026)
Paper ID
h2d1960ef20c8ca95
Venue
VLDB
Year
2018
Pagerank
9.7341914e-05
Overall Rank
1,746 | 88.27%
DOI
10.14778/3184470.3184475
Incoming Non-self Citations Over Time
BibTeX Citation
@article{psallidas_vldb18,
title = {{SMOKE: Fine-grained Lineage at Interactive Speed}},
author = {Psallidas, Fotis and Wu, Eugene},
journal = {PVLDB},
series = {{VLDB} '18},
volume = {11},
number = {6},
pages = {719--732},
doi = {10.14778/3184470.3184475},
url = {https://doi.org/10.14778/3184470.3184475},
year = {2018}
}
Incoming Citations (Sorted by Pagerank)
Showing 27 of 27 citing papers.
Rank
Citing Paper
Year
Venue
Pagerank
1,409
Northstar: An Interactive Data Science System 2018
VLDB
0.00010743451
2,391
DeepLens: Towards a Visual Data Management System 2019
CIDR
8.5365368e-05
2,835
Fine-Grained, Secure and Efficient Data Provenance on Blockchain Systems 2019
VLDB
7.9553846e-05
4,334
LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021
SIGMOD
6.6569314e-05
4,847
Explaining Wrong Queries Using Small Examples 2019
SIGMOD
6.3823876e-05
5,529
Putting Things into Context: Rich Explanations for Query Answers using Join Graphs 2021
SIGMOD
6.0935553e-05
5,573
Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020
SIGMOD
6.0794156e-05
6,190
Fine-Grained Lineage for Safer Notebook Interactions 2021
VLDB
5.8565828e-05
6,875
Towards Democratizing Relational Data Visualization 2019
SIGMOD
5.6589849e-05
7,212
Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science 2021
VLDB
5.5840773e-05
7,703
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
5.4744994e-05
7,744
Rumble: Data Independence for Large Messy Data Sets 2021
VLDB
5.4610663e-05
8,495
Provenance-based Data Skipping 2022
VLDB
5.3304338e-05
8,583
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
5.3092552e-05
8,886
FastPDB: Towards Bag-Probabilistic Queries at Interactive Speeds 2025
SIGMOD
5.2559789e-05
8,892
FaDE: More Than a Million What-ifs Per Second 2025
VLDB
5.2559789e-05
8,939
Compact, Tamper-Resistant Archival of Fine-Grained Provenance 2021
VLDB
5.255502e-05
9,781
Optimizing Dataflow Systems for Scalable Interactive Visualization 2024
SIGMOD
5.1300393e-05
9,787
ProvCite: Provenance-based Data Citation 2019
VLDB
5.1276016e-05
10,021
Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees 2021
VLDB
5.0943545e-05
10,194
LPStream: Fine-grained Lazy Provenance for Stream Processing 2026
SIGMOD
5.0623376e-05
10,828
Toward Temporal Attribution Analytics in Dataflows 2026
VLDB
4.9793485e-05
10,843
I-Rex: An Interactive Debugger for SQL 2026
VLDB
4.9793485e-05
11,135
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
4.9793485e-05
11,957
Flow Provenance in Temporal Interaction Networks 2021
SIGMOD
4.9793485e-05
12,019
A Demonstration of RELIC: A System for REtrospective Lineage InferenCe of Data Workflows 2021
VLDB
4.9793485e-05
12,214
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD
4.9793485e-05
Outgoing Citations (Sorted by Pagerank)
Showing 28 of 28 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Rank
Cited Paper
Year
Venue
Pagerank
21
Efficiently Compiling Efficient Query Plans for Modern Hardware 2011
VLDB
0.00056855599
104
HoloClean: Holistic Data Repairs with Probabilistic Inference 2017
VLDB
0.00033690989
189
Scorpion: Explaining Away Outliers in Aggregate Queries 2013
VLDB
0.00025840026
337
Trio: A System for Data, Uncertainty, and Lineage 2006
VLDB
0.00020621631
525
An Annotation Management System for Relational Databases 2004
VLDB
0.00016890994
1,255
Data Management in Machine Learning: Challenges, Techniques, and Systems 2017
SIGMOD
0.00011325762
1,388
Provenance for Generalized Map and Reduce Workflows 2011
CIDR
0.00010821908
1,395
Data Profiling with Metanome 2015
VLDB
0.00010794808
1,459
Row-wise Parallel Predicate Evaluation 2008
VLDB
0.00010585108
1,500
M4: A Visualization-Oriented Time Series Data Aggregation 2014
VLDB
0.0001046347
1,564
Titian: Data Provenance Support in Spark 2016
VLDB
0.00010222394
1,588
DBNotes: A Post-It System for Relational Databases based on Provenance 2005
SIGMOD
0.00010140362
1,827
Querying Data Provenance 2010
SIGMOD
9.5545888e-05
1,944
Caravan: Provisioning for What-If Analysis 2013
CIDR
9.3281326e-05
2,222
Explaining Query Answers with Explanation-Ready Databases 2016
VLDB
8.8109051e-05
2,418
The Semiring Framework for Database Provenance 2017
PODS
8.4928222e-05
2,700
On Improving User Response Times in Tableau 2015
SIGMOD
8.1188166e-05
2,843
Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead 2017
CIDR
7.9491056e-05
3,422
UGuide – User-Guided Discovery of FD-Detectable Errors 2017
SIGMOD
7.3138834e-05
3,599
Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017
SIGMOD
7.1773938e-05
4,687
Provenance for Natural Language Queries 2017
VLDB
6.4706848e-05
4,940
Explaining Outputs in Modern Data Analytics 2016
VLDB
6.345789e-05
4,998
Descriptive and Prescriptive Data Cleaning 2014
SIGMOD
6.3207886e-05
5,639
Revisiting Reuse in Main Memory Database Systems 2017
SIGMOD
6.0558642e-05
5,969
Factorizing Complex Predicates in Queries to Exploit Indexes 2003
SIGMOD
5.9317876e-05
6,621
A Demonstration of DBWipes: Clean as You Query 2012
VLDB
5.7307884e-05
6,647
Combining Design and Performance in a Data Visualization Management System 2017
CIDR
5.7217042e-05
8,777
Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015
VLDB
5.2792451e-05
Semantically Similar Papers
#
Overall Rank
Paper
Year
Venue
1
1,827
Querying Data Provenance 2010
SIGMOD
2
9,784
Memory Efficient Scheduling of Query Pipeline Execution 2022
CIDR
3
8,583
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
4
7,703
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
5
11,135
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
6
8,190
Lineage Processing over Correlated Probabilistic Databases 2010
SIGMOD
7
6,451
Tracing Lineage Beyond Relational Operators 2007
VLDB
8
11,860
Lineage Resource Manager 2022
SIGMOD
9
1,913
Efficient Lineage Tracking For Scientific Workflows 2008
SIGMOD
10
12,214
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD