Back to papers
SMOKE: Fine-grained Lineage at Interactive Speed
Summary: SMOKE is an in-memory engine that integrates fine-grained lineage capture into physical operators, using compact representations and workload-aware optimizations. It delivers orders-of-magnitude lower capture/query costs, enabling interactive (<150 ms) lineage analytics.
(summarized by gpt-5.6-luna on Jul 24 2026)
Paper ID
h2d1960ef20c8ca95
Venue
VLDB
Year
2018
Pagerank
9.781628e-05
Overall Rank
1,722 | 88.46%
DOI
10.14778/3184470.3184475
Incoming Non-self Citations Over Time
BibTeX Citation
@article{psallidas_vldb18,
title = {{SMOKE: Fine-grained Lineage at Interactive Speed}},
author = {Psallidas, Fotis and Wu, Eugene},
journal = {PVLDB},
series = {{VLDB} '18},
volume = {11},
number = {6},
pages = {719--732},
doi = {10.14778/3184470.3184475},
url = {https://doi.org/10.14778/3184470.3184475},
year = {2018}
}
Incoming Citations (Sorted by Pagerank)
Showing 28 of 28 citing papers.
Rank
Citing Paper
Year
Venue
Pagerank
1,416
Northstar: An Interactive Data Science System 2018
VLDB
0.00010707248
2,393
DeepLens: Towards a Visual Data Management System 2019
CIDR
8.5162362e-05
2,845
Fine-Grained, Secure and Efficient Data Provenance on Blockchain Systems 2019
VLDB
7.9277292e-05
4,354
LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021
SIGMOD
6.6318545e-05
4,871
Explaining Wrong Queries Using Small Examples 2019
SIGMOD
6.3583165e-05
5,546
Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020
SIGMOD
6.071729e-05
5,556
Putting Things into Context: Rich Explanations for Query Answers using Join Graphs 2021
SIGMOD
6.0705311e-05
6,203
Fine-Grained Lineage for Safer Notebook Interactions 2021
VLDB
5.8344547e-05
6,895
Towards Democratizing Relational Data Visualization 2019
SIGMOD
5.6382396e-05
7,235
Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science 2021
VLDB
5.5629781e-05
7,722
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
5.4538143e-05
7,763
Rumble: Data Independence for Large Messy Data Sets 2021
VLDB
5.4404611e-05
8,425
FaDE: More Than a Million What-ifs Per Second 2025
VLDB
5.3187951e-05
8,505
Provenance-based Data Skipping 2022
VLDB
5.3126038e-05
8,609
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
5.2892055e-05
8,915
FastPDB: Towards Bag-Probabilistic Queries at Interactive Speeds 2025
SIGMOD
5.2361195e-05
8,967
Compact, Tamper-Resistant Archival of Fine-Grained Provenance 2021
VLDB
5.2356443e-05
9,819
Optimizing Dataflow Systems for Scalable Interactive Visualization 2024
SIGMOD
5.1106557e-05
9,827
ProvCite: Provenance-based Data Citation 2019
VLDB
5.108228e-05
10,064
Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees 2021
VLDB
5.0751093e-05
10,230
LPStream: Fine-grained Lazy Provenance for Stream Processing 2026
SIGMOD
5.0432098e-05
10,418
Evergreen: Efficient Claim Verification for Semantic Aggregates 2027
VLDB
4.9605343e-05
10,899
Toward Temporal Attribution Analytics in Dataflows 2026
VLDB
4.9605343e-05
10,914
I-Rex: An Interactive Debugger for SQL 2026
VLDB
4.9605343e-05
11,203
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
4.9605343e-05
12,007
Flow Provenance in Temporal Interaction Networks 2021
SIGMOD
4.9605343e-05
12,069
A Demonstration of RELIC: A System for REtrospective Lineage InferenCe of Data Workflows 2021
VLDB
4.9605343e-05
12,263
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD
4.9605343e-05
Outgoing Citations (Sorted by Pagerank)
Showing 28 of 28 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Rank
Cited Paper
Year
Venue
Pagerank
21
Efficiently Compiling Efficient Query Plans for Modern Hardware 2011
VLDB
0.00056737487
100
HoloClean: Holistic Data Repairs with Probabilistic Inference 2017
VLDB
0.00033951027
191
Scorpion: Explaining Away Outliers in Aggregate Queries 2013
VLDB
0.0002578784
340
Trio: A System for Data, Uncertainty, and Lineage 2006
VLDB
0.00020548826
529
An Annotation Management System for Relational Databases 2004
VLDB
0.00016834919
1,226
Data Management in Machine Learning: Challenges, Techniques, and Systems 2017
SIGMOD
0.00011432354
1,393
Provenance for Generalized Map and Reduce Workflows 2011
CIDR
0.00010784123
1,399
Data Profiling with Metanome 2015
VLDB
0.0001076306
1,461
Row-wise Parallel Predicate Evaluation 2008
VLDB
0.00010557729
1,504
M4: A Visualization-Oriented Time Series Data Aggregation 2014
VLDB
0.00010425951
1,562
Titian: Data Provenance Support in Spark 2016
VLDB
0.00010192248
1,593
DBNotes: A Post-It System for Relational Databases based on Provenance 2005
SIGMOD
0.00010105032
1,837
Querying Data Provenance 2010
SIGMOD
9.5210079e-05
1,953
Caravan: Provisioning for What-If Analysis 2013
CIDR
9.297314e-05
2,233
Explaining Query Answers with Explanation-Ready Databases 2016
VLDB
8.7844607e-05
2,427
The Semiring Framework for Database Provenance 2017
PODS
8.4673732e-05
2,701
On Improving User Response Times in Tableau 2015
SIGMOD
8.0959949e-05
2,847
Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead 2017
CIDR
7.9235089e-05
3,432
UGuide – User-Guided Discovery of FD-Detectable Errors 2017
SIGMOD
7.288198e-05
3,606
Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017
SIGMOD
7.1528863e-05
4,697
Provenance for Natural Language Queries 2017
VLDB
6.4479645e-05
4,963
Explaining Outputs in Modern Data Analytics 2016
VLDB
6.3234324e-05
5,022
Descriptive and Prescriptive Data Cleaning 2014
SIGMOD
6.2989483e-05
5,642
Revisiting Reuse in Main Memory Database Systems 2017
SIGMOD
6.0370517e-05
5,974
Factorizing Complex Predicates in Queries to Exploit Indexes 2003
SIGMOD
5.9109943e-05
6,636
A Demonstration of DBWipes: Clean as You Query 2012
VLDB
5.7094244e-05
6,663
Combining Design and Performance in a Data Visualization Management System 2017
CIDR
5.7001805e-05
8,803
Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015
VLDB
5.2598307e-05
Semantically Similar Papers
#
Overall Rank
Paper
Year
Venue
1
9,822
Memory Efficient Scheduling of Query Pipeline Execution 2022
CIDR
2
1,837
Querying Data Provenance 2010
SIGMOD
3
8,609
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
4
7,722
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
5
11,203
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
6
8,212
Lineage Processing over Correlated Probabilistic Databases 2010
SIGMOD
7
6,453
Tracing Lineage Beyond Relational Operators 2007
VLDB
8
11,910
Lineage Resource Manager 2022
SIGMOD
9
1,923
Efficient Lineage Tracking For Scientific Workflows 2008
SIGMOD
10
12,263
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD