Back to papers
SMOKE: Fine-grained Lineage at Interactive Speed
Summary: SMOKE is an in-memory engine that integrates fine-grained lineage capture into physical operators, using compact representations and workload-aware optimizations. It delivers orders-of-magnitude lower capture/query costs, enabling interactive (<150 ms) lineage analytics.
(summarized by gpt-5.6-luna on Jul 24 2026)
Paper ID
h2d1960ef20c8ca95
Venue
VLDB
Year
2018
Pagerank
9.8129981e-05
Overall Rank
1,713 | 88.49%
DOI
10.14778/3184470.3184475
Incoming Non-self Citations Over Time
BibTeX Citation
@article{psallidas_vldb18,
title = {{SMOKE: Fine-grained Lineage at Interactive Speed}},
author = {Psallidas, Fotis and Wu, Eugene},
journal = {PVLDB},
series = {{VLDB} '18},
volume = {11},
number = {6},
pages = {719--732},
doi = {10.14778/3184470.3184475},
url = {https://doi.org/10.14778/3184470.3184475},
year = {2018}
}
Incoming Citations (Sorted by Pagerank)
Showing 28 of 28 citing papers.
Rank
Citing Paper
Year
Venue
Pagerank
1,408
Northstar: An Interactive Data Science System 2018
VLDB
0.00010738859
2,385
DeepLens: Towards a Visual Data Management System 2019
CIDR
8.5393531e-05
2,835
Fine-Grained, Secure and Efficient Data Provenance on Blockchain Systems 2019
VLDB
7.9516187e-05
4,334
LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021
SIGMOD
6.6537801e-05
4,849
Explaining Wrong Queries Using Small Examples 2019
SIGMOD
6.3794032e-05
5,533
Putting Things into Context: Rich Explanations for Query Answers using Join Graphs 2021
SIGMOD
6.0906707e-05
5,573
Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020
SIGMOD
6.0774723e-05
6,193
Fine-Grained Lineage for Safer Notebook Interactions 2021
VLDB
5.8538103e-05
6,878
Towards Democratizing Relational Data Visualization 2019
SIGMOD
5.6563449e-05
7,214
Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science 2021
VLDB
5.5814338e-05
7,709
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
5.4719078e-05
7,750
Rumble: Data Independence for Large Messy Data Sets 2021
VLDB
5.4585103e-05
8,408
FaDE: More Than a Million What-ifs Per Second 2025
VLDB
5.3364407e-05
8,490
Provenance-based Data Skipping 2022
VLDB
5.3302146e-05
8,590
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
5.3067446e-05
8,895
FastPDB: Towards Bag-Probabilistic Queries at Interactive Speeds 2025
SIGMOD
5.2534908e-05
8,947
Compact, Tamper-Resistant Archival of Fine-Grained Provenance 2021
VLDB
5.2530141e-05
9,787
Optimizing Dataflow Systems for Scalable Interactive Visualization 2024
SIGMOD
5.1276108e-05
9,793
ProvCite: Provenance-based Data Citation 2019
VLDB
5.1251743e-05
10,026
Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees 2021
VLDB
5.0919429e-05
10,197
LPStream: Fine-grained Lazy Provenance for Stream Processing 2026
SIGMOD
5.0599411e-05
10,351
Evergreen: Efficient Claim Verification for Semantic Aggregates 2027
VLDB
4.9769913e-05
10,838
Toward Temporal Attribution Analytics in Dataflows 2026
VLDB
4.9769913e-05
10,853
I-Rex: An Interactive Debugger for SQL 2026
VLDB
4.9769913e-05
11,144
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
4.9769913e-05
11,963
Flow Provenance in Temporal Interaction Networks 2021
SIGMOD
4.9769913e-05
12,025
A Demonstration of RELIC: A System for REtrospective Lineage InferenCe of Data Workflows 2021
VLDB
4.9769913e-05
12,220
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD
4.9769913e-05
Outgoing Citations (Sorted by Pagerank)
Showing 28 of 28 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Rank
Cited Paper
Year
Venue
Pagerank
21
Efficiently Compiling Efficient Query Plans for Modern Hardware 2011
VLDB
0.00056835296
104
HoloClean: Holistic Data Repairs with Probabilistic Inference 2017
VLDB
0.00033676943
190
Scorpion: Explaining Away Outliers in Aggregate Queries 2013
VLDB
0.0002582857
337
Trio: A System for Data, Uncertainty, and Lineage 2006
VLDB
0.00020613834
525
An Annotation Management System for Relational Databases 2004
VLDB
0.00016889428
1,223
Data Management in Machine Learning: Challenges, Techniques, and Systems 2017
SIGMOD
0.00011468426
1,389
Provenance for Generalized Map and Reduce Workflows 2011
CIDR
0.00010818511
1,394
Data Profiling with Metanome 2015
VLDB
0.00010791559
1,458
Row-wise Parallel Predicate Evaluation 2008
VLDB
0.00010583148
1,500
M4: A Visualization-Oriented Time Series Data Aggregation 2014
VLDB
0.00010460169
1,564
Titian: Data Provenance Support in Spark 2016
VLDB
0.00010219222
1,587
DBNotes: A Post-It System for Relational Databases based on Provenance 2005
SIGMOD
0.0001013806
1,827
Querying Data Provenance 2010
SIGMOD
9.5518797e-05
1,941
Caravan: Provisioning for What-If Analysis 2013
CIDR
9.3276626e-05
2,222
Explaining Query Answers with Explanation-Ready Databases 2016
VLDB
8.8106741e-05
2,418
The Semiring Framework for Database Provenance 2017
PODS
8.4904382e-05
2,697
On Improving User Response Times in Tableau 2015
SIGMOD
8.1166572e-05
2,838
Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead 2017
CIDR
7.9493532e-05
3,421
UGuide – User-Guided Discovery of FD-Detectable Errors 2017
SIGMOD
7.3120636e-05
3,597
Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017
SIGMOD
7.1759026e-05
4,684
Provenance for Natural Language Queries 2017
VLDB
6.4692258e-05
4,937
Explaining Outputs in Modern Data Analytics 2016
VLDB
6.3443901e-05
5,000
Descriptive and Prescriptive Data Cleaning 2014
SIGMOD
6.3194405e-05
5,638
Revisiting Reuse in Main Memory Database Systems 2017
SIGMOD
6.0546358e-05
5,960
Factorizing Complex Predicates in Queries to Exploit Indexes 2003
SIGMOD
5.9305837e-05
6,627
A Demonstration of DBWipes: Clean as You Query 2012
VLDB
5.7281668e-05
6,652
Combining Design and Performance in a Data Visualization Management System 2017
CIDR
5.7190063e-05
8,785
Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015
VLDB
5.2767488e-05
Semantically Similar Papers
#
Overall Rank
Paper
Year
Venue
1
1,827
Querying Data Provenance 2010
SIGMOD
2
8,137
Thrifty Query Execution via Incrementability 2020
SIGMOD
3
7,709
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
4
8,590
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
5
11,144
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
6
8,198
Lineage Processing over Correlated Probabilistic Databases 2010
SIGMOD
7
6,442
Tracing Lineage Beyond Relational Operators 2007
VLDB
8
11,866
Lineage Resource Manager 2022
SIGMOD
9
1,914
Efficient Lineage Tracking For Scientific Workflows 2008
SIGMOD
10
12,220
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD