Back to papers
SMOKE: Fine-grained Lineage at Interactive Speed
Summary: SMOKE is an in-memory engine that integrates fine-grained lineage capture into physical operators, using compact representations and workload-aware optimizations. It delivers orders-of-magnitude lower capture/query costs, enabling interactive (<150 ms) lineage analytics.
(summarized by gpt-5.6-luna on Jul 24 2026)
Paper ID
11966
Venue
VLDB
Year
2018
Pagerank
9.7361937e-05
Overall Rank
1,798 | 87.67%
DOI
10.14778/3184470.3184475
Incoming Non-self Citations Over Time
BibTeX Citation
@article{psallidas_vldb18,
title = {{SMOKE: Fine-grained Lineage at Interactive Speed}},
author = {Psallidas, Fotis and Wu, Eugene},
journal = {PVLDB},
series = {{VLDB} '18},
volume = {11},
number = {6},
pages = {719--732},
doi = {10.14778/3184470.3184475},
url = {https://doi.org/10.14778/3184470.3184475},
year = {2018}
}
Incoming Citations (Sorted by Pagerank)
Showing 25 of 25 citing papers.
Rank
Citing Paper
Year
Venue
Pagerank
1,392
Northstar: An Interactive Data Science System 2018
VLDB
0.00010936065
2,384
DeepLens: Towards a Visual Data Management System 2019
CIDR
8.6494525e-05
2,851
Fine-Grained, Secure and Efficient Data Provenance on Blockchain Systems 2019
VLDB
8.0462369e-05
4,240
LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021
SIGMOD
6.809685e-05
4,759
Explaining Wrong Queries Using Small Examples 2019
SIGMOD
6.5207388e-05
5,396
Putting Things into Context: Rich Explanations for Query Answers using Join Graphs 2021
SIGMOD
6.2329373e-05
5,524
Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data 2020
SIGMOD
6.1868208e-05
6,071
Fine-Grained Lineage for Safer Notebook Interactions 2021
VLDB
5.9873765e-05
6,737
Towards Democratizing Relational Data Visualization 2019
SIGMOD
5.7875328e-05
7,977
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
5.5152578e-05
8,050
Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science 2021
VLDB
5.5000099e-05
8,387
Rumble: Data Independence for Large Messy Data Sets 2021
VLDB
5.4364932e-05
8,724
FastPDB: Towards Bag-Probabilistic Queries at Interactive Speeds 2025
SIGMOD
5.3766157e-05
8,889
Provenance-based Data Skipping 2022
VLDB
5.3512428e-05
8,950
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
5.345946e-05
9,289
Compact, Tamper-Resistant Archival of Fine-Grained Provenance 2021
VLDB
5.2912339e-05
9,734
Optimizing Dataflow Systems for Scalable Interactive Visualization 2024
SIGMOD
5.227679e-05
9,840
Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees 2021
VLDB
5.2103367e-05
10,077
ProvCite: Provenance-based Data Citation 2019
VLDB
5.1603976e-05
10,320
LPStream: Fine-grained Lazy Provenance for Stream Processing 2026
SIGMOD
5.093636e-05
10,701
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
5.093636e-05
11,109
FaDE: More Than a Million What-ifs Per Second 2025
VLDB
5.093636e-05
11,650
Flow Provenance in Temporal Interaction Networks 2021
SIGMOD
5.093636e-05
11,716
A Demonstration of RELIC: A System for REtrospective Lineage InferenCe of Data Workflows 2021
VLDB
5.093636e-05
11,915
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD
5.093636e-05
Outgoing Citations (Sorted by Pagerank)
Showing 28 of 28 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Rank
Cited Paper
Year
Venue
Pagerank
23
Efficiently Compiling Efficient Query Plans for Modern Hardware 2011
VLDB
0.00054886415
112
HoloClean: Holistic Data Repairs with Probabilistic Inference 2017
VLDB
0.00032801121
191
Scorpion: Explaining Away Outliers in Aggregate Queries 2013
VLDB
0.00026096009
331
Trio: A System for Data, Uncertainty, and Lineage 2006
VLDB
0.00020936658
531
An Annotation Management System for Relational Databases 2004
VLDB
0.00017083233
1,250
Data Management in Machine Learning: Challenges, Techniques, and Systems 2017
SIGMOD
0.00011485301
1,366
Provenance for Generalized Map and Reduce Workflows 2011
CIDR
0.00011016972
1,374
Data Profiling with Metanome 2015
VLDB
0.00010986078
1,450
Row-wise Parallel Predicate Evaluation 2008
VLDB
0.00010746714
1,472
M4: A Visualization-Oriented Time Series Data Aggregation 2014
VLDB
0.00010668946
1,571
DBNotes: A Post-It System for Relational Databases based on Provenance 2005
SIGMOD
0.00010330864
1,617
Titian: Data Provenance Support in Spark 2016
VLDB
0.00010209397
1,912
Querying Data Provenance 2010
SIGMOD
9.4946756e-05
1,952
Caravan: Provisioning for What-If Analysis 2013
CIDR
9.4233049e-05
2,195
Explaining Query Answers with Explanation-Ready Databases 2016
VLDB
8.9713779e-05
2,503
The Semiring Framework for Database Provenance 2017
PODS
8.4964654e-05
2,686
On Improving User Response Times in Tableau 2015
SIGMOD
8.25822e-05
2,807
Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead 2017
CIDR
8.1009158e-05
3,380
UGuide – User-Guided Discovery of FD-Detectable Errors 2017
SIGMOD
7.457539e-05
3,598
Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017
SIGMOD
7.2718988e-05
4,602
Provenance for Natural Language Queries 2017
VLDB
6.6107638e-05
4,845
Explaining Outputs in Modern Data Analytics 2016
VLDB
6.4818607e-05
4,890
Descriptive and Prescriptive Data Cleaning 2014
SIGMOD
6.4590072e-05
5,861
Factorizing Complex Predicates in Queries to Exploit Indexes 2003
SIGMOD
6.0636778e-05
5,947
Revisiting Reuse in Main Memory Database Systems 2017
SIGMOD
6.0323707e-05
6,499
A Demonstration of DBWipes: Clean as You Query 2012
VLDB
5.8609765e-05
6,523
Combining Design and Performance in a Data Visualization Management System 2017
CIDR
5.8518572e-05
8,620
Wisteria: Nurturing Scalable Data Cleaning Infrastructure 2015
VLDB
5.3991092e-05
Semantically Similar Papers
#
Overall Rank
Paper
Year
Venue
1
1,912
Querying Data Provenance 2010
SIGMOD
2
9,612
Memory Efficient Scheduling of Query Pipeline Execution 2022
CIDR
3
7,977
Interactive Query Explanations Using Fine Grained Provenance 2022
SIGMOD
4
8,950
OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs 2023
VLDB
5
10,701
Unified Lineage System: Tracking Data Provenance at Scale 2025
SIGMOD
6
8,032
Lineage Processing over Correlated Probabilistic Databases 2010
SIGMOD
7
6,351
Tracing Lineage Beyond Relational Operators 2007
VLDB
8
11,551
Lineage Resource Manager 2022
SIGMOD
9
1,871
Efficient Lineage Tracking For Scientific Workflows 2008
SIGMOD
10
11,915
Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018
SIGMOD