DBScholar

Back to papers

LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems

Summary: Fine-grained lineage tracing and reuse in ML systems (LIMA) to break coarse, black-box limits. Multi-level traces, loop/function dedup, and cross-hierarchy reuse enable low-overhead provenance with versioning, compatible with task parallelism and operator fusion, delivering up to 12.4x speedups. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h0a8564e76e97bc86
Venue
SIGMOD
Year
2021
Pagerank
6.6318545e-05
Overall Rank
4,354 | 70.82%
DOI
10.1145/3448016.3452788

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{phani_sigmod21,
        title = {{LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems}},
        author = {Phani, Arnab and Rath, Benjamin and Boehm, Matthias},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3452788},
        url = {https://dl.acm.org/doi/10.1145/3448016.3452788},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 16 of 16 citing papers.

Rank Citing Paper Year Venue Pagerank
5,230 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD 6.2059854e-05
6,679 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.6956362e-05
6,902 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6365602e-05
7,833 Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets 2022 SIGMOD 5.4285082e-05
7,860 ExDRa: Exploratory Data Science on Federated Raw Data 2021 SIGMOD 5.422643e-05
8,101 Provenance-Enabled Explainable AI 2024 SIGMOD 5.3739121e-05
9,842 CatDB: Data-catalog-guided, LLM-based Generation of Data-centric ML Pipelines 2025 VLDB 5.1064323e-05
10,017 The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format 2024 SIGMOD 5.0825892e-05
10,312 ElasticNotebook: Enabling Live Migration for Computational Notebooks 2024 VLDB 5.0264591e-05
10,793 CAPS: Cost-Aware ML Pipeline Selection 2026 VLDB 4.9605343e-05
10,968 stratum: A System Infrastructure for Massive Agent-Centric ML Workloads 2026 VLDB 4.9605343e-05
11,015 Morphing-based Compression for Data-centric ML Pipelines 2026 VLDB 4.9605343e-05
11,203 Unified Lineage System: Tracking Data Provenance at Scale 2025 SIGMOD 4.9605343e-05
11,244 Alsatian: Optimizing Model Search for Deep Transfer Learning 2025 SIGMOD 4.9605343e-05
11,485 ML-Asset Management: Curation, Discovery, and Utilization 2025 VLDB 4.9605343e-05
11,896 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 54 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010494385
17 Provenance Semirings 2007 PODS 0.00059660827
89 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035265687
129 Efficient and Extensible Algorithms for Multi Query Optimization 2000 SIGMOD 0.00030314403
253 Database Cracking 2007 CIDR 0.00023037921
389 Why Not? 2009 SIGMOD 0.00019254758
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018619173
418 MauveDB: Supporting Model-based User Views in Database Systems 2006 SIGMOD 0.00018567032
512 Goods: Organizing Google's Datasets 2016 SIGMOD 0.00017036842
569 Incremental Knowledge Base Construction Using DeepDive 2015 VLDB 0.00016212139
656 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015052106
948 Democratizing Data Science through Interactive Curation of ML Pipelines 2019 SIGMOD 0.00012900728
1,043 The DataPath System: A Data-Centric Analytic Processing Engine for Large Data Warehouses 2010 SIGMOD 0.00012325755
1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012089325
1,089 DataHub: Collaborative Data Science & Dataset Version Management at Scale 2015 CIDR 0.00012062983
1,137 Efficient Exploitation of Similar Subexpressions for Query Processing 2007 SIGMOD 0.00011856159
1,393 Provenance for Generalized Map and Reduce Workflows 2011 CIDR 0.00010784123
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
1,506 VisTrails: Visualization meets Data Management 2006 SIGMOD 0.00010423054
1,556 Update Exchange with Mappings and Provenance 2007 VLDB 0.00010232016
1,562 Titian: Data Provenance Support in Spark 2016 VLDB 0.00010192248
1,567 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010179013
1,616 SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle 2020 CIDR 0.00010048776
1,699 MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis 2018 SIGMOD 9.8230859e-05
1,722 SMOKE: Fine-grained Lineage at Interactive Speed 2018 VLDB 9.781628e-05
1,757 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7050769e-05
1,776 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance 2012 VLDB 9.6661217e-05
1,858 Data Market Platforms: Trading Data Assets to Solve Data Problems 2020 VLDB 9.4779185e-05
1,926 Predictable Performance for Unpredictable Workloads 2009 VLDB 9.3500398e-05
1,938 Elastic Machine Learning Algorithms in Amazon SageMaker 2020 SIGMOD 9.3316919e-05
2,083 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.0563677e-05
2,092 An Architecture for Recycling Intermediates in a Column-store 2009 SIGMOD 9.0432353e-05
2,250 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7477605e-05
2,258 Evaluating End-to-End Optimization for Data Analytics Applications in Weld 2018 VLDB 8.7387151e-05
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,845 Fine-Grained, Secure and Efficient Data Provenance on Blockchain Systems 2019 VLDB 7.9277292e-05
3,052 Incremental and Approximate Inference for Faster Occlusion-based Deep CNN Explanations 2019 SIGMOD 7.6924471e-05
3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 7.6281929e-05
3,122 Incremental View Maintenance with Triple Lock Factorization Benefits 2018 SIGMOD 7.6091671e-05
3,331 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.4065701e-05
3,691 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.0771037e-05
4,186 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.7408641e-05
4,316 The Missing Piece in Complex Analytics: Low Latency, Scalable Model Management and Serving with Velox 2015 CIDR 6.6542348e-05
4,505 SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra 2020 VLDB 6.5561966e-05
4,507 Juneau: Data Lake Management for Jupyter 2019 VLDB 6.5555217e-05
5,808 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD 5.9708628e-05
5,822 Incrementally Maintaining Classification using an RDBMS 2011 VLDB 5.9655757e-05
6,062 Your notebook is not crumby enough, REPLace it 2020 CIDR 5.8829004e-05
6,203 Fine-Grained Lineage for Safer Notebook Interactions 2021 VLDB 5.8344547e-05
6,336 "Amnesia" - A Selection of Machine Learning Models That Can Forget User Data Very Fast 2020 CIDR 5.7929324e-05
Previous Page 1 / 2 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,589 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
2 5,230 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD
3 1,923 Efficient Lineage Tracking For Scientific Workflows 2008 SIGMOD
4 2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB
5 6,338 Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines 2021 CIDR
6 7,235 Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science 2021 VLDB
7 3,104 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB
8 5,808 Optimizing Machine Learning Workloads in Collaborative Environments 2020 SIGMOD
9 2,116 Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities 2021 SIGMOD
10 6,234 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD