Back to papers
An Intermediate Representation for Optimizing Machine Learning Pipelines
Summary: Lara, a declarative DSL, provides an IR for end-to-end ML pipelines, unifying preprocessing, UDFs, control flow, and training. Monads enable cross-boundary pushdown/fusion; combinators encode domain operators to optimize data access, with up to 10× speedups on dense and sparse data.
(summarized by gpt-5-nano on Feb 09 2026)
- Paper ID
- 11848
- Venue
- VLDB
- Year
- 2019
- Pagerank
- 8.9727612e-05
- Overall Rank
- 2,355 | 83.64%
- DOI
-
10.14778/3342263.3342633
Incoming Non-self Citations Over Time
Incoming Citations (Sorted by Pagerank)
Showing 19 of 19 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
| 2,122 |
SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle |
2020 |
CIDR |
9.4905306e-05 |
| 2,809 |
Extending Relational Query Processing with ML Inference |
2020 |
CIDR |
8.0869552e-05 |
| 3,409 |
End-to-end Optimization of Machine Learning Prediction Queries |
2022 |
SIGMOD |
7.1240791e-05 |
| 3,866 |
Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML |
2020 |
CIDR |
6.6795497e-05 |
| 4,601 |
Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches |
2021 |
VLDB |
6.05274e-05 |
| 4,779 |
LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems |
2021 |
SIGMOD |
5.9259373e-05 |
| 4,962 |
Doing More with Less: Characterizing Dataset Downsampling for AutoML |
2021 |
VLDB |
5.7979872e-05 |
| 5,062 |
Optimizing Machine Learning Inference Queries with Correlative Proxy Models |
2022 |
VLDB |
5.7172262e-05 |
| 5,438 |
The NebulaStream Platform: Data and Application Management for the Internet of Things |
2020 |
CIDR |
5.5041764e-05 |
| 5,741 |
Babelfish: Efficient Execution of Polyglot Queries |
2022 |
VLDB |
5.3450701e-05 |
| 6,790 |
InferDB: In-Database Machine Learning Inference Using Indexes |
2024 |
VLDB |
4.9205968e-05 |
| 7,459 |
Lachesis: Automatic Partitioning for UDF-Centric Analytics |
2021 |
VLDB |
4.7199075e-05 |
| 8,593 |
Towards A Polyglot Framework for Factorized ML |
2021 |
VLDB |
4.4846362e-05 |
| 8,981 |
HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries |
2021 |
SIGMOD |
4.4138435e-05 |
| 9,787 |
The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format |
2024 |
SIGMOD |
4.2799988e-05 |
| 10,177 |
InferF: Declarative Factorization of AI/ML Inferences over Joins |
2026 |
SIGMOD |
4.1905499e-05 |
| 10,776 |
cedar: Optimized and Unified Machine Learning Input Data Pipelines |
2025 |
VLDB |
4.1905499e-05 |
| 11,341 |
Redundancy Elimination in Distributed Matrix Computation |
2022 |
SIGMOD |
4.1905499e-05 |
| 11,517 |
TraNCE: Transforming Nested Collections Efficiently |
2021 |
VLDB |
4.1905499e-05 |
Outgoing Citations (Sorted by Pagerank)
Showing 23 of 23 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 42 |
A Comparison of Approaches to Large-Scale Data Analysis |
2009 |
SIGMOD |
0.00073570328 |
| 51 |
Including Group-By in Query Optimization |
1994 |
VLDB |
0.00067060283 |
| 59 |
Efficiently Compiling Efficient Query Plans for Modern Hardware |
2011 |
VLDB |
0.0006445664 |
| 543 |
MLbase: A Distributed Machine-learning System |
2013 |
CIDR |
0.0002050918 |
| 557 |
SystemML: Declarative Machine Learning on Spark |
2016 |
VLDB |
0.00020186115 |
| 1,172 |
Learning Generalized Linear Models Over Normalized Data |
2015 |
SIGMOD |
0.00013504249 |
| 1,283 |
Towards Linear Algebra over Normalized Data |
2017 |
VLDB |
0.00012826013 |
| 1,407 |
Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML |
2014 |
VLDB |
0.00012163413 |
| 1,751 |
Weld: A Common Runtime for High Performance Data Analytics |
2017 |
CIDR |
0.00010673874 |
| 1,970 |
Compressed Linear Algebra for Large-Scale Machine Learning |
2016 |
VLDB |
9.9024431e-05 |
| 2,179 |
Spinning Fast Iterative Data Flows |
2012 |
VLDB |
9.3632007e-05 |
| 2,616 |
Opening the Black Boxes in Data Flow Optimization |
2012 |
VLDB |
8.4457819e-05 |
| 2,754 |
Stubby: A Transformation-based Optimizer for MapReduce Workflows |
2012 |
VLDB |
8.1720428e-05 |
| 2,823 |
Implicit Parallelism through Deep Language Embedding |
2015 |
SIGMOD |
8.0593793e-05 |
| 2,843 |
How to Architect a Query Compiler, Revisited |
2018 |
SIGMOD |
8.0334687e-05 |
| 2,904 |
Evaluating End-to-End Optimization for Data Analytics Applications in Weld |
2018 |
VLDB |
7.9403097e-05 |
| 3,920 |
On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML |
2018 |
VLDB |
6.6246708e-05 |
| 3,953 |
A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics |
2018 |
VLDB |
6.5896733e-05 |
| 4,508 |
SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning |
2017 |
CIDR |
6.1261819e-05 |
| 5,265 |
Probabilistic Demand Forecasting at Scale |
2017 |
VLDB |
5.5950627e-05 |
| 8,081 |
Meta-Dataflows: Efficient Exploratory Dataflow Jobs |
2018 |
SIGMOD |
4.5871672e-05 |
| 9,442 |
BlockJoin: Efficient Matrix Partitioning Through Joins |
2017 |
VLDB |
4.3384032e-05 |
| 11,848 |
Emma in Action: Declarative Dataflows for Scalable Data Analysis |
2016 |
SIGMOD |
4.1905499e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 3,694 |
Where Is My Training Bottleneck? Hidden Trade-Offs in Deep Learning Preprocessing Pipelines |
2022 |
SIGMOD |
6.8316905e-05 |
| 1,970 |
Compressed Linear Algebra for Large-Scale Machine Learning |
2016 |
VLDB |
9.9024431e-05 |
| 6,464 |
Materialization and Reuse Optimizations for Production Data Science Pipelines |
2022 |
SIGMOD |
5.0471003e-05 |
| 6,194 |
Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra |
2021 |
SIGMOD |
5.1592984e-05 |
| 1,283 |
Towards Linear Algebra over Normalized Data |
2017 |
VLDB |
0.00012826013 |
| 4,779 |
LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems |
2021 |
SIGMOD |
5.9259373e-05 |
| 6,290 |
Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines |
2021 |
CIDR |
5.1220786e-05 |
| 3,920 |
On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML |
2018 |
VLDB |
6.6246708e-05 |
| 4,508 |
SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning |
2017 |
CIDR |
6.1261819e-05 |
| 5,497 |
SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra |
2020 |
VLDB |
5.4741034e-05 |