DBScholar

Back to papers

Optimizing Data Pipelines for Machine Learning in Feature Stores

Summary: Introduces database-style optimizations for point-in-time joins, a critical feature-store pipeline operation. Implemented in Feathr and validated on TPCx-AI and retail workloads, achieving up to 3× speedups over state-of-the-art baselines. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h05ecde23a75dabef
Venue
VLDB
Year
2023
Pagerank
5.9761004e-05
Overall Rank
5,793 | 61.17%
DOI
10.14778/3625054.3625060
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{liu_vldb23,
        title = {{Optimizing Data Pipelines for Machine Learning in Feature Stores}},
        author = {Liu, Rui and Park, Kwanghyun and Psallidas, Fotis and Zhu, Xiaoyong and Mo, Jinghui and Sen, Rathijit and Interlandi, Matteo and Karanasos, Konstantinos and Tian, Yuanyuan and Camacho-Rodríguez, Jesús},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {13},
        pages = {4230--4239},
        doi = {10.14778/3625054.3625060},
        url = {https://doi.org/10.14778/3625054.3625060},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank Citing Paper Year Venue Pagerank
7,566 The Hopsworks Feature Store for Machine Learning 2024 SIGMOD 5.4776122e-05
10,513 DFLOP: A Data-driven Framework for Multimodal LLM Training Pipeline Optimization 2026 SIGMOD 4.9605343e-05
10,786 TPCx-AI under the Microscope: A Benchmarking Debt Analysis 2026 VLDB 4.9605343e-05
10,793 CAPS: Cost-Aware ML Pipeline Selection 2026 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
62 Maintaining Views Incrementally 1993 SIGMOD 0.00038944207
89 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035265687
388 Incremental Maintenance of Views with Duplicates 1995 SIGMOD 0.0001928135
556 Optimizing Queries Using Materialized Views: A Practical, Scalable Solution 2001 SIGMOD 0.00016470022
656 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015052106
940 A Scalable Algorithm for Answering Queries Using Views 2000 VLDB 0.00012941424
1,059 Answering Complex SQL Queries Using Automatic Summary Tables 2000 SIGMOD 0.00012224962
1,711 Algorithms for Materialized View Design in Data Warehousing Environment 1997 VLDB 9.7964912e-05
1,757 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7050769e-05
2,241 Physical Data Independence, Constraints, and Optimization with Universal Plans 1999 VLDB 8.7710222e-05
3,550 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.1895215e-05
3,691 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.0771037e-05
4,279 Relative Error Streaming Quantiles 2021 PODS 6.6731371e-05
4,744 KLL± Approximate Quantile Sketches over Dynamic Datasets 2021 VLDB 6.4278327e-05
4,949 TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems 2023 VLDB 6.3271767e-05
5,531 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 6.0786523e-05
6,234 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.825343e-05
6,249 Optimizing In-memory Database Engine for AI-powered On-line Decision Augmentation Using Persistent Memory 2021 VLDB 5.8190376e-05
6,679 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.6956362e-05
9,186 Delta: Scalable Data Dissemination under Capacity Constraints 2014 VLDB 5.1979837e-05
9,746 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.1178001e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,765 Machine Learning for Databases 2021 VLDB
2 656 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD
3 6,259 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB
4 6,654 Coresets over Multiple Tables for Feature-rich and Data-efficient Machine Learning 2023 VLDB
5 5,441 An Integrated Development Environment for Faster Feature Engineering 2014 VLDB
6 10,193 Structure-Aware Machine Learning over Multi-Relational Databases 2021 SIGMOD
7 6,234 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD
8 5,531 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB
9 9,213 FEBench: A Benchmark for Real-Time Relational Data Feature Extraction 2023 VLDB
10 7,566 The Hopsworks Feature Store for Machine Learning 2024 SIGMOD