DBScholar

Back to papers

Optimizing Data Pipelines for Machine Learning in Feature Stores

Summary: Introduces database-style optimizations for point-in-time joins, a critical feature-store pipeline operation. Implemented in Feathr and validated on TPCx-AI and retail workloads, achieving up to 3× speedups over state-of-the-art baselines. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
13480
Venue
VLDB
Year
2023
Pagerank
6.1146371e-05
Overall Rank
5,704 | 60.87%
DOI
10.14778/3625054.3625060

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{liu_vldb23,
        title = {{Optimizing Data Pipelines for Machine Learning in Feature Stores}},
        author = {Liu, Rui and Park, Kwanghyun and Psallidas, Fotis and Zhu, Xiaoyong and Mo, Jinghui and Sen, Rathijit and Interlandi, Matteo and Karanasos, Konstantinos and Tian, Yuanyuan and Camacho-Rodríguez, Jesús},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {13},
        pages = {4230--4239},
        doi = {10.14778/3625054.3625060},
        url = {https://doi.org/10.14778/3625054.3625060},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank Citing Paper Year Venue Pagerank
9,385 The Hopsworks Feature Store for Machine Learning 2024 SIGMOD 5.2755515e-05
10,219 DFLOP: A Data-driven Framework for Multimodal LLM Training Pipeline Optimization 2026 SIGMOD 5.093636e-05
10,531 TPCx-AI under the Microscope: A Benchmarking Debt Analysis 2026 VLDB 5.093636e-05
10,540 CAPS: Cost-Aware ML Pipeline Selection 2026 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
61 Maintaining Views Incrementally 1993 SIGMOD 0.00039026867
87 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035281619
375 Incremental Maintenance of Views with Duplicates 1995 SIGMOD 0.00019681204
559 Optimizing Queries Using Materialized Views: A Practical, Scalable Solution 2001 SIGMOD 0.00016528822
640 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015409494
913 A Scalable Algorithm for Answering Queries Using Views 2000 VLDB 0.00013253821
1,034 Answering Complex SQL Queries Using Automatic Summary Tables 2000 SIGMOD 0.00012516197
1,743 Algorithms for Materialized View Design in Data Warehousing Environment 1997 VLDB 9.8702732e-05
1,765 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.8079546e-05
2,189 Physical Data Independence, Constraints, and Optimization with Universal Plans 1999 VLDB 8.9856333e-05
3,605 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.2640711e-05
3,614 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.2568185e-05
4,472 Relative Error Streaming Quantiles 2021 PODS 6.6810874e-05
5,040 TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems 2023 VLDB 6.390395e-05
5,184 KLL± Approximate Quantile Sketches over Dynamic Datasets 2021 VLDB 6.3283918e-05
5,925 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 6.0397888e-05
6,105 Optimizing In-memory Database Engine for AI-powered On-line Decision Augmentation Using Persistent Memory 2021 VLDB 5.9743349e-05
6,309 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.9189554e-05
6,538 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.8477764e-05
8,992 Delta: Scalable Data Dissemination under Capacity Constraints 2014 VLDB 5.3373227e-05
9,529 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.2545475e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 5,340 Machine Learning for Databases 2021 VLDB
2 640 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD
3 6,143 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB
4 7,112 Coresets over Multiple Tables for Feature-rich and Data-efficient Machine Learning 2023 VLDB
5 5,297 An Integrated Development Environment for Faster Feature Engineering 2014 VLDB
6 9,962 Structure-Aware Machine Learning over Multi-Relational Databases 2021 SIGMOD
7 6,309 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD
8 5,925 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB
9 9,433 FEBench: A Benchmark for Real-Time Relational Data Feature Extraction 2023 VLDB
10 9,385 The Hopsworks Feature Store for Machine Learning 2024 SIGMOD