DBScholar

Back to papers

Optimizing Data Pipelines for Machine Learning in Feature Stores

Summary: Introduces database-style optimizations for point-in-time joins, a critical feature-store pipeline operation. Implemented in Feathr and validated on TPCx-AI and retail workloads, achieving up to 3× speedups over state-of-the-art baselines. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h05ecde23a75dabef
Venue
VLDB
Year
2023
Pagerank
5.9987664e-05
Overall Rank
5,773 | 61.19%
DOI
10.14778/3625054.3625060

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{liu_vldb23,
        title = {{Optimizing Data Pipelines for Machine Learning in Feature Stores}},
        author = {Liu, Rui and Park, Kwanghyun and Psallidas, Fotis and Zhu, Xiaoyong and Mo, Jinghui and Sen, Rathijit and Interlandi, Matteo and Karanasos, Konstantinos and Tian, Yuanyuan and Camacho-Rodríguez, Jesús},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {13},
        pages = {4230--4239},
        doi = {10.14778/3625054.3625060},
        url = {https://doi.org/10.14778/3625054.3625060},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank Citing Paper Year Venue Pagerank
7,544 The Hopsworks Feature Store for Machine Learning 2024 SIGMOD 5.4983875e-05
10,435 DFLOP: A Data-driven Framework for Multimodal LLM Training Pipeline Optimization 2026 SIGMOD 4.9793485e-05
10,715 TPCx-AI under the Microscope: A Benchmarking Debt Analysis 2026 VLDB 4.9793485e-05
10,722 CAPS: Cost-Aware ML Pipeline Selection 2026 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
62 Maintaining Views Incrementally 1993 SIGMOD 0.00039045511
88 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035351639
388 Incremental Maintenance of Views with Duplicates 1995 SIGMOD 0.00019350381
553 Optimizing Queries Using Materialized Views: A Practical, Scalable Solution 2001 SIGMOD 0.0001652591
654 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.0001510357
935 A Scalable Algorithm for Answering Queries Using Views 2000 VLDB 0.00012989395
1,054 Answering Complex SQL Queries Using Automatic Summary Tables 2000 SIGMOD 0.00012269068
1,706 Algorithms for Materialized View Design in Data Warehousing Environment 1997 VLDB 9.8299851e-05
1,745 Selecting Subexpressions to Materialize at Datacenter Scale 2018 VLDB 9.7343818e-05
2,226 Physical Data Independence, Constraints, and Optimization with Universal Plans 1999 VLDB 8.8033052e-05
3,545 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.2134803e-05
3,683 Cloudy with High Chance of DBMS: A 10-year Prediction for Enterprise-Grade ML 2020 CIDR 7.1006425e-05
4,564 Relative Error Streaming Quantiles 2021 PODS 6.5317429e-05
4,925 TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems 2023 VLDB 6.3511742e-05
5,045 KLL± Approximate Quantile Sketches over Dynamic Datasets 2021 VLDB 6.3001279e-05
5,506 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 6.1016716e-05
6,217 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD 5.8474357e-05
6,236 Optimizing In-memory Database Engine for AI-powered On-line Decision Augmentation Using Persistent Memory 2021 VLDB 5.8409336e-05
6,662 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7171651e-05
9,153 Delta: Scalable Data Dissemination under Capacity Constraints 2014 VLDB 5.2176985e-05
9,709 Hippo: Sharing Computations in Hyper-Parameter Optimization 2022 VLDB 5.1372107e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,741 Machine Learning for Databases 2021 VLDB
2 654 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD
3 6,246 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB
4 7,201 Coresets over Multiple Tables for Feature-rich and Data-efficient Machine Learning 2023 VLDB
5 5,420 An Integrated Development Environment for Faster Feature Engineering 2014 VLDB
6 10,154 Structure-Aware Machine Learning over Multi-Relational Databases 2021 SIGMOD
7 6,217 Materialization and Reuse Optimizations for Production Data Science Pipelines 2022 SIGMOD
8 5,506 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB
9 9,179 FEBench: A Benchmark for Real-Time Relational Data Feature Extraction 2023 VLDB
10 7,544 The Hopsworks Feature Store for Machine Learning 2024 SIGMOD