Database Paper Browser

Back to papers

Data Management Challenges in Production Machine Learning

Summary: Survey of data-management challenges in production ML pipelines, focusing on understanding, validating, cleaning, and enriching training data. Connects to database literature and outlines open questions on data quality, provenance, validation, and enrichment not yet addressed by prior art. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5341
Venue
SIGMOD
Year
2017
Pagerank
0.00012050431
Overall Rank
1,422 | 90.12%
DOI
10.1145/3035918.3054782

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 27 of 27 citing papers.

Rank Citing Paper Year Venue Pagerank
1,481 Automating Large-Scale Data Quality Verification 2018 VLDB 0.00011715754
1,891 Towards Model-based Pricing for Machine Learning in a Data Marketplace 2019 SIGMOD 0.0001018452
1,942 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 0.00010010569
2,456 Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities 2021 SIGMOD 8.7649259e-05
2,759 Complaint-driven Training Data Debugging for Query 2.0 2020 SIGMOD 8.1646193e-05
3,152 Opportunities for Quantum Acceleration of Databases: Optimization of Queries and Transaction Schedules 2023 VLDB 7.4709765e-05
4,123 Are Key-Foreign Key Joins Safe to Avoid when Learning High-Capacity Classifiers? 2018 VLDB 6.4290005e-05
4,200 Incremental View Maintenance with Triple Lock Factorization Benefits 2018 SIGMOD 6.3618329e-05
4,423 PrIU: A Provenance-Based Approach for Incrementally Updating Regression Models 2020 SIGMOD 6.1925724e-05
4,596 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.0540725e-05
4,787 The Relational Data Borg is Learning 2020 VLDB 5.9168117e-05
4,866 OmniFair: A Declarative System for Model-Agnostic Group Fairness in Machine Learning 2021 SIGMOD 5.8620848e-05
5,227 Enabling SQL-based Training Data Debugging for Federated Learning 2022 VLDB 5.6156523e-05
5,615 TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems 2023 VLDB 5.409e-05
5,729 Survivability of Cloud Databases - Factors and Prediction 2018 SIGMOD 5.3499416e-05
6,139 Finding Label and Model Errors in Perception Data With Learned Observation Assertions 2022 SIGMOD 5.1893488e-05
6,526 Data Collection and Quality Challenges for Deep Learning 2020 VLDB 5.0219175e-05
6,991 Unit Testing Data with Deequ 2019 SIGMOD 4.8646637e-05
7,241 Data Integration and Machine Learning: A Natural Synergy 2018 VLDB 4.7867685e-05
7,411 ItemSuggest: A Data Management Platform for Machine Learned Ranking Services 2019 CIDR 4.7319005e-05
7,840 Auto-Validate: Unsupervised Data Validation Using Data-Domain Patterns Inferred from Data Lakes 2021 SIGMOD 4.6337164e-05
8,096 Saga: A Scalable Framework for Optimizing Data Cleaning Pipelines for Machine Learning Applications 2023 SIGMOD 4.583522e-05
8,515 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 4.4901466e-05
9,116 Towards Observability for Production Machine Learning Pipelines 2022 VLDB 4.3886184e-05
11,319 Data Management Opportunities for Foundation Models 2022 CIDR 4.1905499e-05
11,491 Toto - Benchmarking the Efficiency of a Cloud Service 2021 SIGMOD 4.1905499e-05
13,313 DEEM 2019: Workshop on Data Management for End-to-End Machine Learning 2019 SIGMOD -
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
423 Tuning Database Configuration Parameters with iTuned 2009 VLDB 0.00023628474
430 Approximate Query Processing: Taming the TeraBytes! A Tutorial 2001 VLDB 0.00023406426
461 SeeDB: Efficient Data-Driven Visualization Recommendations to Support Visual Analytics 2015 VLDB 0.00022615628
609 Goods: Organizing Google's Datasets 2016 SIGMOD 0.00019223217
788 ActiveClean: Interactive Data Cleaning For Statistical Modeling 2016 VLDB 0.00016618698
901 To Join or Not to Join? Thinking Twice about Joins before Feature Selection 2016 SIGMOD 0.00015462938
1,001 Intelligent Rollups in Multidimensional OLAP Data 2001 VLDB 0.00014709145
1,137 User-adaptive exploration of multidimensional data 2000 VLDB 0.0001373991
1,164 Querying and Mining of Time Series Data: Experimental Comparison of Representations and Distance Measures 2008 VLDB 0.00013572951
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
11,319 Data Management Opportunities for Foundation Models 2022 CIDR 4.1905499e-05
6,225 Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems 2021 VLDB 5.1425119e-05
10,846 ML-Asset Management: Curation, Discovery, and Utilization 2025 VLDB 4.1905499e-05
4,913 Machine Learning for Big Data 2013 SIGMOD 5.8320287e-05
936 Data Lake Management: Challenges and Opportunities 2019 VLDB 0.00015197838
9,116 Towards Observability for Production Machine Learning Pipelines 2022 VLDB 4.3886184e-05
6,526 Data Collection and Quality Challenges for Deep Learning 2020 VLDB 5.0219175e-05
7,652 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 4.6831938e-05
2,456 Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities 2021 SIGMOD 8.7649259e-05
1,534 Data Management in Machine Learning: Challenges, Techniques, and Systems 2017 SIGMOD 0.00011462072