Database Paper Browser

Back to papers

Data Management in Machine Learning: Challenges, Techniques, and Systems

Summary: Survey of data-management challenges and systems for ML workloads. Three lines of work: integrating ML with DBMS; adapting DB techniques to ML (queries, partitioning, compression); and combining data-management with ML lifecycles, plus open directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5334
Venue
SIGMOD
Year
2017
Pagerank
0.00011462072
Overall Rank
1,534 | 89.35%
DOI
10.1145/3035918.3054775

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank Citing Paper Year Venue Pagerank
684 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00018152321
1,942 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 0.00010010569
2,286 SMOKE: Fine-grained Lineage at Interactive Speed 2018 VLDB 9.102574e-05
2,939 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 7.8514162e-05
3,152 Opportunities for Quantum Acceleration of Databases: Optimization of Queries and Transaction Schedules 2023 VLDB 7.4709765e-05
3,260 Query Processing on Tensor Computation Runtimes 2022 VLDB 7.3091312e-05
3,409 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 7.1240791e-05
3,466 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.0645718e-05
4,040 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 6.5052227e-05
4,197 Overton: A Data System for Monitoring and Improving Machine-Learned Products 2020 CIDR 6.3625568e-05
4,200 Incremental View Maintenance with Triple Lock Factorization Benefits 2018 SIGMOD 6.3618329e-05
4,596 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.0540725e-05
4,787 The Relational Data Borg is Learning 2020 VLDB 5.9168117e-05
4,835 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 5.8861112e-05
5,974 Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond 2021 SIGMOD 5.2458154e-05
6,329 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB 5.1030159e-05
6,371 DeepBase: Deep Inspection of Neural Networks 2019 SIGMOD 5.0880545e-05
6,400 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB 5.0739311e-05
6,526 Data Collection and Quality Challenges for Deep Learning 2020 VLDB 5.0219175e-05
6,646 Functional-Style SQL UDFs With a Capital 'F' 2020 SIGMOD 4.9734285e-05
7,303 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 4.7632836e-05
7,367 Using VDMS to Index and Search 100M Images 2021 VLDB 4.7459078e-05
7,411 ItemSuggest: A Data Management Platform for Machine Learned Ranking Services 2019 CIDR 4.7319005e-05
8,183 SHiFT: An Efficient, Flexible Search Engine for Transfer Learning 2023 VLDB 4.5615358e-05
8,784 Machine Learning Meets Big Spatial Data 2019 VLDB 4.4473392e-05
8,864 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 4.4283952e-05
8,981 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 4.4138435e-05
9,071 ParaX: Boosting Deep Learning for Big Data Analytics on Many-Core CPUs 2021 VLDB 4.3978166e-05
9,855 In-Database Data Imputation 2024 SIGMOD 4.2652623e-05
11,341 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.1905499e-05
11,480 Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study 2021 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 63 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
39 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00075263552
139 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00042320525
169 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00038967371
371 Self-Driving Database Management Systems 2017 CIDR 0.00025382677
468 MauveDB: Supporting Model-based User Views in Database Systems 2006 SIGMOD 0.00022407392
543 MLbase: A Distributed Machine-learning System 2013 CIDR 0.0002050918
557 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00020186115
564 FAQ: Questions Asked Frequently 2016 PODS 0.00020002796
638 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00018810785
656 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00018590675
668 Incremental Knowledge Base Construction Using DeepDive 2015 VLDB 0.00018428925
731 The TileDB Array Data Storage Manager 2017 VLDB 0.0001743996
758 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00017053915
788 ActiveClean: Interactive Data Cleaning For Statistical Modeling 2016 VLDB 0.00016618698
832 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016089705
851 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00015909639
901 To Join or Not to Join? Thinking Twice about Joins before Feature Selection 2016 SIGMOD 0.00015462938
1,015 Tuffy: Scaling up Statistical Inference in Markov Logic Networks using an RDBMS 2011 VLDB 0.00014630577
1,044 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.00014465007
1,048 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00014442178
1,074 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00014238255
1,165 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00013567206
1,172 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00013504249
1,283 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00012826013
1,407 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012163413
1,875 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010243959
1,878 ArrayStore: A Storage Manager for Complex Parallel Array Processing 2011 SIGMOD 0.00010229691
1,970 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 9.9024431e-05
2,085 The Case for Predictive Database Systems: Opportunities and Challenges 2011 CIDR 9.5749968e-05
2,129 MacroBase: Prioritizing Attention in Fast Data 2017 SIGMOD 9.4799835e-05
2,179 Spinning Fast Iterative Data Flows 2012 VLDB 9.3632007e-05
2,253 Vizdom: Interactive Analytics through Pen and Touch 2015 VLDB 9.1886315e-05
2,260 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.1771829e-05
2,309 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems 2012 VLDB 9.0630462e-05
2,627 GenBase: A Complex Analytics Genomics Benchmark 2014 SIGMOD 8.4292895e-05
2,672 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.3334428e-05
2,823 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0593793e-05
2,919 Brainwash: A Data System for Feature Engineering 2013 CIDR 7.9017482e-05
3,222 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.3531422e-05
3,451 Processing Forecasting Queries 2007 VLDB 7.0798147e-05
3,460 A Comparison of Platforms for Implementing and Running Very Large Scale Machine Learning Algorithms 2014 SIGMOD 7.0702034e-05
3,632 Ava: From Data to Insights Through Conversation 2017 CIDR 6.8961387e-05
4,079 Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers 2013 SIGMOD 6.4621024e-05
4,254 Optimizing I/O for Big Array Analytics 2012 VLDB 6.3084831e-05
4,508 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 6.1261819e-05
4,575 The Missing Piece in Complex Analytics: Low Latency, Scalable Model Management and Serving with Velox 2015 CIDR 6.0662145e-05
4,794 Demonstration of Santoku: Optimizing Machine Learning over Normalized Data 2015 VLDB 5.910645e-05
4,807 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 5.9045148e-05
4,913 Machine Learning for Big Data 2013 SIGMOD 5.8320287e-05
5,300 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 5.5751386e-05
Previous Page 1 / 2 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
9,834 Is Data Management the Beating Heart of AI Systems? 2022 SIGMOD 4.2706095e-05
4,006 Data Platform for Machine Learning 2019 SIGMOD 6.5371762e-05
936 Data Lake Management: Challenges and Opportunities 2019 VLDB 0.00015197838
7,652 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 4.6831938e-05
7,016 LLM for Data Management 2024 VLDB 4.8561622e-05
8,340 Deep Learning: Systems and Responsibility 2021 SIGMOD 4.5381546e-05
10,847 Machine Learning for Graph Data Management and Query Processing 2025 VLDB 4.1905499e-05
8,637 Machine Learning for Data Management: Problems and Solutions 2018 SIGMOD 4.4755972e-05
1,422 Data Management Challenges in Production Machine Learning 2017 SIGMOD 0.00012050431
4,913 Machine Learning for Big Data 2013 SIGMOD 5.8320287e-05