Data Management in Machine Learning: Challenges, Techniques, and Systems

Summary: Survey of data-management challenges and systems for ML workloads. Three lines of work: integrating ML with DBMS; adapting DB techniques to ML (queries, partitioning, compression); and combining data-management with ML lifecycles, plus open directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5334
Venue: SIGMOD
Year: 2017
Pagerank: 0.00011462072
Overall Rank: 1,534 | 89.35%
DOI: 10.1145/3035918.3054775

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
684	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00018152321
1,942	SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging	2021	SIGMOD	0.00010010569
2,286	SMOKE: Fine-grained Lineage at Interactive Speed	2018	VLDB	9.102574e-05
2,939	AIDA - Abstraction for Advanced In-Database Analytics	2018	VLDB	7.8514162e-05
3,152	Opportunities for Quantum Acceleration of Databases: Optimization of Queries and Transaction Schedules	2023	VLDB	7.4709765e-05
3,260	Query Processing on Tensor Computation Runtimes	2022	VLDB	7.3091312e-05
3,409	End-to-end Optimization of Machine Learning Prediction Queries	2022	SIGMOD	7.1240791e-05
3,466	AI Meets Database: AI4DB and DB4AI	2021	SIGMOD	7.0645718e-05
4,040	In-RDBMS Hardware Acceleration of Advanced Analytics	2018	VLDB	6.5052227e-05
4,197	Overton: A Data System for Monitoring and Improving Machine-Learned Products	2020	CIDR	6.3625568e-05
4,200	Incremental View Maintenance with Triple Lock Factorization Benefits	2018	SIGMOD	6.3618329e-05
4,596	Data Integration and Machine Learning: A Natural Synergy	2018	SIGMOD	6.0540725e-05
4,787	The Relational Data Borg is Learning	2020	VLDB	5.9168117e-05
4,835	MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions	2019	SIGMOD	5.8861112e-05
5,974	Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond	2021	SIGMOD	5.2458154e-05
6,329	Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse	2018	VLDB	5.1030159e-05
6,371	DeepBase: Deep Inspection of Neural Networks	2019	SIGMOD	5.0880545e-05
6,400	ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation	2019	VLDB	5.0739311e-05
6,526	Data Collection and Quality Challenges for Deep Learning	2020	VLDB	5.0219175e-05
6,646	Functional-Style SQL UDFs With a Capital 'F'	2020	SIGMOD	4.9734285e-05
7,303	DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines	2022	CIDR	4.7632836e-05
7,367	Using VDMS to Index and Search 100M Images	2021	VLDB	4.7459078e-05
7,411	ItemSuggest: A Data Management Platform for Machine Learned Ranking Services	2019	CIDR	4.7319005e-05
8,183	SHiFT: An Efficient, Flexible Search Engine for Transfer Learning	2023	VLDB	4.5615358e-05
8,784	Machine Learning Meets Big Spatial Data	2019	VLDB	4.4473392e-05
8,864	Cerebro: A Layered Data Platform for Scalable Deep Learning	2021	CIDR	4.4283952e-05
8,981	HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries	2021	SIGMOD	4.4138435e-05
9,071	ParaX: Boosting Deep Learning for Big Data Analytics on Many-Core CPUs	2021	VLDB	4.3978166e-05
9,855	In-Database Data Imputation	2024	SIGMOD	4.2652623e-05
11,341	Redundancy Elimination in Distributed Matrix Computation	2022	SIGMOD	4.1905499e-05
11,480	Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study	2021	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 63 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
5,400	Large-scale Predictive Analytics in Vertica: Fast Data Transfer, Distributed Model Creation, and In-database Prediction	2015	SIGMOD	5.5262667e-05
5,860	Active and Accelerated Learning of Cost Models for Optimizing Scientific Applications	2006	VLDB	5.2961021e-05
5,884	Incrementally Maintaining Classification using an RDBMS	2011	VLDB	5.2864334e-05
6,321	The BUDS Language for Distributed Bayesian Machine Learning	2017	SIGMOD	5.1075833e-05
6,706	Big Graph Analytics Systems	2016	SIGMOD	4.9501419e-05
6,783	SparkR: Scaling R Programs with Spark	2016	SIGMOD	4.9221272e-05
6,889	ATLAS: a Small but Complete SQL Extension for Data Mining and Data Streams	2003	VLDB	4.8900881e-05
7,828	Measuring and Optimizing Distributed Array Programs	2016	VLDB	4.6374634e-05
9,432	Storing Matrices on Disk: Theory and Practice Revisited	2011	VLDB	4.3399748e-05
9,585	Introduction to Spark 2.0 for Database Researchers	2016	SIGMOD	4.31773e-05
9,586	One-pass Data Mining Algorithms in a DBMS with UDFs	2011	SIGMOD	4.31773e-05
9,587	A Skip-list Approach for Efficiently Processing Forecasting Queries	2008	VLDB	4.31773e-05
9,949	Cumulon: Matrix-Based Data Analytics in the Cloud with Spot Instances	2016	VLDB	4.2391069e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
9,834	Is Data Management the Beating Heart of AI Systems?	2022	SIGMOD	4.2706095e-05
4,006	Data Platform for Machine Learning	2019	SIGMOD	6.5371762e-05
936	Data Lake Management: Challenges and Opportunities	2019	VLDB	0.00015197838
7,652	Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward	2021	VLDB	4.6831938e-05
7,016	LLM for Data Management	2024	VLDB	4.8561622e-05
8,340	Deep Learning: Systems and Responsibility	2021	SIGMOD	4.5381546e-05
10,847	Machine Learning for Graph Data Management and Query Processing	2025	VLDB	4.1905499e-05
8,637	Machine Learning for Data Management: Problems and Solutions	2018	SIGMOD	4.4755972e-05
1,422	Data Management Challenges in Production Machine Learning	2017	SIGMOD	0.00012050431
4,913	Machine Learning for Big Data	2013	SIGMOD	5.8320287e-05