DBScholar

Back to papers

Data Management in Machine Learning: Challenges, Techniques, and Systems

Summary: Survey of data-management challenges and systems for ML workloads. Three lines of work: integrating ML with DBMS; adapting DB techniques to ML (queries, partitioning, compression); and combining data-management with ML lifecycles, plus open directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h3600472ff61e2e81
Venue
SIGMOD
Year
2017
Pagerank
0.00011468426
Overall Rank
1,223 | 91.79%
DOI
10.1145/3035918.3054775

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{kumar_sigmod17,
        title = {{Data Management in Machine Learning: Challenges, Techniques, and Systems}},
        author = {Kumar, Arun and Boehm, Matthias and Yang, Jun},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3054775},
        url = {https://dl.acm.org/doi/10.1145/3035918.3054775},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank Citing Paper Year Venue Pagerank
1,152 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011796404
1,713 SMOKE: Fine-grained Lineage at Interactive Speed 2018 VLDB 9.8129981e-05
2,329 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 8.6268411e-05
2,460 Query Processing on Tensor Computation Runtimes 2022 VLDB 8.4308406e-05
2,661 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.1568473e-05
2,778 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0261532e-05
2,908 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.8716173e-05
2,978 In-Database Learning with Sparse Tensors 2018 PODS 7.7872011e-05
3,114 Incremental View Maintenance with Triple Lock Factorization Benefits 2018 SIGMOD 7.6321464e-05
3,228 Opportunities for Quantum Acceleration of Databases: Optimization of Queries and Transaction Schedules 2023 VLDB 7.5059992e-05
3,739 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.0595382e-05
3,998 Overton: A Data System for Monitoring and Improving Machine-Learned Products 2020 CIDR 6.862274e-05
4,161 The Relational Data Borg is Learning 2020 VLDB 6.7669004e-05
4,171 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.7576159e-05
4,330 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.6564176e-05
5,074 Data Collection and Quality Challenges for Deep Learning 2020 VLDB 6.2850141e-05
5,078 Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond 2021 SIGMOD 6.2832055e-05
6,146 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB 5.869373e-05
6,249 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB 5.8343283e-05
6,402 Functional-Style SQL UDFs With a Capital 'F' 2020 SIGMOD 5.7953646e-05
6,561 DeepBase: Deep Inspection of Neural Networks 2019 SIGMOD 5.7461874e-05
6,883 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6552024e-05
7,901 Using VDMS to Index and Search 100M Images 2021 VLDB 5.4291648e-05
8,017 ItemSuggest: A Data Management Platform for Machine Learned Ranking Services 2019 CIDR 5.4046581e-05
8,418 SHiFT: An Efficient, Flexible Search Engine for Transfer Learning 2023 VLDB 5.3337649e-05
8,857 Machine Learning Meets Big Spatial Data 2019 VLDB 5.2621882e-05
9,153 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.217676e-05
9,166 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 5.2144986e-05
9,296 ParaX: Boosting Deep Learning for Big Data Analytics on Many-Core CPUs 2021 VLDB 5.2000636e-05
10,185 In-Database Data Imputation 2024 SIGMOD 5.0629036e-05
10,353 Rethinking Query Optimization for Multi-Agent Systems 2027 VLDB 4.9769913e-05
11,852 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9769913e-05
11,987 Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study 2021 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 63 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
22 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00055938421
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033633007
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028568843
224 Self-Driving Database Management Systems 2017 CIDR 0.00024011047
357 FAQ: Questions Asked Frequently 2016 PODS 0.00020013731
416 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018650998
417 MauveDB: Supporting Model-based User Views in Database Systems 2006 SIGMOD 0.00018625112
483 ActiveClean: Interactive Data Cleaning For Statistical Modeling 2016 VLDB 0.00017584249
503 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017195428
521 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016923519
537 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00016762761
548 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00016572863
579 Incremental Knowledge Base Construction Using DeepDive 2015 VLDB 0.00016083582
654 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015096817
673 The TileDB Array Data Storage Manager 2017 VLDB 0.00014891415
731 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014400356
779 To Join or Not to Join? Thinking Twice about Joins before Feature Selection 2016 SIGMOD 0.00014048128
851 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013453278
940 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00012959992
1,009 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.0001253551
1,045 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012327118
1,063 Tuffy: Scaling up Statistical Inference in Markov Logic Networks using an RDBMS 2011 VLDB 0.00012208
1,082 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012118261
1,167 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.0001172597
1,257 Towards Linear Algebra over Normalized Data 2017 VLDB 0.0001130959
1,445 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010628379
1,614 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010067153
1,774 ArrayStore: A Storage Manager for Complex Parallel Array Processing 2011 SIGMOD 9.6661993e-05
1,833 MacroBase: Prioritizing Attention in Fast Data 2017 SIGMOD 9.5376219e-05
1,842 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems 2012 VLDB 9.5247433e-05
2,087 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.0661817e-05
2,097 Vizdom: Interactive Analytics through Pen and Touch 2015 VLDB 9.0525341e-05
2,211 The Case for Predictive Database Systems: Opportunities and Challenges 2011 CIDR 8.8308259e-05
2,228 Spinning Fast Iterative Data Flows 2012 VLDB 8.7996087e-05
2,249 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7544468e-05
2,587 Brainwash: A Data System for Feature Engineering 2013 CIDR 8.2523942e-05
2,753 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0513412e-05
2,983 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.7831414e-05
3,008 GenBase: A Complex Analytics Genomics Benchmark 2014 SIGMOD 7.757408e-05
3,331 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.4138851e-05
3,420 Ava: From Data to Insights Through Conversation 2017 CIDR 7.3130183e-05
3,562 Processing Forecasting Queries 2007 VLDB 7.2023796e-05
3,585 A Comparison of Platforms for Implementing and Running Very Large Scale Machine Learning Algorithms 2014 SIGMOD 7.187207e-05
4,029 Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers 2013 SIGMOD 6.840359e-05
4,117 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7929814e-05
4,214 Optimizing I/O for Big Array Analytics 2012 VLDB 6.7268411e-05
4,300 The Missing Piece in Complex Analytics: Low Latency, Scalable Model Management and Serving with Velox 2015 CIDR 6.676283e-05
4,935 Machine Learning for Big Data 2013 SIGMOD 6.3447168e-05
5,002 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.3183539e-05
5,683 Demonstration of Santoku: Optimizing Machine Learning over Normalized Data 2015 VLDB 6.0369434e-05
Previous Page 1 / 2 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,179 Is Data Management the Beating Heart of AI Systems? 2022 SIGMOD
2 4,675 Data Platform for Machine Learning 2019 SIGMOD
3 624 Data Lake Management: Challenges and Opportunities 2019 VLDB
4 7,813 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB
5 4,727 LLM for Data Management 2024 VLDB
6 8,487 Deep Learning: Systems and Responsibility 2021 SIGMOD
7 9,082 Machine Learning for Graph Data Management and Query Processing 2025 VLDB
8 8,848 Machine Learning for Data Management: Problems and Solutions 2018 SIGMOD
9 1,153 Data Management Challenges in Production Machine Learning 2017 SIGMOD
10 4,935 Machine Learning for Big Data 2013 SIGMOD