DBScholar

Back to papers

Data Management in Machine Learning: Challenges, Techniques, and Systems

Summary: Survey of data-management challenges and systems for ML workloads. Three lines of work: integrating ML with DBMS; adapting DB techniques to ML (queries, partitioning, compression); and combining data-management with ML lifecycles, plus open directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h3600472ff61e2e81
Venue
SIGMOD
Year
2017
Pagerank
0.00011432354
Overall Rank
1,226 | 91.79%
DOI
10.1145/3035918.3054775

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{kumar_sigmod17,
        title = {{Data Management in Machine Learning: Challenges, Techniques, and Systems}},
        author = {Kumar, Arun and Boehm, Matthias and Yang, Jun},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3054775},
        url = {https://dl.acm.org/doi/10.1145/3035918.3054775},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank Citing Paper Year Venue Pagerank
1,154 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011762688
1,722 SMOKE: Fine-grained Lineage at Interactive Speed 2018 VLDB 9.781628e-05
2,341 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 8.5984124e-05
2,464 Query Processing on Tensor Computation Runtimes 2022 VLDB 8.4081954e-05
2,672 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.1301225e-05
2,783 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0027405e-05
2,913 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.855786e-05
2,974 In-Database Learning with Sparse Tensors 2018 PODS 7.7812156e-05
3,122 Incremental View Maintenance with Triple Lock Factorization Benefits 2018 SIGMOD 7.6091671e-05
3,242 Opportunities for Quantum Acceleration of Databases: Optimization of Queries and Transaction Schedules 2023 VLDB 7.4811797e-05
3,746 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.0369561e-05
4,009 Overton: A Data System for Monitoring and Improving Machine-Learned Products 2020 CIDR 6.8427225e-05
4,174 The Relational Data Borg is Learning 2020 VLDB 6.750725e-05
4,186 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.7408641e-05
4,329 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.64569e-05
5,094 Data Collection and Quality Challenges for Deep Learning 2020 VLDB 6.264232e-05
5,100 Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond 2021 SIGMOD 6.2624729e-05
6,164 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB 5.8508462e-05
6,259 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB 5.815406e-05
6,413 Functional-Style SQL UDFs With a Capital 'F' 2020 SIGMOD 5.7764365e-05
6,573 DeepBase: Deep Inspection of Neural Networks 2019 SIGMOD 5.7271875e-05
6,902 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6365602e-05
7,918 Using VDMS to Index and Search 100M Images 2021 VLDB 5.4112841e-05
8,029 ItemSuggest: A Data Management Platform for Machine Learned Ranking Services 2019 CIDR 5.3871627e-05
8,435 SHiFT: An Efficient, Flexible Search Engine for Transfer Learning 2023 VLDB 5.3161281e-05
8,878 Machine Learning Meets Big Spatial Data 2019 VLDB 5.2449044e-05
9,175 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.2004231e-05
9,190 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 5.1972757e-05
9,319 ParaX: Boosting Deep Learning for Big Data Analytics on Many-Core CPUs 2021 VLDB 5.182871e-05
10,218 In-Database Data Imputation 2024 SIGMOD 5.0461625e-05
10,420 Rethinking Query Optimization for Multi-Agent Systems 2027 VLDB 4.9605343e-05
11,896 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 4.9605343e-05
12,031 Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study 2021 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 63 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
22 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00056028465
105 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033605348
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028524078
224 Self-Driving Database Management Systems 2017 CIDR 0.00023973185
357 FAQ: Questions Asked Frequently 2016 PODS 0.00020048899
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.00018619173
418 MauveDB: Supporting Model-based User Views in Database Systems 2006 SIGMOD 0.00018567032
460 ActiveClean: Interactive Data Cleaning For Statistical Modeling 2016 VLDB 0.00017836918
506 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017158546
522 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016893112
538 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00016725463
544 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00016584014
569 Incremental Knowledge Base Construction Using DeepDive 2015 VLDB 0.00016212139
656 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015052106
675 The TileDB Array Data Storage Manager 2017 VLDB 0.00014843089
731 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014363943
783 To Join or Not to Join? Thinking Twice about Joins before Feature Selection 2016 SIGMOD 0.00014015599
851 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013448823
944 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00012927479
1,009 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00012518224
1,050 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012291671
1,067 Tuffy: Scaling up Statistical Inference in Markov Logic Networks using an RDBMS 2011 VLDB 0.00012170631
1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012089325
1,169 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.00011690039
1,200 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011524945
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
1,615 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010054378
1,786 ArrayStore: A Storage Manager for Complex Parallel Array Processing 2011 SIGMOD 9.6344047e-05
1,840 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems 2012 VLDB 9.5171028e-05
1,844 MacroBase: Prioritizing Attention in Fast Data 2017 SIGMOD 9.5112726e-05
2,083 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.0563677e-05
2,108 Vizdom: Interactive Analytics through Pen and Touch 2015 VLDB 9.0229444e-05
2,220 The Case for Predictive Database Systems: Opportunities and Challenges 2011 CIDR 8.8121054e-05
2,240 Spinning Fast Iterative Data Flows 2012 VLDB 8.7716808e-05
2,250 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.7477605e-05
2,596 Brainwash: A Data System for Feature Engineering 2013 CIDR 8.2258492e-05
2,758 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0283838e-05
2,892 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.8872299e-05
3,018 GenBase: A Complex Analytics Genomics Benchmark 2014 SIGMOD 7.7318102e-05
3,331 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.4065701e-05
3,423 Ava: From Data to Insights Through Conversation 2017 CIDR 7.2974827e-05
3,571 Processing Forecasting Queries 2007 VLDB 7.17962e-05
3,577 A Comparison of Platforms for Implementing and Running Very Large Scale Machine Learning Algorithms 2014 SIGMOD 7.1748186e-05
4,046 Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers 2013 SIGMOD 6.8182709e-05
4,134 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.7721426e-05
4,231 Optimizing I/O for Big Array Analytics 2012 VLDB 6.7050212e-05
4,316 The Missing Piece in Complex Analytics: Low Latency, Scalable Model Management and Serving with Velox 2015 CIDR 6.6542348e-05
4,960 Machine Learning for Big Data 2013 SIGMOD 6.3246987e-05
4,993 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.3109925e-05
5,684 Demonstration of Santoku: Optimizing Machine Learning over Normalized Data 2015 VLDB 6.02198e-05
Previous Page 1 / 2 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,213 Is Data Management the Beating Heart of AI Systems? 2022 SIGMOD
2 4,687 Data Platform for Machine Learning 2019 SIGMOD
3 623 Data Lake Management: Challenges and Opportunities 2019 VLDB
4 7,830 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB
5 4,729 LLM for Data Management 2024 VLDB
6 8,502 Deep Learning: Systems and Responsibility 2021 SIGMOD
7 9,103 Machine Learning for Graph Data Management and Query Processing 2025 VLDB
8 8,867 Machine Learning for Data Management: Problems and Solutions 2018 SIGMOD
9 1,151 Data Management Challenges in Production Machine Learning 2017 SIGMOD
10 4,960 Machine Learning for Big Data 2013 SIGMOD