DBScholar

Back to papers

Data Management in Machine Learning: Challenges, Techniques, and Systems

Summary: Survey of data-management challenges and systems for ML workloads. Three lines of work: integrating ML with DBMS; adapting DB techniques to ML (queries, partitioning, compression); and combining data-management with ML lifecycles, plus open directions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5395
Venue
SIGMOD
Year
2017
Pagerank
0.00011485301
Overall Rank
1,250 | 91.43%
DOI
10.1145/3035918.3054775

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{kumar_sigmod17,
        title = {{Data Management in Machine Learning: Challenges, Techniques, and Systems}},
        author = {Kumar, Arun and Boehm, Matthias and Yang, Jun},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3054775},
        url = {https://dl.acm.org/doi/10.1145/3035918.3054775},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 32 of 32 citing papers.

Rank Citing Paper Year Venue Pagerank
1,157 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011924049
1,798 SMOKE: Fine-grained Lineage at Interactive Speed 2018 VLDB 9.7361937e-05
2,273 SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging 2021 SIGMOD 8.8230899e-05
2,823 Query Processing on Tensor Computation Runtimes 2022 VLDB 8.0893814e-05
2,847 AIDA - Abstraction for Advanced In-Database Analytics 2018 VLDB 8.0583142e-05
2,865 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.0180243e-05
2,888 AI Meets Database: AI4DB and DB4AI 2021 SIGMOD 7.9941489e-05
2,927 In-Database Learning with Sparse Tensors 2018 PODS 7.9531195e-05
3,206 Incremental View Maintenance with Triple Lock Factorization Benefits 2018 SIGMOD 7.6367549e-05
3,682 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.2035518e-05
3,947 Overton: A Data System for Monitoring and Improving Machine-Learned Products 2020 CIDR 7.0040437e-05
4,012 Opportunities for Quantum Acceleration of Databases: Optimization of Queries and Transaction Schedules 2023 VLDB 6.9578554e-05
4,100 Data Integration and Machine Learning: A Natural Synergy 2018 SIGMOD 6.9016092e-05
4,128 The Relational Data Borg is Learning 2020 VLDB 6.8850804e-05
4,409 MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions 2019 SIGMOD 6.7178579e-05
4,966 Rotom: A Meta-Learned Data Augmentation Framework for Entity Matching, Data Cleaning, Text Classification, and Beyond 2021 SIGMOD 6.4225454e-05
6,038 Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse 2018 VLDB 5.9990929e-05
6,143 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB 5.9622615e-05
6,315 Data Collection and Quality Challenges for Deep Learning 2020 VLDB 5.915447e-05
6,328 Functional-Style SQL UDFs With a Capital 'F' 2020 SIGMOD 5.9113895e-05
6,427 DeepBase: Deep Inspection of Neural Networks 2019 SIGMOD 5.8808145e-05
7,160 DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines 2022 CIDR 5.6855887e-05
7,734 Using VDMS to Index and Search 100M Images 2021 VLDB 5.5563709e-05
7,855 ItemSuggest: A Data Management Platform for Machine Learned Ranking Services 2019 CIDR 5.530673e-05
8,244 SHiFT: An Efficient, Flexible Search Engine for Transfer Learning 2023 VLDB 5.4587712e-05
8,722 Machine Learning Meets Big Spatial Data 2019 VLDB 5.3769871e-05
8,979 Cerebro: A Layered Data Platform for Scalable Deep Learning 2021 CIDR 5.3399615e-05
8,999 HADAD: A Lightweight Approach for Optimizing Hybrid Complex Analytics Queries 2021 SIGMOD 5.3354529e-05
9,214 ParaX: Boosting Deep Learning for Big Data Analytics on Many-Core CPUs 2021 VLDB 5.3058522e-05
9,993 In-Database Data Imputation 2024 SIGMOD 5.1815618e-05
11,537 Redundancy Elimination in Distributed Matrix Computation 2022 SIGMOD 5.093636e-05
11,674 Enforcing Constraints for Machine Learning Systems via Declarative Feature Selection: An Experimental Study 2021 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 63 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
20 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00056944564
106 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033539462
155 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028713176
234 Self-Driving Database Management Systems 2017 CIDR 0.00023810722
358 FAQ: Questions Asked Frequently 2016 PODS 0.00020243592
408 MauveDB: Supporting Model-based User Views in Database Systems 2006 SIGMOD 0.00019008806
415 SystemML: Declarative Machine Learning on Spark 2016 VLDB 0.0001888524
518 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017167492
532 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00017072641
536 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.0001693369
549 ERACER: A Database Approach for Statistical Inference and Data Cleaning 2010 SIGMOD 0.00016692839
579 Incremental Knowledge Base Construction Using DeepDive 2015 VLDB 0.00016217563
582 ActiveClean: Interactive Data Cleaning For Statistical Modeling 2016 VLDB 0.00016148948
640 Materialization Optimizations for Feature Selection Workloads 2014 SIGMOD 0.00015409494
669 The TileDB Array Data Storage Manager 2017 VLDB 0.00015163245
715 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014655327
764 To Join or Not to Join? Thinking Twice about Joins before Feature Selection 2016 SIGMOD 0.00014226652
835 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013721583
923 Starfish: A Self-tuning System for Big Data Analytics 2011 CIDR 0.00013189886
993 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00012789598
1,039 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012474977
1,043 Tuffy: Scaling up Statistical Inference in Markov Logic Networks using an RDBMS 2011 VLDB 0.0001244565
1,079 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012258469
1,150 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.00011943462
1,235 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011548457
1,442 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010778486
1,644 Compressed Linear Algebra for Large-Scale Machine Learning 2016 VLDB 0.00010132912
1,742 ArrayStore: A Storage Manager for Complex Parallel Array Processing 2011 SIGMOD 9.8748669e-05
1,792 MacroBase: Prioritizing Attention in Fast Data 2017 SIGMOD 9.7436856e-05
1,831 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems 2012 VLDB 9.6635729e-05
2,050 Vizdom: Interactive Analytics through Pen and Touch 2015 VLDB 9.2546631e-05
2,059 LINVIEW: Incremental View Maintenance for Complex Analytical Queries 2014 SIGMOD 9.2471145e-05
2,177 The Case for Predictive Database Systems: Opportunities and Challenges 2011 CIDR 9.0159844e-05
2,196 Spinning Fast Iterative Data Flows 2012 VLDB 8.9704984e-05
2,217 Cumulon: Optimizing Statistical Data Analysis in the Cloud 2013 SIGMOD 8.9332438e-05
2,604 Brainwash: A Data System for Feature Engineering 2013 CIDR 8.3524514e-05
2,717 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.2102313e-05
2,949 GenBase: A Complex Analytics Genomics Benchmark 2014 SIGMOD 7.9281519e-05
2,958 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.9197796e-05
3,284 SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning 2017 CIDR 7.5663058e-05
3,381 Ava: From Data to Insights Through Conversation 2017 CIDR 7.4571963e-05
3,493 Processing Forecasting Queries 2007 VLDB 7.3650273e-05
3,543 A Comparison of Platforms for Implementing and Running Very Large Scale Machine Learning Algorithms 2014 SIGMOD 7.3268101e-05
3,952 Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers 2013 SIGMOD 6.9967272e-05
4,049 Resource Elasticity for Large-Scale Machine Learning 2015 SIGMOD 6.9369379e-05
4,137 Optimizing I/O for Big Array Analytics 2012 VLDB 6.8783832e-05
4,214 The Missing Piece in Complex Analytics: Low Latency, Scalable Model Management and Serving with Velox 2015 CIDR 6.8276099e-05
4,859 Machine Learning for Big Data 2013 SIGMOD 6.4750538e-05
4,897 GLADE: Big Data Analytics Made Easy 2012 SIGMOD 6.4546134e-05
5,557 Demonstration of Santoku: Optimizing Machine Learning over Normalized Data 2015 VLDB 6.17499e-05
Previous Page 1 / 2 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,984 Is Data Management the Beating Heart of AI Systems? 2022 SIGMOD
2 4,592 Data Platform for Machine Learning 2019 SIGMOD
3 749 Data Lake Management: Challenges and Opportunities 2019 VLDB
4 7,661 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB
5 6,101 LLM for Data Management 2024 VLDB
6 8,328 Deep Learning: Systems and Responsibility 2021 SIGMOD
7 11,067 Machine Learning for Graph Data Management and Query Processing 2025 VLDB
8 8,676 Machine Learning for Data Management: Problems and Solutions 2018 SIGMOD
9 1,147 Data Management Challenges in Production Machine Learning 2017 SIGMOD
10 4,859 Machine Learning for Big Data 2013 SIGMOD