DBScholar

Back to papers

In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle

Summary: Proposes CorgiPile, a hierarchical data shuffling method for in-database SGD that avoids full shuffles yet preserves convergence. Systematic study of existing shuffles, convergence theory, and PostgreSQL integration via three new operators; achieves 1.6–12.8× speedups over MADlib/Bismarck on HDD/SSD. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6524
Venue
SIGMOD
Year
2022
Pagerank
5.907165e-05
Overall Rank
6,339 | 56.51%
DOI
10.1145/3514221.3526150

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{xu_sigmod22,
        title = {{In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle}},
        author = {Xu, Lijie and Qiu, Shuang and Yuan, Binhang and Jiang, Jiawei and Renggli, Cedric and Gan, Shaoduo and Kara, Kaan and Li, Guoliang and Liu, Ji and Wu, Wentao and Ye, Jieping and Zhang, Ce},
        series = {{SIGMOD} '22},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3514221.3526150},
        url = {https://dl.acm.org/doi/10.1145/3514221.3526150},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank Citing Paper Year Venue Pagerank
9,470 Powering In-Database Dynamic Model Slicing for Structured Data Analytics 2024 VLDB 5.2634238e-05
10,114 Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates 2022 VLDB 5.1319012e-05
10,386 NeurStore: Efficient In-database Deep Learning Model Management System 2026 SIGMOD 5.093636e-05
10,844 GPEmu: A GPU Emulator for Faster and Cheaper Prototyping and Evaluation of Deep Learning System Research 2025 VLDB 5.093636e-05
11,209 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 20 of 20 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
106 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00033539462
518 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017167492
536 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.0001693369
715 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00014655327
835 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00013721583
993 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00012789598
1,150 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.00011943462
1,157 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00011924049
1,235 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00011548457
2,162 Heterogeneity-aware Distributed Parameter Servers 2017 SIGMOD 9.0581831e-05
2,347 Vertica-ML: Distributed Machine Learning in Vertica Database 2020 SIGMOD 8.7157552e-05
2,370 Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning 2019 VLDB 8.6795925e-05
2,786 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 8.1207221e-05
2,927 In-Database Learning with Sparse Tensors 2018 PODS 7.9531195e-05
3,334 F: Regression Models over Factorized Views 2016 VLDB 7.5110164e-05
4,067 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.9293511e-05
5,195 Tensor Relational Algebra for Distributed Machine Learning System Design 2021 VLDB 6.3232105e-05
6,046 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD 5.9956597e-05
6,143 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB 5.9622615e-05
9,840 Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees 2021 VLDB 5.2103367e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,446 Analyzing and Mitigating Data Stalls in DNN Training 2021 VLDB
2 6,271 Is Your Learned Query Optimizer Behaving As You Expect? A Machine Learning Perspective 2024 VLDB
3 6,708 Serving Deep Learning Models with Deduplication from Relational Databases 2022 VLDB
4 8,040 PerfGuard: Deploying ML-for-Systems without Performance Regressions, Almost! 2021 VLDB
5 6,485 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD
6 9,371 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB
7 9,962 Structure-Aware Machine Learning over Multi-Relational Databases 2021 SIGMOD
8 7,112 Coresets over Multiple Tables for Feature-rich and Data-efficient Machine Learning 2023 VLDB
9 6,143 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB
10 4,799 Scalable Asynchronous Gradient Descent Optimization for Out-of-Core Models 2017 VLDB