Database Paper Browser

Back to papers

In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle

Summary: Proposes CorgiPile, a hierarchical data shuffling method for in-database SGD that avoids full shuffles yet preserves convergence. Systematic study of existing shuffles, convergence theory, and PostgreSQL integration via three new operators; achieves 1.6–12.8× speedups over MADlib/Bismarck on HDD/SSD. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6463
Venue
SIGMOD
Year
2022
Pagerank
5.0009513e-05
Overall Rank
6,573 | 54.32%
DOI
10.1145/3514221.3526150

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank Citing Paper Year Venue Pagerank
9,325 Powering In-Database Dynamic Model Slicing for Structured Data Analytics 2024 VLDB 4.351469e-05
9,965 Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates 2022 VLDB 4.2229209e-05
10,095 NeurStore: Efficient In-database Deep Learning Model Management System 2026 SIGMOD 4.1905499e-05
10,589 GPEmu: A GPU Emulator for Faster and Cheaper Prototyping and Evaluation of Deep Learning System Research 2025 VLDB 4.1905499e-05
11,001 Database Native Model Selection: Harnessing Deep Neural Networks in Database Systems 2024 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
139 The MADlib Analytics Library or MAD Skills, the SQL 2012 VLDB 0.00042320525
638 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00018810785
684 Cerebro: A Data System for Optimized Deep Learning Model Selection 2020 VLDB 0.00018152321
832 Learning Linear Regression Models over Factorized Joins 2016 SIGMOD 0.00016089705
851 Scaling Factorization Machines to Relational Data 2013 VLDB 0.00015909639
1,044 DimmWitted: A Study of Main-Memory Statistical Analytics 2014 VLDB 0.00014465007
1,165 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00013567206
1,172 Learning Generalized Linear Models Over Normalized Data 2015 SIGMOD 0.00013504249
1,283 Towards Linear Algebra over Normalized Data 2017 VLDB 0.00012826013
1,946 Heterogeneity-aware Distributed Parameter Servers 2017 SIGMOD 9.9983926e-05
2,660 Vertica-ML: Distributed Machine Learning in Vertica Database 2020 SIGMOD 8.3614044e-05
3,122 DB4ML – An In-Memory Database Kernel with Machine Learning Support 2020 SIGMOD 7.5284233e-05
4,195 F: Regression Models over Factorized Views 2016 VLDB 6.3635322e-05
4,601 Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches 2021 VLDB 6.05274e-05
5,836 Tensor Relational Algebra for Distributed Machine Learning System Design 2021 VLDB 5.3079723e-05
6,194 Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra 2021 SIGMOD 5.1592984e-05
6,400 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB 5.0739311e-05
9,705 Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees 2021 VLDB 4.2951758e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
1,500 Analyzing and Mitigating Data Stalls in DNN Training 2021 VLDB 0.00011636174
7,009 Is Your Learned Query Optimizer Behaving As You Expect? A Machine Learning Perspective 2024 VLDB 4.8597992e-05
7,055 Serving Deep Learning Models with Deduplication from Relational Databases 2022 VLDB 4.8428976e-05
8,219 PerfGuard: Deploying ML-for-Systems without Performance Regressions, Almost! 2021 VLDB 4.551524e-05
6,535 Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent 2019 SIGMOD 5.0184189e-05
9,225 Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning 2021 VLDB 4.3656789e-05
9,775 Structure-Aware Machine Learning over Multi-Relational Databases 2021 SIGMOD 4.2815042e-05
7,180 Coresets over Multiple Tables for Feature-rich and Data-efficient Machine Learning 2023 VLDB 4.8032775e-05
6,400 ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation 2019 VLDB 5.0739311e-05
4,394 Scalable Asynchronous Gradient Descent Optimization for Out-of-Core Models 2017 VLDB 6.2173726e-05