Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent

Summary: Proposes tuple-oriented compression (TOC) for mini-batch SGD, preserving tuple boundaries while using LZW-inspired coding. Enables compressed-domain matrix operations on TOC, delivering up to 51x compression and 10.2x speedups for MGD workloads with no decompression overhead. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5601
Venue: SIGMOD
Year: 2019
Pagerank: 5.023239e-05
Overall Rank: 6,538 | 54.52%
DOI: 10.1145/3299869.3300070

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 8 of 8 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
683	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00018195476
1,940	SliceLine: Fast, Linear-Algebra-based Slice Finding for ML Model Debugging	2021	SIGMOD	0.00010020173
4,557	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.087611e-05
7,704	ExDRa: Exploratory Data Science on Federated Raw Data	2021	SIGMOD	4.6733838e-05
8,786	AWARE: Workload-aware, Redundancy-exploiting Linear Algebra	2023	SIGMOD	4.4521262e-05
8,864	Cerebro: A Layered Data Platform for Scalable Deep Learning	2021	CIDR	4.4326439e-05
10,286	QStore: Quantization-Aware Compressed Model Storage	2026	VLDB	4.1945683e-05
10,291	Morphing-based Compression for Data-centric ML Pipelines	2026	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
131	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0004370331
140	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00042270404
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031420034
543	MLbase: A Distributed Machine-learning System	2013	CIDR	0.00020526854
658	Towards a Unified Architecture for in-RDBMS Analytics	2012	SIGMOD	0.00018506577
834	Learning Linear Regression Models over Factorized Joins	2016	SIGMOD	0.00016135159
903	To Join or Not to Join? Thinking Twice about Joins before Feature Selection	2016	SIGMOD	0.0001547016
1,158	Simulation of Database-Valued Markov Chains Using SimSQL	2013	SIGMOD	0.0001361064
1,167	Learning Generalized Linear Models Over Normalized Data	2015	SIGMOD	0.00013547713
1,270	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.00012926086
1,279	Towards Linear Algebra over Normalized Data	2017	VLDB	0.00012868394
1,402	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB	0.00012180605
1,967	Compressed Linear Algebra for Large-Scale Machine Learning	2016	VLDB	9.9131712e-05
2,862	An Experimental Study of Bitmap Compression vs. Inverted List Compression	2017	SIGMOD	7.9898539e-05
3,638	Bolt-on Differential Privacy for Scalable Stochastic Gradient Descent-based Analytics	2017	SIGMOD	6.8952488e-05
4,395	Scalable Asynchronous Gradient Descent Optimization for Out-of-Core Models	2017	VLDB	6.2244283e-05
6,986	A Cost-based Optimizer for Gradient Descent Optimization	2017	SIGMOD	4.8727048e-05
7,171	Leveraging Compression in the Tableau Data Engine	2014	SIGMOD	4.8117476e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,808	SketchML: Accelerating Distributed Machine Learning with Data Sketches	2018	SIGMOD	6.7455428e-05
8,786	AWARE: Workload-aware, Redundancy-exploiting Linear Algebra	2023	SIGMOD	4.4521262e-05
3,745	DeepSqueeze: Deep Semantic Compression for Tabular Data	2020	SIGMOD	6.7926132e-05
7,429	CompressDB: Enabling Efficient Compressed Data Direct Processing for Various Databases	2022	SIGMOD	4.7320139e-05
1,100	Query Optimization In Compressed Database Systems	2001	SIGMOD	0.00014072277
11,574	An Evaluation of Methods of Compressing Doubles	2020	SIGMOD	4.1945683e-05
9,595	High-Ratio Compression for Machine-Generated Data	2023	SIGMOD	4.3194469e-05
9,408	Experimental Analysis of Large-scale Learnable Vector Storage Compression	2024	VLDB	4.3441378e-05
8,657	Improving Matrix-vector Multiplication via Lossless Grammar-Compressed Matrices	2022	VLDB	4.4730648e-05
1,967	Compressed Linear Algebra for Large-Scale Machine Learning	2016	VLDB	9.9131712e-05