DimmWitted: A Study of Main-Memory Statistical Analytics

Summary: Study of main-memory statistical analytics on NUMA; compares row- vs column-order access and data/model sharing granularity. Uncovers hardware-statistical efficiency tradeoffs; prototype runs popular tasks (SVM, LR, Gibbs, NN) up to 100x faster across five architectures. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hc98b16f3aea1db73
Venue: VLDB
Year: 2014
Pagerank: 0.00011690039
Overall Rank: 1,169 | 92.17%
DOI: 10.14778/2732977.2732988
PDF: Download (CC BY-NC-ND 3.0)

Incoming Non-self Citations Over Time

Authors

1. Ce Zhang (Stanford University; University of Wisconsin)
2. Christopher Ré (Stanford University)

BibTeX Citation

@article{zhang_vldb14,
        title = {{DimmWitted: A Study of Main-Memory Statistical Analytics}},
        author = {Zhang, Ce and Ré, Christopher},
        journal = {PVLDB},
        series = {{VLDB} '14},
        volume = {7},
        number = {12},
        pages = {1283--1294},
        doi = {10.14778/2732977.2732988},
        url = {https://doi.org/10.14778/2732977.2732988},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
100	HoloClean: Holistic Data Repairs with Probabilistic Inference	2017	VLDB	0.00033951027
569	Incremental Knowledge Base Construction Using DeepDive	2015	VLDB	0.00016212139
1,226	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011432354
1,449	An Architecture for Compiling UDF-centric Workflows	2015	VLDB	0.00010597074
1,938	Elastic Machine Learning Algorithms in Amazon SageMaker	2020	SIGMOD	9.3316919e-05
2,139	Tupleware: "Big" Data, Big Analytics, Small Clusters	2015	CIDR	8.9729383e-05
2,196	Heterogeneity-aware Distributed Parameter Servers	2017	SIGMOD	8.8807201e-05
3,746	In-RDBMS Hardware Acceleration of Advanced Analytics	2018	VLDB	7.0369561e-05
3,770	CROSSBOW: Scaling Deep Learning with Small Batch Sizes on Multi-GPU Servers	2019	VLDB	7.0145345e-05
3,797	SLiMFast: Guaranteed Results for Data Fusion and Source Reliability	2017	SIGMOD	6.9951279e-05
3,887	SketchML: Accelerating Distributed Machine Learning with Data Sketches	2018	SIGMOD	6.9277708e-05
4,134	Resource Elasticity for Large-Scale Machine Learning	2015	SIGMOD	6.7721426e-05
4,403	Extracting Databases from Dark Data with DeepDive	2016	SIGMOD	6.6033854e-05
4,891	Accelerating Generalized Linear Models with MLWeaving: A One-Size-Fits-All System for Any-Precision Learning	2019	VLDB	6.3508222e-05
4,961	Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce	2021	SIGMOD	6.3246342e-05
5,738	An Experimental Evaluation of Large Scale GBDT Systems	2019	VLDB	5.9951855e-05
5,787	Database Technology for the Masses: Sub-Operators as First-Class Entities	2021	VLDB	5.9768075e-05
5,885	BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees	2019	SIGMOD	5.9421702e-05
6,259	ColumnML: Column-Store Machine Learning with On-The-Fly Data Transformation	2019	VLDB	5.815406e-05
6,474	In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle	2022	SIGMOD	5.7555547e-05
7,168	A Cost-based Optimizer for Gradient Descent Optimization	2017	SIGMOD	5.5794432e-05
8,228	SDP_PIPE: A Semi-Decentralized Framework for Heterogeneity-aware Pipeline-parallel Training	2023	VLDB	5.3581744e-05
9,099	Scheduling Data Processing Pipelines for Incremental Training on MLP-based Recommendation Models	2025	SIGMOD	5.208561e-05
9,319	ParaX: Boosting Deep Learning for Big Data Analytics on Many-Core CPUs	2021	VLDB	5.182871e-05
10,375	Distributed Learning of Fully Connected Neural Networks using Independent Subnet Training	2022	VLDB	4.9979062e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
22	Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud	2012	VLDB	0.00056028465
105	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00033605348
161	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00027629724
212	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.00024786576
250	Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited	2014	VLDB	0.00023080446
423	Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems	2012	VLDB	0.00018450254
464	An Architecture for Parallel Topic Models	2010	VLDB	0.0001776101
707	Main-Memory Scan Sharing For Multi-Core CPUs	2008	VLDB	0.00014613324
1,205	NUMA-aware algorithms: the case of data shuffling	2013	CIDR	0.00011512846
4,042	Cache-conscious Frequent Pattern Mining on a Modern Processor	2005	VLDB	6.8217193e-05
5,839	Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases	2013	VLDB	5.957817e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,158	Balance-Aware Distributed String Similarity-Based Query Processing System	2019	VLDB
2	1,119	A Comprehensive Study of Main-Memory Partitioning and its Application to Large-Scale Comparison- and Radix-Sort	2014	SIGMOD
3	2,385	Dynamic Memory Allocation for Multiple-Query Workloads	1993	VLDB
4	506	Towards a Unified Architecture for in-RDBMS Analytics	2012	SIGMOD
5	5,603	Database Processing-in-Memory: An Experimental Study	2020	VLDB
6	4,036	Scaling Up Concurrent Main-Memory Column-Store Scans: Towards Adaptive NUMA-aware Data and Task Placement	2015	VLDB
7	12,518	Multi-dimensional Data Statistics for Columnar In-Memory Databases	2014	SIGMOD
8	9,121	DimmStore: Memory Power Optimization for Database Systems	2019	VLDB
9	6,297	Rethinking MIMD-SIMD Interplay for Analytical Query Processing in In-Memory Database Engines	2025	CIDR
10	4,707	Adaptive NUMA-aware data placement and task scheduling for analytical workloads in main-memory column-stores	2017	VLDB