Cerebro: A Layered Data Platform for Scalable Deep Learning

Summary: Cerebro: a layered data platform that makes DL model selection a first-class data-management problem with higher-level APIs and a DB-inspired architecture for coordinated large-scale model/hyperparameter search. Uses multi-query optimization to share computation and reduce resource waste. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: ha6b29a81644119f9
Venue: CIDR
Year: 2021
Pagerank: 5.2004231e-05
Overall Rank: 9,175 | 38.50%
DOI: -
PDF: Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

1. Arun Kumar (University of California San Diego)
2. Supun Nakandala (University of California San Diego)
3. Yuhao Zhang (University of California San Diego)
4. Side Li (University of California San Diego)
5. Advitya Gemawat (University of California San Diego)
6. Kabir Nagrecha (University of California San Diego)

BibTeX Citation

@inproceedings{kumar_cidr21,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '21},
        title = {{Cerebro: A Layered Data Platform for Scalable Deep Learning}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Kumar, Arun and Nakandala, Supun and Zhang, Yuhao and Li, Side and Gemawat, Advitya and Nagrecha, Kabir},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
4,117	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.784003e-05
5,916	Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines	2023	VLDB	5.9320442e-05
7,091	Saturn: An Optimized Data System for Multi-Large-Model Deep Learning Workloads	2024	VLDB	5.5871281e-05
9,427	GraphGem: Optimized Scalable System for Graph Convolutional Networks	2021	SIGMOD	5.1664651e-05
9,589	Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning	2021	VLDB	5.1377385e-05
9,590	Intermittent Human-in-the-Loop Model Selection using Cerebro: A Demonstration	2021	VLDB	5.1377385e-05
9,942	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB	5.0923288e-05
11,587	StarfishDB: a Query Execution Engine for Relational Probabilistic Programming	2024	SIGMOD	4.9605343e-05
12,002	Grouped Learning: Group-By Model Selection Workloads	2021	SIGMOD	4.9605343e-05
13,734	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 20 of 20 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
105	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00033605348
506	Towards a Unified Architecture for in-RDBMS Analytics	2012	SIGMOD	0.00017158546
526	PyTorch Distributed: Experiences on Accelerating Data Parallel Training	2020	VLDB	0.00016866695
656	Materialization Optimizations for Feature Selection Workloads	2014	SIGMOD	0.00015052106
731	Learning Generalized Linear Models Over Normalized Data	2015	SIGMOD	0.00014363943
1,154	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00011762688
1,200	Towards Linear Algebra over Normalized Data	2017	VLDB	0.00011524945
1,226	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011432354
2,204	Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra	2019	SIGMOD	8.8531297e-05
2,596	Brainwash: A Data System for Feature Engineering	2013	CIDR	8.2258492e-05
2,713	Panorama: A Data System for Unbounded Vocabulary Querying over Video	2020	VLDB	8.0876569e-05
3,052	Incremental and Approximate Inference for Faster Occlusion-based Deep CNN Explanations	2019	SIGMOD	7.6924471e-05
3,528	A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics	2018	VLDB	7.2134232e-05
3,643	VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale	2020	SIGMOD	7.1227166e-05
4,117	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.784003e-05
5,684	Demonstration of Santoku: Optimizing Machine Learning over Normalized Data	2015	VLDB	6.02198e-05
6,603	Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent	2019	SIGMOD	5.7204739e-05
7,555	Feature Selection in Enterprise Analytics: A Demonstration using an R-based Data Analytics System	2013	VLDB	5.4797204e-05
8,776	Probabilistic Management of OCR Data using an RDBMS	2012	VLDB	5.2666658e-05
13,872	Demonstration of Krypton: Optimized CNN Inference for Occlusion-based Deep CNN Explanations	2019	VLDB	-

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,815	From Natural Language Processing to Neural Databases	2021	VLDB
2	6,592	Deep Lake: a Lakehouse for Deep Learning	2023	CIDR
3	10,193	Structure-Aware Machine Learning over Multi-Relational Databases	2021	SIGMOD
4	9,365	Deep Query Optimization	2019	SIGMOD
5	5,795	The Tensor Data Platform: Towards an AI-centric Database System	2023	CIDR
6	9,590	Intermittent Human-in-the-Loop Model Selection using Cerebro: A Demonstration	2021	VLDB
7	4,687	Data Platform for Machine Learning	2019	SIGMOD
8	4,117	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB
9	13,734	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB
10	1,154	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB