Cerebro: A Layered Data Platform for Scalable Deep Learning

Summary: Cerebro: a layered data platform that makes DL model selection a first-class data-management problem with higher-level APIs and a DB-inspired architecture for coordinated large-scale model/hyperparameter search. Uses multi-query optimization to share computation and reduce resource waste. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: ha6b29a81644119f9
Venue: CIDR
Year: 2021
Pagerank: 5.217676e-05
Overall Rank: 9,153 | 38.49%
DOI: -
PDF: Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

1. Arun Kumar (University of California San Diego)
2. Supun Nakandala (University of California San Diego)
3. Yuhao Zhang (University of California San Diego)
4. Side Li (University of California San Diego)
5. Advitya Gemawat (University of California San Diego)
6. Kabir Nagrecha (University of California San Diego)

BibTeX Citation

@inproceedings{kumar_cidr21,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '21},
        title = {{Cerebro: A Layered Data Platform for Scalable Deep Learning}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Kumar, Arun and Nakandala, Supun and Zhang, Yuhao and Li, Side and Gemawat, Advitya and Nagrecha, Kabir},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
4,097	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.8064316e-05
5,901	Lotan: Bridging the Gap between GNNs and Scalable Graph Analytics Engines	2023	VLDB	5.9517243e-05
7,071	Saturn: An Optimized Data System for Multi-Large-Model Deep Learning Workloads	2024	VLDB	5.6056639e-05
9,402	GraphGem: Optimized Scalable System for Graph Convolutional Networks	2021	SIGMOD	5.1836053e-05
9,564	Towards an Optimized GROUP BY Abstraction for Large-Scale Machine Learning	2021	VLDB	5.1547835e-05
9,565	Intermittent Human-in-the-Loop Model Selection using Cerebro: A Demonstration	2021	VLDB	5.1547835e-05
9,907	Scalable Graph Convolutional Network Training on Distributed-Memory Systems	2023	VLDB	5.1092231e-05
11,538	StarfishDB: a Query Execution Engine for Relational Probabilistic Programming	2024	SIGMOD	4.9769913e-05
11,958	Grouped Learning: Group-By Model Selection Workloads	2021	SIGMOD	4.9769913e-05
13,694	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 20 of 20 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
105	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00033633007
503	Towards a Unified Architecture for in-RDBMS Analytics	2012	SIGMOD	0.00017195428
523	PyTorch Distributed: Experiences on Accelerating Data Parallel Training	2020	VLDB	0.000169044
654	Materialization Optimizations for Feature Selection Workloads	2014	SIGMOD	0.00015096817
731	Learning Generalized Linear Models Over Normalized Data	2015	SIGMOD	0.00014400356
1,152	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00011796404
1,223	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011468426
1,257	Towards Linear Algebra over Normalized Data	2017	VLDB	0.0001130959
2,201	Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra	2019	SIGMOD	8.8708356e-05
2,587	Brainwash: A Data System for Feature Engineering	2013	CIDR	8.2523942e-05
2,705	Panorama: A Data System for Unbounded Vocabulary Querying over Video	2020	VLDB	8.1096249e-05
3,042	Incremental and Approximate Inference for Faster Occlusion-based Deep CNN Explanations	2019	SIGMOD	7.7179591e-05
3,518	A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics	2018	VLDB	7.236638e-05
3,632	VISTA: Optimized System for Declarative Feature Transfer from Deep CNNs at Scale	2020	SIGMOD	7.146238e-05
4,097	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB	6.8064316e-05
5,683	Demonstration of Santoku: Optimizing Machine Learning over Normalized Data	2015	VLDB	6.0369434e-05
6,594	Tuple-oriented Compression for Large-scale Mini-batch Stochastic Gradient Descent	2019	SIGMOD	5.7394502e-05
7,542	Feature Selection in Enterprise Analytics: A Demonstration using an R-based Data Analytics System	2013	VLDB	5.4976824e-05
8,755	Probabilistic Management of OCR Data using an RDBMS	2012	VLDB	5.2841044e-05
13,832	Demonstration of Krypton: Optimized CNN Inference for Occlusion-based Deep CNN Explanations	2019	VLDB	-

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,840	From Natural Language Processing to Neural Databases	2021	VLDB
2	6,583	Deep Lake: a Lakehouse for Deep Learning	2023	CIDR
3	10,158	Structure-Aware Machine Learning over Multi-Relational Databases	2021	SIGMOD
4	9,342	Deep Query Optimization	2019	SIGMOD
5	5,778	The Tensor Data Platform: Towards an AI-centric Database System	2023	CIDR
6	9,565	Intermittent Human-in-the-Loop Model Selection using Cerebro: A Demonstration	2021	VLDB
7	4,675	Data Platform for Machine Learning	2019	SIGMOD
8	4,097	Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches	2021	VLDB
9	13,694	Reimagining Deep Learning Systems Through the Lens of Data Systems	2024	VLDB
10	1,152	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB