SmartLite: A DBMS-based Serving System for DNN Inference in Resource-constrained Environments

Summary: SmartLite is a lightweight DBMS that stores DNN parameters/structure as tables and implements neural operators, turning tensor ops into DB value-lookups. Uses binarized quantization and pruning to run multiple models on constrained edge devices, achieving 98% memory reduction and ~134% speedup vs TorchServe. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13500
Venue: VLDB
Year: 2024
Pagerank: 5.0844374e-05
Overall Rank: 6,379 | 55.67%
DOI: 10.14778/3632093.3632095

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,377	Mitigating the Impedance Mismatch between Prediction Query Execution and Database Engine	2025	SIGMOD	5.0860948e-05
9,397	Database as Runtime: Compiling LLMs to SQL for In-database Model Serving	2025	SIGMOD	4.3399748e-05
10,177	InferF: Declarative Factorization of AI/ML Inferences over Joins	2026	SIGMOD	4.1905499e-05
10,479	Alsatian: Optimizing Model Search for Deep Transfer Learning	2025	SIGMOD	4.1905499e-05
10,508	Privacy and Accuracy-Aware AI/ML Model Deduplication	2025	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
139	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00042320525
1,267	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.00012917585
2,660	Vertica-ML: Distributed Machine Learning in Vertica Database	2020	SIGMOD	8.3614044e-05
3,122	DB4ML – An In-Memory Database Kernel with Machine Learning Support	2020	SIGMOD	7.5284233e-05
5,062	Optimizing Machine Learning Inference Queries with Correlative Proxy Models	2022	VLDB	5.7172262e-05
5,957	LMFAO: An Engine for Batches of Group-By Aggregates	2020	VLDB	5.2523266e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,242	Using Deep Learning Models to Replace Large Materialized Views in Relational Database	2021	CIDR	-
4,923	LightNE: A Lightweight Graph Processing System for Network Embedding	2021	SIGMOD	5.8218782e-05
6,311	VergeDB: A Database for IoT Analytics on Edge Devices	2021	CIDR	5.1112212e-05
9,421	Declarative Data Serving: The Future of Machine Learning Inference on the Edge	2021	VLDB	4.3399748e-05
10,122	TranSQL+: Serving Large Language Models with SQL on Low-Resource Hardware	2026	SIGMOD	4.1905499e-05
3,291	Jointly Optimizing Preprocessing and Inference for DNN-based Visual Analytics	2021	VLDB	7.2607192e-05
10,095	NeurStore: Efficient In-database Deep Learning Model Management System	2026	SIGMOD	4.1905499e-05
7,398	SmartBench: A Benchmark For Data Management In Smart Spaces	2020	VLDB	4.7364678e-05
9,891	DBMS Fitting: Why should we learn what we already know?	2020	CIDR	4.2573619e-05
7,055	Serving Deep Learning Models with Deduplication from Relational Databases	2022	VLDB	4.8428976e-05