SmartLite: A DBMS-based Serving System for DNN Inference in Resource-constrained Environments

Summary: SmartLite is a lightweight DBMS that stores DNN parameters/structure as tables and implements neural operators, turning tensor ops into DB value-lookups. Uses binarized quantization and pruning to run multiple models on constrained edge devices, achieving 98% memory reduction and ~134% speedup vs TorchServe. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13499
Venue: VLDB
Year: 2024
Pagerank: 5.0893219e-05
Overall Rank: 6,380 | 55.62%
DOI: 10.14778/3632093.3632095

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,378	Mitigating the Impedance Mismatch between Prediction Query Execution and Database Engine	2025	SIGMOD	5.0909804e-05
9,391	Database as Runtime: Compiling LLMs to SQL for In-database Model Serving	2025	SIGMOD	4.3441378e-05
10,177	InferF: Declarative Factorization of AI/ML Inferences over Joins	2026	SIGMOD	4.1945683e-05
10,469	Alsatian: Optimizing Model Search for Deep Transfer Learning	2025	SIGMOD	4.1945683e-05
10,499	Privacy and Accuracy-Aware AI/ML Model Deduplication	2025	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 6 of 6 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
140	The MADlib Analytics Library or MAD Skills, the SQL	2012	VLDB	0.00042270404
1,270	BitWeaving: Fast Scans for Main Memory Data Processing	2013	SIGMOD	0.00012926086
2,642	Vertica-ML: Distributed Machine Learning in Vertica Database	2020	SIGMOD	8.3851878e-05
3,099	DB4ML – An In-Memory Database Kernel with Machine Learning Support	2020	SIGMOD	7.5642871e-05
5,072	Optimizing Machine Learning Inference Queries with Correlative Proxy Models	2022	VLDB	5.7185674e-05
5,955	LMFAO: An Engine for Batches of Group-By Aggregates	2020	VLDB	5.2572882e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
13,229	Using Deep Learning Models to Replace Large Materialized Views in Relational Database	2021	CIDR	-
5,110	LightNE: A Lightweight Graph Processing System for Network Embedding	2021	SIGMOD	5.6901951e-05
6,311	VergeDB: A Database for IoT Analytics on Edge Devices	2021	CIDR	5.1161316e-05
9,415	Declarative Data Serving: The Future of Machine Learning Inference on the Edge	2021	VLDB	4.3441378e-05
10,122	TranSQL+: Serving Large Language Models with SQL on Low-Resource Hardware	2026	SIGMOD	4.1945683e-05
3,293	Jointly Optimizing Preprocessing and Inference for DNN-based Visual Analytics	2021	VLDB	7.2629834e-05
10,095	NeurStore: Efficient In-database Deep Learning Model Management System	2026	SIGMOD	4.1945683e-05
7,399	SmartBench: A Benchmark For Data Management In Smart Spaces	2020	VLDB	4.7410149e-05
9,892	DBMS Fitting: Why should we learn what we already know?	2020	CIDR	4.261445e-05
7,061	Serving Deep Learning Models with Deduplication from Relational Databases	2022	VLDB	4.8463881e-05