LobRA: Multi-tenant Fine-tuning over Heterogeneous Data

Summary: LobRA enables multi-tenant joint fine-tuning of LoRA adapters by tackling two data heterogeneities—sequence-length variation and skew—that hurt joint FT efficiency. It runs heterogeneous FT replicas (varying resource/parallel configs) plus a skew-aware dispatcher to balance per-step workloads, cutting GPU-seconds by ~45–60.7%. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13906
Venue: VLDB
Year: 2025
Pagerank: 4.1905499e-05
Overall Rank: 10,634 | 26.10%
DOI: 10.14778/3742728.3742752

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,089	Hydraulis: Balancing Large Transformer Model Training via Co-designing Parallel Strategies and Data Assignment	2026	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
411	PyTorch Distributed: Experiences on Accelerating Data Parallel Training	2020	VLDB	0.00023881138
1,953	D-Bot: Database Diagnosis System using Large Language Models	2024	VLDB	9.9701097e-05
2,357	MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud	2023	VLDB	8.9688205e-05
2,907	PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel	2023	VLDB	7.9322286e-05
3,105	GPTuner: A Manual-Reading Database Tuning System via GPT-Guided Bayesian Optimization	2024	VLDB	7.5567226e-05
5,730	BAGUA: Scaling up Distributed Learning with System Relaxations	2022	VLDB	5.3476346e-05
6,361	Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism	2023	VLDB	5.0903244e-05
7,535	Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent	2023	VLDB	4.7131061e-05
8,518	mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs	2025	VLDB	4.4893996e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,280	A Layered Aggregate Engine for Analytics Workloads	2019	SIGMOD	7.2813732e-05
10,340	Libra: One-Shot Parameter Sensitivity Estimation for Transfer Learning in Database Performance Prediction	2026	VLDB	4.1905499e-05
5,997	DLRover-RM: Resource Optimization for Deep Recommendation Models Training in the Cloud	2024	VLDB	5.2365238e-05
10,183	Mixtera: A Data Plane for Foundation Model Training	2026	SIGMOD	4.1905499e-05
10,720	CoLA: Model Collaboration for Log-based Anomaly Detection	2025	VLDB	4.1905499e-05
10,646	Heta: Distributed Training of Heterogeneous Graph Neural Networks	2025	VLDB	4.1905499e-05
1,946	Heterogeneity-aware Distributed Parameter Servers	2017	SIGMOD	9.9983926e-05
9,789	RALF: Accuracy-Aware Scheduling for Feature Store Maintenance	2024	VLDB	4.2786659e-05
7,954	LFTF: A Framework for Efficient Tensor Analytics at Scale	2017	VLDB	4.6089395e-05
8,518	mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs	2025	VLDB	4.4893996e-05