Database Paper Browser

Back to papers

HET-GMP: A Graph-based System Approach to Scaling Large Embedding Model Training

Summary: HET-GMP uses a graph-based design to scale embedding models via a bigraph of data-sample to embedding-vector access. Graph locality, skewness-aware replication/partitioning, bounded-asynchronous sync reduces comms; 87.5% reduction, 27.5x CTR speedup. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6355
Venue
SIGMOD
Year
2022
Pagerank
5.642415e-05
Overall Rank
5,169 | 64.08%
DOI
10.1145/3514221.3517902

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank Citing Paper Year Venue Pagerank
5,485 ETC: Efficient Training of Temporal Graph Neural Networks over Large-scale Dynamic Graphs 2024 VLDB 5.4817019e-05
5,570 Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses 2024 VLDB 5.4280174e-05
6,361 Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism 2023 VLDB 5.0903244e-05
6,997 PetPS: Supporting Huge Embedding Models with Persistent Memory 2023 VLDB 4.8629617e-05
8,733 Scheduling Data Processing Pipelines for Incremental Training on MLP-based Recommendation Models 2025 SIGMOD 4.4520434e-05
8,807 FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement 2023 SIGMOD 4.4413307e-05
9,331 BladeDISC: Optimizing Dynamic Shape Machine Learning Workloads via Compiler Approach 2023 SIGMOD 4.351469e-05
9,408 CAFE: Towards Compact, Adaptive, and Fast Embedding for Large-scale Recommendation Models 2024 SIGMOD 4.3399748e-05
9,414 Experimental Analysis of Large-scale Learnable Vector Storage Compression 2024 VLDB 4.3399748e-05
9,677 Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving 2025 SIGMOD 4.3006524e-05
9,965 Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates 2022 VLDB 4.2229209e-05
10,111 Scalable Graph Indexing using GPUs for Approximate Nearest Neighbor Search 2026 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
13 Mining Association Rules between Sets of Items in Large Databases 1993 SIGMOD 0.0010863639
39 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00075263552
411 PyTorch Distributed: Experiences on Accelerating Data Parallel Training 2020 VLDB 0.00023881138
635 APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embedding 2021 SIGMOD 0.00018825777
2,678 HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework 2022 VLDB 8.3224016e-05
5,332 Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce 2021 SIGMOD 5.5640779e-05
6,482 Dynamic Parameter Allocation in Parameter Servers 2020 VLDB 5.0396586e-05
6,553 Reliable Data Distillation on Graph Convolutional Network 2020 SIGMOD 5.0100594e-05
6,754 Agile and Accurate CTR Prediction Model Training for Massive-Scale Online Advertising Systems 2021 SIGMOD 4.9344367e-05
8,052 Just Move It! Dynamic Parameter Allocation in Action 2021 VLDB 4.5925868e-05
11,803 LDA*: A Robust and Large-scale Topic Modeling System 2017 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
11,426 Scalable Robust Graph Embedding with Spark 2022 VLDB 4.1905499e-05
1,876 Large-Scale Distributed Graph Computing Systems: An Experimental Evaluation 2015 VLDB 0.00010242818
2,399 ByteGNN: Efficient Graph Neural Network Training at Large Scale 2022 VLDB 8.8869693e-05
8,736 Historical Embedding-Guided Efficient Large-Scale Federated Graph Learning 2024 SIGMOD 4.4520434e-05
5,383 Parallel Training of Knowledge Graph Embedding Models: A Comparison of Techniques 2022 VLDB 5.5357645e-05
9,596 Scalable Graph Convolutional Network Training on Distributed-Memory Systems 2023 VLDB 4.3150788e-05
3,092 Scalable and Efficient Full-Graph GNN Training for Large Graphs 2023 SIGMOD 7.5869574e-05
7,924 Distributed Graph Embedding with Information-Oriented Random Walks 2023 VLDB 4.6109814e-05
10,646 Heta: Distributed Training of Heterogeneous Graph Neural Networks 2025 VLDB 4.1905499e-05
2,678 HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework 2022 VLDB 8.3224016e-05