Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine
Summary: Xorbits’ decentralized actor model (Xoscar) avoids a global scheduler to enable fine-grained distribution of pipeline operators. Reference-based distributed storage unifies heterogeneous memory and key-level intermediates, yielding up to 3.22× speedups. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Weizheng Lu (Renmin University of China)
- 2. Chao Hui (Shandong University)
- 3. Yunhai Wang (Renmin University of China)
- 4. Feng Zhang (Renmin University of China)
- 5. Yueguo Chen (Renmin University of China)
- 6. Bao Liu (Xorbits Inc.)
- 7. Chengjie Li (Xorbits Inc.)
- 8. Zhaoxin Wu (Xorbits Inc.)
- 9. Xuye Qin (Xorbits Inc.)
BibTeX Citation
@article{lu_vldb25,
title = {{Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine}},
author = {Lu, Weizheng and Hui, Chao and Wang, Yunhai and Zhang, Feng and Chen, Yueguo and Liu, Bao and Li, Chengjie and Wu, Zhaoxin and Qin, Xuye},
journal = {PVLDB},
series = {{VLDB} '25},
volume = {18},
number = {9},
pages = {2955--2963},
doi = {10.14778/3746405.3746420},
url = {https://doi.org/10.14778/3746405.3746420},
year = {2025}
}Incoming Citations (Sorted by Pagerank)
Showing 2 of 2 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 10,715 | TPCx-AI under the Microscope: A Benchmarking Debt Analysis | 2026 | VLDB | 4.9793485e-05 |
| 10,930 | Seron: Smart Query Router for Multi-Primary Cloud-Native Databases with Shared Storage | 2026 | VLDB | 4.9793485e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 9 of 9 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 432 | Shark: SQL and Rich Analytics at Scale | 2013 | SIGMOD | 0.00018339357 |
| 1,369 | Towards Scalable Dataframe Systems | 2020 | VLDB | 0.00010899832 |
| 2,207 | Magpie: Python at Speed and Scale using Cloud Backends | 2021 | CIDR | 8.8487039e-05 |
| 2,372 | Giraph Unchained: Barrierless Asynchronous Parallel Execution in Pregel-like Graph Processing Systems | 2015 | VLDB | 8.5610804e-05 |
| 2,641 | Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks | 2020 | SIGMOD | 8.1787073e-05 |
| 3,930 | Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System | 2022 | VLDB | 6.9185978e-05 |
| 4,815 | PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes | 2021 | VLDB | 6.3992929e-05 |
| 4,925 | TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems | 2023 | VLDB | 6.3511742e-05 |
| 5,348 | Adaptive and Robust Query Execution for Lakehouses at Scale | 2024 | VLDB | 6.1690434e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 2,723 | Exploiting Matrix Dependency for Efficient Distributed Matrix Computation | 2015 | SIGMOD |
| 2 | 7,898 | GraphScope: A One-Stop Large Graph Processing System | 2021 | VLDB |
| 3 | 4,095 | Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches | 2021 | VLDB |
| 4 | 6,116 | ConnectorX: Accelerating Data Loading From Databases to Dataframes | 2022 | VLDB |
| 5 | 3,532 | Rethinking Data-Intensive Science Using Scalable Analytics Systems | 2015 | SIGMOD |
| 6 | 537 | MLbase: A Distributed Machine-learning System | 2013 | CIDR |
| 7 | 2,227 | Spinning Fast Iterative Data Flows | 2012 | VLDB |
| 8 | 10,926 | Benchmarking Native In-Database TPCx-AI at 100 Terabytes in Ocient Hyperscale Data Warehouse: An Eight-Use-Case Study of Classical and Statistical ML on Relational Primitives | 2026 | VLDB |
| 9 | 7,008 | An Algebraic Approach for Data-Centric Scientific Workflows | 2011 | VLDB |
| 10 | 10,305 | Fast and Scalable Data Transfer Across Data Systems | 2025 | SIGMOD |