Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine
Summary: Xorbits’ decentralized actor model (Xoscar) avoids a global scheduler to enable fine-grained distribution of pipeline operators. Reference-based distributed storage unifies heterogeneous memory and key-level intermediates, yielding up to 3.22× speedups. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Weizheng Lu (Renmin University of China)
- 2. Chao Hui (Shandong University)
- 3. Yunhai Wang (Renmin University of China)
- 4. Feng Zhang (Renmin University of China)
- 5. Yueguo Chen (Renmin University of China)
- 6. Bao Liu (Xorbits Inc.)
- 7. Chengjie Li (Xorbits Inc.)
- 8. Zhaoxin Wu (Xorbits Inc.)
- 9. Xuye Qin (Xorbits Inc.)
BibTeX Citation
@article{lu_vldb25,
title = {{Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine}},
author = {Lu, Weizheng and Hui, Chao and Wang, Yunhai and Zhang, Feng and Chen, Yueguo and Liu, Bao and Li, Chengjie and Wu, Zhaoxin and Qin, Xuye},
journal = {PVLDB},
series = {{VLDB} '25},
volume = {18},
number = {9},
pages = {2955--2963},
doi = {10.14778/3746405.3746420},
url = {https://doi.org/10.14778/3746405.3746420},
year = {2025}
}Incoming Citations (Sorted by Pagerank)
Showing 1 of 1 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 10,531 | TPCx-AI under the Microscope: A Benchmarking Debt Analysis | 2026 | VLDB | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 9 of 9 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 425 | Shark: SQL and Rich Analytics at Scale | 2013 | SIGMOD | 0.00018704491 |
| 1,431 | Towards Scalable Dataframe Systems | 2020 | VLDB | 0.00010807221 |
| 2,325 | Giraph Unchained: Barrierless Asynchronous Parallel Execution in Pregel-like Graph Processing Systems | 2015 | VLDB | 8.7495171e-05 |
| 2,651 | Magpie: Python at Speed and Scale using Cloud Backends | 2021 | CIDR | 8.2918086e-05 |
| 2,744 | Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks | 2020 | SIGMOD | 8.1781662e-05 |
| 4,079 | Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System | 2022 | VLDB | 6.9188052e-05 |
| 4,728 | PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes | 2021 | VLDB | 6.5360246e-05 |
| 5,040 | TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems | 2023 | VLDB | 6.390395e-05 |
| 5,983 | Adaptive and Robust Query Execution for Lakehouses at Scale | 2024 | VLDB | 6.0206841e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 11,874 | I Can't Believe It's Not (Only) Software! Bionic Distributed Storage for Parquet Files | 2019 | VLDB |
| 2 | 2,681 | Exploiting Matrix Dependency for Efficient Distributed Matrix Computation | 2015 | SIGMOD |
| 3 | 4,067 | Distributed Deep Learning on Data Systems: A Comparative Analysis of Approaches | 2021 | VLDB |
| 4 | 7,796 | GraphScope: A One-Stop Large Graph Processing System | 2021 | VLDB |
| 5 | 6,628 | ConnectorX: Accelerating Data Loading From Databases to Dataframes | 2022 | VLDB |
| 6 | 3,552 | Rethinking Data-Intensive Science Using Scalable Analytics Systems | 2015 | SIGMOD |
| 7 | 532 | MLbase: A Distributed Machine-learning System | 2013 | CIDR |
| 8 | 2,196 | Spinning Fast Iterative Data Flows | 2012 | VLDB |
| 9 | 6,889 | An Algebraic Approach for Data-Centric Scientific Workflows | 2011 | VLDB |
| 10 | 10,761 | Fast and Scalable Data Transfer Across Data Systems | 2025 | SIGMOD |