Chukonu: A Fully-Featured High-Performance Big Data Framework that Integrates a Native Compute Engine into Spark
Summary: Chukonu embeds a native compute engine in Spark via DAG splitting: Spark handles runtime features, while compile-time fragments undergo fusion, vectorization, and compaction. This preserves Spark’s ecosystem while delivering up to 71.6× speedup and 2.29× faster TPC-DS. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Bowen Yu (Tsinghua University)
- 2. Guanyu Feng (Tsinghua University)
- 3. Huanqi Cao (Tsinghua University)
- 4. Xiaohan Li (Tsinghua University)
- 5. Zhenbo Sun (Tsinghua University)
- 6. Haojie Wang (Tsinghua University)
- 7. Xiaowei Zhu (Tsinghua University)
- 8. Weimin Zheng (Tsinghua University)
- 9. Wenguang Chen (Tsinghua University)
BibTeX Citation
@article{yu_vldb22,
title = {{Chukonu: A Fully-Featured High-Performance Big Data Framework that Integrates a Native Compute Engine into Spark}},
author = {Yu, Bowen and Feng, Guanyu and Cao, Huanqi and Li, Xiaohan and Sun, Zhenbo and Wang, Haojie and Zhu, Xiaowei and Zheng, Weimin and Chen, Wenguang},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {4},
pages = {872--885},
doi = {10.14778/3503585.3503596},
url = {https://doi.org/10.14778/3503585.3503596},
year = {2022}
}Incoming Citations (Sorted by Pagerank)
Showing 1 of 1 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6,742 | Mitigating the Impedance Mismatch between Prediction Query Execution and Database Engine | 2025 | SIGMOD | 5.6910432e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 21 | Efficiently Compiling Efficient Query Plans for Modern Hardware | 2011 | VLDB | 0.00056855599 |
| 23 | Spark SQL: Relational Data Processing in Spark | 2015 | SIGMOD | 0.00055406774 |
| 1,123 | Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark | 2018 | SIGMOD | 0.0001193233 |
| 3,207 | Why You Should Run TPC-DS:A Workload Analysis | 2007 | VLDB | 7.5387953e-05 |
| 3,862 | Husky: Towards a More Efficient and Expressive Distributed Computing Framework | 2016 | VLDB | 6.9652009e-05 |
| 5,408 | Lifetime-Based Memory Management for Distributed Data Processing Systems | 2016 | VLDB | 6.1415736e-05 |
| 6,996 | Bridging the Gap Between HPC and Big Data Frameworks | 2017 | VLDB | 5.6256144e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 4,288 | Clash of the Titans: MapReduce vs. Spark for Large Scale Data Analytics | 2015 | VLDB |
| 2 | 11,714 | QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark | 2023 | SIGMOD |
| 3 | 6,450 | Towards General and Efficient Online Tuning for Spark | 2023 | VLDB |
| 4 | 3,455 | Scaling Spark in the Real World: Performance and Usability | 2015 | VLDB |
| 5 | 8,217 | Enabling Transparent Acceleration of Big Data Frameworks Using Heterogeneous Hardware | 2022 | VLDB |
| 6 | 10,887 | MFTune: An Efficient Multi-fidelity Framework for Spark SQL Configuration Tuning | 2026 | VLDB |
| 7 | 8,004 | A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning | 2024 | VLDB |
| 8 | 9,321 | Dynamic Speculative Optimizations for SQL Compilation in Apache Spark | 2020 | VLDB |
| 9 | 6,996 | Bridging the Gap Between HPC and Big Data Frameworks | 2017 | VLDB |
| 10 | 2,635 | Big Data Analytics with Datalog Queries on Spark | 2016 | SIGMOD |