DBScholar

Back to papers

Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine

Summary: Rust-based, Arrow-backed embeddable analytic query engine with a fast, modular design. Open architecture with 10+ extension APIs delivers competitive performance against DuckDB and enables bespoke data infrastructures across databases, ML pipelines, and OLAP workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf86814928ab9722e
Venue
SIGMOD
Year
2024
Pagerank
6.8198673e-05
Overall Rank
4,074 | 72.61%
DOI
10.1145/3626246.3653368

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{lamb_sigmod24,
        title = {{Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine}},
        author = {Lamb, Andrew and Shen, Yijie and Heres, Daniël and Chakraborty, Jayjeet and Kabak, Mehmet Ozan and Hsieh, Liang-Chi and Sun, Chao},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626246.3653368},
        url = {https://dl.acm.org/doi/10.1145/3626246.3653368},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank Citing Paper Year Venue Pagerank
6,587 Maximus: A Modular Accelerated Query Engine for Data Analytics on Heterogeneous Systems 2025 SIGMOD 5.7429023e-05
6,805 Instance-Optimal Acyclic Join Processing Without Regret: Engineering the Yannakakis Algorithm in Column Stores 2025 VLDB 5.6780394e-05
8,223 PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees 2025 SIGMOD 5.3751366e-05
9,684 The HANA Native Query Engine for Lakehouse Systems 2025 VLDB 5.1423628e-05
9,999 Selective Late Materialization in Modern Analytical Databases 2025 VLDB 5.0979044e-05
10,080 LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics 2025 VLDB 5.0830849e-05
10,226 Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability 2026 VLDB 5.0571508e-05
10,250 AnyBlox: A Framework for Self-Decoding Datasets 2025 VLDB 5.051964e-05
10,304 Data Chunk Compaction in Vectorized Execution 2025 SIGMOD 5.0400722e-05
10,452 Factorized and Vectorized Execution: Optimizing Analytical and Semantic Queries over Relations 2026 SIGMOD 4.9793485e-05
10,601 TQEx: Tensor-based Query Engine Enhanced by Bridging the Gap 2026 SIGMOD 4.9793485e-05
10,822 Decisionhouse: Prescriptive Analytics in the Data Stack 2026 VLDB 4.9793485e-05
10,901 Overlay Bitmap Encoding for Efficient Consumption of Apache Parquet Files 2026 VLDB 4.9793485e-05
10,906 RayBooster: A Ray Tracing Engine to Accelerate SedonaDB 2026 VLDB 4.9793485e-05
10,932 IMLane: Composable Framework for Efficient AI Function Execution in Database Engine 2026 VLDB 4.9793485e-05
10,942 One Ring to Shuffle Them All: Scalable Intra-Process Data Redistribution with Ring-Buffer Shuffle in Redpanda Oxla 2026 VLDB 4.9793485e-05
11,037 Future-Proof Data Systems 2026 VLDB 4.9793485e-05
11,126 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9793485e-05
11,344 Towards Designing Future-Proof Data Processing Systems 2025 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
12 C-Store: A Column-oriented DBMS 2005 VLDB 0.00068998927
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043160717
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037720227
93 Encapsulation of Parallelism in the Volcano Query Processing System 1990 SIGMOD 0.00034622929
179 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026611886
215 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00024598661
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024485024
379 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00019514689
459 Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores 2020 VLDB 0.00017856221
604 Rethinking Database System Architecture: Towards a Self-tuning RISC-style Database System 2000 VLDB 0.0001566686
605 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB 0.00015647561
1,424 Velox: Meta's Unified Execution Engine 2022 VLDB 0.00010719232
1,487 Photon: A Fast Query Engine for Lakehouse Systems 2022 SIGMOD 0.00010521722
3,337 The Composable Data Management System Manifesto 2023 VLDB 7.4104865e-05
3,427 Efficient Processing of Window Functions in Analytical SQL Queries 2015 VLDB 7.3082914e-05
3,446 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.2942885e-05
3,642 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1416697e-05
Previous Page 1 / 1 Next

Semantically Similar Papers