DBScholar

Back to papers

Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine

Summary: Rust-based, Arrow-backed embeddable analytic query engine with a fast, modular design. Open architecture with 10+ extension APIs delivers competitive performance against DuckDB and enables bespoke data infrastructures across databases, ML pipelines, and OLAP workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf86814928ab9722e
Venue
SIGMOD
Year
2024
Pagerank
6.8175757e-05
Overall Rank
4,074 | 72.62%
DOI
10.1145/3626246.3653368

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{lamb_sigmod24,
        title = {{Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine}},
        author = {Lamb, Andrew and Shen, Yijie and Heres, Daniël and Chakraborty, Jayjeet and Kabak, Mehmet Ozan and Hsieh, Liang-Chi and Sun, Chao},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626246.3653368},
        url = {https://dl.acm.org/doi/10.1145/3626246.3653368},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank Citing Paper Year Venue Pagerank
6,589 Maximus: A Modular Accelerated Query Engine for Data Analytics on Heterogeneous Systems 2025 SIGMOD 5.7401837e-05
6,811 Instance-Optimal Acyclic Join Processing Without Regret: Engineering the Yannakakis Algorithm in Column Stores 2025 VLDB 5.6754603e-05
7,749 PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees 2025 SIGMOD 5.4585522e-05
9,690 The HANA Native Query Engine for Lakehouse Systems 2025 VLDB 5.1399285e-05
10,004 Selective Late Materialization in Modern Analytical Databases 2025 VLDB 5.0954911e-05
10,085 LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics 2025 VLDB 5.0806786e-05
10,232 Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability 2026 VLDB 5.0547568e-05
10,256 AnyBlox: A Framework for Self-Decoding Datasets 2025 VLDB 5.0495724e-05
10,311 Data Chunk Compaction in Vectorized Execution 2025 SIGMOD 5.0376863e-05
10,463 Factorized and Vectorized Execution: Optimizing Analytical and Semantic Queries over Relations 2026 SIGMOD 4.9769913e-05
10,612 TQEx: Tensor-based Query Engine Enhanced by Bridging the Gap 2026 SIGMOD 4.9769913e-05
10,832 Decisionhouse: Prescriptive Analytics in the Data Stack 2026 VLDB 4.9769913e-05
10,910 Overlay Bitmap Encoding for Efficient Consumption of Apache Parquet Files 2026 VLDB 4.9769913e-05
10,915 RayBooster: A Ray Tracing Engine to Accelerate SedonaDB 2026 VLDB 4.9769913e-05
10,941 IMLane: Composable Framework for Efficient AI Function Execution in Database Engine 2026 VLDB 4.9769913e-05
10,951 One Ring to Shuffle Them All: Scalable Intra-Process Data Redistribution with Ring-Buffer Shuffle in Redpanda Oxla 2026 VLDB 4.9769913e-05
11,046 Future-Proof Data Systems 2026 VLDB 4.9769913e-05
11,135 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9769913e-05
11,351 Towards Designing Future-Proof Data Processing Systems 2025 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
12 C-Store: A Column-oriented DBMS 2005 VLDB 0.0006897844
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.0004314366
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037724477
93 Encapsulation of Parallelism in the Volcano Query Processing System 1990 SIGMOD 0.00034607573
178 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026620521
215 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00024589307
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024485637
379 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00019507406
460 Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores 2020 VLDB 0.00017850215
604 Rethinking Database System Architecture: Towards a Self-tuning RISC-style Database System 2000 VLDB 0.00015664234
605 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB 0.00015640305
1,424 Velox: Meta's Unified Execution Engine 2022 VLDB 0.00010714183
1,487 Photon: A Fast Query Engine for Lakehouse Systems 2022 SIGMOD 0.00010516813
3,337 The Composable Data Management System Manifesto 2023 VLDB 7.4077425e-05
3,427 Efficient Processing of Window Functions in Analytical SQL Queries 2015 VLDB 7.3048595e-05
3,446 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.2908619e-05
3,645 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1383149e-05
Previous Page 1 / 1 Next

Semantically Similar Papers