DBScholar

Back to papers

Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine

Summary: Rust-based, Arrow-backed embeddable analytic query engine with a fast, modular design. Open architecture with 10+ extension APIs delivers competitive performance against DuckDB and enables bespoke data infrastructures across databases, ML pipelines, and OLAP workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hf86814928ab9722e
Venue
SIGMOD
Year
2024
Pagerank
6.7952274e-05
Overall Rank
4,095 | 72.56%
DOI
10.1145/3626246.3653368

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{lamb_sigmod24,
        title = {{Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine}},
        author = {Lamb, Andrew and Shen, Yijie and Heres, Daniël and Chakraborty, Jayjeet and Kabak, Mehmet Ozan and Hsieh, Liang-Chi and Sun, Chao},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626246.3653368},
        url = {https://dl.acm.org/doi/10.1145/3626246.3653368},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank Citing Paper Year Venue Pagerank
6,571 Maximus: A Modular Accelerated Query Engine for Data Analytics on Heterogeneous Systems 2025 SIGMOD 5.7278348e-05
6,826 Instance-Optimal Acyclic Join Processing Without Regret: Engineering the Yannakakis Algorithm in Column Stores 2025 VLDB 5.6566963e-05
7,745 PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees 2025 SIGMOD 5.4457135e-05
9,719 The HANA Native Query Engine for Lakehouse Systems 2025 VLDB 5.1229327e-05
10,039 Selective Late Materialization in Modern Analytical Databases 2025 VLDB 5.0786422e-05
10,119 LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics 2025 VLDB 5.0638787e-05
10,262 Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability 2026 VLDB 5.0380426e-05
10,287 AnyBlox: A Framework for Self-Decoding Datasets 2025 VLDB 5.0328754e-05
10,339 Data Chunk Compaction in Vectorized Execution 2025 SIGMOD 5.0210286e-05
10,529 Factorized and Vectorized Execution: Optimizing Analytical and Semantic Queries over Relations 2026 SIGMOD 4.9605343e-05
10,673 TQEx: Tensor-based Query Engine Enhanced by Bridging the Gap 2026 SIGMOD 4.9605343e-05
10,893 Decisionhouse: Prescriptive Analytics in the Data Stack 2026 VLDB 4.9605343e-05
10,971 Overlay Bitmap Encoding for Efficient Consumption of Apache Parquet Files 2026 VLDB 4.9605343e-05
10,976 RayBooster: A Ray Tracing Engine to Accelerate SedonaDB 2026 VLDB 4.9605343e-05
11,002 IMLane: Composable Framework for Efficient AI Function Execution in Database Engine 2026 VLDB 4.9605343e-05
11,012 One Ring to Shuffle Them All: Scalable Intra-Process Data Redistribution with Ring-Buffer Shuffle in Redpanda Oxla 2026 VLDB 4.9605343e-05
11,107 Future-Proof Data Systems 2026 VLDB 4.9605343e-05
11,195 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9605343e-05
11,404 Towards Designing Future-Proof Data Processing Systems 2025 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
12 C-Store: A Column-oriented DBMS 2005 VLDB 0.00068985264
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043085722
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037688945
93 Encapsulation of Parallelism in the Volcano Query Processing System 1990 SIGMOD 0.00034518001
177 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026571747
215 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00024554257
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024446892
382 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.0001946654
462 Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores 2020 VLDB 0.00017825062
604 Rethinking Database System Architecture: Towards a Self-tuning RISC-style Database System 2000 VLDB 0.00015642703
606 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB 0.00015609823
1,415 Velox: Meta's Unified Execution Engine 2022 VLDB 0.00010707308
1,488 Photon: A Fast Query Engine for Lakehouse Systems 2022 SIGMOD 0.00010487094
3,344 The Composable Data Management System Manifesto 2023 VLDB 7.3834228e-05
3,438 Efficient Processing of Window Functions in Analytical SQL Queries 2015 VLDB 7.2807703e-05
3,457 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.2667942e-05
3,654 User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases 2022 VLDB 7.1147757e-05
Previous Page 1 / 1 Next

Semantically Similar Papers