Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine

Summary: Rust-based, Arrow-backed embeddable analytic query engine with a fast, modular design. Open architecture with 10+ extension APIs delivers competitive performance against DuckDB and enables bespoke data infrastructures across databases, ML pipelines, and OLAP workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6777
Venue: SIGMOD
Year: 2024
Pagerank: 5.1021765e-05
Overall Rank: 6,332 | 56.00%
DOI: 10.1145/3626246.3653368

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,035	Instance-Optimal Acyclic Join Processing Without Regret: Engineering the Yannakakis Algorithm in Column Stores	2025	VLDB	4.5967078e-05
8,123	Maximus: A Modular Accelerated Query Engine for Data Analytics on Heterogeneous Systems	2025	SIGMOD	4.5770901e-05
9,238	PilotDB: Database-Agnostic Online Approximate Query Processing with A Priori Error Guarantees	2025	SIGMOD	4.3648789e-05
9,900	AnyBlox: A Framework for Self-Decoding Datasets	2025	VLDB	4.2539423e-05
10,121	TQEx: Tensor-based Query Engine Enhanced by Bridging the Gap	2026	SIGMOD	4.1905499e-05
10,248	Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability	2026	VLDB	4.1905499e-05
10,384	Data Chunk Compaction in Vectorized Execution	2025	SIGMOD	4.1905499e-05
10,415	Dynamic Pruning for Recursive Joins	2025	SIGMOD	4.1905499e-05
10,721	Towards Designing Future-Proof Data Processing Systems	2025	VLDB	4.1905499e-05
10,762	Selective Late Materialization in Modern Analytical Databases	2025	VLDB	4.1905499e-05
10,773	The HANA Native Query Engine for Lakehouse Systems	2025	VLDB	4.1905499e-05
10,858	LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics	2025	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
20	C-Store: A Column-oriented DBMS	2005	VLDB	0.00086163998
109	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.00048217028
113	Encapsulation of Parallelism in the Volcano Query Processing System	1990	SIGMOD	0.0004673401
185	DuckDB: an Embeddable Analytical Database	2019	SIGMOD	0.00036529607
310	The Vertica Analytic Database: C-Store 7 Years Later	2012	VLDB	0.0002815547
367	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00025518228
417	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00023734582
528	Rethinking Database System Architecture: Towards a Self-tuning RISC-style Database System	2000	VLDB	0.0002085799
542	Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources	2018	SIGMOD	0.00020522627
739	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017365933
848	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015933538
2,472	Photon: A Fast Query Engine for Lakehouse Systems	2022	SIGMOD	8.7156826e-05
2,533	Velox: Meta’s Unified Execution Engine	2022	VLDB	8.5870599e-05
3,966	Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing	2019	SIGMOD	6.5782437e-05
4,241	The Composable Data Management System Manifesto	2023	VLDB	6.3258298e-05
4,257	Efficient Processing of Window Functions in Analytical SQL Queries	2015	VLDB	6.3050642e-05
4,930	User-Defined Operators: Efficiently Integrating Custom Algorithms into Modern Databases	2022	VLDB	5.8171482e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
6,683	Adaptive and Robust Query Execution for Lakehouses at Scale	2024	VLDB	4.9593505e-05
542	Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources	2018	SIGMOD	0.00020522627
1,751	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR	0.00010673874
10,501	Intra-Query Runtime Elasticity for Cloud-Native Data Analysis	2025	SIGMOD	4.1905499e-05
7,303	DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines	2022	CIDR	4.7632836e-05
4,498	ClickHouse - Lightning Fast Analytics for Everyone	2024	VLDB	6.1351257e-05
1,865	Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last	2018	VLDB	0.00010271333
5,334	Fast In-Memory SQL Analytics on Typed Graphs	2017	VLDB	5.5625443e-05
7,324	BOSS - An Architecture for Database Kernel Composition	2024	VLDB	4.7565238e-05
5,571	A Deep Dive into Common Open Formats for Analytical DBMSs	2023	VLDB	5.4279553e-05