DBScholar

Back to papers

Efficiently Compiling Efficient Query Plans for Modern Hardware

Summary: Introduces LLVM-based compilation of queries into compact machine code optimized for locality and predictable branches, overcoming iterator/vectorization overheads. Integrated in HyPer, it approaches hand-written C++ performance with modest compilation time. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
hbfb599b38b0c2b2f
Venue
VLDB
Year
2011
Pagerank
0.00056737487
Overall Rank
21 | 99.87%
DOI
10.14778/2002938.2002944

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{neumann_vldb11,
        title = {{Efficiently Compiling Efficient Query Plans for Modern Hardware}},
        author = {Neumann, Thomas},
        journal = {PVLDB},
        series = {{VLDB} '11},
        volume = {4},
        number = {9},
        pages = {539--550},
        doi = {10.14778/2002938.2002944},
        url = {https://doi.org/10.14778/2002938.2002944},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 217 citing papers.

Rank Citing Paper Year Venue Pagerank
35 Hekaton: SQL Server’s Memory-Optimized OLTP Engine 2013 SIGMOD 0.00047937476
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041439488
71 DuckDB: an Embeddable Analytical Database 2019 SIGMOD 0.00037688945
208 EmptyHeaded: A Relational Engine for Graph Processing 2016 SIGMOD 0.00024929198
215 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00024554257
226 Amazon Redshift and the Case for Simpler Data Warehouses 2015 SIGMOD 0.0002389883
228 Fast Serializable Multi-Version Concurrency Control for Main-Memory Database Systems 2015 SIGMOD 0.00023872855
375 Umbra: A Disk-Based System with In-Memory Performance 2020 CIDR 0.00019660459
420 Cypher: An Evolving Query Language for Property Graphs 2018 SIGMOD 0.00018489392
423 Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems 2012 VLDB 0.00018450254
498 Building Efficient Query Engines in a High-Level Language 2014 VLDB 0.00017323427
545 Plan-Structured Deep Neural Network Models for Query Performance Prediction 2019 VLDB 0.0001657599
606 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB 0.00015609823
627 Rethinking SIMD Vectorization for In-Memory Databases 2015 SIGMOD 0.00015430074
894 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013179915
1,009 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00012518224
1,025 High-Speed Query Processing over High-Speed Networks 2016 VLDB 0.00012396134
1,188 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011580449
1,197 Weld: A Common Runtime for High Performance Data Analytics 2017 CIDR 0.00011548039
1,228 A Study of the Fundamental Performance Characteristics of GPUs and CPUs for Database Analytics 2020 SIGMOD 0.00011425748
1,269 An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory 2016 SIGMOD 0.00011236561
1,350 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010934877
1,383 H2O: A Hands-free Adaptive Store 2014 SIGMOD 0.00010826996
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
1,475 Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware 2016 VLDB 0.00010525713
1,488 Photon: A Fast Query Engine for Lakehouse Systems 2022 SIGMOD 0.00010487094
1,530 Pipelined Query Processing in Coprocessor Environments 2018 SIGMOD 0.00010318943
1,603 Adopting Worst-Case Optimal Joins in Relational Database Systems 2020 VLDB 0.00010090639
1,722 SMOKE: Fine-grained Lineage at Interactive Speed 2018 VLDB 9.781628e-05
1,748 HetExchange: Encapsulating heterogeneous CPU-GPU parallelism in JIT compiled engines 2019 VLDB 9.7176232e-05
1,756 How to Architect a Query Compiler 2016 SIGMOD 9.7053947e-05
1,800 Procedural Extensions of SQL: Understanding their usage in the wild 2021 VLDB 9.5999908e-05
1,812 Tuplex: Data Science in Python at Native Code Speed 2021 SIGMOD 9.5747668e-05
1,835 Data Management for Data Science: Towards Embedded Analytics 2020 CIDR 9.5293678e-05
1,942 Instant Loading for Main Memory Databases 2013 VLDB 9.3133693e-05
2,147 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9595129e-05
2,239 BtrBlocks: Efficient Columnar Compression for Data Lakes 2023 SIGMOD 8.7753778e-05
2,248 Cache-Efficient Aggregation: Hashing Is Sorting 2015 SIGMOD 8.7484225e-05
2,258 Evaluating End-to-End Optimization for Data Analytics Applications in Weld 2018 VLDB 8.7387151e-05
2,278 An Intermediate Representation for Optimizing Machine Learning Pipelines 2019 VLDB 8.6993865e-05
2,433 How to Architect a Query Compiler, Revisited 2018 SIGMOD 8.4614165e-05
2,464 Query Processing on Tensor Computation Runtimes 2022 VLDB 8.4081954e-05
2,474 AnalyticDB: Real-time OLAP Database System at Alibaba Cloud 2019 VLDB 8.3955114e-05
2,505 Towards Scalable Real-time Analytics: An Architecture for Scale-out of OLxP Workloads 2015 VLDB 8.3555487e-05
2,606 Robust Query Processing in Co-Processor-accelerated Databases 2016 SIGMOD 8.2118469e-05
2,673 A Layered Aggregate Engine for Analytics Workloads 2019 SIGMOD 8.1276375e-05
2,700 Major Technical Advancements in Apache Hive 2014 SIGMOD 8.096888e-05
2,812 HyPer-sonic Combined Transaction AND Query Processing 2011 VLDB 7.9566265e-05
2,878 Choosing A Cloud DBMS: Architectures and Tradeoffs 2019 VLDB 7.8955094e-05
2,910 ClickHouse - Lightning Fast Analytics for Everyone 2024 VLDB 7.8621757e-05
Previous Page 1 / 5 Next

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
14 MonetDB/X100: Hyper-Pipelining Query Execution 2005 CIDR 0.00063972112
27 Database Architecture Optimized for the New Bottleneck: Memory Access 1999 VLDB 0.0005146739
218 SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units 2009 VLDB 0.00024342426
626 Adaptive Aggregation on Chip Multiprocessors 2007 VLDB 0.00015431379
702 Database Architecture Evolution: Mammals Flourished long before Dinosaurs became Extinct 2009 VLDB 0.0001464107
766 Conjunctive Selection Conditions in Main Memory 2002 PODS 0.00014105436
1,274 Managing Intra-operator Parallelism in Parallel Database Systems 1995 VLDB 0.00011216274
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 10,794 Scalable GPU Acceleration of Scalar Functions in Analytical Databases: Compilation, Benchmarking, and Optimization 2026 VLDB
2 291 Optimization of Dynamic Query Evaluation Plans 1994 SIGMOD
3 606 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB
4 5,475 Evolution of a Compiling Query Engine 2021 VLDB
5 13,977 Errata for "Building Efficient Query Engines in a High-Level Language" 2014 VLDB
6 8,230 Architecting a Query Compiler for Spatial Workloads 2020 SIGMOD
7 1,756 How to Architect a Query Compiler 2016 SIGMOD
8 1,530 Pipelined Query Processing in Coprocessor Environments 2018 SIGMOD
9 2,433 How to Architect a Query Compiler, Revisited 2018 SIGMOD
10 498 Building Efficient Query Engines in a High-Level Language 2014 VLDB