Back to papers
Nested Parquet Is Flat, Why Not Use It? How To Scan Nested Data With On-the-Fly Key Generation and Joins
Summary: Process nested Parquet in relational engines via on-the-fly join-key generation to reconstruct nesting without materializing an internal format. Scans flat Parquet columns and uses on-the-fly joins to rebuild nesting, delivering vastly faster analytics.
(summarized by gpt-5-nano on Feb 09 2026)
- Paper ID
- 7249
- Venue
- SIGMOD
- Year
- 2025
- Pagerank
- 4.1905499e-05
- Overall Rank
- 10,504 | 27.00%
- DOI
-
10.1145/3725329
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
Outgoing Citations (Sorted by Pagerank)
Showing 23 of 23 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 99 |
XMark: A Benchmark for XML Data Management |
2002 |
VLDB |
0.00050043993 |
| 109 |
Dremel: Interactive Analysis of Web-Scale Datasets |
2010 |
VLDB |
0.00048217028 |
| 153 |
Relational Databases for Querying XML Documents: Limitations and Opportunities |
1999 |
VLDB |
0.00040759404 |
| 185 |
DuckDB: an Embeddable Analytical Database |
2019 |
SIGMOD |
0.00036529607 |
| 206 |
Storing Semistructured Data with STORED |
1999 |
SIGMOD |
0.00034583517 |
| 350 |
Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs |
2009 |
VLDB |
0.00026368305 |
| 403 |
Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited |
2014 |
VLDB |
0.00024176677 |
| 538 |
Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs |
2011 |
SIGMOD |
0.00020632609 |
| 729 |
Umbra: A Disk-Based System with In-Memory Performance |
2020 |
CIDR |
0.00017448059 |
| 1,437 |
AsterixDB: A Scalable, Open Source BDMS |
2014 |
VLDB |
0.00011973401 |
| 2,060 |
Dremel: A Decade of Interactive SQL Analysis at Web Scale |
2020 |
VLDB |
9.6585115e-05 |
| 2,472 |
Photon: A Fast Query Engine for Lakehouse Systems |
2022 |
SIGMOD |
8.7156826e-05 |
| 3,642 |
BtrBlocks: Efficient Columnar Compression for Data Lakes |
2023 |
SIGMOD |
6.8876984e-05 |
| 3,719 |
To Partition, or Not to Partition, That is the Join Question in a Real System |
2021 |
SIGMOD |
6.8141176e-05 |
| 4,516 |
An Empirical Evaluation of Columnar Storage Formats |
2024 |
VLDB |
6.1146215e-05 |
| 4,702 |
JSON Tiles: Fast Analytics on Semi-Structured Data |
2021 |
SIGMOD |
5.9796907e-05 |
| 5,571 |
A Deep Dive into Common Open Formats for Analytical DBMSs |
2023 |
VLDB |
5.4279553e-05 |
| 6,082 |
The Flatter, the Better: Query Compilation Based on the Flattening Transformation |
2015 |
SIGMOD |
5.2175854e-05 |
| 6,661 |
Scalable Querying of Nested Data |
2021 |
VLDB |
4.9663934e-05 |
| 6,675 |
Exploiting Common Patterns for Tree-Structured Data |
2017 |
SIGMOD |
4.9615691e-05 |
| 7,427 |
Selection Pushdown in Column Stores using Bit Manipulation Instructions |
2023 |
SIGMOD |
4.7282014e-05 |
| 7,554 |
Storing and Querying Tree-Structured Records in Dremel |
2014 |
VLDB |
4.7079131e-05 |
| 8,727 |
Columnar Formats for Schemaless LSM-based Document Stores |
2022 |
VLDB |
4.4534547e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 5,571 |
A Deep Dive into Common Open Formats for Analytical DBMSs |
2023 |
VLDB |
5.4279553e-05 |
| 3,380 |
Query Shredding: Efficient Relational Evaluation of Queries over Nested Multisets |
2014 |
SIGMOD |
7.1565855e-05 |
| 9,008 |
The Power of Nested Parallelism in Big Data Processing – Hitting Three Flies with One Slap – |
2021 |
SIGMOD |
4.4065351e-05 |
| 4,516 |
An Empirical Evaluation of Columnar Storage Formats |
2024 |
VLDB |
6.1146215e-05 |
| 2,109 |
A Recursive Algebra and Query Optimization for Nested Relations |
1989 |
SIGMOD |
9.5283567e-05 |
| 4,411 |
An Implementation for Nested Relational Databases |
1988 |
VLDB |
6.2005552e-05 |
| 8,676 |
A Practical Approach to Groupjoin and Nested Aggregates |
2021 |
VLDB |
4.4652082e-05 |
| 2,466 |
Supporting Flat Relations by a Nested Relational Kernel |
1987 |
VLDB |
8.734134e-05 |
| 12,543 |
A Nested Relational Approach to Processing SQL Subqueries |
2005 |
SIGMOD |
4.1905499e-05 |
| 6,661 |
Scalable Querying of Nested Data |
2021 |
VLDB |
4.9663934e-05 |