A Deep Dive into Common Open Formats for Analytical DBMSs
Summary: Systematic evaluation of Arrow, Parquet, and ORC against OLAP DBMS requirements, showing how layout, vectorization, compression, metadata, and mmap trade-offs affect query efficiency and integration. Identifies co‑design opportunities for unified in‑memory/on‑disk representation and practical guidance for implementers. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Chunwei Liu (Massachusetts Institute of Technology)
- 2. Anna Pavlenko (Microsoft)
- 3. Matteo Interlandi (Microsoft)
- 4. Brandon Haynes (Microsoft)
BibTeX Citation
@article{liu_vldb23,
title = {{A Deep Dive into Common Open Formats for Analytical DBMSs}},
author = {Liu, Chunwei and Pavlenko, Anna and Interlandi, Matteo and Haynes, Brandon},
journal = {PVLDB},
series = {{VLDB} '23},
volume = {16},
number = {11},
pages = {3044--3056},
doi = {10.14778/3611479.3611507},
url = {https://doi.org/10.14778/3611479.3611507},
year = {2023}
}Incoming Citations (Sorted by Pagerank)
Showing 13 of 13 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 26 of 26 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 503 | Towards a Unified Architecture for in-RDBMS Analytics | 2012 | SIGMOD |
| 2 | 10,022 | Towards Functional Decomposition of Storage Formats | 2025 | CIDR |
| 3 | 2,689 | Major Technical Advancements in Apache Hive | 2014 | SIGMOD |
| 4 | 4,074 | Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine | 2024 | SIGMOD |
| 5 | 976 | A Common Database Approach for OLTP and OLAP Using an In-Memory Column Database | 2009 | SIGMOD |
| 6 | 10,226 | Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability | 2026 | VLDB |
| 7 | 8,228 | Operational Analytics Data Management Systems | 2016 | VLDB |
| 8 | 6,297 | Mainlining Databases: Supporting Fast Transactional Workloads on Universal Columnar Data File Formats | 2021 | VLDB |
| 9 | 2,966 | Choosing A Cloud DBMS: Architectures and Tradeoffs | 2019 | VLDB |
| 10 | 3,808 | An Empirical Evaluation of Columnar Storage Formats | 2024 | VLDB |