DBScholar

Back to papers

Mainlining Databases: Supporting Fast Transactional Workloads on Universal Columnar Data File Formats

Summary: In-memory DBMS storage emits universal columnar blocks (Apache Arrow) tailored to data usage, reducing OLTP-analytic data movement. Relaxed update formats with lightweight transforms to read-optimized layouts on cold data and fast Arrow exports in NoisePage yield OLTP parity and large export speedups. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
12761
Venue
VLDB
Year
2021
Pagerank
5.9357781e-05
Overall Rank
6,264 | 57.03%
DOI
10.14778/3436905.3436913

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{li_vldb21,
        title = {{Mainlining Databases: Supporting Fast Transactional Workloads on Universal Columnar Data File Formats}},
        author = {Li, Tianyu and Butrovich, Matthew and Ngom, Amadou and Lim, Wan Shen and McKinney, Wes and Pavlo, Andrew},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {4},
        pages = {534--546},
        doi = {10.14778/3436905.3436913},
        url = {https://doi.org/10.14778/3436905.3436913},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 11 of 11 citing papers.

Rank Citing Paper Year Venue Pagerank
5,000 Permutable Compiled Queries: Dynamically Adapting Compiled Queries without Recompiling 2021 VLDB 6.4069917e-05
5,037 A Deep Dive into Common Open Formats for Analytical DBMSs 2023 VLDB 6.3914026e-05
5,805 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 6.0822211e-05
6,628 ConnectorX: Accelerating Data Loading From Databases to Dataframes 2022 VLDB 5.8197537e-05
6,782 Everything is a Transaction: Unifying Logical Concurrency Control and Physical Data Structure Maintenance in Database Management Systems 2021 CIDR 5.7762362e-05
7,785 Tastes Great! Less Filling! High Performance and Accurate Training Data Collection for Self-Driving Database Management Systems 2022 SIGMOD 5.5450355e-05
7,988 Scalable and Robust Snapshot Isolation for High-Performance Storage Engines 2023 VLDB 5.5113542e-05
9,708 Deploying Computational Storage for HTAP DBMSs Takes More Than Just Computation Offloading 2023 VLDB 5.2345314e-05
10,058 TiQuE: Improving the Transactional Performance of Analytical Systems for True Hybrid Workloads 2023 VLDB 5.1664022e-05
10,355 Counting Is All You Need for Instant Tuple Discovery: Enabling Real-Time HTAP in Standalone DBMSs 2026 SIGMOD 5.093636e-05
10,770 Moving on From Group Commit: Autonomous Commit Enables High Throughput and Low Latency on NVMe SSDs 2025 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
7 Implementation Techniques For Main Memory Database Systems 1984 SIGMOD 0.00083340894
14 MonetDB/X100: Hyper-Pipelining Query Execution 2005 CIDR 0.0006312782
68 The End of an Architectural Era (It’s Time for a Complete Rewrite) 2007 VLDB 0.00038446206
172 High-Performance Concurrency Control Mechanisms for Main-Memory Databases 2012 VLDB 0.00027281663
226 OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases 2014 VLDB 0.00024027277
233 Fast Serializable Multi-Version Concurrency Control for Main-Memory Database Systems 2015 SIGMOD 0.00023815642
345 Column-Stores vs. Row-Stores: How Different Are They Really? 2008 SIGMOD 0.00020656723
428 HYRISE—A Main Memory Hybrid Storage Engine 2011 VLDB 0.00018633493
473 Staring into the Abyss: An Evaluation of Concurrency Control with One Thousand Cores 2015 VLDB 0.00017900942
575 Efficient Transaction Processing in SAP HANA Database – The End of a Column Store Myth 2012 SIGMOD 0.00016257033
614 Faster: A Concurrent Key-Value Store with In-Place Updates 2018 SIGMOD 0.00015720975
649 Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask 2018 VLDB 0.00015320656
720 Anti-Caching: A New Approach to Database Management System Architecture 2013 VLDB 0.00014632914
903 An Empirical Evaluation of In-Memory Multi-Version Concurrency Control 2017 VLDB 0.0001332486
941 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013078348
1,199 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011703966
1,367 H2O: A Hands-free Adaptive Store 2014 SIGMOD 0.00011014419
1,379 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010970894
1,390 Building a Bw-Tree Takes More Than Just Buzz Words 2018 SIGMOD 0.00010942775
2,388 Low-Overhead Asynchronous Checkpointing in Main-Memory Database Systems 2016 SIGMOD 8.6474765e-05
3,292 Compacting Transactional Data in Hybrid OLTP&OLAP Databases 2012 VLDB 7.5518441e-05
3,434 Hybrid Garbage Collection for Multi-Version Concurrency Control in SAP HANA 2016 SIGMOD 7.4172842e-05
3,489 Read-Optimized Databases, In Depth 2008 VLDB 7.3670717e-05
4,036 Don’t Hold My Data Hostage – A Case For Client Protocol Redesign 2017 VLDB 6.9436548e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,903 Instant Loading for Main Memory Databases 2013 VLDB
2 29 Database Architecture Optimized for the New Bottleneck: Memory Access 1999 VLDB
3 3,357 Columnar Storage and List-based Processing for Graph Database Management Systems 2021 VLDB
4 10,067 Shared Load(ing): Efficient Bulk Loading into Optimized Storage 2020 CIDR
5 5,715 Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases 2013 VLDB
6 630 Performance Tradeoffs in Read-Optimized Databases 2006 VLDB
7 3,902 The Impact of Columnar In-Memory Databases on Enterprise Systems: Implications of Eliminating Transaction-Maintained Aggregates 2014 VLDB
8 966 A Common Database Approach for OLTP and OLAP Using an In-Memory Column Database 2009 SIGMOD
9 3,877 An Empirical Evaluation of Columnar Storage Formats 2024 VLDB
10 1,199 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD