Pando: Enhanced Data Skipping with Logical Data Partitioning

Summary: Pando improves automatic physical layout design by exploiting correlations among workload predicates through logical, correlation-aware partitioning. It enables up to 2.8× fewer blocks scanned and 2.3× faster queries than state-of-the-art skipping methods. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 13270
Venue: VLDB
Year: 2023
Pagerank: 5.9970052e-05
Overall Rank: 6,042 | 58.55%
DOI: 10.14778/3598581.3598601

Incoming Non-self Citations Over Time

Authors

1. Sivaprasad Sudhir (Massachusetts Institute of Technology; Meta)
2. Wenbo Tao (Meta)
3. Nikolay Laptev (Meta)
4. Cyrille Habis (Meta)
5. Michael Cafarella (Massachusetts Institute of Technology)
6. Samuel Madden (Massachusetts Institute of Technology)

BibTeX Citation

@article{sudhir_vldb23,
        title = {{Pando: Enhanced Data Skipping with Logical Data Partitioning}},
        author = {Sudhir, Sivaprasad and Tao, Wenbo and Laptev, Nikolay and Habis, Cyrille and Cafarella, Michael and Madden, Samuel},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {9},
        pages = {2316--2329},
        doi = {10.14778/3598581.3598601},
        url = {https://doi.org/10.14778/3598581.3598601},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,465	Automated Multidimensional Data Layouts in Amazon Redshift	2024	SIGMOD	5.6108826e-05
7,469	Optimizing Collections of Bloom Filters within a Space Budget	2024	VLDB	5.609743e-05
9,913	Adaptive data transformations for QaaS	2025	CIDR	5.1955087e-05
10,355	Counting Is All You Need for Instant Tuple Discovery: Enabling Real-Time HTAP in Standalone DBMSs	2026	SIGMOD	5.093636e-05
10,430	Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning	2026	SIGMOD	5.093636e-05
11,274	Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines	2024	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
12	C-Store: A Column-oriented DBMS	2005	VLDB	0.00069513174
18	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059284255
87	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035281619
126	Schism: a Workload-Driven Approach to Database Replication and Partitioning	2010	VLDB	0.00030779127
156	An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server	1997	VLDB	0.00028636811
199	Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design	2004	SIGMOD	0.00025612088
227	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00023958508
246	Automating Physical Database Design in a Parallel Database	2002	SIGMOD	0.00023457421
568	SageDB: A Learned Database System	2019	CIDR	0.0001641553
940	Enhancements to SQL Server Column Stores	2013	SIGMOD	0.00013081205
1,044	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.0001244236
1,135	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00012032847
1,174	Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads	2021	VLDB	0.00011817414
1,500	Efficient Discovery of Approximate Dependencies	2018	VLDB	0.00010561098
1,648	BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data	2003	VLDB	0.00010120668
2,213	Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations	2019	SIGMOD	8.9410226e-05
2,302	Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies	2009	VLDB	8.7808696e-05
2,499	Learning a Partitioning Advisor for Cloud Databases	2020	SIGMOD	8.4993549e-05
2,866	Optimal Column Layout for Hybrid Workloads	2019	VLDB	8.0175489e-05
3,035	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	7.8297746e-05
3,106	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	7.7515666e-05
3,137	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB	7.7204167e-05
3,413	Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing	2017	VLDB	7.4326381e-05
3,449	CORADD: Correlation Aware Database Designer for Materialized Views and Indexes	2010	VLDB	7.4074656e-05
3,967	STAR: Scaling Transactions through Asymmetric Replication	2019	VLDB	6.984665e-05
6,076	Self-Organizing Data Containers	2022	CIDR	5.9852895e-05
6,670	Replicated Layout for In-Memory Database Systems	2022	VLDB	5.8074043e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,585	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD
2	9,836	Towards Functional Decomposition of Storage Formats	2025	CIDR
3	471	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD
4	6,653	Adaptive Data Skipping in Main-Memory Systems	2016	SIGMOD
5	246	Automating Physical Database Design in a Parallel Database	2002	SIGMOD
6	3,200	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
7	1,044	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD
8	8,889	Provenance-based Data Skipping	2022	VLDB
9	3,106	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB
10	12,191	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB