Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve

Summary: Learned adaptive curve for SMA block skipping in high-dimensional data via an attention-based network and end-to-end training. Scales to 1000 columns with a 2.8x block-skipping improvement over static space-filling curves on real Spark workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 7054
Venue: SIGMOD
Year: 2025
Pagerank: 4.1905499e-05
Overall Rank: 10,396 | 27.75%
DOI: 10.1145/3709710

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 24 of 24 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
2	R-Trees: A Dynamic Index Structure For Spatial Searching	1984	SIGMOD	0.0032118946
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
101	The Case for Learned Index Structures	2018	SIGMOD	0.00049778866
203	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00034868567
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031314629
290	Linear Clustering of Objects with Multiple Attributes	1990	SIGMOD	0.00028845557
367	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00025518228
739	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017365933
752	Deep Unsupervised Cardinality Estimation	2020	VLDB	0.00017138049
1,464	Learning Multi-dimensional Indexes	2020	SIGMOD	0.0001184772
1,473	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.00011786148
1,608	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011169837
1,887	Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads	2021	VLDB	0.00010201938
2,676	Effectively Learning Spatial Indices	2020	VLDB	8.326321e-05
2,841	Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies	2009	VLDB	8.0396876e-05
3,731	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	6.8074069e-05
3,777	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	6.7713324e-05
4,954	Dimensions Based Data Clustering and Zone Maps	2017	VLDB	5.8058349e-05
5,339	LEON: A New Framework for ML-Aided Query Optimization	2023	VLDB	5.5596755e-05
6,693	QUILTS: Multidimensional Partitioning Framework Based on Query-Aware and Skew-Tolerant Space-Filling Curves	2017	SIGMOD	4.9557363e-05
6,806	LMSFC: A Novel Multidimensional Index based on Learned Monotonic Space Filling Curves	2023	VLDB	4.917024e-05
8,089	Towards Designing and Learning Piecewise Space-Filling Curves	2023	VLDB	4.5855593e-05
8,223	Automated Multidimensional Data Layouts in Amazon Redshift	2024	SIGMOD	4.5509217e-05
9,107	BASE: Bridging the Gap between Cost and Latency for Query Optimization	2023	VLDB	4.3907944e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
1,464	Learning Multi-dimensional Indexes	2020	SIGMOD	0.0001184772
1,473	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.00011786148
9,700	Towards Functional Decomposition of Storage Formats	2025	CIDR	4.2967256e-05
10,754	Benchmarking Adaptive Multidimensional Indices	2025	VLDB	4.1905499e-05
1,608	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011169837
12,001	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB	4.1905499e-05
8,585	A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning	2024	VLDB	4.4856045e-05
5,116	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	5.6805476e-05
3,777	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	6.7713324e-05
6,807	Adaptive Data Skipping in Main-Memory Systems	2016	SIGMOD	4.915939e-05