Optimizing I/O for Big Array Analytics

Summary: Introduces a declarative framework for big array analytics via nested-loop tasks, exposing shared I/O opportunities. An optimizer finds execution plans that exploit cross-step I/O sharing, yielding notable data-movement savings. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10706
Venue: VLDB
Year: 2012
Pagerank: 6.8783832e-05
Overall Rank: 4,137 | 71.62%
DOI: 10.14778/2824032.2824057

Incoming Non-self Citations Over Time

Authors

1. Yi Zhang (Duke University)
2. Jun Yang (Duke University)

BibTeX Citation

@article{zhang_vldb12,
        title = {{Optimizing I/O for Big Array Analytics}},
        author = {Zhang, Yi and Yang, Jun},
        journal = {PVLDB},
        series = {{VLDB} '12},
        volume = {8},
        number = {12},
        pages = {1666--1677},
        doi = {10.14778/2824032.2824057},
        url = {https://doi.org/10.14778/2824032.2824057},
        year = {2012}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,079	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB	0.00012258469
1,250	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011485301
4,452	Just-in-time compilation for SQL query processing	2013	VLDB	6.6942969e-05
5,356	Code generation for efficient query processing in managed runtimes	2014	VLDB	6.2498397e-05
7,662	Measuring and Optimizing Distributed Array Programs	2016	VLDB	5.5732476e-05
8,606	PreVision: An Out-of-Core Matrix Computation System with Optimal Buffer Replacement	2024	SIGMOD	5.4026249e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.0006312782
27	Fast Algorithms for Mining Association Rules	1994	VLDB	0.00052255472
128	Efficient and Extensible Algorithms for Multi Query Optimization	2000	SIGMOD	0.0003072825
239	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00023674329
383	QPipe: A Simultaneously Pipelined Relational Query Engine	2005	SIGMOD	0.00019520728
761	Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS	2007	VLDB	0.00014254351
1,024	The DataPath System: A Data-Centric Analytic Processing Engine for Large Data Warehouses	2010	SIGMOD	0.0001258839
1,039	RIOT: I/O-Efficient Numerical Computing without SQL	2009	CIDR	0.00012474977
9,580	Storing Matrices on Disk: Theory and Practice Revisited	2011	VLDB	5.2528121e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,481	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD
2	4,845	Explaining Outputs in Modern Data Analytics	2016	VLDB
3	5,534	Skew-Aware Join Optimization for Array Databases	2015	SIGMOD
4	3,035	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD
5	1,742	ArrayStore: A Storage Manager for Complex Parallel Array Processing	2011	SIGMOD
6	5,388	Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing	2022	VLDB
7	2,164	Opening the Black Boxes in Data Flow Optimization	2012	VLDB
8	2,196	Spinning Fast Iterative Data Flows	2012	VLDB
9	1,320	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
10	8,738	Translation of Array-Based Loops to Distributed Data-Parallel Programs	2020	VLDB