Translation of Array-Based Loops to Distributed Data-Parallel Programs

Summary: Automatically translates imperative array-based loops into distributed data-parallel programs, targeting scientists’ existing numerical code. A Spark prototype offers broader translation coverage and improved efficiency over prior approaches, approaching hand-written implementations. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 12228
Venue: VLDB
Year: 2020
Pagerank: 5.3766157e-05
Overall Rank: 8,738 | 40.05%
DOI: 10.14778/3389133.3389141

Incoming Non-self Citations Over Time

Authors

1. Leonidas Fegaras (University of Texas)
2. Md Hasanuzzaman Noor (University of Texas)

BibTeX Citation

@article{fegaras_vldb20,
        title = {{Translation of Array-Based Loops to Distributed Data-Parallel Programs}},
        author = {Fegaras, Leonidas and Noor, Md Hasanuzzaman},
        journal = {PVLDB},
        series = {{VLDB} '20},
        volume = {13},
        number = {8},
        pages = {1248--1260},
        doi = {10.14778/3389133.3389141},
        url = {https://doi.org/10.14778/3389133.3389141},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
11,711	TraNCE: Transforming Nested Collections Efficiently	2021	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
239	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00023674329
669	The TileDB Array Data Storage Manager	2017	VLDB	0.00015163245
956	Parallelizing Sequential Graph Computations	2017	SIGMOD	0.0001297452
1,261	Rewriting Procedures for Batched Bindings	2008	VLDB	0.0001143305
1,742	ArrayStore: A Storage Manager for Complex Parallel Array Processing	2011	SIGMOD	9.8748669e-05
2,939	Extracting Equivalent SQL from Imperative Code in Database Applications	2016	SIGMOD	7.9395908e-05
4,599	Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications	2018	SIGMOD	6.6122875e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,794	Distributed Data-Parallel Computing Using a High-Level Programming Language	2009	SIGMOD
2	2,389	Parallel Data Analysis Directly on Scientific File Formats	2014	SIGMOD
3	1,742	ArrayStore: A Storage Manager for Complex Parallel Array Processing	2011	SIGMOD
4	1,079	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB
5	2,717	Implicit Parallelism through Deep Language Embedding	2015	SIGMOD
6	2,594	Big Data Analytics with Datalog Queries on Spark	2016	SIGMOD
7	6,850	Bridging the Gap Between HPC and Big Data Frameworks	2017	VLDB
8	2,196	Spinning Fast Iterative Data Flows	2012	VLDB
9	2,681	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD
10	4,137	Optimizing I/O for Big Array Analytics	2012	VLDB