Translation of Array-Based Loops to Distributed Data-Parallel Programs

Summary: Automatically translates imperative array-based loops into distributed data-parallel programs, targeting scientists’ existing numerical code. A Spark prototype offers broader translation coverage and improved efficiency over prior approaches, approaching hand-written implementations. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hb3a8942ebac2e3ab
Venue: VLDB
Year: 2020
Pagerank: 5.2559789e-05
Overall Rank: 8,900 | 40.17%
DOI: 10.14778/3389133.3389141

Incoming Non-self Citations Over Time

Authors

1. Leonidas Fegaras (University of Texas)
2. Md Hasanuzzaman Noor (University of Texas)

BibTeX Citation

@article{fegaras_vldb20,
        title = {{Translation of Array-Based Loops to Distributed Data-Parallel Programs}},
        author = {Fegaras, Leonidas and Noor, Md Hasanuzzaman},
        journal = {PVLDB},
        series = {{VLDB} '20},
        volume = {13},
        number = {8},
        pages = {1248--1260},
        doi = {10.14778/3389133.3389141},
        url = {https://doi.org/10.14778/3389133.3389141},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
12,015	TraNCE: Transforming Nested Collections Efficiently	2021	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
23	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00055406774
248	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00023189805
672	The TileDB Array Data Storage Manager	2017	VLDB	0.0001489638
947	Parallelizing Sequential Graph Computations	2017	SIGMOD	0.00012914714
1,274	Rewriting Procedures for Batched Bindings	2008	VLDB	0.00011247334
1,774	ArrayStore: A Storage Manager for Complex Parallel Array Processing	2011	SIGMOD	9.6688719e-05
2,993	Extracting Equivalent SQL from Imperative Code in Database Applications	2016	SIGMOD	7.7721951e-05
4,654	Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications	2018	SIGMOD	6.4849398e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,810	Distributed Data-Parallel Computing Using a High-Level Programming Language	2009	SIGMOD
2	2,422	Parallel Data Analysis Directly on Scientific File Formats	2014	SIGMOD
3	1,774	ArrayStore: A Storage Manager for Complex Parallel Array Processing	2011	SIGMOD
4	1,081	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB
5	2,754	Implicit Parallelism through Deep Language Embedding	2015	SIGMOD
6	2,635	Big Data Analytics with Datalog Queries on Spark	2016	SIGMOD
7	6,996	Bridging the Gap Between HPC and Big Data Frameworks	2017	VLDB
8	2,227	Spinning Fast Iterative Data Flows	2012	VLDB
9	2,723	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD
10	4,212	Optimizing I/O for Big Array Analytics	2012	VLDB