Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees

Summary: Two-phase execution for numerical/ML workloads expressed as aggregated join trees (joins then aggregation). Pilot run collects lineage to enable record-level planning before execution; experiments show this relational two-phase approach as an effective platform for distributed ML. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h6421feb9d6ebb633
Venue: VLDB
Year: 2021
Pagerank: 5.0919429e-05
Overall Rank: 10,026 | 32.62%
DOI: 10.14778/3450980.3450991
PDF: Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

1. Dimitrije Jankov (Rice University)
2. Binhang Yuan (Rice University)
3. Shangyu Luo (Rice University)
4. Chris Jermaine (Rice University)

BibTeX Citation

@article{jankov_vldb21,
        title = {{Distributed Numerical and Machine Learning Computations via Two-Phase Execution of Aggregated Join Trees}},
        author = {Jankov, Dimitrije and Yuan, Binhang and Luo, Shangyu and Jermaine, Chris},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {7},
        pages = {1228--1240},
        doi = {10.14778/3450980.3450991},
        url = {https://doi.org/10.14778/3450980.3450991},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,460	In-Database Machine Learning with CorgiPile: Stochastic Gradient Descent without Full Data Shuffle	2022	SIGMOD	5.7746493e-05
6,552	JoinBoost: Grow Trees Over Normalized Data Using Only SQL	2023	VLDB	5.7475822e-05
10,709	Automated Tensor-Relational Decomposition for Large-Scale Sparse Tensor Computation	2026	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0023943337
5	Optimal Aggregation Algorithms for Middleware [Extended Abstract]	2001	PODS	0.0010679903
135	Ripple Joins for Online Aggregation	1999	SIGMOD	0.00029858107
272	An Overview of Query Optimization in Relational Systems	1998	PODS	0.0002251422
337	Trio: A System for Data, Uncertainty, and Lineage	2006	VLDB	0.00020613834
405	Distributed Query Processing In A Relational Data Base System	1978	SIGMOD	0.00019057201
845	Exploiting Inter-Operation Parallelism in XPRS	1992	SIGMOD	0.00013527474
1,713	SMOKE: Fine-grained Lineage at Interactive Speed	2018	VLDB	9.8129981e-05
1,997	Track Join: Distributed Joins with Minimal Network Traffic	2014	SIGMOD	9.2126022e-05
2,401	Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning	2019	VLDB	8.517457e-05
2,829	DB4ML – An In-Memory Database Kernel with Machine Learning Support	2020	SIGMOD	7.9592539e-05
2,978	In-Database Learning with Sparse Tensors	2018	PODS	7.7872011e-05
3,524	MLog: Towards Declarative In-Database Machine Learning	2017	VLDB	7.2303094e-05
3,866	Optimizing Nested Queries with Parameter Sort Orders	2005	VLDB	6.9590958e-05
4,069	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	6.8184364e-05
5,292	Tensor Relational Algebra for Distributed Machine Learning System Design	2021	VLDB	6.1911633e-05
6,764	DistME: A Fast and Elastic Distributed Matrix Computation Engine using GPUs	2019	SIGMOD	5.6863551e-05
9,225	Chasing Similarity: Distribution-aware Aggregation Scheduling	2019	VLDB	5.2032183e-05
9,753	PlinyCompute: A Platform for High-Performance, Distributed, Data-Intensive Tool Development	2018	SIGMOD	5.1325223e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	3,062	Design and Evaluation of Parallel Pipelined Join Algorithms	1987	SIGMOD
2	4,889	Parallel Processing of Recursive Queries in Distributed Architectures	1989	VLDB
3	2,401	Declarative Recursive Computation on an RDBMS or, Why You Should Use a Database For Distributed Machine Learning	2019	VLDB
4	8,275	Accelerate Distributed Joins with Predicate Transfer	2025	SIGMOD
5	6,171	Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra	2021	SIGMOD
6	5,292	Tensor Relational Algebra for Distributed Machine Learning System Design	2021	VLDB
7	1,292	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
8	12,389	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR
9	9,897	Sharing Aggregate Computation for Distributed Queries	2007	SIGMOD
10	3,637	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB