BlockJoin: Efficient Matrix Partitioning Through Joins

Summary: BlockJoin fuses relational and linear-algebra operators to emit block-partitioned results, cutting shuffles. Adapts columnar techniques (index-joins, late materialization) to dataflow engines, delivering 6x speedups and skew resilience vs Spark. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11518
Venue: VLDB
Year: 2017
Pagerank: 4.3384032e-05
Overall Rank: 9,442 | 34.38%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,122	SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle	2020	CIDR	9.4905306e-05
2,355	An Intermediate Representation for Optimizing Machine Learning Pipelines	2019	VLDB	8.9727612e-05

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Implementation Techniques For Main Memory Database Systems	1984	SIGMOD	0.001426258
51	Including Group-By in Query Optimization	1994	VLDB	0.00067060283
52	Database Architecture Optimized for the new Bottleneck: Memory Access	1999	VLDB	0.00066322421
169	MAD Skills: New Analysis Practices for Big Data	2009	VLDB	0.00038967371
319	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00027771951
496	Column-Stores vs. Row-Stores: How Different Are They Really?	2008	SIGMOD	0.00021705611
543	MLbase: A Distributed Machine-learning System	2013	CIDR	0.0002050918
557	SystemML: Declarative Machine Learning on Spark	2016	VLDB	0.00020186115
584	Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems	2012	VLDB	0.00019700451
758	Materialization Optimizations for Feature Selection Workloads	2014	SIGMOD	0.00017053915
856	The Multidimensional Database System RasDaMan	1998	SIGMOD	0.00015845377
1,073	Processing Theta-Joins using MapReduce*	2011	SIGMOD	0.00014255717
1,172	Learning Generalized Linear Models Over Normalized Data	2015	SIGMOD	0.00013504249
1,635	Query Processing Techniques for Solid State Drives	2009	SIGMOD	0.00011059682
1,970	Compressed Linear Algebra for Large-Scale Machine Learning	2016	VLDB	9.9024431e-05
2,518	Track Join: Distributed Joins with Minimal Network Traffic	2014	SIGMOD	8.6052941e-05
2,672	Cumulon: Optimizing Statistical Data Analysis in the Cloud	2013	SIGMOD	8.3334428e-05
2,823	Implicit Parallelism through Deep Language Embedding	2015	SIGMOD	8.0593793e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
962	A Comparison of Join Algorithms for Log Processing in MapReduce	2010	SIGMOD	0.00015003834
442	Efficient Parallel Set-Similarity Joins Using MapReduce	2010	SIGMOD	0.00023095823
3,139	ClusterJoin: A Similarity Joins Framework using Map-Reduce	2014	VLDB	7.4915127e-05
1,938	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD	0.00010025547
6,194	Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra	2021	SIGMOD	5.1592984e-05
10,933	Similarity Joins of Sparse Features	2024	SIGMOD	4.1905499e-05
5,116	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	5.6805476e-05
11,805	Runtime Optimization of Join Location in Parallel Data Management Systems	2017	VLDB	4.1905499e-05
11,898	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR	4.1905499e-05
3,384	Scalable and Adaptive Online Joins	2014	VLDB	7.153329e-05