Redundancy Elimination in Distributed Matrix Computation

Summary: ReMac: automatic and adaptive redundancy elimination for distributed matrix computation. It uses block-wise search to rapidly uncover common subexpressions and a DP-based cost model to generate efficient plans while preserving operator order; implemented on SystemDS with orders-of-magnitude gains over prior solutions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6391
Venue: SIGMOD
Year: 2022
Pagerank: 5.093636e-05
Overall Rank: 11,537 | 20.85%
DOI: 10.1145/3514221.3517877

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Zihao Chen (East China Normal University)
2. Baokun Han (East China Normal University)
3. Chen Xu (East China Normal University)
4. Weining Qian (East China Normal University)
5. Aoying Zhou (East China Normal University)

BibTeX Citation

@inproceedings{chen_sigmod22,
        title = {{Redundancy Elimination in Distributed Matrix Computation}},
        author = {Chen, Zihao and Han, Baokun and Xu, Chen and Qian, Weining and Zhou, Aoying},
        series = {{SIGMOD} '22},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3514221.3517877},
        url = {https://dl.acm.org/doi/10.1145/3514221.3517877},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,232	EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines	2026	SIGMOD	5.093636e-05
11,600	ReMac: A Matrix Computation System with Redundancy Elimination	2022	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
239	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00023674329
415	SystemML: Declarative Machine Learning on Spark	2016	VLDB	0.0001888524
1,157	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00011924049
1,250	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011485301
1,756	SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle	2020	CIDR	9.8172465e-05
2,078	Query Optimization in Microsoft SQL Server PDW	2012	SIGMOD	9.2078209e-05
2,095	Enhanced Subquery Optimizations in Oracle	2009	VLDB	9.1803718e-05
2,239	An Intermediate Representation for Optimizing Machine Learning Pipelines	2019	VLDB	8.8875753e-05
2,681	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD	8.2632778e-05
3,205	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB	7.6386536e-05
3,284	SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning	2017	CIDR	7.5663058e-05
3,459	A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics	2018	VLDB	7.3953716e-05
4,240	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	6.809685e-05
4,409	MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions	2019	SIGMOD	6.7178579e-05
4,976	SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra	2020	VLDB	6.4168322e-05
6,632	DistME: A Fast and Elastic Distributed Matrix Computation Engine using GPUs	2019	SIGMOD	5.8190054e-05
8,483	Optimization of Common Table Expressions in MPP Database Systems	2015	VLDB	5.4157148e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	3,205	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB
2	4,673	Handling Redundancy in the Processing of Recursive Database Queries	1987	SIGMOD
3	2,893	Distributed Data Deduplication	2016	VLDB
4	9,766	On Efficient Large Sparse Matrix Chain Multiplication	2024	SIGMOD
5	9,718	Sharing Aggregate Computation for Distributed Queries	2007	SIGMOD
6	7,143	Parallel Algorithms for Sparse Matrix Multiplication and Join-Aggregate Queries	2020	PODS
7	6,046	Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra	2021	SIGMOD
8	11,669	Hybrid Evaluation for Distributed Iterative Matrix Computation	2021	SIGMOD
9	2,681	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD
10	11,600	ReMac: A Matrix Computation System with Redundancy Elimination	2022	VLDB