Redundancy Elimination in Distributed Matrix Computation

Summary: ReMac: automatic and adaptive redundancy elimination for distributed matrix computation. It uses block-wise search to rapidly uncover common subexpressions and a DP-based cost model to generate efficient plans while preserving operator order; implemented on SystemDS with orders-of-magnitude gains over prior solutions. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h30583c8711f89376
Venue: SIGMOD
Year: 2022
Pagerank: 4.9769913e-05
Overall Rank: 11,852 | 20.35%
DOI: 10.1145/3514221.3517877

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Zihao Chen (East China Normal University)
2. Baokun Han (East China Normal University)
3. Chen Xu (East China Normal University)
4. Weining Qian (East China Normal University)
5. Aoying Zhou (East China Normal University)

BibTeX Citation

@inproceedings{chen_sigmod22,
        title = {{Redundancy Elimination in Distributed Matrix Computation}},
        author = {Chen, Zihao and Han, Baokun and Xu, Chen and Qian, Weining and Zhou, Aoying},
        series = {{SIGMOD} '22},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3514221.3517877},
        url = {https://dl.acm.org/doi/10.1145/3514221.3517877},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,459	EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines	2026	SIGMOD	4.9769913e-05
11,914	ReMac: A Matrix Computation System with Redundancy Elimination	2022	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
248	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00023179865
416	SystemML: Declarative Machine Learning on Spark	2016	VLDB	0.00018650998
1,152	Cerebro: A Data System for Optimized Deep Learning Model Selection	2020	VLDB	0.00011796404
1,223	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011468426
1,669	SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle	2020	CIDR	9.9324573e-05
2,089	Query Optimization in Microsoft SQL Server PDW	2012	SIGMOD	9.0635188e-05
2,109	Enhanced Subquery Optimizations in Oracle	2009	VLDB	9.0230202e-05
2,266	An Intermediate Representation for Optimizing Machine Learning Pipelines	2019	VLDB	8.7248802e-05
2,724	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD	8.090674e-05
3,103	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB	7.6456038e-05
3,331	SPOOF: Sum-Product Optimization and Operator Fusion for Large-Scale Machine Learning	2017	CIDR	7.4138851e-05
3,518	A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics	2018	VLDB	7.236638e-05
4,330	MNC: Structure-Exploiting Sparsity Estimation for Matrix Expressions	2019	SIGMOD	6.6564176e-05
4,334	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	6.6537801e-05
4,975	SPORES: Sum-Product Optimization via Relational Equality Saturation for Large Scale Linear Algebra	2020	VLDB	6.3289021e-05
6,764	DistME: A Fast and Elastic Distributed Matrix Computation Engine using GPUs	2019	SIGMOD	5.6863551e-05
8,660	Optimization of Common Table Expressions in MPP Database Systems	2015	VLDB	5.2919676e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	3,103	On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML	2018	VLDB
2	4,770	Handling Redundancy in the Processing of Recursive Database Queries	1987	SIGMOD
3	2,949	Distributed Data Deduplication	2016	VLDB
4	9,952	On Efficient Large Sparse Matrix Chain Multiplication	2024	SIGMOD
5	9,897	Sharing Aggregate Computation for Distributed Queries	2007	SIGMOD
6	7,295	Parallel Algorithms for Sparse Matrix Multiplication and Join-Aggregate Queries	2020	PODS
7	6,171	Automatic Optimization of Matrix Implementations for Distributed Machine Learning and Linear Algebra	2021	SIGMOD
8	11,982	Hybrid Evaluation for Distributed Iterative Matrix Computation	2021	SIGMOD
9	2,724	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD
10	11,914	ReMac: A Matrix Computation System with Redundancy Elimination	2022	VLDB