Husky: Towards a More Efficient and Expressive Distributed Computing Framework

Summary: Husky is an in-memory distributed framework that exposes finer-grained control than MapReduce/Spark while retaining an intuitive data-parallel model. It unifies implementations of diverse frameworks and matches or exceeds domain-specific systems, reducing reliance on DSLs or MPI. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 11521
Venue: VLDB
Year: 2016
Pagerank: 7.1240627e-05
Overall Rank: 3,789 | 74.01%
DOI: 10.14778/2876473.2876477

Incoming Non-self Citations Over Time

Authors

1. Fan Yang (Chinese University of Hong Kong)
2. Jinfeng Li (Chinese University of Hong Kong)
3. James Cheng (Chinese University of Hong Kong)

BibTeX Citation

@article{yang_vldb16,
        title = {{Husky: Towards a More Efficient and Expressive Distributed Computing Framework}},
        author = {Yang, Fan and Li, Jinfeng and Cheng, James},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {5},
        pages = {420--431},
        doi = {10.14778/2876473.2876477},
        url = {https://doi.org/10.14778/2876473.2876477},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,693	FlexPS: Flexible Parallelism Control in Parameter Server Architecture	2018	VLDB	8.247004e-05
2,854	Extracting and Analyzing Hidden Graphs from Relational Databases	2017	SIGMOD	8.0350257e-05
3,351	RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! -	2018	VLDB	7.4937347e-05
3,858	A General and Efficient Querying Method for Learning to Hash	2018	SIGMOD	7.067591e-05
4,456	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	6.692321e-05
6,519	Dynamic Parameter Allocation in Parameter Servers	2020	VLDB	5.8536062e-05
7,281	A General-Purpose Query-Centric Framework for Querying Big Graphs	2016	VLDB	5.6567845e-05
8,270	LFTF: A Framework for Efficient Tensor Analytics at Scale	2017	VLDB	5.4574671e-05
9,885	RushMon: Real-time Isolation Anomalies Monitoring	2018	SIGMOD	5.2014857e-05
10,076	Chukonu: A Fully-Featured High-Performance Big Data Framework that Integrates a Native Compute Engine into Spark	2022	VLDB	5.1613298e-05
11,963	My Weak Consistency is Strong: When Bad Things Do Not Come in Threes	2017	CIDR	5.093636e-05
11,987	The Best of Both Worlds: Big Data Programming with Both Productivity and Performance	2017	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
3	Pregel: A System for Large-Scale Graph Processing	2010	SIGMOD	0.0012250108
220	Storm @Twitter	2014	SIGMOD	0.00024244587
224	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00024130894
452	An Architecture for Parallel Topic Models	2010	VLDB	0.00018146809
937	Blogel: A Block-Centric Framework for Distributed Computation on Real-World Graphs	2014	VLDB	0.00013091546
2,354	epiC: an Extensible and Scalable System for Processing Big Data	2014	VLDB	8.7060612e-05
2,615	NOMAD: Non-locking, stOchastic Multi-machine algorithm for Asynchronous and Decentralized matrix completion	2014	VLDB	8.340186e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB
2	372	HaLoop: Efficient Iterative Data Processing on Large Clusters	2010	VLDB
3	4,599	Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications	2018	SIGMOD
4	1,079	Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML	2014	VLDB
5	2,265	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD
6	6,850	Bridging the Gap Between HPC and Big Data Frameworks	2017	VLDB
7	2,207	Shark: Fast Data Analysis Using Coarse-grained Distributed Memory	2012	SIGMOD
8	1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB
9	2,681	Exploiting Matrix Dependency for Efficient Distributed Matrix Computation	2015	SIGMOD
10	11,987	The Best of Both Worlds: Big Data Programming with Both Productivity and Performance	2017	SIGMOD