DBScholar

Back to papers

Shark: SQL and Rich Analytics at Scale

Summary: Shark unifies SQL and analytics on clusters via a distributed memory abstraction into a single scalable engine. In-memory columnar storage, replanning, and fault tolerance enable SQL and ML, 100x faster than Hive/Hadoop, competitive with MPP. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4759
Venue
SIGMOD
Year
2013
Pagerank
0.00018704491
Overall Rank
425 | 97.09%
DOI
10.1145/2463676.2465288

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{xin_sigmod13,
        title = {{Shark: SQL and Rich Analytics at Scale}},
        author = {Xin, Reynold S. and Rosen, Josh and Zaharia, Matei and Franklin, Michael J. and Shenker, Scott and Stoica, Ion},
        series = {{SIGMOD} '13},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2463676.2465288},
        url = {https://dl.acm.org/doi/10.1145/2463676.2465288},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 54 citing papers.

Rank Citing Paper Year Venue Pagerank
24 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00054865648
1,044 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.0001244236
1,175 Simba: Efficient In-Memory Spatial Analytics 2016 SIGMOD 0.00011812263
1,320 From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System 2015 SIGMOD 0.00011166426
1,352 Scuba: Diving into Data at Facebook 2013 VLDB 0.00011064595
1,401 Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems 2014 SIGMOD 0.00010889902
1,448 Skew in Parallel Query Processing 2014 PODS 0.00010758872
1,606 Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing 2014 VLDB 0.00010228576
1,889 SQL-on-Hadoop: Full Circle Back to Shared-Nothing Database Architectures 2014 VLDB 9.5335988e-05
2,156 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 9.0635624e-05
2,398 BigDansing: A System for Big Data Cleansing 2015 SIGMOD 8.631172e-05
2,583 Towards Scalable Real-time Analytics: An Architecture for Scale-out of OLxP Workloads 2015 VLDB 8.3849987e-05
2,599 WideTable: An Accelerator for Analytical Data Processing 2014 VLDB 8.3583572e-05
2,850 HAWQ: A Massively Parallel Processing SQL Engine in Hadoop 2014 SIGMOD 8.0499212e-05
2,937 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.9435581e-05
3,200 Locality-aware Partitioning in Parallel Database Systems 2015 SIGMOD 7.642132e-05
3,494 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.3642231e-05
3,598 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 7.2718988e-05
3,682 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.2035518e-05
4,306 WANalytics: Geo-Distributed Analytics for a Data Intensive World 2015 SIGMOD 6.7702911e-05
4,481 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.6754521e-05
4,826 Design Tradeoffs of Data Access Methods 2016 SIGMOD 6.4904836e-05
5,388 Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing 2022 VLDB 6.2362811e-05
5,720 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 6.1092082e-05
5,983 Adaptive and Robust Query Execution for Lakehouses at Scale 2024 VLDB 6.0206841e-05
6,127 A Performance Study of Big Data on Small Nodes 2015 VLDB 5.9668307e-05
6,255 Elastic Pipelining in an In-Memory Database Cluster 2016 SIGMOD 5.9399698e-05
6,344 Towards General and Efficient Online Tuning for Spark 2023 VLDB 5.9060457e-05
6,585 JoinBoost: Grow Trees Over Normalized Data Using Only SQL 2023 VLDB 5.8350362e-05
6,640 Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters 2013 VLDB 5.8162526e-05
6,653 Adaptive Data Skipping in Main-Memory Systems 2016 SIGMOD 5.8138531e-05
6,734 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.7879923e-05
6,822 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB 5.7627651e-05
6,865 SparkR: Scaling R Programs with Spark 2016 SIGMOD 5.7508365e-05
7,182 Bubble Execution: Resource-aware Reliable Analytics at Cloud Scale 2018 VLDB 5.6793679e-05
7,238 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 5.664642e-05
7,502 Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine 2025 VLDB 5.6029996e-05
7,709 Quill: Efficient, Transferable, and Rich Analytics at Scale 2016 VLDB 5.5628268e-05
7,734 Using VDMS to Index and Search 100M Images 2021 VLDB 5.5563709e-05
8,175 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.4737932e-05
8,446 Parallel-Correctness and Transferability for Conjunctive Queries 2015 PODS 5.4240058e-05
8,455 Piranha: Optimizing Short Jobs in Hadoop 2013 VLDB 5.4226e-05
8,615 A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning 2024 VLDB 5.4005602e-05
9,079 QMapper for Smart Grid: Migrating SQL-based Application to Hive 2015 SIGMOD 5.3251649e-05
9,596 Cost-based Fault-tolerance for Parallel Data Processing 2015 SIGMOD 5.2496236e-05
9,803 Introduction to Spark 2.0 for Database Researchers 2016 SIGMOD 5.21582e-05
10,690 Dynamic Pruning for Recursive Joins 2025 SIGMOD 5.093636e-05
11,885 Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology 2019 VLDB 5.093636e-05
12,032 Logical Aspects of Massively Parallel and Distributed Systems 2016 PODS 5.093636e-05
12,082 Parallel Evaluation of Multi-Semi-Joins 2016 VLDB 5.093636e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012250108
12 C-Store: A Column-oriented DBMS 2005 VLDB 0.00069513174
20 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00056944564
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00051174276
44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00046055057
51 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.0004291425
53 Eddies: Continuously Adaptive Query Processing 2000 SIGMOD 0.00041071971
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031680027
151 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00029161879
155 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028713176
372 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001981521
419 Cost-based Query Scrambling for Initial Delays 1998 SIGMOD 0.0001879684
518 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017167492
872 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013486409
1,225 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.00011590013
1,319 SkewTune: Mitigating Skew in MapReduce Applications 2012 SIGMOD 0.00011175005
1,791 Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce 2010 VLDB 9.7470504e-05
1,794 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 9.7399162e-05
Previous Page 1 / 1 Next

Semantically Similar Papers