DBScholar

Back to papers

Shark: SQL and Rich Analytics at Scale

Summary: Shark unifies SQL and analytics on clusters via a distributed memory abstraction into a single scalable engine. In-memory columnar storage, replanning, and fault tolerance enable SQL and ML, 100x faster than Hive/Hadoop, competitive with MPP. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hb5edf1e8c00cfaf4
Venue
SIGMOD
Year
2013
Pagerank
0.00018339357
Overall Rank
432 | 97.10%
DOI
10.1145/2463676.2465288

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{xin_sigmod13,
        title = {{Shark: SQL and Rich Analytics at Scale}},
        author = {Xin, Reynold S. and Rosen, Josh and Zaharia, Matei and Franklin, Michael J. and Shenker, Scott and Stoica, Ion},
        series = {{SIGMOD} '13},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2463676.2465288},
        url = {https://dl.acm.org/doi/10.1145/2463676.2465288},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 54 citing papers.

Rank Citing Paper Year Venue Pagerank
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055406774
1,036 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012377471
1,178 Simba: Efficient In-Memory Spatial Analytics 2016 SIGMOD 0.00011632691
1,292 From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System 2015 SIGMOD 0.00011152286
1,381 Scuba: Diving into Data at Facebook 2013 VLDB 0.00010860462
1,428 Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems 2014 SIGMOD 0.00010693831
1,481 Skew in Parallel Query Processing 2014 PODS 0.00010539119
1,622 Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing 2014 VLDB 0.00010051462
1,884 SQL-on-Hadoop: Full Circle Back to Shared-Nothing Database Architectures 2014 VLDB 9.4388097e-05
2,137 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9777553e-05
2,423 BigDansing: A System for Big Data Cleansing 2015 SIGMOD 8.4877894e-05
2,499 Towards Scalable Real-time Analytics: An Architecture for Scale-out of OLxP Workloads 2015 VLDB 8.3815142e-05
2,628 WideTable: An Accelerator for Analytical Data Processing 2014 VLDB 8.2053454e-05
2,898 HAWQ: A Massively Parallel Processing SQL Engine in Hadoop 2014 SIGMOD 7.8853204e-05
2,952 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.8153507e-05
3,239 Locality-aware Partitioning in Parallel Database Systems 2015 SIGMOD 7.5007569e-05
3,556 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.2084485e-05
3,599 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 7.1773938e-05
3,737 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.0628666e-05
4,069 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.821366e-05
4,394 WANalytics: Geo-Distributed Analytics for a Data Intensive World 2015 SIGMOD 6.618384e-05
4,885 Design Tradeoffs of Data Access Methods 2016 SIGMOD 6.3706825e-05
5,058 Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing 2022 VLDB 6.2926774e-05
5,348 Adaptive and Robust Query Execution for Lakehouses at Scale 2024 VLDB 6.1690434e-05
5,834 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.9759267e-05
6,259 A Performance Study of Big Data on Small Nodes 2015 VLDB 5.832951e-05
6,288 Elastic Pipelining in an In-Memory Database Cluster 2016 SIGMOD 5.8227911e-05
6,450 Towards General and Efficient Online Tuning for Spark 2023 VLDB 5.7817872e-05
6,550 JoinBoost: Grow Trees Over Normalized Data Using Only SQL 2023 VLDB 5.7503043e-05
6,763 Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters 2013 VLDB 5.6874593e-05
6,782 Adaptive Data Skipping in Main-Memory Systems 2016 SIGMOD 5.6835894e-05
6,819 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.672617e-05
6,958 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB 5.634024e-05
6,987 SparkR: Scaling R Programs with Spark 2016 SIGMOD 5.6283496e-05
7,269 Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine 2025 VLDB 5.5694935e-05
7,312 Bubble Execution: Resource-aware Reliable Analytics at Cloud Scale 2018 VLDB 5.5555613e-05
7,360 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 5.5427171e-05
7,836 Quill: Efficient, Transferable, and Rich Analytics at Scale 2016 VLDB 5.4435399e-05
7,897 Using VDMS to Index and Search 100M Images 2021 VLDB 5.4317361e-05
8,004 A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning 2024 VLDB 5.4089097e-05
8,346 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.3510511e-05
8,614 Parallel-Correctness and Transferability for Conjunctive Queries 2015 PODS 5.3024208e-05
8,624 Piranha: Optimizing Short Jobs in Hadoop 2013 VLDB 5.3009314e-05
9,254 QMapper for Smart Grid: Migrating SQL-based Application to Hive 2015 SIGMOD 5.2056825e-05
9,773 Cost-based Fault-tolerance for Parallel Data Processing 2015 SIGMOD 5.1319066e-05
9,988 Introduction to Spark 2.0 for Database Researchers 2016 SIGMOD 5.0998353e-05
11,126 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9793485e-05
12,185 Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology 2019 VLDB 4.9793485e-05
12,327 Logical Aspects of Massively Parallel and Distributed Systems 2016 PODS 4.9793485e-05
12,375 Parallel Evaluation of Multi-Semi-Joins 2016 VLDB 4.9793485e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012092602
12 C-Store: A Column-oriented DBMS 2005 VLDB 0.00068998927
22 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00055962491
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050495102
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045546775
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043160717
53 Eddies: Continuously Adaptive Query Processing 2000 SIGMOD 0.00040860054
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.000311132
149 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00028981723
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028579704
384 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001948031
424 Cost-based Query Scrambling for Initial Delays 1998 SIGMOD 0.0001848836
503 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017202276
876 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013309176
1,210 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.00011527605
1,351 SkewTune: Mitigating Skew in MapReduce Applications 2012 SIGMOD 0.00010934347
1,810 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 9.5892079e-05
1,837 Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce 2010 VLDB 9.5350058e-05
Previous Page 1 / 1 Next

Semantically Similar Papers