DBScholar

Back to papers

Shark: SQL and Rich Analytics at Scale

Summary: Shark unifies SQL and analytics on clusters via a distributed memory abstraction into a single scalable engine. In-memory columnar storage, replanning, and fault tolerance enable SQL and ML, 100x faster than Hive/Hadoop, competitive with MPP. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hb5edf1e8c00cfaf4
Venue
SIGMOD
Year
2013
Pagerank
0.00018274105
Overall Rank
436 | 97.08%
DOI
10.1145/2463676.2465288

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{xin_sigmod13,
        title = {{Shark: SQL and Rich Analytics at Scale}},
        author = {Xin, Reynold S. and Rosen, Josh and Zaharia, Matei and Franklin, Michael J. and Shenker, Scott and Stoica, Ion},
        series = {{SIGMOD} '13},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2463676.2465288},
        url = {https://dl.acm.org/doi/10.1145/2463676.2465288},
        year = {2013}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 54 citing papers.

Rank Citing Paper Year Venue Pagerank
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055523999
1,039 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012349128
1,183 Simba: Efficient In-Memory Spatial Analytics 2016 SIGMOD 0.00011589152
1,296 From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System 2015 SIGMOD 0.00011119184
1,379 Scuba: Diving into Data at Facebook 2013 VLDB 0.00010836332
1,435 Knowing When You’re Wrong: Building Fast and Reliable Approximate Query Processing Systems 2014 SIGMOD 0.00010659454
1,483 Skew in Parallel Query Processing 2014 PODS 0.00010500209
1,625 Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing 2014 VLDB 0.00010028153
1,889 SQL-on-Hadoop: Full Circle Back to Shared-Nothing Database Architectures 2014 VLDB 9.4145058e-05
2,147 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9595129e-05
2,429 BigDansing: A System for Big Data Cleansing 2015 SIGMOD 8.4657925e-05
2,505 Towards Scalable Real-time Analytics: An Architecture for Scale-out of OLxP Workloads 2015 VLDB 8.3555487e-05
2,634 WideTable: An Accelerator for Analytical Data Processing 2014 VLDB 8.1797149e-05
2,912 HAWQ: A Massively Parallel Processing SQL Engine in Hadoop 2014 SIGMOD 7.8573961e-05
2,965 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.7894987e-05
3,258 Locality-aware Partitioning in Parallel Database Systems 2015 SIGMOD 7.4730157e-05
3,565 WANalytics: Analytics for a Geo-Distributed Data-Intensive World 2015 CIDR 7.183429e-05
3,606 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 7.1528863e-05
3,746 In-RDBMS Hardware Acceleration of Advanced Analytics 2018 VLDB 7.0369561e-05
4,088 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD 6.7973616e-05
4,416 WANalytics: Geo-Distributed Analytics for a Data Intensive World 2015 SIGMOD 6.5933768e-05
4,897 Design Tradeoffs of Data Access Methods 2016 SIGMOD 6.3489205e-05
5,043 Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing 2022 VLDB 6.28918e-05
5,367 Adaptive and Robust Query Execution for Lakehouses at Scale 2024 VLDB 6.1462017e-05
5,847 Opportunistic Physical Design for Big Data Analytics 2014 SIGMOD 5.9537345e-05
6,274 A Performance Study of Big Data on Small Nodes 2015 VLDB 5.8109116e-05
6,302 Elastic Pipelining in an In-Memory Database Cluster 2016 SIGMOD 5.8013694e-05
6,464 Towards General and Efficient Online Tuning for Spark 2023 VLDB 5.759941e-05
6,562 JoinBoost: Grow Trees Over Normalized Data Using Only SQL 2023 VLDB 5.7287508e-05
6,785 Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters 2013 VLDB 5.6659903e-05
6,803 Adaptive Data Skipping in Main-Memory Systems 2016 SIGMOD 5.6621153e-05
6,834 Liquid: Unifying Nearline and Offline Big Data Integration 2015 CIDR 5.6528857e-05
6,981 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB 5.6127553e-05
6,996 SparkR: Scaling R Programs with Spark 2016 SIGMOD 5.6092026e-05
7,291 Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine 2025 VLDB 5.5484494e-05
7,332 Bubble Execution: Resource-aware Reliable Analytics at Cloud Scale 2018 VLDB 5.5351368e-05
7,366 Kodiak: Leveraging Materialized Views For Very Low-Latency Analytics Over High-Dimensional Web-Scale Data 2016 VLDB 5.5268158e-05
7,857 Quill: Efficient, Transferable, and Rich Analytics at Scale 2016 VLDB 5.4230146e-05
7,918 Using VDMS to Index and Search 100M Images 2021 VLDB 5.4112841e-05
8,026 A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning 2024 VLDB 5.3884724e-05
8,362 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.3308358e-05
8,643 Parallel-Correctness and Transferability for Conjunctive Queries 2015 PODS 5.2823858e-05
8,650 Piranha: Optimizing Short Jobs in Hadoop 2013 VLDB 5.2809021e-05
9,288 QMapper for Smart Grid: Migrating SQL-based Application to Hive 2015 SIGMOD 5.1860131e-05
9,809 Cost-based Fault-tolerance for Parallel Data Processing 2015 SIGMOD 5.1125251e-05
10,020 Introduction to Spark 2.0 for Database Researchers 2016 SIGMOD 5.082155e-05
11,195 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9605343e-05
12,234 Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology 2019 VLDB 4.9605343e-05
12,376 Logical Aspects of Massively Parallel and Distributed Systems 2016 PODS 4.9605343e-05
12,424 Parallel Evaluation of Multi-Semi-Joins 2016 VLDB 4.9605343e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012089097
12 C-Store: A Column-oriented DBMS 2005 VLDB 0.00068985264
22 Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud 2012 VLDB 0.00056028465
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050364918
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045453255
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043085722
53 Eddies: Continuously Adaptive Query Processing 2000 SIGMOD 0.00040739114
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031017868
149 Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans 1998 SIGMOD 0.00028910892
154 MAD Skills: New Analysis Practices for Big Data 2009 VLDB 0.00028524078
385 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00019419661
426 Cost-based Query Scrambling for Initial Delays 1998 SIGMOD 0.00018432573
506 Towards a Unified Architecture for in-RDBMS Analytics 2012 SIGMOD 0.00017158546
876 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013272245
1,212 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.00011493478
1,360 SkewTune: Mitigating Skew in MapReduce Applications 2012 SIGMOD 0.00010893993
1,814 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 9.5659163e-05
1,850 Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce 2010 VLDB 9.4997173e-05
Previous Page 1 / 1 Next

Semantically Similar Papers