Shark: SQL and Rich Analytics at Scale

Summary: Shark unifies SQL and analytics on clusters via a distributed memory abstraction into a single scalable engine. In-memory columnar storage, replanning, and fault tolerance enable SQL and ML, 100x faster than Hive/Hadoop, competitive with MPP. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4698
Venue: SIGMOD
Year: 2013
Pagerank: 0.00020615453
Overall Rank: 539 | 96.26%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 4 of 54 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
11,956	Tutorial: SQL-on-Hadoop Systems	2015	VLDB	4.1905499e-05
11,982	DoomDB - Kill the Query	2014	SIGMOD	4.1905499e-05
12,001	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB	4.1905499e-05
12,007	Getting Your Big Data Priorities Straight: A Demonstration of Priority-based QoS using Social-network-driven Stock Recommendation	2014	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
4	Pregel: A System for Large-Scale Graph Processing	2010	SIGMOD	0.0019040811
20	C-Store: A Column-oriented DBMS	2005	VLDB	0.00086163998
22	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.00084679526
39	Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud	2012	VLDB	0.00075263552
42	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00073570328
109	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.00048217028
116	Eddies: Continuously Adaptive Query Processing	2000	SIGMOD	0.00046191288
158	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00040401371
169	MAD Skills: New Analysis Practices for Big Data	2009	VLDB	0.00038967371
221	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00033182072
408	HaLoop: Efficient Iterative Data Processing on Large Clusters	2010	VLDB	0.00023939456
457	Cost-based Query Scrambling for Initial Delays	1998	SIGMOD	0.00022699974
638	Towards a Unified Architecture for in-RDBMS Analytics	2012	SIGMOD	0.00018810785
909	Tenzing A SQL Implementation On The MapReduce Framework	2011	VLDB	0.0001540191
1,339	SkewTune: Mitigating Skew in MapReduce Applications	2012	SIGMOD	0.00012492978
1,470	Processing a Trillion Cells per Mouse Click	2012	VLDB	0.00011827274
1,719	Distributed Data-Parallel Computing Using a High-Level Programming Language	2009	SIGMOD	0.00010759065
1,945	Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce	2010	VLDB	0.0001000706

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
6,683	Adaptive and Robust Query Execution for Lakehouses at Scale	2024	VLDB	4.9593505e-05
2,123	SQL-on-Hadoop: Full Circle Back to Shared-Nothing Database Architectures	2014	VLDB	9.4836925e-05
7,600	Quill: Efficient, Transferable, and Rich Analytics at Scale	2016	VLDB	4.697054e-05
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
3,070	HAWQ: A Massively Parallel Processing SQL Engine in Hadoop	2014	SIGMOD	7.6157391e-05
3,966	Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing	2019	SIGMOD	6.5782437e-05
1,151	Blink and It's Done: Interactive Queries on Very Large Data	2012	VLDB	0.00013634671
4,706	SharkDB: An In-Memory Storage System for Massive Trajectory Data	2015	SIGMOD	5.9773995e-05
1,048	Starfish: A Self-tuning System for Big Data Analytics	2011	CIDR	0.00014442178
2,487	Shark: Fast Data Analysis Using Coarse-grained Distributed Memory	2012	SIGMOD	8.6609871e-05