Database Paper Browser

Back to papers

Spark SQL: Relational Data Processing in Spark

Summary: Relational processing integrated into Spark via DataFrame API, unifying SQL queries with Spark's functional workflow. Catalyst, a Scala-based extensible optimizer, enables composable rules, code generation, JSON schema inference, and federation to databases. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5023
Venue
SIGMOD
Year
2015
Pagerank
0.00061707583
Overall Rank
66 | 99.55%
DOI
10.1145/2723372.2742797

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 50 of 206 citing papers.

Rank Citing Paper Year Venue Pagerank
3,649 One WITH RECURSIVE is Worth Many GOTOs 2021 SIGMOD 6.8764882e-05
3,703 How to Win a Hot Dog Eating Contest: Distributed Incremental View Maintenance with Batch Updates 2016 SIGMOD 6.8249334e-05
3,731 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 6.8074069e-05
3,764 F1 Lightning: HTAP as a Service 2020 VLDB 6.7762323e-05
3,772 Flexible Rule-Based Decomposition and Metadata Independence in Modin: A Parallel Dataframe System 2022 VLDB 6.7736479e-05
3,920 On Optimizing Operator Fusion Plans for Large-Scale Machine Learning in SystemML 2018 VLDB 6.6246708e-05
3,923 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 6.6232068e-05
3,944 AQP++: Connecting Approximate Query Processing With Aggregate Precomputation for Interactive Analytics 2018 SIGMOD 6.6056349e-05
3,971 Apache IoTDB: A Time Series Database for IoT Applications 2023 SIGMOD 6.5733348e-05
4,010 Adore: Differentially Oblivious Relational Database Operators 2023 VLDB 6.5355058e-05
4,319 Fast Queries Over Heterogeneous Data Through Engine Customization 2016 VLDB 6.2823814e-05
4,364 Evolving Databases for New-Gen Big Data Applications 2017 CIDR 6.2454708e-05
4,406 Declarative Recursive Computation on an RDBMS 2019 VLDB 6.2044305e-05
4,416 Don't Hold My Data Hostage - A Case For Client Protocol Redesign 2017 VLDB 6.1963721e-05
4,603 Accelerating Raw Data Analysis with the ACCORDA Software and Hardware Architecture 2019 VLDB 6.0515823e-05
4,619 Wildfire: Concurrent Blazing Data Ingest and Analytics 2016 SIGMOD 6.0376316e-05
4,646 LocationSpark: A Distributed In-Memory Data Management System for Big Spatial Data 2016 VLDB 6.0176549e-05
4,655 ExplainIt! - A Declarative Root-cause Analysis Engine for Time Series Data 2019 SIGMOD 6.0126689e-05
4,672 FlexPushdownDB: Hybrid Pushdown and Caching in a Cloud DBMS 2021 VLDB 6.001444e-05
4,676 Automatically Leveraging MapReduce Frameworks for Data-Intensive Applications 2018 SIGMOD 5.9992323e-05
4,700 Tensors: An abstraction for general data processing 2021 VLDB 5.9810592e-05
4,702 JSON Tiles: Fast Analytics on Semi-Structured Data 2021 SIGMOD 5.9796907e-05
4,724 GeCo: Quality Counterfactual Explanations in Real Time 2021 VLDB 5.9640238e-05
4,776 PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes 2021 VLDB 5.9263134e-05
4,800 Efficient Deep Learning Pipelines for Accurate Cost Estimations Over Large Scale Query Workload 2021 SIGMOD 5.9077188e-05
4,937 UlTraMan: A Unified Platform for Big Trajectory Data Management and Analytics 2018 VLDB 5.8147395e-05
4,972 PS2: Parameter Server on Spark 2019 SIGMOD 5.7894524e-05
5,265 Probabilistic Demand Forecasting at Scale 2017 VLDB 5.5950627e-05
5,304 ReCache: Reactive Caching for Fast Analytics over Heterogeneous Data 2018 VLDB 5.5738777e-05
5,318 LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications 2022 SIGMOD 5.5685434e-05
5,409 Towards Scalable Hybrid Stores: Constraint-Based Rewriting to the Rescue 2019 SIGMOD 5.5224926e-05
5,446 Using Cloud Functions as Accelerator for Elastic Data Analytics 2023 SIGMOD 5.4986799e-05
5,511 GraphOS: Towards Oblivious Graph Processing 2023 VLDB 5.4701773e-05
5,537 Presto: A Decade of SQL Analytics at Meta 2023 SIGMOD 5.453017e-05
5,587 Magnet: Push-based Shuffle Service for Large-scale Data Processing 2020 VLDB 5.4193445e-05
5,592 Efficient Confidentiality-Preserving Data Analytics over Symmetrically Encrypted Datasets 2020 VLDB 5.4180573e-05
5,649 Optimizing Data-intensive Systems in Disaggregated Data Centers with TELEPORT 2022 SIGMOD 5.3897976e-05
5,654 AutoSteer: Learned Query Optimization for Any SQL Database 2023 VLDB 5.3882121e-05
5,728 Conjunctive Queries with Comparisons 2022 SIGMOD 5.350072e-05
5,803 Lifetime-Based Memory Management for Distributed Data Processing Systems 2016 VLDB 5.3208219e-05
5,853 ByteHTAP: ByteDance’s HTAP System with High Data Freshness and Strong Data Consistency 2022 VLDB 5.2982336e-05
5,855 MIFO: A Query-Semantic Aware Resource Allocation Policy 2019 SIGMOD 5.297903e-05
5,882 Membrane - Safe and Performant Data Access Controls in Apache Spark in the Presence of Imperative Code 2024 VLDB 5.2871604e-05
5,970 Cornus: Atomic Commit for a Cloud DBMS with Storage Disaggregation 2023 VLDB 5.2467448e-05
6,068 GPU Database Systems Characterization and Optimization 2024 VLDB 5.2240241e-05
6,226 When Tree Meets Hash: Reducing Random Reads for Index Structures on Persistent Memories 2023 SIGMOD 5.1413982e-05
6,241 Helios: Hyperscale Indexing for the Cloud & Edge 2020 VLDB 5.1357476e-05
6,257 VectorH: Taking SQL-on-Hadoop to the Next Level 2016 SIGMOD 5.1316025e-05
6,280 Cheetah: Accelerating Database Queries with Switch Pruning 2020 SIGMOD 5.1239052e-05
6,327 The Tensor Data Platform: Towards an AI-centric Database System 2023 CIDR 5.1035567e-05
Previous Page 2 / 5 Next

Outgoing Citations (Sorted by Pagerank)

Showing 15 of 15 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Previous Page 1 / 1 Next

Semantically Similar Papers