SparkR: Scaling R Programs with Spark

Summary: R's single-threaded nature and memory limits curb interactive analytics. SparkR adds an R frontend to Apache Spark, enabling scalable, distributed data analysis from the R shell via Spark's DataFrame API and distributed computation. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5200
Venue: SIGMOD
Year: 2016
Pagerank: 4.9221272e-05
Overall Rank: 6,783 | 52.86%
DOI: 10.1145/2882903.2903740

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,356	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012409986
1,534	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011462072
2,197	Enabling and Optimizing Non-linear Feature Interactions in Factorized Linear Algebra	2019	SIGMOD	9.3117431e-05
5,741	Babelfish: Efficient Execution of Polyglot Queries	2022	VLDB	5.3450701e-05
9,585	Introduction to Spark 2.0 for Database Researchers	2016	SIGMOD	4.31773e-05
10,972	Query Compilation Without Regrets	2024	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
476	Impala: A Modern, Open-Source SQL Engine for Hadoop	2015	CIDR	0.00022216002
539	Shark: SQL and Rich Analytics at Scale	2013	SIGMOD	0.00020615453
1,494	Ricardo: Integrating R and Hadoop	2010	SIGMOD	0.00011677793
3,536	Scaling Spark in the Real World: Performance and Usability	2015	VLDB	6.9938207e-05
5,400	Large-scale Predictive Analytics in Vertica: Fast Data Transfer, Distributed Model Creation, and In-database Prediction	2015	SIGMOD	5.5262667e-05
6,875	Stat! - An Interactive Analytics Environment for Big Data	2013	SIGMOD	4.8957561e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
1,546	Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark	2018	SIGMOD	0.00011418993
4,435	Clash of the Titans: MapReduce vs. Spark for Large Scale Data Analytics	2015	VLDB	6.18493e-05
3,207	Big Data Analytics with Datalog Queries on Spark	2016	SIGMOD	7.3847098e-05
11,199	QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark	2023	SIGMOD	4.1905499e-05
2,922	RaSQL: Greater Power and Performance for Big Data Analytics with Recursive-aggregate-SQL on Spark	2019	SIGMOD	7.897179e-05
7,019	Bridging the Gap Between HPC and Big Data Frameworks	2017	VLDB	4.8553946e-05
557	SystemML: Declarative Machine Learning on Spark	2016	VLDB	0.00020186115
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
11,867	dmapply: A functional primitive to express distributed machine learning algorithms in R	2016	VLDB	4.1905499e-05
3,536	Scaling Spark in the Real World: Performance and Usability	2015	VLDB	6.9938207e-05