Trends and Challenges in Big Data Processing
Summary: Reflects on Spark’s success as a unified in-memory engine spanning batch, SQL, streaming, and iterative workloads. Identifies challenges for next-generation systems as memory scaling slows and GPUs, FPGAs, and 3D XPoint reshape hardware. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Authors
- 1. Ion Stoica (University of California Berkeley)
BibTeX Citation
@article{stoica_vldb16,
title = {{Trends and Challenges in Big Data Processing}},
author = {Stoica, Ion},
journal = {PVLDB},
series = {{VLDB} '16},
volume = {9},
number = {13},
pages = {1619},
doi = {10.14778/3007263.3007324},
url = {https://doi.org/10.14778/3007263.3007324},
year = {2016}
}
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 0 of 0 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 7,601 | Systems for Scalable Graph Analytics and Machine Learning: Trends and Methods | 2025 | VLDB |
| 2 | 13,479 | The Challenge of Building Effective Data Lakes | 2020 | SIGMOD |
| 3 | 13,575 | From Data to Insights @ Bare Metal Speed | 2015 | SIGMOD |
| 4 | 3,819 | Evolving Databases for New-Gen Big Data Applications | 2017 | CIDR |
| 5 | 13,536 | The Data Center under your Desk – How Disruptive is Modern Hardware for DB System Design? | 2017 | VLDB |
| 6 | 6,850 | Bridging the Gap Between HPC and Big Data Frameworks | 2017 | VLDB |
| 7 | 2,594 | Big Data Analytics with Datalog Queries on Spark | 2016 | SIGMOD |
| 8 | 13,702 | Is It Still "Big Data" If It Fits In My Pocket? | 2011 | VLDB |
| 9 | 9,803 | Introduction to Spark 2.0 for Database Researchers | 2016 | SIGMOD |
| 10 | 3,411 | Scaling Spark in the Real World: Performance and Usability | 2015 | VLDB |