DBScholar

Back to papers

SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets

Summary: SCOPE is a declarative, extensible scripting language for data analysis on clusters, hiding parallelism from users. It provides SQL-like modeling with joins and aggregates, plus user-defined operators (extractors, processors, reducers, combiners), nesting, and stepwise plans compiled into parallel execution. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hdc248f8ae945036c
Venue
VLDB
Year
2008
Pagerank
0.00050364918
Overall Rank
30 | 99.81%
DOI
10.14778/1454159.1454224

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{chaiken_vldb08,
        title = {{SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets}},
        author = {Chaiken, Ronnie and Jenkins, Bob and Larson, Per-Åke and Ramsey, Bill and Shakib, Darren and Weaver, Simon and Zhou, Jingren},
        journal = {PVLDB},
        series = {{VLDB} '08},
        volume = {1},
        number = {1},
        pages = {1265--1276},
        doi = {10.14778/1454159.1454224},
        url = {https://doi.org/10.14778/1454159.1454224},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 89 citing papers.

Rank Citing Paper Year Venue Pagerank
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045453255
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043085722
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031017868
278 Accelerating Machine Learning Inference with Probabilistic Predicates 2018 SIGMOD 0.00022277737
436 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00018274105
655 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015076669
677 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00014835154
688 Trill: A High-Performance Incremental Query Processor for Diverse Analytics 2015 VLDB 0.00014736145
799 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00013839554
825 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013600553
841 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013503124
876 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013272245
963 Fast Personalized PageRank on MapReduce 2011 SIGMOD 0.00012805146
982 Parallel Evaluation of Conjunctive Queries 2011 PODS 0.00012687016
1,009 Simulation of Database-Valued Markov Chains Using SimSQL 2013 SIGMOD 0.00012518224
1,040 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012336829
1,065 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012181098
1,084 Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce 2013 VLDB 0.00012086348
1,133 Large Graph Processing in the Cloud 2010 SIGMOD 0.00011867467
1,166 A Case for A Collaborative Query Management System 2009 CIDR 0.00011705174
1,281 Orca: A Modular Query Optimizer Architecture for Big Data 2014 SIGMOD 0.00011198917
1,289 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.0001116552
1,436 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010658836
1,449 An Architecture for Compiling UDF-centric Workflows 2015 VLDB 0.00010597074
1,470 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00010532106
1,687 POLARIS: The Distributed SQL Engine in Azure Synapse 2020 VLDB 9.8500167e-05
1,706 PerfXplain: Debugging MapReduce Job Performance 2012 VLDB 9.804657e-05
1,814 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 9.5659163e-05
1,892 Automated Partitioning Design in Parallel Database Systems 2011 SIGMOD 9.405261e-05
2,124 Opening the Black Boxes in Data Flow Optimization 2012 VLDB 8.9915327e-05
2,139 Tupleware: "Big" Data, Big Analytics, Small Clusters 2015 CIDR 8.9729383e-05
2,190 Lero: A Learning-to-Rank Query Optimizer 2023 VLDB 8.8848923e-05
2,191 Combining User Interaction, Speculative Query Execution and Sampling in the DICE System 2014 VLDB 8.8844453e-05
2,240 Spinning Fast Iterative Data Flows 2012 VLDB 8.7716808e-05
2,299 A Platform for Scalable One-Pass Analytics using MapReduce 2011 SIGMOD 8.6639611e-05
2,452 Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics 2017 SIGMOD 8.4280184e-05
2,561 Minimal MapReduce Algorithms 2013 SIGMOD 8.2743492e-05
2,581 ClusterJoin: A Similarity Joins Framework using Map-Reduce 2014 VLDB 8.2491224e-05
2,758 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD 8.0283838e-05
2,828 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 7.9476509e-05
3,043 Chi: A Scalable and Programmable Control Plane for Distributed Stream Processing Systems 2018 VLDB 7.7045781e-05
3,081 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6515625e-05
3,453 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2720027e-05
3,550 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.1895215e-05
3,831 Integrating Hadoop and Parallel DBMS 2010 SIGMOD 6.9765502e-05
3,907 Hyper Dimension Shuffle: Efficient Data Repartition at Petabyte Scale in SCOPE 2019 VLDB 6.9139522e-05
3,951 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.8884038e-05
4,357 Algorithmic Aspects of Parallel Query Processing 2018 SIGMOD 6.6290396e-05
4,444 Auto-Transform: Learning-to-Transform by Patterns 2020 VLDB 6.5812416e-05
Previous Page 1 / 2 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010494385
76 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.00036932687
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 6,452 Scalable Querying of Nested Data 2021 VLDB
2 1,040 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB
3 982 Parallel Evaluation of Conjunctive Queries 2011 PODS
4 7,919 GraphScope: A One-Stop Large Graph Processing System 2021 VLDB
5 2,758 Implicit Parallelism through Deep Language Embedding 2015 SIGMOD
6 3,453 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD
7 3,638 Advanced Join Strategies for Large-Scale Distributed Computation 2014 VLDB
8 6,981 JetScope: Reliable and Interactive Analytics at Cloud Scale 2015 VLDB
9 2,594 GraphScope: A Unified Engine For Big Graph Processing 2021 VLDB
10 4,842 Continuous Cloud-Scale Query Optimization and Processing 2013 VLDB