DBScholar

Back to papers

Pig Latin: A Not-So-Foreign Language for Data Processing

Summary: Pig Latin sits between SQL and MapReduce, enabling procedural analysts to express data flows without MapReduce coding. Pig compiles Pig Latin to Hadoop MapReduce plans and offers an integrated debugger; open-source under Apache Incubator with Yahoo-scale deployments. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h115ebfcac5edf7ca
Venue
SIGMOD
Year
2008
Pagerank
0.0010494385
Overall Rank
6 | 99.97%
DOI
10.1145/1376616.1376726

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{olston_sigmod08,
        title = {{Pig Latin: A Not-So-Foreign Language for Data Processing}},
        author = {Olston, Christopher and Reed, Benjamin and Srivastava, Utkarsh and Kumar, Ravi and Tomkins, Andrew},
        series = {{SIGMOD} '08},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1376616.1376726},
        url = {https://dl.acm.org/doi/10.1145/1376616.1376726},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 153 citing papers.

Rank Citing Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012089097
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055523999
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050364918
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045453255
47 PNUTS: Yahoo!'s Hosted Data Serving Platform 2008 VLDB 0.00043937456
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043085722
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031017868
382 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.0001946654
385 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00019419661
392 One Trillion Edges: Graph Processing at Facebook-Scale 2015 VLDB 0.0001917435
538 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00016725463
655 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015076669
677 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00014835154
799 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00013839554
825 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013600553
841 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013503124
867 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00013342302
876 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013272245
963 Fast Personalized PageRank on MapReduce 2011 SIGMOD 0.00012805146
1,040 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012336829
1,050 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012291671
1,065 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012181098
1,083 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012089325
1,084 Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce 2013 VLDB 0.00012086348
1,166 A Case for A Collaborative Query Management System 2009 CIDR 0.00011705174
1,183 Simba: Efficient In-Memory Spatial Analytics 2016 SIGMOD 0.00011589152
1,214 Query From Examples: An Iterative, Data-Driven Approach to Query Construction 2015 VLDB 0.00011490045
1,242 Communication Steps for Parallel Query Processing 2013 PODS 0.00011372366
1,286 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00011187304
1,289 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.0001116552
1,375 Ricardo: Integrating R and Hadoop 2010 SIGMOD 0.00010861932
1,393 Provenance for Generalized Map and Reduce Workflows 2011 CIDR 0.00010784123
1,424 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010694144
1,470 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00010532106
1,483 Skew in Parallel Query Processing 2014 PODS 0.00010500209
1,552 Distributed SociaLite: A Datalog-Based Language for Large-Scale Graph Analysis 2013 VLDB 0.00010252208
1,562 Titian: Data Provenance Support in Spark 2016 VLDB 0.00010192248
1,567 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010179013
1,640 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 9.9825117e-05
1,691 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 9.838545e-05
1,706 PerfXplain: Debugging MapReduce Job Performance 2012 VLDB 9.804657e-05
1,707 BigBench: Towards an Industry Standard Benchmark for Big Data Analytics 2013 SIGMOD 9.8031942e-05
1,776 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance 2012 VLDB 9.6661217e-05
1,785 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.6438157e-05
1,814 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 9.5659163e-05
1,845 Towards a One Size Fits All Database Architecture 2011 CIDR 9.507323e-05
1,882 Storage Management in AsterixDB 2014 VLDB 9.4243119e-05
1,936 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3375824e-05
2,124 Opening the Black Boxes in Data Flow Optimization 2012 VLDB 8.9915327e-05
2,134 Generating Example Data for Dataflow Programs 2009 SIGMOD 8.9819242e-05
Previous Page 1 / 4 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
57 On Random Sampling over Joins 1999 SIGMOD 0.0003999751
76 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.00036932687
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,147 From SPARQL to MapReduce: The Journey Using a Nested TripleGroup Algebra 2011 VLDB
2 4,705 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD
3 12,234 Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology 2019 VLDB
4 1,040 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB
5 12,662 ReStore: Reusing Results of MapReduce Jobs in Pig 2012 SIGMOD
6 31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB
7 13,985 The Farm - where Pig Scripts are bred and raised 2013 SIGMOD
8 3,799 Large-Scale Machine Learning at Twitter 2012 SIGMOD
9 4,273 Nova: Continuous Pig/Hadoop Workflows 2011 SIGMOD
10 655 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB