DBScholar

Back to papers

Pig Latin: A Not-So-Foreign Language for Data Processing

Summary: Pig Latin sits between SQL and MapReduce, enabling procedural analysts to express data flows without MapReduce coding. Pig compiles Pig Latin to Hadoop MapReduce plans and offers an integrated debugger; open-source under Apache Incubator with Yahoo-scale deployments. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h115ebfcac5edf7ca
Venue
SIGMOD
Year
2008
Pagerank
0.001052036
Overall Rank
6 | 99.97%
DOI
10.1145/1376616.1376726

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{olston_sigmod08,
        title = {{Pig Latin: A Not-So-Foreign Language for Data Processing}},
        author = {Olston, Christopher and Reed, Benjamin and Srivastava, Utkarsh and Kumar, Ravi and Tomkins, Andrew},
        series = {{SIGMOD} '08},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1376616.1376726},
        url = {https://dl.acm.org/doi/10.1145/1376616.1376726},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 153 citing papers.

Rank Citing Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012092602
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055406774
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050495102
43 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00045546775
47 PNUTS: Yahoo!'s Hosted Data Serving Platform 2008 VLDB 0.00044066403
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043160717
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.000311132
379 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00019514689
384 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001948031
394 One Trillion Edges: Graph Processing at Facebook-Scale 2015 VLDB 0.00019191286
537 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00016768109
651 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015130782
673 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.0001488755
799 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00013889081
823 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013648332
840 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.0001354605
865 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.0001338765
876 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013309176
962 Fast Personalized PageRank on MapReduce 2011 SIGMOD 0.00012820478
1,037 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012376819
1,044 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012332595
1,080 Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce 2013 VLDB 0.00012131978
1,081 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012123917
1,082 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012122749
1,164 A Case for A Collaborative Query Management System 2009 CIDR 0.00011745383
1,178 Simba: Efficient In-Memory Spatial Analytics 2016 SIGMOD 0.00011632691
1,211 Query From Examples: An Iterative, Data-Driven Approach to Query Construction 2015 VLDB 0.00011524858
1,231 Communication Steps for Parallel Query Processing 2013 PODS 0.00011410373
1,281 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00011213384
1,285 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.00011201377
1,371 Ricardo: Integrating R and Hadoop 2010 SIGMOD 0.00010899041
1,388 Provenance for Generalized Map and Reduce Workflows 2011 CIDR 0.00010821908
1,421 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010726757
1,466 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00010569837
1,481 Skew in Parallel Query Processing 2014 PODS 0.00010539119
1,548 Distributed SociaLite: A Datalog-Based Language for Large-Scale Graph Analysis 2013 VLDB 0.00010290306
1,564 Titian: Data Provenance Support in Spark 2016 VLDB 0.00010222394
1,568 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.0001021302
1,633 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010019617
1,688 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 9.8645784e-05
1,702 BigBench: Towards an Industry Standard Benchmark for Big Data Analytics 2013 SIGMOD 9.8361594e-05
1,708 PerfXplain: Debugging MapReduce Job Performance 2012 VLDB 9.8224587e-05
1,765 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance 2012 VLDB 9.6955585e-05
1,771 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.6803752e-05
1,810 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 9.5892079e-05
1,848 Towards a One Size Fits All Database Architecture 2011 CIDR 9.5082163e-05
1,875 Storage Management in AsterixDB 2014 VLDB 9.4576907e-05
1,924 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.3687009e-05
2,116 Generating Example Data for Dataflow Programs 2009 SIGMOD 9.0149557e-05
2,178 Combining User Interaction, Speculative Query Execution and Sampling in the DICE System 2014 VLDB 8.9152266e-05
Previous Page 1 / 4 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
57 On Random Sampling over Joins 1999 SIGMOD 0.00040108301
75 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0003704106
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,119 From SPARQL to MapReduce: The Journey Using a Nested TripleGroup Algebra 2011 VLDB
2 4,691 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD
3 12,185 Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology 2019 VLDB
4 1,037 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB
5 12,613 ReStore: Reusing Results of MapReduce Jobs in Pig 2012 SIGMOD
6 31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB
7 13,940 The Farm - where Pig Scripts are bred and raised 2013 SIGMOD
8 3,788 Large-Scale Machine Learning at Twitter 2012 SIGMOD
9 4,254 Nova: Continuous Pig/Hadoop Workflows 2011 SIGMOD
10 651 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB