DBScholar

Back to papers

Pig Latin: A Not-So-Foreign Language for Data Processing

Summary: Pig Latin sits between SQL and MapReduce, enabling procedural analysts to express data flows without MapReduce coding. Pig compiles Pig Latin to Hadoop MapReduce plans and offers an integrated debugger; open-source under Apache Incubator with Yahoo-scale deployments. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4119
Venue
SIGMOD
Year
2008
Pagerank
0.0010686205
Overall Rank
6 | 99.97%
DOI
10.1145/1376616.1376726

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{olston_sigmod08,
        title = {{Pig Latin: A Not-So-Foreign Language for Data Processing}},
        author = {Olston, Christopher and Reed, Benjamin and Srivastava, Utkarsh and Kumar, Ravi and Tomkins, Andrew},
        series = {{SIGMOD} '08},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1376616.1376726},
        url = {https://dl.acm.org/doi/10.1145/1376616.1376726},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 153 citing papers.

Rank Citing Paper Year Venue Pagerank
3 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0012250108
24 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00054865648
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00051174276
44 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00046055057
47 PNUTS: Yahoo!'s Hosted Data Serving Platform 2008 VLDB 0.00044503718
51 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.0004291425
120 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00031680027
372 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.0001981521
389 One Trillion Edges: Graph Processing at Facebook-Scale 2015 VLDB 0.00019386526
445 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00018336751
532 MLbase: A Distributed Machine-learning System 2013 CIDR 0.00017072641
642 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00015395331
660 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00015198804
769 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00014166872
803 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00013899943
819 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00013815639
843 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00013666161
872 Tenzing: A SQL Implementation On The MapReduce Framework 2011 VLDB 0.00013486409
945 Fast Personalized PageRank on MapReduce 2011 SIGMOD 0.00013066956
1,021 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012606673
1,039 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00012474977
1,067 Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce 2013 VLDB 0.00012327784
1,079 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012258469
1,108 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00012145154
1,149 A Case for A Collaborative Query Management System 2009 CIDR 0.0001194728
1,175 Simba: Efficient In-Memory Spatial Analytics 2016 SIGMOD 0.00011812263
1,192 Query From Examples: An Iterative, Data-Driven Approach to Query Construction 2015 VLDB 0.00011740132
1,207 Communication Steps for Parallel Query Processing 2013 PODS 0.00011663155
1,257 Automatic Optimization for MapReduce Programs 2011 VLDB 0.000114432
1,264 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.00011416393
1,333 Ricardo: Integrating R and Hadoop 2010 SIGMOD 0.0001112858
1,366 Provenance for Generalized Map and Reduce Workflows 2011 CIDR 0.00011016972
1,415 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010840141
1,436 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00010797443
1,448 Skew in Parallel Query Processing 2014 PODS 0.00010758872
1,539 Distributed SociaLite: A Datalog-Based Language for Large-Scale Graph Analysis 2013 VLDB 0.000104329
1,569 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010335423
1,617 Titian: Data Provenance Support in Spark 2016 VLDB 0.00010209397
1,639 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010155021
1,665 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 0.00010069173
1,693 BigBench: Towards an Industry Standard Benchmark for Big Data Analytics 2013 SIGMOD 9.9965799e-05
1,694 PerfXplain: Debugging MapReduce Job Performance 2012 VLDB 9.9953156e-05
1,786 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance 2012 VLDB 9.7690421e-05
1,794 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 9.7399162e-05
1,854 Towards a One Size Fits All Database Architecture 2011 CIDR 9.6069414e-05
1,874 Storage Management in AsterixDB 2014 VLDB 9.5750002e-05
1,883 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.5421713e-05
1,895 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.5260291e-05
2,077 Generating Example Data for Dataflow Programs 2009 SIGMOD 9.2085989e-05
2,136 Combining User Interaction, Speculative Query Execution and Sampling in the DICE System 2014 VLDB 9.1126926e-05
Previous Page 1 / 4 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
54 On Random Sampling over Joins 1999 SIGMOD 0.00040810225
72 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.00037695852
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 8,955 From SPARQL to MapReduce: The Journey Using a Nested TripleGroup Algebra 2011 VLDB
2 4,595 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD
3 11,885 Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology 2019 VLDB
4 1,021 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB
5 12,322 ReStore: Reusing Results of MapReduce Jobs in Pig 2012 SIGMOD
6 32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB
7 13,627 The Farm - where Pig Scripts are bred and raised 2013 SIGMOD
8 3,714 Large-Scale Machine Learning at Twitter 2012 SIGMOD
9 4,175 Nova: Continuous Pig/Hadoop Workflows 2011 SIGMOD
10 642 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB