Database Paper Browser

Back to papers

Pig Latin: A Not-So-Foreign Language for Data Processing

Summary: Pig Latin sits between SQL and MapReduce, enabling procedural analysts to express data flows without MapReduce coding. Pig compiles Pig Latin to Hadoop MapReduce plans and offers an integrated debugger; open-source under Apache Incubator with Yahoo-scale deployments. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4058
Venue
SIGMOD
Year
2008
Pagerank
0.0024217964
Overall Rank
3 | 99.99%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 50 of 154 citing papers.

Rank Citing Paper Year Venue Pagerank
4 Pregel: A System for Large-Scale Graph Processing 2010 SIGMOD 0.0019040811
22 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00084679526
42 A Comparison of Approaches to Large-Scale Data Analysis 2009 SIGMOD 0.00073570328
54 PNUTS: Yahoo!'s Hosted Data Serving Platform 2008 VLDB 0.0006582344
66 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00061707583
109 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00048217028
158 HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads 2009 VLDB 0.00040401371
395 One Trillion Edges: Graph Processing at Facebook-Scale 2015 VLDB 0.00024440144
408 HaLoop: Efficient Iterative Data Processing on Large Clusters 2010 VLDB 0.00023939456
542 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00020522627
543 MLbase: A Distributed Machine-learning System 2013 CIDR 0.0002050918
709 A Case for A Collaborative Query Management System 2009 CIDR 0.00017740603
776 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00016765694
789 Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing) 2010 VLDB 0.00016602215
875 Fast Personalized PageRank on MapReduce 2011 SIGMOD 0.00015679931
909 Tenzing A SQL Implementation On The MapReduce Framework 2011 VLDB 0.0001540191
947 MRShare: Sharing Across Multiple Queries in MapReduce 2010 VLDB 0.00015112344
962 A Comparison of Join Algorithms for Log Processing in MapReduce 2010 SIGMOD 0.00015003834
1,073 Processing Theta-Joins using MapReduce* 2011 SIGMOD 0.00014255717
1,074 RIOT: I/O-Efficient Numerical Computing without SQL 2009 CIDR 0.00014238255
1,199 Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce 2013 VLDB 0.00013358019
1,265 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012933537
1,281 Automatic Optimization for MapReduce Programs 2011 VLDB 0.00012837411
1,301 Simba: Efficient In-Memory Spatial Analytics 2016 SIGMOD 0.00012702767
1,320 Quickr: Lazily Approximating Complex AdHoc Queries in BigData Clusters 2016 SIGMOD 0.00012606067
1,323 Distributed SociaLite: A Datalog-Based Language for Large-Scale Graph Analysis 2013 VLDB 0.00012595443
1,361 SQL/MapReduce: A practical approach to self-describing, polymorphic, and parallelizable user-defined functions 2009 VLDB 0.00012393719
1,407 Hybrid Parallelization Strategies for Large-Scale Machine Learning in SystemML 2014 VLDB 0.00012163413
1,411 Communication Steps for Parallel Query Processing 2013 PODS 0.00012118832
1,441 Provenance for Generalized Map and Reduce Workflows 2011 CIDR 0.00011950114
1,456 Query From Examples: An Iterative, Data-Driven Approach to Query Construction 2015 VLDB 0.00011891284
1,494 Ricardo: Integrating R and Hadoop 2010 SIGMOD 0.00011677793
1,533 PerfXplain: Debugging MapReduce Job Performance 2012 VLDB 0.00011462982
1,574 Approximate Query Processing: No Silver Bullet 2017 SIGMOD 0.00011289028
1,615 The Performance of MapReduce: An In-depth Study 2010 VLDB 0.00011137225
1,666 HELIX: Holistic Optimization for Accelerating Iterative Machine Learning 2019 VLDB 0.00010955907
1,719 Distributed Data-Parallel Computing Using a High-Level Programming Language 2009 SIGMOD 0.00010759065
1,728 BigBench: Towards an Industry Standard Benchmark for Big Data Analytics 2013 SIGMOD 0.00010731422
1,768 ParaTimer: A Progress Indicator for MapReduce DAGs 2010 SIGMOD 0.00010608933
1,775 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors 2012 VLDB 0.00010584816
1,793 Summingbird: A Framework for Integrating Batch and Online MapReduce Computations 2014 VLDB 0.00010522029
1,849 Combining User Interaction, Speculative Query Execution and Sampling in the DICE System 2014 VLDB 0.00010331082
2,024 Storage Management in AsterixDB 2014 VLDB 9.7528344e-05
2,030 Titian: Data Provenance Support in Spark 2016 VLDB 9.734332e-05
2,031 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance 2012 VLDB 9.7341007e-05
2,035 Generating Example Data for Dataflow Programs 2009 SIGMOD 9.7131385e-05
2,211 ReStore: Reusing Results of MapReduce Jobs 2012 VLDB 9.2823037e-05
2,213 Clustera: An Integrated Computation And Data Management System 2008 VLDB 9.2796992e-05
2,216 Skew in Parallel Query Processing 2014 PODS 9.2693784e-05
2,304 A Demonstration of SpatialHadoop: An Efficient MapReduce Framework for Spatial Data 2013 VLDB 9.0659453e-05
Previous Page 1 / 4 Next

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010668335
18 On Random Sampling over Joins 1999 SIGMOD 0.00092569117
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
8,787 From SPARQL to MapReduce: The Journey Using a Nested TripleGroup Algebra 2011 VLDB 4.446583e-05
4,859 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD 5.8680444e-05
11,695 Integration of Large-Scale Data Processing Systems and Traditional Parallel Database Technology 2019 VLDB 4.1905499e-05
1,265 Jaql: A Scripting Language for Large Scale Semistructured Data Analysis 2011 VLDB 0.00012933537
12,133 ReStore: Reusing Results of MapReduce Jobs in Pig 2012 SIGMOD 4.1905499e-05
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059744625
13,439 The Farm - where Pig Scripts are bred and raised 2013 SIGMOD -
3,606 Large-Scale Machine Learning at Twitter 2012 SIGMOD 6.9246371e-05
4,424 Nova: Continuous Pig/Hadoop Workflows 2011 SIGMOD 6.19243e-05
776 Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience 2009 VLDB 0.00016765694