Database Paper Browser

Back to papers

Provenance for Generalized Map and Reduce Workflows

Summary: Proposes a formal provenance model for generalized map-and-reduce workflows (acyclic DAGs of map/reduce), enabling recursive composition and both backward and forward tracing between inputs and outputs. Implements transparent, wrapper-based capture in Hadoop that preserves parallelism and fault-tolerance and reports prototype performance. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
170
Venue
CIDR
Year
2011
Pagerank
0.00011950114
Overall Rank
1,441 | 89.99%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank Citing Paper Year Venue Pagerank
1,312 Upper and Lower Bounds on the Cost of a Map-Reduce Computation 2013 VLDB 0.00012650678
2,030 Titian: Data Provenance Support in Spark 2016 VLDB 9.734332e-05
2,031 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance 2012 VLDB 9.7341007e-05
2,286 SMOKE: Fine-grained Lineage at Interactive Speed 2018 VLDB 9.102574e-05
3,158 Fine-Grained, Secure and Efficient Data Provenance on Blockchain Systems 2019 VLDB 7.466958e-05
3,704 RAMP: A System for Capturing and Tracing Provenance in MapReduce Workflows 2011 VLDB 6.8242938e-05
4,779 LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems 2021 SIGMOD 5.9259373e-05
5,212 Explaining Outputs in Modern Data Analytics 2016 VLDB 5.6239563e-05
5,374 A Quest for Beauty and Wealth (or, Business Processes for Database Researchers) 2011 PODS 5.5408029e-05
6,980 Dataset Relationship Management 2019 CIDR 4.8696895e-05
7,678 To Not Miss the Forest for the Trees - A Holistic Approach for Explaining Missing Answers over Nested Data 2021 SIGMOD 4.6768157e-05
7,858 Fixed It For You: Protocol Repair Using Lineage Graphs 2019 CIDR 4.6301072e-05
8,392 Hypothetical Reasoning via Provenance Abstraction 2019 SIGMOD 4.5234647e-05
8,501 Distributed Time-aware Provenance 2013 VLDB 4.4918817e-05
9,058 Tracking Personal Data Use: Provenance And Trust 2015 CIDR 4.3997447e-05
11,667 Capturing and Querying Structural Provenance in Spark with Pebble 2019 SIGMOD 4.1905499e-05
11,716 Demonstration of Smoke: A Deep Breath of Data-Intensive Lineage Applications 2018 SIGMOD 4.1905499e-05
11,806 Privacy-Preserving Network Provenance 2017 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
3 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0024217964
15 Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters 2007 SIGMOD 0.0010668335
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059744625
593 Lineage Tracing for General Data Warehouse Transformations 2001 VLDB 0.0001952223
921 Provenance and Scientific Workflows: Challenges and Opportunities 2008 SIGMOD 0.00015261463
1,763 Efficient Lineage Tracking For Scientific Workflows 2008 SIGMOD 0.00010626896
1,864 Efficient Provenance Storage 2008 SIGMOD 0.00010277171
1,868 Update Exchange with Mappings and Provenance 2007 VLDB 0.0001026365
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
921 Provenance and Scientific Workflows: Challenges and Opportunities 2008 SIGMOD 0.00015261463
2,031 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance 2012 VLDB 9.7341007e-05
11,670 Ursprung: Provenance for Large-Scale Analytics Environments 2019 SIGMOD 4.1905499e-05
7,131 Enabling Privacy in Provenance-Aware Workflow Systems 2011 CIDR 4.8181343e-05
8,501 Distributed Time-aware Provenance 2013 VLDB 4.4918817e-05
5,854 Tracing Lineage Beyond Relational Operators 2007 VLDB 5.2982313e-05
593 Lineage Tracing for General Data Warehouse Transformations 2001 VLDB 0.0001952223
8,166 Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science 2021 VLDB 4.567959e-05
1,763 Efficient Lineage Tracking For Scientific Workflows 2008 SIGMOD 0.00010626896
3,704 RAMP: A System for Capturing and Tracing Provenance in MapReduce Workflows 2011 VLDB 6.8242938e-05