Putting Lipstick on Pig: Enabling Database-style Workflow Provenance

Summary: Merges database- and workflow-style provenance by exposing module functionality via Pig Latin to reveal state, fine-grained dependencies, and ZoomIn/ZoomOut granularity. Lipstick implements the approach and benchmarks its performance. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 10484
Venue: VLDB
Year: 2012
Pagerank: 9.7341007e-05
Overall Rank: 2,031 | 85.89%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 24 of 24 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,030	Titian: Data Provenance Support in Spark	2016	VLDB	9.734332e-05
2,456	Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities	2021	SIGMOD	8.7649259e-05
2,770	The Semiring Framework for Database Provenance	2017	PODS	8.1495762e-05
3,107	Data X-Ray: A Diagnostic Tool for Data Errors	2015	SIGMOD	7.5549177e-05
4,423	PrIU: A Provenance-Based Approach for Incrementally Updating Regression Models	2020	SIGMOD	6.1925724e-05
4,779	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	5.9259373e-05
5,088	Improving Reproducibility of Data Science Pipelines through Transparent Provenance Capture	2020	VLDB	5.7023581e-05
5,212	Explaining Outputs in Modern Data Analytics	2016	VLDB	5.6239563e-05
5,454	QFix: Diagnosing Errors through Query Histories	2017	SIGMOD	5.4967096e-05
6,290	Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines	2021	CIDR	5.1220786e-05
7,678	To Not Miss the Forest for the Trees - A Holistic Approach for Explaining Missing Answers over Nested Data	2021	SIGMOD	4.6768157e-05
7,718	Provenance: On and Behind the Screens	2016	SIGMOD	4.6639968e-05
7,838	Dependency-Driven Analytics: a Compass for Uncharted Data Oceans	2017	CIDR	4.6338262e-05
8,392	Hypothetical Reasoning via Provenance Abstraction	2019	SIGMOD	4.5234647e-05
8,725	OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs	2023	VLDB	4.453957e-05
9,043	Query-Guided Resolution in Uncertain Databases	2023	SIGMOD	4.3997447e-05
9,058	Tracking Personal Data Use: Provenance And Trust	2015	CIDR	4.3997447e-05
9,204	Compact, Tamper-Resistant Archival of Fine-Grained Provenance	2021	VLDB	4.3701044e-05
10,429	Unified Lineage System: Tracking Data Provenance at Scale	2025	SIGMOD	4.1905499e-05
10,914	Postulates for Provenance: Instance-based provenance for first-order logic	2024	PODS	4.1905499e-05
11,652	Ariadne: Online Provenance for Big Graph Analytics	2019	SIGMOD	4.1905499e-05
11,667	Capturing and Querying Structural Provenance in Spark with Pebble	2019	SIGMOD	4.1905499e-05
11,900	Looking at Everything in Context	2015	CIDR	4.1905499e-05
12,022	A Provenance Framework for Data-Dependent Process Analysis	2014	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024217964
31	Provenance Semirings	2007	PODS	0.00078516827
921	Provenance and Scientific Workflows: Challenges and Opportunities	2008	SIGMOD	0.00015261463
1,106	Provenance for Aggregate Queries	2011	PODS	0.00013976386
1,441	Provenance for Generalized Map and Reduce Workflows	2011	CIDR	0.00011950114
1,868	Update Exchange with Mappings and Provenance	2007	VLDB	0.0001026365
2,182	Querying Data Provenance	2010	SIGMOD	9.3596252e-05
4,785	Ibis: A Provenance Manager for Multi-Layer Systems	2011	CIDR	5.9196501e-05
5,275	Annotated XML: Queries and Provenance	2008	PODS	5.5908918e-05
8,939	Zoom*UserViews: Querying Relevant Provenance in Workflow Systems	2007	VLDB	4.4229886e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
6,511	Provenance Views for Module Privacy	2011	PODS	5.0273291e-05
2,903	Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead	2017	CIDR	7.9403877e-05
8,166	Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science	2021	VLDB	4.567959e-05
921	Provenance and Scientific Workflows: Challenges and Opportunities	2008	SIGMOD	0.00015261463
6,531	Labeling Workflow Views with Fine-Grained Dependencies	2012	VLDB	5.0196961e-05
5,816	An Optimal Labeling Scheme for Workflow Provenance Using Skeleton Labels	2010	SIGMOD	5.3158435e-05
7,131	Enabling Privacy in Provenance-Aware Workflow Systems	2011	CIDR	4.8181343e-05
1,441	Provenance for Generalized Map and Reduce Workflows	2011	CIDR	0.00011950114
12,022	A Provenance Framework for Data-Dependent Process Analysis	2014	VLDB	4.1905499e-05
1,763	Efficient Lineage Tracking For Scientific Workflows	2008	SIGMOD	0.00010626896