Provenance and Scientific Workflows: Challenges and Opportunities

Summary: Provenance in scientific workflows spans data products and workflow specifications to enable reproducibility, sharing, and reuse. Surveys current systems' provenance support, highlights emerging applications, and sketches open problems and directions for database research. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h5b67dc8717941c3b
Venue: SIGMOD
Year: 2008
Pagerank: 0.00012897365
Overall Rank: 949 | 93.65%
DOI: 10.1145/1376616.1376772

Incoming Non-self Citations Over Time

Authors

1. Susan B. Davidson (University of Pennsylvania)
2. Juliana Freire (University of Utah)

BibTeX Citation

@inproceedings{davidson_sigmod08,
        title = {{Provenance and Scientific Workflows: Challenges and Opportunities}},
        author = {Davidson, Susan B. and Freire, Juliana},
        series = {{SIGMOD} '08},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1376616.1376772},
        url = {https://dl.acm.org/doi/10.1145/1376616.1376772},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 29 of 29 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,393	Provenance for Generalized Map and Reduce Workflows	2011	CIDR	0.00010784123
1,776	Putting Lipstick on Pig: Enabling Database-style Workflow Provenance	2012	VLDB	9.6661217e-05
1,858	Data Market Platforms: Trading Data Assets to Solve Data Problems	2020	VLDB	9.4779185e-05
2,685	Data X-Ray: A Diagnostic Tool for Data Errors	2015	SIGMOD	8.116387e-05
4,697	Provenance for Natural Language Queries	2017	VLDB	6.4479645e-05
5,917	Bolt-on, Compact, and Rapid Program Slicing for Notebooks	2022	VLDB	5.9320008e-05
6,053	ReproZip: Computational Reproducibility With Ease	2016	SIGMOD	5.8859918e-05
6,062	Your notebook is not crumby enough, REPLace it	2020	CIDR	5.8829004e-05
6,203	Fine-Grained Lineage for Safer Notebook Interactions	2021	VLDB	5.8344547e-05
6,367	Packing Experiments for Sharing and Publication	2013	SIGMOD	5.78729e-05
6,728	Selective Provenance for Datalog Programs Using Top-K Queries	2015	VLDB	5.6812425e-05
7,409	Sailing the Information Ocean with Awareness of Currents: Discovery and Application of Source Dependence	2009	CIDR	5.5168332e-05
7,575	Detecting and Resolving Unsound Workflow Views for Correct Provenance Analysis	2009	SIGMOD	5.4768074e-05
7,865	SOLOMON: Seeking the Truth Via Copying Detection	2010	VLDB	5.4217315e-05
7,971	Provenance: On and Behind the Screens	2016	SIGMOD	5.3995407e-05
8,048	Dependency-Driven Analytics: a Compass for Uncharted Data Oceans	2017	CIDR	5.3842397e-05
8,293	Distributed Time-aware Provenance	2013	VLDB	5.3440772e-05
8,387	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD	5.325795e-05
9,379	Tracking Personal Data Use: Provenance And Trust	2015	CIDR	5.170668e-05
9,630	Equivalence-Invariant Algebraic Provenance for Hyperplane Update Queries	2020	SIGMOD	5.1363807e-05
9,980	NLProv: Natural Language Provenance	2016	VLDB	5.0870037e-05
10,230	LPStream: Fine-grained Lazy Provenance for Stream Processing	2026	SIGMOD	5.0432098e-05
10,288	PROPOLIS: Provisioned Analysis of Data-Centric Processes	2013	VLDB	5.0323262e-05
10,716	FlowPilot: A Suggestion System for Designing Scientific Workflows	2026	SIGMOD	4.9605343e-05
12,449	Even Metadata is Getting Big: Annotation Summarization using InsightNotes	2015	SIGMOD	4.9605343e-05
12,474	SAASFEE: Scalable Scientific Workflow Execution Engine	2015	VLDB	4.9605343e-05
12,552	A Provenance Framework for Data-Dependent Process Analysis	2014	VLDB	4.9605343e-05
12,878	PDiffView: Viewing the Difference in Provenance of Workflow Results	2009	VLDB	4.9605343e-05
14,103	WOLVES: Achieving Correct Provenance Analysis by Detecting and Resolving Unsound Workflow Views	2009	VLDB	-

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
321	Making Database Systems Usable	2007	SIGMOD	0.00021093212
2,047	Querying Business Processes	2006	VLDB	9.1200868e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,580	Computational Reproducibility: State-of-the-Art, Challenges, and Database Research Opportunities	2012	SIGMOD
2	2,847	Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead	2017	CIDR
3	14,099	Storing Scientific Workflows in a Database	2009	VLDB
4	13,771	Theory and Practice of Provenance	2022	SIGMOD
5	2,186	Provenance Management in Curated Databases	2006	SIGMOD
6	1,923	Efficient Lineage Tracking For Scientific Workflows	2008	SIGMOD
7	7,385	Enabling Privacy in Provenance-Aware Workflow Systems	2011	CIDR
8	8,520	Querying and Re-Using Workflows with VisTrails	2008	SIGMOD
9	7,971	Provenance: On and Behind the Screens	2016	SIGMOD
10	12,989	Provenance in Databases (Tutorial Outline)	2007	SIGMOD