Efficient Provenance Storage

Summary: Proposes efficient provenance storage via three techniques—factorization and two inheritance-based methods—to reduce provenance data while preserving queryability. Applied to MiMI, Karma, and PReServ, it yields up to 20x storage reduction with efficient queries and cheap incremental updates. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h8ff2efadca59f113
Venue: SIGMOD
Year: 2008
Pagerank: 0.00010072076
Overall Rank: 1,611 | 89.18%
DOI: 10.1145/1376616.1376715

Incoming Non-self Citations Over Time

Authors

1. Adriane P. Chapman (University of Michigan)
2. H.V. Jagadish (University of Michigan)
3. Prakash Ramanan (Wichita State University)

BibTeX Citation

@inproceedings{chapman_sigmod08,
        title = {{Efficient Provenance Storage}},
        author = {Chapman, Adriane P. and Jagadish, H.V. and Ramanan, Prakash},
        series = {{SIGMOD} '08},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1376616.1376715},
        url = {https://dl.acm.org/doi/10.1145/1376616.1376715},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,389	Provenance for Generalized Map and Reduce Workflows	2011	CIDR	0.00010818511
1,827	Querying Data Provenance	2010	SIGMOD	9.5518797e-05
4,684	Provenance for Natural Language Queries	2017	VLDB	6.4692258e-05
5,533	Putting Things into Context: Rich Explanations for Query Answers using Join Graphs	2021	SIGMOD	6.0906707e-05
5,628	Distributed Provenance Compression	2017	SIGMOD	6.0576733e-05
5,749	An Optimal Labeling Scheme for Workflow Provenance Using Skeleton Labels	2010	SIGMOD	6.0051184e-05
6,459	On Provenance Minimization	2011	PODS	5.7751941e-05
6,488	Approximate Summaries for Why and Why-not Provenance	2020	VLDB	5.7659318e-05
6,712	Selective Provenance for Datalog Programs Using Top-K Queries	2015	VLDB	5.70009e-05
7,235	Hypothetical Reasoning via Provenance Abstraction	2019	SIGMOD	5.5765963e-05
7,561	Detecting and Resolving Unsound Workflow Views for Correct Provenance Analysis	2009	SIGMOD	5.4949533e-05
8,083	Provenance-Enabled Explainable AI	2024	SIGMOD	5.3917406e-05
8,490	Provenance-based Data Skipping	2022	VLDB	5.3302146e-05
8,947	Compact, Tamper-Resistant Archival of Fine-Grained Provenance	2021	VLDB	5.2530141e-05
9,604	Equivalence-Invariant Algebraic Provenance for Hyperplane Update Queries	2020	SIGMOD	5.1534211e-05
9,947	NLProv: Natural Language Provenance	2016	VLDB	5.1038803e-05
10,838	Toward Temporal Attribution Analytics in Dataflows	2026	VLDB	4.9769913e-05
11,144	Unified Lineage System: Tracking Data Provenance at Scale	2025	SIGMOD	4.9769913e-05
11,963	Flow Provenance in Temporal Interaction Networks	2021	SIGMOD	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
84	ULDBs: Databases with Uncertainty and Lineage	2006	VLDB	0.00035960573
525	An Annotation Management System for Relational Databases	2004	VLDB	0.00016889428
590	Lineage Tracing for General Data Warehouse Transformations	2001	VLDB	0.00015884721
709	Archiving Scientific Data	2002	SIGMOD	0.00014605778
1,016	XMill: an Efficient Compressor for XML Data	2000	SIGMOD	0.00012487786
2,172	Provenance Management in Curated Databases	2006	SIGMOD	8.9202679e-05
5,307	The Virtual Data Grid: A New Model and Architecture for Data-Intensive Collaboration	2003	CIDR	6.1846664e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,628	Distributed Provenance Compression	2017	SIGMOD
2	6,488	Approximate Summaries for Why and Why-not Provenance	2020	VLDB
3	2,838	Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead	2017	CIDR
4	1,827	Querying Data Provenance	2010	SIGMOD
5	7,235	Hypothetical Reasoning via Provenance Abstraction	2019	SIGMOD
6	8,947	Compact, Tamper-Resistant Archival of Fine-Grained Provenance	2021	VLDB
7	11,981	On Optimizing the Trade-off between Privacy and Utility in Data Provenance	2021	SIGMOD
8	1,914	Efficient Lineage Tracking For Scientific Workflows	2008	SIGMOD
9	6,459	On Provenance Minimization	2011	PODS
10	2,172	Provenance Management in Curated Databases	2006	SIGMOD