Efficient Provenance Storage

Summary: Proposes efficient provenance storage via three techniques—factorization and two inheritance-based methods—to reduce provenance data while preserving queryability. Applied to MiMI, Karma, and PReServ, it yields up to 20x storage reduction with efficient queries and cheap incremental updates. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4110
Venue: SIGMOD
Year: 2008
Pagerank: 0.00010188097
Overall Rank: 1,627 | 88.84%
DOI: 10.1145/1376616.1376715

Incoming Non-self Citations Over Time

Authors

1. Adriane P. Chapman (University of Michigan)
2. H.V. Jagadish (University of Michigan)
3. Prakash Ramanan (Wichita State University)

BibTeX Citation

@inproceedings{chapman_sigmod08,
        title = {{Efficient Provenance Storage}},
        author = {Chapman, Adriane P. and Jagadish, H.V. and Ramanan, Prakash},
        series = {{SIGMOD} '08},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1376616.1376715},
        url = {https://dl.acm.org/doi/10.1145/1376616.1376715},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,366	Provenance for Generalized Map and Reduce Workflows	2011	CIDR	0.00011016972
1,912	Querying Data Provenance	2010	SIGMOD	9.4946756e-05
4,602	Provenance for Natural Language Queries	2017	VLDB	6.6107638e-05
5,396	Putting Things into Context: Rich Explanations for Query Answers using Join Graphs	2021	SIGMOD	6.2329373e-05
5,724	An Optimal Labeling Scheme for Workflow Provenance Using Skeleton Labels	2010	SIGMOD	6.108728e-05
5,757	Distributed Provenance Compression	2017	SIGMOD	6.0972276e-05
6,358	On Provenance Minimization	2011	PODS	5.9020113e-05
6,360	Approximate Summaries for Why and Why-not Provenance	2020	VLDB	5.9009081e-05
6,587	Selective Provenance for Datalog Programs Using Top-K Queries	2015	VLDB	5.8333865e-05
7,416	Detecting and Resolving Unsound Workflow Views for Correct Provenance Analysis	2009	SIGMOD	5.6237046e-05
7,907	Provenance-Enabled Explainable AI	2024	SIGMOD	5.5181056e-05
8,509	Hypothetical Reasoning via Provenance Abstraction	2019	SIGMOD	5.4120069e-05
8,889	Provenance-based Data Skipping	2022	VLDB	5.3512428e-05
9,289	Compact, Tamper-Resistant Archival of Fine-Grained Provenance	2021	VLDB	5.2912339e-05
9,416	Equivalence-Invariant Algebraic Provenance for Hyperplane Update Queries	2020	SIGMOD	5.2742007e-05
9,763	NLProv: Natural Language Provenance	2016	VLDB	5.2234888e-05
10,701	Unified Lineage System: Tracking Data Provenance at Scale	2025	SIGMOD	5.093636e-05
11,650	Flow Provenance in Temporal Interaction Networks	2021	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
78	ULDBs: Databases with Uncertainty and Lineage	2006	VLDB	0.00036571789
531	An Annotation Management System for Relational Databases	2004	VLDB	0.00017083233
585	Lineage Tracing for General Data Warehouse Transformations	2001	VLDB	0.00016139897
701	Archiving Scientific Data	2002	SIGMOD	0.00014870915
1,011	XMill: an Efficient Compressor for XML Data	2000	SIGMOD	0.00012683964
2,134	Provenance Management in Curated Databases	2006	SIGMOD	9.1154913e-05
5,200	The Virtual Data Grid: A New Model and Architecture for Data-Intensive Collaboration	2003	CIDR	6.3208212e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,757	Distributed Provenance Compression	2017	SIGMOD
2	6,360	Approximate Summaries for Why and Why-not Provenance	2020	VLDB
3	2,807	Data Provenance at Internet Scale: Architecture, Experiences, and the Road Ahead	2017	CIDR
4	1,912	Querying Data Provenance	2010	SIGMOD
5	8,509	Hypothetical Reasoning via Provenance Abstraction	2019	SIGMOD
6	9,289	Compact, Tamper-Resistant Archival of Fine-Grained Provenance	2021	VLDB
7	11,668	On Optimizing the Trade-off between Privacy and Utility in Data Provenance	2021	SIGMOD
8	1,871	Efficient Lineage Tracking For Scientific Workflows	2008	SIGMOD
9	6,358	On Provenance Minimization	2011	PODS
10	2,134	Provenance Management in Curated Databases	2006	SIGMOD