Dependency-Driven Analytics: a Compass for Uncharted Data Oceans

Summary: Proposes DDA: extract a compact dependency graph from raw telemetry to index and constrain analyses, reducing cognitive and compute costs for petabyte-scale log analytics. Deployed at Microsoft on job/file lineage using off-the-shelf Big Data+graph DBs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 306
Venue: CIDR
Year: 2017
Pagerank: 5.5246167e-05
Overall Rank: 7,878 | 45.96%
DOI: -

Incoming Non-self Citations Over Time

Authors

1. Ruslan Mavlyutov (University of Freiburg)
2. Carlo Curino (Microsoft)
3. Boris Asipov (Microsoft)
4. Philippe Cudre-Mauroux (University of Freiburg)

BibTeX Citation

@inproceedings{mavlyutov_cidr17,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '17},
        title = {{Dependency-Driven Analytics: a Compass for Uncharted Data Oceans}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Mavlyutov, Ruslan and Curino, Carlo and Asipov, Boris and Cudre-Mauroux, Philippe},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,605	Computation Reuse in Analytics Job Service at Microsoft	2018	SIGMOD	7.2640711e-05
4,756	Improving Reproducibility of Data Science Pipelines through Transparent Provenance Capture	2020	VLDB	6.5221401e-05
8,950	OneProvenance: Efficient Extraction of Dynamic Coarse-Grained Provenance From Database Query Event Logs	2023	VLDB	5.345946e-05
11,862	Peering through the Dark: An Owl's View of Inter-job Dependencies and Jobs' Impact in Shared Clusters	2019	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
30	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.00051174276
125	Trio: A System for Integrated Management of Data, Accuracy, and Lineage	2005	CIDR	0.00030932014
191	Scorpion: Explaining Away Outliers in Aggregate Queries	2013	VLDB	0.00026096009
211	EmptyHeaded: A Relational Engine for Graph Processing	2016	SIGMOD	0.00024797217
514	Goods: Organizing Google's Datasets	2016	SIGMOD	0.00017178673
579	Incremental Knowledge Base Construction Using DeepDive	2015	VLDB	0.00016217563
919	Provenance and Scientific Workflows: Challenges and Opportunities	2008	SIGMOD	0.00013214041
1,077	DataHub: Collaborative Data Science & Dataset Version Management at Scale	2015	CIDR	0.00012269438
1,617	Titian: Data Provenance Support in Spark	2016	VLDB	0.00010209397
1,786	Putting Lipstick on Pig: Enabling Database-style Workflow Provenance	2012	VLDB	9.7690421e-05
7,204	WOO: A Scalable and Multi-tenant Platform for Continuous Knowledge Base Synthesis	2013	VLDB	5.6739087e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,875	Reliability Analytics for Cloud Based Distributed Databases	2020	SIGMOD
2	11,829	Automated Performance Management for the Big Data Stack	2019	CIDR
3	494	Dependencies Revisited for Improving Data Quality	2008	PODS
4	11,862	Peering through the Dark: An Owl's View of Inter-job Dependencies and Jobs' Impact in Shared Clusters	2019	SIGMOD
5	618	A Hybrid Approach to Functional Dependency Discovery	2016	SIGMOD
6	729	Functional Dependency Discovery: An Experimental Evaluation of Seven Algorithms	2015	VLDB
7	11,743	Making DBMSes Dependency-Aware	2020	CIDR
8	9,801	Breaking the Chains: On Declarative Data Analysis and Data Independence in the Big Data Era	2014	VLDB
9	13,829	Mapping Moving Landscapes by Mining Mountains of Logs: Novel Techniques for Dependency Model Generation	2006	VLDB
10	5,052	Distributed implementations of dependency discovery algorithms	2019	VLDB