Towards Understanding Data Analysis Workflows using a Large Notebook Corpus

Summary: Leverages a large Jupyter notebook corpus to analyze pandas usage and extract data-analysis patterns. Constructs lineage graphs of pandas notebook workflows to enable on-the-fly optimization and synthetic workflow generation using design patterns. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5700
Venue: SIGMOD
Year: 2019
Pagerank: -
Overall Rank: 13,493 | 7.43%
DOI: 10.1145/3299869.3300107

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Mohammed Suhail Rehman (University of Chicago)

BibTeX Citation

@inproceedings{rehman_sigmod19,
        title = {{Towards Understanding Data Analysis Workflows using a Large Notebook Corpus}},
        author = {Rehman, Mohammed Suhail},
        series = {{SIGMOD} '19},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3299869.3300107},
        url = {https://dl.acm.org/doi/10.1145/3299869.3300107},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,457	FlowPilot: A Suggestion System for Designing Scientific Workflows	2026	SIGMOD
2	9,089	Querying and Re-Using Workflows with VisTrails	2008	SIGMOD
3	3,072	Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflows	2022	VLDB
4	11,594	DPDS: Assisting Data Science with Data Provenance	2022	VLDB
5	13,433	Automating State Management in Computational Notebooks	2021	CIDR
6	7,065	Dataset Relationship Management	2019	CIDR
7	1,303	Finding Related Tables in Data Lakes for Interactive Data Science	2020	SIGMOD
8	6,071	Fine-Grained Lineage for Safer Notebook Interactions	2021	VLDB
9	2,744	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD
10	1,871	Efficient Lineage Tracking For Scientific Workflows	2008	SIGMOD