FlowPilot: A Suggestion System for Designing Scientific Workflows
Summary: FlowPilot targets scientific-workflow authoring, where code LLMs underperform due to sparse domain-specific training data. It indexes historical workflows in a similarity KB and uses Markov-chain next-operator prediction to suggest the next step, outperforming LLM and association-rule baselines on NextFlow. (summarized by gpt-5-mini on Apr 11 2026)
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Authors
- 1. Mahdi Esmailoghli (Humboldt University of Berlin)
- 2. Matthias Weidlich (Humboldt University of Berlin)
BibTeX Citation
@inproceedings{esmailoghli_sigmod26,
title = {{FlowPilot: A Suggestion System for Designing Scientific Workflows}},
author = {Esmailoghli, Mahdi and Weidlich, Matthias},
series = {{SIGMOD} '26},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/3786653},
url = {https://dl.acm.org/doi/10.1145/3786653},
year = {2026}
}Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 8 of 8 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 919 | Provenance and Scientific Workflows: Challenges and Opportunities | 2008 | SIGMOD | 0.00013214041 |
| 1,985 | Querying Business Processes | 2006 | VLDB | 9.353709e-05 |
| 2,192 | Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning | 2023 | VLDB | 8.9767241e-05 |
| 2,744 | Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks | 2020 | SIGMOD | 8.1781662e-05 |
| 4,875 | Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search | 2021 | VLDB | 6.4689177e-05 |
| 8,914 | CtxPipe: Context-aware Data Preparation Pipeline Construction for Machine Learning | 2024 | SIGMOD | 5.3483178e-05 |
| 8,916 | Texera: A System for Collaborative and Interactive Data Analytics Using Workflows | 2024 | VLDB | 5.3483178e-05 |
| 8,934 | Similarity Search for Scientific Workflows | 2014 | VLDB | 5.3483178e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 713 | Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes | 2024 | VLDB |
| 2 | 8,934 | Similarity Search for Scientific Workflows | 2014 | VLDB |
| 3 | 3,381 | Ava: From Data to Insights Through Conversation | 2017 | CIDR |
| 4 | 10,909 | LLMLog: Advanced Log Template Generation via LLM-driven Multi-Round Annotation | 2025 | VLDB |
| 5 | 13,311 | Prompt Editor: A Taxonomy-driven System for Guided LLM Prompt Development in Enterprise Settings | 2025 | SIGMOD |
| 6 | 13,493 | Towards Understanding Data Analysis Workflows using a Large Notebook Corpus | 2019 | SIGMOD |
| 7 | 10,228 | Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective | 2026 | SIGMOD |
| 8 | 4,050 | Revisiting Prompt Engineering via Declarative Crowdsourcing | 2024 | CIDR |
| 9 | 10,882 | CatDB: Data-catalog-guided, LLM-based Generation of Data-centric ML Pipelines | 2025 | VLDB |
| 10 | 13,303 | Demonstrating CatDB: LLM-based Generation of Data-centric ML Pipelines | 2025 | SIGMOD |