Pasta: A Cost-Based Optimizer for Generating Pipelining Schedules for Dataflow DAGs

Summary: Introduces Pasta, a cost-based optimizer for scheduling pipelined execution of dataflow DAGs. General across cost models, it exploits cost-function structure to reduce materialization and improve plan quality on real-world workflows. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 7001
Venue: SIGMOD
Year: 2024
Pagerank: 4.1945683e-05
Overall Rank: 10,996 | 23.51%
DOI: 10.1145/3698832

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
977	Pipelining in Multi-Query Optimization	2001	PODS	0.0001488881
1,825	Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism	1994	VLDB	0.00010401739
2,417	Dynamic Load Balancing in Hierarchical Parallel Database Systems	1996	VLDB	8.8604775e-05
3,260	On Optimal Processor Allocation To Support Pipelined Hash Joins	1993	SIGMOD	7.3122611e-05
5,072	Optimizing Machine Learning Inference Queries with Correlative Proxy Models	2022	VLDB	5.7185674e-05
6,469	Materialization and Reuse Optimizations for Production Data Science Pipelines	2022	SIGMOD	5.0519488e-05
8,038	Amber: A Debuggable Dataflow System Based on the Actor Model	2020	VLDB	4.600124e-05
8,746	Texera: A System for Collaborative and Interactive Data Analytics Using Workflows	2024	VLDB	4.456315e-05
9,197	Demonstration of Collaborative and Interactive Workflow-Based Data Analytics in Texera	2022	VLDB	4.3748331e-05
11,272	Building a Collaborative Data Analytics System: Opportunities and Challenges	2023	VLDB	4.1945683e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
5,209	Explaining Outputs in Modern Data Analytics	2016	VLDB	5.629362e-05
1,825	Optimization Algorithms for Exploiting the Parallelism-Communication Tradeoff in Pipelined Parallelism	1994	VLDB	0.00010401739
2,611	Opening the Black Boxes in Data Flow Optimization	2012	VLDB	8.4536967e-05
2,456	Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities	2021	SIGMOD	8.7733773e-05
8,078	Meta-Dataflows: Efficient Exploratory Dataflow Jobs	2018	SIGMOD	4.5914967e-05
3,710	Optimizing Analytic Data Flows for Multiple Execution Engines	2012	SIGMOD	6.8238962e-05
977	Pipelining in Multi-Query Optimization	2001	PODS	0.0001488881
6,469	Materialization and Reuse Optimizations for Production Data Science Pipelines	2022	SIGMOD	5.0519488e-05
2,172	Spinning Fast Iterative Data Flows	2012	VLDB	9.3706587e-05
4,700	Schedule Optimization for Data Processing Flows on the Cloud	2011	SIGMOD	5.9882572e-05