Versatile Optimization of UDF-heavy Data Flows with Sofa
Summary: Introduces Meteor, a declarative data-flow language, and Sofa, a logical optimizer for UDF-heavy analytics in Stratosphere. Uses a compact set of UDF annotations and rewrite rules to realize semantically equivalent plan rewrites, with a subsumption-based operator hierarchy for extensibility and interactive, cost-based optimization with dependency visualization. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Astrid Rheinländer (Humboldt University of Berlin)
- 2. Martin Beckmann (Humboldt University of Berlin)
- 3. Anja Kunkel (Humboldt University of Berlin)
- 4. Arvid Heise (Hasso Plattner Institute)
- 5. Thomas Stoltmann (Humboldt University of Berlin)
- 6. Ulf Leser (Humboldt University of Berlin)
BibTeX Citation
@inproceedings{rheinlander_sigmod14,
title = {{Versatile Optimization of UDF-heavy Data Flows with Sofa}},
author = {Rheinländer, Astrid and Beckmann, Martin and Kunkel, Anja and Heise, Arvid and Stoltmann, Thomas and Leser, Ulf},
series = {{SIGMOD} '14},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/2588555.2594517},
url = {https://dl.acm.org/doi/10.1145/2588555.2594517},
year = {2014}
}
Incoming Citations (Sorted by Pagerank)
Showing 1 of 1 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 9,456 | QURE: AI-Assisted and Automatically Verified UDF Inlining | 2025 | SIGMOD | 5.2643416e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 6 of 6 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6 | Pig Latin: A Not-So-Foreign Language for Data Processing | 2008 | SIGMOD | 0.0010686205 |
| 32 | Hive - A Warehousing Solution Over a Map-Reduce Framework | 2009 | VLDB | 0.00050111008 |
| 319 | Declarative Information Extraction Using Datalog with Embedded Extraction Predicates | 2007 | VLDB | 0.00021377065 |
| 1,021 | Jaql: A Scripting Language for Large Scale Semistructured Data Analysis | 2011 | VLDB | 0.00012606673 |
| 2,164 | Opening the Black Boxes in Data Flow Optimization | 2012 | VLDB | 9.0521951e-05 |
| 8,196 | Massively Parallel Data Analysis with PACTs on Nephele | 2010 | VLDB | 5.4692179e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 10,121 | End-to-End Declarative Data Analytics: Co-designing Engines, Interfaces, and Cloud Infrastructure | 2026 | CIDR |
| 2 | 1,442 | An Architecture for Compiling UDF-centric Workflows | 2015 | VLDB |
| 3 | 10,740 | UDFBench: A Tool for Benchmarking UDF Queries on SQL Engines | 2025 | SIGMOD |
| 4 | 4,481 | Dynamically Optimizing Queries over Large Scale Data Platforms | 2014 | SIGMOD |
| 5 | 12,510 | Fast and Dynamic OLAP Exploration Using UDFs | 2009 | SIGMOD |
| 6 | 10,582 | FlowLog: Efficient and Extensible Datalog via Incrementality | 2026 | VLDB |
| 7 | 6,253 | Declarative Sub-Operators for Universal Data Processing | 2023 | VLDB |
| 8 | 9,917 | The UDFBench Benchmark for General-purpose UDF Queries | 2025 | VLDB |
| 9 | 8,096 | Efficient Execution of User-Defined Functions in SQL Queries | 2023 | VLDB |
| 10 | 2,164 | Opening the Black Boxes in Data Flow Optimization | 2012 | VLDB |