Generating Example Data for Dataflow Programs
Summary: Generates small, semantically faithful intermediate data to illustrate dataflow program semantics rather than full outputs. Tackles highly selective and noninvertible operators with dedicated data generation techniques, validated on real Yahoo!-scale dataflow workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Christopher Olston (Yahoo)
- 2. Shubham Chopra (Yahoo)
- 3. Utkarsh Srivastava (Yahoo)
BibTeX Citation
@inproceedings{olston_sigmod09,
title = {{Generating Example Data for Dataflow Programs}},
author = {Olston, Christopher and Chopra, Shubham and Srivastava, Utkarsh},
series = {{SIGMOD} '09},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/1559845.1559873},
url = {https://dl.acm.org/doi/10.1145/1559845.1559873},
year = {2009}
}Incoming Citations (Sorted by Pagerank)
Showing 11 of 11 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 651 | Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience | 2009 | VLDB | 0.00015123701 |
| 2,246 | Characterizing Schema Mappings via Data Examples | 2010 | PODS | 8.7612699e-05 |
| 2,414 | Data Generation using Declarative Constraints | 2011 | SIGMOD | 8.5054535e-05 |
| 3,397 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD | 7.3332055e-05 |
| 4,093 | Generating Databases for Query Workloads | 2010 | VLDB | 6.809504e-05 |
| 4,351 | Mining Top-K Large Structural Patterns in a Massive Network | 2011 | VLDB | 6.6423305e-05 |
| 4,619 | QueryVis: Logic-based Diagrams help Users Understand Complicated SQL Queries Faster | 2020 | SIGMOD | 6.4965731e-05 |
| 4,849 | Explaining Wrong Queries Using Small Examples | 2019 | SIGMOD | 6.3794032e-05 |
| 6,792 | Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads | 2013 | VLDB | 5.6794384e-05 |
| 8,346 | Databases will Visualize Queries too | 2011 | VLDB | 5.3488022e-05 |
| 9,069 | Understanding Queries by Conditional Instances | 2022 | SIGMOD | 5.2265129e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6 | Pig Latin: A Not-So-Foreign Language for Data Processing | 2008 | SIGMOD | 0.0010515896 |
| 57 | On Random Sampling over Joins | 1999 | SIGMOD | 0.00040095727 |
| 748 | QAGen: Generating Query-Aware Test Databases | 2007 | SIGMOD | 0.00014277246 |
| 1,900 | Tioga: Providing Data Management Support for Scientific Visualization Applications | 1993 | VLDB | 9.4026255e-05 |
| 5,240 | Test Data for Relational Queries (Extended abstract) | 1986 | PODS | 6.2142772e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,339 | Optimizing Analytic Data Flows for Multiple Execution Engines | 2012 | SIGMOD |
| 2 | 6,333 | New Trends on Exploratory Methods for Data Analytics | 2017 | VLDB |
| 3 | 7,644 | Test Data Generation for Complex SQL Queries | 2026 | SIGMOD |
| 4 | 5,325 | Sampling Algorithms in a Stream Operator | 2005 | SIGMOD |
| 5 | 8,516 | Exploring the Data Wilderness through Examples | 2019 | SIGMOD |
| 6 | 3,397 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD |
| 7 | 1,050 | Data-Driven Understanding and Refinement of Schema Mappings | 2001 | SIGMOD |
| 8 | 325 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB |
| 9 | 2,197 | Opening the Black Boxes in Data Flow Optimization | 2012 | VLDB |
| 10 | 4,937 | Explaining Outputs in Modern Data Analytics | 2016 | VLDB |