Generating Example Data for Dataflow Programs
Summary: Generates small, semantically faithful intermediate data to illustrate dataflow program semantics rather than full outputs. Tackles highly selective and noninvertible operators with dedicated data generation techniques, validated on real Yahoo!-scale dataflow workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Christopher Olston (Yahoo)
- 2. Shubham Chopra (Yahoo)
- 3. Utkarsh Srivastava (Yahoo)
BibTeX Citation
@inproceedings{olston_sigmod09,
title = {{Generating Example Data for Dataflow Programs}},
author = {Olston, Christopher and Chopra, Shubham and Srivastava, Utkarsh},
series = {{SIGMOD} '09},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/1559845.1559873},
url = {https://dl.acm.org/doi/10.1145/1559845.1559873},
year = {2009}
}Incoming Citations (Sorted by Pagerank)
Showing 11 of 11 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 651 | Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience | 2009 | VLDB | 0.00015130782 |
| 2,244 | Characterizing Schema Mappings via Data Examples | 2010 | PODS | 8.7653687e-05 |
| 2,413 | Data Generation using Declarative Constraints | 2011 | SIGMOD | 8.5094338e-05 |
| 3,397 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD | 7.3366398e-05 |
| 4,090 | Generating Databases for Query Workloads | 2010 | VLDB | 6.8126942e-05 |
| 4,350 | Mining Top-K Large Structural Patterns in a Massive Network | 2011 | VLDB | 6.645396e-05 |
| 4,617 | QueryVis: Logic-based Diagrams help Users Understand Complicated SQL Queries Faster | 2020 | SIGMOD | 6.49965e-05 |
| 4,847 | Explaining Wrong Queries Using Small Examples | 2019 | SIGMOD | 6.3823876e-05 |
| 6,786 | Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads | 2013 | VLDB | 5.6820666e-05 |
| 8,343 | Databases will Visualize Queries too | 2011 | VLDB | 5.3513352e-05 |
| 9,061 | Understanding Queries by Conditional Instances | 2022 | SIGMOD | 5.2289882e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6 | Pig Latin: A Not-So-Foreign Language for Data Processing | 2008 | SIGMOD | 0.001052036 |
| 57 | On Random Sampling over Joins | 1999 | SIGMOD | 0.00040108301 |
| 747 | QAGen: Generating Query-Aware Test Databases | 2007 | SIGMOD | 0.00014283935 |
| 1,899 | Tioga: Providing Data Management Support for Scientific Visualization Applications | 1993 | VLDB | 9.4070548e-05 |
| 5,235 | Test Data for Relational Queries (Extended abstract) | 1986 | PODS | 6.2172158e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,339 | Optimizing Analytic Data Flows for Multiple Execution Engines | 2012 | SIGMOD |
| 2 | 6,330 | New Trends on Exploratory Methods for Data Analytics | 2017 | VLDB |
| 3 | 7,638 | Test Data Generation for Complex SQL Queries | 2026 | SIGMOD |
| 4 | 5,318 | Sampling Algorithms in a Stream Operator | 2005 | SIGMOD |
| 5 | 8,510 | Exploring the Data Wilderness through Examples | 2019 | SIGMOD |
| 6 | 3,397 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD |
| 7 | 325 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB |
| 8 | 1,050 | Data-Driven Understanding and Refinement of Schema Mappings | 2001 | SIGMOD |
| 9 | 2,195 | Opening the Black Boxes in Data Flow Optimization | 2012 | VLDB |
| 10 | 4,940 | Explaining Outputs in Modern Data Analytics | 2016 | VLDB |