Generating Example Data for Dataflow Programs
Summary: Generates small, semantically faithful intermediate data to illustrate dataflow program semantics rather than full outputs. Tackles highly selective and noninvertible operators with dedicated data generation techniques, validated on real Yahoo!-scale dataflow workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Christopher Olston (Yahoo)
- 2. Shubham Chopra (Yahoo)
- 3. Utkarsh Srivastava (Yahoo)
BibTeX Citation
@inproceedings{olston_sigmod09,
title = {{Generating Example Data for Dataflow Programs}},
author = {Olston, Christopher and Chopra, Shubham and Srivastava, Utkarsh},
series = {{SIGMOD} '09},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/1559845.1559873},
url = {https://dl.acm.org/doi/10.1145/1559845.1559873},
year = {2009}
}Incoming Citations (Sorted by Pagerank)
Showing 11 of 11 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 642 | Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience | 2009 | VLDB | 0.00015395331 |
| 2,215 | Characterizing Schema Mappings via Data Examples | 2010 | PODS | 8.93781e-05 |
| 2,369 | Data Generation using Declarative Constraints | 2011 | SIGMOD | 8.682429e-05 |
| 3,341 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD | 7.5028917e-05 |
| 3,994 | Generating Databases for Query Workloads | 2010 | VLDB | 6.9686731e-05 |
| 4,282 | Mining Top-K Large Structural Patterns in a Massive Network | 2011 | VLDB | 6.7842201e-05 |
| 4,721 | QueryVis: Logic-based Diagrams help Users Understand Complicated SQL Queries Faster | 2020 | SIGMOD | 6.5444379e-05 |
| 4,759 | Explaining Wrong Queries Using Small Examples | 2019 | SIGMOD | 6.5207388e-05 |
| 6,736 | Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads | 2013 | VLDB | 5.787547e-05 |
| 8,174 | Databases will Visualize Queries too | 2011 | VLDB | 5.4738201e-05 |
| 8,970 | Understanding Queries by Conditional Instances | 2022 | SIGMOD | 5.3422757e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6 | Pig Latin: A Not-So-Foreign Language for Data Processing | 2008 | SIGMOD | 0.0010686205 |
| 54 | On Random Sampling over Joins | 1999 | SIGMOD | 0.00040810225 |
| 734 | QAGen: Generating Query-Aware Test Databases | 2007 | SIGMOD | 0.00014525584 |
| 1,851 | Tioga: Providing Data Management Support for Scientific Visualization Applications | 1993 | VLDB | 9.6139015e-05 |
| 5,113 | Test Data for Relational Queries (Extended abstract) | 1986 | PODS | 6.3587816e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,275 | Optimizing Analytic Data Flows for Multiple Execution Engines | 2012 | SIGMOD |
| 2 | 6,200 | New Trends on Exploratory Methods for Data Analytics | 2017 | VLDB |
| 3 | 10,406 | Test Data Generation for Complex SQL Queries | 2026 | SIGMOD |
| 4 | 5,193 | Sampling Algorithms in a Stream Operator | 2005 | SIGMOD |
| 5 | 8,358 | Exploring the Data Wilderness through Examples | 2019 | SIGMOD |
| 6 | 3,341 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD |
| 7 | 361 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB |
| 8 | 1,030 | Data-Driven Understanding and Refinement of Schema Mappings | 2001 | SIGMOD |
| 9 | 2,164 | Opening the Black Boxes in Data Flow Optimization | 2012 | VLDB |
| 10 | 4,845 | Explaining Outputs in Modern Data Analytics | 2016 | VLDB |