Generating Example Data for Dataflow Programs
Summary: Generates small, semantically faithful intermediate data to illustrate dataflow program semantics rather than full outputs. Tackles highly selective and noninvertible operators with dedicated data generation techniques, validated on real Yahoo!-scale dataflow workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Christopher Olston (Yahoo)
- 2. Shubham Chopra (Yahoo)
- 3. Utkarsh Srivastava (Yahoo)
BibTeX Citation
@inproceedings{olston_sigmod09,
title = {{Generating Example Data for Dataflow Programs}},
author = {Olston, Christopher and Chopra, Shubham and Srivastava, Utkarsh},
series = {{SIGMOD} '09},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/1559845.1559873},
url = {https://dl.acm.org/doi/10.1145/1559845.1559873},
year = {2009}
}Incoming Citations (Sorted by Pagerank)
Showing 11 of 11 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 655 | Building a High-Level Dataflow System on top of Map-Reduce: The Pig Experience | 2009 | VLDB | 0.00015076669 |
| 2,263 | Characterizing Schema Mappings via Data Examples | 2010 | PODS | 8.7343452e-05 |
| 2,422 | Data Generation using Declarative Constraints | 2011 | SIGMOD | 8.4785012e-05 |
| 3,407 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD | 7.3096046e-05 |
| 4,113 | Generating Databases for Query Workloads | 2010 | VLDB | 6.7870932e-05 |
| 4,363 | Mining Top-K Large Structural Patterns in a Massive Network | 2011 | VLDB | 6.6264137e-05 |
| 4,638 | QueryVis: Logic-based Diagrams help Users Understand Complicated SQL Queries Faster | 2020 | SIGMOD | 6.4750914e-05 |
| 4,871 | Explaining Wrong Queries Using Small Examples | 2019 | SIGMOD | 6.3583165e-05 |
| 6,808 | Hadoop's Adolescence: An analysis of Hadoop usage in scientific workloads | 2013 | VLDB | 5.6608074e-05 |
| 8,359 | Databases will Visualize Queries too | 2011 | VLDB | 5.3311423e-05 |
| 9,090 | Understanding Queries by Conditional Instances | 2022 | SIGMOD | 5.2092307e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6 | Pig Latin: A Not-So-Foreign Language for Data Processing | 2008 | SIGMOD | 0.0010494385 |
| 57 | On Random Sampling over Joins | 1999 | SIGMOD | 0.0003999751 |
| 751 | QAGen: Generating Query-Aware Test Databases | 2007 | SIGMOD | 0.00014245413 |
| 1,911 | Tioga: Providing Data Management Support for Scientific Visualization Applications | 1993 | VLDB | 9.3720964e-05 |
| 5,261 | Test Data for Relational Queries (Extended abstract) | 1986 | PODS | 6.1938203e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,347 | Optimizing Analytic Data Flows for Multiple Execution Engines | 2012 | SIGMOD |
| 2 | 6,344 | New Trends on Exploratory Methods for Data Analytics | 2017 | VLDB |
| 3 | 7,658 | Test Data Generation for Complex SQL Queries | 2026 | SIGMOD |
| 4 | 5,341 | Sampling Algorithms in a Stream Operator | 2005 | SIGMOD |
| 5 | 8,531 | Exploring the Data Wilderness through Examples | 2019 | SIGMOD |
| 6 | 3,407 | Designing and Refining Schema Mappings via Data Examples | 2011 | SIGMOD |
| 7 | 328 | The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing | 2015 | VLDB |
| 8 | 1,054 | Data-Driven Understanding and Refinement of Schema Mappings | 2001 | SIGMOD |
| 9 | 2,124 | Opening the Black Boxes in Data Flow Optimization | 2012 | VLDB |
| 10 | 4,963 | Explaining Outputs in Modern Data Analytics | 2016 | VLDB |