Adapting to Source Properties in Processing Data Integration Queries

Summary: Proposes adaptive query processing for data integration, using ADP to split sources into regions for distinct plans. ADP enables corrections of underestimated selectivity/cardinality and reveals exploitable order and pre-aggregation opportunities. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h9e9a08c2a614df7d
Venue: SIGMOD
Year: 2004
Pagerank: 7.7492907e-05
Overall Rank: 3,001 | 79.89%
DOI: 10.1145/1007568.1007613

Incoming Non-self Citations Over Time

Authors

1. Zachary G. Ives (University of Pennsylvania)
2. Alon Y. Halevy (University of Washington)
3. Daniel S. Weld (University of Washington)

BibTeX Citation

@inproceedings{ives_sigmod04,
        title = {{Adapting to Source Properties in Processing Data Integration Queries}},
        author = {Ives, Zachary G. and Halevy, Alon Y. and Weld, Daniel S.},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007613},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007613},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 18 of 18 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
826	Data Integration: The Teenage Years	2006	VLDB	0.00013599086
838	Proactive Re-Optimization	2005	SIGMOD	0.00013528646
1,818	ORCHESTRA: Rapid, Collaborative Sharing of Dynamic Data	2005	CIDR	9.5594619e-05
2,612	Query Optimization over Web Services	2006	VLDB	8.2025949e-05
3,779	Query Suspend and Resume	2007	SIGMOD	7.0032366e-05
4,069	Adaptive Query Processing in the Looking Glass	2005	CIDR	6.8080574e-05
4,122	Content-Based Routing: Different Plans for Different Data	2005	VLDB	6.7810085e-05
5,673	Enabling Incremental Query Re-Optimization	2016	SIGMOD	6.0252485e-05
5,712	Approximate Quantiles and the Order of the Stream	2006	PODS	6.0096683e-05
5,922	Query Processing over Incomplete Autonomous Databases	2007	VLDB	5.9284185e-05
6,759	Cheap Data Analytics using Cold Storage Devices	2016	VLDB	5.6710776e-05
6,902	DAPHNE: An Open and Extensible System Infrastructure for Integrated Data Analysis Pipelines	2022	CIDR	5.6365602e-05
7,269	Efficient Adaptive Detection of Complex Event Patterns	2018	VLDB	5.5534971e-05
7,432	POLAR: Adaptive and Non-invasive Join Order Selection via Plans of Least Resistance	2024	VLDB	5.5133928e-05
10,322	Request Window: an Approach to Improve Throughput of RDBMS-based Data Integration System by Utilizing Data Sharing Across Concurrent Distributed Queries	2007	VLDB	5.0255524e-05
11,011	Ultron: History-Based Query Optimization at Databricks	2026	VLDB	4.9605343e-05
12,434	Looking at Everything in Context	2015	CIDR	4.9605343e-05
12,916	Optimization of Multi-Domain Queries on the Web	2008	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
9	Online Aggregation	1997	SIGMOD	0.00076079812
53	Eddies: Continuously Adaptive Query Processing	2000	SIGMOD	0.00040739114
73	Including Group-By in Query Optimization	1994	VLDB	0.00037420958
78	Sampling-Based Estimation of the Number of Distinct Values of an Attribute	1995	VLDB	0.00036725074
98	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034050614
135	Ripple Joins for Online Aggregation	1999	SIGMOD	0.00029805026
149	Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans	1998	SIGMOD	0.00028910892
174	Optimizing Queries across Diverse Data Sources	1997	VLDB	0.00026736308
201	Continuously Adaptive Continuous Queries over Streams	2002	SIGMOD	0.00025363666
234	Adaptive Selectivity Estimation Using Query Feedback	1994	SIGMOD	0.00023726296
291	Optimization of Dynamic Query Evaluation Plans	1994	SIGMOD	0.00021898776
336	An Adaptive Query Execution System for Data Integration*	1999	SIGMOD	0.00020619345
426	Cost-based Query Scrambling for Initial Delays	1998	SIGMOD	0.00018432573
646	Exploiting Statistics on Query Expressions for Optimization	2002	SIGMOD	0.00015166402
872	Query Optimization in the Presence of Limited Access Patterns	1999	SIGMOD	0.00013307412
1,809	Dynamic Pipeline Scheduling for Improving Interactive Query Performance	2001	VLDB	9.5834851e-05
1,811	Hash joins and hash teams in Microsoft SQL Server	1998	VLDB	9.5759277e-05
2,563	Tuple Routing Strategies for Distributed Eddies	2003	VLDB	8.2699925e-05
5,701	A Parallel Processing Strategy for Evaluating Recursive Queries	1986	VLDB	6.0127868e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	3,079	Adaptive Query Processing on RAW Data	2014	VLDB
2	1,185	Adaptive Optimization of Very Large Join Queries	2018	SIGMOD
3	3,156	Query Optimization Techniques for Partitioned Tables	2011	SIGMOD
4	5,673	Enabling Incremental Query Re-Optimization	2016	SIGMOD
5	13,166	Adaptive Distributed Query Processing	2003	VLDB
6	336	An Adaptive Query Execution System for Data Integration*	1999	SIGMOD
7	1,633	Adaptive Parallel Aggregation Algorithms	1995	SIGMOD
8	4,210	Adaptive Work Placement for Query Processing on Heterogeneous Computing Resources	2017	VLDB
9	4,069	Adaptive Query Processing in the Looking Glass	2005	CIDR
10	6,214	Adaptive Query Processing: Why, How, When, What Next	2006	SIGMOD