Database Paper Browser

Back to papers

Web-scale Data Integration: You can only afford to Pay As You Go

Summary: Argues that traditional tightly-coupled integration fails at web scale (Deep Web, Google Base) due to extreme heterogeneity and scale. Proposes PAYGO, a dataspaces-inspired pay-as-you-go architecture that delivers incremental, best-effort, cost-aware integration to maximize utility under limited resources. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
94
Venue
CIDR
Year
2007
Pagerank
0.0001367088
Overall Rank
1,146 | 92.04%
DOI
-

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 28 of 28 citing papers.

Rank Citing Paper Year Venue Pagerank
257 Making Database Systems Usable 2007 SIGMOD 0.00030237174
630 Management of Probabilistic Data: Foundations and Challenges 2007 PODS 0.00018942778
668 Incremental Knowledge Base Construction Using DeepDive 2015 VLDB 0.00018428925
686 Pay-as-you-go User Feedback for Dataspace Systems 2008 SIGMOD 0.00018107664
1,538 Google's Deep-Web Crawl 2008 VLDB 0.00011455291
2,017 DB&IR: Both Sides Now (Extended Abstract) 2007 SIGMOD 9.7875061e-05
2,760 A Relational Approach to Incrementally Extracting and Querying Structure in Unstructured Data 2007 VLDB 8.1640002e-05
3,951 BLAST: a Loosely Schema-aware Meta-blocking Approach for Entity Resolution 2016 VLDB 6.5919471e-05
3,982 How Large Language Models Will Disrupt Data Management 2023 VLDB 6.5595332e-05
4,181 Arnold: Declarative Crowd-Machine Data Integration 2013 CIDR 6.3725128e-05
4,228 Harnessing the Deep Web: Present and Future 2009 CIDR 6.3354352e-05
4,510 iTrails: Pay-as-you-go Information Integration in Dataspaces 2007 VLDB 6.1239848e-05
5,219 Schema-agnostic vs Schema-based Configurations for Blocking Methods on Homogeneous Data 2016 VLDB 5.6196254e-05
5,586 HAMSTER: Using Search Clicklogs for Schema and Taxonomy Matching 2009 VLDB 5.4194791e-05
5,783 A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration 2009 VLDB 5.3262443e-05
7,682 SXPath - Extending XPath towards Spatial Querying on Web Documents 2011 VLDB 4.6759376e-05
7,930 Entity Resolution On-Demand 2022 VLDB 4.6089604e-05
8,002 A Grammar-based Entity Representation Framework for Data Cleaning 2009 SIGMOD 4.60503e-05
8,551 Search Driven Analysis of Heterogeneous XML Data 2009 CIDR 4.4893996e-05
8,692 Effective Entity Augmentation By Querying External Data Sources 2023 VLDB 4.4617233e-05
8,824 The Role of Schema Matching in Large Enterprises 2009 CIDR 4.4371579e-05
8,877 Learning to Extract Form Labels 2008 VLDB 4.4259652e-05
9,943 Stop Word and Related Problems in Web Interface Integration 2009 VLDB 4.241573e-05
12,121 Mob Data Sourcing 2012 SIGMOD 4.1905499e-05
12,192 Pay-As-You-Go Mapping Selection in Dataspaces 2011 SIGMOD 4.1905499e-05
12,231 Schema Clustering and Retrieval for Multi-domain Pay-As-You-Go Data Integration Systems 2010 SIGMOD 4.1905499e-05
12,248 Creating and Exploring Web Form Repositories 2010 SIGMOD 4.1905499e-05
12,328 Vispedia: On-demand Data Integration for Interactive Visualization and Exploration 2009 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
47 Data Integration: A Theoretical Perspective 2002 PODS 0.00069691761
188 Applying Model Management to Classical Meta Data Problems 2003 CIDR 0.00035935715
207 Reconciling Schemas of Disparate Data Sources: A Machine-Learning Approach 2001 SIGMOD 0.00034571837
228 Reference Reconciliation in Complex Information Spaces 2005 SIGMOD 0.00032266415
233 Crawling the Hidden Web 2001 VLDB 0.00031996412
427 Automated Ranking of Database Query Results 2003 CIDR 0.0002350378
671 An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web 2004 SIGMOD 0.00018370384
1,198 Crossing the Structure Chasm 2003 CIDR 0.00013360548
1,251 Principles of Dataspace Systems 2006 PODS 0.0001302453
2,071 DBLife: A Community Information Management Platform for the Database Research Community 2007 CIDR 9.6311384e-05
2,335 A Platform for Personal Information Management and Integration 2005 CIDR 9.0110693e-05
2,447 WISE-Integrator: An Automatic Integrator of Web Search Interfaces for E-Commerce 2003 VLDB 8.7958725e-05
3,721 Toward Large Scale Integration: Building a MetaQuerier over Databases on the Web 2005 CIDR 6.8139343e-05
6,308 A Dataspace Odyssey: The iMeMex Personal Dataspace Management System 2007 CIDR 5.1126253e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
12,861 Data Integration in the Large: The Challenge of Reuse 1994 VLDB 4.1905499e-05
12,620 Architectural Issues and Solutions in the Development of Data-Intensive Web Applications 2003 CIDR 4.1905499e-05
2,737 Open Data Integration 2018 VLDB 8.2053894e-05
671 An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web 2004 SIGMOD 0.00018370384
6,585 Web Data Management 2011 SIGMOD 4.9975374e-05
1,855 An Analysis of Structured Data on the Web 2012 VLDB 0.00010319508
12,178 Schema-As-You-Go: On Probabilistic Tagging and Querying of Wide Tables 2011 SIGMOD 4.1905499e-05
3,721 Toward Large Scale Integration: Building a MetaQuerier over Databases on the Web 2005 CIDR 6.8139343e-05
12,231 Schema Clustering and Retrieval for Multi-domain Pay-As-You-Go Data Integration Systems 2010 SIGMOD 4.1905499e-05
1,862 Bootstrapping Pay-As-You-Go Data Integration Systems 2008 SIGMOD 0.00010292134