Harnessing the Deep Web: Present and Future

Summary: Google deployment comparing VI (per-site mediated schemas) vs surfacing (precomputed form submissions) to expose Deep Web content. Surfacing scales for web search; VI better for verticals; open problems: routing, form semantics, preserving structure. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: h563d6fed0da3591e
Venue: CIDR
Year: 2009
Pagerank: 6.5170432e-05
Overall Rank: 4,569 | 69.38%
DOI: -
PDF: Download (CC BY 3.0)

Incoming Non-self Citations Over Time

Authors

1. Jayant Madhavan (Google)
2. Loredana Afanasiev (University of Amsterdam)
3. Lyublena Antova (Cornell University)
4. Alon Halevy (Google)

BibTeX Citation

@inproceedings{madhavan_cidr09,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '09},
        title = {{Harnessing the Deep Web: Present and Future}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Madhavan, Jayant and Afanasiev, Loredana and Antova, Lyublena and Halevy, Alon},
        year = {2009}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,927	A Web of Concepts	2009	PODS	9.3492587e-05
2,135	An Analysis of Structured Data on the Web	2012	VLDB	8.9793548e-05
2,265	Extraction and Integration of Partially Overlapping Web Sources	2013	VLDB	8.7205552e-05
3,405	Automatic Wrappers for Large Scale Web Extraction	2011	VLDB	7.3163069e-05
6,715	Web Data Management	2011	SIGMOD	5.6846475e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
88	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00035500667
117	Querying Heterogeneous Information Sources Using Source Descriptions	1996	VLDB	0.00031526277
349	Crawling the Hidden Web	2001	VLDB	0.0002018926
800	Statistical Schema Matching across Web Query Interfaces	2003	SIGMOD	0.00013834019
816	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD	0.00013671567
994	Web-scale Data Integration: You can only afford to Pay As You Go	2007	CIDR	0.00012610224
1,519	Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection	2002	VLDB	0.0001036122
1,584	Google’s Deep-Web Crawl	2008	VLDB	0.00010136933
1,673	Bootstrapping Pay-As-You-Go Data Integration Systems	2008	SIGMOD	9.9018228e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,519	Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection	2002	VLDB
2	12,275	Deeper: A Data Enrichment System Powered by Deep Web	2018	SIGMOD
3	8,763	Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment	2019	SIGMOD
4	5,692	A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration	2009	VLDB
5	2,906	Knocking the Door to the Deep Web: Integrating Web Query Interfaces	2004	SIGMOD
6	9,866	Exploration of Deep Web Repositories	2011	VLDB
7	12,775	Creating and Exploring Web Form Repositories	2010	SIGMOD
8	349	Crawling the Hidden Web	2001	VLDB
9	816	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD
10	1,584	Google’s Deep-Web Crawl	2008	VLDB