Harnessing the Deep Web: Present and Future

Summary: Google deployment comparing VI (per-site mediated schemas) vs surfacing (precomputed form submissions) to expose Deep Web content. Surfacing scales for web search; VI better for verticals; open problems: routing, form semantics, preserving structure. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 111
Venue: CIDR
Year: 2009
Pagerank: 6.6813981e-05
Overall Rank: 4,471 | 69.33%
DOI: -

Incoming Non-self Citations Over Time

Authors

1. Jayant Madhavan (Google)
2. Loredana Afanasiev (University of Amsterdam)
3. Lyublena Antova (Cornell University)
4. Alon Halevy (Google)

BibTeX Citation

@inproceedings{madhavan_cidr09,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '09},
        title = {{Harnessing the Deep Web: Present and Future}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Madhavan, Jayant and Afanasiev, Loredana and Antova, Lyublena and Halevy, Alon},
        year = {2009}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,873	A Web of Concepts	2009	PODS	9.5751398e-05
2,096	An Analysis of Structured Data on the Web	2012	VLDB	9.1746663e-05
2,322	Extraction and Integration of Partially Overlapping Web Sources	2013	VLDB	8.7526172e-05
3,340	Automatic Wrappers for Large Scale Web Extraction	2011	VLDB	7.5040045e-05
6,573	Web Data Management	2011	SIGMOD	5.8371536e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
91	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00034838835
117	Querying Heterogeneous Information Sources Using Source Descriptions	1996	VLDB	0.00032192665
340	Crawling the Hidden Web	2001	VLDB	0.00020711119
778	Statistical Schema Matching across Web Query Interfaces	2003	SIGMOD	0.00014102198
791	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD	0.00013995705
969	Web-scale Data Integration: You can only afford to Pay As You Go	2007	CIDR	0.00012892148
1,483	Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection	2002	VLDB	0.00010633832
1,554	Google’s Deep-Web Crawl	2008	VLDB	0.00010372108
1,649	Bootstrapping Pay-As-You-Go Data Integration Systems	2008	SIGMOD	0.00010117306

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,483	Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection	2002	VLDB
2	11,927	Deeper: A Data Enrichment System Powered by Deep Web	2018	SIGMOD
3	8,705	Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment	2019	SIGMOD
4	5,545	A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration	2009	VLDB
5	2,916	Knocking the Door to the Deep Web: Integrating Web Query Interfaces	2004	SIGMOD
6	9,651	Exploration of Deep Web Repositories	2011	VLDB
7	12,435	Creating and Exploring Web Form Repositories	2010	SIGMOD
8	340	Crawling the Hidden Web	2001	VLDB
9	791	An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web	2004	SIGMOD
10	1,554	Google’s Deep-Web Crawl	2008	VLDB