DBScholar

Back to papers

Crawling the Hidden Web

Summary: Proposes a hidden Web crawler model and HiWE (Hidden Web Exposer) for extracting content behind search forms and logins. Introduces LITE, a layout-based extraction technique to semantically parse forms and result pages, with experimental validation. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
he23e399a5576d209
Venue
VLDB
Year
2001
Pagerank
0.00020252678
Overall Rank
348 | 97.67%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{raghavan_vldb01,
        title = {{Crawling the Hidden Web}},
        author = {Raghavan, Sriram and Garcia-Molina, Hector},
        journal = {PVLDB},
        series = {{VLDB} '01},
        year = {2001}
}

Incoming Citations (Sorted by Pagerank)

Showing 32 of 32 citing papers.

Rank Citing Paper Year Venue Pagerank
815 An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web 2004 SIGMOD 0.00013713173
992 Web-scale Data Integration: You can only afford to Pay As You Go 2007 CIDR 0.00012641942
1,505 Generic Schema Matching, Ten Years Later 2011 VLDB 0.00010449986
1,582 Google’s Deep-Web Crawl 2008 VLDB 0.00010168682
2,327 Partial Results for Online Query Processing 2002 SIGMOD 8.6271354e-05
2,419 Instance-based Schema Matching for Web Databases by Domain-specific Query Probing 2004 VLDB 8.4890861e-05
2,602 Understanding Web Query Interfaces: Best-Effort Parsing with Hidden Syntax 2004 SIGMOD 8.2325116e-05
2,662 WISE-Integrator: An Automatic Integrator of Web Search Interfaces for E-Commerce 2003 VLDB 8.1565356e-05
3,033 Entity Search Engine: Towards Agile Best-Effort Information Integration over the Web 2007 CIDR 7.7315971e-05
3,253 Computing PageRank in a Distributed Internet Search System 2004 VLDB 7.4894399e-05
3,589 Using the Structure of Web Sites for Automatic Segmentation of Tables 2004 SIGMOD 7.1837396e-05
4,551 Harnessing the Deep Web: Present and Future 2009 CIDR 6.5380754e-05
5,679 A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration 2009 VLDB 6.0381177e-05
5,860 RankMass Crawler: A Crawler with High Personalized PageRank Coverage Guarantee 2007 VLDB 5.9654785e-05
5,985 A Random Walk Approach to Sampling Hidden Databases 2007 SIGMOD 5.9233486e-05
7,778 Predicate-based Indexing of Enterprise Web Applications 2007 CIDR 5.4528941e-05
8,554 Discovering the Skyline of Web Databases 2016 VLDB 5.3146691e-05
8,744 Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment 2019 SIGMOD 5.287931e-05
8,842 Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases 2010 SIGMOD 5.2651524e-05
8,878 WISE-Integrator: A System for Extracting and Integrating Complex Web Search Interfaces of the Deep Web 2005 VLDB 5.2578365e-05
9,208 Learning to Extract Form Labels 2008 VLDB 5.2063337e-05
9,832 Aggregate Estimation Over Dynamic Hidden Web Databases 2014 VLDB 5.1227072e-05
9,863 Optimal Algorithms for Crawling a Hidden Database in the Web 2012 VLDB 5.1161474e-05
9,864 Attribute Domain Discovery for Hidden Web Databases 2011 SIGMOD 5.1161474e-05
12,382 Query Reranking As A Service 2016 VLDB 4.9769913e-05
12,582 Rank Discovery From Web Databases 2013 VLDB 4.9769913e-05
12,681 Randomized Generalization for Aggregate Suppression Over Hidden Web Databases 2011 VLDB 4.9769913e-05
12,723 Optimizing Content Freshness of Relations Extracted From the Web Using Keyword Search 2010 SIGMOD 4.9769913e-05
12,816 Kosmix: High-Performance Topic Exploration using the Deep Web 2009 VLDB 4.9769913e-05
13,014 Automatic Extraction of Dynamic Record Sections From Search Engine Result Pages 2006 VLDB 4.9769913e-05
13,079 An Automatic Data Grabber for Large Web Sites 2004 VLDB 4.9769913e-05
13,123 From Focused Crawling to Expert Information: an Application Framework for Web Exploration and Portal Generation 2003 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1,266 Focused Crawling Using Context Graphs 2000 VLDB 0.00011267736
1,639 Synchronizing a database to Improve Freshness 2000 SIGMOD 0.00010007329
7,684 The Evolution of the Web and Implications for an Incremental Crawler 2000 VLDB 5.4746904e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 5,679 A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration 2009 VLDB
2 14,325 A Method of Re-ranking Web Search Results Using their Hidden Hyperlink Structure 2002 VLDB
3 1,517 Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection 2002 VLDB
4 1,266 Focused Crawling Using Context Graphs 2000 VLDB
5 4,551 Harnessing the Deep Web: Present and Future 2009 CIDR
6 8,744 Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment 2019 SIGMOD
7 8,342 Accurate and Efficient Crawling for Relevant Websites 2004 VLDB
8 4,612 Probe, Count, and Classify: Categorizing Hidden-Web Databases 2001 SIGMOD
9 1,582 Google’s Deep-Web Crawl 2008 VLDB
10 9,863 Optimal Algorithms for Crawling a Hidden Database in the Web 2012 VLDB