Optimal Algorithms for Crawling a Hidden Database in the Web
Summary: Algorithms to extract all tuples from a hidden web database via a query-only interface, even when results are partial. Provably efficient in the worst case and asymptotically optimal, with extensive experiments on real datasets. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Cheng Sheng
- 2. Nan Zhang
- 3. Yufei Tao
- 4. Xin Jin
Incoming Citations (Sorted by Pagerank)
Showing 6 of 6 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 8,256 | Discovering the Skyline of Web Databases | 2016 | VLDB | 5.5215308e-05 |
| 8,554 | Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment | 2019 | SIGMOD | 5.4726897e-05 |
| 9,440 | Aggregate Estimation Over Dynamic Hidden Web Databases | 2014 | VLDB | 5.3325274e-05 |
| 11,891 | Query Reranking As A Service | 2016 | VLDB | 5.1725247e-05 |
| 12,096 | Rank Discovery From Web Databases | 2013 | VLDB | 5.1725247e-05 |
| 13,424 | HDBTracker: Monitoring the Aggregates On Dynamic Hidden Web Databases | 2014 | VLDB | - |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 10 of 10 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 329 | Crawling the Hidden Web | 2001 | VLDB | 0.00021076269 |
| 758 | Statistical Schema Matching across Web Query Interfaces | 2003 | SIGMOD | 0.00014315559 |
| 1,351 | Google's Deep-Web Crawl | 2008 | VLDB | 0.00011167301 |
| 1,447 | Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection | 2002 | VLDB | 0.00010842505 |
| 2,510 | Understanding Web Query Interfaces: Best-Effort Parsing with Hidden Syntax | 2004 | SIGMOD | 8.5562705e-05 |
| 2,630 | Mining Search Engine Query Logs via Suggestion Sampling | 2008 | VLDB | 8.3888642e-05 |
| 5,467 | A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration | 2009 | VLDB | 6.2755703e-05 |
| 7,311 | Meaningful Labeling of Integrated Query Interfaces | 2006 | VLDB | 5.704179e-05 |
| 8,565 | Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases | 2010 | SIGMOD | 5.4712742e-05 |
| 9,542 | Attribute Domain Discovery for Hidden Web Databases | 2011 | SIGMOD | 5.3165429e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| Overall Rank | Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,334 | Distributed Hypertext Resource Discovery Through Examples | 1999 | VLDB | 7.5707908e-05 |
| 8,256 | Discovering the Skyline of Web Databases | 2016 | VLDB | 5.5215308e-05 |
| 12,309 | Privacy Preservation of Aggregates in Hidden Databases: Why and How? | 2009 | SIGMOD | 5.1725247e-05 |
| 1,351 | Google's Deep-Web Crawl | 2008 | VLDB | 0.00011167301 |
| 5,776 | A Random Walk Approach to Sampling Hidden Databases | 2007 | SIGMOD | 6.1554293e-05 |
| 1,447 | Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection | 2002 | VLDB | 0.00010842505 |
| 8,554 | Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment | 2019 | SIGMOD | 5.4726897e-05 |
| 8,565 | Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases | 2010 | SIGMOD | 5.4712742e-05 |
| 329 | Crawling the Hidden Web | 2001 | VLDB | 0.00021076269 |
| 4,452 | Probe, Count, and Classify: Categorizing Hidden-Web Databases | 2001 | SIGMOD | 6.7509636e-05 |