Optimal Algorithms for Crawling a Hidden Database in the Web
Summary: Algorithms to extract all tuples from a hidden web database via a query-only interface, even when results are partial. Provably efficient in the worst case and asymptotically optimal, with extensive experiments on real datasets. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Cheng Sheng (Chinese University of Hong Kong)
- 2. Nan Zhang (George Washington University)
- 3. Yufei Tao (Chinese University of Hong Kong; Korea Advanced Institute of Science and Technology)
- 4. Xin Jin (George Washington University)
BibTeX Citation
@article{sheng_vldb12,
title = {{Optimal Algorithms for Crawling a Hidden Database in the Web}},
author = {Sheng, Cheng and Zhang, Nan and Tao, Yufei and Jin, Xin},
journal = {PVLDB},
series = {{VLDB} '12},
volume = {5},
number = {11},
pages = {1112--1123},
doi = {10.14778/2350229.2350240},
url = {https://doi.org/10.14778/2350229.2350240},
year = {2012}
}Incoming Citations (Sorted by Pagerank)
Showing 6 of 6 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 8,378 | Discovering the Skyline of Web Databases | 2016 | VLDB | 5.4387677e-05 |
| 8,705 | Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment | 2019 | SIGMOD | 5.3807913e-05 |
| 9,650 | Aggregate Estimation Over Dynamic Hidden Web Databases | 2014 | VLDB | 5.2427667e-05 |
| 12,083 | Query Reranking As A Service | 2016 | VLDB | 5.093636e-05 |
| 12,285 | Rank Discovery From Web Databases | 2013 | VLDB | 5.093636e-05 |
| 13,612 | HDBTracker: Monitoring the Aggregates On Dynamic Hidden Web Databases | 2014 | VLDB | - |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 10 of 10 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 340 | Crawling the Hidden Web | 2001 | VLDB | 0.00020711119 |
| 778 | Statistical Schema Matching across Web Query Interfaces | 2003 | SIGMOD | 0.00014102198 |
| 1,483 | Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection | 2002 | VLDB | 0.00010633832 |
| 1,554 | Google’s Deep-Web Crawl | 2008 | VLDB | 0.00010372108 |
| 2,554 | Understanding Web Query Interfaces: Best-Effort Parsing with Hidden Syntax | 2004 | SIGMOD | 8.4252755e-05 |
| 2,683 | Mining Search Engine Query Logs via Suggestion Sampling | 2008 | VLDB | 8.2608808e-05 |
| 5,545 | A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration | 2009 | VLDB | 6.1795204e-05 |
| 7,442 | Meaningful Labeling of Integrated Query Interfaces | 2006 | VLDB | 5.6171595e-05 |
| 8,671 | Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases | 2010 | SIGMOD | 5.3876663e-05 |
| 9,684 | Attribute Domain Discovery for Hidden Web Databases | 2011 | SIGMOD | 5.2352357e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,383 | Distributed Hypertext Resource Discovery Through Examples | 1999 | VLDB |
| 2 | 8,378 | Discovering the Skyline of Web Databases | 2016 | VLDB |
| 3 | 12,495 | Privacy Preservation of Aggregates in Hidden Databases: Why and How? | 2009 | SIGMOD |
| 4 | 1,554 | Google’s Deep-Web Crawl | 2008 | VLDB |
| 5 | 5,868 | A Random Walk Approach to Sampling Hidden Databases | 2007 | SIGMOD |
| 6 | 1,483 | Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection | 2002 | VLDB |
| 7 | 8,705 | Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment | 2019 | SIGMOD |
| 8 | 8,671 | Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases | 2010 | SIGMOD |
| 9 | 340 | Crawling the Hidden Web | 2001 | VLDB |
| 10 | 4,524 | Probe, Count, and Classify: Categorizing Hidden-Web Databases | 2001 | SIGMOD |