Optimal Algorithms for Crawling a Hidden Database in the Web
Summary: Algorithms to extract all tuples from a hidden web database via a query-only interface, even when results are partial. Provably efficient in the worst case and asymptotically optimal, with extensive experiments on real datasets. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Cheng Sheng (Chinese University of Hong Kong)
- 2. Nan Zhang (George Washington University)
- 3. Yufei Tao (Chinese University of Hong Kong; Korea Advanced Institute of Science and Technology)
- 4. Xin Jin (George Washington University)
BibTeX Citation
@article{sheng_vldb12,
title = {{Optimal Algorithms for Crawling a Hidden Database in the Web}},
author = {Sheng, Cheng and Zhang, Nan and Tao, Yufei and Jin, Xin},
journal = {PVLDB},
series = {{VLDB} '12},
volume = {5},
number = {11},
pages = {1112--1123},
doi = {10.14778/2350229.2350240},
url = {https://doi.org/10.14778/2350229.2350240},
year = {2012}
}Incoming Citations (Sorted by Pagerank)
Showing 6 of 6 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 8,554 | Discovering the Skyline of Web Databases | 2016 | VLDB | 5.3146691e-05 |
| 8,744 | Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment | 2019 | SIGMOD | 5.287931e-05 |
| 9,832 | Aggregate Estimation Over Dynamic Hidden Web Databases | 2014 | VLDB | 5.1227072e-05 |
| 12,382 | Query Reranking As A Service | 2016 | VLDB | 4.9769913e-05 |
| 12,582 | Rank Discovery From Web Databases | 2013 | VLDB | 4.9769913e-05 |
| 13,930 | HDBTracker: Monitoring the Aggregates On Dynamic Hidden Web Databases | 2014 | VLDB | - |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 10 of 10 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 348 | Crawling the Hidden Web | 2001 | VLDB | 0.00020252678 |
| 801 | Statistical Schema Matching across Web Query Interfaces | 2003 | SIGMOD | 0.00013866905 |
| 1,517 | Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection | 2002 | VLDB | 0.00010395336 |
| 1,582 | Google’s Deep-Web Crawl | 2008 | VLDB | 0.00010168682 |
| 2,602 | Understanding Web Query Interfaces: Best-Effort Parsing with Hidden Syntax | 2004 | SIGMOD | 8.2325116e-05 |
| 2,736 | Mining Search Engine Query Logs via Suggestion Sampling | 2008 | VLDB | 8.0720125e-05 |
| 5,679 | A Hierarchical Approach to Model Web Query Interfaces for Web Source Integration | 2009 | VLDB | 6.0381177e-05 |
| 7,587 | Meaningful Labeling of Integrated Query Interfaces | 2006 | VLDB | 5.488606e-05 |
| 8,842 | Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases | 2010 | SIGMOD | 5.2651524e-05 |
| 9,864 | Attribute Domain Discovery for Hidden Web Databases | 2011 | SIGMOD | 5.1161474e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,347 | Distributed Hypertext Resource Discovery Through Examples | 1999 | VLDB |
| 2 | 8,554 | Discovering the Skyline of Web Databases | 2016 | VLDB |
| 3 | 12,791 | Privacy Preservation of Aggregates in Hidden Databases: Why and How? | 2009 | SIGMOD |
| 4 | 1,582 | Google’s Deep-Web Crawl | 2008 | VLDB |
| 5 | 5,985 | A Random Walk Approach to Sampling Hidden Databases | 2007 | SIGMOD |
| 6 | 1,517 | Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection | 2002 | VLDB |
| 7 | 8,744 | Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment | 2019 | SIGMOD |
| 8 | 8,842 | Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases | 2010 | SIGMOD |
| 9 | 348 | Crawling the Hidden Web | 2001 | VLDB |
| 10 | 4,612 | Probe, Count, and Classify: Categorizing Hidden-Web Databases | 2001 | SIGMOD |