Database Paper Browser

Back to papers

Progressive Deep Web Crawling Through Keyword Queries For Data Enrichment

Summary: SmartCrawl enables progressive deep-web crawling via keyword queries to enrich a local database under top-k and query-budget limits. It constructs a local data-driven query pool and iteratively issues high-benefit queries to maximize coverage, addressing ΔD and top-k effects with novel benefit estimation and optimizations. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
5712
Venue
SIGMOD
Year
2019
Pagerank
4.4659264e-05
Overall Rank
8,674 | 39.72%
DOI
10.1145/3299869.3319899

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank Citing Paper Year Venue Pagerank
8,121 LakeBench: A Benchmark for Discovering Joinable and Unionable Tables in Data Lakes 2024 VLDB 4.5771143e-05
8,692 Effective Entity Augmentation By Querying External Data Sources 2023 VLDB 4.4617233e-05
9,278 ActiveDeeper: A Model-based Active Data Enrichment System 2020 VLDB 4.3607776e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
182 Mining Frequent Patterns without Candidate Generation 2000 SIGMOD 0.00036955562
233 Crawling the Hidden Web 2001 VLDB 0.00031996412
420 InfoGather: Entity Augmentation and Attribute Discovery By Holistic Matching with Web Tables 2012 SIGMOD 0.00023700634
519 Data Integration for the Relational Web 2009 VLDB 0.00021148006
671 An Interactive Clustering-based Approach to Integrating Source Query Interfaces on the Deep Web 2004 SIGMOD 0.00018370384
814 Finding Related Tables 2012 SIGMOD 0.00016298739
1,370 Answering Table Queries on the Web using Column Keywords 2012 VLDB 0.00012339543
1,403 Detecting Data Errors: Where are we and what needs to be done? 2016 VLDB 0.00012180046
1,486 Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection 2002 VLDB 0.00011691409
1,538 Google's Deep-Web Crawl 2008 VLDB 0.00011455291
3,232 InfoGather+: Semantic Matching and Annotation of Numeric and Time-Varying Attributes in Web Tables 2013 SIGMOD 7.3324293e-05
3,721 Toward Large Scale Integration: Building a MetaQuerier over Databases on the Web 2005 CIDR 6.8139343e-05
5,141 A Random Walk Approach to Sampling Hidden Databases 2007 SIGMOD 5.6627467e-05
7,890 Mining a Search Engine’s Corpus: Efficient Yet Unbiased Sampling and Aggregate Estimation 2011 SIGMOD 4.6205184e-05
8,680 Unbiased Estimation of Size and Other Aggregates Over Hidden Web Databases 2010 SIGMOD 4.4634799e-05
9,549 Optimal Algorithms for Crawling a Hidden Database in the Web 2012 VLDB 4.3216687e-05
9,550 Attribute Domain Discovery for Hidden Web Databases 2011 SIGMOD 4.3216687e-05
11,728 Deeper: A Data Enrichment System Powered by Deep Web 2018 SIGMOD 4.1905499e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
409 Focused Crawling Using Context Graphs 2000 VLDB 0.00023928618
12,239 Optimizing Content Freshness of Relations Extracted From the Web Using Keyword Search 2010 SIGMOD 4.1905499e-05
1,486 Distributed Search over the Hidden Web: Hierarchical Database Sampling and Selection 2002 VLDB 0.00011691409
9,438 Exploration of Deep Web Repositories 2011 VLDB 4.3390134e-05
233 Crawling the Hidden Web 2001 VLDB 0.00031996412
7,767 Accurate and Efficient Crawling for Relevant Websites 2004 VLDB 4.6525495e-05
3,956 Probe, Count, and Classify: Categorizing Hidden-Web Databases 2001 SIGMOD 6.5891156e-05
1,538 Google's Deep-Web Crawl 2008 VLDB 0.00011455291
11,728 Deeper: A Data Enrichment System Powered by Deep Web 2018 SIGMOD 4.1905499e-05
9,549 Optimal Algorithms for Crawling a Hidden Database in the Web 2012 VLDB 4.3216687e-05