Web Page Language Identification Based on URLs

Summary: URL-only language identification for uncrawled pages, combining URL features with ML to reduce crawler downloads and meet language quotas. Across five European languages, achieves ~0.90 F-measure (up to .96), outperforming humans and ccTLD-only baselines. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 9858
Venue: VLDB
Year: 2008
Pagerank: -
Overall Rank: 13,770 | 5.53%
DOI: 10.14778/1453856.1453880

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Eda Baykan (EPFL)
2. Monika Henzinger (EPFL; Google)
3. Ingmar Weber (EPFL)

BibTeX Citation

@article{baykan_vldb08,
        title = {{Web Page Language Identification Based on URLs}},
        author = {Baykan, Eda and Henzinger, Monika and Weber, Ingmar},
        journal = {PVLDB},
        series = {{VLDB} '08},
        pages = {176},
        doi = {10.14778/1453856.1453880},
        url = {https://doi.org/10.14778/1453856.1453880},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,031	Learning to Extract Form Labels	2008	VLDB
2	12,045	Potential and Pitfalls of Domain-Specific Information Extraction at Web Scale	2016	SIGMOD
3	588	Extracting Structured Data from Web Pages	2003	SIGMOD
4	3,523	Using the Structure of Web Sites for Automatic Segmentation of Tables	2004	SIGMOD
5	7,811	The Smallest Extraction Problem	2021	VLDB
6	12,783	An Automatic Data Grabber for Large Web Sites	2004	VLDB
7	4,220	Multilingual Schema Matching for Wikipedia Infoboxes	2012	VLDB
8	12,884	Toward Learning Based Web Query Processing	2000	VLDB
9	11,455	Self-Training for Label-Efficient Information Extraction from Semi-Structured Web-Pages	2023	VLDB
10	8,166	Accurate and Efficient Crawling for Relevant Websites	2004	VLDB