DBScholar

Back to papers

Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning

Summary: Starmie enables table-union discovery with unsupervised contrastive, multi-column contextual encoders that learn semantic column representations from pretrained language models. Filter-and-verify scoring plus HNSW indexing improves retrieval effectiveness and delivers up to 3,000× speedups. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
13219
Venue
VLDB
Year
2023
Pagerank
8.9767241e-05
Overall Rank
2,192 | 84.97%
DOI
10.14778/3587136.3587146

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{fan_vldb23,
        title = {{Semantics-aware Dataset Discovery from Data Lakes with Contextualized Column-based Representation Learning}},
        author = {Fan, Grace and Wang, Jin and Li, Yuliang and Zhang, Dan and Miller, Renée J.},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {7},
        pages = {1726--1739},
        doi = {10.14778/3587136.3587146},
        url = {https://doi.org/10.14778/3587136.3587146},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank Citing Paper Year Venue Pagerank
4,123 Integrating Data Lake Tables 2023 VLDB 6.8878137e-05
5,220 Databases Unbound: Querying All of the World’s Bytes with AI 2024 VLDB 6.3108362e-05
5,293 Magneto: Combining Small and Large Language Models for Schema Matching 2025 VLDB 6.279939e-05
7,501 TableDC: Deep Clustering for Tabular Data 2025 SIGMOD 5.6029996e-05
7,613 LakeCompass: An End-to-End System for Data Maintenance, Search and Analysis in Data Lakes 2024 VLDB 5.5817761e-05
7,893 LakeBench: A Benchmark for Discovering Joinable and Unionable Tables in Data Lakes 2024 VLDB 5.5209866e-05
8,860 Watchog: A Light-weight Contrastive Learning based Framework for Column Annotation 2023 SIGMOD 5.3564029e-05
9,065 R2D2: Reducing Redundancy and Duplication in Data Lakes 2023 SIGMOD 5.3251649e-05
9,972 Cents: A Flexible and Cost-Effective Framework for LLM-Based Table Understanding 2025 VLDB 5.1845938e-05
10,109 QueryArtisan: Generating Data Manipulation Codes for Ad-hoc Analysis in Data Lakes 2025 VLDB 5.1347137e-05
10,287 Shape-Agnostic Table Overlap Discovery: A Maximum Common Subhypergraph Approach 2026 SIGMOD 5.093636e-05
10,399 Retrieve-and-Verify: A Table Context Selection Framework for Accurate Column Annotations 2026 SIGMOD 5.093636e-05
10,457 FlowPilot: A Suggestion System for Designing Scientific Workflows 2026 SIGMOD 5.093636e-05
10,486 Qualitative Join Discovery in Data Lakes using Examples 2026 SIGMOD 5.093636e-05
10,783 Table Overlap Estimation through Graph Embeddings 2025 SIGMOD 5.093636e-05
10,850 Birdie: Natural Language-Driven Table Discovery Using Differentiable Search Index 2025 VLDB 5.093636e-05
10,933 LakeVisage: Towards Scalable, Flexible and Interactive Visualization Recommendation for Data Discovery over Data Lakes 2025 VLDB 5.093636e-05
10,987 OmniMatch: Joinability Discovery in Data Products 2025 VLDB 5.093636e-05
11,050 TableCopilot: A Table Assistant Empowered by Natural Language Conditional Table Discovery 2025 VLDB 5.093636e-05
11,062 Data Discovery in Data Lakes: Operations, Indexes, Systems 2025 VLDB 5.093636e-05
11,066 ML-Asset Management: Curation, Discovery, and Utilization 2025 VLDB 5.093636e-05
11,068 Panel on Neural Relational Data: Tabular Foundation Models, LLMs... or both? 2025 VLDB 5.093636e-05
11,262 Enriching Relations with Additional Attributes for ER 2024 VLDB 5.093636e-05
11,270 Searching Data Lakes for Nested and Joined Data 2024 VLDB 5.093636e-05
11,303 Navigating Data Repositories: Utilizing Line Charts to Discover Relevant Datasets 2024 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
21 Similarity Search in High Dimensions via Hashing 1999 VLDB 0.00056760516
91 WebTables: Exploring the Power of Tables on the Web 2008 VLDB 0.00034838835
141 Deep Entity Matching with Pre-Trained Language Models 2021 VLDB 0.0002964847
317 Annotating and Searching Web Tables Using Entities, Types and Relationships 2010 VLDB 0.00021402049
367 InfoGather: Entity Augmentation and Attribute Discovery By Holistic Matching with Web Tables 2012 SIGMOD 0.00019979463
397 TURL: Table Understanding through Representation Learning 2021 VLDB 0.00019278189
493 Data Integration for the Relational Web 2009 VLDB 0.00017558709
739 Finding Related Tables 2012 SIGMOD 0.0001448231
749 Data Lake Management: Challenges and Opportunities 2019 VLDB 0.00014379989
753 Recovering Semantics of Tables on the Web 2011 VLDB 0.00014336094
779 JOSIE: Overlap Set Similarity Search for Finding Joinable Tables in Data Lakes 2019 SIGMOD 0.00014092047
878 Table Union Search on Open Data 2018 VLDB 0.00013463374
1,303 Finding Related Tables in Data Lakes for Interactive Data Science 2020 SIGMOD 0.0001123653
1,402 Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks 2020 SIGMOD 0.00010888094
1,447 Auctus: A Dataset Search Engine for Data Discovery and Augmentation 2021 VLDB 0.00010760327
1,495 LSH Ensemble: Internet-Scale Domain Search 2016 VLDB 0.00010571481
1,923 Annotating Columns with Pre-trained Language Models 2022 SIGMOD 9.4789109e-05
2,216 Open Data Integration 2018 VLDB 8.9374127e-05
2,223 Sato: Contextual Semantic Type Detection in Tables 2020 VLDB 8.9189986e-05
2,315 SANTOS: Relationship-based Semantic Table Union Search 2023 SIGMOD 8.7605101e-05
2,415 Schema Extraction for Tabular Data on the Web 2013 VLDB 8.6069635e-05
3,301 Stitching Web Tables for Improving Matching Quality 2017 VLDB 7.5408662e-05
4,123 Integrating Data Lake Tables 2023 VLDB 6.8878137e-05
4,201 CLAMS: Bringing Quality to Data Lakes 2016 SIGMOD 6.8355878e-05
4,735 Leva: Boosting Machine Learning Performance with Relational Embedding Data Augmentation 2022 SIGMOD 6.5315782e-05
5,125 Data-Driven Domain Discovery for Structured Datasets 2020 VLDB 6.356638e-05
8,144 WarpGate: A Semantic Join Discovery System for Cloud Data Warehouses 2023 CIDR 5.4800625e-05
Previous Page 1 / 1 Next

Semantically Similar Papers