Efficient Estimation of Inclusion Coefficient using HyperLogLog Sketches
Summary: Introduces BML, an HLL-based estimator for column inclusion coefficients that substantially improves accuracy over Bottom-k sketches for profiling and foreign-key discovery. Also enables deletion-aware incremental HLL maintenance with constant extra memory. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Azade Nazi (Microsoft)
- 2. Bolin Ding (Microsoft)
- 3. Vivek Narasayya (Microsoft)
- 4. Surajit Chaudhuri (Microsoft)
BibTeX Citation
@article{nazi_vldb18,
title = {{Efficient Estimation of Inclusion Coefficient using HyperLogLog Sketches}},
author = {Nazi, Azade and Ding, Bolin and Narasayya, Vivek and Chaudhuri, Surajit},
journal = {PVLDB},
series = {{VLDB} '18},
volume = {11},
number = {10},
pages = {1097--1109},
doi = {10.14778/3231751.3231759},
url = {https://doi.org/10.14778/3231751.3231759},
year = {2018}
}Incoming Citations (Sorted by Pagerank)
Showing 4 of 4 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,215 | Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates | 2019 | CIDR | 7.6324234e-05 |
| 5,864 | SetSketch: Filling the Gap between MinHash and HyperLogLog | 2021 | VLDB | 6.0619574e-05 |
| 6,121 | The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward | 2021 | VLDB | 5.9688569e-05 |
| 6,920 | UltraLogLog: A Practical and More Space-Efficient Alternative to HyperLogLog for Approximate Distinct Counting | 2024 | VLDB | 5.7390922e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 30 | SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets | 2008 | VLDB | 0.00051174276 |
| 689 | On Synopses for Distinct-Value Estimation Under Multiset Operations | 2007 | SIGMOD | 0.00014940023 |
| 1,374 | Data Profiling with Metanome | 2015 | VLDB | 0.00010986078 |
| 1,521 | On Multi-Column Foreign Key Discovery | 2010 | VLDB | 0.00010506299 |
| 3,795 | Is Min-Wise Hashing Optimal for Summarizing Set Intersection? | 2014 | PODS | 7.1200458e-05 |
| 4,386 | Divide & Conquer-based Inclusion Dependency Discovery | 2015 | VLDB | 6.7309577e-05 |
| 5,099 | Fast Foreign-Key Detection in Microsoft SQL Server PowerPivot for Excel | 2014 | VLDB | 6.3646928e-05 |
Previous
Page 1 / 1
Next