Efficient Estimation of Inclusion Coefficient using HyperLogLog Sketches
Summary: Introduces BML, an HLL-based estimator for column inclusion coefficients that substantially improves accuracy over Bottom-k sketches for profiling and foreign-key discovery. Also enables deletion-aware incremental HLL maintenance with constant extra memory. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Azade Nazi (Microsoft)
- 2. Bolin Ding (Microsoft)
- 3. Vivek Narasayya (Microsoft)
- 4. Surajit Chaudhuri (Microsoft)
BibTeX Citation
@article{nazi_vldb18,
title = {{Efficient Estimation of Inclusion Coefficient using HyperLogLog Sketches}},
author = {Nazi, Azade and Ding, Bolin and Narasayya, Vivek and Chaudhuri, Surajit},
journal = {PVLDB},
series = {{VLDB} '18},
volume = {11},
number = {10},
pages = {1097--1109},
doi = {10.14778/3231751.3231759},
url = {https://doi.org/10.14778/3231751.3231759},
year = {2018}
}
Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,132 | Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates | 2019 | CIDR | 7.6107287e-05 |
| 5,987 | SetSketch: Filling the Gap between MinHash and HyperLogLog | 2021 | VLDB | 5.9231381e-05 |
| 6,248 | The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward | 2021 | VLDB | 5.8345657e-05 |
| 7,055 | UltraLogLog: A Practical and More Space-Efficient Alternative to HyperLogLog for Approximate Distinct Counting | 2024 | VLDB | 5.6097402e-05 |
| 10,926 | No Silver Bullet: Boosting GaussDB Performance on the 30TB TPC-H Workload | 2026 | VLDB | 4.9769913e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 30 | SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets | 2008 | VLDB | 0.00050475202 |
| 707 | On Synopses for Distinct-Value Estimation Under Multiset Operations | 2007 | SIGMOD | 0.00014633741 |
| 1,394 | Data Profiling with Metanome | 2015 | VLDB | 0.00010791559 |
| 1,533 | On Multi-Column Foreign Key Discovery | 2010 | VLDB | 0.00010328081 |
| 3,859 | Is Min-Wise Hashing Optimal for Summarizing Set Intersection? | 2014 | PODS | 6.9644179e-05 |
| 4,247 | Divide & Conquer-based Inclusion Dependency Discovery | 2015 | VLDB | 6.703008e-05 |
| 5,138 | Fast Foreign-Key Detection in Microsoft SQL Server PowerPivot for Excel | 2014 | VLDB | 6.2561301e-05 |
Previous
Page 1 / 1
Next