Efficient Estimation of Inclusion Coefficient using HyperLogLog Sketches
Summary: Introduces BML, an HLL-based estimator for column inclusion coefficients that substantially improves accuracy over Bottom-k sketches for profiling and foreign-key discovery. Also enables deletion-aware incremental HLL maintenance with constant extra memory. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Azade Nazi (Microsoft)
- 2. Bolin Ding (Microsoft)
- 3. Vivek Narasayya (Microsoft)
- 4. Surajit Chaudhuri (Microsoft)
BibTeX Citation
@article{nazi_vldb18,
title = {{Efficient Estimation of Inclusion Coefficient using HyperLogLog Sketches}},
author = {Nazi, Azade and Ding, Bolin and Narasayya, Vivek and Chaudhuri, Surajit},
journal = {PVLDB},
series = {{VLDB} '18},
volume = {11},
number = {10},
pages = {1097--1109},
doi = {10.14778/3231751.3231759},
url = {https://doi.org/10.14778/3231751.3231759},
year = {2018}
}
Incoming Citations (Sorted by Pagerank)
Showing 5 of 5 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,131 | Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates | 2019 | CIDR | 7.6141006e-05 |
| 5,987 | SetSketch: Filling the Gap between MinHash and HyperLogLog | 2021 | VLDB | 5.9259433e-05 |
| 6,245 | The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward | 2021 | VLDB | 5.837329e-05 |
| 7,061 | UltraLogLog: A Practical and More Space-Efficient Alternative to HyperLogLog for Approximate Distinct Counting | 2024 | VLDB | 5.6103223e-05 |
| 10,917 | No Silver Bullet: Boosting GaussDB Performance on the 30TB TPC-H Workload | 2026 | VLDB | 4.9793485e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 30 | SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets | 2008 | VLDB | 0.00050495102 |
| 707 | On Synopses for Distinct-Value Estimation Under Multiset Operations | 2007 | SIGMOD | 0.00014640173 |
| 1,395 | Data Profiling with Metanome | 2015 | VLDB | 0.00010794808 |
| 1,532 | On Multi-Column Foreign Key Discovery | 2010 | VLDB | 0.00010332696 |
| 3,858 | Is Min-Wise Hashing Optimal for Summarizing Set Intersection? | 2014 | PODS | 6.9676872e-05 |
| 4,246 | Divide & Conquer-based Inclusion Dependency Discovery | 2015 | VLDB | 6.7061689e-05 |
| 5,135 | Fast Foreign-Key Detection in Microsoft SQL Server PowerPivot for Excel | 2014 | VLDB | 6.2587553e-05 |
Previous
Page 1 / 1
Next