Effective Use of Block-Level Sampling in Statistics Estimation

Summary: Block-level sampling is efficient but error-prone for statistics. Proposes a two-phase adaptive histogram algorithm using a phase-1 sample and a subset-extraction technique to adapt estimators to block-level distinct-value data; experiments show accuracy and speed gains. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 3588
Venue: SIGMOD
Year: 2004
Pagerank: 9.7112151e-05
Overall Rank: 1,806 | 87.62%
DOI: 10.1145/1007568.1007602

Incoming Non-self Citations Over Time

Authors

1. Surajit Chaudhuri (Microsoft)
2. Gautam Das (Microsoft)
3. Utkarsh Srivastava (Stanford University)

BibTeX Citation

@inproceedings{chaudhuri_sigmod04,
        title = {{Effective Use of Block-Level Sampling in Statistics Estimation}},
        author = {Chaudhuri, Surajit and Das, Gautam and Srivastava, Utkarsh},
        series = {{SIGMOD} '04},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1007568.1007602},
        url = {https://dl.acm.org/doi/10.1145/1007568.1007602},
        year = {2004}
}

Incoming Citations (Sorted by Pagerank)

Showing 16 of 16 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
347	Tuning Database Configuration Parameters with iTuned	2009	VLDB	0.00020651582
866	Pay-as-you-go User Feedback for Dataspace Systems	2008	SIGMOD	0.00013519288
2,308	Hashed Samples: Selectivity Estimators For Set Similarity Selection Queries	2008	VLDB	8.7738996e-05
3,096	Early Accurate Results for Advanced Analytics on MapReduce	2012	VLDB	7.7629371e-05
3,930	Data Canopy: Accelerating Exploratory Statistical Analysis	2017	SIGMOD	7.0102082e-05
4,481	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	6.6754521e-05
5,477	PolarDB-IMCI: A Cloud-Native HTAP Database System at Alibaba	2023	SIGMOD	6.2051869e-05
5,676	Scalable Progressive Analytics on Big Data in the Cloud	2013	VLDB	6.1251441e-05
5,743	Joins on Samples: A Theoretical Guide for Practitioners	2020	VLDB	6.1025457e-05
5,868	A Random Walk Approach to Sampling Hidden Databases	2007	SIGMOD	6.0613238e-05
5,983	Adaptive and Robust Query Execution for Lakehouses at Scale	2024	VLDB	6.0206841e-05
6,827	Sampling Dirty Data for Matching Attributes	2010	SIGMOD	5.7616041e-05
7,866	Dscaler: Synthetically Scaling A Given Relational Database	2016	VLDB	5.5281143e-05
8,161	LAQy: Efficient and Reusable Query Approximations via Lazy Sampling	2023	SIGMOD	5.4752972e-05
8,850	Learning-based Property Estimation with Polynomials	2024	SIGMOD	5.3577504e-05
10,774	PLM4NDV: Minimizing Data Access for Number of Distinct Values Estimation with Pre-trained Language Models	2025	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
35	Improved Histograms for Selectivity Estimation of Range Predicates	1996	SIGMOD	0.00048481081
36	Accurate Estimation Of The Number Of Tuples Satisfying A Condition	1984	SIGMOD	0.00048351457
55	Statistical Estimators for Relational Algebra Expressions	1988	PODS	0.00040746149
75	Sampling-Based Estimation of the Number of Distinct Values of an Attribute	1995	VLDB	0.00037277061
76	Practical Selectivity Estimation through Adaptive Sampling	1990	SIGMOD	0.00037054261
235	Fast Incremental Maintenance of Approximate Histograms	1997	VLDB	0.00023783792
288	Towards Estimation Error Guarantees for Distinct Values	2000	PODS	0.00022296371
339	Sequential Sampling Procedures For Query Size Estimation	1992	SIGMOD	0.00020723773
484	Error-Constrained COUNT Query Evaluation in Relational Databases	1991	SIGMOD	0.00017746696
508	Random Sampling for Histogram Construction: How much is enough?	1998	SIGMOD	0.00017275873

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	55	Statistical Estimators for Relational Algebra Expressions	1988	PODS
2	2,413	A Sampling Algebra for Aggregate Estimation	2013	VLDB
3	12,305	Space-Efficient Estimation of Statistics over Sub-Sampled Streams	2012	PODS
4	5,421	Fast and Near–Optimal Algorithms for Approximating Distributions by Histograms	2015	PODS
5	255	Distinct Sampling for Highly-Accurate Answers to Distinct Values Queries and Event Reports	2001	VLDB
6	508	Random Sampling for Histogram Construction: How much is enough?	1998	SIGMOD
7	9,676	Analysis and Application of Adaptive Sampling	2000	PODS
8	12,362	Get the Most out of Your Sample: Optimal Unbiased Estimators using Partial Information	2011	PODS
9	75	Sampling-Based Estimation of the Number of Distinct Values of an Attribute	1995	VLDB
10	288	Towards Estimation Error Guarantees for Distinct Values	2000	PODS