Large-Scale Metric Computation in Online Controlled Experiment Platform

Summary: Presents a production-scale metric engine for online controlled experiments at WeChat, using bitsliced-index (BSI) arithmetic to accelerate computation across rapidly growing experiments and metrics. Demonstrates its suitability through real-world performance results. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 13790
Venue: VLDB
Year: 2024
Pagerank: 5.093636e-05
Overall Rank: 11,288 | 22.56%
DOI: 10.14778/3685800.3685823

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Tao Xiong (Tencent)
2. Yong Wang (Tencent)

BibTeX Citation

@article{xiong_vldb24,
        title = {{Large-Scale Metric Computation in Online Controlled Experiment Platform}},
        author = {Xiong, Tao and Wang, Yong},
        journal = {PVLDB},
        series = {{VLDB} '24},
        volume = {17},
        number = {12},
        pages = {4014--4024},
        doi = {10.14778/3685800.3685823},
        url = {https://doi.org/10.14778/3685800.3685823},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 3 of 3 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
104	Improved Query Performance with Variant Indexes	1997	SIGMOD	0.00033932213
3,597	Bit-Sliced Index Arithmetic	2001	SIGMOD	7.2721197e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,667	On the algebra of data sketches	2021	VLDB
2	9,916	Efficient Historical Butterfly Counting in Large Temporal Bipartite Networks via Graph Structure-aware Index	2025	VLDB
3	4,918	Massive Scale-out of Expensive Continuous Queries	2011	VLDB
4	4,696	Error-bounded Sampling for Analytics on Big Sparse Data	2014	VLDB
5	2,878	Data Sketches for Disaggregated Subset Sum and Frequent Item Estimation	2018	SIGMOD
6	5,385	Randomized Error Removal for Online Spread Estimation in Data Streaming	2021	VLDB
7	7,827	Efficient B-tree Based Indexing for Cloud Data Processing	2010	VLDB
8	1,875	Large-Scale Distributed Graph Computing Systems: An Experimental Evaluation	2015	VLDB
9	4,742	Continuous Cloud-Scale Query Optimization and Processing	2013	VLDB
10	4,945	Lightweight Cardinality Estimation in LSM-based Systems	2018	SIGMOD