FEBench: A Benchmark for Real-Time Relational Data Feature Extraction

Summary: Characterizes real-time feature-extraction workloads across 100+ datasets, exposing major differences from transactional/analytical benchmarks. Introduces FEBench—representative data, SQL-like query templates, and an online request simulator—to compare latency, tail latency, and concurrency in OpenMLDB and Flink. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 13378
Venue: VLDB
Year: 2023
Pagerank: 5.2696166e-05
Overall Rank: 9,433 | 35.29%
DOI: 10.14778/3611540.3611550

Incoming Non-self Citations Over Time

Authors

1. Xuanhe Zhou (Tsinghua University)
2. Cheng Chen (4Paradigm Inc.)
3. Kunyi Li (Tsinghua University)
4. Bingsheng He (National University of Singapore)
5. Mian Lu (4Paradigm Inc.)
6. Qiaosheng Liu (4Paradigm Inc.)
7. Wei Huang (4Paradigm Inc.)
8. Guoliang Li (Tsinghua University; Zhongguancun Laboratory)
9. Zhao Zheng (4Paradigm Inc.)
10. Yuqiang Chen (4Paradigm Inc.)

BibTeX Citation

@article{zhou_vldb23,
        title = {{FEBench: A Benchmark for Real-Time Relational Data Feature Extraction}},
        author = {Zhou, Xuanhe and Chen, Cheng and Li, Kunyi and He, Bingsheng and Lu, Mian and Liu, Qiaosheng and Huang, Wei and Li, Guoliang and Zheng, Zhao and Chen, Yuqiang},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {12},
        pages = {3597--3609},
        doi = {10.14778/3611540.3611550},
        url = {https://doi.org/10.14778/3611540.3611550},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,327	Breaking It Down: An In-depth Study of Index Advisors	2024	VLDB	5.9124005e-05
7,847	Biathlon: Harnessing Model Resilience for Accelerating ML Inference Pipelines	2024	VLDB	5.5330423e-05
10,466	InferF: Declarative Factorization of AI/ML Inferences over Joins	2026	SIGMOD	5.093636e-05
10,696	OpenMLDB: A Real-Time Relational Data Feature Computation System for Online ML	2025	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
18	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059284255
226	OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases	2014	VLDB	0.00024027277
232	LinkBench: a Database Benchmark Based on the Facebook Social Graph	2013	SIGMOD	0.00023830978
465	An End-to-End Learning-based Cost Estimator	2020	VLDB	0.0001803934
2,452	A Learned Query Rewrite System using Monte Carlo Tree Search	2022	VLDB	8.5584e-05
2,762	Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection	2022	VLDB	8.1539867e-05
2,888	AI Meets Database: AI4DB and DB4AI	2021	SIGMOD	7.9941489e-05
3,404	Data Generation for Application-Specific Benchmarking	2011	VLDB	7.4411075e-05
3,662	openGauss: An Autonomous Database System	2021	VLDB	7.2166682e-05
3,688	FACE: A Normalizing Flow based Cardinality Estimator	2022	VLDB	7.201795e-05
3,792	Learned Index: A Comprehensive Experimental Evaluation	2023	VLDB	7.1220982e-05
3,851	Analyzing Efficient Stream Processing on Modern Hardware	2019	VLDB	7.0735328e-05
5,206	BriskStream: Scaling Data Stream Processing on Shared-Memory Multicore Architectures	2019	SIGMOD	6.3180444e-05
5,925	Managing ML Pipelines: Feature Stores and the Coming Wave of Embedding Ecosystems	2021	VLDB	6.0397888e-05
6,105	Optimizing In-memory Database Engine for AI-powered On-line Decision Augmentation Using Persistent Memory	2021	VLDB	5.9743349e-05
8,453	A Learned Query Rewrite System	2023	VLDB	5.4229225e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,812	Query Performance Prediction for Concurrent Queries using Graph Embedding	2020	VLDB
2	9,962	Structure-Aware Machine Learning over Multi-Relational Databases	2021	SIGMOD
3	5,804	A Relational Framework for Classifier Engineering	2017	PODS
4	5,524	Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data	2020	SIGMOD
5	11,215	OEBench: Investigating Open Environment Challenges in Real-World Relational Data Streams	2024	VLDB
6	5,174	An In-Depth Benchmarking of Text-to-SQL Systems	2021	SIGMOD
7	5,073	Database Workload Characterization with Query Plan Encoders	2022	VLDB
8	5,704	Optimizing Data Pipelines for Machine Learning in Feature Stores	2023	VLDB
9	10,696	OpenMLDB: A Real-Time Relational Data Feature Computation System for Online ML	2025	SIGMOD
10	226	OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases	2014	VLDB