TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems
Summary: TPCx-AI: the first standardized, industry benchmark for end-to-end ML deployments. Uniquely combines scalable realistic structured/unstructured data generation with representative integration, processing, training, and inference workloads across Python and Spark. (summarized by gpt-5.6-luna on Jul 24 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Christoph Brücke (bankmark)
- 2. Philipp Härtling (bankmark)
- 3. Hamesh Patel (Intel)
- 4. Rodrigo D Escobar Palacios (Intel)
- 5. Tilmann Rabl (Hasso Plattner Institute; University of Potsdam; bankmark)
BibTeX Citation
@article{brucke_vldb23,
title = {{TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems}},
author = {Brücke, Christoph and Härtling, Philipp and Patel, Hamesh and Palacios, Rodrigo D Escobar and Rabl, Tilmann},
journal = {PVLDB},
series = {{VLDB} '23},
volume = {16},
number = {12},
pages = {3649--3661},
doi = {10.14778/3611540.3611554},
url = {https://doi.org/10.14778/3611540.3611554},
year = {2023}
}Incoming Citations (Sorted by Pagerank)
Showing 8 of 8 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 5,704 | Optimizing Data Pipelines for Machine Learning in Feature Stores | 2023 | VLDB | 6.1146371e-05 |
| 6,614 | Mitigating the Impedance Mismatch between Prediction Query Execution and Database Engine | 2025 | SIGMOD | 5.8216658e-05 |
| 7,502 | Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine | 2025 | VLDB | 5.6029996e-05 |
| 9,385 | The Hopsworks Feature Store for Machine Learning | 2024 | SIGMOD | 5.2755515e-05 |
| 10,230 | Eliminating Redundant Feature Tests in Decision Tree and Random Forest Inference on SQL Predicates | 2026 | SIGMOD | 5.093636e-05 |
| 10,386 | NeurStore: Efficient In-database Deep Learning Model Management System | 2026 | SIGMOD | 5.093636e-05 |
| 10,531 | TPCx-AI under the Microscope: A Benchmarking Debt Analysis | 2026 | VLDB | 5.093636e-05 |
| 10,618 | ELT-Bench: An End-to-End Benchmark for Evaluating AI Agents on ELT Pipelines | 2026 | VLDB | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 7 of 7 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 476 | The Making of TPC-DS | 2006 | VLDB | 0.00017860667 |
| 1,147 | Data Management Challenges in Production Machine Learning | 2017 | SIGMOD | 0.00011974846 |
| 1,693 | BigBench: Towards an Industry Standard Benchmark for Big Data Analytics | 2013 | SIGMOD | 9.9965799e-05 |
| 2,657 | Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunities | 2021 | SIGMOD | 8.2887895e-05 |
| 3,459 | A Comparative Evaluation of Systems for Scalable Linear Algebra-based Analytics | 2018 | VLDB | 7.3953716e-05 |
| 4,877 | TPC-DI: The First Industry Benchmark for Data Integration | 2014 | VLDB | 6.468584e-05 |
| 7,763 | MLBench: Benchmarking Machine Learning Services Against Human Experts | 2018 | VLDB | 5.5500928e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 3,173 | Why You Should Run TPC-DS:A Workload Analysis | 2007 | VLDB |
| 2 | 9,777 | PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking | 2025 | VLDB |
| 3 | 9,622 | Revisiting Graph Analytics Benchmark | 2025 | SIGMOD |
| 4 | 1,693 | BigBench: Towards an Industry Standard Benchmark for Big Data Analytics | 2013 | SIGMOD |
| 5 | 9,433 | FEBench: A Benchmark for Real-Time Relational Data Feature Extraction | 2023 | VLDB |
| 6 | 4,877 | TPC-DI: The First Industry Benchmark for Data Integration | 2014 | VLDB |
| 7 | 3,543 | A Comparison of Platforms for Implementing and Running Very Large Scale Machine Learning Algorithms | 2014 | SIGMOD |
| 8 | 7,763 | MLBench: Benchmarking Machine Learning Services Against Human Experts | 2018 | VLDB |
| 9 | 2,823 | Query Processing on Tensor Computation Runtimes | 2022 | VLDB |
| 10 | 10,531 | TPCx-AI under the Microscope: A Benchmarking Debt Analysis | 2026 | VLDB |