FILA: Online Auditing of Machine Learning Model Accuracy under Finite Labelling Budget
Summary: FILA: online auditing of ML model accuracy under finite labeling budget; sampling-based stratified estimator with human-in-the-loop. FILA-Thompson, Thompson-Sampling-driven variant, budgeted label allocation, asymptotic optimality, variance analysis. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Authors
- 1. Naiqing Guan (University of Toronto)
- 2. Nick Koudas (University of Toronto)
BibTeX Citation
@inproceedings{guan_sigmod22,
title = {{FILA: Online Auditing of Machine Learning Model Accuracy under Finite Labelling Budget}},
author = {Guan, Naiqing and Koudas, Nick},
series = {{SIGMOD} '22},
booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
publisher = {Association for Computing Machinery},
doi = {10.1145/3514221.3517904},
url = {https://dl.acm.org/doi/10.1145/3514221.3517904},
year = {2022}
}
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 8 of 8 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 141 | Deep Entity Matching with Pre-Trained Language Models | 2021 | VLDB | 0.0002964847 |
| 176 | Deep Learning for Entity Matching: A Design Space Exploration | 2018 | SIGMOD | 0.00027191081 |
| 248 | Evaluation of entity resolution approaches on real-world match problems | 2010 | VLDB | 0.00023278354 |
| 439 | Corleone: Hands-Off Crowdsourcing for Entity Matching | 2014 | SIGMOD | 0.00018464913 |
| 2,290 | ZeroER: Entity Resolution using Zero Labeled Examples | 2020 | SIGMOD | 8.799251e-05 |
| 2,463 | A Comprehensive Benchmark Framework for Active Learning Methods in Entity Matching | 2020 | SIGMOD | 8.5486912e-05 |
| 3,630 | TensorFlow Data Validation: Data Analysis and Validation in Continuous ML Pipelines | 2020 | SIGMOD | 7.2387749e-05 |
| 5,899 | In Search of an Entity Resolution OASIS: Optimal Asymptotic Sequential Importance Sampling | 2017 | VLDB | 6.0469241e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 11,260 | Efficiently Mitigating the Impact of Data Drift on Machine Learning Pipelines | 2024 | VLDB |
| 2 | 8,608 | One Size Does Not Fit All: A Bandit-Based Sampler Combination Framework with Theoretical Guarantees | 2022 | SIGMOD |
| 3 | 4,808 | Selective Data Acquisition in the Wild for Model Charging | 2022 | VLDB |
| 4 | 5,785 | BlinkML: Efficient Maximum Likelihood Estimation with Probabilistic Guarantees | 2019 | SIGMOD |
| 5 | 7,048 | Learning to Sample: Counting with Complex Queries | 2020 | VLDB |
| 6 | 6,854 | iFlipper: Label Flipping for Individual Fairness | 2023 | SIGMOD |
| 7 | 6,581 | Efficient Knowledge Graph Accuracy Evaluation | 2019 | VLDB |
| 8 | 10,186 | Accelerating Approximate Analytical Join Queries over Unstructured Data with Statistical Guarantees | 2026 | SIGMOD |
| 9 | 11,239 | Efficient and Reliable Estimation of Knowledge Graph Accuracy | 2024 | VLDB |
| 10 | 6,431 | Finding Label and Model Errors in Perception Data With Learned Observation Assertions | 2022 | SIGMOD |