Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines
Summary: mlinspect: a library that extracts a DAG representation of Python ML preprocessing pipelines to enable lightweight lineage-based inspection of brittle data issues affecting reliability, accountability, and fairness. Automatically instruments declarative abstractions (estimator/transformer pipelines) via lightweight annotation propagation—no manual code instrumentation—enabling end-to-end inspection in native ML stacks. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Stefan Grafberger (Technical University of Munich)
- 2. Julia Stoyanovich (New York University)
- 3. Sebastian Schelter (University of Amsterdam)
BibTeX Citation
@inproceedings{grafberger_cidr21,
address = {Amsterdam, Netherlands},
series = {{CIDR} '21},
title = {{Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines}},
booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
author = {Grafberger, Stefan and Stoyanovich, Julia and Schelter, Sebastian},
year = {2021}
}Incoming Citations (Sorted by Pagerank)
Showing 6 of 6 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 2,865 | End-to-end Optimization of Machine Learning Prediction Queries | 2022 | SIGMOD | 8.0180243e-05 |
| 4,240 | LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems | 2021 | SIGMOD | 6.809685e-05 |
| 4,518 | MLINSPECT: A Data Distribution Debugger for Machine Learning Pipelines | 2021 | SIGMOD | 6.6474737e-05 |
| 8,838 | The Cost of Representation by Subset Repairs | 2025 | VLDB | 5.3592132e-05 |
| 11,309 | LucidScript: Bottom-up Standardization for Data Preparation | 2024 | VLDB | 5.093636e-05 |
| 11,509 | Screening Native ML Pipelines with “ArgusEyes” | 2022 | CIDR | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 11 of 11 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 17 | Provenance Semirings | 2007 | PODS | 0.00059843817 |
| 1,229 | Weld: A Common Runtime for High Performance Data Analytics | 2017 | CIDR | 0.00011578425 |
| 1,340 | Responsible Data Management | 2020 | VLDB | 0.00011111667 |
| 1,350 | Automating Large-Scale Data Quality Verification | 2018 | VLDB | 0.00011065626 |
| 1,670 | MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis | 2018 | SIGMOD | 0.00010045615 |
| 1,786 | Putting Lipstick on Pig: Enabling Database-style Workflow Provenance | 2012 | VLDB | 9.7690421e-05 |
| 2,000 | Data Management for Data Science: Towards Embedded Analytics | 2020 | CIDR | 9.3336258e-05 |
| 2,431 | noWorkflow: a Tool for Collecting, Analyzing, and Managing Provenance from Python Scripts | 2017 | VLDB | 8.5875984e-05 |
| 4,373 | Data Debugging and Exploration with Vizier | 2019 | SIGMOD | 6.738145e-05 |
| 5,404 | Dagger: A Data (not code) Debugger | 2020 | CIDR | 6.2294192e-05 |
| 5,442 | Inspector Gadget: A Framework for Custom Monitoring and Debugging of Distributed Dataflows | 2011 | SIGMOD | 6.2184416e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 11,043 | mlidea: Interactively Improving ML Data Preparation Code via “Shadow Pipelines” | 2025 | VLDB |
| 2 | 11,509 | Screening Native ML Pipelines with “ArgusEyes” | 2022 | CIDR |
| 3 | 7,490 | mlwhatif: What If You Could Stop Re-Implementing Your Machine Learning Pipeline Analyses Over and Over? | 2023 | VLDB |
| 4 | 11,047 | APEX-DAG: Library and Language independent Pipeline EXtraction | 2025 | VLDB |
| 5 | 8,050 | Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science | 2021 | VLDB |
| 6 | 11,353 | Reconstructing and Querying ML Pipeline Intermediates | 2023 | CIDR |
| 7 | 9,245 | Towards Observability for Production Machine Learning Pipelines | 2022 | VLDB |
| 8 | 7,395 | Automating and Optimizing Data-Centric What-If Analyses on Native Machine Learning Pipelines | 2023 | SIGMOD |
| 9 | 11,512 | Towards Observability for Machine Learning Pipelines | 2022 | CIDR |
| 10 | 4,518 | MLINSPECT: A Data Distribution Debugger for Machine Learning Pipelines | 2021 | SIGMOD |