Debugging Large-Scale Data Science Pipelines using Dagger
Summary: End-to-end debugger for data pipelines; Dagger isolates data-centric errors from transformations to model inputs. It enables inter-module (black-box blocks) and intra-module (inspect DataFrames/Python objects) debugging, demonstrated on Intel BI workloads. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. El Kindi Rezig
- 2. Ashrita Brahmaroutu
- 3. Nesime Tatbul
- 4. Mourad Ouzzani
- 5. Nan Tang
- 6. Timothy Mattson
- 7. Samuel Madden
- 8. Michael Stonebraker
Incoming Citations (Sorted by Pagerank)
Showing 3 of 3 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6,948 | DataPrism: Exposing Disconnect between Data and Systems | 2022 | SIGMOD | 4.8865863e-05 |
| 11,412 | Machine Programming: Turning Data into Programmer Productivity | 2022 | VLDB | 4.1905499e-05 |
| 13,245 | Data Cleaning in the Era of Data Science: Challenges and Opportunities | 2021 | CIDR | - |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 8 of 8 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,274 | The Data Civilizer System | 2017 | CIDR | 0.00012869297 |
| 1,354 | Northstar: An Interactive Data Science System | 2018 | VLDB | 0.00012424105 |
| 1,403 | Detecting Data Errors: Where are we and what needs to be done? | 2016 | VLDB | 0.00012180046 |
| 2,157 | MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis | 2018 | SIGMOD | 9.4153917e-05 |
| 3,027 | Helix: Accelerating Human-in-the-loop Machine Learning | 2018 | VLDB | 7.68624e-05 |
| 4,425 | Data Debugging and Exploration with Vizier | 2019 | SIGMOD | 6.1913912e-05 |
| 5,698 | Dagger: A Data (not code) Debugger | 2020 | CIDR | 5.3669165e-05 |
| 7,992 | Data Civilizer 2.0: A Holistic Framework for Data Preparation and Analytics | 2019 | VLDB | 4.6082565e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| Overall Rank | Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 9,116 | Towards Observability for Production Machine Learning Pipelines | 2022 | VLDB | 4.3886184e-05 |
| 10,821 | mlidea: Interactively Improving ML Data Preparation Code via "Shadow Pipelines" | 2025 | VLDB | 4.1905499e-05 |
| 6,814 | Error Diagnosis and Data Profiling with Data X-Ray | 2015 | VLDB | 4.9130627e-05 |
| 13,157 | Bridging Disciplines in Data Management Research to Solve Complex Data Problems | 2025 | VLDB | - |
| 4,731 | MLINSPECT: A Data Distribution Debugger for Machine Learning Pipelines | 2021 | SIGMOD | 5.9558692e-05 |
| 8,335 | BugDoc: Algorithms to Debug Computational Processes | 2020 | SIGMOD | 4.538972e-05 |
| 11,150 | Reconstructing and Querying ML Pipeline Intermediates | 2023 | CIDR | 4.1905499e-05 |
| 4,425 | Data Debugging and Exploration with Vizier | 2019 | SIGMOD | 6.1913912e-05 |
| 9,223 | BugDoc: A System for Debugging Computational Pipelines | 2020 | SIGMOD | 4.3660299e-05 |
| 5,698 | Dagger: A Data (not code) Debugger | 2020 | CIDR | 5.3669165e-05 |