DQDF: Data-Quality-Aware Dataframes
Summary: DQDF embeds data-quality checks directly into Python dataframes, removing separate QC state maintenance. Automatic metadata-change detection and per-check context reuse accelerate QC on evolving data, delivering 40–80% faster quality evaluation with <10% memory overhead. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Phanwadee Sinthong (University of California Irvine)
- 2. Dhaval Patel (IBM)
- 3. Nianjun Zhou (IBM)
- 4. Shrey Shrivastava (IBM)
- 5. Arun Iyengar (IBM)
- 6. Anuradha Bhamidipaty (IBM)
BibTeX Citation
@article{sinthong_vldb22,
title = {{DQDF: Data-Quality-Aware Dataframes}},
author = {Sinthong, Phanwadee and Patel, Dhaval and Zhou, Nianjun and Shrivastava, Shrey and Iyengar, Arun and Bhamidipaty, Anuradha},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {4},
pages = {949--957},
doi = {10.14778/3503585.3503602},
url = {https://doi.org/10.14778/3503585.3503602},
year = {2022}
}Incoming Citations (Sorted by Pagerank)
Showing 1 of 1 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 11,090 | T-Assess: An Efficient Data Quality Assessment System Tailored for Trajectory Data | 2025 | VLDB | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 4 of 4 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 1,350 | Automating Large-Scale Data Quality Verification | 2018 | VLDB | 0.00011065626 |
| 1,431 | Towards Scalable Dataframe Systems | 2020 | VLDB | 0.00010807221 |
| 3,411 | Scaling Spark in the Real World: Performance and Usability | 2015 | VLDB | 7.436229e-05 |
| 3,630 | TensorFlow Data Validation: Data Analysis and Validation in Continuous ML Pipelines | 2020 | SIGMOD | 7.2387749e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 11,845 | Query-Driven Learning for Next Generation Predictive Modeling & Analytics | 2019 | SIGMOD |
| 2 | 725 | NADEEF: A Commodity Data Cleaning System | 2013 | SIGMOD |
| 3 | 11,487 | To UDFs and Beyond: Demonstration of a Fully Decomposed Data Processor for General Data Wrangling Tasks | 2023 | VLDB |
| 4 | 4,728 | PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes | 2021 | VLDB |
| 5 | 1,484 | Data Quality and Data Cleaning: An Overview | 2003 | SIGMOD |
| 6 | 11,235 | SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis | 2024 | VLDB |
| 7 | 4,592 | Data Platform for Machine Learning | 2019 | SIGMOD |
| 8 | 647 | Discovering Data Quality Rules | 2008 | VLDB |
| 9 | 1,431 | Towards Scalable Dataframe Systems | 2020 | VLDB |
| 10 | 1,350 | Automating Large-Scale Data Quality Verification | 2018 | VLDB |