Debugging Missing Answers for Spark Queries over Nested Data with Breadcrumb
Summary: Breadcrumb provides query-based explanations for missing Spark results on nested data, pinpointing the operators responsible for the absence. It scales to big data and handles schema-semantic errors in nested/de-normalized queries, guiding fixes. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Ralf Diestelkämper (University of Stuttgart)
- 2. Seokki Lee (University of Cincinnati)
- 3. Boris Glavic (Illinois Institute of Technology)
- 4. Melanie Herschel (University of Stuttgart)
BibTeX Citation
@article{diestelkamper_vldb21,
title = {{Debugging Missing Answers for Spark Queries over Nested Data with Breadcrumb}},
author = {Diestelkämper, Ralf and Lee, Seokki and Glavic, Boris and Herschel, Melanie},
journal = {PVLDB},
series = {{VLDB} '21},
volume = {14},
number = {12},
pages = {2731--2734},
doi = {10.14778/3476311.3476331},
url = {https://doi.org/10.14778/3476311.3476331},
year = {2021}
}
Incoming Citations (Sorted by Pagerank)
Showing 1 of 1 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 5,278 | Why Not Yet: Fixing a Top-k Ranking that Is Not Fair to Individuals | 2023 | VLDB | 6.2856584e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 385 | Why Not? | 2009 | SIGMOD | 0.00019455743 |
| 585 | Lineage Tracing for General Data Warehouse Transformations | 2001 | VLDB | 0.00016139897 |
| 1,158 | Schema and Ontology Matching with COMA++ | 2005 | SIGMOD | 0.00011899424 |
| 7,175 | NLProveNAns: Natural Language Provenance for Non-Answers | 2018 | VLDB | 5.6820504e-05 |
| 7,748 | To Not Miss the Forest for the Trees - A Holistic Approach for Explaining Missing Answers over Nested Data | 2021 | SIGMOD | 5.5528084e-05 |
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 11,091 | LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison | 2025 | VLDB |
| 2 | 11,603 | SparkCAD: Caching Anomalies Detector for Spark Applications | 2022 | VLDB |
| 3 | 6,377 | Scalable Querying of Nested Data | 2021 | VLDB |
| 4 | 8,482 | A Demonstration of DLBD: Database Logic Bug Detection System | 2023 | VLDB |
| 5 | 1,350 | Automating Large-Scale Data Quality Verification | 2018 | VLDB |
| 6 | 11,399 | QaaD (Query-as-a-Data): Scalable Execution of Massive Number of Small Queries in Spark | 2023 | SIGMOD |
| 7 | 2,594 | Big Data Analytics with Datalog Queries on Spark | 2016 | SIGMOD |
| 8 | 5,570 | Debugging Big Data Analytics in Spark with BigDebug | 2017 | SIGMOD |
| 9 | 11,857 | Capturing and Querying Structural Provenance in Spark with Pebble | 2019 | SIGMOD |
| 10 | 7,748 | To Not Miss the Forest for the Trees - A Holistic Approach for Explaining Missing Answers over Nested Data | 2021 | SIGMOD |