DBScholar

Back to papers

DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing

Summary: DocETL declaratively optimizes complex LLM document-processing pipelines via agent-generated logical rewrites (“rewrite directives”) and latency-aware plan evaluation. It trades single-call execution for decomposition and empirical plan search, improving accuracy 21–80% on four real tasks. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h3f14751160b5f392
Venue
VLDB
Year
2025
Pagerank
0.00015402076
Overall Rank
630 | 95.78%
DOI
10.14778/3746405.3746426
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{shankar_vldb25,
        title = {{DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing}},
        author = {Shankar, Shreya and Chambers, Tristan and Shah, Tarak and Parameswaran, Aditya G. and Wu, Eugene},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {9},
        pages = {3035--3048},
        doi = {10.14778/3746405.3746426},
        url = {https://doi.org/10.14778/3746405.3746426},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 44 of 44 citing papers.

Rank Citing Paper Year Venue Pagerank
2,256 The Design of an LLM-powered Unstructured Analytics System 2025 CIDR 8.7418985e-05
2,611 Semantic Operators and Their Optimization: Enabling LLM-Based Data Processing with Accuracy Guarantees in LOTUS 2025 VLDB 8.2027761e-05
2,924 Abacus: A Cost-Based Optimizer for Semantic Operator Systems 2026 VLDB 7.8407467e-05
3,717 Logical and Physical Optimizations for SQL Query Execution over Large Language Models 2025 SIGMOD 7.05392e-05
4,996 SemBench: A Benchmark for Semantic Query Processing Engines 2026 VLDB 6.3095672e-05
6,615 Multi-Objective Agentic Rewrites for Unstructured Data Processing 2026 VLDB 5.7164252e-05
6,763 VectraFlow: Integrating Vectors into Stream Processing 2025 CIDR 5.6701896e-05
6,938 PalimpChat: Declarative and Interactive AI analytics 2025 SIGMOD 5.6242429e-05
7,882 Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems 2025 VLDB 5.4181983e-05
8,311 ELT-Bench: An End-to-End Benchmark for Evaluating AI Agents on ELT Pipelines 2026 VLDB 5.3410298e-05
8,543 Cut Costs, Not Accuracy: LLM-Powered Data Processing with Guarantees 2026 SIGMOD 5.3039559e-05
8,707 Relational Deep Dive: Error-Aware Queries Over Unstructured Data 2026 VLDB 5.2705676e-05
8,708 Unstructured Data Analysis Using LLMs: A Comprehensive Benchmark 2026 VLDB 5.2705676e-05
10,185 Deep Research is the New Analytics System: Towards Building the Runtime for AI-Driven Analytics 2026 CIDR 5.052396e-05
10,231 Task Cascades for Efficient Unstructured Data Processing 2026 SIGMOD 5.0432098e-05
10,232 Featurized-Decomposition Join: Low-Cost Semantic Joins with Guarantees 2026 VLDB 5.0432098e-05
10,388 CADENZA: Compiling Natural-Language Intent into Task-Specific Operator DAGs for Semantic Query Processing 2027 SIGMOD 4.9605343e-05
10,405 NOAH: A System for Analyzing Non-relational Tables Using Natural Language 2027 SIGMOD 4.9605343e-05
10,418 Evergreen: Efficient Claim Verification for Semantic Aggregates 2027 VLDB 4.9605343e-05
10,420 Rethinking Query Optimization for Multi-Agent Systems 2027 VLDB 4.9605343e-05
10,422 Please Don't Kill My Vibe: Empowering Agents with Data Flow Control 2026 CIDR 4.9605343e-05
10,425 KathDB: Explainable Multimodal Database Management System with Human-AI Collaboration 2026 CIDR 4.9605343e-05
10,432 Making Prompts First-Class Citizens for Adaptive LLM Pipelines 2026 CIDR 4.9605343e-05
10,478 100x Cost & Latency Reduction: Performance Analysis of AI Query Approximation using Lightweight Proxy Models: [Experiments & Analysis] 2026 SIGMOD 4.9605343e-05
10,493 Automated Discovery of Test Oracles for Database Management Systems Using LLMs 2026 SIGMOD 4.9605343e-05
10,500 Bridging the Gap: Cardinality Estimation for Semantic Queries on Unstructured Data 2026 SIGMOD 4.9605343e-05
10,575 ScaleDoc: Scaling LLM-based Predicates over Large Document Collections 2026 SIGMOD 4.9605343e-05
10,634 Drama: Unifying Data Retrieval and Analysis for Open-Domain Analytic Queries 2026 SIGMOD 4.9605343e-05
10,670 AixelAsk: A Stepwise-Guided Retrieval and Reasoning Framework for Large Table QA 2026 SIGMOD 4.9605343e-05
10,677 Visual Template Inference for Data Extraction from Documents 2026 SIGMOD 4.9605343e-05
10,694 Beyond Relational: Semantic-Aware Multi-Modal Analytics with LLM-Native Query Optimization 2026 SIGMOD 4.9605343e-05
10,742 PRISM: Navigating Cost–Accuracy Trade-offs for NL2SQL 2026 SIGMOD 4.9605343e-05
10,862 BookRAG: A Hierarchical Structure-aware Index-based Approach for Retrieval-Augmented Generation on Complex Documents 2026 VLDB 4.9605343e-05
10,875 Document-to-Database: Extraction Meets Relational Semantics 2026 VLDB 4.9605343e-05
10,928 Sema: A High-performance System for LLM-based Semantic Query Processing 2026 VLDB 4.9605343e-05
11,027 Credo: Declarative Control of LLM Pipelines via Beliefs and Policies 2026 VLDB 4.9605343e-05
11,030 QuWARTS: Query Workload Aware Relational Table Synthesis from Unstructured Text 2026 VLDB 4.9605343e-05
11,048 CADENZA in Action: Breaking the Monolith with Intent-Dependent Plan Spaces for Semantic Queries 2026 VLDB 4.9605343e-05
11,050 Carnot: Interpretable, Interactive, and Optimized Execution of Deep Research Queries 2026 VLDB 4.9605343e-05
11,056 Demonstrating Samsara: A Super-Optimizer for Multimodal Stream Processing 2026 VLDB 4.9605343e-05
11,078 iPDB: SQL with ML and LLM Predicates (Towards a Database Engine for AI) 2026 VLDB 4.9605343e-05
11,094 Bridging LLMs and Database Systems: A Deep Dive into Enhanced Relational Operators 2026 VLDB 4.9605343e-05
11,104 Data Agents: Rethinking Data Systems in the AI Agent Era 2026 VLDB 4.9605343e-05
11,139 KEN: An Execution Engine for Unstructured Database Systems 2026 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
62 Maintaining Views Incrementally 1993 SIGMOD 0.00038944207
92 CrowdDB: Answering Queries with Crowdsourcing 2011 SIGMOD 0.00034613457
257 Crowdsourced Databases: Query Processing with People 2011 CIDR 0.00022914527
259 An Overview of Query Optimization in Relational Systems 1998 PODS 0.00022881075
273 NoScope: Optimizing Neural Network Queries over Video at Scale 2017 VLDB 0.00022518449
494 Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes 2024 VLDB 0.00017350554
605 CAESURA: Language Models as Multi-Modal Query Planners 2024 CIDR 0.00015630219
697 Palimpzest: Optimizing AI-Powered Analytics with Declarative Query Processing 2025 CIDR 0.00014665686
1,238 DB-BERT: A Database Tuning Tool that "Reads the Manual" 2022 SIGMOD 0.00011375179
1,838 CHORUS: Foundation Models for Unified Data Discovery and Exploration 2024 VLDB 9.5195856e-05
2,256 The Design of an LLM-powered Unstructured Analytics System 2025 CIDR 8.7418985e-05
2,370 DeepJoin: Joinable Table Discovery with Pre-trained Language Models 2023 VLDB 8.5469172e-05
2,924 Abacus: A Cost-Based Optimizer for Semantic Operator Systems 2026 VLDB 7.8407467e-05
3,223 How Large Language Models Will Disrupt Data Management 2023 VLDB 7.5043163e-05
3,659 Revisiting Prompt Engineering via Declarative Crowdsourcing 2024 CIDR 7.1094444e-05
4,690 spade: Synthesizing Data Quality Assertions for Large Language Model Pipelines 2024 VLDB 6.4506346e-05
5,051 CDB: A Crowd-Powered Database System 2018 VLDB 6.2863221e-05
5,301 Observatory: Characterizing Embeddings of Relational Tables 2024 VLDB 6.1761723e-05
Previous Page 1 / 1 Next

Semantically Similar Papers