Automatic Index Selection for Large-Scale Datalog Computation

Summary: Automatically selects a minimum index set covering all Datalog searches, eliminating manual tuning. Integrated into Soufflé, it matches hand-optimized performance while delivering up to 2× speedups and 6× lower memory use on large programs. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 12023
Venue: VLDB
Year: 2019
Pagerank: 5.3397715e-05
Overall Rank: 8,982 | 38.38%
DOI: 10.14778/3282495.3282500

Incoming Non-self Citations Over Time

Authors

1. Pavle Subotić (University College London)
2. Herbert Jordan (University of Innsbruck)
3. Lijun Chang (University of Sydney)
4. Alan Fekete (University of Sydney)
5. Bernhard Scholz (University of Sydney)

BibTeX Citation

@article{subotic_vldb19,
        title = {{Automatic Index Selection for Large-Scale Datalog Computation}},
        author = {Subotić, Pavle and Jordan, Herbert and Chang, Lijun and Fekete, Alan and Scholz, Bernhard},
        journal = {PVLDB},
        series = {{VLDB} '19},
        volume = {12},
        number = {2},
        pages = {141--153},
        doi = {10.14778/3282495.3282500},
        url = {https://doi.org/10.14778/3282495.3282500},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,506	This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch!	2026	SIGMOD	5.093636e-05
10,582	FlowLog: Efficient and Extensible Datalog via Incrementality	2026	VLDB	5.093636e-05
11,003	Automatic Indexing in Oracle	2025	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0024089429
156	An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server	1997	VLDB	0.00028636811
360	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00020182846
387	AutoAdmin "What-if" Index Analysis Utility	1998	SIGMOD	0.00019442332
490	Design and Implementation of the LogicBlox System	2015	SIGMOD	0.000175757
2,594	Big Data Analytics with Datalog Queries on Spark	2016	SIGMOD	8.3646367e-05
4,039	Semi-Automatic Index Tuning: Keeping DBAs in the Loop	2012	VLDB	6.9424878e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,548	Automatically Indexing Millions of Databases in Microsoft Azure SQL Database	2019	SIGMOD
2	7,079	Adding Magic to an Optimising Datalog Compiler	2008	SIGMOD
3	6,587	Selective Provenance for Datalog Programs Using Top-K Queries	2015	VLDB
4	11,453	Asymptotically Better Query Optimization Using Indexed Algebra	2023	VLDB
5	1,481	Magic mirror in my hand, which is the best in the land? An Experimental Evaluation of Index Selection Algorithms	2020	VLDB
6	6,331	Index Support for Rule Activation	1993	SIGMOD
7	319	Declarative Information Extraction Using Datalog with Embedded Extraction Predicates	2007	VLDB
8	8,858	Optimizing Parallel Recursive Datalog Evaluation on Multicore Machines	2022	SIGMOD
9	5,783	Scaling-Up In-Memory Datalog Processing: Observations and Techniques	2019	VLDB
10	6,008	More Efficient Datalog Queries: Subsumptive Tabling Beats Magic Sets	2011	SIGMOD