Flare & Lantern: Efficiently Swapping Horses Midstream

Summary: Flare (Spark SQL) and Lantern (TensorFlow/PyTorch) integrated for an end-to-end compiled data path. Runtime compilation and native code generation enable negligible overhead when switching between SQL and ML processing. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12086
Venue: VLDB
Year: 2019
Pagerank: 5.4251194e-05
Overall Rank: 8,438 | 42.11%
DOI: 10.14778/3352063.3352097

Incoming Non-self Citations Over Time

Authors

1. Grégory Essertel (Purdue University)
2. Ruby Y. Tahboub (Purdue University)
3. Fei Wang (Purdue University)
4. James Decker (Purdue University)
5. Tiark Rompf (Purdue University)

BibTeX Citation

@article{essertel_vldb19,
        title = {{Flare \& Lantern: Efficiently Swapping Horses Midstream}},
        author = {Essertel, Grégory and Tahboub, Ruby Y. and Wang, Fei and Decker, James and Rompf, Tiark},
        journal = {PVLDB},
        series = {{VLDB} '19},
        volume = {12},
        number = {12},
        pages = {1910--1913},
        doi = {10.14778/3352063.3352097},
        url = {https://doi.org/10.14778/3352063.3352097},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,899	Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms	2021	VLDB	5.5195553e-05
8,057	Architecting a Query Compiler for Spatial Workloads	2020	SIGMOD	5.4982831e-05
8,638	Towards A Polyglot Framework for Factorized ML	2021	VLDB	5.395289e-05

Outgoing Citations (Sorted by Pagerank)

Showing 4 of 4 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
23	Efficiently Compiling Efficient Query Plans for Modern Hardware	2011	VLDB	0.00054886415
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
1,229	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR	0.00011578425
2,488	How to Architect a Query Compiler, Revisited	2018	SIGMOD	8.5091578e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	6,850	Bridging the Gap Between HPC and Big Data Frameworks	2017	VLDB
2	6,865	SparkR: Scaling R Programs with Spark	2016	SIGMOD
3	2,865	End-to-end Optimization of Machine Learning Prediction Queries	2022	SIGMOD
4	1,824	Photon: A Fast Query Engine for Lakehouse Systems	2022	SIGMOD
5	6,743	In-database Distributed Machine Learning: Demonstration using Teradata SQL Engine	2019	VLDB
6	8,104	Enabling Transparent Acceleration of Big Data Frameworks Using Heterogeneous Hardware	2022	VLDB
7	9,835	Share the Tensor Tea: How Databases can Leverage the Machine Learning Ecosystem	2022	VLDB
8	415	SystemML: Declarative Machine Learning on Spark	2016	VLDB
9	1,229	Weld: A Common Runtime for High Performance Data Analytics	2017	CIDR
10	7,165	Flare: A Fast, Secure, and Memory-Efficient Distributed Analytics Framework	2023	VLDB