ConnectorX: Accelerating Data Loading From Databases to Dataframes

Summary: ConnectorX speeds loading from DBMSs to dataframes by reducing client-side overhead—the dominant cost—rather than query execution or data transfer. Server-side result partitioning and a modular design enable easy extension to multiple databases and dataframes, yielding speedups over prior libraries. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12970
Venue: VLDB
Year: 2022
Pagerank: 5.8197537e-05
Overall Rank: 6,628 | 54.53%
DOI: 10.14778/3551793.3551847

Incoming Non-self Citations Over Time

Authors

1. Xiaoying Wang (Simon Fraser University)
2. Weiyuan Wu (Simon Fraser University)
3. Jinze Wu (Simon Fraser University)
4. Yizhou Chen (Simon Fraser University)
5. Nick Zrymiak (Simon Fraser University)
6. Changbo Qu (Simon Fraser University)
7. Lampros Flokas (Columbia University)
8. George Chow (Simon Fraser University)
9. Jiannan Wang (Simon Fraser University)
10. Tianzheng Wang (Simon Fraser University)
11. Eugene Wu (Columbia University)
12. Qingqing Zhou (Tencent)

BibTeX Citation

@article{wang_vldb22,
        title = {{ConnectorX: Accelerating Data Loading From Databases to Dataframes}},
        author = {Wang, Xiaoying and Wu, Weiyuan and Wu, Jinze and Chen, Yizhou and Zrymiak, Nick and Qu, Changbo and Flokas, Lampros and Chow, George and Wang, Jiannan and Wang, Tianzheng and Wu, Eugene and Zhou, Qingqing},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {11},
        pages = {2994--3003},
        doi = {10.14778/3551793.3551847},
        url = {https://doi.org/10.14778/3551793.3551847},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,232	EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines	2026	SIGMOD	5.093636e-05
10,466	InferF: Declarative Factorization of AI/ML Inferences over Joins	2026	SIGMOD	5.093636e-05
10,761	Fast and Scalable Data Transfer Across Data Systems	2025	SIGMOD	5.093636e-05
10,852	Accio: Bolt-on Query Federation	2025	VLDB	5.093636e-05
11,033	Enter the Warp: Fast and Adaptive Data Transfer with XDBC	2025	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 18 of 18 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
66	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00038561587
1,138	Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics	2021	CIDR	0.00012023643
1,235	Towards Linear Algebra over Normalized Data	2017	VLDB	0.00011548457
1,333	Ricardo: Integrating R and Hadoop	2010	SIGMOD	0.0001112858
1,431	Towards Scalable Dataframe Systems	2020	VLDB	0.00010807221
1,453	Dremel: A Decade of Interactive SQL Analysis at Web Scale	2020	VLDB	0.00010742227
2,000	Data Management for Data Science: Towards Embedded Analytics	2020	CIDR	9.3336258e-05
2,293	Extending Relational Query Processing with ML Inference	2020	CIDR	8.7949378e-05
2,651	Magpie: Python at Speed and Scale using Cloud Backends	2021	CIDR	8.2918086e-05
2,786	DB4ML – An In-Memory Database Kernel with Machine Learning Support	2020	SIGMOD	8.1207221e-05
2,847	AIDA - Abstraction for Advanced In-Database Analytics	2018	VLDB	8.0583142e-05
2,927	In-Database Learning with Sparse Tensors	2018	PODS	7.9531195e-05
3,490	MLog: Towards Declarative In-Database Machine Learning	2017	VLDB	7.3667971e-05
4,036	Don’t Hold My Data Hostage – A Case For Client Protocol Redesign	2017	VLDB	6.9436548e-05
4,292	Putting Pandas in a Box	2021	CIDR	6.7784325e-05
5,855	Bridging Two Worlds with RICE: Integrating R into the SAP In-Memory Computing Engine	2011	VLDB	6.064726e-05
6,264	Mainlining Databases: Supporting Fast Transactional Workloads on Universal Columnar Data File Formats	2021	VLDB	5.9357781e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	11,481	Demonstration of OpenDBML, a Framework for Democratizing In-Database Machine Learning	2023	VLDB
2	9,069	DQDF: Data-Quality-Aware Dataframes	2022	VLDB
3	4,292	Putting Pandas in a Box	2021	CIDR
4	7,502	Decentralized Actor Scheduling and Reference-based Storage in Xorbits: a Native Scalable Data Science Engine	2025	VLDB
5	2,960	XXL - A Library Approach to Supporting Efficient Implementations of Advanced Database Queries	2001	VLDB
6	1,431	Towards Scalable Dataframe Systems	2020	VLDB
7	10,852	Accio: Bolt-on Query Federation	2025	VLDB
8	11,235	SplitDF: Splitting Dataframes for Memory-Efficient Data Analysis	2024	VLDB
9	10,761	Fast and Scalable Data Transfer Across Data Systems	2025	SIGMOD
10	4,728	PolyFrame: A Retargetable Query-based Approach to Scaling Dataframes	2021	VLDB