Main-Memory Scan Sharing For Multi-Core CPUs

Summary: Introduces FullSharing and cache-aware BatchSharing to share scans across concurrent BI queries while preventing aggregation-table thrashing on multicore systems. Lottery scheduling preserves fairness and bounded staging, delivering 2–2.5× throughput on 8 cores. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: h2cc320048a72d7f7
Venue: VLDB
Year: 2008
Pagerank: 0.00014657491
Overall Rank: 705 | 95.27%
DOI: 10.14778/1454159.1454165

Incoming Non-self Citations Over Time

Authors

1. Lin Qiao (IBM)
2. Vijayshankar Raman (IBM)
3. Frederick Reiss (IBM)
4. Peter J. Haas (IBM)
5. Guy M. Lohman (IBM)

BibTeX Citation

@article{qiao_vldb08,
        title = {{Main-Memory Scan Sharing For Multi-Core CPUs}},
        author = {Qiao, Lin and Raman, Vijayshankar and Reiss, Frederick and Haas, Peter J. and Lohman, Guy M.},
        journal = {PVLDB},
        series = {{VLDB} '08},
        volume = {1},
        number = {1},
        pages = {610--621},
        doi = {10.14778/1454159.1454165},
        url = {https://doi.org/10.14778/1454159.1454165},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
219	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024363532
667	SharedDB: Killing One Thousand Queries With One Stone	2012	VLDB	0.00014978213
823	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB	0.00013648332
1,034	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.00012394538
1,167	DimmWitted: A Study of Main-Memory Statistical Analytics	2014	VLDB	0.00011729888
1,241	BatchDB: Efficient Isolated Execution of Hybrid OLTP+OLAP Workloads for Interactive Applications	2017	SIGMOD	0.00011378254
1,745	Selecting Subexpressions to Materialize at Datacenter Scale	2018	VLDB	9.7343818e-05
1,918	Predictable Performance for Unpredictable Workloads	2009	VLDB	9.3789552e-05
1,925	Here are my Data Files. Here are my Queries. Where are my Results?	2011	CIDR	9.3670488e-05
2,137	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.9777553e-05
2,225	Shared Workload Optimization	2014	VLDB	8.8081001e-05
2,249	Evaluating End-to-End Optimization for Data Analytics Applications in Weld	2018	VLDB	8.7549752e-05
3,396	Variance Aware Optimization of Parameterized Queries	2010	SIGMOD	7.3418098e-05
3,545	Computation Reuse in Analytics Job Service at Microsoft	2018	SIGMOD	7.2134803e-05
3,599	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	7.1773938e-05
4,048	Fast Scans on Key-Value Stores	2017	VLDB	6.8304396e-05
4,392	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB	6.6213651e-05
4,730	MQJoin: Efficient Shared Execution of Main-Memory Joins	2016	VLDB	6.4468007e-05
4,810	UpBit: Scalable In-Memory Updatable Bitmap Indexing	2016	SIGMOD	6.4050834e-05
4,912	A Top-Down Approach to Achieving Performance Predictability in Database Systems	2017	SIGMOD	6.3578361e-05
5,618	BinDex: A Two-Layered Index for Fast and Robust Scans	2020	SIGMOD	6.0630987e-05
5,639	Revisiting Reuse in Main Memory Database Systems	2017	SIGMOD	6.0558642e-05
6,444	RTScan: Efficient Scan with Ray Tracing Cores	2024	VLDB	5.7825648e-05
6,814	CrocodileDB: Efficient Database Execution through Intelligent Deferment	2020	CIDR	5.6735614e-05
7,722	Resource-efficient Shared Query Execution via Exploiting Time Slackness	2021	SIGMOD	5.467573e-05
7,815	Mining Tree-Structured Data on Multicore Systems	2009	VLDB	5.448188e-05
8,474	ParTime: Parallel Temporal Aggregation	2016	SIGMOD	5.3343907e-05
9,127	Automatic Contention Detection and Amelioration for Data-Intensive Operations	2010	SIGMOD	5.2237283e-05
9,617	MCC-DB: Minimizing Cache Conflicts in Multi-core Processors for Databases	2009	VLDB	5.1507816e-05
9,782	Sharing Opportunities for OLTP Workloads in Different Isolation Levels	2020	VLDB	5.1296539e-05
11,461	Oligolithic Cross-task Optimizations across Isolated Workloads*	2024	CIDR	4.9793485e-05
11,675	Pipeline Group Optimization on Disaggregated Systems	2023	CIDR	4.9793485e-05
11,727	SH2O: Efficient Data Access for Work-Sharing Databases	2023	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00053930011
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.000392237
389	QPipe: A Simultaneously Pipelined Relational Query Engine	2005	SIGMOD	0.00019269777
626	Adaptive Aggregation on Chip Multiprocessors	2007	VLDB	0.00015473276
634	Performance Tradeoffs in Read-Optimized Databases	2006	VLDB	0.00015373122
762	Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS	2007	VLDB	0.00014140446
1,770	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.686541e-05
4,056	The Case for Precision Sharing	2004	VLDB	6.8261065e-05
4,577	To Share or Not to Share?	2007	VLDB	6.523408e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,011	Deployment of Query Plans on Multicores	2015	VLDB
2	4,702	Adaptive NUMA-aware data placement and task scheduling for analytical workloads in main-memory column-stores	2017	VLDB
3	11,461	Oligolithic Cross-task Optimizations across Isolated Workloads*	2024	CIDR
4	2,466	Concurrent Analytical Query Processing with GPUs	2014	VLDB
5	4,754	Performance Analysis of a Load Balancing Hash-Join Algorithm for a Shared Memory Multiprocessor	1991	VLDB
6	8,409	Effective Resource Utilization for Multiprocessor Join Execution	1989	VLDB
7	9,617	MCC-DB: Minimizing Cache Conflicts in Multi-core Processors for Databases	2009	VLDB
8	4,730	MQJoin: Efficient Shared Execution of Main-Memory Joins	2016	VLDB
9	4,713	Scalable Reservoir Sampling on Many-Core CPUs	2019	SIGMOD
10	4,577	To Share or Not to Share?	2007	VLDB