Main-Memory Scan Sharing For Multi-Core CPUs

Summary: Introduces FullSharing and cache-aware BatchSharing to share scans across concurrent BI queries while preventing aggregation-table thrashing on multicore systems. Lottery scheduling preserves fairness and bounded staging, delivering 2–2.5× throughput on 8 cores. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 9891
Venue: VLDB
Year: 2008
Pagerank: 0.00014891322
Overall Rank: 696 | 95.23%
DOI: 10.14778/1454159.1454165

Incoming Non-self Citations Over Time

Authors

1. Lin Qiao (IBM)
2. Vijayshankar Raman (IBM)
3. Frederick Reiss (IBM)
4. Peter J. Haas (IBM)
5. Guy M. Lohman (IBM)

BibTeX Citation

@article{qiao_vldb08,
        title = {{Main-Memory Scan Sharing For Multi-Core CPUs}},
        author = {Qiao, Lin and Raman, Vijayshankar and Reiss, Frederick and Haas, Peter J. and Lohman, Guy M.},
        journal = {PVLDB},
        series = {{VLDB} '08},
        volume = {1},
        number = {1},
        pages = {610--621},
        doi = {10.14778/1454159.1454165},
        url = {https://doi.org/10.14778/1454159.1454165},
        year = {2008}
}

Incoming Citations (Sorted by Pagerank)

Showing 33 of 33 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
216	SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units	2009	VLDB	0.00024498128
670	SharedDB: Killing One Thousand Queries With One Stone	2012	VLDB	0.00015157572
803	MRShare: Sharing Across Multiple Queries in MapReduce	2010	VLDB	0.00013899943
1,022	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB	0.00012602841
1,150	DimmWitted: A Study of Main-Memory Statistical Analytics	2014	VLDB	0.00011943462
1,238	BatchDB: Efficient Isolated Execution of Hybrid OLTP+OLAP Workloads for Interactive Applications	2017	SIGMOD	0.00011543368
1,765	Selecting Subexpressions to Materialize at Datacenter Scale	2018	VLDB	9.8079546e-05
1,879	Predictable Performance for Unpredictable Workloads	2009	VLDB	9.5613416e-05
1,927	Here are my Data Files. Here are my Queries. Where are my Results?	2011	CIDR	9.4703074e-05
2,156	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	9.0635624e-05
2,276	Shared Workload Optimization	2014	VLDB	8.8196376e-05
2,316	Evaluating End-to-End Optimization for Data Analytics Applications in Weld	2018	VLDB	8.7596739e-05
3,513	Variance Aware Optimization of Parameterized Queries	2010	SIGMOD	7.354613e-05
3,598	Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe?	2017	SIGMOD	7.2718988e-05
3,605	Computation Reuse in Analytics Job Service at Microsoft	2018	SIGMOD	7.2640711e-05
4,058	Fast Scans on Key-Value Stores	2017	VLDB	6.9335663e-05
4,330	Sharing Data and Work Across Concurrent Analytical Queries	2013	VLDB	6.7563122e-05
4,639	MQJoin: Efficient Shared Execution of Main-Memory Joins	2016	VLDB	6.5918791e-05
4,816	A Top-Down Approach to Achieving Performance Predictability in Database Systems	2017	SIGMOD	6.4949878e-05
4,988	UpBit: Scalable In-Memory Updatable Bitmap Indexing	2016	SIGMOD	6.4107392e-05
5,512	BinDex: A Two-Layered Index for Fast and Robust Scans	2020	SIGMOD	6.1913331e-05
5,947	Revisiting Reuse in Main Memory Database Systems	2017	SIGMOD	6.0323707e-05
6,684	CrocodileDB: Efficient Database Execution through Intelligent Deferment	2020	CIDR	5.8036476e-05
7,412	RTScan: Efficient Scan with Ray Tracing Cores	2024	VLDB	5.624223e-05
7,579	Resource-efficient Shared Query Execution via Exploiting Time Slackness	2021	SIGMOD	5.592546e-05
7,710	Mining Tree-Structured Data on Multicore Systems	2009	VLDB	5.5618769e-05
8,306	ParTime: Parallel Temporal Aggregation	2016	SIGMOD	5.4568273e-05
8,962	Automatic Contention Detection and Amelioration for Data-Intensive Operations	2010	SIGMOD	5.3435928e-05
9,449	MCC-DB: Minimizing Cache Conflicts in Multi-core Processors for Databases	2009	VLDB	5.2665098e-05
9,607	Sharing Opportunities for OLTP Workloads in Different Isolation Levels	2020	VLDB	5.2473912e-05
11,113	Oligolithic Cross-task Optimizations across Isolated Workloads*	2024	CIDR	5.093636e-05
11,358	Pipeline Group Optimization on Disaggregated Systems	2023	CIDR	5.093636e-05
11,413	SH2O: Efficient Data Access for Work-Sharing Databases	2023	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 9 of 9 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
25	NiagaraCQ: A Scalable Continuous Query System for Internet Databases	2000	SIGMOD	0.00054667018
60	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0003955489
383	QPipe: A Simultaneously Pipelined Relational Query Engine	2005	SIGMOD	0.00019520728
630	Performance Tradeoffs in Read-Optimized Databases	2006	VLDB	0.00015591796
632	Adaptive Aggregation on Chip Multiprocessors	2007	VLDB	0.00015575286
761	Cooperative Scans: Dynamic Bandwidth Sharing in a DBMS	2007	VLDB	0.00014254351
1,748	How to Wring a Table Dry: Entropy Compression of Relations and Querying of Compressed Relations	2006	VLDB	9.8480684e-05
3,978	The Case for Precision Sharing	2004	VLDB	6.9771565e-05
4,508	To Share or Not to Share?	2007	VLDB	6.6561159e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	4,085	Deployment of Query Plans on Multicores	2015	VLDB
2	4,607	Adaptive NUMA-aware data placement and task scheduling for analytical workloads in main-memory column-stores	2017	VLDB
3	11,113	Oligolithic Cross-task Optimizations across Isolated Workloads*	2024	CIDR
4	2,504	Concurrent Analytical Query Processing with GPUs	2014	VLDB
5	4,668	Performance Analysis of a Load Balancing Hash-Join Algorithm for a Shared Memory Multiprocessor	1991	VLDB
6	8,243	Effective Resource Utilization for Multiprocessor Join Execution	1989	VLDB
7	9,449	MCC-DB: Minimizing Cache Conflicts in Multi-core Processors for Databases	2009	VLDB
8	4,639	MQJoin: Efficient Shared Execution of Main-Memory Joins	2016	VLDB
9	4,800	Scalable Reservoir Sampling on Many-Core CPUs	2019	SIGMOD
10	4,508	To Share or Not to Share?	2007	VLDB