Column-Oriented Storage Techniques for MapReduce

Summary: Adapts columnar storage to Hadoop while preserving MapReduce APIs and replication/scheduling, delivering up to 100× faster map phases than text. A skip-list format and lazy record construction avoid deserializing unused nested data. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 10461
Venue: VLDB
Year: 2011
Pagerank: 8.053191e-05
Overall Rank: 2,849 | 80.46%
DOI: 10.14778/1988776.1988778

Incoming Non-self Citations Over Time

Authors

1. Avrilia Floratou (University of Wisconsin)
2. Jignesh M. Patel (University of Wisconsin)
3. Eugene J. Shekita (IBM)
4. Sandeep Tata (IBM)

BibTeX Citation

@article{floratou_vldb11,
        title = {{Column-Oriented Storage Techniques for MapReduce}},
        author = {Floratou, Avrilia and Patel, Jignesh M. and Shekita, Eugene J. and Tata, Sandeep},
        journal = {PVLDB},
        series = {{VLDB} '11},
        volume = {4},
        number = {7},
        doi = {10.14778/1988776.1988778},
        url = {https://doi.org/10.14778/1988776.1988778},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 16 of 16 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,889	SQL-on-Hadoop: Full Circle Back to Shared-Nothing Database Architectures	2014	VLDB	9.5335988e-05
2,539	Minimal MapReduce Algorithms	2013	SIGMOD	8.4526595e-05
2,706	Major Technical Advancements in Apache Hive	2014	SIGMOD	8.2287564e-05
3,008	Scalable Big Graph Processing in MapReduce	2014	SIGMOD	7.8578871e-05
3,106	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	7.7515666e-05
4,230	Can the Elephants Handle the NoSQL Onslaught?	2012	VLDB	6.8178353e-05
5,156	Only Aggressive Elephants are Fast Elephants	2012	VLDB	6.3410921e-05
5,395	AQWA: Adaptive Query-Workload-Aware Partitioning of Big Spatial Data	2015	VLDB	6.2331619e-05
6,103	VectorH: Taking SQL-on-Hadoop to the Next Level	2016	SIGMOD	5.9755412e-05
6,199	Clydesdale: Structured Data Processing on Hadoop	2012	SIGMOD	5.9458654e-05
6,640	Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters	2013	VLDB	5.8162526e-05
6,896	Wide Table Layout Optimization based on Column Ordering and Duplication	2017	SIGMOD	5.7440611e-05
8,276	CARTILAGE: Adding Flexibility to the Hadoop Skeleton	2013	SIGMOD	5.4574671e-05
9,510	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB	5.2576928e-05
9,594	Overview of Turn Data Management Platform for Digital Advertising	2013	VLDB	5.2509871e-05
11,381	Grouping Time Series for Efficient Columnar Storage	2023	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
6	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0010686205
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.0006312782
44	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00046055057
49	Weaving Relations for Cache Performance	2001	VLDB	0.00043781096
51	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.0004291425
60	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0003955489
120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00031680027
345	Column-Stores vs. Row-Stores: How Different Are They Really?	2008	SIGMOD	0.00020656723
660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB	0.00015198804
1,257	Automatic Optimization for MapReduce Programs	2011	VLDB	0.000114432
1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB	0.00010797443
1,679	Self-organizing Tuple Reconstruction in Column-stores	2009	SIGMOD	0.00010029136
1,791	Cheetah: A High Performance, Custom Data Warehouse on Top of MapReduce	2010	VLDB	9.7470504e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,395	Column-oriented Database Systems	2009	VLDB
2	120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB
3	2,539	Minimal MapReduce Algorithms	2013	SIGMOD
4	2,265	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD
5	9,510	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB
6	660	Hadoop++: Making a Yellow Elephant Run Like a Cheetah (Without It Even Noticing)	2010	VLDB
7	2,642	CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop	2011	VLDB
8	6,896	Wide Table Layout Optimization based on Column Ordering and Duplication	2017	SIGMOD
9	3,877	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB
10	1,436	The Performance of MapReduce: An In-depth Study	2010	VLDB