Self-Organizing Data Containers
Summary: Self-Organizing Data Containers (SDCs): a metadata-rich cloud storage format that instance-optimizes data representation to exploit actual data distributions and workloads, promising large speedups over static formats like Arrow/Parquet. Unifies partitioning, replication, indexing and materialization while capturing access histories and distributional statistics; presents a preliminary design, motivating experiments, and open optimization/systems challenges. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Samuel Madden (Massachusetts Institute of Technology)
- 2. Jialin Ding (Massachusetts Institute of Technology)
- 3. Tim Kraska (Massachusetts Institute of Technology)
- 4. Sivaprasad Sudhir (Massachusetts Institute of Technology)
- 5. David Cohen (Intel)
- 6. Timothy Mattson (Intel)
- 7. Nesime Tatbul (Intel; Massachusetts Institute of Technology)
BibTeX Citation
@inproceedings{madden_cidr22,
address = {Amsterdam, Netherlands},
series = {{CIDR} '22},
title = {{Self-Organizing Data Containers}},
booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
author = {Madden, Samuel and Ding, Jialin and Kraska, Tim and Sudhir, Sivaprasad and Cohen, David and Mattson, Timothy and Tatbul, Nesime},
year = {2022}
}Incoming Citations (Sorted by Pagerank)
Showing 6 of 6 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 3,877 | An Empirical Evaluation of Columnar Storage Formats | 2024 | VLDB | 7.0532293e-05 |
| 4,457 | Analyzing and Comparing Lakehouse Storage Systems | 2023 | CIDR | 6.6913393e-05 |
| 5,037 | A Deep Dive into Common Open Formats for Analytical DBMSs | 2023 | VLDB | 6.3914026e-05 |
| 6,042 | Pando: Enhanced Data Skipping with Logical Data Partitioning | 2023 | VLDB | 5.9970052e-05 |
| 9,881 | The Image Calculator: 10x Faster Image-AI Inference by Replacing JPEG with Self-designing Storage Format | 2024 | SIGMOD | 5.2040783e-05 |
| 9,913 | Adaptive data transformations for QaaS | 2025 | CIDR | 5.1955087e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 12 of 12 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 12,360 | Cloud Resource Orchestration: A Data-Centric Approach | 2011 | CIDR |
| 2 | 11,274 | Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines | 2024 | VLDB |
| 3 | 3,035 | Instance-Optimized Data Layouts for Cloud Analytics Workloads | 2021 | SIGMOD |
| 4 | 7,428 | Invisible Glue: Scalable Self-Tuning Multi-Stores | 2015 | CIDR |
| 5 | 8,347 | WWHow! Freeing Data Storage from Cages | 2013 | CIDR |
| 6 | 5,083 | Automating Distributed Tiered Storage Management in Cluster Computing | 2020 | VLDB |
| 7 | 5,978 | From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems | 2019 | SIGMOD |
| 8 | 2,411 | Towards Elastic Transactional Cloud Storage with Range Query Support | 2010 | VLDB |
| 9 | 3,877 | An Empirical Evaluation of Columnar Storage Formats | 2024 | VLDB |
| 10 | 9,836 | Towards Functional Decomposition of Storage Formats | 2025 | CIDR |