Incremental Organization for Data Recording and Warehousing

Summary: Introduces two external-sort-inspired incremental organization schemes for high-rate streams, balancing write efficiency with key-based query locality. Includes concurrency control and recovery designs, with analytical and experimental validation for warehousing and recording workloads. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: 8593
Venue: VLDB
Year: 1997
Pagerank: 0.0001284025
Overall Rank: 981 | 93.28%
DOI: -

Incoming Non-self Citations Over Time

Authors

1. H. V. Jagadish (AT&T)
2. P. P. S. Narayan (AT&T; Indian Institute of Technology)
3. S. Seshadri (Indian Institute of Technology)
4. Rama Kanneganti (AT&T)
5. S. Sudarshan (AT&T; Indian Institute of Technology)

BibTeX Citation

@article{jagadish_vldb97,
        title = {{Incremental Organization for Data Recording and Warehousing}},
        author = {Jagadish, H. V. and Narayan, P. P. S. and Seshadri, S. and Kanneganti, Rama and Sudarshan, S.},
        journal = {PVLDB},
        series = {{VLDB} '97},
        pages = {16},
        year = {1997}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
512	Tree Indexing on Solid State Drives	2010	VLDB	0.00017196795
807	Design, Implementation, and Performance of the LHAM Log-Structured History Data Access Method	1998	VLDB	0.00013884448
831	Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging	2018	SIGMOD	0.00013748512
857	SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data	2017	VLDB	0.00013568886
1,347	X-Engine: An Optimized Storage Engine for Large-scale E-commerce Transaction Processing	2019	SIGMOD	0.00011073571
1,502	The Log-Structured Merge-Bush & the Wacky Continuum	2019	SIGMOD	0.00010557694
1,508	Sorting And Indexing With Partitioned B-Trees	2003	CIDR	0.00010540965
1,629	Positional Update Handling in Column Stores	2010	SIGMOD	0.00010184131
1,942	Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn	2019	CIDR	9.4451535e-05
1,954	Chucky: A Succinct Cuckoo Filter for LSM-Tree	2021	SIGMOD	9.4208165e-05
2,396	A Novel Index Supporting High Volume Data Warehouse Insertions	1999	VLDB	8.6345567e-05
2,698	Rosetta: A Robust Space-Time Optimized Range Filter for Key-Value Stores	2020	SIGMOD	8.2450522e-05
3,566	Efficient Bulk Insertion into a Distributed Ordered Table	2008	SIGMOD	7.303217e-05
3,802	Leaper: A Learned Prefetcher for Cache Invalidation in LSM-tree based Storage Engines	2020	VLDB	7.1115502e-05
4,826	Design Tradeoffs of Data Access Methods	2016	SIGMOD	6.4904836e-05
5,304	An Evaluation of Generic Bulk Loading Techniques	2001	VLDB	6.2733516e-05
7,804	Online B-Tree Merging	2005	SIGMOD	5.5415082e-05
8,072	Operational Analytics Data Management Systems	2016	VLDB	5.4933919e-05
8,919	MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying	2023	SIGMOD	5.3483178e-05
8,937	Dynamic Indexability and Lower Bounds for Dynamic One-Dimensional Range Query Indexes	2009	PODS	5.3483178e-05
9,481	The End of Moore’s Law and the Rise of The Data Processor	2021	VLDB	5.2634238e-05
11,017	Streaming View: An Efficient Data Processing Engine for Modern Real-time Data Warehouse of Alibaba Cloud	2025	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
59	Differential Files: Their Application To The Maintenance Of Large Data Bases	1976	SIGMOD	0.00040060625
214	ARIES/KVL: A Key-Value Locking Method for Concurrency Control of Multiaction Transactions Operating on B-Tree Indexes	1990	VLDB	0.00024680756

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,944	On-line Reorganization in Object Databases	2000	SIGMOD
2	1,022	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB
3	8,075	Online Reorganization in Read Optimized MMDBS	2011	SIGMOD
4	2,801	Concurrency and Linear Hashing	1985	PODS
5	3,220	Efficient Resumption of Interrupted Warehouse Loads	2000	SIGMOD
6	4,374	Distributed File Organization with Scalable Cost/Performance	1994	SIGMOD
7	6,497	Index Maintenance for Non-Uniform Record Distributions	1984	PODS
8	11,460	Out-of-Order Sliding-Window Aggregation with Efficient Bulk Evictions and Insertions	2023	VLDB
9	5,715	Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases	2013	VLDB
10	2,729	On-the-Fly, Incremental, Consistent Reading of Entire Databases	1985	VLDB