Incremental Organization for Data Recording and Warehousing

Summary: Introduces two external-sort-inspired incremental organization schemes for high-rate streams, balancing write efficiency with key-based query locality. Includes concurrency control and recovery designs, with analytical and experimental validation for warehousing and recording workloads. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: h6a415f56748874f8
Venue: VLDB
Year: 1997
Pagerank: 0.0001279879
Overall Rank: 966 | 93.51%
DOI: -

Incoming Non-self Citations Over Time

Authors

1. H. V. Jagadish (AT&T)
2. P. P. S. Narayan (AT&T; Indian Institute of Technology)
3. S. Seshadri (Indian Institute of Technology)
4. Rama Kanneganti (AT&T)
5. S. Sudarshan (AT&T; Indian Institute of Technology)

BibTeX Citation

@article{jagadish_vldb97,
        title = {{Incremental Organization for Data Recording and Warehousing}},
        author = {Jagadish, H. V. and Narayan, P. P. S. and Seshadri, S. and Kanneganti, Rama and Sudarshan, S.},
        journal = {PVLDB},
        series = {{VLDB} '97},
        pages = {16},
        year = {1997}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
513	Tree Indexing on Solid State Drives	2010	VLDB	0.00017044842
754	Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging	2018	SIGMOD	0.00014236015
815	Design, Implementation, and Performance of the LHAM Log-Structured History Data Access Method	1998	VLDB	0.00013689839
816	SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data	2017	VLDB	0.00013687311
1,313	X-Engine: An Optimized Storage Engine for Large-scale E-commerce Transaction Processing	2019	SIGMOD	0.00011060108
1,422	The Log-Structured Merge-Bush & the Wacky Continuum	2019	SIGMOD	0.00010725538
1,539	Sorting And Indexing With Partitioned B-Trees	2003	CIDR	0.00010316015
1,632	Positional Update Handling in Column Stores	2010	SIGMOD	0.00010021251
1,889	Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn	2019	CIDR	9.4273689e-05
1,980	Chucky: A Succinct Cuckoo Filter for LSM-Tree	2021	SIGMOD	9.2595896e-05
2,431	A Novel Index Supporting High Volume Data Warehouse Insertions	1999	VLDB	8.4776498e-05
2,664	Rosetta: A Robust Space-Time Optimized Range Filter for Key-Value Stores	2020	SIGMOD	8.1569551e-05
3,639	Efficient Bulk Insertion into a Distributed Ordered Table	2008	SIGMOD	7.1444069e-05
3,671	Leaper: A Learned Prefetcher for Cache Invalidation in LSM-tree based Storage Engines	2020	VLDB	7.1100217e-05
4,364	An Evaluation of Generic Bulk Loading Techniques	2001	VLDB	6.6343719e-05
4,885	Design Tradeoffs of Data Access Methods	2016	SIGMOD	6.3706825e-05
7,958	Online B-Tree Merging	2005	SIGMOD	5.4182694e-05
8,228	Operational Analytics Data Management Systems	2016	VLDB	5.3736562e-05
9,081	MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying	2023	SIGMOD	5.2283159e-05
9,100	Dynamic Indexability and Lower Bounds for Dynamic One-Dimensional Range Query Indexes	2009	PODS	5.2283159e-05
9,662	The End of Moore’s Law and the Rise of The Data Processor	2021	VLDB	5.1453267e-05
10,885	Storing and Indexing Multiple Tables by Interesting Orderings: For Efficient Joins, Groupings, and Updates in Relational Databases	2026	VLDB	4.9793485e-05
11,382	Streaming View: An Efficient Data Processing Engine for Modern Real-time Data Warehouse of Alibaba Cloud	2025	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
59	Differential Files: Their Application To The Maintenance Of Large Data Bases	1976	SIGMOD	0.00039605949
221	ARIES/KVL: A Key-Value Locking Method for Concurrency Control of Multiaction Transactions Operating on B-Tree Indexes	1990	VLDB	0.00024274803

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,112	On-line Reorganization in Object Databases	2000	SIGMOD
2	1,034	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB
3	8,233	Online Reorganization in Read Optimized MMDBS	2011	SIGMOD
4	2,862	Concurrency and Linear Hashing	1985	PODS
5	3,278	Efficient Resumption of Interrupted Warehouse Loads	2000	SIGMOD
6	6,623	Index Maintenance for Non-Uniform Record Distributions	1984	PODS
7	4,467	Distributed File Organization with Scalable Cost/Performance	1994	SIGMOD
8	11,772	Out-of-Order Sliding-Window Aggregation with Efficient Bulk Evictions and Insertions	2023	VLDB
9	5,827	Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases	2013	VLDB
10	2,781	On-the-Fly, Incremental, Consistent Reading of Entire Databases	1985	VLDB