Incremental Organization for Data Recording and Warehousing

Summary: Introduces two external-sort-inspired incremental organization schemes for high-rate streams, balancing write efficiency with key-based query locality. Includes concurrency control and recovery designs, with analytical and experimental validation for warehousing and recording workloads. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: h6a415f56748874f8
Venue: VLDB
Year: 1997
Pagerank: 0.00012755618
Overall Rank: 969 | 93.51%
DOI: -

Incoming Non-self Citations Over Time

Authors

1. H. V. Jagadish (AT&T)
2. P. P. S. Narayan (AT&T; Indian Institute of Technology)
3. S. Seshadri (Indian Institute of Technology)
4. Rama Kanneganti (AT&T)
5. S. Sudarshan (AT&T; Indian Institute of Technology)

BibTeX Citation

@article{jagadish_vldb97,
        title = {{Incremental Organization for Data Recording and Warehousing}},
        author = {Jagadish, H. V. and Narayan, P. P. S. and Seshadri, S. and Kanneganti, Rama and Sudarshan, S.},
        journal = {PVLDB},
        series = {{VLDB} '97},
        pages = {16},
        year = {1997}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
515	Tree Indexing on Solid State Drives	2010	VLDB	0.00016989841
761	Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging	2018	SIGMOD	0.00014191047
814	SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data	2017	VLDB	0.00013697533
818	Design, Implementation, and Performance of the LHAM Log-Structured History Data Access Method	1998	VLDB	0.00013657405
1,324	X-Engine: An Optimized Storage Engine for Large-scale E-commerce Transaction Processing	2019	SIGMOD	0.00011019001
1,429	The Log-Structured Merge-Bush & the Wacky Continuum	2019	SIGMOD	0.00010685393
1,543	Sorting And Indexing With Partitioned B-Trees	2003	CIDR	0.00010277834
1,637	Positional Update Handling in Column Stores	2010	SIGMOD	9.9898497e-05
1,900	Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn	2019	CIDR	9.3926585e-05
1,991	Chucky: A Succinct Cuckoo Filter for LSM-Tree	2021	SIGMOD	9.2264312e-05
2,443	A Novel Index Supporting High Volume Data Warehouse Insertions	1999	VLDB	8.4468451e-05
2,667	Rosetta: A Robust Space-Time Optimized Range Filter for Key-Value Stores	2020	SIGMOD	8.1324472e-05
3,647	Efficient Bulk Insertion into a Distributed Ordered Table	2008	SIGMOD	7.1176467e-05
3,679	Leaper: A Learned Prefetcher for Cache Invalidation in LSM-tree based Storage Engines	2020	VLDB	7.0849238e-05
4,391	An Evaluation of Generic Bulk Loading Techniques	2001	VLDB	6.6093384e-05
4,897	Design Tradeoffs of Data Access Methods	2016	SIGMOD	6.3489205e-05
7,979	Online B-Tree Merging	2005	SIGMOD	5.3978271e-05
8,250	Operational Analytics Data Management Systems	2016	VLDB	5.3539237e-05
9,111	MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying	2023	SIGMOD	5.208561e-05
9,129	Dynamic Indexability and Lower Bounds for Dynamic One-Dimensional Range Query Indexes	2009	PODS	5.208561e-05
9,698	The End of Moore’s Law and the Rise of The Data Processor	2021	VLDB	5.1258854e-05
10,955	Storing and Indexing Multiple Tables by Interesting Orderings: For Efficient Joins, Groupings, and Updates in Relational Databases	2026	VLDB	4.9605343e-05
11,441	Streaming View: An Efficient Data Processing Engine for Modern Real-time Data Warehouse of Alibaba Cloud	2025	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
59	Differential Files: Their Application To The Maintenance Of Large Data Bases	1976	SIGMOD	0.00039478403
221	ARIES/KVL: A Key-Value Locking Method for Concurrency Control of Multiaction Transactions Operating on B-Tree Indexes	1990	VLDB	0.0002420049

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	8,137	On-line Reorganization in Object Databases	2000	SIGMOD
2	1,029	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB
3	8,256	Online Reorganization in Read Optimized MMDBS	2011	SIGMOD
4	2,872	Concurrency and Linear Hashing	1985	PODS
5	3,290	Efficient Resumption of Interrupted Warehouse Loads	2000	SIGMOD
6	4,491	Distributed File Organization with Scalable Cost/Performance	1994	SIGMOD
7	6,638	Index Maintenance for Non-Uniform Record Distributions	1984	PODS
8	11,822	Out-of-Order Sliding-Window Aggregation with Efficient Bulk Evictions and Insertions	2023	VLDB
9	5,839	Design and Evaluation of Storage Organizations for Read-Optimized Main Memory Databases	2013	VLDB
10	2,788	On-the-Fly, Incremental, Consistent Reading of Entire Databases	1985	VLDB