Data Ingestion for the Connected World

Summary: Positions traditional batch ETL as the bottleneck for timely analytics in connected/IoT settings and advocates a push-based streaming-ETL architecture to ensure scalable, correct ingestion. Implements this with Kafka + transactional S-Store + BigDAWG and a new ingestion-optimized time-series DB. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 290
Venue: CIDR
Year: 2017
Pagerank: 5.1991194e-05
Overall Rank: 6,123 | 57.41%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,286	Monarch: Google’s Planet-Scale In-Memory Time Series Database	2020	VLDB	7.2740159e-05
6,877	Extract-Transform-Load for Video Streams	2023	VLDB	4.8974054e-05
8,151	Visual Exploration of Time Series Anomalies with Metro-Viz	2019	SIGMOD	4.5746365e-05
9,361	An IDEA: An Ingestion Framework for Data Enrichment in AsterixDB	2019	VLDB	4.3506168e-05
9,381	MorphStream: Adaptive Scheduling for Scalable Transactional Stream Processing on Multicores	2023	SIGMOD	4.3459591e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
137	H-Store: A High-Performance, Distributed Main Memory Transaction Processing System	2008	VLDB	0.00042342967
210	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.0003404384
318	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00027795661
824	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.0001623129
1,820	A Demonstration of the BigDAWG Polystore System	2015	VLDB	0.00010428281
2,264	S-Store: Streaming Meets Transaction Processing	2015	VLDB	9.1575142e-05
4,788	Consistency in a Stream Warehouse	2011	CIDR	5.9200462e-05
5,114	TPC-DI: The First Industry Benchmark for Data Integration	2014	VLDB	5.6863051e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
6,877	Extract-Transform-Load for Video Streams	2023	VLDB	4.8974054e-05
10,788	Streaming View: An Efficient Data Processing Engine for Modern Real-time Data Warehouse of Alibaba Cloud	2025	VLDB	4.1945683e-05
3,388	Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database	2015	SIGMOD	7.1571148e-05
6,856	Liquid: Unifying Nearline and Offline Big Data Integration	2015	CIDR	4.9060615e-05
11,802	Query-able Kafka: An agile data analytics pipeline for mobile wireless networks	2017	VLDB	4.1945683e-05
9,114	Data Stream Warehousing in Tidalrace	2015	CIDR	4.3935469e-05
1,820	A Demonstration of the BigDAWG Polystore System	2015	VLDB	0.00010428281
4,167	Scalable Distributed Stream Join Processing	2015	SIGMOD	6.3919506e-05
538	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020678804
9,504	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3341665e-05