Data Ingestion for the Connected World

Summary: Positions traditional batch ETL as the bottleneck for timely analytics in connected/IoT settings and advocates a push-based streaming-ETL architecture to ensure scalable, correct ingestion. Implements this with Kafka + transactional S-Store + BigDAWG and a new ingestion-optimized time-series DB. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 290
Venue: CIDR
Year: 2017
Pagerank: 5.1943896e-05
Overall Rank: 6,128 | 57.42%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 5 of 5 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,288	Monarch: Google’s Planet-Scale In-Memory Time Series Database	2020	VLDB	7.2680967e-05
6,868	Extract-Transform-Load for Video Streams	2023	VLDB	4.8982283e-05
8,155	Visual Exploration of Time Series Anomalies with Metro-Viz	2019	SIGMOD	4.5702491e-05
9,369	An IDEA: An Ingestion Framework for Data Enrichment in AsterixDB	2019	VLDB	4.3464471e-05
9,374	MorphStream: Adaptive Scheduling for Scalable Transactional Stream Processing on Multicores	2023	SIGMOD	4.3453721e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
136	H-Store: A High-Performance, Distributed Main Memory Transaction Processing System	2008	VLDB	0.00042409816
211	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.0003401421
319	Overview of SciDB: Large Scale Array Storage, Processing and Analysis	2010	SIGMOD	0.00027771951
822	Twitter Heron: Stream Processing at Scale	2015	SIGMOD	0.00016226851
1,818	A Demonstration of the BigDAWG Polystore System	2015	VLDB	0.00010418381
2,270	S-Store: Streaming Meets Transaction Processing	2015	VLDB	9.149662e-05
4,789	Consistency in a Stream Warehouse	2011	CIDR	5.9144227e-05
5,115	TPC-DI: The First Industry Benchmark for Data Integration	2014	VLDB	5.6808821e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
6,868	Extract-Transform-Load for Video Streams	2023	VLDB	4.8982283e-05
10,794	Streaming View: An Efficient Data Processing Engine for Modern Real-time Data Warehouse of Alibaba Cloud	2025	VLDB	4.1905499e-05
3,387	Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database	2015	SIGMOD	7.1505623e-05
6,856	Liquid: Unifying Nearline and Offline Big Data Integration	2015	CIDR	4.901516e-05
11,810	Query-able Kafka: An agile data analytics pipeline for mobile wireless networks	2017	VLDB	4.1905499e-05
9,112	Data Stream Warehousing in Tidalrace	2015	CIDR	4.3893358e-05
4,161	Scalable Distributed Stream Join Processing	2015	SIGMOD	6.3883784e-05
1,818	A Demonstration of the BigDAWG Polystore System	2015	VLDB	0.00010418381
536	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020651621
9,505	Supporting Scalable Analytics with Latency Constraints	2015	VLDB	4.3300131e-05