Liquid: Unifying Nearline and Offline Big Data Integration

Summary: Liquid replaces DFS-centric batch stacks with a unified nearline+offline integration architecture: a stateful stream-processing layer for incremental, low-latency transforms plus a highly-available pub/sub messaging layer. Deployed at LinkedIn, it provides cost-efficient, scalable pre-processing for real-time and batch consumers. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 268
Venue: CIDR
Year: 2015
Pagerank: 4.9060615e-05
Overall Rank: 6,856 | 52.31%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,338	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.00711e-05
3,333	SnappyData: A Unified Cluster for Streaming, Transactions, and Interactive Analytics	2017	CIDR	7.2093479e-05
4,822	Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka	2021	SIGMOD	5.8959131e-05
6,492	FILM: a Fully Learned Index for Larger-than-Memory Databases	2023	VLDB	5.042727e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
70	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00059533166
288	Storm @Twitter	2014	SIGMOD	0.00028939871
542	Shark: SQL and Rich Analytics at Scale	2013	SIGMOD	0.00020595648
982	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014872253
1,226	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00013180799
1,499	Apache Hadoop Goes Realtime at Facebook	2011	SIGMOD	0.00011675192
2,059	Stream Warehousing with DataDepot	2009	SIGMOD	9.6582554e-05
2,658	Data Warehousing and Analytics Infrastructure at Facebook	2010	SIGMOD	8.3607429e-05
3,017	Enterprise Information Integration: Successes, Challenges and Controversies	2005	SIGMOD	7.7028124e-05
4,486	OpenII: An Open Source Information Integration Toolkit	2010	SIGMOD	6.1455674e-05
7,877	Emerging Trends in the Enterprise Data Analytics: Connecting Hadoop and DB2 Warehouse	2011	SIGMOD	4.6297559e-05
8,978	SpongeFiles: Mitigating Data Skew in MapReduce Using Distributed Memory	2014	SIGMOD	4.417225e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,338	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.00711e-05
2,706	Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core	2006	SIGMOD	8.2673299e-05
7,736	From a Stream of Relational Queries to Distributed Stream Processing	2010	VLDB	4.664248e-05
3,388	Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database	2015	SIGMOD	7.1571148e-05
4,767	Pinot: Realtime OLAP for 530 Million Users	2018	SIGMOD	5.9364731e-05
6,436	Providing Streaming Joins as a Service at Facebook	2018	VLDB	5.0636254e-05
4,857	The "Big Data" Ecosystem at LinkedIn	2013	SIGMOD	5.8736144e-05
6,123	Data Ingestion for the Connected World	2017	CIDR	5.1991194e-05
1,853	On Brewing Fresh Espresso: LinkedIn’s Distributed Data Serving Platform	2013	SIGMOD	0.00010320369
10,854	LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics	2025	VLDB	4.1945683e-05