Liquid: Unifying Nearline and Offline Big Data Integration

Summary: Liquid replaces DFS-centric batch stacks with a unified nearline+offline integration architecture: a stateful stream-processing layer for incremental, low-latency transforms plus a highly-available pub/sub messaging layer. Deployed at LinkedIn, it provides cost-efficient, scalable pre-processing for real-time and batch consumers. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 268
Venue: CIDR
Year: 2015
Pagerank: 4.901516e-05
Overall Rank: 6,856 | 52.36%
DOI: -

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,339	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.0029559e-05
3,335	SnappyData: A Unified Cluster for Streaming, Transactions, and Interactive Analytics	2017	CIDR	7.2023806e-05
4,824	Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka	2021	SIGMOD	5.8902451e-05
6,488	FILM: a Fully Learned Index for Larger-than-Memory Databases	2023	VLDB	5.0378878e-05

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
70	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00059744625
287	Storm @Twitter	2014	SIGMOD	0.00028917909
539	Shark: SQL and Rich Analytics at Scale	2013	SIGMOD	0.00020615453
980	Anti-Caching: A New Approach to Database Management System Architecture	2013	VLDB	0.00014868633
1,226	Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management	2013	SIGMOD	0.00013168869
1,497	Apache Hadoop Goes Realtime at Facebook	2011	SIGMOD	0.00011668393
2,063	Stream Warehousing with DataDepot	2009	SIGMOD	9.6490291e-05
2,658	Data Warehousing and Analytics Infrastructure at Facebook	2010	SIGMOD	8.3634079e-05
3,021	Enterprise Information Integration: Successes, Challenges and Controversies	2005	SIGMOD	7.695431e-05
4,485	OpenII: An Open Source Information Integration Toolkit	2010	SIGMOD	6.142053e-05
7,879	Emerging Trends in the Enterprise Data Analytics: Connecting Hadoop and DB2 Warehouse	2011	SIGMOD	4.6253726e-05
8,985	SpongeFiles: Mitigating Data Skew in MapReduce Using Distributed Memory	2014	SIGMOD	4.4129993e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,339	Samza: Stateful Scalable Stream Processing at LinkedIn	2017	VLDB	9.0029559e-05
2,710	Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core	2006	SIGMOD	8.2580301e-05
7,735	From a Stream of Relational Queries to Distributed Stream Processing	2010	VLDB	4.6599101e-05
3,387	Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database	2015	SIGMOD	7.1505623e-05
4,766	Pinot: Realtime OLAP for 530 Million Users	2018	SIGMOD	5.933206e-05
6,430	Providing Streaming Joins as a Service at Facebook	2018	VLDB	5.0587634e-05
4,859	The "Big Data" Ecosystem at LinkedIn	2013	SIGMOD	5.8680444e-05
6,128	Data Ingestion for the Connected World	2017	CIDR	5.1943896e-05
1,858	On Brewing Fresh Espresso: LinkedIn’s Distributed Data Serving Platform	2013	SIGMOD	0.00010311085
10,858	LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics	2025	VLDB	4.1905499e-05