DBScholar

Back to papers

Liquid: Unifying Nearline and Offline Big Data Integration

Summary: Liquid replaces DFS-centric batch stacks with a unified nearline+offline integration architecture: a stateful stream-processing layer for incremental, low-latency transforms plus a highly-available pub/sub messaging layer. Deployed at LinkedIn, it provides cost-efficient, scalable pre-processing for real-time and batch consumers. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID
267
Venue
CIDR
Year
2015
Pagerank
5.7879923e-05
Overall Rank
6,734 | 53.80%
DOI
-

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{fernandez_cidr15,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '15},
        title = {{Liquid: Unifying Nearline and Offline Big Data Integration}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Fernandez, Raul Castro and Pietzuch, Peter and Kreps, Jay and Narkhede, Neha and Rao, Jun and Koshy, Joel and Lin, Dong and Riccomini, Chris and Wang, Guozhang},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank Citing Paper Year Venue Pagerank
1,895 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB 9.5260291e-05
2,868 SnappyData: A Unified Cluster for Streaming, Transactions, and Interactive Analytics 2017 CIDR 8.0156936e-05
4,389 Consistency and Completeness: Rethinking Distributed Stream Processing in Apache Kafka 2021 SIGMOD 6.7304854e-05
5,447 FILM: a Fully Learned Index for Larger-than-Memory Databases 2023 VLDB 6.2149491e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 12 of 12 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
220 Storm @Twitter 2014 SIGMOD 0.00024244587
425 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00018704491
720 Anti-Caching: A New Approach to Database Management System Architecture 2013 VLDB 0.00014632914
983 Integrating Scale Out and Fault Tolerance in Stream Processing using Operator State Management 2013 SIGMOD 0.0001283214
1,324 Apache Hadoop Goes Realtime at Facebook 2011 SIGMOD 0.00011149314
2,191 Data Warehousing and Analytics Infrastructure at Facebook 2010 SIGMOD 8.9780154e-05
2,502 Stream Warehousing with DataDepot 2009 SIGMOD 8.4972586e-05
3,664 Enterprise Information Integration: Successes, Challenges and Controversies 2005 SIGMOD 7.2148176e-05
4,164 OpenII: An Open Source Information Integration Toolkit 2010 SIGMOD 6.8600415e-05
7,965 Emerging Trends in the Enterprise Data Analytics: Connecting Hadoop and DB2 Warehouse 2011 SIGMOD 5.5174991e-05
9,137 SpongeFiles: Mitigating Data Skew in MapReduce Using Distributed Memory 2014 SIGMOD 5.3162511e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 1,895 Samza: Stateful Scalable Stream Processing at LinkedIn 2017 VLDB
2 2,393 Design, Implementation, and Evaluation of the Linear Road Benchmark on the Stream Processing Core 2006 SIGMOD
3 7,840 From a Stream of Relational Queries to Distributed Stream Processing 2010 VLDB
4 3,082 Analytics in Motion: High Performance Event-Processing AND Real-Time Analytics in the Same Database 2015 SIGMOD
5 4,231 Pinot: Realtime OLAP for 530 Million Users 2018 SIGMOD
6 6,108 Providing Streaming Joins as a Service at Facebook 2018 VLDB
7 4,595 The "Big Data" Ecosystem at LinkedIn 2013 SIGMOD
8 6,004 Data Ingestion for the Connected World 2017 CIDR
9 1,999 On Brewing Fresh Espresso: LinkedIn’s Distributed Data Serving Platform 2013 SIGMOD
10 11,078 LiquidCache: Efficient Pushdown Caching for Cloud-Native Data Analytics 2025 VLDB