Scribe: How Meta transports terabytes per second in real time

Summary: Scribe: Meta’s multi-tenant, low-latency message queue ingesting >15 TB/s and delivering >110 TB/s to consumers for massive real-time streams. Key innovations: a multi-hop write path with opportunistic placement to maximize write availability, and an adaptive read path that tunes replica placement/representation per workload while exposing tunable delivery guarantees. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 14087
Venue: VLDB
Year: 2025
Pagerank: 4.1945683e-05
Overall Rank: 10,766 | 25.11%
DOI: 10.14778/3750601.3750607

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
131	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0004370331
314	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00028084774
432	Flexible Time Management in Data Stream Systems	2004	PODS	0.00023368424
538	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020678804
1,487	Scuba: Diving into Data at Facebook	2013	VLDB	0.00011701099
1,551	Out-of-Order Processing: A New Architecture for High-Performance Stream Systems	2008	VLDB	0.00011416058
1,613	Realtime Data Processing at Facebook	2016	SIGMOD	0.00011140777
2,528	Velox: Meta’s Unified Execution Engine	2022	VLDB	8.59454e-05
2,693	An Architecture for Recycling Intermediates in a Column-store	2009	SIGMOD	8.2883398e-05
3,402	TAO: How Facebook Serves the Social Graph	2012	SIGMOD	7.1378698e-05
5,531	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	5.4549499e-05
9,111	Meta's Next-generation Realtime Monitoring and Analytics Platform	2022	VLDB	4.3942367e-05
9,401	Vortex: A Stream-oriented Storage Engine For Big Data Analytics	2024	SIGMOD	4.3441378e-05
9,411	Kora: A Cloud-Native Event Streaming Platform For Kafka	2023	VLDB	4.3441378e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,372	Predictable Performance for Unpredictable Workloads	2009	VLDB	8.947963e-05
6,715	Shared Foundations: Modernizing Meta's Data Lakehouse	2023	CIDR	4.9509939e-05
3,755	In-Memory Data Management for Consumer Transactions: The TimesTen Approach	1999	SIGMOD	6.784193e-05
9,496	Scabbard: Single-Node Fault-Tolerant Stream Processing	2022	VLDB	4.3341665e-05
11,566	Rethinking Message Brokers on RDMA and NVM	2020	SIGMOD	4.1945683e-05
189	Megastore: Providing Scalable, Highly Available Storage for Interactive Services	2011	CIDR	0.00035925334
11,628	A Drop-in Middleware for Serializable DB Clustering across Geo-distributed Sites	2020	VLDB	4.1945683e-05
1,613	Realtime Data Processing at Facebook	2016	SIGMOD	0.00011140777
2,658	Data Warehousing and Analytics Infrastructure at Facebook	2010	SIGMOD	8.3607429e-05
9,111	Meta's Next-generation Realtime Monitoring and Analytics Platform	2022	VLDB	4.3942367e-05