Scribe: How Meta transports terabytes per second in real time

Summary: Scribe: Meta’s multi-tenant, low-latency message queue ingesting >15 TB/s and delivering >110 TB/s to consumers for massive real-time streams. Key innovations: a multi-hop write path with opportunistic placement to maximize write availability, and an adaptive read path that tunes replica placement/representation per workload while exposing tunable delivery guarantees. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 14088
Venue: VLDB
Year: 2025
Pagerank: 4.1905499e-05
Overall Rank: 10,772 | 25.14%
DOI: 10.14778/3750601.3750607

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
132	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.00043697853
314	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00028059664
433	Flexible Time Management in Data Stream Systems	2004	PODS	0.00023336894
536	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020651621
1,488	Scuba: Diving into Data at Facebook	2013	VLDB	0.00011690191
1,549	Out-of-Order Processing: A New Architecture for High-Performance Stream Systems	2008	VLDB	0.00011407374
1,616	Realtime Data Processing at Facebook	2016	SIGMOD	0.00011133818
2,533	Velox: Meta’s Unified Execution Engine	2022	VLDB	8.5870599e-05
2,695	An Architecture for Recycling Intermediates in a Column-store	2009	SIGMOD	8.2827669e-05
3,399	TAO: How Facebook Serves the Social Graph	2012	SIGMOD	7.1366107e-05
5,537	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	5.453017e-05
9,105	Meta's Next-generation Realtime Monitoring and Analytics Platform	2022	VLDB	4.3911131e-05
9,407	Vortex: A Stream-oriented Storage Engine For Big Data Analytics	2024	SIGMOD	4.3399748e-05
9,417	Kora: A Cloud-Native Event Streaming Platform For Kafka	2023	VLDB	4.3399748e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,372	Predictable Performance for Unpredictable Workloads	2009	VLDB	8.940791e-05
6,716	Shared Foundations: Modernizing Meta's Data Lakehouse	2023	CIDR	4.9462431e-05
3,759	In-Memory Data Management for Consumer Transactions: The TimesTen Approach	1999	SIGMOD	6.7791262e-05
9,497	Scabbard: Single-Node Fault-Tolerant Stream Processing	2022	VLDB	4.3300131e-05
11,570	Rethinking Message Brokers on RDMA and NVM	2020	SIGMOD	4.1905499e-05
189	Megastore: Providing Scalable, Highly Available Storage for Interactive Services	2011	CIDR	0.00035934191
11,632	A Drop-in Middleware for Serializable DB Clustering across Geo-distributed Sites	2020	VLDB	4.1905499e-05
1,616	Realtime Data Processing at Facebook	2016	SIGMOD	0.00011133818
2,658	Data Warehousing and Analytics Infrastructure at Facebook	2010	SIGMOD	8.3634079e-05
9,105	Meta's Next-generation Realtime Monitoring and Analytics Platform	2022	VLDB	4.3911131e-05