Scribe: How Meta transports terabytes per second in real time

Summary: Scribe: Meta’s multi-tenant, low-latency message queue ingesting >15 TB/s and delivering >110 TB/s to consumers for massive real-time streams. Key innovations: a multi-hop write path with opportunistic placement to maximize write availability, and an adaptive read path that tunes replica placement/representation per workload while exposing tunable delivery guarantees. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 14275
Venue: VLDB
Year: 2025
Pagerank: 5.093636e-05
Overall Rank: 10,996 | 24.56%
DOI: 10.14778/3750601.3750607

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Manos Karpathiotakis (Meta)
2. Vlassios Rizopoulos (Meta)
3. Basri Kahveci (Meta)
4. Tiziano Carotti (Meta)
5. Artem Gelum (Meta)
6. Hazem Nada (Meta)
7. Yuri Dolgov (Meta)

BibTeX Citation

@article{karpathiotakis_vldb25,
        title = {{Scribe: How Meta transports terabytes per second in real time}},
        author = {Karpathiotakis, Manos and Rizopoulos, Vlassios and Kahveci, Basri and Carotti, Tiziano and Gelum, Artem and Nada, Hazem and Dolgov, Yuri},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {12},
        pages = {4817--4830},
        doi = {10.14778/3750601.3750607},
        url = {https://doi.org/10.14778/3750601.3750607},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 14 of 14 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
60	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0003955489
224	MillWheel: Fault-Tolerant Stream Processing at Internet Scale	2013	VLDB	0.00024130894
361	The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing	2015	VLDB	0.00020138717
424	Flexible Time Management in Data Stream Systems	2004	PODS	0.0001870735
1,223	Out-of-Order Processing: A New Architecture for High-Performance Stream Systems	2008	VLDB	0.00011602265
1,352	Scuba: Diving into Data at Facebook	2013	VLDB	0.00011064595
1,389	Realtime Data Processing at Facebook	2016	SIGMOD	0.00010943767
1,757	Velox: Meta's Unified Execution Engine	2022	VLDB	9.8166984e-05
2,151	An Architecture for Recycling Intermediates in a Column-store	2009	SIGMOD	9.0784444e-05
3,140	TAO: How Facebook Serves the Social Graph	2012	SIGMOD	7.7176906e-05
4,705	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	6.5529421e-05
9,157	Meta's Next-generation Realtime Monitoring and Analytics Platform	2022	VLDB	5.3115153e-05
9,555	Vortex: A Stream-oriented Storage Engine For Big Data Analytics	2024	SIGMOD	5.2528121e-05
9,562	Kora: A Cloud-Native Event Streaming Platform For Kafka	2023	VLDB	5.2528121e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	1,879	Predictable Performance for Unpredictable Workloads	2009	VLDB
2	6,407	Shared Foundations: Modernizing Meta's Data Lakehouse	2023	CIDR
3	3,965	In-Memory Data Management for Consumer Transactions: The TimesTen Approach	1999	SIGMOD
4	9,633	Scabbard: Single-Node Fault-Tolerant Stream Processing	2022	VLDB
5	11,763	Rethinking Message Brokers on RDMA and NVM	2020	SIGMOD
6	144	Megastore: Providing Scalable, Highly Available Storage for Interactive Services	2011	CIDR
7	11,823	A Drop-in Middleware for Serializable DB Clustering across Geo-distributed Sites	2020	VLDB
8	1,389	Realtime Data Processing at Facebook	2016	SIGMOD
9	2,191	Data Warehousing and Analytics Infrastructure at Facebook	2010	SIGMOD
10	9,157	Meta's Next-generation Realtime Monitoring and Analytics Platform	2022	VLDB