MacroBase: Prioritizing Attention in Fast Data

Summary: MacroBase prioritizes end-user attention in high-volume fast data streams and acts as a search engine for fast data. It delivers accurate, scalable classifications with explanations over groups, powered by a reservoir sampler and heavy-hitters sketch that reach up to 2M events/sec per core and see deployment in telematics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: haf683f8e1be6fa37
Venue: SIGMOD
Year: 2017
Pagerank: 9.5376219e-05
Overall Rank: 1,833 | 87.69%
DOI: 10.1145/3035918.3035928

Incoming Non-self Citations Over Time

Authors

1. Peter Bailis (Stanford University)
2. Edward Gan (Stanford University)
3. Samuel Madden (Massachusetts Institute of Technology)
4. Deepak Narayanan (Stanford University)
5. Kexin Rong (Stanford University)
6. Sahaana Suri (Stanford University)

BibTeX Citation

@inproceedings{bailis_sigmod17,
        title = {{MacroBase: Prioritizing Attention in Fast Data}},
        author = {Bailis, Peter and Gan, Edward and Madden, Samuel and Narayanan, Deepak and Rong, Kexin and Suri, Sahaana},
        series = {{SIGMOD} '17},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3035918.3035928},
        url = {https://dl.acm.org/doi/10.1145/3035918.3035928},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 31 of 31 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
271	NoScope: Optimizing Neural Network Queries over Video at Scale	2017	VLDB	0.0002256866
1,223	Data Management in Machine Learning: Challenges, Techniques, and Systems	2017	SIGMOD	0.00011468426
1,545	Exathlon: A Benchmark for Explainable Anomaly Detection over Time Series	2021	VLDB	0.00010299696
2,162	DIFF: A Relational Interface for Large-Scale Data Explanation	2019	VLDB	8.9344773e-05
2,799	Moment-Based Quantile Sketches for Efficient High Cardinality Aggregation Queries	2018	VLDB	7.9895512e-05
3,514	Sketching Linear Classifiers over Data Streams	2018	SIGMOD	7.2395322e-05
4,105	AutoOD: Automatic Outlier Detection	2023	SIGMOD	6.8033852e-05
4,171	Data Integration and Machine Learning: A Natural Synergy	2018	SIGMOD	6.7576159e-05
4,261	MorphoSys: Automatic Physical Design Metamorphosis for Distributed Database Systems	2020	VLDB	6.6960399e-05
4,433	ASAP: Prioritizing Attention via Time Series Smoothing	2017	VLDB	6.5989752e-05
4,560	Scalable Kernel Density Classification via Threshold-Based Pruning	2017	SIGMOD	6.5319373e-05
4,611	ExplainIt! - A Declarative Root-cause Analysis Engine for Time Series Data	2019	SIGMOD	6.5004232e-05
4,689	A Demonstration of AutoOD: A Self-Tuning Anomaly Detection System	2022	VLDB	6.4677473e-05
4,984	XInsight: eXplainable Data Analysis Through The Lens of Causality	2023	SIGMOD	6.325863e-05
7,030	Explaining Inference Queries with Bayesian Optimization	2021	VLDB	5.6150695e-05
7,185	DataPrism: Exposing Disconnect between Data and Systems	2022	SIGMOD	5.5890883e-05
7,418	Data Integration and Machine Learning: A Natural Synergy	2018	VLDB	5.5306468e-05
7,632	BugDoc: Algorithms to Debug Computational Processes	2020	SIGMOD	5.4788866e-05
7,707	Enabling Efficient and General Subpopulation Analytics in Multidimensional Data Streams	2022	VLDB	5.4723863e-05
7,928	Outlier Summarization via Human Interpretable Rules	2024	VLDB	5.4233854e-05
8,097	Sentinel: Understanding Data Systems	2020	SIGMOD	5.3917406e-05
8,818	Demonstration: MacroBase, A Fast Data Analysis Engine	2017	SIGMOD	5.2698464e-05
9,036	A Distributed System for Large-scale n-gram Language Models at Tencent	2019	VLDB	5.2318513e-05
9,347	A Demonstration of the Exathlon Benchmarking Platform for Explainable Anomaly Detection	2021	VLDB	5.1886484e-05
9,520	Panakos: Chasing the Tails for Multidimensional Data Streams	2023	VLDB	5.1683226e-05
9,891	TSExplain: Surfacing Evolving Explanations for Time Series	2021	SIGMOD	5.1145101e-05
10,191	Reptile: Aggregation-level Explanations for Hierarchical Data	2022	SIGMOD	5.0628015e-05
11,110	Agree to Disagree: Robust Anomaly Detection with Noisy Labels	2025	SIGMOD	4.9769913e-05
11,456	SDEcho: Efficient Explanation of Aggregated Sequence Difference	2025	VLDB	4.9769913e-05
12,131	Leveraging Organizational Resources to Adapt Models to New Data Modalities	2020	VLDB	4.9769913e-05
12,266	Prioritizing Attention in Fast Data: Principles and Promise	2017	CIDR	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 21 of 21 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
112	TelegraphCQ: Continuous Dataflow Processing for an Uncertain World	2003	CIDR	0.00032445088
127	The Design of the Borealis Stream Processing Engine	2005	CIDR	0.00030414379
148	Gorilla: A Fast, Scalable, In-Memory Time Series Database	2015	VLDB	0.00029001141
164	Mining Frequent Patterns without Candidate Generation	2000	SIGMOD	0.000273994
190	Scorpion: Explaining Away Outliers in Aggregate Queries	2013	VLDB	0.0002582857
240	Gigascope: A Stream Database for Network Applications	2003	SIGMOD	0.00023425462
245	MCDB: A Monte Carlo Approach to Managing Uncertain Data	2008	SIGMOD	0.00023251151
495	Building Efficient Query Engines in a High-Level Language	2014	VLDB	0.00017363171
503	Towards a Unified Architecture for in-RDBMS Analytics	2012	SIGMOD	0.00017195428
671	A Formal Approach to Finding Explanations for Database Queries	2014	SIGMOD	0.00014948069
685	Trill: A High-Performance Incremental Query Processor for Diverse Analytics	2015	VLDB	0.00014778299
783	DBSherlock: A Performance Diagnostic Tool for Transactional Databases	2016	SIGMOD	0.0001401708
878	Interpretable and Informative Explanations of Outcomes	2015	VLDB	0.00013296412
1,983	Causality and Explanations in Databases	2014	VLDB	9.2548712e-05
2,360	Online Outlier Detection in Sensor Data Using Non-Parametric Models	2006	VLDB	8.5774153e-05
2,687	Data X-Ray: A Diagnostic Tool for Data Errors	2015	SIGMOD	8.1271333e-05
3,044	Interactive Outlier Exploration in Big Data Streams	2014	VLDB	7.7177446e-05
4,313	On Biased Reservoir Sampling in the Presence of Stream Evolution	2006	VLDB	6.667311e-05
5,953	A Framework for Clustering Uncertain Data	2015	VLDB	5.9338001e-05
9,161	Relative Risk and Odds Ratio: A Data Mining Perspective	2005	PODS	5.2154318e-05
12,266	Prioritizing Attention in Fast Data: Principles and Promise	2017	CIDR	4.9769913e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,823	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
2	2,285	A Platform for Scalable One-Pass Analytics using MapReduce	2011	SIGMOD
3	6,589	Maximus: A Modular Accelerated Query Engine for Data Analytics on Heterogeneous Systems	2025	SIGMOD
4	4,071	Beyond Macrobenchmarks: Microbenchmark-based Graph Database Evaluation	2019	VLDB
5	2,162	DIFF: A Relational Interface for Large-Scale Data Explanation	2019	VLDB
6	11,648	Mach: Firefighting Time-Critical Issues in Complex Systems Using High-Frequency Telemetry	2024	VLDB
7	537	MLbase: A Distributed Machine-learning System	2013	CIDR
8	8,037	Mach: A Pluggable Metrics Storage Engine for the Age of Observability	2022	CIDR
9	8,818	Demonstration: MacroBase, A Fast Data Analysis Engine	2017	SIGMOD
10	12,266	Prioritizing Attention in Fast Data: Principles and Promise	2017	CIDR