MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis

Summary: MISTIQUE stores and queries model intermediates for ML diagnosis, spanning traditional pipelines and deep nets. It chooses re-run vs. reuse per query and uses quantization, summarization, dedup to cut storage up to 110× and speed queries up to 390× (ML) / 210× (DL). (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5642
Venue: SIGMOD
Year: 2018
Pagerank: 0.00010045615
Overall Rank: 1,670 | 88.55%
DOI: 10.1145/3183713.3196934

Incoming Non-self Citations Over Time

Authors

1. Manasi Vartak (Massachusetts Institute of Technology)
2. Joana M. F. da Trindade (Massachusetts Institute of Technology)
3. Samuel Madden (Massachusetts Institute of Technology)
4. Matei Zaharia (Stanford University)

BibTeX Citation

@inproceedings{vartak_sigmod18,
        title = {{MISTIQUE: A System to Store and Query Model Intermediates for Model Diagnosis}},
        author = {Vartak, Manasi and da Trindade, Joana M. F. and Madden, Samuel and Zaharia, Matei},
        series = {{SIGMOD} '18},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3183713.3196934},
        url = {https://dl.acm.org/doi/10.1145/3183713.3196934},
        year = {2018}
}

Incoming Citations (Sorted by Pagerank)

Showing 28 of 28 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,569	HELIX: Holistic Optimization for Accelerating Iterative Machine Learning	2019	VLDB	0.00010335423
1,756	SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle	2020	CIDR	9.8172465e-05
3,536	How Large Language Models Will Disrupt Data Management	2023	VLDB	7.3297343e-05
4,240	LIMA: Fine-grained Lineage Tracing and Reuse in Machine Learning Systems	2021	SIGMOD	6.809685e-05
5,404	Dagger: A Data (not code) Debugger	2020	CIDR	6.2294192e-05
5,699	Optimizing Machine Learning Workloads in Collaborative Environments	2020	SIGMOD	6.1170243e-05
6,038	Efficient Construction of Approximate Ad-Hoc ML models Through Materialization and Reuse	2018	VLDB	5.9990929e-05
6,105	Optimizing In-memory Database Engine for AI-powered On-line Decision Augmentation Using Persistent Memory	2021	VLDB	5.9743349e-05
6,250	Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines	2021	CIDR	5.9418015e-05
6,309	Materialization and Reuse Optimizations for Production Data Science Pipelines	2022	SIGMOD	5.9189554e-05
6,427	DeepBase: Deep Inspection of Neural Networks	2019	SIGMOD	5.8808145e-05
6,525	Hindsight Logging for Model Training	2021	VLDB	5.8514923e-05
6,708	Serving Deep Learning Models with Deduplication from Relational Databases	2022	VLDB	5.7964983e-05
6,960	DeepEverest: Accelerating Declarative Top-K Queries for Deep Neural Network Interpretation	2022	VLDB	5.7303405e-05
7,656	Nautilus: An Optimized System for Deep Transfer Learning over Evolving Training Datasets	2022	SIGMOD	5.5740571e-05
7,687	ExDRa: Exploratory Data Science on Federated Raw Data	2021	SIGMOD	5.5671645e-05
8,050	Capturing and Querying Fine-grained Provenance of Preprocessing Pipelines in Data Science	2021	VLDB	5.5000099e-05
8,328	Deep Learning: Systems and Responsibility	2021	SIGMOD	5.4535681e-05
8,908	Privacy and Accuracy-Aware AI/ML Model Deduplication	2025	SIGMOD	5.3483178e-05
9,245	Towards Observability for Production Machine Learning Pipelines	2022	VLDB	5.2992628e-05
9,495	Debugging Large-Scale Data Science Pipelines using Dagger	2020	VLDB	5.2616335e-05
9,520	Experimental Analysis of Large-scale Learnable Vector Storage Compression	2024	VLDB	5.2561283e-05
10,075	ElasticNotebook: Enabling Live Migration for Computational Notebooks	2024	VLDB	5.1613298e-05
10,540	CAPS: Cost-Aware ML Pipeline Selection	2026	VLDB	5.093636e-05
10,635	Flow with FlorDB: Incremental Context Maintenance for the Machine Learning Lifecycle	2025	CIDR	5.093636e-05
11,219	MetaStore: Analyzing Deep Learning Meta-Data at Scale	2024	VLDB	5.093636e-05
11,512	Towards Observability for Machine Learning Pipelines	2022	CIDR	5.093636e-05
13,501	DEEM 2019: Workshop on Data Management for End-to-End Machine Learning	2019	SIGMOD	-

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
12	C-Store: A Column-oriented DBMS	2005	VLDB	0.00069513174
78	ULDBs: Databases with Uncertainty and Lineage	2006	VLDB	0.00036571789
669	The TileDB Array Data Storage Manager	2017	VLDB	0.00015163245
1,349	Principles of Dataset Versioning: Exploring the Recreation/Storage Tradeoff	2015	VLDB	0.00011069122
1,475	VisTrails: Visualization meets Data Management	2006	SIGMOD	0.00010662942
1,617	Titian: Data Provenance Support in Spark	2016	VLDB	0.00010209397
1,644	Compressed Linear Algebra for Large-Scale Machine Learning	2016	VLDB	0.00010132912
1,946	OrpheusDB: Bolt-on Versioning for Relational Databases	2017	VLDB	9.4334506e-05
2,235	Decibel: The Relational Dataset Branching System	2016	VLDB	8.8913373e-05
3,402	Collaborative Data Analytics with DataHub	2015	VLDB	7.4418927e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,386	NeurStore: Efficient In-database Deep Learning Model Management System	2026	SIGMOD
2	11,043	mlidea: Interactively Improving ML Data Preparation Code via “Shadow Pipelines”	2025	VLDB
3	8,908	Privacy and Accuracy-Aware AI/ML Model Deduplication	2025	SIGMOD
4	11,211	MisDetect: Iterative Mislabel Detection using Early Loss	2024	VLDB
5	683	MYSTIQ: A system for finding more answers by using probabilities	2005	SIGMOD
6	4,518	MLINSPECT: A Data Distribution Debugger for Machine Learning Pipelines	2021	SIGMOD
7	8,949	Modyn: Data-Centric Machine Learning Pipeline Orchestration	2025	SIGMOD
8	10,472	Mixtera: A Data Plane for Foundation Model Training	2026	SIGMOD
9	11,219	MetaStore: Analyzing Deep Learning Meta-Data at Scale	2024	VLDB
10	11,353	Reconstructing and Querying ML Pipeline Intermediates	2023	CIDR