Evaluating Interactive Data Systems: Workloads, Metrics, and Guidelines

Summary: Survey of evaluation for interactive data systems, cataloging workload characteristics across input modalities (touch, gesture, sliders) and confounding factors in benchmarks and metrics. Two case studies with real user traces reveal metric inadequacies and propose new measures and guidelines to better capture interactivity. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5585
Venue: SIGMOD
Year: 2018
Pagerank: 5.059132e-05
Overall Rank: 6,444 | 55.18%
DOI: 10.1145/3183713.3197386

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
5,810	Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data	2020	SIGMOD	5.3178017e-05
6,842	Towards Democratizing Relational Data Visualization	2019	SIGMOD	4.9103931e-05
7,073	Marviq: Quality-Aware Geospatial Visualization of Range-Selection Queries Using Materialization	2020	SIGMOD	4.842703e-05
7,766	ICARUS: Minimizing Human Effort in Iterative Data Completion	2018	VLDB	4.6564959e-05
10,366	An Adaptive Benchmark for Modeling User Exploration of Large Datasets	2025	SIGMOD	4.1945683e-05
11,637	ARQuery: Hallucinating Analytics over Real-World Data using Augmented Reality	2019	CIDR	4.1945683e-05
11,653	Data Pipelines for User Group Analytics	2019	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
64	Improved Histograms for Selectivity Estimation of Range Predicates	1996	SIGMOD	0.00063612837
257	Making Database Systems Usable	2007	SIGMOD	0.00030223397
269	Fast Incremental Maintenance of Approximate Histograms	1997	VLDB	0.00029656549
530	Random Sampling for Histogram Construction: How much is enough?	1998	SIGMOD	0.00020803682
996	Approximating Multi-Dimensional Aggregate Range Queries Over Real Attributes	2000	SIGMOD	0.00014741524
1,587	Dynamic Prefetching of Data Tiles for Interactive Visualization	2016	SIGMOD	0.00011245116
1,918	VizDeck: Self-Organizing Dashboards for Visual Analytics	2012	SIGMOD	0.00010097599
3,070	Explore-by-Example: An Automatic Query Steering Framework for Interactive Data Exploration	2014	SIGMOD	7.6137064e-05
3,188	Gestural Query Specification	2014	VLDB	7.4117439e-05
6,064	SCOUT: Prefetching for Latent Structure Following Queries	2012	VLDB	5.2299134e-05
6,564	SnapToQuery: Providing Interactive Feedback during Exploratory Query Specification	2015	VLDB	5.0087945e-05
6,627	Data Tweening: Incremental Visualization of Data Transforms	2017	VLDB	4.9886939e-05
6,822	Skimmer: Rapid Scrolling of Relational Query Results	2012	SIGMOD	4.9152454e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
2,129	IDEBench: A Benchmark for Interactive Data Exploration	2020	SIGMOD	9.480002e-05
6,609	Data-driven Visual Query Interfaces for Graphs: Past, Present, and (Near) Future	2022	SIGMOD	4.9956718e-05
6,564	SnapToQuery: Providing Interactive Feedback during Exploratory Query Specification	2015	VLDB	5.0087945e-05
1,023	Query Steering for Interactive Data Exploration	2013	CIDR	0.00014611863
1,907	Guided Interaction: Rethinking the Query-Result Paradigm	2011	VLDB	0.00010136636
4,758	Optimization for Active Learning-based Interactive Database Exploration	2019	VLDB	5.9422515e-05
7,775	Graph Querying Meets HCI: State of the Art and Future Directions	2017	SIGMOD	4.653773e-05
10,366	An Adaptive Benchmark for Modeling User Exploration of Large Datasets	2025	SIGMOD	4.1945683e-05
4,052	Interactive Analysis of Web-Scale Data	2009	CIDR	6.4936745e-05
5,810	Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data	2020	SIGMOD	5.3178017e-05