A Review and Analysis of Evaluation Practices in VIS Domain Applications
Published in IEEE Transactions on Visualization and Computer Graphics, 2024
This article presents a review and analysis of evaluation practices within the visualization and visual analytics (VIS) domain, with a focus on domain application work accepted at the IEEE VIS conference from 2018 to 2022. Through the analysis of 140 pertinent article, we establish a detailed classification principle for evaluation practices, using the Who, When, What, and Howindicators. This principle covers facets such as analysis methods, targets, scenarios, participant expertise, and stages of occurrence. By systematically categorizing the application domains presented in these works, we apply our established classification principle to discern and categorize the evaluation practices within them, identifying the prevailing characteristics and trends. The article explores the variety of evaluation methods employed across different application domains and observes the distinctions in their usage. In conclusion, we provide insights and highlight concerns for conducting evaluations in upcoming domain application research. Our findings are intended to inform and guide subsequent studies in a similar context.
Recommended citation: Y. Xing, G. D. Cantareira, R. Borgo and A. Abdul-Rahman, "A Review and Analysis of Evaluation Practices in VIS Domain Applications," in IEEE Transactions on Visualization and Computer Graphics, vol. 31, no. 9, pp. 5580-5592, Sept. 2025, doi: 10.1109/TVCG.2024.3460181.
Paper | Bibtex