Investigating the Intelligibility of Plural Counterfactual Examples for Non-Expert Users: an Explanation User Interface Proposition and User Study - Laboratoire des Usages en Technologies de l'Information Numérique
Conference Papers Year : 2023

Investigating the Intelligibility of Plural Counterfactual Examples for Non-Expert Users: an Explanation User Interface Proposition and User Study

Abstract

Plural counterfactual examples have been proposed to explain the prediction of a classifier by offering a user several instances of minimal modifications that may be performed to change the prediction. Yet, such explanations may provide too much information, generating potential confusion for the end-users with no specific knowledge, neither on the machine learning, nor on the application domains. In this paper, we investigate the design of explanation user interfaces for plural counterfactual examples offering comparative analysis features to mitigate this potential confusion and improve the intelligibility of such explanations for non-expert users. We propose an implementation of such an enhanced explanation user interface, illustrating it in a financial scenario related to a loan application. We then present the results of a lab user study conducted with 112 participants to evaluate the effectiveness of having plural examples and of offering comparative analysis principles, both on the objective understanding and satisfaction of such explanations. The results demonstrate the effectiveness of the plural condition, both on objective understanding and satisfaction scores, as compared to having a single counterfactual example. Beside the statistical analysis, we perform a thematic analysis of the participants' responses to the open-response questions, that also shows encouraging results for the comparative analysis features on the objective understanding. CCS CONCEPTS • Human-centered computing → User studies.
Fichier principal
Vignette du fichier
_ACM_IUI_2023__Paper_1450 (1).pdf (5.55 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04160341 , version 1 (06-11-2023)

Licence

Identifiers

Cite

Clara Bove, Marie-Jeanne Lesot, Charles Albert Tijus, Marcin Detyniecki. Investigating the Intelligibility of Plural Counterfactual Examples for Non-Expert Users: an Explanation User Interface Proposition and User Study. 28th Annual Conference on Intelligent User Interface, Mar 2023, Sydney, Australia. pp.188-203, ⟨10.1145/3581641.3584082⟩. ⟨hal-04160341⟩
108 View
78 Download

Altmetric

Share

More