Explainable deep learning improves human mental models of self-driving cars
How can a passenger understand why a self-driving car behaves unexpectedly? This study introduces the Concept-Wrapper Network (CW-Net), which connects a learned planner to human-readable concepts and examines whether explanations improve understanding of vehicle behaviour. Its evaluation combines private-track experiments with a real autonomous vehicle, expert and non-expert studies, and an online study using public-road recordings collected while a human drove. Participants receiving concept explanations performed better on selected questions about surprising situations. The accompanying critique distinguishes the architecture in which concepts determine the planning reward from an alternative that provides diagnostic explanations without determining trajectory selection. It also examines concept-recognition errors, the inclusion of caution questions in a prediction measure, and uncertainty about effects during ordinary situations. The publication offers evidence about interpretable planning and human understanding, while explaining why these results do not establish safer autonomous operation on public roads or unrestricted replication of the complete vehicle system.
Explainable deep learning improves human mental models of self-driving cars Leer más »


