Automated UI evaluation based on a cognitive architecture and UsiXML

•We propose a method to automate the evaluation process of user interfaces.•Relying on models facilitates the identification of guidelines that are useful.•Automatically evaluating a user interface facilitates aircraft’s design.•The method includes a cognitive architecture to predict human performance on the UI.

In this paper, we will present a method for automated UI evaluation. Based on a formal UI description in UsiXML, the cognitive architecture CASCaS will be used to predict human performance on the UI, in terms of task execution time, workload and possible human errors. In addition, the UsabilityAdviser tool can be used to check the UI description against a set of usability rules. This approach fits well into the human performance and error analysis proposed in the European project HUMAN, where virtual testers (CASCaS) are used to evaluate assistant systems and their HMI. A first step for realizing this approach has been made by implementing a 3D rendering engine for UsiXML.