Evaluation of human–agent user interfaces in multi-agent systems

A multi-agent system (MAS) is a computational system in which two or more intelligent agents work together to perform a set of tasks. MAS's have had a significant impact in a wide range of applications. However, little attention has been paid to the design of human–agent user interfaces. Our research was conducted primarily to further explore interaction between humans and intelligent agents, as well as attempt to solidify foundational concepts for intelligent multi-agent system interface design. Based on the foundation of the commercialized PC game Unreal Tournament 2003, a framework was developed that utilized fundamental interface design principles as well as newly designed guidelines. Three user interfaces were designed for an experiment conducted with 25 participants. Their performances were evaluated via effectiveness, efficiency, satisfaction, and workload metrics. Through the testing of scenario tasks, an in-depth study was conducted on the collaboration between the human user and intelligent agents within a system. Finally, the paper summarized a set of design principles and guidelines developed through the study, which could easily be applicable to the design of future user interfaces for multi-agent systems.Relevance to industryA deeper understanding of the manner by which the appropriate information is provided to the user interacting with multi-agent systems in the correct form at the right time should have a broad impact on the future development of intelligent multi-agent system interfaces.