MiRA—Mixed Reality Agents

In recent years, an increasing number of Mixed Reality (MR) applications have been developed using agent technology — both for the underlying software and as an interface metaphor. However, no unifying field or theory currently exists that can act as a common frame of reference for these varied works. As a result, much duplication of research is evidenced in the literature. This paper seeks to fill this important gap by outlining “for the first time” a formal field of research that has hitherto gone unacknowledged, namely the field of Mixed Reality Agents (MiRAs), which are defined as agents embodied in a Mixed Reality environment.Based on this definition, a taxonomy is offered that classifies MiRAs along three axes: agency, based on the weak and strong notions outlined by Wooldridge and Jennings (1995); corporeal presence, which describes the degree of virtual or physical representation (body) of a MiRA; and interactive capacity, which characterises its ability to sense and act on the virtual and physical environment.Furthermore, this paper offers the first comprehensive survey of the state-of-the-art of MiRA research and places each project within the proposed taxonomy. Finally, common trends and future directions for MiRA research are discussed.By defining Mixed Reality Agents as a formal field, establishing a common taxonomy, and retrospectively placing existing MiRA projects within it, future researchers can effectively position their research within this landscape, thereby avoiding duplication and fostering reuse and interoperability.

Research Highlights►The paper introduces the concept of Mixed Reality Agent (MiRA). ►A classification of MiRAs is provided via the MiRA Cube Taxonomy. ►The taxonomy spans the axes of agency, corporeal presence, and interactive capacity. ►Five distinct areas are identified where existing projects cluster in the MiRA Cube.