Learning in multimodal training: Visual guidance can be both appealing and disadvantageous in spatial tasks

Multimodal training involving both visual and auditory information was shown to improve text comprehension and reduce cognitive load. However, it is argued that in spatial tasks visual guidance can impair training effectiveness because it encourages shallow performance strategies and little exploration. Moreover, visual aids are attractive to both trainers as well as trainees, who tend to use them despite their potential disadvantages. To examine this potential training trap, two experimental studies were conducted. In Study 1, each trainer instructed trainees on how to perform a 3-D puzzle in two conditions: vocal guidance (17 trainees), where only vocal instructions were possible, and vocal guidance with mouse pointing (17 trainees), where the trainer could also use a mouse to point out positions on the trainee's screen. The results showed that while the use of the mouse pointer reduced trainees' mental load during training, it also drastically lowered performance level on a non-supervised test. In Study 2, a real-world version of puzzle was trained. A comparison of a vocal guidance group (16 trainees) to a group trained with an additional mouse pointing and drawing option (16 trainees) showed, as well, reduced performance levels with the additional visual aids. The results suggest that the abundant use of multimodal training in Augmented Reality (AR) applications should be re-evaluated.

Research Highlights► Visual training aids were attractive for both trainees and trainers in a spatial task. ► However, visual aids had negative effect in the transfer to non-supervised training. ► Specifically, visual aids appear to increase the “ease” of training. ► Trainees have lower mental load during training when instructed with visual aids. ► Instructors use more direct commands with visual aids, which impairs transfer.