Human performance in a multiple-task environment: Effects of automation reliability on visual attention allocation

Diagnostic automation has been posited to alleviate the high demands of multiple-task environments; however, mixed effects have been found pertaining to performance aid success. To better understand these effects, attention allocation must be studied directly. We developed a multiple-task environment to study the effects of automation on visual attention. Participants interacted with a system providing varying levels of automation and automation reliability and then were transferred to a system with no support. Attention allocation was measured by tracking the number of times each task was viewed. We found that participants receiving automation allocated their time according to the task frequency and that tasks that benefited most from automation were most harmed when it was removed. The results suggest that the degree to which automation affects multiple-task performance is dependent on the relative attributes of the tasks involved. Moreover, there is an inverse relationship between support and cost when automation fails.

► We test the effects of imperfect diagnostic automation on attention allocation in a multiple task environment.
► Diagnostic automation biases the participant toward more frequent tasks, with more reliable automation creating more bias.
► The participants in automated conditions also relied upon the automation, suffering when it was taken away.
► Those tasks most benefitted by the automation suffered the most.