Automation bias: Empirical results assessing influencing factors

•Research provides empirical support for automation bias within the healthcare field.•In 5.2% of prescribing cases correct answers were switched to incorrect answers after advice.•Trust in the study's simulated CDSS, decision confidence, and task difficulty influenced rate of decision switching.•Lower clinical experience was associated with more decision switching.•Age, DSS experience and overall trust in CDSS generally were not associated with decision switching.

ObjectiveTo investigate the rate of automation bias – the propensity of people to over rely on automated advice and the factors associated with it. Tested factors were attitudinal – trust and confidence, non-attitudinal – decision support experience and clinical experience, and environmental – task difficulty. The paradigm of simulated decision support advice within a prescribing context was used.DesignThe study employed within participant before–after design, whereby 26 UK NHS General Practitioners were shown 20 hypothetical prescribing scenarios with prevalidated correct and incorrect answers – advice was incorrect in 6 scenarios. They were asked to prescribe for each case, followed by being shown simulated advice. Participants were then asked whether they wished to change their prescription, and the post-advice prescription was recorded.MeasurementsRate of overall decision switching was captured. Automation bias was measured by negative consultations – correct to incorrect prescription switching.ResultsParticipants changed prescriptions in 22.5% of scenarios. The pre-advice accuracy rate of the clinicians was 50.38%, which improved to 58.27% post-advice. The CDSS improved the decision accuracy in 13.1% of prescribing cases. The rate of automation bias, as measured by decision switches from correct pre-advice, to incorrect post-advice was 5.2% of all cases – a net improvement of 8%.More immediate factors such as trust in the specific CDSS, decision confidence, and task difficulty influenced rate of decision switching. Lower clinical experience was associated with more decision switching.Age, DSS experience and trust in CDSS generally were not significantly associated with decision switching.ConclusionsThis study adds to the literature surrounding automation bias in terms of its potential frequency and influencing factors.