Human and organizational error data challenges in complex, large-scale systems

In complex, large-scale systems, event analyses are constrained by the quality of the data gathered, the maturity of the associated reporting system, and the training and background of the investigator and reporter. Such constraints place limits on the adequacy and strength of analyses conducted with the data. In this paper, we focus on the challenges of measuring performance variability in complex systems, using the lens of human and organizational error modeling. This paper begins with an overview of human and organizational error assessments, and then introduces the particular challenges of data needs in human reliability analyses. A case study of human and organizational error analysis in a complex, large-scale system, marine transportation in Puget Sound, is used to illustrate the impact of the data challenges on risk assessment processes. Suggestions for future research conclude the paper.