STREET: Swedish Tool for Risk/Resource Estimation at EvenTs. Part two, resource assessment – face validity and inter–rater reliability

ObjectiveTo develop a validated and generalized collaborative tool to be utilized by high reliability organizations in order to conduct common resource assessment before major events and mass gatherings.MethodsThe Swedish resource and risk estimation guide was used as foundation for the development of the generalized collaborative tool, by three different expert groups, and then analyzed. Analysis of inter-rater reliability was conducted through simulated cases that showed weighted and unweight κ-statistics.ResultsThe results revealed a mean of unweight κ-value from the three cases of 0.44 and a mean accuracy of 61% of the tool.ConclusionsA better collaboration ability and more accurate resource assessment with acceptable reliability and validity were shown in this study to be used as a foundation for resource assessment before major events/mass-gathering in a simulated environment. However, the result also indicates the challenges of creating measurable values from simulated cases. A study on real events can provide higher reliability but needs, on the other hand, an already developed tool.