Validity and Reliability of the Rapid Assessment for Adolescent Preventive Services Adolescent Health Risk Assessment

PurposeSeventy-five percent of adolescent morbidity and mortality is a result of risky behaviors. The Rapid Assessment for Adolescent Preventive Services (RAAPS) is a 21-question adolescent risk screening tool developed to identify the behaviors contributing most to adolescent morbidity, mortality, and social problems. The aim of this study was to evaluate the validity and reliability of the RAAPS.MethodsThis study used psychometric methods to establish face-, content-, and criterion-related validity and inter-rater and equivalence reliability. Focus groups with adolescents (n = 21) and health care professionals (n = 7) were facilitated to establish face validity. Adolescent expert review (n = 10) was gathered to establish content validity and reliability. A retrospective chart audit of adolescents (n = 263) who completed both the RAAPS and the Guidelines for Adolescent Preventive Services risk questionnaire was conducted to assess criterion-related validity and equivalence between paired question responses using Cohen kappa measure, percent agreement, and Fisher exact test.ResultsFace validity was established by consensus of focus group. Adolescent expert content validity index scores ranged from 0.825 to 1.0, and inter-rater content agreement ranged from 0.9 to 1.0. Cohen kappa ranged from 0.44 to 0.99; percent agreement ranged from 0.71 to .99; Fisher exact test resulted in all p > 0.05 establishing criterion-related validity and equivalence.ConclusionValidity and reliability of the RAAPS as a measure of adolescent risk behaviors was established. Results indicate RAAPS is an acceptable screening tool in identifying adolescent risk behaviors, contributing most to morbidity, mortality, and social problems.