Development of an Evaluation Capacity-Building Program for Nurse Teachers in Students’ Practicum

Crucial problems commonly found in practicum evaluation of nurse teachers are rater effects. One among effective solutions is rater training. Despite these problems, studies in this population are scanty. The objectives of this study were to develop an evaluation capacity building program for nurse teachers in practicum evaluation of student nurses and to investigate the quality of instruments in the program. The multidisciplinary model of evaluation-capacity building was employed to develop the program. All of the faculty of nursing, Suan Dusit University and other 26 nurse teachers were recruited as participants. The results showed that instruments for the program were developed and investigated the validity, and reliability as follows 1) Rubric, IOC of 26 sub-items = .56 - .89; with corresponding 2) 8 sets of video clips, inter-rater agreement index: RAI of scores by mean RAI = .84-.95; and inter-rater reliability, ICC(3,5) 95% CI = .12 - .80 3) Manual for training, IOC = .78-.89 4) An attitude scales, IOC = .67 - 1.00; Alpha = .83 5) A test on knowledge, IOC = .44 - 1.00; Difficulty: Pi = .23 - 1.00; Sensitivity Index: Si = -.35 - .44; Alpha = .18. After being revised some marginal values, most of the instruments were considered to be valid, and reliable except the test of knowledge. The item and test analysis were shown low to negative values in some items. However, the program will be used in a pilot group, further recalculated and improved before using in the major group.