Operative performance in laparoscopic cholecystectomy using the Procedural-Based Assessment tool

AimsThe Intercollegiate Surgical Curriculum Project (ISCP) has devised assessment tools for index operations to assess trainee technical skills. In this study we used the Procedural-Based Assessment (PBA) tool to evaluate operations performed by trainees.MethodsLive and simulated laparoscopic cholecystectomies were performed by trainees. Two experienced surgeons assessed each operation blindly and independently.ResultsEighty-four live (supervised) and 112 simulated (unsupervised) operations were performed by 28 trainees. Mean inter-rater reliability was kappa = .86 and .84 for live and simulated operations, respectively. Construct validity using Mann–Whitney for generic technical skills was significant for live and simulated operations, P ≤ .05. Assessing specific technical skills showed construct validity for simulated unsupervised operations only, Mann–Whitney P < .05, but not for supervised live operations, Mann–Whitney P > .05.ConclusionsThe PBA showed good inter-rater reliability. Assessing generic technical skills, PBA showed construct validity for both types of operations and for specific technical skills in the unsupervised simulated operations. We conclude that the PBA seems to be a reliable and valid assessment tool for generic technical skills in unsupervised simulated and live supervised laparoscopic cholecystectomies.