Audio and Visual Analysis of Urologic Laparoscopic and Robotic Skills: Objective Criteria for Surgical Skill Evaluation

ObjectiveTo assess intraoperative cognitive and motor skills using audio- and video-based analysis.Materials and MethodsThe study enrolled 11 surgeons who were categorized into novice (n = 4), intermediate (n = 4), and expert (n = 3) groups. Categorization of skill level was based on years of experience and as determined by the lead expert surgeon. A total of 32 cases were available for analysis, including 5 robotic and 27 laparoscopic renal cases. For each procedure, video and audio components were recorded and sent for grading to 4 blinded judges. The previously validated global rating scale (GRS) and operation-specific rating scale (ORS), as well as a novel cognitive rating scale (CRS), were used to assess performances. Statistical comparisons were performed by analysis of variance.ResultsComparison of the 3 skill levels using analysis of variance showed that each scale was able to differentiate among the levels (P <.05). The mean scores for the before and after audio GRS, ORS, and CRS showed significant difference between the novice, intermediate, and expert groups, demonstrating construct validity.ConclusionThe use of intraoperative audio is an innovative way to assess the cognitive ability of the surgeon. The CRS demonstrated construct validity. The addition of the CRS to the already validated GRS and ORS may serve as a reliable system to objectively evaluate laparoscopic and robotic surgical skill.