Telementoring versus on-site mentoring in virtual reality-based surgical training

BACKGROUND: Telementoring can be an adjunct to surgical training using virtual reality surgical simulation. Telementoring is hypothesized to be as effective as a local mentor for surgical skills training. METHODS: In this study, 20 Romanian medical students trained using a virtual reality surgical simulator (LapSim) with a telementor or local mentor. All the students watched an instructional module at the beginning of the exercise. The telementor, in the United States, interacted by videoconferencing. Before and after training sessions, tool path length and time for task completion were measured. RESULTS: Instructional media and training with mentoring resulted in similar levels of performance between locally mentored and telementored groups. Right- and left-hand path length and time decreased significantly within each group from the initial to the final evaluation (p < 0.05) for most tasks (grasping, cutting, suturing). No significant difference was achieved for clip-applying. CONCLUSIONS: Integration of instructional media with telementoring can be as effective for the development of surgical skills as local mentoring.     

Proficiency-based training of medical students using virtual simulators for laparoscopy and robot-assisted surgery: results of a pilot study

Proficiency-based training has become essential in the training of surgeons such that on completion they can execute complex operations with novel surgical approaches including direct manual laparoscopic surgery (DMLS) and robotically assisted laparoscopic surgery (RALS). To this effect, several virtual reality (VR) simulators have been developed. The objective of the present study was to assess and establish proficiency gain curves for medical students on VR simulators for DMLS and RALS. Five medical students participated in training course consisting of didactic teaching and practical hands-on training with VR simulators for DMLS and RALS. Evaluation of didactic component was by questionnaire completed by participating students, who also were required to undertake selected exercises to reach proficiency at each VR simulator: (1) 12 tasks on LapSim VR (Surgical Science, Gothenburg, Sweden) for DMLS, and (2) six selected exercises on the dV-Trainer Mimic (Seattle, WA, United States). The five medical students reached the 60% threshold on the questionnaire-based didactic component. During selected hands-on simulation on VR simulators, students with previous experience with simulators (n?=?3) outperformed those without (n?=?2) in ten out of twelve LapSim tasks and all six at dV-Trainer, by requiring fewer attempts to reach proficiency although the difference was not significant (p?<?0.05). In this work, we developed a proficiency-based training program for medical undergraduates based on surgical simulation for DMLS and RALS.z. Larger studies are needed to evaluate the benefit of this program in stimulating interest for surgical career amongst medical students after the qualify.     

A competency-based virtual reality training curriculum for the acquisition of laparoscopic psychomotor skill

BACKGROUND: Studies have demonstrated the beneficial effect of training novice laparoscopic surgeons using virtual reality (VR) simulators, although there is still no consensus regarding an optimal VR training curriculum. This study aims to establish and validate a structured VR curriculum to provide an evidence-based approach for laparoscopic training programmes. METHODS: The minimally invasive VR simulator (MIST-VR) has 12 abstract laparoscopic tasks, each at 3 graduated levels of difficulty (easy, medium, and hard). Twenty medical students completed 2 sessions of all tasks at the easy level, 10 sessions at the medium level, and finally 5 sessions of the 2 most complex tasks at the hard level. At the medium level, subjects were randomized into 2 equal groups performing either all 12 tasks (group A) or the 2 most complex tasks (group B). Performance was measured by time taken, path length, and errors for each hand. The results were compared between groups, and to those of 10 experienced laparoscopic surgeons. RESULTS: Baseline performance of both groups was similar at the easy level. At the medium level, learning curves for all 3 parameters reached plateau at the second (group A, P < .05) and sixth (group B, P < .05) repetitions. Performance at the hard level was similar between the 2 groups, and all achieved the pre-set expert criteria. CONCLUSION: A graduated laparoscopic training curriculum enables trainees to familiarise, train and be assessed on laparoscopic VR simulators. This study can aid the incorporation of VR simulation into established surgical training programmes.     

Construct validity of the LapSim: Can the LapSim virtual reality simulator distinguish between novices and experts?

Background Virtual reality simulators may be invaluable in training and assessing future endoscopic surgeons. The purpose of this study was to investigate if the results of a training session reflect the actual skill of the trainee who is being assessed and thereby establish construct validity for the LapSim virtual reality simulator (Surgical Science Ltd., Gothenburg, Sweden). Methods Forty-eight subjects were assigned to one of three groups: 16 novices (0 endoscopic procedures), 16 surgical residents in training (>10 but <100 endoscopic procedures), and 16 experienced endoscopic surgeons (>100 endoscopic procedures). Performance was measured by a relative scoring system that combines single parameters measured by the computer. Results The higher the level of endoscopic experience of a participant, the higher the score. Experienced surgeons and surgical residents in training showed statistically significant higher scores than novices for both overall score and efficiency, speed, and precision parameters. Conclusions Our results show that performance of the various tasks on the simulator corresponds to the respective level of endoscopic experience in our research population. This study demonstrates construct validity for the LapSim virtual reality simulator. It thus measures relevant skills and can be integrated in an endoscopic training and assessment program.     

Construct validity of the LapSim virtual reality laparoscopic simulator within a urology residency program

Objective:

We assessed the construct validity of the LapSim laparoscopic surgical simulator in a urology residency training program.

Methods:

In total, 15 residents participated in the study between July 2007 and July 2008. The subjects were tested six times at one-month intervals on three skill tasks (lifting and grasping, cutting and clip application) using the LapSim laparoscopic simulator. The testing sessions were divided into the first three sessions (seminar 1), and the subsequent three sessions (seminar 2). We evaluated the following parameters: total time, path length, angular path length, tissue damage, maximum damage and stretch damage. The subjects were divided into junior (PGY 1,2) and senior resident groups (PGY 3,4,5). The Wilcoxon Signed-Rank test for paired samples was used to compare the performances of the juniors and seniors during seminar 1 to their performance in seminar 2 to determine whether there was improvement over time. The Wilcoxon Rank-Sum test for independent samples was used to compare the performance of the juniors to that of the seniors for seminar 1, seminar 2 and the combination of both seminars to determine whether the more experienced senior residents performed better than the less experienced juniors.

Results:

No significant performance improvement between testing sessions could be demonstrated. Similarly, there was no significant difference in performance between junior and senior residents.

Conclusions:

Construct validity could not be demonstrated for the total time, path length, angular path length and tissue handling parameters of the LapSim laparoscopic surgical simulator when examined within the context of a urology residency program.     

A randomized crossover trial examining low- versus high-fidelity simulation in basic laparoscopic skills training

Background

Previous randomized studies have compared high- versus low-fidelity laparoscopic simulators; however, no proficiency criteria were defined and results have been mixed. The purpose of this research was to determine whether there were any differences in the learning outcomes of participants who had trained to proficiency on low- or high-fidelity laparoscopic surgical simulators.

Methods

We conducted a randomized, prospective crossover trial with participants recruited from New South Wales, Western Australia, and South Australia. Participants were randomized to high-fidelity (LapSim, Surgical Science) or low-fidelity (FLS, SAGES) laparoscopic simulators and trained to proficiency in a defined number of tasks. They then crossed over to the other fidelity simulator and were tested. The outcomes of interest were the crossover mean scores, the proportion of tasks passed, and percentage passes for the crossover simulator tasks.

Results

Of the 228 participants recruited, 100 were randomized to LapSim and 128 to FLS. Mean crossover score increased from baseline for both simulators, but there was no significant difference between them (11.0?% vs. 11.9?%). FLS-trained participants passed a significantly higher proportion of crossover tasks compared with LapSim-trained participants (0.26 vs. 0.20, p?=?0.016). A significantly higher percentage of FLS-trained participants passed intracorporeal knot tying than LapSim-trained participants (35?% vs. 8?%, p?<?0.001).

Conclusion

Similar increases in participant score from baseline illustrate that training on either simulator type is beneficial. However, FLS-trained participants demonstrated a greater ability to translate their skills to successfully complete LapSim tasks. The ability of FLS-trained participants to transfer their skills to new settings suggests the benefit of this simulator type compared with the LapSim.     

Construction of an evidence-based, graduated training curriculum for D-box, a webcam-based laparoscopic basic skills trainer box

BackgroundSurgical training programs are now including simulators as training tools for teaching laparoscopic surgery. The aim of this study was to develop a standardized, graduated, and evidence-based curriculum for the newly developed D-box (D-box Medical, Lier, Norway) for training basic laparoscopic skills.MethodsEighteen interns with no laparoscopic experience completed a training program on the D-box consisting of 8 sessions of 5 tasks with assessment on a sixth task. Performance was measured by the use of 3-dimensional electromagnetic tracking of hand movements, path length, and time taken. Ten experienced surgeons (>100 laparoscopic surgeries, median 250) were recruited for establishing benchmark criteria.ResultsSignificant learning curves were obtained for all construct valid parameters for tasks 4 (P < .005) and 5 (P < .005) and reached plateau levels between the fifth and sixth session. Within the 8 sessions of this study, between 50% and 89% of the interns reached benchmark criteria on tasks 4 and 5.ConclusionsBenchmark criteria and an evidence-based curriculum have been developed for the D-box. The curriculum is aimed at training and assessing surgical novices in basic laparoscopic skills.     

Use of a virtual reality simulator for ureteroscopy training

PURPOSE: Virtual reality surgical simulators may shorten operative time and reduce the potential for iatrogenic injury by providing training outside the operating room. We hypothesized that training on a virtual ureteroscopy (VU) simulator would allow novice endoscopists to overcome the initial learning curve before entering the operating room. MATERIALS AND METHODS: We evaluated 16 medical students on their ability to perform specific ureteroscopic tasks on a VU simulator. The students trained on the simulator for a total of 5 hours over multiple sessions using different training modules and then were retested on the initial module. Likewise, 16 urology residents with varying degrees of endoscopic experience were assessed on the same test module twice, without additional simulator training. RESULTS: The students improved task completion time from 17.4 to 8.7 minutes (p <0.05), while the residents performed the task in 7.6 minutes at baseline and 6.7 minutes at the second trial. Stratification of residents by years of urology training revealed that the mean completion time for the students after training did not differ statistically from that of first year residents who had performed a median of 14 clinical ureteroscopies. Furthermore, the subjective performance scores of the students were comparable to those of the first year residents. CONCLUSIONS: Novice medical students trained on a VU simulator improved task completion time by 50% after training, and performed comparably to residents who had completed nearly 1 year of urology training. VR training may allow beginning urology residents to shorten the initial learning curve associated with ureteroscopy training, although this hypothesis requires further validation.     

The use of LapSim virtual reality simulator in the evaluation of laparoscopic surgery skill. Preliminary results

The aim of this study is to establish if the results obtained in the evaluation of the candidates for the laparoscopic surgery competence using the LapSim virtual reality simulator are comparable with intraoperative evaluation. For this study has been evaluated in front of the LapSim and in the operating room a number of 12 surgeons who have achieved the criteria for laparoscopic surgery competence evaluation. The results of any one of the candidates have been evaluated, on Lapsim and by the exam committee in the operation room relating to four criteria: (1) utilization of 300 camera; (2) manipulation and coordination of laparoscopic instruments, suturing; (3) grasping and cutting; (4) clip applying. The evaluation has been made relating to the time need for every candidate to perform the asked task, and the subjective evaluation of the examining committee with marks from 1 to 10. The LapSim evaluation, in concordance with intraoperative evaluation managed to establish 2 candidates with deficiency in manipulation and coordination of laparoscopic instruments, and difficulty in the laparoscopic bidimensional field orientation. We consider this experiment only the beginning in the evaluation of the utility of virtual reality simulator in the training and examination of the results in laparoscopic surgery. We consider that large series of subjects with different levels of knowledge in laparoscopic surgery have to be evaluated to conclude if the benefit of laparoscopic surgery virtual reality simulator is the same as in airplane pilots.     

The LapSim virtual reality simulator: promising but not yet proven

Background  

The acquisition of technical skills using surgical simulators is an area of active research and rapidly evolving technology. The LapSim is a virtual reality simulator that currently allows practice of basic laparoscopic skills and some procedures. To date, no reviews have been published with reference to a single virtual reality simulator.     

Establishing a curriculum for the acquisition of laparoscopic psychomotor skills in the virtual reality environment

BackgroundThe unique psychomotor skills required in laparoscopy result in reduced patient safety during the early part of the learning curve. Evidence suggests that these may be safely acquired in the virtual reality (VR) environment. Several VR simulators are available, each preloaded with several psychomotor skills tasks that provide users with computer-generated performance metrics. This review aimed to evaluate the usefulness of specific psychomotor skills tasks and metrics, and how trainers might build an effective training curriculum.MethodsWe performed a comprehensive literature search.ResultsThe vast majority of VR psychomotor skills tasks show construct validity for one or more metrics. These are commonly for time and motion parameters. Regarding training schedules, distributed practice is preferred over massed practice. However, a degree of supervision may be needed to counter the limitations of VR training.ConclusionsIn the future, standardized proficiency scores should facilitate local institutions in establishing VR laparoscopic psychomotor skills curricula.     

Comparison of the sensitivity of physical and virtual laparoscopic surgical training simulators to the user’s level of experience

Background: The recent focus on quality of care and patient safety has been accompanied by increased interest in standardizing the training for laparoscopic surgeons. Studies have shown that laparoscopic simulators can be used to train surgical skills. Therefore, we designed an experiment to compare the effectiveness of two popular training systems. One system was based on a physical model, whereas the other used a virtual reality model. Methods: A total of 32 medical students and residents were tested on both simulators. Time required for task completion and number of errors committed were recorded and compared. Results: The physical training system differentiated among experience levels on three of the five tasks when time was used as a measure and four of five tasks when score was used, whereas the virtual reality system yielded statistically significant results in eight of 13 tasks for time and in five of 13 tasks for score. Conclusion: The physical model is more sensitive than the virtual reality one in detecting differences in levels of laparoscopic surgical experience.     

Identification of skills common to renal and iliac endovascular procedures performed on a virtual reality simulator.

INTRODUCTION: There is a learning curve in the acquisition of endovascular skills for the treatment of vascular disease. Integration of Virtual reality (VR) simulator based training into the educational training curriculum offers a potential solution to overcome this learning curve. However evidence-based training curricula that define which tasks, how often and in which order they should be performed have yet to be developed. The aim of this study was to determine the nature of skills acquisition on the renal and iliac modules of a commercially-available VR simulator. METHOD: 20 surgical trainees without endovascular experience were randomised to complete eight sessions on a VR iliac (group A) or renal (group B) training module. To determine skills transferability across the two procedures, all subjects performed two further VR cases of the other procedure. Performance was recorded by the simulator for parameters such as time taken, contrast fluid usage and stent placement accuracy. RESULTS: During training, both groups demonstrated statistically significant VR learning curves: group A for procedure time (p<0.001) and stent placement accuracy (p=0.013) group B for procedure time (p<0.001), fluoroscopy time (p=0.003) and volume of contrast fluid used (p<0.001). At crossover, subjects in group B (renal trained) performed to the same level of skill on the simulated iliac task as group A. However, those in group A (iliac trained) had a significantly higher fluoroscopy time (median 118 vs 72 secs, p=0.020) when performing their first simulated renal task than for group B. CONCLUSION: Novice endovascular surgeons can significantly improve their performance of simulated procedures through repeated practice on VR simulators. Skills transfer between tasks was demonstrated but complex task training, such as selective arterial cannulation in simulators and possibly in the real world appears to involve a separate skill. It is thus suggested that a stepwise and hierarchical training curriculum is developed for acquisition of endovascular skill using VR simulation to supplement training on patients.     

Laparoscopic virtual reality and box trainers: is one superior to the other?

Background: Virtual reality (VR) simulators now have the potential to replace traditional methods of laparoscopic training. The aim of this study was to compare the VR simulator with the classical box trainer and determine whether one has advantages over the other. Methods: Twenty four novices were tested to determine their baseline laparoscopic skills and then randomized into the following three group: LapSim, box trainer, and no training (control). After 3 weekly training sessions lasting 30-min each, all subjects were reassessed. Assessment included motion analysis and error scores. Nonparametric tests were applied, and p < 0.05 was deemed significant. Results: Both trained groups made significant improvements in all parameters measured (p < 0.05). Compared to the controls, the box trainer group performed significantly better on most of the parameters, whereas the LapSim group performed significantly better on some parameters. There were no significant differences between the LapSim and box trainer groups. Conclusions: LapSim is effective in teaching skills that are transferable to a real laparoscopic task. However, there appear to be no substantial advantages of one system over the other.     

New perspectives in laparoscopic simulation: from students' skills lab to stress evaluation

BACKGROUND: Application of a LapSim-training model in the Students' Skills Lab as well as the objective evaluation of stress in a virtual operating room scenario offer new perspectives in laparoscopic simulation. METHODS: In a Students' Skills Lab , assessment of learning curves of laparoscopic basic skills and complex tasks was carried out with 28 individuals at a LapSim Virtual Reality (VR)-simulator in a training curriculum consisting of 9 units. In addition, in a virtual operating room scenario, stress evaluation was performed with 18 surgeons by means of a sympathicograph and, in that way, the laparoscopic error and complication rate were recorded. Three different stress reactions (SR 1-3) could be identified. RESULTS: In the Students' Skills Lab, at the beginning of the curriculum (unit 1), the best learning effects together with the improvement of the laparoscopic performance could be presented for the two parameters: Extent of movement of the laparoscopic instruments (length of path as well as degree of deviation from the "optimal course") and duration of the procedure. In the virtual stress scenario, the intraoperative error rate of surgeons with a stress reaction without recovery (SR-1) was lower than of those with recovery (SR-2) or without stress reaction (SR-3). CONCLUSION: Application of the LapSim Virtual Reality (VR)-simulator in the Students' Skills Lab and for stress and crisis simulation represents a new perspective in laparoscopic simulation, which will have to be further evaluated in the future. The transfer to the "real" operating room will have to be continued as a training and scientific validation paradigm.     

Simulation‐based surgical education in cardiothoracic training

Simulation has emerged as a feasible adjunct to surgical education and training for most specialties. It provides trainees with an immersive, realistic way to learn a variety of skills in a safe environment with the end goal of improving patient safety. There are three broad types of simulators: full mannequin simulators, part‐task trainers or bench models and virtual reality systems. This review aims to describe the current use of simulation in cardiothoracic surgical education and training. We identified multiple procedures that can be simulated in cardiothoracic surgery using a combination of the above simulators, three‐dimensional printing and computer‐based simulation. All studies that assessed the efficacy of simulators showed that simulation enhances learning and trainee performance allowing for repetitive training until the acquisition of competence but further research into how it translates into the operating theatre is required. In Australia, cardiac surgery simulation is not yet part of the training curricula, but simulators are available for certain tasks and procedures.     

From planes to brains: parallels between military development of virtual reality environments and virtual neurological surgery

Military explorations of the practical role of simulators have served as a driving force for much of the virtual reality technology that we have today. The evolution of 3-dimensional and virtual environments from the early flight simulators used during World War II to the sophisticated training simulators in the modern military followed a path that virtual surgical and neurosurgical devices have already begun to parallel. By understanding the evolution of military simulators as well as comparing and contrasting that evolution with current and future surgical simulators, it may be possible to expedite the development of appropriate devices and establish their validity as effective training tools. As such, this article presents a historical perspective examining the progression of neurosurgical simulators, the establishment of effective and appropriate curricula for using them, and the contributions that the military has made during the ongoing maturation of this exciting treatment and training modality.     

Psychomotor performance measured in a virtual environment correlates with technical skills in the operating room

Background  This study was conducted to validate the role of virtual reality computer simulation as an objective method for assessing laparoscopic technical skills. The authors aimed to investigate whether performance in the operating room, assessed using a modified Objective Structured Assessment of Technical Skill (OSATS), correlated with the performance parameters registered by a virtual reality laparoscopic trainer (LapSim). Methods  The study enrolled 10 surgical residents (3 females) with a median of 5.5 years (range, 2–6 years) since graduation who had similar limited experience in laparoscopic surgery (median, 5; range, 1–16 laparoscopic cholecystectomies). All the participants performed three repetitions of seven basic skills tasks on the LapSim laparoscopic trainer and one laparoscopic cholecystectomy in the operating room. The operating room procedure was video recorded and blindly assessed by two independent observers using a modified OSATS rating scale. Assessment in the operating room was based on three parameters: time used, error score, and economy of motion score. During the tasks on the LapSim, time, error (tissue damage and millimeters of tissue damage [tasks 2–6], error score [incomplete target areas, badly placed clips, and dropped clips [task 7]), and economy of movement parameters (path length and angular path) were registered. The correlation between time, economy, and error parameters during the simulated tasks and the operating room procedure was statistically assessed using Spearman’s test. Results  Significant correlations were demonstrated between the time used to complete the operating room procedure and time used for task 7 (r _s = 0.74; p = 0.015). The error score demonstrated during the laparoscopic cholecystectomy correlated well with the tissue damage in three of the seven tasks (p < 0.05), the millimeters of tissue damage during two of the tasks, and the error score in task 7 (r _s = 0.67; p = 0.034). Furthermore, statistically significant correlations were observed between the economy of motion score from the operative procedure and LapSim’s economy parameters (path length and angular path in six of the tasks) (p < 0.05). Conclusions  The current study demonstrated significant correlations between operative performance in the operating room (assessed using a well-validated rating scale) and psychomotor performance in virtual environment assessed by a computer simulator. This provides strong evidence for the validity of the simulator system as an objective tool for assessing laparoscopic skills. Virtual reality simulation can be used in practice to assess technical skills relevant for minimally invasive surgery.     

A Pilot Study of Surgical Training Using a Virtual Robotic Surgery Simulator

Background and Objectives:

Our objectives were to compare the utility of learning a suturing task on the virtual reality da Vinci Skills Simulator versus the da Vinci Surgical System dry laboratory platform and to assess user satisfaction among novice robotic surgeons.

Methods:

Medical trainees were enrolled prospectively; one group trained on the virtual reality simulator, and the other group trained on the da Vinci dry laboratory platform. Trainees received pretesting and post-testing on the dry laboratory platform. Participants then completed an anonymous online user experience and satisfaction survey.

Results:

We enrolled 20 participants. Mean pretest completion times did not significantly differ between the 2 groups. Training with either platform was associated with a similar decrease in mean time to completion (simulator platform group, 64.9 seconds [P = .04]; dry laboratory platform group, 63.9 seconds [P < .01]). Most participants (58%) preferred the virtual reality platform. The majority found the training “definitely useful” in improving robotic surgical skills (mean, 4.6) and would attend future training sessions (mean, 4.5).

Conclusion:

Training on the virtual reality robotic simulator or the dry laboratory robotic surgery platform resulted in significant improvements in time to completion and economy of motion for novice robotic surgeons. Although there was a perception that both simulators improved performance, there was a preference for the virtual reality simulator. Benefits unique to the simulator platform include autonomy of use, computerized performance feedback, and ease of setup. These features may facilitate more efficient and sophisticated simulation training above that of the conventional dry laboratory platform, without loss of efficacy.     

Comparison of training on two laparoscopic simulators and assessment of skills transfer to surgical performance

BACKGROUND: Several studies have investigated the transfer of surgical trainees' skills acquired on surgical simulators to the operating room setting. The purpose of this study was to compare the effectiveness of two laparoscopic surgery simulators by assessing the transfer of skills learned on simulators to closely matched surgical tasks in the animal laboratory. STUDY DESIGN: In this post-test-only Control group study design, 46 surgically naive medical student volunteers were randomly assigned to one of three groups: Tower Trainer group (n = 16), LapSim group (n = 17), and Control group (n = 13). Outcomes measures included both time and accuracy scores on three laparoscopic tasks (Task 1: Grasp and Place; Task 2: Run the Bowel; Task 3: Clip and Cut) performed on live anesthetized pigs, and a global rating of overall performance as judged by four experienced surgeons. RESULTS: The Tower Trainer group performed significantly better than the Control group on 1 of 7 outcomes measures-Task 3: Time (p < 0.032), although the LapSim group performed significantly better than the Control group on 2 of 7 measures-Task 3: Time (p < 0.008) and Global score (p < 0.005). In comparing the two simulators, the LapSim group performed significantly better than the Tower Trainer group on 3 of 7 outcomes measures-Task 2: Time (p < 0.032), Task 2: Accuracy (p < 0.030) and Global score (p < 0.005), although the Tower Trainer group did not perform significantly better than the LapSim group on any measure. CONCLUSIONS: This study demonstrated that naive subjects trained on a virtual-reality part-task trainer performed better on live surgical tasks in a porcine model as compared with those trained with a traditional box trainer. These findings could aid in selection of appropriate training methodologies.