Training for infrainguinal bypass surgery.

BACKGROUND: Despite satisfactory results for surgery performed by trainees, vascular surgeons need to improve training methods to ensure that aspiring surgeons are adequately trained with less clinical exposure during fewer dedicated years of training. OBJECTIVES: To review the wide range of workshop, laboratory and seminar-room based methods available to train for the diverse range of skills required for distal arterial revascularisation. Training methods include anastomotic suturing skills with bench-top training apparatus, working with realistic plastic models and prosthetic conduits, cadaveric dissections and virtual-reality simulations. Many of these also provide excellent opportunities for objective assessment of technical skills and trainees' progress. DESIGN AND METHODS: A review of the literature on surgical education, surgical skills training and assessment. An evaluation of some of the apparatus, facilities, training curricula and courses, currently available to European trainees, is carried out. CONCLUSIONS: Many methods are now available to allow focused training for particular skills in non-clinical settings. Objective tools are also available that allow assessment of trainees at many levels or practicing surgeons. These technical skills assessment methods are important for trainees and surgeons who, in the future, will increasingly need to demonstrate competence in vascular surgery.     

What do master surgeons think of surgical competence and revalidation?

BACKGROUND: There has been on-going debate and public interest in surgical competence in recent years. METHODS: A Delphi reiterative opinion survey was conducted among master surgeons on selection of surgical trainees, methods of assessment of progress of surgical trainees, and revalidation of established consultant surgeons. RESULTS: Selection-the current methods of trainee selection were considered inadequate and in need of revision. The important attributes recognized by group are cognitive factors, innate dexterity, and personality. Important aspects of personality include decision-making ability, insight, team spirit, and emotional stability. Assessment during training-the majority view was that this should be based on clinical judgement/skills, operative skills, and cognitive ability. Assessment of technical ability should be based on standardized checklists. Research within training programs was encouraged but academic achievement does not reflect surgical competence. There was a majority verdict for an exit clinical examination. Revalidation-the group agreed on the need for competence checks during the professional career of surgeons. These should cover knowledge, clinical, operative, and humanistic skills; but expressed concern on the feasibility of a revalidation system that can reliably assess the range of skills needed for surgical competence. There was a majority vote against an internal appraisal system. External assessment by nationally appointed 'assessors' was considered preferable. CONCLUSIONS: Both selection and assessment of surgical trainees require changes and standardization. Although revalidation is necessary, concern was expressed on the reliability and validity of existing and proposed systems.     

Accreditation council on graduate medical education technical skills competency compliance: urologic surgical skills

BACKGROUND: In accordance with new mandates implemented by the Accreditation Council on Graduate Medical Education, reliance on operative case logs as demonstration of residents' surgical competence will no longer be adequate. We describe the implementation of a comprehensive, year-round, mandatory skills laboratory curriculum as an integral component of our urology residency training program. STUDY DESIGN: We developed eight laboratory practicums using primarily nonhuman models: basic endoscopy, advanced endoscopy, ureteroscopy, percutaneous renal surgery, basic laparoscopy, advanced laparoscopy, urologic use of the gastrointestinal tract, and cadaveric pelvic dissection. RESULTS: Anonymous evaluations submitted by all training session participants indicate that acquisition of surgical skills is facilitated through participation in laboratory practicums. An incremental progression in proficiency was observed by all of the instructors and students who participated. There was a high degree of satisfaction with model fidelity and the value of technical experience gained. CONCLUSIONS: Our urologic surgery skills laboratory curriculum is an effective means of skills acquisition and maintenance for a wide variety of urologic techniques, including complex endourologic procedures. Patient care can safely be of secondary importance with respect to trainee experience in a low-stress environment that provides an opportunity for supervised repetitive performance of essential technical skills. We describe effective models, with high fidelity-to-cost ratio, that incorporate laboratory-based surgical skills training and evaluation into urology residency programs, with the aim of Accreditation Council on Graduate Medical Education competency guideline compliance.     

Core competency in laparoendoscopic surgery.

BACKGROUND: Concern about patient safety and physician competence was highlighted by the Institute of Medicine report, revealing the prevalence of fatal medical errors. There is also awareness that technical difficulties specific to laparoendoscopic surgery can cause medical errors. Reported herein is a review of the evidence pertaining to objective assessment of core competency components in laparoendoscopic surgery: cognitive skills, technical skills, surgical performance, and judgment. METHODS: PubMed and MedLine searches were performed to identify articles with combinations of the following key words: core competency, competency, laparoscopy, training, assessment, and curriculum. Further articles were obtained by searching reference lists of identified papers and through personal communication. CONCLUSIONS: The available evidence suggests that it is currently possible to objectively assess core competency components in laparoendoscopic surgery: knowledge and clinical judgment with well-established tests and innate technical abilities with computer-based simulators with embedded metrics. Simulation training is conducted to a proficiency criterion regardless of the number of repetitions or practice hours. Reports indicate that skills learned on a simulator transfer to the operating room. However, to date, objective assessment of surgical performance can be obtained only through review of unedited video tapes of surgical procedures by disinterested experts as recently demonstrated by our Japanese colleagues in urology.     

Acquiring surgical skills

BACKGROUND: Technical competence is the bedrock of surgery, yet it has only recently been viewed as a valid area for either critical evaluation or formal teaching. METHODS: This review examines the teaching of surgical skills. The core is derived from a literature search of the Medline computer database. Results and conclusion: The impetus for surgical change has generally related to the introduction of new technology. Advances initially allowed for open operation within the main body cavities; more recently minimal access surgery has appeared. The latter was introduced in an inappropriate manner, which has led to the evolution of teaching of technical skills away from an apprenticeship-based activity towards more formal skill-based training programmes. There is now a need for a solid theoretical base for the teaching of manual skills that accommodates concepts of surgical competence.     

What does leadership in surgery entail?

Background: Leadership is not formally taught at any level in surgical training; there are no mandatory leadership courses or qualifications for trainees or specialists, and leadership performance is rarely evaluated within surgical appraisal or assessment programmes. Methods: Literature obtained from a MEDLINE search was reviewed to determine the characteristics of surgical leaders; outline an analytical framework through which these characteristics can be developed both in surgeons and surgical departments; and reflect on future challenges and recommendations for the central role of leadership in the field of surgery. Results: Leadership in surgery entails professionalism, technical competence, motivation, innovation, teamwork, communication skills, decision‐making, business acumen, emotional competence, resilience and effective teaching. Leadership skills can be developed through experience, observation, and education using a framework including mentoring, coaching, networking, stretch assignments, action learning and feedback. Conclusion: Modern surgery will need leaders with superior leadership skills that are well defined. It is vital that leadership programmes to develop leadership skills are put into practice in medical education curriculum and postgraduate surgical training. This will ensure maintenance and improvement in the quality of patient care.     

A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre

BACKGROUND: High-risk organizations such as aviation rely on simulations for the training and assessment of technical and team performance. The aim of this study was to develop a simulated environment for surgical trainees using similar principles. METHODS: A total of 27 surgical trainees carried out a simulated procedure in a Simulated Operating Theatre with a standardized OR team. Observation of OR events was carried out by an unobtrusive data collection system: clinical data recorder. Assessment of performance consisted of blinded rating of technical skills, a checklist of technical events, an assessment of communication, and a global rating of team skills by a human factors expert and trained surgical research fellows. The participants underwent a debriefing session, and the face validity of the simulated environment was evaluated. RESULTS: While technical skills rating discriminated between surgeons according to experience (P = 0.002), there were no differences in terms of the checklist and team skills (P = 0.70). While all trainees were observed to gown/glove and handle sharps correctly, low scores were observed for some key features of communication with other team members. Low scores were obtained by the entire cohort for vigilance. Interobserver reliability was 0.90 and 0.89 for technical and team skills ratings. CONCLUSIONS: The simulated operating theatre could serve as an environment for the development of surgical competence among surgical trainees. Objective, structured, and multimodal assessment of performance during simulated procedures could serve as a basis for focused feedback during training of technical and team skills.     

How do we assess microsurgical skill?

How does one demonstrate competence in microsurgery? This will become an increasingly more important question as further reforms in surgical training and revalidation are implemented. Any assessment of competence should include an assessment of technical skill, but there is presently no validated objective assessment technique to do this. We examine the ideal characteristics of an assessment technique and review the methods currently being validated and which could be applicable to microsurgical skills. © 2005 Wiley‐Liss, Inc. Microsurgery 25:25–29, 2005.     

Simulation

Simulation is an established instrument for medical training and further education covering technical and non-technical skills. It provides a platform for training psychomotor skills and professional behavior. Various simulators have been developed for cardiac, thoracic, and vascular surgery. Skill trainers are described for heart valve surgery and coronary anastomoses. Even beating artificial hearts are commercially available for surgical training, besides classical animal models. Virtual reality provides an additional dimension for training in thoracoscopic and interventional surgery. Every simulator has to be embedded in a defined curriculum to achieve the optimal effect. Curricula in the form of courses may be more effective in teaching basic surgical skills than learning solely during patient treatment in the operating room. One popular method to facilitate simulators for education is scenario training in real time. International associations recommend the implementation of scenario simulation for emergency training and evaluation of surgical skills in various disciplines. Issues, such as communication, team leadership and decision making can be effectively trained by simulation scenarios. There are only a few but fundamental publications providing evidence that simulation has a positive effect on patient care during cardiac surgery and on intensive care units; however, simulation can never replace experience in real patient care. Especially inexperienced healthcare providers have a tendency to overestimate their competence after training by simulation. Simulation is therefore a valuable adjunct but not a substitute for medical training and further education.     

Establishing milestones in urology training: A survey of the Canadian Academy of Urological Surgeons

Background:

At the current time, technical skills are not directly evaluated by the Royal College of Physicians and Surgeons of Canada (RCPSC) as part of the certification process in urology. Rather, the RCPSC relies on the evaluation of Program Directors to ensure that trainees have acquired the necessary surgical skills.

Methods:

An electronic survey was sent out to the members of the Canadian Academy of Urological Surgeons (CAUS), including the 13 Canadian urology program directors, to assess the teaching and evaluation of technical skills of urology trainees.

Results:

The response rate was 37% (33/89), including 8 of the 13 (62%) Program Directors from across Canada. For the teaching of technical skills, most programs had access to live animal laboratories (69%), dedicated teaching time in simulation (59%) and physical training models (59%). Most relied on voluntary faculty. There was a wide variety of structured evaluations for technical skills used across programs, while 36% of respondents did not use structured evaluations. For trainees with deficiencies in technical skills, 67% of programs offered extra operative time with designated faculty, 26% offered additional simulation focused on the deficiency and 19% offered faculty tutorial sessions.

Conclusion:

Among Canadian urology residency programs, there is considerable variability in the assessment of technical skills of trainees. Standardized objective assessment tools would help ensure that all trainees have acquired adequate surgical proficiency to operate independently.     

Competence Assessment of Laparoscopic Operative and Cognitive Skills: Objective Structured Clinical Examination (OSCE) or Observational Clinical Human Reliability Assessment (OCHRA)

Background There is no agreed system that is acknowledged as the ideal assessment of laparoscopic operative and cognitive skills. A new approach that combines Objective Structured Clinical Examination (OSCE) and Observational Clinical Human Reliability Assessment (OCHRA) was developed and used to assess trainees’ operative and cognitive skills during laparoscopic training courses. Methods Performance of 60 trainees participating in 3-day essential laparoscopic skills training (cognitive and psychomotor) courses were assessed and scored using both OSCE and OCHRA. Results The study showed significant inverse correlations between the number of technical errors identified by OCHRA and the scores obtained by OSCE for individual tasks performed either by electro-surgical hook or laparoscopic scissors (r = −0.864 and r = −0.808, respectively). Significant differences between trainees were observed in relation to both overall OSCE scores and OCHRA parameters: execution time, total errors, and consequential errors (P < 0.001). Conclusions OCHRA provides a discriminative feedback assessment of laparoscopic operative skills. OCHRA and OSCE are best regarded as complementary assessment tools for operative and cognitive skills. The present study has documented significant variance between surgical trainees in the acquisition of both cognitive and operative skills.     

Experience matters: comparing novice and expert ratings of non‐technical skills using the NOTSS system

There is growing evidence that non‐technical skills (NTS) are related to surgical outcomes and patient safety. The aim of this study was to further evaluate a behaviour rating system (NOTSS: Non‐Technical Skills for Surgeons) which can be used for workplace assessment of the cognitive and social skills which are essential components of NTS. A novice group composed of consultant surgeons (n = 44) from five Scottish hospitals attended one of six experimental sessions and were trained to use the NOTSS system. They then used NOTSS to rate surgeons’ behaviors in six simulated scenarios filmed in the operating room. The behaviours demonstrated in each scenario were compared to expert ratings to determine accuracy. The mode rating from the novice group (who received a short training session in behaviour assessment) was the same as the expert group in 50% of ratings. Where there was disagreement, novice raters tended to provide lower ratings than the experts. Novice raters require significant training in this emerging area of competence in order to accurately rate non‐technical skills.     

A Review of the Available Urology Skills Training Curricula and Their Validation

BackgroundThe transforming field of urological surgery continues to demand development of novel training devices and curricula for its trainees. Contemporary trainees have to balance workplace demands while overcoming the cognitive barriers of acquiring skills in rapidly multiplying and advancing surgical techniques. This article provides a brief review of the process involved in developing a surgical curriculum and the current status of real and simulation-based curricula in the 4 subgroups of urological surgical practice: open, laparoscopic, endoscopic, and robotic.MethodsAn informal literature review was conducted to provide a snapshot into the variety of simulation training tools available for technical and nontechnical urological surgical skills within all subgroups of urological surgery using the following keywords: “urology, surgery, training, curriculum, validation, non-technical skills, technical skills, LESS, robotic, laparoscopy, animal models.” Validated training tools explored in research were tabulated and summarized.Results and ConclusionsA total of 20 studies exploring validated training tools were identified. Huge variation was noticed in the types of validity sought by researchers and suboptimal incorporation of these tools into curricula was noted across the subgroups of urological surgery. The following key recommendations emerge from the review: adoption of simulation-based curricula in training; better integration of dedicated training time in simulated environments within a trainee's working hours; better incentivization for educators and assessors to improvise, research, and deliver teaching using the technologies available; and continued emphasis on developing nontechnical skills in tandem with technical operative skills.     

Visuospatial and technical ability in the selection and assessment of higher surgical trainees in the London deanery

INTRODUCTION

Despite awareness of the limitations of current selection and competency assessments, there is little consensus and alternatives have not been readily accepted. Essential surgical skills include visuospatial and technical ability. The aim of this study was to survey current methods of higher surgical trainee selection and assessment. We suggest ways to improve the process.

MATERIALS AND METHODS

Nine surgical training programmes in the London deanery were surveyed through questionnaires to programme directors, existing trainees and examination of deanery publications.

RESULTS

Testing of visuospatial and technical ability was piloted at selection only in a single general surgical department. Practical skills were assessed in 3/9 (33%) specialties (ENT, plastic and general surgery). Once selected, no specialty tested visuospatial and technical ability. Practical skills were tested in only 1/9 (11%) specialties (plastic surgery). The remaining 8/9 (89%) were ‘assessed’ by interview.

CONCLUSIONS

Lack of visuospatial and technical ability assessment was identified at selection and during higher surgical training. Airlines have long recognised early identification of these qualities as critical for efficient training. There is a need for more objective methods in this area prior to selection as time to assess surgical trainees during long apprenticeships is no longer available. We advocate a suitably validated competency-based model during and at completion of training.     

Simulation in surgery. Where are we now and where to from here?

With the introduction of new techniques and technologies, operative skills became a crucial part of surgical competence, deserving more attention. Implementation of validated simulation modalities into the training curriculum is emphasized. It became obvious that operative skills should be brought to an adequate level of proficiency using different available approaches. At the dawn of the 21st century it became apparent that the use of simulation to train and to assess technical surgical skills provided a good solution to offset the curtailed apprenticeship system. The current state and future perspectives of simulation in surgical training are discussed. Development and use of multimodality simulation supported by e-learning, video-learning in web-based modules, is needed to support the apprenticeship system in order to achieve the necessary competences to become an expert surgeon.     

A new web-based operative skills assessment tool effectively tracks progression in surgical resident performance

PURPOSE: The study aim was to demonstrate that a new database tool for assessment of surgical resident operative skills discerns predictable progression in those skills over successive residency years for specific index case types. METHODS: A Web-based interactive database (OpRate) was used to assess selected aspects of resident operative performance as determined by supervising attending surgeons in a medium-sized residency (5-6 residents per postgraduate year [PGY]). This assessment consisted of (1) 3 questions pertaining to patient information, technical, and disease-specific preparedness; (2) 4 laparoscopic technical skills questions pertaining to tissue handling, dexterity, planning, and ability to function independently; and (3) similar open technical skills questions, with the addition of 2 questions defining knot tying ability. Two years of assessment data were examined for cholecystectomy (CH), appendectomy (AP), colon resection (CR), ventral hernia repair (VH), and inguinal hernia repair (IH). Mean scores for total, technical, and preparedness responses, as well as each response area were compared for successive training years for each case type. Mean performance data between postgraduate years were compared by ANOVA, and interitem reliability was assessed by Cronbach's alpha determinations. RESULTS: OpRate data for 579 cases (142 CH, 67 AP, 73 CR, 202 IH, and 95 VH) were examined. Significant incremental increases in open and laparoscopic technical skills scores by training year were observed for all case types (ANOVA, p < 0.0001). Individual technical skills as well as technical and disease-specific preparedness response areas also demonstrated significant improvement by successive training year. Cronbach's alpha determinations were 0.80-0.94 for the preparedness test items and the skills performance scores for all assessed procedures. CONCLUSIONS: Our early results show that the OpRate assessment tool is effective in identifying expected changes in operative performance across successive training years, with a satisfactory level of internal consistency for the test items. As such, the use of this database tool may offer the opportunity to (1) define performance benchmarks for specific levels of training and (2) identify areas where focused training may be required for specific residents.     

Technical and technological skills assessment in laparoscopic surgery.

OBJECTIVES: Surgical appraisal and revalidation are key components of good surgical practice and training. Assessing technical skills in a structured manner is still not widely used. Laparoscopic surgery also requires the surgeon to be competent in technological aspects of the operation. METHODS: Checklists for generic, specific technical, and technological skills for laparoscopic cholecystectomies were constructed. Two surgeons with >12 years postgraduate surgical experience assessed each operation blindly and independently on DVD. The technological skills were assessed in the operating room. RESULTS: One hundred operations were analyzed. Eight trainees and 10 consultant surgeons were recruited. No adverse events occurred due to technical or technological skills. Mean interrater reliability was kappa=0.88, P=<0.05. Construct validity for both technical and technological skills between trainee and consultant surgeons were significant, Mann-Whitney P=<0.05. CONCLUSIONS: Our study demonstrates that technical and technological skills can be measured to assess performance of laparoscopic surgeons. This technical and technological assessment tool for laparoscopic surgery seems to have face, content, concurrent, and construct validities and could be modified and applied to any laparoscopic operation. The tool has the possibility of being used in surgical training and appraisal. We aim to modify and apply this tool to advanced laparoscopic operations.     

Apprenticeship in laparoscopic surgery: Tools and methods for the surgeon in training

The introduction of laparoscopic approaches to surgery has been responsible for increased morbidity and has necessitated the development of a system of apprenticeship training in and out of the operating room for surgeons making their debut in the laparoscopic arena. This study, based on published data in the surgical literature, aims to evaluate the tools currently available for both teaching and evaluating competence in laparascopic surgery. Video simulators currently being used for teaching laparoscopic skills do not permit an objective evaluation of skill acquisition. Virtual reality simulators have the advantage of permitting an apprenticeship in laparoscopic surgical technique and a simultaneous assessment of the acquisition of surgical dexterity. This new technology should enable a better preparation of young surgeons for the operating room of the future.     

Multidisciplinary Crisis Simulations: The Way Forward for Training Surgical Teams

Background High-reliability organizations have stressed the importance of nontechnical skills for safety and of regularly providing such training to their teams. Recently safety skills training has been applied in the practice of medicine. In this study, we developed and piloted a module using multidisciplinary crisis scenarios in a simulated operating theatre to train entire surgical teams. Methods Twenty teams participated (n = 80); each consisted of a trainee surgeon, anesthetist, operating department practitioner (ODP), and scrub nurse. Crisis scenarios such as difficult intubation, hemorrhage, or cardiac arrest were simulated. Technical and nontechnical skills (leadership, communication, team skills, decision making, and vigilance), were assessed by clinical experts and by two psychologists using relevant technical and human factors rating scales. Participants received technical and nontechnical feedback, and the whole team received feedback on teamwork. Results Trainees assessed the training favorably. For technical skills there were no differences between surgical trainees’ assessment scores and the assessment scores of the trainers. However, nurses overrated their technical skill. Regarding nontechnical skills, leadership and decision making were scored lower than the other three nontechnical skills (communication, team skills, and vigilance). Surgeons scored lower than nurses on communication and teamwork skills. Surgeons and anesthetists scored lower than nurses on leadership. Conclusions Multidisciplinary simulation-based team training is feasible and well received by surgical teams. Nontechnical skills can be assessed alongside technical skills, and differences in performance indicate where there is a need for further training. Future work should focus on developing team performance measures for training and on the development and evaluation of systematic training for technical and nontechnical skills to enhance team performance and safety in surgery.     

Establishing learning curves for surgical residents using Cumulative Summation (CUSUM) Analysis

BACKGROUND: The assessment of technical proficiency is of paramount importance in the training of surgical residents. The fact that technical proficiency is underrepresented in the context of the ACGME outcomes project is evidenced in that proficiency skills comprise less than 5% of all assessments that evaluate residents. In this study, we use Cumulative Summation Analysis (CUSUM) as a visual objective analytic tool to determine performance accuracy and establish learning curves for PGY-1s in surgery. METHODS: From April 2001 to May 2002, 11 surgical residents completed a 1-month anesthesia rotation. Each resident was asked to complete a preoperative airway assessment followed by endotracheal intubation with induction of anesthesia. Airway assessment was performed independently by a resident and a licensed anesthesiologist or certified anesthetist with the modified Mallampati Score. Data were sequentially collected and plotted for summated successes and failures. RESULTS: The average intern required approximately 19 intubation attempts to complete the learning curve experience. There was no learning curve for airway assessment. CONCLUSIONS: The CUSUM analysis is an effective objective tool to define learning curves for technical skills. Vital information is provided for surgical programs that place residents in positions to manage airways, and limitless potential for defining the learning curves for technical skills is provided.