The role of online videos in teaching procedural skills to post-graduate medical learners: A systematic narrative review

Abstract

Objective: Online videos are commonly used in medical education. The aim of this review was to investigate the role of online instructional videos in teaching procedural skills to postgraduate medical learners.

Methods: This systematic narrative review was conducted according to the PRISMA guidelines. MEDLINE, Cochrane Central Register of Controlled Trials, EMBASE, ERIC and Google Scholar were searched. Full texts that applied to online videos, postgraduate medical learners and procedural skills were included without language restrictions. The methodological quality of the studies was evaluated using a validated tool. A thematic analysis of the studies was carried out using a general inductive approach.

Results: A total of 785 articles were retrieved and the full text was reviewed for 66 articles that met the inclusion and exclusion criteria of the study. Twenty papers that were relevant to the role of online videos in postgraduate medical education of procedural skills were used for this review. They were heterogenous in the outcomes collected and the evidence was of variable quality. There was strong evidence for the use of online videos for procedural skill knowledge acquisition and retention. Online videos were used for various purposes, such as supervision, assessment, postoperative debriefing, providing feedback, and promoting reflection.

Conclusion: Online videos are a valuable educational tool especially for procedural skill knowledge acquisition and retention. Future research needs to be carried out on the appropriate use of platforms in disseminating and using online videos, identifying the factors surrounding the learners, video characteristics, and data protection.     

Impact of different scoring methods on the clinical skills assessment of internal medicine students

The aim of this study was to determine how different scoring methods could influence the results achieved in clinical competence assessment examinations at the end of the medical school curriculum. Fifty-six final-year medical school students were examined using a programme of multimedia computer-based simulated cases (Procuste programme). For generating results, the following scoring methods were applied: (1) the method used for the Internal Medicine official certification examination which includes both weighted and unweighted items; (2) a method with only unweighted items;(3) a method which includes single-item analysis. Each time an absolute pass/fail cut-off standard ( S 60/100) and a relative pass/fail cut-off (mean minus 1 standard deviation) were applied.Taking as a reference the first method, the effect of using different scoring methods on the percentage of student failure was evaluated. Furthermore, correlation studies between the results obtained with these scoring methods and the grades reported by the examinees during the medical school curriculum were performed. It was found that the first method generated a more realistic pass/fail rate compared with the two other methods. Furthermore this method, which has been used for the last 10 years for administering internal medicine examinations, showed better correlation coefficients with the curriculum scores.     

A feasibility study comparing checklists and global rating forms to assess resident performance in clinical skills

This study evaluated the feasibility of two different scoring forms for assessing the clinical performance of residents in anaesthesiology. One of the forms had a checklist format including task-specific items and the other was a global rating form with general dimensions of competence including 'clinical skills', 'communication skills' and 'knowledge'. Thirty-two clinicians representing 25 (83%) of the 30 training hospitals in the country participated in the study. The clinicians were randomized into two groups, each of which used one of the scoring formats to assess a resident's performance in four simulated clinical scenarios on videotape. Clinicians' opinions about the appropriateness of the scoring forms were rated on a scale of 1-5. The checklist format was rated significantly higher compared with the global rating form (mean 4.6, 0.5 vs. mean 3.5, 1.4, p < 0.001). The inter-rater agreement regarding pass/fail decisions was poor irrespective of the scoring form used. This was explained by clinicians' leniency as assessors rather than by lack of vigilance in the observations or disagreements on standards for good performance.     

Training junior faculty to become clinical teachers: The value of personalized coaching

Abstract

Background: Junior clinical faculty require institutional support in the acquisition of feedback and clinical supervision skills of trainees. We tested the effectiveness of a personalized coaching versus guided self-reflection format of a faculty development program at improving faculty skills and self-efficacy.

Methods: Participants were evaluated both before and after the program using a four-station Objective Structured Teaching Exercise (OSTE). A gain-score analysis, one-way ANOVA, and paired t-tests were used to evaluate both groups. The impact on the learning environment was measured by resident ratings of the Maastricht Clinical Teaching Questionnaire.

Results: One hundred and twenty-seven participants completed the study over a three-year period. Both groups had significant improvements in self-efficacy. Participants in the coaching group demonstrated superior performance in encouraging learner self-reflection, teaching effectiveness, verifying learner understanding, exploring feelings/needs, and defining learning objectives. Over a 5-year period, the overall institutional learning climate significantly improved concerning faculty role-modeling, coaching, articulation, and explorations skills.

Conclusion: Offering a contextualized faculty-development program using OSTEs that provides multiple opportunities for feedback and is focused on creating a community of practice is an effective method to facilitate the transfer of skills to the clinical environment, supports teacher identity development, and favorably impacts the learning climate.     

An international study on teachers’ conceptions of learning and teaching and corresponding teacher profiles

Abstract

Introduction: Teachers’ conceptions of learning and teaching (COLT) affect their teaching behaviour. The 18 item COLT instrument has been developed in the Netherlands and comprises three scales, ‘teacher centredness’, ‘appreciation of active learning’ and ‘orientation to professional practice’. Previously we found five teacher profiles. The aim of this study was to find out if the COLT instrument can be used in an international setting.

Methods: Data were collected with the web-based COLT. Cronbach’s alphas of the three COLT scales were calculated. Subsequently a cluster analysis was conducted to identify different teacher profiles, followed by a split half validation procedure.

Results: Respondents (n?=?708) worked in 28 countries. Cronbach’s alphas were 0.67, 0.54, and 0.66. A six-cluster solution fitted best, based on meaning and explained variance. The sixth teacher profile scored high on ‘teacher centredness’, average on ‘appreciation of active learning’ and low on ‘orientation to professional practice’. The split half validation resulted in a Cohen’s kappa of 0.744.

Discussion: Cronbach’s alphas indicated acceptable reliablities for all three subscales. The new, sixth profile was labelled ‘neo-transmitter’.

Conclusion: We found evidence supporting the validity of the use of COLT in an international context and identified a new, sixth teacher profile.     

Introducing peer observation of teaching to GP teachers: a questionnaire study

In medical education programmes which rely on clinical teachers spread across diverse sites, the application of peer observation of teaching offers the potential of both supporting teachers and maintaining quality. This paper reports on a questionnaire survey carried out with general practitioner (GP) teachers of medical undergraduate students from King's College London School of Medicine at Guy's, King's College and St Thomas' Hospitals. The aim of the study was to determine GP teachers' views on a proposed programme of peer observation of their teaching. The majority of GP teachers identified benefits of the proposed scheme with 69% saying it would help improve the education of future doctors. However, despite seeing the benefits, less than half wished to take part in the programme. Two thirds cited time and paperwork as major disincentives to taking part and 62% said that they felt it would make them feel under scrutiny. No associations were found between measures of workload and willingness to take part. This suggests that a fundamental fear of scrutiny and criticism may be the main hurdle to be overcome in implementing the scheme. Imposing peer observation on GP teachers in the form proposed could create suspicion and distance between the university department and practice-based GP teachers and may even result in a loss of teachers. The introduction of peer observation is more likely to be successful if GPs' apprehensions are addressed. Using peer observation to strengthen the process of quality assurance may undermine its role in the support and development of clinical teachers.     

Undergraduate students' attitudes to communication skills learning differ depending on year of study and gender

The authors wished to assess medical students' attitudes towards communication skills learning, and to validate the use of the Communication Skills Attitude Scale (CSAS) in a different population. This cross-sectional study of Years 1-3 MBChB students, University of Aberdeen, in 2002-03 (overall response rate=86.2%) identified significant differences in attitudes to communication skills teaching by year of study and gender. PAS (positive attitudes scores) for Year 1 were significantly higher than those for Years 2 and 3. NAS (negative attitudes scores) for Year 1 were significantly lower than the scores for Year 2 but not Year 3. The scores for Years 2 and 3 were not significantly different. Female students had a significantly higher mean PAS score and lower mean NAS score than males, and were more likely to disagree that their communication and clinical skills were competent. While cohort effects may be present, it seems that attitudes towards communication skills learning are positive initially, becoming less so until students experience interacting with patients. Differences between male and female students reflect those seen in previous studies. The findings presented support the use of the CSAS as an appropriate tool to measure attitudes in a wide population of medical students.     

Defining a framework for medical teachers’ competencies to teach ethnic and cultural diversity: Results of a European Delphi study

Background: Medical students need to be trained in delivering diversity-responsive health care but unknown is what competencies teachers need. The aim of this study was to devise a framework of competencies for diversity teaching.

Methods: An open-ended questionnaire about essential diversity teaching competencies was sent to a panel. This resulted in a list of 74 teaching competencies, which was sent in a second round to the panel for rating. The final framework of competencies was approved by the panel.

Results: Thirty-four experts participated. The final framework consisted of 10 competencies that were seen as essential for all medical teachers: (1) ability to critically reflect on own values and beliefs; (2) ability to communicate about individuals in a nondiscriminatory, nonstereotyping way; (3) empathy for patients regardless of ethnicity, race or nationality; (4) awareness of intersectionality; (5) awareness of own ethnic and cultural background; (6) knowledge of ethnic and social determinants of physical and mental health of migrants; (7) ability to reflect with students on the social or cultural context of the patient relevant to the medical encounter; (8) awareness that teachers are role models in the way they talk about patients from different ethnic, cultural and social backgrounds; (9) empathy for students of diverse ethnic, cultural and social background; (10) ability to engage, motivate and let all students participate.

Conclusions: This framework of teaching competencies can be used in faculty development programs to adequately train all medical teachers.     

An evaluation plan to assess the process and outcomes of a learner-centered training program for clinical research

In 1994, the National Center for Research Resources' Committee on Addressing Career Paths for Clinical Research reported that insufficient training in research methods, inadequate mentoring, and inappropriate timing of training presented major barriers to the development of clinical researchers. The National Institutes of Health responded to the need for additional training programs by supporting 57 institutions through the Clinical Research Curriculum Award (K30) Program. The ability to assess the success of these programs depends on the nature and extent of their evaluation plans. Evaluation plans for clinical research training programs should include means of assessing both process and outcomes of a program's implementation in its formative and summative stages. This article describes the University of Wisconsin-Madison's Clinical Investigator Preparatory Program and an evaluation plan that incorporates process and outcome assessments based on a theoretical framework of adult and professional education.