An analysis of reflective writing early in the medical curriculum: The relationship between reflective capacity and academic achievement

Objective: To examine the relationship between reflection, gender, residency choice, word count, and academic achievement among medical students.

Methods: A modified version of the Reflection Evaluation for Learners’ Enhanced Competencies Tool (REFLECT) was developed and used for this study (Cronbach’s alpha of 0.86 with an intraclass correlation coefficient [ICC] of 0.68). This was applied to writing samples about professionalism in gross anatomy from first-year medical students between 2005 and 2011. Four analysts reviewed and scored written reflections independently. Composite reflection scores were compared with gender, residency choice, length of written reflection, NBME® Gross Anatomy and Embryology Subject Examination scores, and final gross anatomy course.

Results: Total of 319 written reflections were evaluated. Female students who pursued medicine specialties had the highest composite reflection scores (87 [27.2%]). Word count frequently correlated with reflection score (p?<?0.0001). Students who performed well on the NBME® Gross Anatomy and Embryology Subject Examination tended to achieve high anatomy course grades (p?<?0.0001). There was no statistically significant relationship between composite reflection scores and NBME® Gross Anatomy and Embryology Subject Examination scores (p?=?0.16) or anatomy course grades (p?=?0.90).

Conclusions: This study suggests there are likely no correlations between reflective capacity and academic performance on tests of medical knowledge administered early in the medical curriculum.     

Mixed reality as a time-efficient alternative to cadaveric dissection

Abstract

Objectives: The extent of medical knowledge increases yearly, but the time available for students to learn is limited, leading to administrative pressures to revise and reconfigure medical school curricula. The goal of the present study is to determine whether the mixed reality platform HoloAnatomy represents an effective and time-efficient modality to learn anatomy when compared to traditional cadaveric dissection.

Methods: This was a prospective, longitudinal study of medical students completing a musculoskeletal anatomy course at Case Western Reserve University School of Medicine. Participants were divided into two groups based on learning platform (HoloAnatomy versus traditional cadaveric dissection) and content area (upper limb versus lower limb anatomy). Time spent in lab and end of course practical exam scores were compared between groups.

Results: The average study time of 48 medical students who completed study requirements was 4.564?h using HoloAnatomy and 7.318?h in the cadaver lab (p?=?0.001). No significant difference was found between exam scores for HoloAnatomy and cadaver learners (p?=?0.185).

Conclusions: Our results indicate that HoloAnatomy may decrease the time necessary for anatomy didactics without sacrificing student understanding of the material.     

A randomized controlled trial of high-fidelity simulation versus lecture-based education in preclinical medical students*

Purpose:?The purpose of this study was to compare the efficacy of simulation versus lecture-based education among preclinical medical students.

Methods:?Twenty medical students participated in this randomized, controlled crossover study. Students were randomized to four groups. Each group received two simulations and two lectures covering four different topics. Students were administered a pre-test, post-test and delayed post-test. The mean percentage of questions answered correctly on each test was calculated. The mean of each student’s change in score across the three tests was used to compare simulation- versus lecture-based education.

Results: Students in both the simulation and lecture groups demonstrated improvement between the pre-test and post-test (p?<?0.05). Students in the simulation group demonstrated improvement between the immediate post-test and delayed post-test (p?<?0.05), while students in the lecture group did not demonstrate improvement (p?>?0.05). When comparing interventions, the change in score between the pre-test and post-test was similar among both the groups (p?>?0.05). The change in score between the post-test and delayed post-test was greater in the simulation group (p?<?0.05).

Conclusions:?High-fidelity simulation may serve as a viable didactic platform for preclinical medical education. Our study demonstrated equivalent immediate knowledge gain and superior long-term knowledge retention in comparison to lectures.     

Tensions in mentoring medical students toward self-directed and reflective learning in a longitudinal portfolio-based mentoring system – An activity theory analysis

Background: In medical education, students need to acquire skills to self-direct(ed) learning (SDL), to enable their development into self-directing and reflective professionals. This study addressed the mentor perspective on how processes in the mentor–student interaction influenced development of SDL.

Methods: n?=?22 mentors of a graduate-entry medical school with a problem-based curriculum and longitudinal mentoring system were interviewed (n?=?1 recording failed). Using activity theory (AT) as a theoretical framework, thematic analysis was applied to the interview data to identify important themes.

Results: Four themes emerged: centered around the role of the portfolio, guiding of students’ SDL in the context of assessment procedures, mentor-role boundaries and longitudinal development of skills by both the mentor and mentee. Application of AT showed that in the interactions between themes tensions or supportive factors could emerge for activities in the mentoring process.

Conclusion: The mentors’ perspective on coaching and development of reflection and SDL of medical students yielded important insights into factors that can hinder or support students’ SDL, during a longitudinal mentor–student interaction. Coaching skills of the mentor, the interaction with a portfolio and the context of a mentor community are important factors in a longitudinal mentor–student interaction that can translate to students’ SDL skills.     

Medical students and professionalism – Do the hidden curriculum and current role models fail our future doctors?

Purpose: Formal medical curricula aim to promote professionalism through learning from lectures, interactive tutorials and simulations. We report an exploratory voting exercise, conducted within a new integrated professional teaching module, examining the likely influence on students’ knowledge and perceptions of truth telling.

Methods: Responses were collected from cohorts of final year students over a six-year period. Students were asked to pick between two responses to a standardized clinical vignette, firstly the response that they personally thought was the more desirable action, and subsequently the response they believed would most likely result in the context of everyday real-life clinical practice.

Results: The difference (proportional change) in voting for “avoid full disclosure” from vote 1 (more desirable action) to vote 2 (likely real-life response) was 50% (95% CI: 36–64%, p?Conclusions: This finding highlights a substantial inconsistency between the knowledge taught by the formal curriculum, and the perception generated by the hidden curriculum. Medical Schools should develop strategies to manage the hidden curriculum, prepare clinical teachers to be good role models, and prepare students to be discerning about the hidden curriculum and when choosing role models.     

Effects of Team-Based Learning on short-term and long-term retention of factual knowledge

Purpose: We investigated the effect of Team-Based Learning (TBL) on long-term retention of knowledge in comparison to a traditional curriculum.

Methods: As TBL was incorporated into our curriculum in the 2008–2009 academic year, students were compared with those who received the traditional curriculum the year prior. Students in both the groups completed multiple-choice knowledge test at four time points spanning two years. Test performance was compared at each time point to assess changes in knowledge retention as a function of time.

Results: Baseline knowledge did not differ significantly between the TBL and control groups [51% versus 46%; t(84)?=?0.91, p?=?0.37, d?=?0.20]. Performance improved after the course for both the groups, but was significantly higher in the TBL group [79% versus 59%; t(84)?=?4.96, p?=?0.000004, d?=?0.95]. However, when assessed prior to the pediatrics clerkship, learning gains from TBL had largely disappeared and the small difference in performance was not significant [57% versus 51%; t(84)?=?1.51, p?=?0.14, d?=?0.32].

Conclusion: Incorporating TBL into the pre-clinical pediatrics curriculum led to large gains in knowledge over the short-term, but these gains did not persist. Further research should focus on extending the impact of TBL on long-term knowledge retention.     

Reforms in VUmc School of Medical Sciences Amsterdam: Student engagement,a Minor elective semester and stakeholder collaboration in improving the quality of assessments

Abstract

Background: At VUmc School of Medical Sciences, major curricular reforms occurred in 2005 and 2015, related to the introduction of a Bachelor-Master structure, a new legislation from the Ministry of Education, the changing societal context, and taking note of students’ and teachers’ needs.

Summary of work: Along with the introduction of the Bachelor-Master system, the period between 2005 and 2009 saw the movement from traditional lecture-based teaching to small group teaching in a competency-based curriculum, in which the students were responsible for their learning. Student engagement grew through students’ designing learning modules and conducting some of the teaching. In the Bachelor program, an elective “Minor”, was designed to broaden and deepen the knowledge of our students beyond the core learning outcomes, in a discipline of their choice. The examination board (EB), responsible for maintaining the quality of assessment, was split into the General EB, which handled overall strategy issues, and the Executive EB, which handled student requests and monitored the quality of assessments.

Lessons learned: Students develop a sense of what education is about if they are provided opportunities in designing teaching and conducting it. A Minor elective in the medical study can provide the students with an opportunity to learn outside the medical field. Collaborative working between different stakeholders in a medical school is crucial for safeguarding the quality of assessments. Curricular reforms need time to be accepted and integrated into the culture of the medical school. The educational vision needs to be refreshed regularly in alignment with the changing societal context.     

Shedding light into the black box: A prospective longitudinal study identifying the CanMEDS roles of final year medical students’ on-ward activities

Introduction: To our best knowledge, a rigorous prospective analysis of final year medical students’ (FY medical students) activity profiles during workplace learning is lacking. The present study investigated the CanMEDS characteristics of all on-ward activities performed by internal medicine FY medical students. We tested the hypotheses that during FY medical student workplace training (I) routine activities are predominantly performed, while supervised, more complex activities are underrepresented with (II) FY medical students performing an insufficient number of autonomous activities and that (III) the CanMEDS roles of the Communicator and the Professional prevail.

Methods: During the second and the sixth week of their final year trimester at the University of Heidelberg Medical Hospital, N?=?34 FY medical students (73% female; mean age 26.4?±?2.4) were asked to keep a detailed record of all their on-ward activities and to document the duration, mode of action (active versus passive; independent versus supervised), estimated relevance for later practice, and difficulty-level in specially designed activity logbooks. CanMEDS roles were assigned to the documented activities via post-hoc expert consensus.

Results: About 4308 activities lasting a total of 2211.4?h were documented. Drawing blood (20.8%) was the most frequently documented medical activity followed by full admission procedures (9.6%). About 14.9% of the time was spent with non-medical activities. About 82.1% of all medical activities performed went unsupervised. The Communicator (42%), the Professional (38%), and the Collaborator (7%) were assigned as the top three CanMEDS roles.

Conclusions: The results call for increased efforts in creating more authentic learning experiences for FY medical students shifting towards more complex, supervised tasks, and improved team integration.     

A unique flipped classroom approach shows promising results in physician assistant education

Abstract

Aims: The flipped classroom (FC) model utilizes pre-class foundational learning with in-class higher-order application exercises. FC approaches have reported positive perceptions and mixed academic performance outcomes in medical education; however, little evidence exists on their impact in the 56-week didactic curriculum of Physician Assistant (PA) education.

Methods: A 4-week FC curriculum was piloted in a PA behavioral medicine course (n?=?34). Before class, students completed online video modules. During class, students completed a pre-class quiz and answered clinical case-based questions in a think-pair-share format.

Results: Students rated in-class time higher than a lecture-based segment of the same course (p?=?0.028). Assessment of achievement emotions demonstrated increased enjoyment (p?=?0.028) and decreased boredom (p?<?0.001) in the FC curriculum with no difference in anxiety. The FC curriculum produced a 57.2?min increase in pre-class preparation time with no change in post-class studying time. Compared to historical lecture-based controls (n?=?35), students in the FC curriculum scored significantly higher on clinical vignette questions (p?=?0.019) with equivalent performance on other question formats.

Conclusions: This study offers the first positive outcomes of an FC approach in PA education and provides a framework for improving academic performance while scaling back in-class time.     

The effectiveness of webcast compared to live lectures as a teaching tool in medical school

Objective: The purpose of this study is to investigate whether webcast lectures are comparable to live lectures as a teaching tool in medical school.

Methods: Three Otolaryngology-Head&Neck Surgery (OTO-HNS) lectures were given to third year medical students through their regular academic curriculum with one group receiving lectures in a live lecture format and the other group in a webcast format. All lectures (live or webcast) were given by the same lecturer and contained identical material. Three outcome measures were used: a student satisfaction survey, performance on the OTO-HNS component of their written examination, and performance on an OTO-HNS OSCE station in the general end of year OSCE examination session.

Results: Students performance on the written examination was equal between the two groups. The webcast group outperformed the live lecture group in the OSCE station. The majority of students in the webcast group felt it was an effective learning tool for them. Most viewed the lectures more than once, and felt that this was beneficial to their learning.

Conclusion: Webcasts appear equally effective to live lectures as a teaching tool.     

Self-regulated learning and academic performance in medical education

Content: Medical schools aim to graduate medical doctors who are able to self-regulate their learning. It is therefore important to investigate whether medical students’ self-regulated learning skills change during medical school. In addition, since these skills are expected to be helpful to learn more effectively, it is of interest to investigate whether these skills are related to academic performance.

Methods: In a cross-sectional design, the Self-Regulation of Learning Self-Report Scale (SRL-SRS) was used to investigate the change in students’ self-regulated learning skills. First and third-year students (N?=?949, 81.7%) SRL-SRS scores were compared with ANOVA. The relation with academic performance was investigated with multinomial regression analysis.

Results: Only one of the six skills, reflection, significantly, but positively, changed during medical school. In addition, a small, but positive relation of monitoring, reflection, and effort with first-year GPA was found, while only effort was related to third-year GPA.

Conclusions: The change in self-regulated learning skills is minor as only the level of reflection differs between the first and third year. In addition, the relation between self-regulated learning skills and academic performance is limited. Medical schools are therefore encouraged to re-examine the curriculum and methods they use to enhance their students’ self-regulated learning skills. Future research is required to understand the limited impact on performance.     

Spaced learning using emails to integrate psychiatry into general medical curriculum: Keep psychiatry in mind

Objectives: Traditionally, medical students on clinical rotations receive instruction on principles of mental health only during the psychiatry clerkship. We used emails to insert teaching of psychiatric concepts beyond the psychiatry clerkship into other rotations using the method of spaced learning, the delivery of brief morsels of information repeated over time intervals. We predicted that the intervention would improve attitudes and confidence towards the integration of psychiatry and knowledge retention.

Methods: We developed and distributed a series of emails relating key psychiatric concepts targeted to the other core clerkships.

Results: In a cluster-randomized trial over one academic year (intervention group n?=?71, control group n?=?61), scores on the Attitudes and Confidence in the Integration of Psychiatry scale and on the knowledge quiz did not differ significantly. Students who actively engaged with the emails demonstrated significantly higher scores on the knowledge test. Email users valued the timing, format of delivery and application of psychiatric principles outside the psychiatric setting. Participants recommended simplifying the format and previewing the benefits of spaced learning to increase utilization.

Conclusion: Delivering spaced learning through emails, within a curriculum designed to foster engagement, may provide an efficient means of addressing the widely-recognized but elusive goal of integrating teaching across medical disciplines.     

Ethical dilemmas during international clinical rotations in global health settings: Findings from a training and debriefing program

Purpose: This study describes the impact of an open-access, case-based global health ethics workshop and describes the breadth of dilemmas faced by students to inform future interventions.

Methods: Eighty-two medical students who undertook electives at 16 international sites between 2012 and 2015 received web-based surveys at three time points, incorporating quantitative and free-text probes of knowledge, skills, and attitudes related to global health clinical ethics dilemmas. Sixty students (73%) completed the pre-workshop survey, 38 (46%) completed the post-workshop survey, and 43 (52%) completed the post-trip survey.

Results: Analysis demonstrated improvement following the workshop in self-rated preparedness to manage ethical dilemmas abroad, identify ways to prepare for dilemmas, engage support persons, and manage related emotions (all comparisons, p?Conclusions: This analysis describes an ethics curriculum that prepares students to face ethical dilemmas during international clinical rotations. It broadens the representation of the dilemmas that students face, and highlights areas for curricular focus and optimization of on-site and post-trip student support resources.     

The impact of socially-accountable,community-engaged medical education on graduates in the Central Philippines: Implications for the global rural medical workforce

Introduction: Developing and retaining a high quality medical workforce, especially within low-resource countries has been a world-wide challenge exacerbated by a lack of medical schools, the maldistribution of doctors towards urban practice, health system inequities, and training doctors in tertiary centers rather than in rural communities.

Aim: To describe the impact of socially-accountable health professional education on graduates; specifically: their motivation towards community-based service, preparation for addressing local priority health issues, career choices, and practice location.

Methods: Cross-sectional survey of graduates from two medical schools in the Philippines: the University of Manila-School of Health Sciences (SHS-Palo) and a medical school with a more conventional curriculum.

Results: SHS-Palo graduates had significantly (p?p?p?=?0.032) or in rural government health services (p?p?p?=?0.028) and their current position (p?Conclusions: SHS-Palo medical graduates fulfilled a key aim of their socially-accountable institution to develop a health professional workforce willing and able, and have a commitment to work in underserved rural communties.     

Providing context for a medical school basic science curriculum: The importance of the humanities

Introduction: To increase students’ understanding of what it means to be a physician and engage in the everyday practice of medicine, a humanities program was implemented into the preclinical curriculum of the medical school curriculum. The purpose of our study was to determine how medical students’ views of being a doctor evolved after participating in a required humanities course.

Methods: Medical students completing a 16-clock hour humanities course from 10 courses were asked to respond to an open-ended reflection question regarding changes, if any, of their views of being a doctor. The constant comparative method was used for coding; triangulation and a variety of techniques were used to provide evidence of validity of the analysis.

Results: A majority of first- and second-year medical students (rr?=?70%) replied, resulting in 100 pages of text. A meta-theme of Contextualizing the Purpose of Medicine and three subthemes: the importance of Treating Patients Rather than a Disease, Understanding Observation Skills are Important, and Recognizing that Doctors are Fallible emerged from the data.

Conclusions: Results suggest that requiring humanities as part of the required preclinical curriculum can have a positive influence on medical students and act as a bridge to contextualize the purpose of medicine.     

Boosting clinical performance: The impact of enhanced final year placements

Background: This study follows on from a study that investigated how to develop effective final year medical student assistantship placements, using multidisciplinary clinical teams in planning and delivery.

Aims: This study assessed the effects on objective structured clinical examination (OSCE) performance of the in-course enhanced “super-assistantship” placement introduced to a randomly selected sample of 2013–14 final year medical students at Leeds medical school.

Methods: Quantitative data analysis was used to compare the global grades of OSCE stations between students who undertook this placement against those who did not.

Results: There was a small overall improvement in the “super-assistantship” student scores across the whole assessment (effect size?=?0.085). “Pre-op Capacity”, “Admissions Prescribing” and “Hip Pain” stations had small-medium effect sizes (0.226, 0.215, and 0.214) in favor of the intervention group. Other stations had small effect sizes (0.107–0.191), mostly in favor of the intervention group.

Conclusions: The “super-assistantship” experience characterized by increasing student responsibility on placement can help to improve competence and confidence in clinical decision-making “in a simulated environment”. The clinical environment and multidisciplinary team must be ready and supported to provide these opportunities effectively. Further in-course opportunities for increasing final year student responsibility should be developed.     

Undergraduate medical students’ perspectives of skills,uses and preferences of information technology in medical education: A cross-sectional study in a Saudi Medical College

Abstract

Background: Information technology (IT) is widely used in medical education. However, there are not enough studies about IT uses and preferences among traditional and problem-based learning (PBL) medical students.

Aim: To compare IT skills, uses and preferences for education between traditional and PBL medical students’.

Method: A cross-sectional study; a modified Educause Center for Analysis and Research online survey was sent to traditional curriculum 5th and PBL 4th year medical students of King Saud University.

Results: Most of the responding 176 students prefer mobile devices and moderate amount of IT in education. Fourth and fifth year students perceived high academic value of Google (94.2 vs. 86.7%, p?=?0.34), YouTube (90.7 vs. 92.2%, p?=?0.83) and PubMed (83.7 vs. 86.7%, p?=?0.06). More 4th year than 5th year students rated themselves as skilled in learning management system (54.7 vs. 21.1%, p?=?0.0001) and Smartboard use (40.7 vs. 23.3%, p?=?0.04). Most students rated faculty IT skills as effective. Students agreed that technology helps working faster (95.5%) and make learning creative (85.9%).

Conclusions: More integration of information literacy and IT training in medical curricula is needed to enhance better utilization of full features of IT resources available for learning and problem solving. National multi-institutional studies are recommended.     

Learning methods and strategies of anatomy among medical students in two different Institutions in Riyadh,Saudi Arabia

Abstract

Background: Anatomy instructors adopt individual teaching methods and strategies to convey anatomical information to medical students for learning. Students also exhibit their own individual learning preferences. Instructional methods preferences vary between both instructors and students across different institutions.

Aims: In attempt to bridge the gap between teaching methods and the students’ learning preferences, this study aimed to identify students’ learning methods and different strategies of studying anatomy in two different Saudi medical schools in Riyadh.

Materials and Methods: A cross-sectional study, conducted in Saudi Arabia in April 2015, utilized a three-section questionnaire, which was distributed to a consecutive sample of 883 medical students to explore their methods and strategies in learning and teaching anatomy in two separate institutions in Riyadh, Saudi Arabia.

Results: Medical students’ learning styles and preferences were found to be predominantly affected by different cultural backgrounds, gender, and level of study. Many students found it easier to understand and remember anatomy components using study aids. In addition, almost half of the students felt confident to ask their teachers questions after class. The study also showed that more than half of the students found it easier to study by concentrating on a particular part of the body rather than systems. Students’ methods of learning were distributed equally between memorizing facts and learning by hands-on dissection. In addition, the study showed that two thirds of the students felt satisfied with their learning method and believed it was well suited for anatomy.

Conclusions: There is no single teaching method which proves beneficial; instructors should be flexible in their teaching in order to optimize students’ academic achievements.