An analysis of reflective writing early in the medical curriculum: The relationship between reflective capacity and academic achievement

Objective: To examine the relationship between reflection, gender, residency choice, word count, and academic achievement among medical students.

Methods: A modified version of the Reflection Evaluation for Learners’ Enhanced Competencies Tool (REFLECT) was developed and used for this study (Cronbach’s alpha of 0.86 with an intraclass correlation coefficient [ICC] of 0.68). This was applied to writing samples about professionalism in gross anatomy from first-year medical students between 2005 and 2011. Four analysts reviewed and scored written reflections independently. Composite reflection scores were compared with gender, residency choice, length of written reflection, NBME® Gross Anatomy and Embryology Subject Examination scores, and final gross anatomy course.

Results: Total of 319 written reflections were evaluated. Female students who pursued medicine specialties had the highest composite reflection scores (87 [27.2%]). Word count frequently correlated with reflection score (p?<?0.0001). Students who performed well on the NBME® Gross Anatomy and Embryology Subject Examination tended to achieve high anatomy course grades (p?<?0.0001). There was no statistically significant relationship between composite reflection scores and NBME® Gross Anatomy and Embryology Subject Examination scores (p?=?0.16) or anatomy course grades (p?=?0.90).

Conclusions: This study suggests there are likely no correlations between reflective capacity and academic performance on tests of medical knowledge administered early in the medical curriculum.     

A unique flipped classroom approach shows promising results in physician assistant education

Abstract

Aims: The flipped classroom (FC) model utilizes pre-class foundational learning with in-class higher-order application exercises. FC approaches have reported positive perceptions and mixed academic performance outcomes in medical education; however, little evidence exists on their impact in the 56-week didactic curriculum of Physician Assistant (PA) education.

Methods: A 4-week FC curriculum was piloted in a PA behavioral medicine course (n?=?34). Before class, students completed online video modules. During class, students completed a pre-class quiz and answered clinical case-based questions in a think-pair-share format.

Results: Students rated in-class time higher than a lecture-based segment of the same course (p?=?0.028). Assessment of achievement emotions demonstrated increased enjoyment (p?=?0.028) and decreased boredom (p?<?0.001) in the FC curriculum with no difference in anxiety. The FC curriculum produced a 57.2?min increase in pre-class preparation time with no change in post-class studying time. Compared to historical lecture-based controls (n?=?35), students in the FC curriculum scored significantly higher on clinical vignette questions (p?=?0.019) with equivalent performance on other question formats.

Conclusions: This study offers the first positive outcomes of an FC approach in PA education and provides a framework for improving academic performance while scaling back in-class time.     

What makes a good children’s doctor? Exploring the child perspective in the OSCE setting

Background: Patient feedback is increasingly important in clinical practice, and this should include children’s views. 28 children aged 8–10 years participating in a large-scale OSCE underwent cranial nerve examination by student candidates. They scored each out of 10 for the question: ‘If you had to see a doctor again, how happy would you be to see this one?’ An age-adapted qualitative focus group methodology was used to explore why they scored some students more highly than others.

Results: Children’s scores for the 256 medical students ranged from 2 to 10 (median 9; mean 8.46). 76% of scores were above 8. ‘Good' doctor attributes included: ‘friendly’, ‘funny’, ‘knowledgeable’, ‘confident’; ‘bad’ doctor attributes were: ‘making mistakes’, ‘not paying attention’, ‘forgot everything’, ‘serious’. Children’s reasons for specific scores are further explored.

Discussion and conclusion: Scores were positively skewed, in line with most patient/simulated patient feedback, and children discriminated between candidates. It should not be assumed that clinician examiners can accurately represent the views of child patients who may value different qualities in doctors. Children participating in our study had clear views of what they want from a doctor: a consultative approach with clear and kind explanation of the process of examination.     

The alignment imperative in curriculum renewal

Abstract

Rationale: There are perennial calls for MD curricula to reform in order to meet the changing needs of students, patients, and society. And yet, efforts at renewal have also been suggested to have minimal impact on the pedagogy and outcomes of medical education. One reason may be misalignment between the components of the curriculum during design and implementation. The University of Toronto MD program recently renewed its undergraduate preclinical Foundations curriculum. Mindful of the pitfalls of misalignment, the renewal process focused deliberately on alignment between the various components of the curriculum: instructional methods, student assessment, faculty development, and the larger purpose of serving students and society.

Innovation: Educational evidence was used to drive the alignment process which resulted in three major changes. First, we created a spiral curriculum centered on 72 virtual patient cases designed to integrate content and prepare students for clinical learning. Second, we introduced a novel medical psychiatry component to address a core societal need in mental health. This exposed students early to experiences of complexity, ambiguity, and integrated patient care. Lastly, a shift to assessment for learning and programmatic assessment was designed and implemented concurrently to reinforce the pedagogy of the curriculum. Synchronous faculty development was developed for the new roles required of faculty.

Conclusions: Early program evaluation shows alignment of these curricular components requires ongoing attention and resources in order to be successful. The potential benefits of this alignment are well prepared students who can meet the needs of their patients and society in an increasingly complex health system.     

Evidence-based medicine (EBM) for undergraduate medical students: A six-step,integrative approach

Abstract

Background: Nowadays, there is an increasing interest in practicing evidence-based medicine (EBM) to provide valid and up-to-date information about health problems and procedures for solving these problems. However, studying EBM among other medical education disciplines remains unsatisfactory.

Aim: To design and pilot a basic course on EBM for undergraduate medical students in order to raise the awareness of the Saudi medical education community about this discipline.

Subjects and methods: The developed course targeted undergraduate Year 4 medical students at Ibn Sina National College for Medical Studies in Jeddah, Saudi Arabia. The course was integrated longitudinally into ?Integrated Multisystem Module? of Year 4. Students and faculty perceptions were evaluated for program evaluation purposes. Course design was based on Kern et al. six-step approach for curriculum development.

Results: Students overall perception of this course was positive except for some points related to the time allocated and their training on using evidence databases. Faculty members who participated in implementing the course perceived it positively.

Conclusions: Teaching EBM is recommended and applicable. It is not resource-intensive, and can be conducted through developing and integrating EBM courses in the undergraduate medical curriculum. Students and teachers agree upon the need and importance of teaching such discipline.     

A meta-ethnography of interview-based qualitative research studies on medical students’ views and experiences of empathy

Background: Quantitative research suggests that medical students' empathy declines during their training. This meta-ethnography asks: What new understanding may be gained by a synthesis of interview-based qualitative research on medical students’ views and experiences of empathy? How can such a synthesis be undertaken?

Methodology: A meta-ethnography synthesizes individual qualitative studies to generate knowledge increasing understanding and informing debate. A literature search yielded eight qualitative studies which met the inclusion criteria. These were analyzed from a phenomenological and interpretative perspective.

Results: The meta-ethnography revealed a conceptual confusion around empathy and a tension in medical education between distancing and connecting with patients. Barriers to empathy included a lack of patient contact and a strong emphasis on the biomedical over the psycho-social aspects of the curriculum. A number of influences discussed in the paper lead students to adopt less overt ways of showing their empathy.

Conclusion: These insights deepen our understanding of the apparent decline in empathy in medical students. The lessons from these studies suggest that future curriculum development should include earlier patient contact, more emphasis on psycho-social aspects of care and address the barriers to empathy to ensure that tomorrow’s doctors are empathetic as well as competent.     

A randomized controlled trial of high-fidelity simulation versus lecture-based education in preclinical medical students*

Purpose:?The purpose of this study was to compare the efficacy of simulation versus lecture-based education among preclinical medical students.

Methods:?Twenty medical students participated in this randomized, controlled crossover study. Students were randomized to four groups. Each group received two simulations and two lectures covering four different topics. Students were administered a pre-test, post-test and delayed post-test. The mean percentage of questions answered correctly on each test was calculated. The mean of each student’s change in score across the three tests was used to compare simulation- versus lecture-based education.

Results: Students in both the simulation and lecture groups demonstrated improvement between the pre-test and post-test (p?<?0.05). Students in the simulation group demonstrated improvement between the immediate post-test and delayed post-test (p?<?0.05), while students in the lecture group did not demonstrate improvement (p?>?0.05). When comparing interventions, the change in score between the pre-test and post-test was similar among both the groups (p?>?0.05). The change in score between the post-test and delayed post-test was greater in the simulation group (p?<?0.05).

Conclusions:?High-fidelity simulation may serve as a viable didactic platform for preclinical medical education. Our study demonstrated equivalent immediate knowledge gain and superior long-term knowledge retention in comparison to lectures.     

Small group activities within academic communities improve the connectedness of students and faculty

Background: The University of California, San Diego, School of Medicine implemented a curriculum change that included reduction of lectures, incorporation of problem-based learning and other small group activities. Six academic communities were introduced for teaching longitudinal curricular content and organizing extracurricular activities.

Methods: Surveys were collected from 904 first- and second-year medical students over 6 years. Student satisfaction data with their sense of connectedness and community support were collected before and after the implementation of the new curriculum. In a follow-up survey, medical students rated factors that contributed to their sense of connectedness with faculty and students (n?=?134).

Results: Students’ perception of connectedness to faculty significantly increased following implementation of a curriculum change that included academic communities. Students ranked small group clinical skills activities within academic communities significantly higher than other activities concerning their sense of connectedness with faculty. Students’ perception of connectedness among each other was high at baseline and did not significantly change. Small group activities scored higher than extracurricular activities regarding students’ connectedness among themselves.

Conclusions: The implementation of a new curriculum with more small group educational activities including academic communities enhanced connectedness between students and faculty and resulted in an increased sense of community.     

Preclinical medical student observations associated with later professionalism concerns

Purpose: Professionalism is a core physician competency and identifying students at risk for poor professional development early in their careers may allow for mentoring. This study identified indicators in the preclinical years associated with later professionalism concerns.

Methods: A retrospective analysis of observable indicators in the preclinical and clinical years was conducted using two classes of students (n?=?226). Relationships between five potential indicators of poor professionalism in the preclinical years and observations related to professional concerns in the clinical years were analyzed.

Results: Fifty-three medical students were identified with at least one preclinical indicator and one professionalism concern during the clinical years. Two observable preclinical indicators were significantly correlated with unprofessional conduct during the clinical years: Three or more absences from attendance-required sessions (odds ratio 4.47; p=.006) and negative peer assessment (odds ratio 3.35; p=.049).

Conclusions: We identified two significant observable preclinical indicators associated with later professionalism concerns: excessive absences and negative peer assessments. Early recognition of students at risk for future professionalism struggles would provide an opportunity for proactive professional development prior to the clinical years, when students’ permanent records may be affected. Peer assessment, coupled with attention to frequent absences, may be a method to provide early recognition.     

Self-regulated learning and academic performance in medical education

Content: Medical schools aim to graduate medical doctors who are able to self-regulate their learning. It is therefore important to investigate whether medical students’ self-regulated learning skills change during medical school. In addition, since these skills are expected to be helpful to learn more effectively, it is of interest to investigate whether these skills are related to academic performance.

Methods: In a cross-sectional design, the Self-Regulation of Learning Self-Report Scale (SRL-SRS) was used to investigate the change in students’ self-regulated learning skills. First and third-year students (N?=?949, 81.7%) SRL-SRS scores were compared with ANOVA. The relation with academic performance was investigated with multinomial regression analysis.

Results: Only one of the six skills, reflection, significantly, but positively, changed during medical school. In addition, a small, but positive relation of monitoring, reflection, and effort with first-year GPA was found, while only effort was related to third-year GPA.

Conclusions: The change in self-regulated learning skills is minor as only the level of reflection differs between the first and third year. In addition, the relation between self-regulated learning skills and academic performance is limited. Medical schools are therefore encouraged to re-examine the curriculum and methods they use to enhance their students’ self-regulated learning skills. Future research is required to understand the limited impact on performance.     

Integrated curriculum and the change process in undergraduate medical education

Abstract

Introduction: This study is aimed at explaining the change process followed for the implementation of the new curriculum at Avalon University School of Medicine and its evaluation.

Background: Self-evaluation at Avalon University School of Medicine identified the need for a change in the curriculum. The main reasons for the change are isolated disciplines and overcrowded curriculum leading to less self-study time for students. The new curriculum is aimed to have an integrated curriculum and to avoid redundancies. The new curriculum is designed, implemented, and evaluation of the same is in place.

Evaluation methods and materials: After implementation, quantitative (results from exams) and semi-quantitative (self-administered questionnaire) evaluation methods are being used to evaluate the new curriculum. Feedback is also taken by having discussions with teachers and students to find out what they like and where modifications are needed. In this article, we are presenting the results of course evaluations (semi-quantitative methods) for two courses. The course evaluations were taken from the sample class size of 30 students.

Results and discussion: The course evaluations demonstrated an improvement. The main reason for the improvement is due to collaborative efforts of the faculty members from different disciplines in teaching, assessments, and providing feedback to the students.

Conclusions: The well-approached change process is required for the successful implementation of the new curriculum. The idea of ownership among all stakeholders is required for a well-managed change process.     

Long-term benefits by a mind–body medicine skills course on perceived stress and empathy among medical and nursing students

Background: A significant number of medical students suffer from burnout symptoms and reduced empathy. This controlled, quasi-experimental study aimed to investigate whether a mind–body medicine (MBM) skills course could reduce perceived stress and increase empathy and self-reflection in medical and nursing students.

Methods: The MBM course (consisting of experiential sessions of mind–body techniques and group reflections) was piloted among Dutch medical students and Swedish nursing students. Main outcome variables were perceived stress (PSS), empathy (IRI subscales perspective taking, fantasy, empathic concern, and personal distress), and self-reflection (GRAS). Participating and control students completed questionnaires at baseline, post-intervention, at 6 and 12 months follow-up.

Results: Seventy-four medical and 47 nursing students participated in the course. Participating medical students showed significantly increased empathic concern [1.42 (95% CI 0.05, 2.78), p?=?0.042], increased fantasy [3.24 (95% CI 1.58, 4.90), p?p?=?0.010] compared to controls until 12 months follow-up. Participating nursing students showed significantly decreased levels of perceived stress [?5.09 (95% CI ?8.37, ?1.82), p?=?0.002] and decreased personal distress [?5.01 (95% CI ?6.97, ?3.06), p?Conclusions: This study demonstrated long-term beneficial effects of the MBM course on perceived stress and empathy in medical and nursing students.     

Tensions in mentoring medical students toward self-directed and reflective learning in a longitudinal portfolio-based mentoring system – An activity theory analysis

Background: In medical education, students need to acquire skills to self-direct(ed) learning (SDL), to enable their development into self-directing and reflective professionals. This study addressed the mentor perspective on how processes in the mentor–student interaction influenced development of SDL.

Methods: n?=?22 mentors of a graduate-entry medical school with a problem-based curriculum and longitudinal mentoring system were interviewed (n?=?1 recording failed). Using activity theory (AT) as a theoretical framework, thematic analysis was applied to the interview data to identify important themes.

Results: Four themes emerged: centered around the role of the portfolio, guiding of students’ SDL in the context of assessment procedures, mentor-role boundaries and longitudinal development of skills by both the mentor and mentee. Application of AT showed that in the interactions between themes tensions or supportive factors could emerge for activities in the mentoring process.

Conclusion: The mentors’ perspective on coaching and development of reflection and SDL of medical students yielded important insights into factors that can hinder or support students’ SDL, during a longitudinal mentor–student interaction. Coaching skills of the mentor, the interaction with a portfolio and the context of a mentor community are important factors in a longitudinal mentor–student interaction that can translate to students’ SDL skills.     

Interprofessional learning through shadowing: Insights and lessons learned

Background: Interprofessional education (IPE) aims to improve patient outcomes. Interprofessional shadowing improves students’ knowledge of different roles and attitudes toward other professionals.

Aim: This study evaluates (1) how pre-clinical medical students describe the roles of the healthcare professionals they shadowed, and (2) whether shadowing can be used to introduce medical students to the benefits of interprofessional collaboration, and if so, in what ways.

Methods: Second-year medical students shadow another discipline and write a reflection on the shadowed discipline (SD)’s role and collaboration in patient care. A non-proportional stratified random sample of these reflections was coded during an iterative process. Any number of the 13 possible codes could be assigned to each reflection. Codes relevant to the research questions underwent narrative analysis.

Results: The most frequent codes were “specific function of SD” (88%), “SD’s general purpose” (86%), and “value of SD’s role” (68%). One-third of reflections referenced “communication,” and one-third mentioned “teamwork.” Insights gained included an appreciation for interprofessional care and a global perspective on patient care, extending beyond the inpatient encounter.

Conclusion: Through shadowing, students achieve several IPE core competencies and a broader perspective on patient care. Shadowing is an effective pedagogical method for IPE in the pre-clerkship curriculum.     

Educating universal professionals or global physicians? A multi-centre study of international medical programmes design

Abstract

Introduction: Medical schools increasingly offer curricula that specifically aim to prepare students for an international medical career. This is challenging as well as controversial: curriculum designers must balance specific local healthcare requirements with global health competencies doctors need in our globalised world. By investigating how international medical programme designers experience this balancing act, this study aims to contribute insights to the debate on local versus global medical education.

Methods: We conducted a multi-centre instrumental case study across three universities with international medical programmes in three countries. The study involved 26 semi-structured interviews with key curriculum designers recruited through purposive sampling. Additionally, we performed a curriculum document analysis. Data were thematically analysed within a multidisciplinary team.

Results: Participants described two profiles of international medical programme graduates: ‘a global physician’, equipped with specific competencies for international practice, and ‘a universal professional’, an overall high-level graduate fit for future practice anywhere. These perspectives presented different curriculum design challenges.

Conclusions: International medical programmes teach us how we can rethink graduate profiles in a globalising world. Yet, educational standardisation poses risks and securing equity in global health education is challenging, as is preparing students to be adaptable to the requirements of a rapidly changing future local healthcare context.     

Undergraduate medical students’ perspectives of skills,uses and preferences of information technology in medical education: A cross-sectional study in a Saudi Medical College

Abstract

Background: Information technology (IT) is widely used in medical education. However, there are not enough studies about IT uses and preferences among traditional and problem-based learning (PBL) medical students.

Aim: To compare IT skills, uses and preferences for education between traditional and PBL medical students’.

Method: A cross-sectional study; a modified Educause Center for Analysis and Research online survey was sent to traditional curriculum 5th and PBL 4th year medical students of King Saud University.

Results: Most of the responding 176 students prefer mobile devices and moderate amount of IT in education. Fourth and fifth year students perceived high academic value of Google (94.2 vs. 86.7%, p?=?0.34), YouTube (90.7 vs. 92.2%, p?=?0.83) and PubMed (83.7 vs. 86.7%, p?=?0.06). More 4th year than 5th year students rated themselves as skilled in learning management system (54.7 vs. 21.1%, p?=?0.0001) and Smartboard use (40.7 vs. 23.3%, p?=?0.04). Most students rated faculty IT skills as effective. Students agreed that technology helps working faster (95.5%) and make learning creative (85.9%).

Conclusions: More integration of information literacy and IT training in medical curricula is needed to enhance better utilization of full features of IT resources available for learning and problem solving. National multi-institutional studies are recommended.     

Longitudinal cohort study on medical student retention of anatomical knowledge in an integrated problem-based learning curriculum

Background: When modifying a curriculum to accommodate changes in the methods of subject matter presentation or fit within a shortened time frame, student retention of knowledge remains an important issue.

Aim: This study evaluates medical student retention of anatomical knowledge as they matriculate through an anatomy curriculum where the instruction hours are less than half of the current national average.

Method: Medical students completed an assessment tool developed to evaluate their baseline level of anatomical knowledge at the beginning of the first year. They then completed the instrument at the end of their 1st, 2nd, 3rd, and 4th years to assess their retention of anatomical knowledge during medical school. Data collection began in September 2010 and concluded in June 2015.

Results: Results demonstrate that students began medical school with a low level of anatomical knowledge (baseline), that knowledge increased during their first year (p?<?0.001), continued to increase during their second year (p?<?0.001), but was over 90% maintained through years 3 and 4.

Conclusion: In conclusion, an anatomy course with reduced hours (～60), using active learning methods, contextual learning, cadaver demonstrations, increased exposure to imaging, and longitudinal reinforcement can help students build a strong foundation of anatomical knowledge.     

Mind the gap: Teachers’ conceptions of student-staff partnership and its potential to enhance educational quality

Abstract

Introduction: Student-staff partnerships as a concept to improve medical education have received a growing amount of attention. Such partnerships are collaborations in which students and teachers seek to improve education by each adding their unique contribution to decision-making and implementation processes. Although previous research has demonstrated that students are favourable to this concept, teachers remain hesitant. The present study investigated teachers’ conceptions of student-staff partnerships and of the prerequisites that are necessary to render such partnerships successful and enhance educational quality.

Method: We conducted semi-structured interviews with 14 course coordinators who lead course design teams and also teach in 4 bachelor health programmes, using Bovill and Bulley’s levels of student participation as sensitising concepts during data analysis.

Results: The results pointed to three different conceptions of student-staff partnerships existing among teachers: Teachers teach and students study; teachers teach and value students’ feedback; and teachers and students co-create. The prerequisites for effective co-creation teachers identified were: Teachers must be open to involve students and create dialogues; students must be motivated and have good communication skills; the organisation must be supportive; and teachers should have the final say.

Conclusion: We conclude that teachers’ conceptions are consistent with Bovill and Bulley’s levels of student participation. Under certain conditions, teachers are willing to co-create and reach the highest levels of student participation.     

Describing medical student curiosity across a four year curriculum: An exploratory study

Background: Intellectual curiosity can be defined as a desire for knowledge that leads to exploratory behavior and consists of an inherent and stable trait (i.e. trait curiosity) and a variable context-dependent state (i.e. state curiosity). Although intellectual curiosity has been considered an important aspect of medical education and practice, its relationship to medical education has not been empirically investigated. The purpose of this exploratory study was to describe medical students’ intellectual curiosity across a four-year undergraduate program.

Methods: We employed a cross-sectional design in which medical students, across a four-year undergraduate program at McGill University, completed the Melbourne Curiosity Inventory as a measure of their state and trait intellectual curiosity. A Mixed Models ANOVA was used to compare students across year of training.

Results: Four hundred and two out of 751 students completed the inventory (53.5%). Trait curiosity was significantly higher than state curiosity (M?=?64.5, SD?=?8.5 versus M?=?58.5, SD?=?11.6) overall, and within each year of training.

Conclusions: This study is the first to describe state and trait intellectual curiosity in undergraduate medical education. Findings suggest that medical students’ state curiosity may not be optimally supported and highlight avenues for further research.     

Development of cognitive processing and judgments of knowledge in medical students: Analysis of progress test results

Background: Beside acquiring knowledge, medical students should also develop the ability to apply and reflect on it, requiring higher-order cognitive processing. Ideally, students should have reached higher-order cognitive processing when they enter the clinical program. Whether this is the case, is unknown. We investigated students’ cognitive processing, and awareness of their knowledge during medical school.

Methods: Data were gathered from 347 first-year preclinical and 196 first-year clinical students concerning the 2008 and 2011 Dutch progress tests. Questions were classified based upon Bloom’s taxonomy: “simple questions” requiring lower and “vignette questions” requiring higher-order cognitive processing. Subsequently, we compared students’ performance and awareness of their knowledge in 2008 to that in 2011 for each question type.

Results: Students’ performance on each type of question increased as students progressed. Preclinical and first-year clinical students performed better on simple questions than on vignette questions. Third-year clinical students performed better on vignette questions than on simple questions. The accuracy of students’ judgment of knowledge decreased over time.

Conclusions: The progress test is a useful tool to assess students’ cognitive processing and awareness of their knowledge. At the end of medical school, students achieved higher-order cognitive processing but their awareness of their knowledge had decreased.