Development and alignment of undergraduate medical curricula in a web-based,dynamic Learning Opportunities,Objectives and Outcome Platform (LOOOP)

Introduction: This study presents a web-based method and its interface ensuring alignment of all parts of a curriculum map including competencies, objectives, teaching and assessment methods, workload and patient availability. Needs, acceptance and effectiveness are shown through a nine-year study.

Methods: After a comprehensive needs assessment, the curriculum map and a web-based interface “Learning Opportunities, Objectives and Outcome Platform” (LOOOP) were developed according to Harden’s conceptual framework of 10-steps for curriculum mapping. The outcome was measured by surveys and results of interdisciplinary MCQ-assessments. The usage rates and functionalities were analysed.

Results: The implementation of LOOOP was significantly associated with improved perception of the curriculum structure by teachers and students, quality of defined objectives and their alignment with teaching and assessment, usage by students to prepare examinations and their scores in interdisciplinary MCQ-assessment. Additionally, LOOOP improved the curriculum coordination by faculty, and assisted departments for identifying patient availability for clinical training.

Conclusion: LOOOP is well accepted among students and teachers, has positive effect on curriculum development, facilitates effective utilisation of educational resources and improves student’s outcomes. Currently, LOOOP is used in five undergraduate medical curricula including 85,000 mapped learning opportunities (lectures, seminars), 5000 registered users (students, teachers) and 380,000 yearly page-visits.     

Scholar outcomes for dental internship research program in Saudi Arabia: A qualitative evaluation

Abstract

Objective: To explore the potential, challenges and needs for internship research activities in achieving scholar outcomes among graduates.

Methods: A qualitative general needs assessment and evaluation of an internship research program was conducted at King Abdulaziz University, Faculty of Dentistry (KAUFD), KSA, from December 2014 to February 2015 using focus groups and interviews. The participants included: administrates, faculty, and internship students. Data were transcribed and analyzed following the grounded theory.

Results: The participants were two administrative personnel, 21 faculty members, and 16 internship students. Results were clustered around five main domains; curriculum design, faculty, students, administrative, and institutional domain. Reported potentials included: a multi-faceted educational intervention approach, and building evidence-based skills and inquiry minds among graduates. Time, load, and incentives were major challenges reported by faculty. Interesting and achievable research topics were major challenges reported by students. Areas that needed development included: equipped research personnel, aligned administrative and institutional support, faculty skills, students’ knowledge and skills, aligned curriculum, and clear program goals, objectives, and outcomes.

Conclusion: Curriculum design, faculty and students’ skills; as well as administrative and institutional support were found to play major roles in the success of the current internship research program at KAUFD.     

Crowdsourcing for assessment items to support adaptive learning

Abstract

Purpose: Adaptive learning requires frequent and valid assessments for learners to track progress against their goals. This study determined if multiple-choice questions (MCQs) “crowdsourced” from medical learners could meet the standards of many large-scale testing programs.

Methods: Users of a medical education app (Osmosis.org, Baltimore, MD) volunteered to submit case-based MCQs. Eleven volunteers were selected to submit MCQs targeted to second year medical students. Two hundred MCQs were subjected to duplicate review by a panel of internal medicine faculty who rated each item for relevance, content accuracy, and quality of response option explanations. A sample of 121 items was pretested on clinical subject exams completed by a national sample of U.S. medical students.

Results: Seventy-eight percent of the 200 MCQs met faculty reviewer standards based on relevance, accuracy, and quality of explanations. Of the 121 pretested MCQs, 50% met acceptable statistical criteria. The most common reasons for exclusion were that the item was too easy or had a low discrimination index.

Conclusions: Crowdsourcing can efficiently yield high-quality assessment items that meet rigorous judgmental and statistical criteria. Similar models may be adopted by students and educators to augment item pools that support adaptive learning.     

Eight-year outcomes of a competency-based residency training program in orthopedic surgery

Abstract

Background: The Division of Orthopaedic Surgery at the University of Toronto implemented a pilot residency training program that used a competency-based framework in July of 2009. The competency-based curriculum (CBC) deployed an innovative, modularized approach that dramatically intensified both the structured learning elements and the assessment processes.

Methods: This paper discusses the initial curriculum design of the CBC pilot program; the refinement of the curriculum using curriculum mapping that allowed for efficiencies in educational delivery; details of evaluating resident competence; feedback from external reviews by accrediting bodies; and trainee and program outcomes for the first eight years of the program’s implementation.

Results: Feedback from the residents, the faculty, and the postgraduate residency training accreditation bodies on the CBC has been positive and suggests that the essential framework of the program may provide a valuable tool to other programs that are contemplating embarking on transition to competency-based education.

Conclusions: While the goal of the program was not to shorten training per se, efficiencies gained through a modular, competency-based program have resulted in shortened time to completion of residency training for some learners.     

Awareness and usage of evidence-based learning strategies among health professions students and faculty

Abstract

Introduction: Learning is essential and life-long for faculty and students. Often students and teachers use ineffective learning strategies and are not aware of evidence-based strategies.

Methods: A multicenter, international, cross-sectional, online survey-based assessment of awareness of evidence-based learning strategies among health professions students (n?=?679) and faculty (n?=?205).

Results: Students endorsed many study habits which violate evidence-based principles, including studying whatever is due soonest (389/679, 57%), failing to return to course material once a course has ended (465/679, 68%), and re-reading underlined or highlighted notes (298.679, 44%). While the majority of faculty surveyed (125/157, 80%) reported recommending effective study strategies for their students, most students (558/679, 82%) said they did not study the way they do because of instruction from faculty. The majority of faculty (142/156, 91%) and students (347/661, 53%) believe students have different learning styles.

Discussion: The results of this study demonstrate health professions students continue to use many ineffective study strategies, and both students and faculty hold misconceptions about evidence-based learning. While planning a curriculum, medical educators should focus on teaching students how to learn and use higher order thinking procedures in addition to teaching content.     

School of Medicine of Federal University of Rio Grande Do Norte: A traditional curriculum with innovative trends in medical education

Abstract

Introduction: The Medical School of the Federal University of Rio Grande do Norte (UFRN) is one of the biggest public medical schools in Northeast Brazil. In the last decade, significant investment in faculty development, innovative learning methodologies and student engagement has been key milestones in educational improvement at this medical school, harnessed to recent political changes that strengthened community-based and emergency education. This study describes how curriculum changes in UFRN Medical School have been responsible for major improvements in medical education locally and which impacts such transformations may have on the educational community.

Methods: A group of students and teachers revised the new curriculum and established the key changes over the past years that have been responsible for the local enhancement of medical education. This information was compared and contrasted to further educational evidences in order to define patterns that can be reproduced in other institutions.

Results: Improvements in faculty development have been fairly observed in the institution, exemplified by the participation of a growing number of faculty members in programs for professional development and also by the creation of a local masters degree in health education. Alongside, strong student engagement in curriculum matters enhanced the teaching-learning process.

Conclusions: Due to a deeper involvement of students and teachers in medical education, it has been possible to implement innovative teaching-learning and assessment strategies over the last ten years and place UFRN Medical School at a privileged position in relation to undergraduate training, educational research and professional development of faculty staff.     

Small group activities within academic communities improve the connectedness of students and faculty

Background: The University of California, San Diego, School of Medicine implemented a curriculum change that included reduction of lectures, incorporation of problem-based learning and other small group activities. Six academic communities were introduced for teaching longitudinal curricular content and organizing extracurricular activities.

Methods: Surveys were collected from 904 first- and second-year medical students over 6 years. Student satisfaction data with their sense of connectedness and community support were collected before and after the implementation of the new curriculum. In a follow-up survey, medical students rated factors that contributed to their sense of connectedness with faculty and students (n?=?134).

Results: Students’ perception of connectedness to faculty significantly increased following implementation of a curriculum change that included academic communities. Students ranked small group clinical skills activities within academic communities significantly higher than other activities concerning their sense of connectedness with faculty. Students’ perception of connectedness among each other was high at baseline and did not significantly change. Small group activities scored higher than extracurricular activities regarding students’ connectedness among themselves.

Conclusions: The implementation of a new curriculum with more small group educational activities including academic communities enhanced connectedness between students and faculty and resulted in an increased sense of community.     

Medical students' perception of test anxiety triggered by different assessment modalities

Abstract

Objectives: Test anxiety is well known among medical students. However, little is known about test anxiety produced by different components of exam individually. This study aimed to stratify varying levels of test anxiety provoked by each exam modality and to explore the students perceptions about confounding factors.

Methods: A self-administered questionnaire was administered to medical students. The instrument contained four main themes; lifestyle, psychological and specific factors of information needs, learning styles, and perceived difficulty level of each assessment tool.

Results: A highest test anxiety score of 5 was ranked for “not scheduling available time” and “insufficient exercise” by 28.8 and 28.3% students, respectively. For “irrational thoughts about exam” and “fear to fail”, a highest test anxiety score of 5 was scored by 28.8 and 25.7% students, respectively. The highest total anxiety score of 1255 was recorded for long case exam, followed by 975 for examiner-based objective structured clinical examination. Excessive course load and course not well covered by faculty were thought to be the main confounding factors.

Conclusions: The examiner-based assessment modalities induced high test anxiety. Faculty is urged to cover core contents within stipulated time and to rigorously reform and update existing curricula to prepare relevant course material.     

The hidden and informal curriculum across the continuum of training: A cross-sectional qualitative study*

Purpose: The hidden and informal curricula refer to learning in response to unarticulated processes and constraints, falling outside the formal medical curriculum. The hidden curriculum has been identified as requiring attention across all levels of learning. We sought to assess the knowledge and perceptions of the hidden and informal curricula across the continuum of learning at a single institution.

Methods: Focus groups were held with undergraduate and postgraduate learners and faculty to explore knowledge and perceptions relating to the hidden and informal curricula. Thematic analysis was conducted both inductively by research team members and deductively using questions structured by the existing literature.

Results: Participants highlighted several themes related to the presence of the hidden and informal curricula in medical training and practice, including: the privileging of some specialties over others; the reinforcement of hierarchies within medicine; and a culture of tolerance towards unprofessional behaviors. Participants acknowledged the importance of role modeling in the development of professional identities and discussed the deterioration in idealism that occurs.

Conclusions: Common issues pertaining to the hidden curriculum exist across all levels of learners, including faculty. Increased awareness of these issues could allow for the further development of methods to address learning within the hidden curriculum.     

Student participation in the development of interprofessional education courses: Perceptions and experiences of faculty members and the students

Abstract

Introduction: Student participation has shown positive effects on the curriculum development process for a single health profession. This qualitative study explores faculty members’ and students’ perceptions and experiences regarding student participation in interprofessional course development.

Methods: Interprofessional courses were developed and implemented by interprofessional teams of faculty members and students. Two focus group discussions were carried out: one with faculty members and one with students.

Results: Students contributed to both the process and the results of interprofessional course development in a complementary manner. Student participation was facilitated via motivation for and through work on interprofessional education, a balance between clarity on tasks and students’ autonomy, and a low-hierarchy team atmosphere. Students developed professionally, and faculty members saw them as future ambassadors for interprofessional collaboration.

Conclusions: This study provides multiple qualitative evidence for a positive, complementary role of student participation in interprofessional course development. A number of factors were identified that should be nurtured to facilitate this effect. Our findings may stimulate and guide other schools to actively involve students in the development of interprofessional education.     

Integrated curriculum and the change process in undergraduate medical education

Abstract

Introduction: This study is aimed at explaining the change process followed for the implementation of the new curriculum at Avalon University School of Medicine and its evaluation.

Background: Self-evaluation at Avalon University School of Medicine identified the need for a change in the curriculum. The main reasons for the change are isolated disciplines and overcrowded curriculum leading to less self-study time for students. The new curriculum is aimed to have an integrated curriculum and to avoid redundancies. The new curriculum is designed, implemented, and evaluation of the same is in place.

Evaluation methods and materials: After implementation, quantitative (results from exams) and semi-quantitative (self-administered questionnaire) evaluation methods are being used to evaluate the new curriculum. Feedback is also taken by having discussions with teachers and students to find out what they like and where modifications are needed. In this article, we are presenting the results of course evaluations (semi-quantitative methods) for two courses. The course evaluations were taken from the sample class size of 30 students.

Results and discussion: The course evaluations demonstrated an improvement. The main reason for the improvement is due to collaborative efforts of the faculty members from different disciplines in teaching, assessments, and providing feedback to the students.

Conclusions: The well-approached change process is required for the successful implementation of the new curriculum. The idea of ownership among all stakeholders is required for a well-managed change process.     

Development,implementation, and evaluation of an integrated multidisciplinary Objective Structured Clinical Examination (OSCE) in primary health care settings within limited resources

Background: In ordinary circumstances, objective structured clinical examination (OSCE) is a resource-intensive assessment method. In case of developing and implementing multidisciplinary OSCE, there is no doubt that the cost will be greater.

Aim: Through this study a research project was conducted to develop, implement and evaluate a multidisciplinary OSCE model within limited resources.

Methods: This research project went through the steps of blueprinting, station writing, resources reallocation, implementation and finally evaluation.

Results: The developed model was implemented in the Primary Health Care (PHC) program which is one of the pillars of the Community-Based undergraduate curriculum of the Faculty of Medicine, Suez Canal University (FOM-SCU). Data for evaluation of the implemented OSCE model were derived from two resources. First, feedback of the students and assessors through self-administered questionnaires was obtained. Second, evaluation of the OSCE psychometrics was done. The deliverables of this research project included a set of validated integrated multi-disciplinary and low cost OSCE stations with an estimated reliability index of 0.6.

Conclusion: After having this experience, we have a critical mass of faculty members trained on blueprinting and station writing and a group of trained assessors, facilitators and role players. Also there is a state of awareness among students on how to proceed in this type of OSCE which renders future implementation more feasible.     

The journeys of three ASPIRE winning medical schools toward excellence in student assessment

Abstract

Introduction: ASPIRE Excellence Awards in Student Assessment are offered to medical schools with innovative and comprehensive assessment programmes adjudged by international experts, using evidence-based criteria.

The journeys of three ASPIRE-winning medical schools toward “assessment excellence” are presented. These schools include Aga Khan University Medical College (AKU-MC), Pakistan, Southern Illinois University School of Medicine (SIUSOM), USA, and University of Leeds School of Medicine, UK.

Methods: The unfolding journeys highlighting achievements, innovations, and essential components of each assessment programme were compared to identify differences and commonalities.

Results: Cultural contextual differences included developed-versus-developing country, east-west, type of regulatory bodies, and institutional-versus-national certifying/licensing examinations, which influence curricula and assessments.

In all, 12 essential commonalities were found: alignment with institutional vision; sustained assessment leadership; stakeholder engagement; communication between curriculum and assessment; assessment-for-learning and feedback; longitudinal student profiling of outcome achievement; assessment rigor and robustness; 360° feedback from-and-to assessment; continuous enrichment through rigorous quality assurance; societal sensitivity; influencing others; and a “wow factor.”

Conclusions: Although the journeys of the three medical schools were undertaken in different cultural contexts, similar core components highlight strong foundations in student assessment. The journeys continue as assessment programmes remain dynamic and measurement science expands. This article may be helpful to other institutions pursuing excellence in assessment.     

The education avenue of the clinical learning environment: A pragmatic approach

Abstract

Aim: This perspective is part of a series of articles that are outcomes of a consensus conference, that seek to offer a comprehensive examination of the clinical learning environment (CLE), using different academic disciplines and areas of focus termed “avenues.” The education dimensions of the CLE are discussed in detail in this perspective, along with critical linkages to the other avenues.

Methods: Using iterative presentations, discussion and small group work, in October 2018, the consensus conference participants explored the education, psychological, sociocultural, diversity and inclusion, digital and architectural aspects of the CLE.

Results: The education avenue of the CLE includes elements of teaching and learning such as the curriculum, clinical experiences, the assessment system, educational program governance, trainee selection, faculty development, and program evaluation and improvement. Within the educational domain, we focus on organizational and personal/social aspects of the CLE, including (1) curriculum design and deployment, including placement of trainees in clinical settings, organizational culture, practices and policies, and accreditation and regulatory requirements from the organizational domain (2) the education system, including assessment, program evaluation and organization and governance; and (3) elements from the personal and social domains, including peer-to-peer, trainee-faculty, and trainee-patient relationships that influence how and what postgraduate trainees learn, trainee selection, informal and hidden curricula, and trainees’ perceptions of their learning environment.

Conclusions: We provide suggestions for further research and recommendations for addressing challenges and facilitating improvement in the educational aspects of the CLE, along with actionable practice points.     

Reforms in VUmc School of Medical Sciences Amsterdam: Student engagement,a Minor elective semester and stakeholder collaboration in improving the quality of assessments

Abstract

Background: At VUmc School of Medical Sciences, major curricular reforms occurred in 2005 and 2015, related to the introduction of a Bachelor-Master structure, a new legislation from the Ministry of Education, the changing societal context, and taking note of students’ and teachers’ needs.

Summary of work: Along with the introduction of the Bachelor-Master system, the period between 2005 and 2009 saw the movement from traditional lecture-based teaching to small group teaching in a competency-based curriculum, in which the students were responsible for their learning. Student engagement grew through students’ designing learning modules and conducting some of the teaching. In the Bachelor program, an elective “Minor”, was designed to broaden and deepen the knowledge of our students beyond the core learning outcomes, in a discipline of their choice. The examination board (EB), responsible for maintaining the quality of assessment, was split into the General EB, which handled overall strategy issues, and the Executive EB, which handled student requests and monitored the quality of assessments.

Lessons learned: Students develop a sense of what education is about if they are provided opportunities in designing teaching and conducting it. A Minor elective in the medical study can provide the students with an opportunity to learn outside the medical field. Collaborative working between different stakeholders in a medical school is crucial for safeguarding the quality of assessments. Curricular reforms need time to be accepted and integrated into the culture of the medical school. The educational vision needs to be refreshed regularly in alignment with the changing societal context.     

A decade of reform in medical education: Experiences and challenges at Tehran University of Medical Sciences

Abstract

Purpose: In this paper, we present the major curricular reform in MD program of Tehran University of Medical Sciences, the oldest and the largest medical university in Iran, initiated about a decade ago.

Materials and methods: Following a comprehensive program evaluation, many of the basic challenges of the traditional curriculum were revealed, namely, lack of pre-defined competencies for graduates, over-reliance on teacher-centered teaching methods, over-emphasis on knowledge base in student assessments, and focusing solely on biomedical aspects of patient care. In 2010, a vision statement for reform was created and approved by the University Council. The new curriculum was launched in 2011.

Results: The changes included: revising the content of the courses, assimilating horizontal and vertical integration, emphasizing clinical skills, encouraging active involvement in patient management, providing more opportunity for supervised practice, integrating behavioral and psychosocial topics into the curriculum, incorporating interactive teaching methods, assessing students’ higher levels of cognition, and strengthening workplace assessments. To evaluate the changes, data were continuously collected and analyzed from the beginning.

Conclusions: Changing the curriculum of an MD program is a laborious task which should be planned and undertaken carefully and cautiously. It is an endless, yet invaluable and satisfying endeavor toward better future.     

Beyond communication training: The MaRIS model for developing medical students’ human capabilities and personal resilience

Abstract

Purpose: Human capabilities in medicine, including communication skills, are increasingly important within the complex, challenging and dynamic landscape of healthcare. Supporting medical students to manage unavoidable role-related stressors adaptively may help mitigate the anguish that is too commonly reported among the profession. We developed a model, “MaRIS”, underpinned by contemplative pedagogy, to support medical students to enhance their human capabilities, across all three domains of Bloom's taxonomy, and their personal resilience. It is the first to integrate Mindfulness, affective Reflection, Impactive experiences and a Supportive environment into medical curriculum design. Here, we describe the theoretical basis underpinning MaRIS and present a preliminary study to evaluate its impact on students' subjectively-rated capabilities.

Materials and Methods: A questionnaire capturing self-ratings of competence, empathy and resilience, as well as impressions of their experiences, was administered to foundation year medical students before (T0), during (T1) and after delivery (T2).

Results: Fifty-five students completed the survey at all time points. Mean scores for all domains increased significantly from T0 to T1 and from T0 to T2. Free-text comments suggest learning impact across the cognitive, psychomotor and affective domains.

Conclusions: MaRIS appears to facilitate medical students' establishment of the foundations for building the human capabilities and personal resilience required for professional practice.     

Training medical students for the twenty-first century: Rationale and development of the Utrecht curriculum “CRU+”

Abstract

Aim: The aim of this report, written for the 40th anniversary issue of Medical Teacher, is to document 20 years of development of the Utrecht undergraduate medical curriculum, as both to exhibit accountability and to inform the community of the process and choices that can be made in long-term curriculum development.

Methods: We used the SPICES model, created by Medical Teacher’s Editor Ronald Harden and colleagues in 1984.

Results: The Utrecht six-year program, now called “CRU+”, has many distinct features that were introduced, most of which are well documented. A limited selection includes

• ???A new 3+3 years Bachelor-Master structure following the EU Bologna rules leading to MD registration for cohorts of about 300.

• ???Horizontally integrated classroom teaching of basic sciences with clinical disciplines predominantly in groups of 12 and limited lectures.

• ???Mandatory knowledge retention tests, retesting the clinically relevant core knowledge from block tests of semesters one through four.

• ???Vertical integration not only linking clinical experience with background knowledge, but also exemplified by a stepwise increase in health care responsibilities throughout the curriculum.

• ???A final year focussing on growth towards the level of a primary responsible physician in a 12-week sub-internship for a limited number of patients and beds, in a chosen specialty. The student is called a semi-physician in the clerkship of this transitional year to residency.

• ???Teaching skills training for all medical graduates, an elective teaching rotation and various peer-teaching arrangements throughout the curriculum.

• ???Integrated semi-longitudinal clerkships with an assessment focus on entrustment decisions for Entrustable Professional Activities.

Conclusion: UMC Utrecht has made a continuous attempt to both develop its medical curriculum and to study and report on its development in the literature, regarding new methods found and insights derived. UMC Utrecht will remain committed to developing training to meet twenty-first century demands of medical graduates.     

Twelve tips for teaching brief motivational interviewing to medical students

Background: Shifting from paternalistic to patient-centred doctor-patient relationships has seen a growing number of medical programs incorporate brief motivational interviewing training in their curriculum. Some medical educators, however, are unsure of precisely what, when, and how to incorporate such training.

Aims: This article provides educators with 12 tips for teaching brief motivational interviewing to medical students, premised on evidence-based pedagogy.

Methods: Tips were drawn from the literature and authors’ own experiences.

Results: The 12 tips are: (1) Set clear learning objectives, (2) Select experienced educators, (3) Provide theoretical perspectives, (4) Share the evidence base, (5) Outline the “spirit”, principles, and sequence, (6) Show students what it looks like, (7) Give students a scaffold to follow, (8) Provide opportunities for skill practice, (9) Involve clinical students in teaching, (10) Use varied formative and summative assessments, (11) Integrate and maintain, and (12) Reflect and evaluate.

Conclusions: We describe what to include and why, and outline when and how to teach the essential components of brief motivational interviewing knowledge and skills in a medical curriculum.