Students perceive skills learned in pre-clerkship PBL valuable in core clinical rotations

Abstract

Purpose: Problem-based learning (PBL) is an instructional method widely used by medical educators that promotes an environment in which students effectively learn the foundational knowledge and skills that are prerequisites for graduation. This study evaluated medical students’ perceptions of the helpfulness of skills acquired in PBL to core clerkship rotations.

Methods: A 25-item survey was designed to assess students’ perceptions of skills learned in PBL that were helpful on core clerkships and transferable to the clinical setting. A random sample of students with at least 8?months of clerkship experience were invited to complete the survey.

Results: Of 68 students, 35 (52%) returned questionnaires. Results suggest a clustering of themes based on their perceived value. Skills learned in PBL that students rated most highly as helpful or very helpful during core clinical rotations include: comfort discussing concepts, identifying key information, presentation skills, interpersonal skills, diagnostic thinking, finding information, self-awareness, and organizing information. Other items rated highly included: forming questions, time management, primary literature (engaging with published original research articles), and leadership. The skills acquired in PBL were associated with multiple competency domains.

Conclusions: Although conditions of the pre-clerkship curriculum are substantially different from the learning environment of clerkship rotations, skills learned in PBL are perceived as applicable to authentic clinical training.     

Threshold concepts: A portal into new ways of thinking and practising in psychiatry

Abstract

Introduction: The theory of threshold concepts conjectures that there are areas in every educational curriculum that are challenging; however, mastering these areas transform the learner’s view of the subject. In psychiatry, research into threshold concepts can inform educators so that they can better support students with mastering these challenging areas.

Purpose: To identify threshold concepts, we conducted semi-structured interviews with six psychiatry educators and free-text surveys with medical students. To identify avenues for improving the curriculum, we discussed with educators, ways of improving understanding and looked at different approaches to learning.

Materials and methods: From our analysis of all responses, we derived three threshold concepts: Therapeutic Risk-Taking, the Biopsychosocial Model, and the Concept of Diagnosis in psychiatry. The majority of students experienced difficulties grasping these concepts and applying them in their patient interactions.

Results and conclusions: Hence, we propose focused teaching activities that can help students cross these thresholds: student Balint groups exploring therapeutic risk, student Balint groups exploring the role of a psychiatrist, exposure to psychological therapies/psychotherapy skills and explicit diagnostic reasoning. These activities can be integrated into the undergraduate curriculum to help medical students develop a better understanding and appreciation of psychiatry.     

Effects of Team-Based Learning on short-term and long-term retention of factual knowledge

Purpose: We investigated the effect of Team-Based Learning (TBL) on long-term retention of knowledge in comparison to a traditional curriculum.

Methods: As TBL was incorporated into our curriculum in the 2008–2009 academic year, students were compared with those who received the traditional curriculum the year prior. Students in both the groups completed multiple-choice knowledge test at four time points spanning two years. Test performance was compared at each time point to assess changes in knowledge retention as a function of time.

Results: Baseline knowledge did not differ significantly between the TBL and control groups [51% versus 46%; t(84)?=?0.91, p?=?0.37, d?=?0.20]. Performance improved after the course for both the groups, but was significantly higher in the TBL group [79% versus 59%; t(84)?=?4.96, p?=?0.000004, d?=?0.95]. However, when assessed prior to the pediatrics clerkship, learning gains from TBL had largely disappeared and the small difference in performance was not significant [57% versus 51%; t(84)?=?1.51, p?=?0.14, d?=?0.32].

Conclusion: Incorporating TBL into the pre-clinical pediatrics curriculum led to large gains in knowledge over the short-term, but these gains did not persist. Further research should focus on extending the impact of TBL on long-term knowledge retention.     

A cross-sectional study of learning styles among continuing medical education participants

Purpose: Experiential learning has been suggested as a framework for planning continuing medical education (CME). We aimed to (1) determine participants’ learning styles at traditional CME courses and (2) explore associations between learning styles and participant characteristics.

Materials and methods: Cross-sectional study of all participants (n?=?393) at two Mayo Clinic CME courses who completed the Kolb Learning Style Inventory and provided demographic data.

Results: A total of 393 participants returned 241 surveys (response rate, 61.3%). Among the 143 participants (36.4%) who supplied complete demographic and Kolb data, Kolb learning styles included diverging (45; 31.5%), assimilating (56; 39.2%), converging (8; 5.6%), and accommodating (34; 23.8%). Associations existed between learning style and gender (p?=?0.02). For most men, learning styles were diverging (23 of 63; 36.5%) and assimilating (30 of 63; 47.6%); for most women, diverging (22 of 80; 27.5%), assimilating (26 of 80; 32.5%), and accommodating (26 of 80; 32.5%).

Conclusions: Internal medicine and psychiatry CME participants had diverse learning styles. Female participants had more variation in their learning styles than men. Teaching techniques must vary to appeal to all learners. The experiential learning theory sequentially moves a learner from Why? to What? to How? to If? to accommodate learning styles.     

Awareness and usage of evidence-based learning strategies among health professions students and faculty

Abstract

Introduction: Learning is essential and life-long for faculty and students. Often students and teachers use ineffective learning strategies and are not aware of evidence-based strategies.

Methods: A multicenter, international, cross-sectional, online survey-based assessment of awareness of evidence-based learning strategies among health professions students (n?=?679) and faculty (n?=?205).

Results: Students endorsed many study habits which violate evidence-based principles, including studying whatever is due soonest (389/679, 57%), failing to return to course material once a course has ended (465/679, 68%), and re-reading underlined or highlighted notes (298.679, 44%). While the majority of faculty surveyed (125/157, 80%) reported recommending effective study strategies for their students, most students (558/679, 82%) said they did not study the way they do because of instruction from faculty. The majority of faculty (142/156, 91%) and students (347/661, 53%) believe students have different learning styles.

Discussion: The results of this study demonstrate health professions students continue to use many ineffective study strategies, and both students and faculty hold misconceptions about evidence-based learning. While planning a curriculum, medical educators should focus on teaching students how to learn and use higher order thinking procedures in addition to teaching content.     

Comparison of students’ encountered diseases and available diseases at clerkship sites by exploratory multivariate analysis: Are encountered diseases predictable?

Background: Students in clerkship are expected to gain clinical expertise by interacting with real patients in clinical situations. Monitoring and predicting the students' encounter diseases (EDs) is important for providing an optimal experience. EDs should be compared with the available diseases (ADs) at the clerkship site and with the required diseases described in some guidelines for the clinical curriculum.

Aims: To explore the differences in ADs as learning resources among different types of clerkship sites and to investigate discrepancies between EDs and ADs.

Method: A retrospective observational study used secondary data from government statistics to compare ADs of various types of observable clerkship sites by biplot analyses, which allowed multivariate comparisons. EDs collected from logbooks during clerkships at a university hospital were also compared with ADs across sites.

Results: The distributions of ADs differed according to institutional type, and EDs at Kyushu University Hospital were similar to the ADs for the category of hospitals in which it was placed.

Conclusion: EDs at a clerkship site may be predictable to some extent by analysing the site’s distribution of ADs, but further study is needed. Biplot is useful for visualising these types of statistical similarity.     

A unique flipped classroom approach shows promising results in physician assistant education

Abstract

Aims: The flipped classroom (FC) model utilizes pre-class foundational learning with in-class higher-order application exercises. FC approaches have reported positive perceptions and mixed academic performance outcomes in medical education; however, little evidence exists on their impact in the 56-week didactic curriculum of Physician Assistant (PA) education.

Methods: A 4-week FC curriculum was piloted in a PA behavioral medicine course (n?=?34). Before class, students completed online video modules. During class, students completed a pre-class quiz and answered clinical case-based questions in a think-pair-share format.

Results: Students rated in-class time higher than a lecture-based segment of the same course (p?=?0.028). Assessment of achievement emotions demonstrated increased enjoyment (p?=?0.028) and decreased boredom (p?<?0.001) in the FC curriculum with no difference in anxiety. The FC curriculum produced a 57.2?min increase in pre-class preparation time with no change in post-class studying time. Compared to historical lecture-based controls (n?=?35), students in the FC curriculum scored significantly higher on clinical vignette questions (p?=?0.019) with equivalent performance on other question formats.

Conclusions: This study offers the first positive outcomes of an FC approach in PA education and provides a framework for improving academic performance while scaling back in-class time.     

Incorporation and evaluation of serial concept maps for vertical integration and clinical reasoning in case-based learning tutorials: Perspectives of students beginning clinical medicine

Abstract

Background: Concept maps and case-based learning (CBL) are recognized and useful strategies to enhance undergraduate medical learning. However, research on the use of a mixed approach is limited.

Aims: To incorporate serial concept mapping (CM) into CBL tutorials, to explore students’ perspectives on the worth of the method to better understand patients’ problems and elicit diagnoses, and to assess the student’s learning.

Methods: We designed a four-phase method of CBL that incorporated serial mapping to assist students in the process of knowledge construction regarding the underlying principles of the patients’ present complaints, the recognition of disease patterns and the eliciting of diagnostic hypotheses. Students worked both individually and collaboratively. We used a questionnaire to explore the students’ perspectives of the method and a score system to assess end-of-course performance.

Results: The students perceived that serial CM was useful to integrate previous knowledge into new clinical information for case analysis and to elicit diagnoses. They also reported an increase in content-related knowledge. The end-of-course scores were high for most students.

Conclusions: Novice medical students perceived serial CM in CBL tutorials as an effective strategy for learning. End-of-course examination scores indicated that they improved case analysis and clinical reasoning skills.     

How we tackled the problem of assessing humanities,social and behavioural sciences in medical education

Background: Assessment serves as an important motivation for learning. However, multiple choice and short answer question formats are often considered unsatisfactory for assessment of medical humanities, and the social and behavioural sciences. Little consensus exists as to what might constitute ‘best’ assessment practice.

What we did: We designed an assessment format closely aligned to the curricular approach of problem-based learning which allows for greater assessment of students’ understanding, depth of knowledge and interpretation, rather than recall of rote learning.

Conclusion: The educational impact of scenario-based assessment has been profound. Students reported changing their approach to PBL, independent learning and exam preparation by taking a less reductionist, more interpretative approach to the topics studied.     

Political Therapeutics: Dialogues and Frictions Around Care and Cure

ABSTRACT

In 1978, Italy passed a law establishing the abolition of the mental hospital. Up to that time, the traditional asylums were still governed by the 1904 law that positioned psychiatry within the criminal justice system by assigning it the function of custodia (control, custody) rather than of cura (care). In the 1960s and 1970s, Italian psychiatrist Franco Basaglia initiated a movement of de-institutionalization of the mentally ill that revolutionized psychiatric care in Italy. It also had a deep impact on restructuring the psychiatric system in other European and Latin American countries. In this article, I discuss the different psychiatric practices and imaginaries that resulted from the movement of democratic psychiatry and Basaglia’s visions for a community-based and diagnosis-free care of the mentally ill. I ethnographically trace what I call the “Basaglia effect” in today’s psychiatric practices, and focus on ethnopsychiatry as a counter clinic that emerged from Basaglia’s legacy. I reflect on the frictions between care and cure that ethnopsychiatry re-articulates and works with in the context of contemporary migrations to Europe.     

How do formative objective structured clinical examinations drive learning? Analysis of residents’ perceptions

Introduction: Although several studies have explored the relationship between learning and written tests, little is understood about how performance-based examinations influence learning. The purpose of this study was to explore how a formative objective structured clinical examination (OSCE) drives learning.

Methods: We administered surveys to residents (n?=?35) at three time points to determine if and how an OSCE influenced their learning: before and immediately following the OSCE, and after the distribution of their results. Differences in quantitative responses between high- and low-performing residents and across time were compared using repeated-measures ANOVA. Thematic analysis was used to analyze narrative comments.

Results: Participants’ goals for the OSCE related to performance, mastery and feedback. Almost all participants reported that they had learned something from the OSCE (94%) and most participants generated learning goals after the OSCE (71%). High performers appeared to recognize the importance of content-related knowledge for scoring well before and after the OSCE, whereas low performers may have under-estimated its importance until after the examination.

Discussion: Participants viewed a formative OSCE as both a hurdle to overcome (assessment of learning) and an opportunity to learn (assessment for learning). Understanding how OSCEs influence study behavior can help guide the development of assessments that promote learning.     

Using language of entrustable professional activities to define learning objectives of radiology clerkship: A modified Delphi study

Abstract

Background: A standard undergraduate radiology education is essential to prepare graduates for multidisciplinary clinical practice yet the literature lacks clear guidelines or consensus about the learning objectives of an optimal radiology clerkship.

Aim: To define a competency-based framework for undergraduate radiology education by using language of Entrustable Professional Activities (EPAs).

Methods: A modified Delphi method with three iterative rounds was used as an expert consensus approach. An online questionnaire with Likert scale was formulated incorporating EPAs and their components (competencies, assessment strategies, and supervision level) and distributed to 45 consultant radiologists following pilot study. Items reaching consensus were accepted and rest were resent in round 2. In round 3, a dichotomous scale was used for final approval and to see response stability.

Results: A final set of six EPAs with 87 competencies and respective assessment strategies, all aiming for ‘level 3a’ of supervision was identified. These include recommending cost effective appropriate imaging tests for common pathologies, obtaining informed consent for diagnostic contrast studies, basic interpretation and communication of common pathologies/emergencies on radiographs (chest, abdominal, and skeletal) and on CT brain.

Conclusion: This EPA framework for radiology clerkship is a first step towards a competency-based approach to undergraduate radiology training and assessment.     

Undergraduate medical students’ perceptions of their learning experience in pediatric rotation at King Abdulaziz University Medical College in Jeddah,Saudi Arabia

Abstract

Aim: This study aimed to evaluate fifth-year medical students' perception of their learning experience during pediatric rotation at the medical college of King Abdulaziz University (KAU), Jeddah, Saudi Arabia.

Method: This cross-sectional study was conducted by distributing a questionnaire to fifth-year students who attended the pediatric rotation at KAU, during 2013–2014.

Results: Three hundred fifty-six out of 360 students agreed to participate, representing a response rate of 99%. More than 90% were satisfied with the module, and 80% reported the usefulness of the orientation session. The mean scores for the usefulness of morning experience and afternoon activities were 7.20?±?2.40 and 6.40?±?2.70, respectively. A significant difference in the mean scores for supervision was observed between the clerkship sites (p?=?.0001), with the highest score for consultants’ supervision (7.01?±?2.90) and lowest for interns’ supervision (4.81?±?3.30).

Conclusions: Overall, although the program was satisfactory to the majority of participants, areas of concern were identified. Students reported more effective learning and development of clinical skills , during the morning rounds, when supervised by consultants and senior specialists, and in activities that involved examining patients, presenting cases, and participating in discussions.     

The multiple mini-interviews as a predictor of peer evaluations during clinical training in medical school*

Background: Multiple Mini-Interviews (MMI) is an admissions tool being used for more than a decade by medical schools worldwide to assess non-cognitive skills. In Israel, in addition to the MMI tool, two questionnaires are given to the candidates. It has been necessary to find a relevant criterion to examine the predictive validity of the MMI test. The measure developed in this study was a peer assessment tool which was filled out during clerkship.

Aims: The study aims at evaluating the predictive validity of the MMI and two questionnaires when compared with the peer assessment tool.

Method: Ninety nine fourth-year medical students were included in this study. All of them went through the MMI test before the beginning of their studies. The students participated in two clinical rotations and were divided into 10 groups, each consisting of 9–12 students. This study is based on assessments given to 99 students. Every member of a group evaluated his fellow members on a number of attribute. The questionnaire included 10 statements, related to a particular attributes. In addition two concluding questions were included. Pearson correlations were used to test the relationships between pre-admission variables (MMI and two questionnaires) and the peer assessments.

Results: Statistically significant, moderate correlations between the general MOR and MIRKAM scores and the sum of the questionnaire assessments were 0.39 and 0.37, respectively (P-value <0.05).

Conclusions: The study provides important evidence for the validity of the MMI. Additional studies are required to reevaluate the predicted validity of the MMI.     

Assessing learning in the adaptive curriculum

Abstract

Background: Medical education is a dynamic process that will continuously evolve to respond to changes in the foundations of medicine, the clinical practice of medicine and in health systems science.

Purpose: In this paper, we review how assessing learning in such a dynamic environment requires comprehensive flexible and adaptable methodological approaches designed to assess knowledge attainment and transfer, clinical skills/competency development, and ethical/professional behavior. Adaptive assessments should measure the learner’s ability to observe where changes in health care delivery are needed and how to implement them. Balancing formative and summative assessments will promote reflective learning so that each student will reach her/his highest potential. From the programmatic perspective, measuring the design and delivery of instruction in relation to students? efforts to achieve competency will improve learning and foster continuous professional development of faculty and advance the science of learning.

Approach: We describe how two medical schools are approaching adaptive assessment, including using portfolio systems that encompass teaching and learning experiences while offering real-time longitudinal tracking of digital data toward improving learning and provide curricula continuous improvement cycles. Using latest technologies, portfolios produce actionable data displays with precise guidance for learning and program development.     

Providing a liminal space: Threshold concepts for learning in palliative medicine

Abstract

Introduction: Experience in palliative medicine provides a beneficial learning opportunity for doctors-in-training. There is, however, a gap in understanding which aspects of learning are most useful, which are problematic and how learning can best be facilitated. This study addresses that gap using the ‘threshold concepts’ framework. Threshold concepts are critical points of learning, often unique to a discipline. The learning occurs within a transitional or ‘liminal’ space and has specific characteristics including being ‘troublesome’ and ‘transformative.’

Methods: A qualitative, exploratory study was carried using the threshold concept framework. Semi-structured focus group interviews were held with doctors-in-training who had undertaken a 6-month palliative medicine attachment. Data were analysed using a content analysis approach with deductive and inductive phases, in order to identify threshold concepts.

Results: Five threshold concepts were identified. Two of these, ‘emotional engagement’ and ‘communication management,’ displayed all the typical characteristics of threshold concepts. This learning was highly valued by participants, had not occurred elsewhere in training and continued to influence practice.

Conclusions: Specific threshold concepts were identified for doctors undertaking a palliative medicine placement. These highlights where specific supports are required for learning and can be used to inform curriculum design.     

Training junior faculty to become clinical teachers: The value of personalized coaching

Abstract

Background: Junior clinical faculty require institutional support in the acquisition of feedback and clinical supervision skills of trainees. We tested the effectiveness of a personalized coaching versus guided self-reflection format of a faculty development program at improving faculty skills and self-efficacy.

Methods: Participants were evaluated both before and after the program using a four-station Objective Structured Teaching Exercise (OSTE). A gain-score analysis, one-way ANOVA, and paired t-tests were used to evaluate both groups. The impact on the learning environment was measured by resident ratings of the Maastricht Clinical Teaching Questionnaire.

Results: One hundred and twenty-seven participants completed the study over a three-year period. Both groups had significant improvements in self-efficacy. Participants in the coaching group demonstrated superior performance in encouraging learner self-reflection, teaching effectiveness, verifying learner understanding, exploring feelings/needs, and defining learning objectives. Over a 5-year period, the overall institutional learning climate significantly improved concerning faculty role-modeling, coaching, articulation, and explorations skills.

Conclusion: Offering a contextualized faculty-development program using OSTEs that provides multiple opportunities for feedback and is focused on creating a community of practice is an effective method to facilitate the transfer of skills to the clinical environment, supports teacher identity development, and favorably impacts the learning climate.