Students perceive skills learned in pre-clerkship PBL valuable in core clinical rotations

Abstract

Purpose: Problem-based learning (PBL) is an instructional method widely used by medical educators that promotes an environment in which students effectively learn the foundational knowledge and skills that are prerequisites for graduation. This study evaluated medical students’ perceptions of the helpfulness of skills acquired in PBL to core clerkship rotations.

Methods: A 25-item survey was designed to assess students’ perceptions of skills learned in PBL that were helpful on core clerkships and transferable to the clinical setting. A random sample of students with at least 8?months of clerkship experience were invited to complete the survey.

Results: Of 68 students, 35 (52%) returned questionnaires. Results suggest a clustering of themes based on their perceived value. Skills learned in PBL that students rated most highly as helpful or very helpful during core clinical rotations include: comfort discussing concepts, identifying key information, presentation skills, interpersonal skills, diagnostic thinking, finding information, self-awareness, and organizing information. Other items rated highly included: forming questions, time management, primary literature (engaging with published original research articles), and leadership. The skills acquired in PBL were associated with multiple competency domains.

Conclusions: Although conditions of the pre-clerkship curriculum are substantially different from the learning environment of clerkship rotations, skills learned in PBL are perceived as applicable to authentic clinical training.     

The effectiveness of integration of virtual patients in a collaborative learning activity

Abstract

Background: Virtual patients (VPs) have been recently integrated within different learning activities.

Aim: To compare between the effect of using VPs in a collaborative learning activity and using VPs in an independent learning activity on students’ knowledge acquisition, retention and transfer.

Methods: For two different topics, respectively 82 and 76 dental students participated in teaching, learning and assessment sessions with VPs. Students from a female campus and from a male campus have been randomly assigned to condition (collaborative and independent), yielding four experimental groups. Each group received a lecture followed by a learning session using two VPs per topic. Students were administrated immediate and delayed written tests as well as transfer tests using two VPs to assess their knowledge in diagnosis and treatment.

Results: For the treatment items of the immediate and delayed written tests, females outperformed males in the collaborative VP group but not in the independent VP group.

Conclusion: On the female campus, the use of VPs in a collaborative learning activity is more effective than its use as an independent learning activity in enhancing students’ knowledge acquisition and retention. However, the collaborative use of VPs by itself is not enough to produce consistent results across different groups of students and attention should be given to all the factors that would affect students’ interaction.     

Medical students and professionalism – Do the hidden curriculum and current role models fail our future doctors?

Purpose: Formal medical curricula aim to promote professionalism through learning from lectures, interactive tutorials and simulations. We report an exploratory voting exercise, conducted within a new integrated professional teaching module, examining the likely influence on students’ knowledge and perceptions of truth telling.

Methods: Responses were collected from cohorts of final year students over a six-year period. Students were asked to pick between two responses to a standardized clinical vignette, firstly the response that they personally thought was the more desirable action, and subsequently the response they believed would most likely result in the context of everyday real-life clinical practice.

Results: The difference (proportional change) in voting for “avoid full disclosure” from vote 1 (more desirable action) to vote 2 (likely real-life response) was 50% (95% CI: 36–64%, p?Conclusions: This finding highlights a substantial inconsistency between the knowledge taught by the formal curriculum, and the perception generated by the hidden curriculum. Medical Schools should develop strategies to manage the hidden curriculum, prepare clinical teachers to be good role models, and prepare students to be discerning about the hidden curriculum and when choosing role models.     

Embedding of the progress test in an assessment program designed according to the principles of programmatic assessment

Background: Progress tests (PT) are used to assess students on topics from all medical disciplines. Progress testing is usually one of the assessment methods of the cognitive domain. There is limited knowledge on how positioning of the PT in a program of assessment (PoA) influences students’ PT scores, use of PT feedback and perceived learning value.

Methods: We compared PT total scores and use of a PT test feedback (ProF) system in two medical courses, where the PT is either used as a summative assessment or embedded in a comprehensive PoA and used formatively. In addition, an interview study was used to explore the students’ perception on use of PT feedback and perceived learning value.

Results: PT total scores were higher, with considerable effect sizes (ESs) and students made more use of ProF when the PT was embedded in a comprehensive PoA. Analysis of feedback in the portfolio stimulated students to look for patterns in PT results, link the PT to other assessment results, follow-up on learning objectives, and integrate the PT in their learning for the entire PoA.

Conclusions: Embedding the PT in an assessment program designed according to the principles of programmatic assessment positively affects PT total scores, use of PT feedback, and perceived learning value.     

The simulated clinical environment: Cognitive and emotional impact among undergraduates

Context: Simulated clinical immersion (SCI) is used in undergraduate healthcare programs to expose the learner to real-life situations in authentic simulated clinical environments. For novices, the environment in which the simulation occurs can be distracting and stressful, hence potentially compromising learning.

Objectives: This study aims to determine whether SCI (with environment) imposes greater extraneous cognitive load and stress on undergraduate pharmacy students than simulated patients (SP) (without environment). It also aims to explore how features of the simulated environment influence students’ perception of learning.

Methods: In this mixed-methods study, 143 undergraduate pharmacy students experienced both SCI and SP in a crossover design. After the simulations, participants rated their cognitive load and emotions. Thirty-five students met in focus groups to explore their perception of learning in simulation.

Results: Intrinsic and extraneous cognitive load and stress scores in SCI were significantly but modestly higher compared to SP. Qualitative findings reveal that the physical environment in SCI generated more stress and affected students? focus. In SP, students concentrated on clinical reasoning. SCI stimulated a focus on data collection but impeded in-depth problem solving processes.

Conclusion: The physical environment in simulation influences what and how students learn. SCI was reported as more cognitively demanding than SP. Our findings emphasize the need for the development of adapted instructional design guidelines in simulation for novices.     

Learning methods and strategies of anatomy among medical students in two different Institutions in Riyadh,Saudi Arabia

Abstract

Background: Anatomy instructors adopt individual teaching methods and strategies to convey anatomical information to medical students for learning. Students also exhibit their own individual learning preferences. Instructional methods preferences vary between both instructors and students across different institutions.

Aims: In attempt to bridge the gap between teaching methods and the students’ learning preferences, this study aimed to identify students’ learning methods and different strategies of studying anatomy in two different Saudi medical schools in Riyadh.

Materials and Methods: A cross-sectional study, conducted in Saudi Arabia in April 2015, utilized a three-section questionnaire, which was distributed to a consecutive sample of 883 medical students to explore their methods and strategies in learning and teaching anatomy in two separate institutions in Riyadh, Saudi Arabia.

Results: Medical students’ learning styles and preferences were found to be predominantly affected by different cultural backgrounds, gender, and level of study. Many students found it easier to understand and remember anatomy components using study aids. In addition, almost half of the students felt confident to ask their teachers questions after class. The study also showed that more than half of the students found it easier to study by concentrating on a particular part of the body rather than systems. Students’ methods of learning were distributed equally between memorizing facts and learning by hands-on dissection. In addition, the study showed that two thirds of the students felt satisfied with their learning method and believed it was well suited for anatomy.

Conclusions: There is no single teaching method which proves beneficial; instructors should be flexible in their teaching in order to optimize students’ academic achievements.     

Legitimisation,personalisation and maturation: Using the experiences of a compulsory mobile curriculum to reconceptualise mobile learning

Background: Smartphone use is well established in society, with increasing acceptance in many professional workplaces. Despite the growth in mobile resources, how students and teachers benefit from these devices remains under-researched.

Aims: An exploration of student and educators views on the impact of mobile learning re-sources on placement learning experiences as part of the Leeds ‘MBChB Mobile’ programme.

Methods: Focus groups incorporating visual methodologies were undertaken with students from each year group; semi-structured interviews were undertaken with clinical teaching staff, including those who experienced the mobile programme as students themselves.

Results: Four key themes emerged. ‘Maturity of learning’, related to the way in which senior students use resources in a more nuanced way than junior colleagues. ‘Learning differently’, identified ‘personalisation’ and ‘just in time’ opportunities that mobile resources afforded. ‘Learning legitimately’ was identified by students as key to ensuring they adopted appropriate behaviours in relation to mobile learning. Using mobile resources at undergraduate level was found to ‘change learning patterns for life’.

Conclusions: There is a need to further develop the educational theory behind using mobile resources for learning. The results here suggest that mobile technologies are shaping learning behaviours, and are an indicator of learning maturity, reflecting the wider context of societal enculturation.     

How we tackled the problem of assessing humanities,social and behavioural sciences in medical education

Background: Assessment serves as an important motivation for learning. However, multiple choice and short answer question formats are often considered unsatisfactory for assessment of medical humanities, and the social and behavioural sciences. Little consensus exists as to what might constitute ‘best’ assessment practice.

What we did: We designed an assessment format closely aligned to the curricular approach of problem-based learning which allows for greater assessment of students’ understanding, depth of knowledge and interpretation, rather than recall of rote learning.

Conclusion: The educational impact of scenario-based assessment has been profound. Students reported changing their approach to PBL, independent learning and exam preparation by taking a less reductionist, more interpretative approach to the topics studied.     

How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review

Background: A key feature of health professionals’ training, irrespective of discipline, is the acquisition and application of clinical and communication skills. Despite this, little is known about the potential role of patient feedback on this process. This systematic review aimed to answer the question: How does feedback from patients impact upon healthcare student clinical skill development and learning?

Design: Systematic review of published literature.

Methods: Electronic databases were searched for studies that explored the effects of patient feedback on student learning and were published before March 2016. Eligible articles underwent methodological evaluation using the McMaster University Critical Evaluation Forms and data extraction.

Results: A total of 237 articles were retrieved following searches of electronic databases and hand searches of reference lists. Twelve (7 quantitative, 2 qualitative, 3 mixed methods) studies met the inclusion criteria. Eleven studies reported that patient feedback improved students’ clinical skills.

Conclusion: Minimal research has explored the impact of patient feedback on student learning. The research to date suggests that direct feedback from patients may be beneficial for the development of students’ communication and clinical skills; however, the wide variety of evaluation methods and the lack of validated tools for patients to provide feedback suggest that further exploration is warranted.     

Development of cognitive processing and judgments of knowledge in medical students: Analysis of progress test results

Background: Beside acquiring knowledge, medical students should also develop the ability to apply and reflect on it, requiring higher-order cognitive processing. Ideally, students should have reached higher-order cognitive processing when they enter the clinical program. Whether this is the case, is unknown. We investigated students’ cognitive processing, and awareness of their knowledge during medical school.

Methods: Data were gathered from 347 first-year preclinical and 196 first-year clinical students concerning the 2008 and 2011 Dutch progress tests. Questions were classified based upon Bloom’s taxonomy: “simple questions” requiring lower and “vignette questions” requiring higher-order cognitive processing. Subsequently, we compared students’ performance and awareness of their knowledge in 2008 to that in 2011 for each question type.

Results: Students’ performance on each type of question increased as students progressed. Preclinical and first-year clinical students performed better on simple questions than on vignette questions. Third-year clinical students performed better on vignette questions than on simple questions. The accuracy of students’ judgment of knowledge decreased over time.

Conclusions: The progress test is a useful tool to assess students’ cognitive processing and awareness of their knowledge. At the end of medical school, students achieved higher-order cognitive processing but their awareness of their knowledge had decreased.     

The roles of basic psychological needs,self-compassion,and self-efficacy in the development of mastery goals among medical students

Abstract

Aim: Competency-based medical education aims to foster mastery goals in learners. We examined medical students’ mastery approach (beneficial) and mastery avoidance (maladaptive) goals and their associations with students’ basic psychological needs, self-compassion, and self-efficacy.

Methods: This was a cross-sectional study employing an online questionnaire. Two hundred medical students in all four years of the medical program completed the questionnaire, containing measures of mastery goals, basic psychological needs (autonomy, competence, relatedness), self-compassion, and self-efficacy. Regression analyses were performed.

Results: Of the three basic psychological needs, the need for competence was significant in explaining both types of mastery goals. Self-efficacy and self-compassion were significant in explaining mastery approach and mastery avoidance goals, respectively.

Conclusions: Creating learning environments that are supportive of students’ need for competence, raising students’ awareness of the value of learning from mistakes in competency acquisition, and providing opportunities for students to experience self-efficacy may foster beneficial mastery approach goals in medical students.     

Undergraduate medical students’ perspectives of skills,uses and preferences of information technology in medical education: A cross-sectional study in a Saudi Medical College

Abstract

Background: Information technology (IT) is widely used in medical education. However, there are not enough studies about IT uses and preferences among traditional and problem-based learning (PBL) medical students.

Aim: To compare IT skills, uses and preferences for education between traditional and PBL medical students’.

Method: A cross-sectional study; a modified Educause Center for Analysis and Research online survey was sent to traditional curriculum 5th and PBL 4th year medical students of King Saud University.

Results: Most of the responding 176 students prefer mobile devices and moderate amount of IT in education. Fourth and fifth year students perceived high academic value of Google (94.2 vs. 86.7%, p?=?0.34), YouTube (90.7 vs. 92.2%, p?=?0.83) and PubMed (83.7 vs. 86.7%, p?=?0.06). More 4th year than 5th year students rated themselves as skilled in learning management system (54.7 vs. 21.1%, p?=?0.0001) and Smartboard use (40.7 vs. 23.3%, p?=?0.04). Most students rated faculty IT skills as effective. Students agreed that technology helps working faster (95.5%) and make learning creative (85.9%).

Conclusions: More integration of information literacy and IT training in medical curricula is needed to enhance better utilization of full features of IT resources available for learning and problem solving. National multi-institutional studies are recommended.     

Assisting the integration of social media in problem-based learning sessions in the Faculty of Medicine at King Abdulaziz University

Abstract

Purpose: Issues related to traditional Problem-Based Learning (PBL) at King Abdulaziz University Faculty of Medicine (KAU-FOM), including lack of student interaction between sessions and outdated instructional materials have led to the examining the use of social media. This study examines factors affecting the implementation of social media into PBL sessions

Methods: Mentored social media activities were incorporated between PBL sessions to third year medical students. Ground rules were set, and students were kept on track with learning objectives and authentic references. An online survey consisting of 18 questions were administered to measure the impact of the social media model embedded between PBL sessions.

Results: Feedback showed major improvements in students’ learning process as well as identifying areas for improvement. The highest ratings were in participation and communication, knowledge and information gathering, and cooperation and team-building.

Conclusions: This paper indicates that incorporating social media could facilitate learning between PBL sessions. Furthermore, guidelines are proposed to help educators implement a social media model into their PBL sessions.     

Reflecting on exchange students’ learning: Structure,objectives and supervision

Abstract

Background and aim: The increasing opportunities for medical students to participate in international electives may improve students’ professionalism and cultural competence. However, the students’ overall experiences may be unpredictable, unstructured and lack supervision. There is scant evidence with respect to their learning outcomes. These reflections demonstrate that short-term supervised elective can provide students with structured learning experiences to achieve specific learning objectives.

Methods: We carried out daily debriefs and a weekly summary with seven Curtin Medical School students from Perth, Australia during an 18-days supervised elective in the First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China. The daily debriefs and the weekly summary in different disciplines become the content of the reflections discussed in this article.

Results: The main themes identified in the feedback were as follows: Skills in history taking and physical examination; clinical reasoning; diagnosis and management of diseases rarely seen in Australia; awareness of clinical ethics; merits and demerits of different systems of healthcare; sensitivity to issues in doctor-patient relationships; work ethics; enhancement of cultural competence; and personal development.

Conclusions: These reflections provide insight into how overseas electives may be structured to improve students’ clinical reasoning skills in this hospital. These students achieved their learning outcomes under joint supervision from both institutions. The clinical skills learned from these experiences enhanced the students’ professionalism and cultural competence, giving students the opportunities to appreciate the multitude healthcare model of bio-psycho-social-political-economical-spiritual dimensions.     

Reforms in VUmc School of Medical Sciences Amsterdam: Student engagement,a Minor elective semester and stakeholder collaboration in improving the quality of assessments

Abstract

Background: At VUmc School of Medical Sciences, major curricular reforms occurred in 2005 and 2015, related to the introduction of a Bachelor-Master structure, a new legislation from the Ministry of Education, the changing societal context, and taking note of students’ and teachers’ needs.

Summary of work: Along with the introduction of the Bachelor-Master system, the period between 2005 and 2009 saw the movement from traditional lecture-based teaching to small group teaching in a competency-based curriculum, in which the students were responsible for their learning. Student engagement grew through students’ designing learning modules and conducting some of the teaching. In the Bachelor program, an elective “Minor”, was designed to broaden and deepen the knowledge of our students beyond the core learning outcomes, in a discipline of their choice. The examination board (EB), responsible for maintaining the quality of assessment, was split into the General EB, which handled overall strategy issues, and the Executive EB, which handled student requests and monitored the quality of assessments.

Lessons learned: Students develop a sense of what education is about if they are provided opportunities in designing teaching and conducting it. A Minor elective in the medical study can provide the students with an opportunity to learn outside the medical field. Collaborative working between different stakeholders in a medical school is crucial for safeguarding the quality of assessments. Curricular reforms need time to be accepted and integrated into the culture of the medical school. The educational vision needs to be refreshed regularly in alignment with the changing societal context.     

Red,yellow and green: What does it mean? How the progress test informs and supports student progress

Objectives: Most medical schools using progress tests (PTs) provide feedback by utilizing a traffic-light system of green (satisfactory), yellow (borderline) and red (unsatisfactory) categories. There is little research assessing students’ perceptions or usage of this feedback. Therefore this study proposed to determine the effectiveness of formative PTs at informing and supporting student progress.

Methods: A mixed methods study was performed, involving a retrospective analysis of a results database to establish the predictive validity of PT categories and 11 semi-structured interviews to explore students’ perceptions of PT feedback in a graduate entry medical programme.

Results: Quantitative analysis revealed that students who always scored green performed better in their summative exams and graduated with a higher final degree than those who received a yellow or red category at least once. Qualitative analysis revealed that just over half of the interviewed students perceived the PT as having informed their progress. Most participants agreed that the current feedback is insufficient and doesn’t guide their on-going learning.

Conclusion: While this study demonstrated that the PT is a useful predictive tool for informing student progress, in its current format it’s not fulfilling a truly formative role and supporting student progress sufficiently.     

Community of practice and student interaction at an acute medical ward: An ethnographic study

Background: A deeper understanding is needed of the acute medical care setting as a learning environment for students.

Aim: To explore workplace culture of an acute medical ward and students’ interactions within this community.

Method: An ethnographic design was applied. Medical and nurse students’ interactions were observed and informal questioning performed. Field notes were transcribed and analysed qualitatively, inspired by Wengers’ “Community of practice” theory.

Results: We identified four characteristics that regulated how students adapt and interact in the community of practice. Complex and stressful situations were stabilized by routines and carriers of culture. Variable composition and roles of community members were a part of the daily routine but did not seam obvious to students. Transitions through community boundaries were confusing especially for new students. Levels of importance and priority: Hierarchies and orders of priority were present as regulators of roles, routines and interactions, and of how staff approach different patient groups.

Conclusion: The culture shaped a pattern for, and created prerequisites that challenged students’ adaptation and created a space for learning. Students’ task on arrival was to enter the semipermeable membrane of the community of practice and to understand and adapt to its culture, and try to become accepted.     

How does peer teaching compare to faculty teaching? A systematic review and meta-analysis*

Purpose: In undergraduate medical education, peer-teaching has become an established and common method to enhance student learning. Evidence suggests that peer-teaching provides learning benefits for both learners and tutors. We aimed to describe the outcomes for medical students taught by peers through systematic review and meta-analysis of existing literature.

Methods: Seven databases were searched through 21 terms and their Boolean combinations. Studies reporting knowledge or skills outcomes of students taught by peers compared to those taught by faculty or qualified clinicians were included. Extracted data on students’ knowledge and skills outcomes were synthesised through a random effects model meta-analysis.

Results: The search yielded 2292 studies. Five hundred and fifty-three duplicates and 1611 irrelevant articles were removed during title-screening. The abstracts of 128 papers were screened against the inclusion and exclusion criteria. Ten studies have been included in the review. Meta-analyses showed no significant difference in peer-teaching compared to faculty teaching for knowledge or skills outcomes, standardised mean differences were 0.07 (95% CI: ?0.07, 0.21) and 0.11 (95% CI: ?0.07, 1.29), respectively.

Conclusion: Students taught by peers do not have significantly different outcomes to those taught by faculty. As the process of teaching helps to develop both tutor knowledge and teaching skills, peer-teaching should be supported.