Legitimisation,personalisation and maturation: Using the experiences of a compulsory mobile curriculum to reconceptualise mobile learning

Background: Smartphone use is well established in society, with increasing acceptance in many professional workplaces. Despite the growth in mobile resources, how students and teachers benefit from these devices remains under-researched.

Aims: An exploration of student and educators views on the impact of mobile learning re-sources on placement learning experiences as part of the Leeds ‘MBChB Mobile’ programme.

Methods: Focus groups incorporating visual methodologies were undertaken with students from each year group; semi-structured interviews were undertaken with clinical teaching staff, including those who experienced the mobile programme as students themselves.

Results: Four key themes emerged. ‘Maturity of learning’, related to the way in which senior students use resources in a more nuanced way than junior colleagues. ‘Learning differently’, identified ‘personalisation’ and ‘just in time’ opportunities that mobile resources afforded. ‘Learning legitimately’ was identified by students as key to ensuring they adopted appropriate behaviours in relation to mobile learning. Using mobile resources at undergraduate level was found to ‘change learning patterns for life’.

Conclusions: There is a need to further develop the educational theory behind using mobile resources for learning. The results here suggest that mobile technologies are shaping learning behaviours, and are an indicator of learning maturity, reflecting the wider context of societal enculturation.     

Clearing the confusion about self-directed learning and self-regulated learning

Abstract

Self-Directed Learning (SDL) and Self-Regulated Learning (SRL) are often used without a clear distinction, leading to confusion in understanding and the use of inappropriate measurement tools. SDL is a general approach to learning and can be identified using ‘aptitude’ questionnaires but SRL is a dynamic and context specific learning process and requires ‘event’ measures, such as microanalysis. These differences have implications for research and remediation.     

An international study on teachers’ conceptions of learning and teaching and corresponding teacher profiles

Abstract

Introduction: Teachers’ conceptions of learning and teaching (COLT) affect their teaching behaviour. The 18 item COLT instrument has been developed in the Netherlands and comprises three scales, ‘teacher centredness’, ‘appreciation of active learning’ and ‘orientation to professional practice’. Previously we found five teacher profiles. The aim of this study was to find out if the COLT instrument can be used in an international setting.

Methods: Data were collected with the web-based COLT. Cronbach’s alphas of the three COLT scales were calculated. Subsequently a cluster analysis was conducted to identify different teacher profiles, followed by a split half validation procedure.

Results: Respondents (n?=?708) worked in 28 countries. Cronbach’s alphas were 0.67, 0.54, and 0.66. A six-cluster solution fitted best, based on meaning and explained variance. The sixth teacher profile scored high on ‘teacher centredness’, average on ‘appreciation of active learning’ and low on ‘orientation to professional practice’. The split half validation resulted in a Cohen’s kappa of 0.744.

Discussion: Cronbach’s alphas indicated acceptable reliablities for all three subscales. The new, sixth profile was labelled ‘neo-transmitter’.

Conclusion: We found evidence supporting the validity of the use of COLT in an international context and identified a new, sixth teacher profile.     

Threshold concepts: A portal into new ways of thinking and practising in psychiatry

Abstract

Introduction: The theory of threshold concepts conjectures that there are areas in every educational curriculum that are challenging; however, mastering these areas transform the learner’s view of the subject. In psychiatry, research into threshold concepts can inform educators so that they can better support students with mastering these challenging areas.

Purpose: To identify threshold concepts, we conducted semi-structured interviews with six psychiatry educators and free-text surveys with medical students. To identify avenues for improving the curriculum, we discussed with educators, ways of improving understanding and looked at different approaches to learning.

Materials and methods: From our analysis of all responses, we derived three threshold concepts: Therapeutic Risk-Taking, the Biopsychosocial Model, and the Concept of Diagnosis in psychiatry. The majority of students experienced difficulties grasping these concepts and applying them in their patient interactions.

Results and conclusions: Hence, we propose focused teaching activities that can help students cross these thresholds: student Balint groups exploring therapeutic risk, student Balint groups exploring the role of a psychiatrist, exposure to psychological therapies/psychotherapy skills and explicit diagnostic reasoning. These activities can be integrated into the undergraduate curriculum to help medical students develop a better understanding and appreciation of psychiatry.     

Using language of entrustable professional activities to define learning objectives of radiology clerkship: A modified Delphi study

Abstract

Background: A standard undergraduate radiology education is essential to prepare graduates for multidisciplinary clinical practice yet the literature lacks clear guidelines or consensus about the learning objectives of an optimal radiology clerkship.

Aim: To define a competency-based framework for undergraduate radiology education by using language of Entrustable Professional Activities (EPAs).

Methods: A modified Delphi method with three iterative rounds was used as an expert consensus approach. An online questionnaire with Likert scale was formulated incorporating EPAs and their components (competencies, assessment strategies, and supervision level) and distributed to 45 consultant radiologists following pilot study. Items reaching consensus were accepted and rest were resent in round 2. In round 3, a dichotomous scale was used for final approval and to see response stability.

Results: A final set of six EPAs with 87 competencies and respective assessment strategies, all aiming for ‘level 3a’ of supervision was identified. These include recommending cost effective appropriate imaging tests for common pathologies, obtaining informed consent for diagnostic contrast studies, basic interpretation and communication of common pathologies/emergencies on radiographs (chest, abdominal, and skeletal) and on CT brain.

Conclusion: This EPA framework for radiology clerkship is a first step towards a competency-based approach to undergraduate radiology training and assessment.     

Nurturing professionalism in medical schools. A systematic scoping review of training curricula between 1990–2019

Abstract

Introduction: Professionalism is an evolving, socioculturally informed multidimensional construct that influences doctor-patient relationships, patient satisfaction and care outcomes. However, despite its clinical significance there is little consistency in how professionalism is nurtured amongst medical students. To address this gap a systemic scoping review of nurturing professionalism in medical schools, is proposed.

Methods: Levac’s framework and the PRISMA-P 2015 checklist underpinned a 6-stage systematic review protocol. Concurrent use of Braun and Clarke’s approach to thematic analysis and directed content analysis was used to identify the key elements in nurturing professionalism.

Results: 13921 abstracts were identified from six databases, 854 full-text articles reviewed, and 162 full-text included articles were included. The 4 themes identified through thematic analysis are consistent with findings of the directed content analysis. These were the definition of professionalism, the approaches, content, barriers and enablers to teaching professionalism.

Conclusion: Informed by a viable definition of professionalism and clear milestones nurturing professionalism nurturing professionalism begins with culturally appropriate training in clinical competence, humanistic qualities and reflective capacity. This process requires effective evaluations of professional identity formation, and the impact of the learning environment underlining the need for longitudinal assessments of the training process.     

Learning methods and strategies of anatomy among medical students in two different Institutions in Riyadh,Saudi Arabia

Abstract

Background: Anatomy instructors adopt individual teaching methods and strategies to convey anatomical information to medical students for learning. Students also exhibit their own individual learning preferences. Instructional methods preferences vary between both instructors and students across different institutions.

Aims: In attempt to bridge the gap between teaching methods and the students’ learning preferences, this study aimed to identify students’ learning methods and different strategies of studying anatomy in two different Saudi medical schools in Riyadh.

Materials and Methods: A cross-sectional study, conducted in Saudi Arabia in April 2015, utilized a three-section questionnaire, which was distributed to a consecutive sample of 883 medical students to explore their methods and strategies in learning and teaching anatomy in two separate institutions in Riyadh, Saudi Arabia.

Results: Medical students’ learning styles and preferences were found to be predominantly affected by different cultural backgrounds, gender, and level of study. Many students found it easier to understand and remember anatomy components using study aids. In addition, almost half of the students felt confident to ask their teachers questions after class. The study also showed that more than half of the students found it easier to study by concentrating on a particular part of the body rather than systems. Students’ methods of learning were distributed equally between memorizing facts and learning by hands-on dissection. In addition, the study showed that two thirds of the students felt satisfied with their learning method and believed it was well suited for anatomy.

Conclusions: There is no single teaching method which proves beneficial; instructors should be flexible in their teaching in order to optimize students’ academic achievements.     

Influences on the implementation of Mini-CEX and DOPS for postgraduate medical trainees’ learning: A grounded theory study

Abstract

Introduction: In order for Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) to actually have a positive effect on trainees’ learning, the way in which the tools are implemented is of key importance. However, there are many factors influencing their implementation. In this study, we aim to develop a comprehensive model of such factors.

Methods: Using a constructivist grounded theory approach, we performed eight focus groups. Participants were postgraduate trainees and supervisors from three different specialties; all were experienced with Mini-CEX and/or DOPS. Data were analyzed for recurring themes, underlying concepts and their interactions using constant comparison.

Results: We developed a model demonstrating how the implementation of Mini-CEX and DOPS for trainees’ learning is influenced by 13 factors relating to four categories: organizational culture (e.g. value of teaching and feedback), work structure (e.g. time for Mini-CEX and DOPS, faculty development), instruments (e.g. content of assessment), and users (e.g. relationship between trainees and supervisors), and their interaction.

Conclusions: We developed a complex model of influencing factors relating to four categories. Consideration of this model might support successful implementation and trainees’ learning with Mini-CEX and DOPS.     

Inclusion in the clinical learning environment: Building the conditions for diverse human flourishing

Abstract

Aim: While diversity, equity, and inclusion are much proclaimed aspirational goals in education programs, the clinical learning environment (CLE) frequently falls short of meaningful incorporation of these concepts in processes, policies, and local culture. In this paper, we explore how inclusion, diversity, and equity can and should be defined and operationalized within medical education.

Methods: Three cases, organized around Hafferty’s curricular framework (formal, informal, and hidden), we illustrate lapses and potential best practices in inclusion in the CLE.

Results: The essential “best-practice” of programs inclusive of diverse individuals is the design of policies, processes, and behavioral norms co-creatively with all community members. Potential pitfalls to greater inclusion include nostalgic reference to “the past”, a neutrality that is operationalized without the rudder of explicit values and not recognizing that ethical obligations between teachers, learners, and programs are at the heart of the discussion of how inclusive learning and work environments are built.

Conclusion: Inclusive CLE’s provide space for co-creation, understand the need to ensure the voices of the vulnerable (i.e. learners) are heard and valued and through this promote the flourishing of diverse human capital, in keeping with a model that views diversity as a key attribute or organizational excellence.     

Assessing learning in the adaptive curriculum

Abstract

Background: Medical education is a dynamic process that will continuously evolve to respond to changes in the foundations of medicine, the clinical practice of medicine and in health systems science.

Purpose: In this paper, we review how assessing learning in such a dynamic environment requires comprehensive flexible and adaptable methodological approaches designed to assess knowledge attainment and transfer, clinical skills/competency development, and ethical/professional behavior. Adaptive assessments should measure the learner’s ability to observe where changes in health care delivery are needed and how to implement them. Balancing formative and summative assessments will promote reflective learning so that each student will reach her/his highest potential. From the programmatic perspective, measuring the design and delivery of instruction in relation to students? efforts to achieve competency will improve learning and foster continuous professional development of faculty and advance the science of learning.

Approach: We describe how two medical schools are approaching adaptive assessment, including using portfolio systems that encompass teaching and learning experiences while offering real-time longitudinal tracking of digital data toward improving learning and provide curricula continuous improvement cycles. Using latest technologies, portfolios produce actionable data displays with precise guidance for learning and program development.     

Tools for structured team communication in pre-registration health professions education: a Best Evidence Medical Education (BEME) review: BEME Guide No. 41

Introduction: Calls for the inclusion of standardized protocols for information exchange into pre-registration health professions curricula have accompanied their introduction into clinical practice. In order to help clinical educators respond to these calls, we have reviewed educational interventions for pre-registration students that incorporate one or more of these ?tools for structured communication?.

Methods: Searches of 10 databases (1990?2014) were supplemented by hand searches and by citation searches (to January 2015). Studies evaluating an intervention for pre-registration students of any clinical profession and incorporating at least one tool were included. Quality of included studies was assessed using a checklist of 11 indicators and a narrative synthesis of findings undertaken.

Results: Fifty studies met our inclusion criteria. Of these, 21 evaluated the specific effect of a tool on educational outcomes, and 27 met seven or more quality indicators.

Conclusions: Pre-registration students, particularly those in the US, are learning to use tools for structured communication either in specific sessions or integrated into more extensive courses or programmes; mostly ‘Situation Background Assessment Recommendation’ and its variants. There is some evidence that learning to use a tool can improve the clarity and comprehensiveness of student communication, their perceived self-confidence and their sense of preparedness for clinical practice. There is, as yet, little evidence for the transfer of these skills to the clinical setting or for any influence of teaching approach on learning outcomes. Educators will need to consider the positioning of such learning with other skills such as clinical reasoning and decision-making.     

What makes a good children’s doctor? Exploring the child perspective in the OSCE setting

Background: Patient feedback is increasingly important in clinical practice, and this should include children’s views. 28 children aged 8–10 years participating in a large-scale OSCE underwent cranial nerve examination by student candidates. They scored each out of 10 for the question: ‘If you had to see a doctor again, how happy would you be to see this one?’ An age-adapted qualitative focus group methodology was used to explore why they scored some students more highly than others.

Results: Children’s scores for the 256 medical students ranged from 2 to 10 (median 9; mean 8.46). 76% of scores were above 8. ‘Good' doctor attributes included: ‘friendly’, ‘funny’, ‘knowledgeable’, ‘confident’; ‘bad’ doctor attributes were: ‘making mistakes’, ‘not paying attention’, ‘forgot everything’, ‘serious’. Children’s reasons for specific scores are further explored.

Discussion and conclusion: Scores were positively skewed, in line with most patient/simulated patient feedback, and children discriminated between candidates. It should not be assumed that clinician examiners can accurately represent the views of child patients who may value different qualities in doctors. Children participating in our study had clear views of what they want from a doctor: a consultative approach with clear and kind explanation of the process of examination.     

Differences between medical school and PGY1 learning outcomes: An explanation for new graduates not being “work ready”?

Abstract

Background: Widespread concerns about new medical graduates’ ‘work readiness’ may reflect, in part, differences in mandatory learning outcomes for medical students and new medical graduates.

Purpose: To examine differences between required medical student and PGY1 (first year resident) training program outcomes, and the nature and magnitude of these differences.

Method: Comparison, systematic identification and thematic analysis of differences between the graduate outcomes in the Australian Medical Council Standards for the Assessment and Accreditation of Primary Medical Programs and those in the New Zealand Curriculum Framework for Prevocational Training.

Results: The relationship between these outcome statements were categorized as: essentially similar; continuity; partial discontinuity; and complete discontinuity of learning trajectory. Areas requiring substantial new learning may reflect medical schools’ focus on individual student performance, and on learning and assessments based on single episodes of often uncomplicated illness. This contrasted with a post-graduate focus on integrated health care delivery by teams and management of complex illnesses over the whole patient care journey.

Conclusions: Characterizing these marked differences between pre-graduate and postgraduate standards, within a trajectory of learning, explains some of the difficulties in students’ preparation for work readiness. These could inform learning interventions to support new graduates’ professional development to ensure patient safety. Development and revision of accreditation standards should include formal review against the expectations of the preceding and succeeding phases of learning.     

How we tackled the problem of assessing humanities,social and behavioural sciences in medical education

Background: Assessment serves as an important motivation for learning. However, multiple choice and short answer question formats are often considered unsatisfactory for assessment of medical humanities, and the social and behavioural sciences. Little consensus exists as to what might constitute ‘best’ assessment practice.

What we did: We designed an assessment format closely aligned to the curricular approach of problem-based learning which allows for greater assessment of students’ understanding, depth of knowledge and interpretation, rather than recall of rote learning.

Conclusion: The educational impact of scenario-based assessment has been profound. Students reported changing their approach to PBL, independent learning and exam preparation by taking a less reductionist, more interpretative approach to the topics studied.     

Accelerating expertise: Perceptual and adaptive learning technology in medical learning

Abstract

Rationale: Recent advances in the learning sciences offer remarkable potential for improving medical learning and performance. Difficult to teach pattern recognition skills can be systematically accelerated using techniques of perceptual learning (PL). The effectiveness of PL interventions is amplified when they are combined with adaptive learning (AL) technology in perceptual–adaptive learning modules (PALMs).

Innovation: Specifically, PALMs incorporate the Adaptive Response Time-based Sequencing (ARTS) system, which leverages learner performance (accuracy and speed) in interactive learning episodes to guide the course of factual, perceptual, or procedural learning, optimize spacing, and lead learners to comprehensive mastery. Here we describe elements and scientific foundations of PL and its embodiment in learning technology. We also consider evidence that AL systems utilizing both accuracy and speed enhance learning efficiency and provide a unified account and potential optimization of spacing effects in learning, as well as supporting accuracy, transfer, and fluency as goals of learning.

Results: To illustrate this process, we review some results of earlier PALMs and present new data from a PALM designed to accelerate and improve diagnosis in electrocardiography.

Conclusions: Through relatively short training interventions, PALMs produce large and durable improvements in trainees’ abilities to accurately and fluently interpret clinical signs and tests, helping to bridge the gap between novice and expert clinicians.     

Learning and professional acculturation through work: Examining the clinical learning environment through the sociocultural lens

Abstract

Purpose: We examined studies of the clinical learning environment from the fields of sociology and organizational culture to (i) offer insight into how workplace culture has informed research on postgraduate trainee learning and professional development; (ii) highlight limitations of the literature; and (iii) suggest practical ways to apply sociocultural concepts to challenges in the learning environment.

Materials and methods: Concepts were explored by participants at a consensus conference in October 2018.

Results: We identified three enduring foci for research using a sociocultural lens: the hidden curriculum, exploration of medical errors, and the impact of time pressures on the relational nature of clinical education. Limitations included the lower value attributed to informal learning and a pejorative valuation of the hidden curriculum; and disconnect between practices in clinical settings and the priorities of the larger organization.

Conclusions: Research on the learning environment using a sociocultural lens suggest workplace goals, norms and practices determined which learners engage in learning-relevant activities, to what extent, and the degree of guidance provided, with these factors creating “tacit” curricula that may support or compete with formal learning goals. We close with guidance on how sociocultural constructs could inform research to improve the learning environment.