Diagnostic ability of medical students in relation to their learning characteristics and preclinical background

Is the diagnostic ability of medical students — as appraised by the Diagnostic Thinking Inventory (DTI) — influenced by the learners’ characteristics, or the way they acquired basic knowledge? This question was explored in a 4-year consecutive sampling of clinical clerkship students. DTI inventory scores (flexibility in thinking and structure in memory), learners’ characteristics (learning style, self-confidence as a learner, and motivation to learn), together with knowledge scores (grade-point average and problem-solving test) were measured and analysed for their relationships and the differences between groups. Results revealed that higher scores of the DTI measures were associated with students’ high self-confidence, high motivation to learn, and abstract learning types. Correlation coefficients showed significant relationships between the DTI scores and both knowledge measures. In addition, t-tests showed that students with an integrated teaching background and problem-based learning (PBL) experience obtained significantly higher scores for structure in memory. The findings suggest that the inventory scores are sensitive to both cognitive and non-cognitive factors. The inventory may be useful in detecting subtle influences on diagnostic ability differentiation in medical students.     

An appraisal of medical students' reflection-in-learning

INTRODUCTION: How do students reflect as they strive for some control of learning early in their clinical activities? The purpose of this study was to examine the reflection-in-learning profile of medical students as they started their clinical apprenticeship. METHODS: A measure of reflection-in-learning was used to appraise the level and direction of change of reflection in relation to a course experience. The study involved 103 medical students of both sexes who were beginning clinical activities. Assessments of self-regulation of learning, of the meaningfulness of the learning experience, and of diagnostic thinking were also obtained. RESULTS: The results showed that 81% of the students had an increase in scores for reflection-in-learning between the beginning and the end of a course. At the end of the course, the level of reflection-in-learning was significantly associated with self-perceived competence for self-regulated learning and with the meaningfulness of the learning experience. In the following term, students who had high reflection-in-learning scores at the end of the course had higher grade-point averages and greater self-reported diagnostic ability in comparison with those with low scores. CONCLUSIONS: There was some evidence of an improved quality of reflection as the students strive for some control of learning. Overall, the findings support the idea that a greater effort at reflection is associated with a more positive learning experience. They also suggest that reflection-in-learning is related to readiness for self-regulation of learning and may be conducive to enhanced diagnostic ability. In conclusion, measuring reflection-in-learning may be a useful tool in the appraisal of medical students' learning profiles.     

What kind of motivation drives medical students' learning quests?

AIMS: To describe the patterns of medical students' motivation early in the undergraduate programme and to examine their relationships with learning features and motivational outcomes. METHODS: The Academic Motivation Scale (AMS) was administered after the first medical year to 297 students of both sexes from consecutive classes within a 4-year timeframe. Measures of learner orientation and reflection in learning were also obtained. Academic achievement and peer tutoring experience were recorded during a 2-year follow-up. Quantitative approaches included analysis of variance, correlational and classificatory analyses of the data. RESULTS: The profile of the students' responses revealed higher levels of autonomous motivation than of controlled motivation although such measures were positively related. Correlation analysis showed significant association of autonomous motivation with higher levels of meaning orientation, reflection in learning, academic achievement, cross-year peer-tutoring experience, and intention to continue with studies. Classificatory analysis identified 4 student groups with distinct patterns of motivation. Analysis of variance revealed significant and consistent differences in learning features and outcomes among such groups. CONCLUSIONS: The findings indicate that medical students portray distinct patterns of autonomous and controlled motivation that seem to relate to the learners' frame of mind towards learning as well as the educational environment. Autonomous motivation had closer relationships than controlled motivation with measures of self-regulation of learning and academic success in the context of a demanding medical programme.     

Problem-based learning versus lecture-based learning in a course of basic pharmacology: a controlled, randomized study

Since its first implementation in a medical programme at McMaster University, Canada, problem-based learning (PBL) has become a well-established means of teaching and learning medicine. Extensive research has been conducted and a number of strengths of the method are well supported. Several items, however, remain unclear although there is evidence that no relevant difference exists in factual knowledge among students from PBL and traditional curricula, a controlled, randomized study has not been conducted to address this issue. The Medical Faculty of the University of Cologne is in the process of integrating elements of PBL into its curriculum. In the spring term of 1997, after seven semesters of experience with PBL supplementing the traditional course of basic pharmacology, we did for the first time use PBL instead of the lecture-based course (LBL) and conducted a controlled prospective study to determine the effects of this intervention. One-hundred and twenty-three students were randomly assigned to either PBL (n = 63), with tutorial groups of up to nine students, or to the traditional, lecture-based course (n = 60). Analysis of the results of both groups in the examination of basic pharmacology, consisting of multiple-choice and short-essay questions, revealed similar scores with a tendency favouring PBL students in the category of short-essay questions. Hence, it seems clear that PBL does not imply a disadvantage in terms of factual knowledge. Students considered PBL to be an effective learning method and favoured it over the lecture format. Furthermore, students reported positive effects of PBL in terms of use of additional learning resources, interdisciplinarity, team work and learning fun.     

Influence of curriculum type on student performance in the United States Medical Licensing Examination Step 1 and Step 2 exams: problem-based learning vs. lecture-based curriculum

INTRODUCTION: The results of the United States Medical Licensing Examination Step 1 and 2 examinations are reported for students enrolled in a problem-based and traditional lecture-based curricula over a seven-year period at a single institution. There were no statistically significant differences in mean scores on either examination over the seven year period as a whole. There were statistically significant main effects noted by cohort year and curricular track for both the Step 1 and 2 examinations. These results support the general, long-term effectiveness of problem-based learning with respect to basic and clinical science knowledge acquisition. CONTEXT: This paper reports the United States Medical Licensing Examination Step 1 and Step 2 results for students enrolled in a problem-based and traditional lecture-based learning curricula over the seven-year period (1992-98) in order to evaluate the adequacy of each curriculum in supporting students learning of the basic and clinical sciences. METHODS: Six hundred and eighty-nine students who took the United States Medical Licensing Examination Step 1 and 540 students who took Step 2 for the first time over the seven-year period were included in the analyses. T-test analyses were utilized to compare students' Step 1 and Step 2 performance by curriculum groups. RESULTS: United States Medical Licensing Examination Step 1 scores over the seven-year period were 214 for Traditional Curriculum students and 208 for Parallel Curriculum students (t-value = 1.32, P=0.21). Mean Step 2 scores over the seven-year period were 208 for Traditional Curriculum students and 206 for Parallel Curriculum students (t-value=1.08, P=0.30). Statistically significant main effects were noted by cohort year and curricular track for both the Step 1 and Step 2 examinations. CONCLUSION: The totality of experience in both groups, although differing by curricular type, may be similar enough that the comparable scores are what should be expected. These results should be reassuring to curricular planners and faculty that problem-based learning can provide students with the knowledge needed for the subsequent phases of their medical education.     

Early effects of a new problem-based clinically oriented curriculum on students' perceptions of teaching

OBJECTIVES: To compare the course experiences of medical students in a new problem-based (PBL) undergraduate medical course with those of their peers in a conventional curriculum. DESIGN: Whole class questionnaire survey using a pre-validated research instrument. SETTING: University of Liverpool, UK. SUBJECTS: First and second year medical students RESULTS: New curriculum students were more satisfied with their course when compared to their conventional course peers. Problem solving, team working and motivation scores were significantly higher amongst new course (PBL) students. New course students were more anxious about clarity of objectives and standard of work required. CONCLUSIONS: Early evidence suggests that curriculum reform from conventional teaching to a small group problem analysis programme results in improvement in student satisfaction with teaching and the development of appropriate learning skills.     

Evaluating problem-based learning in a multilingual student population

OBJECTIVES: The University of Natal Medical School in South Africa provides training for a student body composed of two groups: one with English as a first language and the other with an African language as a first language and English as the second. A new methodology was developed to evaluate an innovative course using modified problem-based learning techniques in this heterogeneous environment. DESIGN: The learning model proposed required achieving a balance of three components: content, enquiry/learning process and social interaction/group process. A multidimensional system, felt to be consistent with this educational philosophy, was developed using seven different quantitative and qualitative techniques. SETTING: The University of Natal Medical School. SUBJECTS: First-year multilingual medical students. RESULTS: The results revealed that social interaction was highly successful in reducing barriers between the student groups and between students and facilitators. However, the emphasis on group participation may have overshadowed the enquiry process, leading to superficial discussions of problems and feelings of repetitiveness. During the course students and facilitators expressed concern that the innovative assessments used did not assess the course content adequately. While the group presentations and projects were useful exercises for consolidation and group interaction, they did not enable facilitators to identify struggling students. CONCLUSIONS: The outcome of the evaluation stressed the need of achieving an appropriate balance both in the curriculum and assessments of the three components of the learning model, particularly in a setting where student backgrounds and language ability differ. Multidimensional methodology is needed for effective evaluation that promotes critical reflection.     

Facility with the English language and problem-based learning group interaction: findings from an Arabic setting

The Faculty of Medicine and Health Sciences (FMHS), United Arab Emirates (UAE) University is in a unique position to explore issues related to English language proficiency and medical student performance. All students entering the FMHS have English as a second language. This study focused on the issues of students' proficiency in English as measured by the TOEFL test, student background factors and interaction in problem-based learning (PBL) groups. Using a modification of Bales Interaction Process Analysis, four problem-based learning groups were observed over four thematic units, to measure the degree of student interaction within PBL groups and to compare this to individual TOEFL scores and key background variables. The students' contributions correlated highly with TOEFL test results in the giving of information (range r = 0.67-0.74). The female students adhered to interacting in English during group sessions, whereas the male students were more likely to revert to using Arabic in elaborating unclear phenomena (p < 0.01). The educational level of the student's mother was highly predictive of TOEFL scores for the male students, but not for female students. Multivariate analysis was undertaken to analyse the relative contribution of the TOEFL, parental education and years of studying in English. The best predictor of students' contributions in PBL groups was identified as TOEFL scores. The study demonstrates the importance of facilitating a locally acceptable level of English proficiency prior to admission to the FMHS. However, it also highlights the importance of not focusing only on English proficiency but paying attention to additional factors in facilitating medical students in maximizing benefits from interactions in PBL settings.     

A comparison of learning outcomes and attitudes in student- versus faculty-led problem-based learning: an experimental study

OBJECTIVES: To compare learning outcomes and perceptions of facilitator behaviours and small-group process in problem-based learning (PBL) groups led by students and those led by faculty. DESIGN: A prospective, Latin-square cross-over design was employed. Second-year medical students participated in 11 PBL cases over the course of the academic year. For each case, half the student groups were led by faculty and the other half by a student group member selected randomly to serve in the facilitator role. Learning outcomes were assessed by performance on objective examinations covering factual materials pertinent to the case. Perceptions of facilitator behaviours and of group functioning were assessed with a questionnaire completed at the end of each individual case. Focus-group discussions were held to gain more in-depth information about student perceptions and experience. Student-led sessions were observed at random by the investigators. SETTING: A state-supported, US medical school with a hybrid lecture-based and problem-based curriculum. SUBJECTS: One hundred and twenty-seven second-year medical students and 30 basic science and clinical faculty. RESULTS: No differences were detected in student performance on the objective evaluation based on whether the facilitator was a faculty member or peer group member, nor were there any differences in the perceptions of group process. Students gave peer facilitators slightly higher ratings in the second semester of the experiment. In the focus-group discussions, students voiced a general preference for student-led groups because they felt they were more efficient. Observation and focus-group reports suggest that groups led by students sometimes took short cuts in the PBL process. CONCLUSION: In a hybrid lecture- and PBL-based curriculum, student performance on objective examinations covering PBL materials is unaffected by the status of the facilitator (student vs. faculty). However, in peer-facilitated groups, students sometimes took short cuts in the PBL process that may undermine some of the intended goals of PBL.     

Pedagogical methods and affect tolerance in medical students

OBJECTIVES: There has been little evaluation, by means other than cognitive variables, of medical school curricula that include problem-based learning (PBL). This study aimed to investigate whether medical students' affect tolerance, an important prerequisite of empathy, was influenced by individual courses. DESIGN: The study is pseudo-randomised and cross-sectional, using a test of affect tolerance in students in their first, sixth and eighth term of medical school, during which they were kept together as one group for their pre-clinical studies, but were subsequently separated during the clinical part and were sent to two different university hospitals that used different teaching methods. SUBJECTS: Medical students. SETTING: University of Lund Medical School, Sweden. RESULTS: After receiving a short course in communications skills training, students in the sixth term had significantly higher mean scores on the test than students in their first term. In the eighth term, which is the surgery term, the mean scores for students attending the PBL course were still as high as those for students in the sixth term, while students in the course using conventional pedagogical methods had significantly lower mean scores. DISCUSSION: Since the content of the courses was similar and the composition of the two groups also fairly similar, we attribute the difference to the differing teaching methods. In the PBL course, the students were given continued and integrated communication skills instruction, in which it was possible for them to learn strategies to counteract the development of rigid psychic defences, which constitute an obstacle to affect tolerance and empathy.     

Self and tutor evaluations in problem-based learning tutorials: is there a relationship?

It is now recognized that acquiring specific skills in self-evaluation helps students in a more general appraisal of their overall performance. Self- and peer-evaluation skills are essential prerequisites for the success of every doctor in maintaining professional competence. In the Faculty of Medicine and Health Sciences (FMHS) of the United Arab Emirates, problem-based learning (PBL) is instituted in the first year. Self-evaluation by students and tutor rating of students' performances are an integral part of the PBL tutorials. This has provided the opportunity to conduct a systematic study of the role of self-evaluation by students as distinct from the tutor evaluation of students in the PBL tutorials for five themes. The study sample included all preparatory year (first-year) students who joined the FMHS in 1994 and 1995. A total number of 64 students participated, of whom 17 (26%) were male and 47 (74%) female. Mean self-evaluation scores were high throughout the module and did not follow any trend from theme one to theme five. While self and tutor scores were similar, male student self-evaluation scores were higher than for female students on overall scores. The sharing of assessment reports between students and tutors has been perceived to be a useful tool for the students' development of the skills of analysis, differentiation and critical appraisal.     

Learning together: clinical skills teaching for medical and nursing students

OBJECTIVE: To evaluate the feasibility and effectiveness of shared learning of clinical skills for medical and nursing students at the University of Manchester. DESIGN: Medical and nursing students learned clinical skills in either uniprofessional or multiprofessional groups. These groups rotated through skills stations taught by multiprofessional facilitators. The groups stayed together for a series of 3 sessions held at weekly intervals (an induction meeting followed by 2 3-hour teaching sessions). Both quantitative and qualitative methods were used to evaluate the project. CONTEXT: A total of 113 Year 3 students registered on the Medical (n = 41), Bachelor of Nursing (Honours) (n = 43) or the Diploma for Professional Studies in Nursing (n = 29) courses participated in the project which was set in the clinical skills unit of a teaching hospital. RESULTS: Pre- and post self-evaluation of confidence levels for the taught skills revealed a statistically significant increase for all skills. The primary reason students gave for participation in the project was to learn or consolidate skills. An additional inducement for participation was the opportunity to share knowledge and observations between professional groups. Tutors also evaluated the experience favourably, particularly with regard to small group discussions. They indicated that the programme provided an opportunity to standardise clinical skills teaching. CONCLUSION: Collaborative learning opportunities for nursing and medical students are feasible and add value to the learning experience. Data indicate positive outcomes of learning in multiprofessional groups, comprising increased confidence levels, increased understanding of others' professional roles and personal development.     

A process evaluation of medical ethics education in the first year of a new medical curriculum

BACKGROUND: Despite the recent increase in activity in the field of medical ethics education, few evaluative studies have been carried out. Most studies have taken place in North America, in curricula where teaching is discipline-based, and have concentrated on outcome rather than on the curricular processes adopted. AIM: To evaluate the process of medical ethics education in the first year of a new learner-centred, problem-based, integrated medical curriculum. METHOD: A qualitative, multi-method approach was adopted using open questionnaires, focus groups and tutor evaluation rating scales. The study involved all 238 students in the first year of the new medical curriculum, and the 30 clinical tutors who facilitated ethics learning. A stratified sampling technique was used to choose focus group participants. RESULTS: Small group teaching proved highly acceptable to both students and tutors. Tutors' teaching skills were central to its effectiveness. Tutors played an important role in promoting students' appreciation of the relevance of medical ethics to clinical practice, and in establishing a climate where constructive criticism of colleagues' actions is acceptable. Course integration, including the provision for students of clinical experiences on which to reflect, was an important aid to learning. Students and tutors were noted to be driving the ethics curriculum towards having a contextual rather than theoretical base. CONCLUSION: This evaluation identified those aspects of the medical ethics course which contributed to its effectiveness and those which detracted from it. This information will be used to inform future development.     

Effectiveness of basic clinical skills training programmes: a cross-sectional comparison of four medical schools

OBJECTIVE: Training in physical diagnostic skills is an important part of undergraduate medical education. The objective of this study was to study the outcome of skills training at four medical schools. CONTEXT: At the time of the study, three schools had a traditional lecture-based curriculum and one school had a problem-based learning curriculum with a longitudinal skills training programme. All schools offer extended exposure to clerkships. METHOD: A cross-sectional study in four medical schools was performed, using a written test of skills that has good correlation with actual student performance. The scores attained from four student groups were compared within and between the four medical schools. A total of 859 volunteer students from the later four years at each medical school participated in the study. RESULTS: The mean scores in the traditional medical schools increased with the start of skill training and the hands-on experience offered during the clerkships. Students from the school with the longitudinal skills training programme and the problem-based learning approach had significantly higher mean scores at the start of the clerkships, and maintained their lead in the subsequent clinical years. CONCLUSIONS: Longitudinal skills training seems to offer the students a superior preparation for clerkships as well as influencing the students' learning abilities during the clerkships. The effect of the problem-based learning approach, also related to the innovative philosophy of the curriculum, could not be accounted for.     

Can medical students from two cultures learn effectively from a shared web‐based learning environment?

OBJECTIVE: This study aimed to establish whether medical students from 2 different cultures can learn effectively from a shared web-based learning environment. METHODS: Students from the College of Medicine, Edinburgh, UK and the Medical School, Gifu, Japan shared 2 weeks of teaching and learning in clinical genetics, using problem-based learning in a web-based application (WBA). Questions about language, time zone, agreement about the curriculum (learning outcomes, tutor activity and assessment) and specific pedagogical issues about the educational effectiveness of students' learning were considered. RESULTS AND CONCLUSIONS: The evidence indicates that a shared WBA is practical where the learning outcomes and problem scenarios are common and students are fluent in the same language. Problem-based learning transfers itself best to online discussion boards when the numbers in the group are 16 or more. Students do not use the WBA as a primary source of resource material, and they augment the discussion boards with face-to-face meetings with peers and tutors.     

Computer-aided learning: an overvalued educational resource?

AIM: The aim of this study was to evaluate the place of computer-aided learning in a basic science course in the undergraduate medical curriculum at the University of Adelaide. METHODS: A software program was written which would allow students to study the anatomy and physiology of the liver and biliary tree in three different styles. Identical content was produced, matched for each style (problem-based, didactic and free text response) and students randomly allocated to one of four groups (three computer and one control). Students were tested before and after access to the program. RESULTS: Ninety second-year students completed the study. Those students who had access to the material in the problem-based and free text response styles did no better in the post-study test than the controls, whilst the group who had studied the didactically presented computer material performed significantly better than the other three groups. All three computer groups accessed the material on a similar number of occasions, but the group who had access to the free text entry program spent significantly less time on computer study. CONCLUSIONS: If computer materials are to be provided as a learning resource for the basic medical sciences, provision must be made for the style of teaching of the course and the style of learning of the students attending that course.     

An experiment in problem-based learning

Summary: Problem-solving skills are important for medical students and problem-based learning (PBL) is especially suited to general practice. Therefore an experiment using a form of PBL was introduced into a new 4-week course in general practice for final rotation students at the University of Glasgow in the session 1992–93. The experiment aimed to introduce students to an alternative method of learning to the traditional one previously used by them in their course, to encourage teamwork and to encourage the use of alternative methods of obtaining information. The method, centred around allowing the students to investigate problems they choose themselves, is described. The evaluation of the course by written standard form, free written comments and audiotape recorded interviews with a one in four sample of the class is presented.
Summary: The students selected many interesting problems and used many different and unusual sources of information in researching them. This method of learning was compared with the parallel lecture course and was thought by the students to be more interesting but less relevant than the lecture course.
Summary: The experiment showed that it is possible to introduce a problem-based form of learning into a new course in parallel with more traditional methods of teaching and for it to be at least partially successful for students much more used to a traditional didactic curriculum. Ways of improving the course in the future to make it more sensitive to the students' learning needs are discussed.     

Teaching medical students about disability and rehabilitation: methods and student feedback

The predicted increase in the prevalence of chronic and disabling diseases in the population over the next 30 years calls for a more effective approach to educating medical students about the assessment and management of disability. The introduction of a new postgraduate medical course at Flinders University of South Australia in 1996 allowed the development of a new topic on disability and rehabilitation. Over a 4-week period, students undertake four activities. First, they follow a particular patient in an inpatient rehabilitation setting and learn about the multidisciplinary approach to rehabilitation. Secondly, they each visit two people with a disability living in the community and assess their physical, mental, functional and social status. Thirdly, they each visit a service which supports those people in the community. Finally, they simulate having a disability which is randomly allocated to them. During these 4 weeks, students also participate in problem-based learning (PBL) and have 27 h of associated sessions or lectures. The PBL cases and associated sessions have a 'chronic disease' theme. We developed a questionnaire to obtain student feedback on this new topic in the first 2 years of its delivery. A 69% response rate has been obtained. Overall, the topic was well-received, and as a result most students felt more comfortable in dealing with disabled people. They were enthusiastic about ward work, and enjoyed learning about aspects of multidisciplinary team care. Exercises involving simulation of disability were largely acceptable. We believe that this topic helps our students to deal better with the problems of disabled people.     

Approaches to learning in a problem-based medical programme: a developmental study

In this study we investigate how the introductory phase of the problem-based medical programme in Maastricht affects the study methods of students. On the first day of the academic year, 142 men and women medical students completed the Short Inventory of Study Approaches and again at the end of the introductory period. The study indicates that these study methods are fostered by training in problem-based learning given during the introductory period.