The effect of compulsory participation of medical students in problem-based learning

Problem-based learning (PBL) is an instructional method that has attracted many advocates since its introduction in medical education almost 20 years ago. PBL features the use of student-directed tutorials, medically relevant problems to set study objectives, and independent learning. Educators have worried that not all students will do well with this method. This study compared a group of students who had chosen to be in a PBL curriculum with a group who had not, as they undertook a curriculum that contained both PBL and lecture-based courses. Academic performance was virtually identical regardless of learning method. Students slightly favoured the courses that featured the method they had originally chosen, but a significantly larger proportion of students shifted their preference from the lecture to the problem-based approach than vice versa. Students' academic performance does not appear to suffer when they are involuntarily enrolled in a PBL curriculum and many come to prefer this type of curriculum.     

Problem-based learning versus lecture-based learning in a course of basic pharmacology: a controlled, randomized study

Since its first implementation in a medical programme at McMaster University, Canada, problem-based learning (PBL) has become a well-established means of teaching and learning medicine. Extensive research has been conducted and a number of strengths of the method are well supported. Several items, however, remain unclear although there is evidence that no relevant difference exists in factual knowledge among students from PBL and traditional curricula, a controlled, randomized study has not been conducted to address this issue. The Medical Faculty of the University of Cologne is in the process of integrating elements of PBL into its curriculum. In the spring term of 1997, after seven semesters of experience with PBL supplementing the traditional course of basic pharmacology, we did for the first time use PBL instead of the lecture-based course (LBL) and conducted a controlled prospective study to determine the effects of this intervention. One-hundred and twenty-three students were randomly assigned to either PBL (n = 63), with tutorial groups of up to nine students, or to the traditional, lecture-based course (n = 60). Analysis of the results of both groups in the examination of basic pharmacology, consisting of multiple-choice and short-essay questions, revealed similar scores with a tendency favouring PBL students in the category of short-essay questions. Hence, it seems clear that PBL does not imply a disadvantage in terms of factual knowledge. Students considered PBL to be an effective learning method and favoured it over the lecture format. Furthermore, students reported positive effects of PBL in terms of use of additional learning resources, interdisciplinarity, team work and learning fun.     

Evaluation of an integrated curriculum using problem-based learning in a clinical environment: the Manchester experience

DESCRIPTION OF COURSE: In 1994, a new problem-based leaning (PBL) curriculum for year 1 medical students was introduced at the University of Manchester. The use of PBL has continued into the clinical clerkships. Year 3 of the curriculum is based entirely in a clinical environment with PBL groups meeting in three teaching hospitals. During this year, all students undertake two integrated 14-week modules with overarching themes. Each week, groups of eight students discuss a trigger problem connected to the relevant theme. The steps the groups use in the PBL process have been amended to encourage students to link their discussion with clinical experience. EVALUATION: At the end of each module, all 309 students were requested to complete an evaluation questionnaire. The response rates were 80% (n=247) and 89% (n=275) for the two core modules. RESULTS: The students have remained 'happy with the way the course is going' (83% at the end of module 2). They were also asked to rate a number of statements on a 5-point Likert scale (5=strongly agree). Concerning PBL, the students remained confident about working in a group (median 4), producing a set of learning objectives (median 4) and linking clinical experience with other knowledge (median 4). However, there were changes over the year. Fewer students agreed at the end of module 2 that 'the working problems were stimulating' (P=0.002) or 'motivated them to learn' (P < 0.001), but the clinical firms were seen as providing more appropriate experience (P=0.01) and being aware of the new curriculum and responding to it (P=0.018). We also surveyed the PBL tutors and had 65 returns from 78 people involved in the 38 PBL groups in year 3. The great majority of these are doctors employed by the National Health service. Virtually all the responders were happy to continue being a tutor (97%) and would recommend it to a colleague (93%). CONCLUSIONS: The evaluation has been positive with PBL having been successfully implemented in a clinical environment. We have identified significant changes over the year, which we need to address as we consolidate the curriculum.     

A lesson from the introduction of a problem-based, graduate entry course: the effects of different views of self-direction

OBJECTIVES: Difficulties in the early years of a new curriculum are to be expected as staff and students come to terms with new structures, and with different approaches to teaching and learning. During the first year of implementation of the Graduate Medical Course at the Graduate School of Medicine, The University of Queensland, we experienced our share of 'teething troubles'. One source of difficulty was different interpretations of the concept of 'self-directed learning' as it was to be applied in the new course. This paper presents an analysis of the effects of these differences on the development of the curriculum. DESIGN: An orientation programme was designed to introduce students to staff, facilities and the PBL process. SETTING: The University of Queensland. SUBJECTS: Problem-based learning (PBL) tutors, medical students. RESULTS: The overall effect was to place in jeopardy the achievement of student self-direction and commitment to lifelong learning as a goal of the course. To counter the undesirable effects of different interpretations, we have developed a conceptual framework to promote an agreed understanding of the meaning of self-direction, and to guide review and further development of the curriculum. A further paper describes the framework. CONCLUSIONS: Consistency in interpretation of key concepts is an important factor in the success of problem-based curricula.     

Early effects of a new problem-based clinically oriented curriculum on students' perceptions of teaching

OBJECTIVES: To compare the course experiences of medical students in a new problem-based (PBL) undergraduate medical course with those of their peers in a conventional curriculum. DESIGN: Whole class questionnaire survey using a pre-validated research instrument. SETTING: University of Liverpool, UK. SUBJECTS: First and second year medical students RESULTS: New curriculum students were more satisfied with their course when compared to their conventional course peers. Problem solving, team working and motivation scores were significantly higher amongst new course (PBL) students. New course students were more anxious about clarity of objectives and standard of work required. CONCLUSIONS: Early evidence suggests that curriculum reform from conventional teaching to a small group problem analysis programme results in improvement in student satisfaction with teaching and the development of appropriate learning skills.     

Using real patients in problem-based learning: students' comments on the value of using real, as opposed to paper cases, in a problem-based learning module in general practice

OBJECTIVES: To explore the feasibility and value of using real patients as trigger material in problem-based learning (PBL). DESIGN: A questionnaire was given to all students participating in a PBL module including a question about 'the added value of using real, as opposed to paper cases', in problem-based learning. Resources used by students and assessment of feasibility were recorded by the course tutors. SETTING: A 7-week student-selected problem-based module in general practice in the fourth-year undergraduate medical curriculum, University of Newcastle upon Tyne. SUBJECTS: 69 students participating in the module over 2 years. RESULTS: All students valued the use of real patients. A total of 10 categories were identified, all congruent with accepted educational principles for effective adult learning. Real patients stimulated the use of a very wide range of resources and imaginative presentation of what had been learned. CONCLUSION: Real patients are potent trigger stimuli in problem-based learning. The use of real patients in this general practice-based module presented no organizational or ethical difficulties. Their use should be considered more widely.     

Task-based learning: the answer to integration and problem-based learning in the clinical years

INTRODUCTION: Integrated teaching and problem-based learning (PBL) are powerful educational strategies. Difficulties arise, however, in their application in the later years of the undergraduate medical curriculum, particularly in clinical attachments. Two solutions have been proposed - the use of integrated clinical teaching teams and time allocated during the week for PBL separate from the clinical work. Both approaches have significant disadvantages. Task-based learning (TBL) is a preferred strategy. In TBL, a range of tasks undertaken by a doctor are identified, e.g. management of a patient with abdominal pain, and these are used as the focus for learning. Students have responsibility for integrating their learning round the tasks as they move through a range of clinical attachments in different disciplines. They are assisted in this process by study guides. METHOD: The implementation of TBL is described in one medical school. One hundred and thirteen tasks, arranged in 16 groups, serve to integrate the student learning as they rotate through 10 clinical attachments. RESULTS: This trans-disciplinary approach to integration, which incorporates the principles of PBL offers advantages to both teachers and students. It recognizes that clinical attachments in individual disciplines can offer rich learning opportunities and that such attachments can play a role in an integrated, as well as in a traditional, curriculum. In TBL, the contributions of the clinical attachments to the curriculum learning outcomes must be clearly defined and tasks selected which will serve as a focus for the integration of the students' learning over the range of attachments.     

Non-cognitive characteristics of medical students: entry to problem-based and lecture-based curricula

The effectiveness of problem-based learning (PBL) versus lecture-based learning (LBL) continues to be debated all over the world. These arguments have often been based on students' cognitive measures of performance. Little emphasis has been placed on non-cognitive factors that may directly or indirectly affect the medical school performance of students in either curriculum. The purpose of this study was to (1) document possible differences in student cognitive and non-cognitive characteristics at entry between the two curricula and (2) to explore the relationships that exist between cognitive and noncognitive factors. Data were obtained from three medical school classes (   n = 281  ). The results indicate that students who entered the PBL curriculum at this medical school had higher total Medical College Admission Test and undergraduate grade point average than students who entered the LBL curriculum. Students who entered the PBL curriculum were also more self-sufficient and were more likely to do well in individualistic and less structured settings. There were no strong correlations between cognitive and non-cognitive variables. Before conclusions can be drawn about the effectiveness of either PBL or LBL curricula, we need to document patterns in entry characteristics to control for a priori differences that affect student performance.     

医学研究生PBL教学效果评价及影响因素分析

目的:评价医学研究生PBL课程的教学效果及其主要影响因素,为推进研究生教学改革提供依据。方法:设计信度、效度较好的PBL教学质量评价问卷,选取某医科大学参与PBL课程的研究生开展问卷调查。结果:PBL在医学研究生中应用有较好的教学效果。多因素分析结果表明,学生课前资料准备情况、学生所修课程与专业的相关程度、课程类型、学生同一学期选课门数、教师是否担任研究生导师、学生课堂讨论参与度、学生对PBL模式的认知程度以及学生有既往是否有工作经历是影响PBL课程教学质量的主要因素。结论:PBL模式在医学研究生中的教学效果可通过完善教学管理、合理组建教学团队、加强研究生自主学习意识培养等环节进一步改善。     

The role of basic sciences in a problem-based learning clinical curriculum

BACKGROUND: Very little is known about the use of problem-based learning (PBL) during the later years of the undergraduate medical course and how it influences further acquisition of basic science knowledge. Similarly to many other Faculties, the PBL approach is used at Manchester in years 1 and 2, but more unusually, the curriculum continues to be centred on PBL in the clinical modules. OBJECTIVES: To explore whether and how basic science learning was continued in year 3 of the PBL clinical curriculum. METHODS: 10 of the weekly problems from the two core modules in year 3 were analysed to determine: (a) whether the design teams were using basic science objectives in devising the problems, and (b) whether PBL student groups were setting basic science learning objectives. The basic science knowledge of year 3 and 4 students was also measured. RESULTS: Similar numbers of objectives were being set by the management groups for each weekly problem (Heart, lung and blood (HLB) module, median 15, range 11-20; Nutrition, metabolism and excretion (NME) module, median 13, range 9-21). In the basic sciences, there was a median of 3 objectives per problem (range 0-6) in the NME module, but only 1 objective (0-2) per problem in the HLB module. The objectives set by six PBL groups in each module were analysed. Overall, agreement was reached on 130 occasions (62%) between the design team basic science objectives and those set for themselves by the student groups. In addition, there was a median of 2 (range 1-8) new basic science objectives brought out by the PBL groups that were not listed by the HLB module design team. In the NME module, there was again a median of 2 new objectives (range 0-6). The performance of year 3 and year 4 students in the multiple-choice questions progress test was analysed. For the 65 basic science questions, the year 3 mark was 40.8 +/- 12.3% compared with 57.1 +/- 12.3% for year 4 (P < 0.0001). CONCLUSIONS: (a) The design teams are setting basic science objectives; (b) the working problems are triggering students to set learning objectives in the basic sciences; (c) most of the objectives being set by the design teams are being triggered in the majority of group sessions; (d) the students knowledge of basic sciences increases in years 3-4.     

Basic sciences in problem-based learning and conventional curricula: students' attitudes

The purpose of this study was to compare the attitudes toward basic sciences of students in a preclinical problem-based curriculum and a conventional lecture-based curriculum at the end of their second year of medical school. The results showed that the PBL class had more positive attitudes toward basic sciences than students in the conventional class. These results may reflect a learning environment where students meet many scientist role models as teachers and where basic science is learnt in the context of clinical problems.     

Teaching professionalism in the early years of a medical curriculum: a qualitative study

CONTEXT: Despite the growing literature on professionalism in undergraduate medical curricula, few studies have examined its delivery. OBJECTIVES: This study investigated tutors' and students' perspectives of the delivery of professionalism in the early years of Glasgow's learner-centred, problem-based learning (PBL), integrated medical curriculum. METHODS: A qualitative approach was adopted involving semistructured interviews, on a 1 in 6 sample of tutors involved in teaching in the early curricular years, and 3 student focus groups. The findings were subjected to between-method triangulation. RESULTS: Involvement in teaching raised students' and tutors' awareness of their professionalism. Learning activities promoting critical reflection were most effective. The integration of professionalism across the domains of Vocational Studies (VS) was important for learning; however, it was not well integrated with the PBL core. Integration was promoted by having the same tutor present throughout all VS sessions. Early patient contact experiences were found to be particularly important. The hidden curriculum provided both opportunities for, and threats to, learning. The small-group format provided a suitable environment for the examination of pre-existing perspectives. The portfolio was an effective learning tool, although its assessment should be formalised. CONCLUSIONS: Reflection is integral to professional development. Early clinical contact is an important part of the process of socialisation, as it allows students to enter the community of practice that is the medical profession. Role models can contribute powerfully to students' learning and identity formation. As students move towards fuller participation, the clinical milieu should be controlled to maximise the influence of role models, and opportunities for guided reflection should be sustained.     

A comparison of learning outcomes and attitudes in student- versus faculty-led problem-based learning: an experimental study

OBJECTIVES: To compare learning outcomes and perceptions of facilitator behaviours and small-group process in problem-based learning (PBL) groups led by students and those led by faculty. DESIGN: A prospective, Latin-square cross-over design was employed. Second-year medical students participated in 11 PBL cases over the course of the academic year. For each case, half the student groups were led by faculty and the other half by a student group member selected randomly to serve in the facilitator role. Learning outcomes were assessed by performance on objective examinations covering factual materials pertinent to the case. Perceptions of facilitator behaviours and of group functioning were assessed with a questionnaire completed at the end of each individual case. Focus-group discussions were held to gain more in-depth information about student perceptions and experience. Student-led sessions were observed at random by the investigators. SETTING: A state-supported, US medical school with a hybrid lecture-based and problem-based curriculum. SUBJECTS: One hundred and twenty-seven second-year medical students and 30 basic science and clinical faculty. RESULTS: No differences were detected in student performance on the objective evaluation based on whether the facilitator was a faculty member or peer group member, nor were there any differences in the perceptions of group process. Students gave peer facilitators slightly higher ratings in the second semester of the experiment. In the focus-group discussions, students voiced a general preference for student-led groups because they felt they were more efficient. Observation and focus-group reports suggest that groups led by students sometimes took short cuts in the PBL process. CONCLUSION: In a hybrid lecture- and PBL-based curriculum, student performance on objective examinations covering PBL materials is unaffected by the status of the facilitator (student vs. faculty). However, in peer-facilitated groups, students sometimes took short cuts in the PBL process that may undermine some of the intended goals of PBL.     

Tutoring in problem-based learning: a teacher development process

Summary: Summary . Undergraduate medical curricula have become increasingly innovative in order to better prepare their graduates to enter practice, with the most notable innovation being the introduction of problem-based learning (PBL). This paper describes Dalhousie University's transition to PBL, from a teacher development perspective.
The paper reinforces the need for a well-designed teacher development process that is carefully implemented and evaluated in order to ensure a successful curriculum change. A seven-stage process for teacher development of tutors at Dalhousie is described, and programme evaluation data are reported from both students' and teachers' points of view. The results from the evaluation are very positive and suggest ways of improving the teacher development process. These improvements are described, as well as future plans in this area.     

Promoting professional knowledge, experiential learning and critical thinking for medical students

It has been recognized internationally that undergraduate medical education must adapt to changing needs, as illustrated by the Tomorrow's Doctors recommendations from the General Medical Council. This paper aims to relate contemporary educational theory to under-graduate medical educational requirements, specifically highlighting conditions (e.g. experiential learning) for: professional knowledge acquisition; critical thinking, problem-solving and clinical problem-solving; and lifelong professional learning. Furthermore, problem-based learning (PBL) is highlighted as potentially providing such conditions. There are lessons from contemporary educational theory for the reform of undergraduate medical education. These include valuing prior knowledge and experience; promoting learner responsibility through facilitating rather than directing learning; encouraging learners to test out and apply new knowledge, and using small-group work to foster explicitly the elusive skills of critical thinking and reflection. Contemporary educational theory contributes valuable insights, but cannot dictate the ultimate 'mix'; at best it provides some principles for reflective analysis of the learning experiences created for tomorrow's doctors.     

Problem-based learning: measurable outcomes

Problem-based learning (PBL) could potentially contribute to four key objectives in the education of doctors. (1) Motivating learning. Three studies show that students studying PBL problems choose fewer topics to study than those identified by the faculty, but one study of a critical care rotation showed that students were motivated to learn over a wider range of basic science topics than had been included in the basic science curriculum. (2) Developing clinical reasoning. One study compared methods of solving problems in PBL and conventional track curricula and suggested that PBL students work backwards from clinical information to theory, while conventional curriculum students tend to reason forward from theory. One study showed that computer searches provide knowledge for helping solve some PBL problems, and another study showed that specific knowledge in emergency medicine correlated with test scores. (3) Structuring knowledge in clinical contexts. A few studies show that PBL students perform less well on basic science examinations but better on clinical examinations. Educational outcomes, however, have been assessed quantitatively mainly by the U.S. National Boards of Medical Examiners Examinations or by clinical examinations with small samples. Only one study includes a power computation to assess type II error. There are no studies that examine how much variance occurs between PBL programmes in their curricular methods and outcomes. (4) Developing self-learning skills. PBL students use a much wider range and number of resources than conventional track students. There is only one study comparing the knowledge of doctors trained by PBL and conventional curricula after the doctors have been in practice for a substantial number of years, and no studies of patient outcomes. Patient outcomes need to be assessed with randomized controlled trials, and sample sizes should be determined by power computations to avoid Type II error. Four possible methods of improving PBL would be to derive national and internationally accepted PBL curricula; to organize internationally accepted and psychometrically validated methods of evaluation; to develop attitudes among students and tutors to facilitate co-operative PBL teamwork; and to teach group process diagnostic skills.     

From traditional to problem-based learning: a case report of complete curriculum reform

The Sherbrooke School of Medicine, Quebec, has restructured its entire curriculum to make problem-based learning (PBL) the main instructional format. This complete reform is explained both in terms of process and content. The curriculum problems were clearly identified and overcome by a major structural shift-over following the stages of a strategic planning of change. Implementation over a period of 7 years is described according to a four-stage framework: need for change; selection of the PBL solution; planning for implementation; and the full-scale adoption of the PBL method. The programme is described in relation to the congruence of goals, learning and evaluation activities. Initial impact on student learning and evaluation, attracting better quality students, academic staff roles, and on financing the operation are discussed. Changing the undergraduate programme has become an institutional project directed by the Office of the Dean.     

Medical faculty as humanistic physicians and teachers: the perceptions of students at innovative and traditional medical schools

BACKGROUND AND OBJECTIVES: The training of caring physicians represents an important goal of medical education. Little is known however, on whether medical faculty constitute good role models for teaching humanistic skills to medical students. In this study, we examined to what extent medical students at innovative and traditional schools perceived their teachers as humanistic physicians and teachers. We also explored whether pre-clinical and clinical students shared the same perceptions. METHODS: A mail survey was conducted in Canada of all second-year students and senior clerks at one innovative medical school (problem-based learning (PBL), patient-centred, community-oriented) and three traditional medical schools. Students were asked to what extent they agreed or disagreed that the majority of their teachers behaved as humanistic physicians and teachers; 10 statements were used. Overall, 65% of the 1039 students returned the questionnaire. RESULTS: Over 25% of second-year students and 40% of senior clerks did not agree that their teachers behaved as humanistic caregivers with patients or were good role models in teaching the doctor-patient relationship. More than half of second-year students and senior clerks did not agree that their teachers valued human contact with them or were supportive of students who had difficulties. There were few differences in the way medical students at innovative and traditional schools perceived their teachers' humanistic qualities. At the pre-clinical level however, there were more students from the innovative school than from the traditional schools (around 60% vs. 40%, P < 0.005) who agreed that their teachers valued human contact with them and were supportive of students. CONCLUSION: Our results indicate that the PBL curriculum fosters better teacher-student relationships during the pre-clinical years. They also suggest that an unacceptably large number of medical students are taught by physicians who seem to lack compassion and caring in their interactions with patients. This study questions the adequacy of medical faculty as role models for the acquisition of caring competence by medical students.     

Student feedback in problem based learning: a survey of 103 final year students across five Ontario medical schools

CONTEXT: Problem based learning (PBL) has become an integral component of medical curricula around the world. In Ontario, Canada, PBL has been implemented in all five Ontario medical schools for several years. Although proper and timely feedback is an essential component of medical education, the types of feedback that students receive in PBL have not been systematically investigated. OBJECTIVES: In the first multischool study of PBL in Canada, we sought to determine the types of feedback (grades, written comments, group feedback from tutor, individual feedback from tutor, peer feedback, self-assessment, no feedback) that students receive as well as their satisfaction with these different feedback modalities. SUBJECTS AND METHODS: We surveyed a sample of 103 final year medical students at the five Ontario schools (University of Toronto, McMaster University, Queens University, University of Ottawa and University of Western Ontario). Subjects were recruited via E-mail and were asked to fill out a questionnaire. RESULTS: Many students felt that the most helpful type of feedback in PBL was individual feedback from the tutor, and indeed, individual feedback was one of the more common types of feedback provided. However, although students also indicated a strong preference for peer and group feedback, these forms of feedback were not widely reported. There were significant differences between schools in the use of grades, written comments, self-assessment and peer feedback, as well as the immediacy of the feedback given. CONCLUSIONS: Across Ontario, students do receive frequent feedback in PBL. However, significant differences exist in the types of feedback students receive, as well as the timing. Although rated highly by students at all schools, the use of peer feedback and self-assessment is limited at most, but not all, medical schools.     

Health promotion and disease prevention: integration into a medical school curriculum

Summary: Many authorities have identified deficiencies in the education of medical students in health promotion and disease prevention. This report describes an attempt to address this problem through the longitudinal integration of health promotion and disease prevention into several major courses in the student curriculum at Harvard Medical School. We used adult learning theory to develop the curricular approach, and designed educational experiences to match the professional development of the student at different phases of medical education. Primary, secondary, and tertiary prevention were particularly germane for students in the first, second, and third years, respectively. During clerkships in the third and fourth years, especially those with a focus on ambulatory patients, students built upon earlier experiences to integrate health promotion and disease prevention into clinical practice. By unifying the teaching of disease prevention with several major required courses, we aimed to create an environment in which students could experience their learning about disease prevention in the same manner that we aspired to have them practise it: integrated throughout clinical medicine.