The effectiveness of problem-based learning compared to traditional teaching in undergraduate psychiatry

OBJECTIVES: A change from traditional to problem-based learning (PBL) methods in a psychiatry attachment was evaluated by comparing the learning styles, attitudes to psychiatry and examination performance of 2 cohorts of students. It was hypothesised that the PBL curriculum would result in increased deep learning, decreased surface learning, more favourable attitudes to psychiatry and improved examination performance. It was predicted that students' examination success would be related to the use of deep and strategic learning and favourable attitudes. METHODS: Consecutive cohorts of Year 2 clinical students taught using a traditional psychiatry curriculum (n = 188) and a PBL curriculum (n = 191) were compared. Students completed the Study Process Questionnaire to assess their learning styles and the Attitudes to Psychiatry Scale at the beginning and end of the attachment. Students completed 2 end-of-attachment examinations, a multiple-choice paper and a viva. RESULTS: The PBL curriculum resulted in significantly better examination performance than did the traditional teaching curriculum, both for multiple-choice questions and the viva. No differences in learning styles or attitudes to psychiatry were found between the curricula. Students were significantly more successful in the examinations if they had received the PBL curriculum, were female, and used strategic learning. CONCLUSIONS: Examination performance indicated that the PBL curriculum was more successful than the previous course, but that this improvement was not due to students using more effective learning styles or having more favourable attitudes towards psychiatry. It is possible that students learned more effectively during the teaching sessions in the PBL curriculum, but did not change their preferred learning styles.     

Assessment of student performance in problem-based learning tutorial sessions

OBJECTIVES: To assess student performance during tutorial sessions in problem-based learning (PBL). DESIGN: A 24-item rating scale was developed to assess student performance during tutorial sessions in problem-based learning (PBL) as conducted during the pre-clinical years of Medical School at the National Autonomous University of Mexico. Items were divided into three categories: Independent study, Group interaction and Reasoning skills. Fourteen tutors assessed 152 first and second-year students in 16 tutorial groups. An exploratory factor analysis with an Oblimin rotation was carried out to identify the underlying dimensions of the questionnaire. SETTING: Medical School at the National Autonomous University of Mexico. SUBJECTS: Medical students. RESULTS: Factor analysis yielded four factors (Independent study, Group interaction, Reasoning skills, and Active participation) which together accounted for 76.6% of the variance. Their Cronbach reliability coefficients were 0.95, 0.83, 0.94 and 0. 93, respectively, and 0.96 for the scale as a whole. CONCLUSIONS: It was concluded that the questionnaire provides a reliable identification of the fundamental components of the PBL method as observable in tutorial groups and could be a useful assessment instrument for tutors wishing to monitor students' progress in each of these components.     

Effectiveness of basic clinical skills training programmes: a cross-sectional comparison of four medical schools

OBJECTIVE: Training in physical diagnostic skills is an important part of undergraduate medical education. The objective of this study was to study the outcome of skills training at four medical schools. CONTEXT: At the time of the study, three schools had a traditional lecture-based curriculum and one school had a problem-based learning curriculum with a longitudinal skills training programme. All schools offer extended exposure to clerkships. METHOD: A cross-sectional study in four medical schools was performed, using a written test of skills that has good correlation with actual student performance. The scores attained from four student groups were compared within and between the four medical schools. A total of 859 volunteer students from the later four years at each medical school participated in the study. RESULTS: The mean scores in the traditional medical schools increased with the start of skill training and the hands-on experience offered during the clerkships. Students from the school with the longitudinal skills training programme and the problem-based learning approach had significantly higher mean scores at the start of the clerkships, and maintained their lead in the subsequent clinical years. CONCLUSIONS: Longitudinal skills training seems to offer the students a superior preparation for clerkships as well as influencing the students' learning abilities during the clerkships. The effect of the problem-based learning approach, also related to the innovative philosophy of the curriculum, could not be accounted for.     

Facility with the English language and problem-based learning group interaction: findings from an Arabic setting

The Faculty of Medicine and Health Sciences (FMHS), United Arab Emirates (UAE) University is in a unique position to explore issues related to English language proficiency and medical student performance. All students entering the FMHS have English as a second language. This study focused on the issues of students' proficiency in English as measured by the TOEFL test, student background factors and interaction in problem-based learning (PBL) groups. Using a modification of Bales Interaction Process Analysis, four problem-based learning groups were observed over four thematic units, to measure the degree of student interaction within PBL groups and to compare this to individual TOEFL scores and key background variables. The students' contributions correlated highly with TOEFL test results in the giving of information (range r = 0.67-0.74). The female students adhered to interacting in English during group sessions, whereas the male students were more likely to revert to using Arabic in elaborating unclear phenomena (p < 0.01). The educational level of the student's mother was highly predictive of TOEFL scores for the male students, but not for female students. Multivariate analysis was undertaken to analyse the relative contribution of the TOEFL, parental education and years of studying in English. The best predictor of students' contributions in PBL groups was identified as TOEFL scores. The study demonstrates the importance of facilitating a locally acceptable level of English proficiency prior to admission to the FMHS. However, it also highlights the importance of not focusing only on English proficiency but paying attention to additional factors in facilitating medical students in maximizing benefits from interactions in PBL settings.     

An experiment in problem-based learning

Summary: Problem-solving skills are important for medical students and problem-based learning (PBL) is especially suited to general practice. Therefore an experiment using a form of PBL was introduced into a new 4-week course in general practice for final rotation students at the University of Glasgow in the session 1992–93. The experiment aimed to introduce students to an alternative method of learning to the traditional one previously used by them in their course, to encourage teamwork and to encourage the use of alternative methods of obtaining information. The method, centred around allowing the students to investigate problems they choose themselves, is described. The evaluation of the course by written standard form, free written comments and audiotape recorded interviews with a one in four sample of the class is presented.
Summary: The students selected many interesting problems and used many different and unusual sources of information in researching them. This method of learning was compared with the parallel lecture course and was thought by the students to be more interesting but less relevant than the lecture course.
Summary: The experiment showed that it is possible to introduce a problem-based form of learning into a new course in parallel with more traditional methods of teaching and for it to be at least partially successful for students much more used to a traditional didactic curriculum. Ways of improving the course in the future to make it more sensitive to the students' learning needs are discussed.     

Problem-based learning improves the academic performance of medical students in South Africa

OBJECTIVES: To compare the academic performance of students on the previous, classical, discipline- and lecture-based, traditional curriculum with that of subsequent students who followed an innovative, problem- and community-based curriculum. METHODS: This was a retrospective study that analysed the records of students who enrolled on the doctor training programme between 1985 and 1995, and the records of students who graduated from the programme between 1989 and 2002. OUTCOMES: The educational outcomes assessed were the attrition and graduation rates on the traditional curriculum and those on the innovative curriculum. RESULTS: A total of 149 students on the traditional curriculum and 145 students on the innovative curriculum were studied. Overall, 23% of the traditional cohort as opposed to 10.3% of the innovative cohort dropped out of the course (P = 0.0041) and 55% of the traditional cohort as opposed to 67% of the innovative cohort graduated within the minimum period of 6 years (P < 0.001). The mean throughput period was 6.71 (0.09) years in the traditional cohort and 6.44 (0.07) years in the innovative cohort (P = 0.014) CONCLUSION: The introduction of the problem-based learning/community-based education (PBL/CBE) curriculum coincided with improved academic performance. The PBL/CBE approach to medical education may have contributed to this improvement.     

Influence of curriculum type on student performance in the United States Medical Licensing Examination Step 1 and Step 2 exams: problem-based learning vs. lecture-based curriculum

INTRODUCTION: The results of the United States Medical Licensing Examination Step 1 and 2 examinations are reported for students enrolled in a problem-based and traditional lecture-based curricula over a seven-year period at a single institution. There were no statistically significant differences in mean scores on either examination over the seven year period as a whole. There were statistically significant main effects noted by cohort year and curricular track for both the Step 1 and 2 examinations. These results support the general, long-term effectiveness of problem-based learning with respect to basic and clinical science knowledge acquisition. CONTEXT: This paper reports the United States Medical Licensing Examination Step 1 and Step 2 results for students enrolled in a problem-based and traditional lecture-based learning curricula over the seven-year period (1992-98) in order to evaluate the adequacy of each curriculum in supporting students learning of the basic and clinical sciences. METHODS: Six hundred and eighty-nine students who took the United States Medical Licensing Examination Step 1 and 540 students who took Step 2 for the first time over the seven-year period were included in the analyses. T-test analyses were utilized to compare students' Step 1 and Step 2 performance by curriculum groups. RESULTS: United States Medical Licensing Examination Step 1 scores over the seven-year period were 214 for Traditional Curriculum students and 208 for Parallel Curriculum students (t-value = 1.32, P=0.21). Mean Step 2 scores over the seven-year period were 208 for Traditional Curriculum students and 206 for Parallel Curriculum students (t-value=1.08, P=0.30). Statistically significant main effects were noted by cohort year and curricular track for both the Step 1 and Step 2 examinations. CONCLUSION: The totality of experience in both groups, although differing by curricular type, may be similar enough that the comparable scores are what should be expected. These results should be reassuring to curricular planners and faculty that problem-based learning can provide students with the knowledge needed for the subsequent phases of their medical education.     

The role of basic sciences in a problem-based learning clinical curriculum

BACKGROUND: Very little is known about the use of problem-based learning (PBL) during the later years of the undergraduate medical course and how it influences further acquisition of basic science knowledge. Similarly to many other Faculties, the PBL approach is used at Manchester in years 1 and 2, but more unusually, the curriculum continues to be centred on PBL in the clinical modules. OBJECTIVES: To explore whether and how basic science learning was continued in year 3 of the PBL clinical curriculum. METHODS: 10 of the weekly problems from the two core modules in year 3 were analysed to determine: (a) whether the design teams were using basic science objectives in devising the problems, and (b) whether PBL student groups were setting basic science learning objectives. The basic science knowledge of year 3 and 4 students was also measured. RESULTS: Similar numbers of objectives were being set by the management groups for each weekly problem (Heart, lung and blood (HLB) module, median 15, range 11-20; Nutrition, metabolism and excretion (NME) module, median 13, range 9-21). In the basic sciences, there was a median of 3 objectives per problem (range 0-6) in the NME module, but only 1 objective (0-2) per problem in the HLB module. The objectives set by six PBL groups in each module were analysed. Overall, agreement was reached on 130 occasions (62%) between the design team basic science objectives and those set for themselves by the student groups. In addition, there was a median of 2 (range 1-8) new basic science objectives brought out by the PBL groups that were not listed by the HLB module design team. In the NME module, there was again a median of 2 new objectives (range 0-6). The performance of year 3 and year 4 students in the multiple-choice questions progress test was analysed. For the 65 basic science questions, the year 3 mark was 40.8 +/- 12.3% compared with 57.1 +/- 12.3% for year 4 (P < 0.0001). CONCLUSIONS: (a) The design teams are setting basic science objectives; (b) the working problems are triggering students to set learning objectives in the basic sciences; (c) most of the objectives being set by the design teams are being triggered in the majority of group sessions; (d) the students knowledge of basic sciences increases in years 3-4.     

Early effects of a new problem-based clinically oriented curriculum on students' perceptions of teaching

OBJECTIVES: To compare the course experiences of medical students in a new problem-based (PBL) undergraduate medical course with those of their peers in a conventional curriculum. DESIGN: Whole class questionnaire survey using a pre-validated research instrument. SETTING: University of Liverpool, UK. SUBJECTS: First and second year medical students RESULTS: New curriculum students were more satisfied with their course when compared to their conventional course peers. Problem solving, team working and motivation scores were significantly higher amongst new course (PBL) students. New course students were more anxious about clarity of objectives and standard of work required. CONCLUSIONS: Early evidence suggests that curriculum reform from conventional teaching to a small group problem analysis programme results in improvement in student satisfaction with teaching and the development of appropriate learning skills.     

A comparison of learning outcomes and attitudes in student- versus faculty-led problem-based learning: an experimental study

OBJECTIVES: To compare learning outcomes and perceptions of facilitator behaviours and small-group process in problem-based learning (PBL) groups led by students and those led by faculty. DESIGN: A prospective, Latin-square cross-over design was employed. Second-year medical students participated in 11 PBL cases over the course of the academic year. For each case, half the student groups were led by faculty and the other half by a student group member selected randomly to serve in the facilitator role. Learning outcomes were assessed by performance on objective examinations covering factual materials pertinent to the case. Perceptions of facilitator behaviours and of group functioning were assessed with a questionnaire completed at the end of each individual case. Focus-group discussions were held to gain more in-depth information about student perceptions and experience. Student-led sessions were observed at random by the investigators. SETTING: A state-supported, US medical school with a hybrid lecture-based and problem-based curriculum. SUBJECTS: One hundred and twenty-seven second-year medical students and 30 basic science and clinical faculty. RESULTS: No differences were detected in student performance on the objective evaluation based on whether the facilitator was a faculty member or peer group member, nor were there any differences in the perceptions of group process. Students gave peer facilitators slightly higher ratings in the second semester of the experiment. In the focus-group discussions, students voiced a general preference for student-led groups because they felt they were more efficient. Observation and focus-group reports suggest that groups led by students sometimes took short cuts in the PBL process. CONCLUSION: In a hybrid lecture- and PBL-based curriculum, student performance on objective examinations covering PBL materials is unaffected by the status of the facilitator (student vs. faculty). However, in peer-facilitated groups, students sometimes took short cuts in the PBL process that may undermine some of the intended goals of PBL.     

The use of student journals in problem-based learning

This paper describes several examples of the use of journals in a Bachelor of Dental Surgery course. The examples cover: the use of journals in first year subjects and in later-year clinical subjects; the effect of changes in policy and practise as a result of experience with journals; and student views on their experiences with journals. The use of journals offers a means of achieving some of the more important goals of problem-based learning (PBL), particularly those requiring students to reflect upon and evaluate their experiences. When effectively integrated in a PBL course, journals have several functions: to formalize reflection; an outlet for personal feeling; an opportunity for feedback about a student's progress and about the course; to provide the student with a summary of the year's work; and a means whereby students and teachers gain insight into the learning process. However, our experience in Dentistry raises several contentious issues, especially with regard to confidentiality and assessment. We make several recommendations for the effective use of journals based on the need for frequent communication between students and staff, the development of an environment of trust, and the need for staff and student education in journal use.     

Problem-based learning: why curricula are likely to show little effect on knowledge and clinical skills

OBJECTIVES: A recent review of problem-based learning's effect on knowledge and clinical skills updated findings reported in 1993. The author argues that effect sizes (ES) seen with PBL have not lived up to expectations (0.8-1.0) and the theoretical basis for PBL, contextual learning theory, is weak. The purposes of this study were to analyse what constitutes reasonable ES in terms of the impacts on individuals and published reports, and to elaborate upon various theories pertaining to PBL. DESIGN: Normal theory is used to demonstrate what various ESs would mean for individual change and a large meta-analysis of over 10 000 studies is referred to in identifying typical ESs. Additional theories bearing upon PBL are presented. RESULTS: Effect sizes of 0.8-1.0 would require some students to move from the bottom quartile to the top half of the class or more. The average ES reported in the literature was 0.50 and many commonly used and accepted medical procedures and therapies are based upon studies with ESs below 0.50. CONCLUSIONS: Effect sizes of 0.8-1.0 are an unreasonable expectation from PBL because, firstly, the degree of changes that would be required of individuals would be excessive, secondly, leading up to medical school, students are groomed and selected for success in a traditional curriculum, expecting them to do better in a PBL curriculum than a traditional curriculum is an unreasonable expectation, and, thirdly, the average study reported in the literature and many commonly used and accepted medical procedures and therapies are based upon studies having lesser ESs. Information-processing theory, Cooperative learning, Self-determination theory and Control theory are suggested as providing better theoretical support for PBL than Contextual learning theory. Even if knowledge acquisition and clinical skills are not improved by PBL, the enhanced work environment for students and faculty that has been consistently found with PBL is a worthwhile goal.     

Non-cognitive characteristics of medical students: entry to problem-based and lecture-based curricula

The effectiveness of problem-based learning (PBL) versus lecture-based learning (LBL) continues to be debated all over the world. These arguments have often been based on students' cognitive measures of performance. Little emphasis has been placed on non-cognitive factors that may directly or indirectly affect the medical school performance of students in either curriculum. The purpose of this study was to (1) document possible differences in student cognitive and non-cognitive characteristics at entry between the two curricula and (2) to explore the relationships that exist between cognitive and noncognitive factors. Data were obtained from three medical school classes (   n = 281  ). The results indicate that students who entered the PBL curriculum at this medical school had higher total Medical College Admission Test and undergraduate grade point average than students who entered the LBL curriculum. Students who entered the PBL curriculum were also more self-sufficient and were more likely to do well in individualistic and less structured settings. There were no strong correlations between cognitive and non-cognitive variables. Before conclusions can be drawn about the effectiveness of either PBL or LBL curricula, we need to document patterns in entry characteristics to control for a priori differences that affect student performance.     

Longterm effects of problem-based learning: a comparison of competencies acquired by graduates of a problem-based and a conventional medical school

BACKGROUND: Problem-based learning (PBL) as an approach to the instruction of medical students has attracted much attention in recent years. However, its effect on the performance of its graduates is the subject of considerable debate. This article presents data from a large-scale study among graduates of a problem-based medical school and those of a conventional medical school to contribute to this discussion. PURPOSE: To study the longterm effects of problem-based medical training on the professional competencies of graduates. METHODS: A questionnaire was sent to all graduates since 1980 of a problem-based and a conventional medical school. Participants were requested to rate themselves on 18 professional competencies derived from the literature. RESULTS: The graduates of the PBL school scored higher on 14 of 18 professional competencies. Graduates of the problem-based school rated themselves as having much better interpersonal skills, better competencies in problem solving, self-directed learning and information gathering, and somewhat better task-supporting skills, such as the ability to work and plan efficiently. There were no sizeable differences with regard to general academic competencies, such as conducting research or writing a paper. Graduates from the conventional school rated themselves as having slightly more medical knowledge. The findings were shown to be valid and robust against possible response bias. CONCLUSION: The findings suggest that PBL not only affects the typical PBL-related competencies in the interpersonal and cognitive domains, but also the more general work-related skills that are deemed important for success in professional practice.     

Problem-based learning versus lecture-based learning in a course of basic pharmacology: a controlled, randomized study

Since its first implementation in a medical programme at McMaster University, Canada, problem-based learning (PBL) has become a well-established means of teaching and learning medicine. Extensive research has been conducted and a number of strengths of the method are well supported. Several items, however, remain unclear although there is evidence that no relevant difference exists in factual knowledge among students from PBL and traditional curricula, a controlled, randomized study has not been conducted to address this issue. The Medical Faculty of the University of Cologne is in the process of integrating elements of PBL into its curriculum. In the spring term of 1997, after seven semesters of experience with PBL supplementing the traditional course of basic pharmacology, we did for the first time use PBL instead of the lecture-based course (LBL) and conducted a controlled prospective study to determine the effects of this intervention. One-hundred and twenty-three students were randomly assigned to either PBL (n = 63), with tutorial groups of up to nine students, or to the traditional, lecture-based course (n = 60). Analysis of the results of both groups in the examination of basic pharmacology, consisting of multiple-choice and short-essay questions, revealed similar scores with a tendency favouring PBL students in the category of short-essay questions. Hence, it seems clear that PBL does not imply a disadvantage in terms of factual knowledge. Students considered PBL to be an effective learning method and favoured it over the lecture format. Furthermore, students reported positive effects of PBL in terms of use of additional learning resources, interdisciplinarity, team work and learning fun.     

A model of clinical problem-based learning for clinical attachments in medicine

Context  Problem-based learning (PBL) has been widely adopted in medical curricula for early-years training, but its use during clinical attachments has not been extensively explored.
Objectives  This study aimed to develop and evaluate a new model, 'clinical problem-based learning' (CPBL), to promote learning skills, attitudes and knowledge during clinical attachments.
Methods  The CPBL model takes the principles of PBL and applies them to learning during clinical attachments. Real patient encounters are guided by a list of broadly defined case types to ensure curriculum coverage. By discussing history taking and examination in the context of differential diagnosis and problem listing, students generate learning objectives relating to clinical skills, disease mechanisms and clinical management. These are explored through self-directed learning before the second tutorial, in which the tutor takes the role of 'expert', demonstrating how learned material translates into clinical practice. We evaluated which components contributed most to the success of the model using semi-structured questionnaires, focus groups and a consensus (Delphi process) method.
Results  Students found CPBL a positive learning experience. Identification of suitable cases for discussion was readily achieved, although follow-up was sometimes difficult. The tutor's level of expertise and a non-threatening learning environment, conducive to student questioning, were highly rated contributors to successful CPBL. Comments reinforced the view that CPBL is a parallel teaching approach that helps structure the teaching week, but does not replace traditional bedside teaching.
Conclusions  Clinical problem-based learning was well received in clinical placements. Key elements were the learning interval, the involvement of expert tutors and a non-threatening learning environment.     

The parallel rural community curriculum: an integrated clinical curriculum based in rural general practice

INTRODUCTION: In an attempt to address the rural medical workforce maldistribution and the concurrent inappropriate caseload at the urban tertiary teaching hospitals, Flinders University and the Riverland Division of General Practice decided to pilot, in 1997, an entire year of undergraduate clinical curriculum in Australian rural general practice. This program is called the Parallel Rural Community Curriculum (PRCC). This paper is a discussion of the aims of the programme; student selection; practice recruitment; curriculum structure, and academic content, together with lessons learnt from the evaluation of the first cohort of students' experience of the course. METHODS: Independent external evaluators undertook a thematic analysis of a series of structured interviews of students and faculty involved in both the PRCC and the traditional curriculum. The mean examination results were determined and a rank order comparison of student academic performance was undertaken. RESULTS: The eight selected volunteer students reported greater access to patients and clinical learning opportunities than their mainstream counterparts and learned clinical decision making in the context of the whole patient, their family, and the available community resources. They identified patients with 'core' clinical conditions and had a longitudinal exposure to common diseases, whereas hospital-based peers had a cross-sectional exposure to highly filtered illness. The PRCC students' academic performance improved in comparison with that of their tertiary hospital peers' and in comparison to their own results in previous years. CONCLUSION: The PRCC curriculum has cut across the traditional clinical discipline boundaries by teaching in an integrated way in rural general practice. It has affirmed the potential role of true generalist physicians in undergraduate medical education.     

Teaching professionalism in the early years of a medical curriculum: a qualitative study

CONTEXT: Despite the growing literature on professionalism in undergraduate medical curricula, few studies have examined its delivery. OBJECTIVES: This study investigated tutors' and students' perspectives of the delivery of professionalism in the early years of Glasgow's learner-centred, problem-based learning (PBL), integrated medical curriculum. METHODS: A qualitative approach was adopted involving semistructured interviews, on a 1 in 6 sample of tutors involved in teaching in the early curricular years, and 3 student focus groups. The findings were subjected to between-method triangulation. RESULTS: Involvement in teaching raised students' and tutors' awareness of their professionalism. Learning activities promoting critical reflection were most effective. The integration of professionalism across the domains of Vocational Studies (VS) was important for learning; however, it was not well integrated with the PBL core. Integration was promoted by having the same tutor present throughout all VS sessions. Early patient contact experiences were found to be particularly important. The hidden curriculum provided both opportunities for, and threats to, learning. The small-group format provided a suitable environment for the examination of pre-existing perspectives. The portfolio was an effective learning tool, although its assessment should be formalised. CONCLUSIONS: Reflection is integral to professional development. Early clinical contact is an important part of the process of socialisation, as it allows students to enter the community of practice that is the medical profession. Role models can contribute powerfully to students' learning and identity formation. As students move towards fuller participation, the clinical milieu should be controlled to maximise the influence of role models, and opportunities for guided reflection should be sustained.     

Skills development by medical students and the influence of prior experience: a study using evaluation by students and self-assessment

Research was carried out into the effectiveness of an innovative, problem-based introductory course which was designed to help medical students, within a traditional curriculum, to bridge the gap between theoretical study during the first 4 years and inservice training during the next 2 years. Comparison of exit and entry self-assessment ratings of students showed a marked rise for history-taking and physical examination and a smaller rise for diagnosis and patient management. Cross-study of these self-assessment ratings and the background variable of past medical training showed that prior active experience within the health care system appeared to have a favourable influence on both history-taking and more intellectual skills, notably diagnosis and patient management. History-taking, however, could be taught as effectively during the introductory course. This was not so for the more intellectual skills. The results of this research plead for early active experience within the health care system during the medical curriculum, in order to give the students more insight into the clinical relevance of their theoretical studies. Evaluation by the students of the teaching formats used to reach the learning objectives was favourable, especially of those formats related to concrete practical skills such as live simulated (programmed) patients. It was rather unfavourable to self-study facilities which provide more theoretical knowledge.