Implementation of problem-based learning in Asian medical schools and students' perceptions of their experience

BACKGROUND: Since the introduction of problem-based learning (PBL) at McMaster University in 1969, many medical schools in the USA, Canada and Europe have included PBL in their curricula. In the past decade, many medical schools in Asia have also done so. However, so far no one has questioned whether the outcomes expected of the learner in a PBL setting are applicable to students from different cultural upbringings. AIM: The aim of this study was to investigate the implementation of PBL in Asian medical schools, their students' perceptions of this new mode of teaching/learning and how the problems that have arisen may be overcome. METHOD: Published reports and conference presentations were gathered on the implementation of PBL in some Asian medical schools and comparisons of the experiences in PBL of Asian and students of other ethnic backgrounds. RESULTS: Most Asian medical schools and their students appear to be positive about adapting to PBL in their curriculum. The positive and negative observations appear to be similar to those experienced in non-Asian medical schools. The problems that arose for students in Asian medical schools in the early stages of implementing PBL appear to have been overcome after a period of adjustment with the help of supportive and open-minded tutors. The reports also suggested that trigger problems should be carefully designed to make them relevant and interesting for the students. CONCLUSION: Strong support from the academic administrators (dean and other staff responsible for implementation of the curriculum) in the introduction of PBL into the curriculum and careful training of both faculty and students appear to be key factors to ensure the successful implementation of PBL in Asian medical schools.     

Evaluation of an integrated curriculum using problem-based learning in a clinical environment: the Manchester experience

DESCRIPTION OF COURSE: In 1994, a new problem-based leaning (PBL) curriculum for year 1 medical students was introduced at the University of Manchester. The use of PBL has continued into the clinical clerkships. Year 3 of the curriculum is based entirely in a clinical environment with PBL groups meeting in three teaching hospitals. During this year, all students undertake two integrated 14-week modules with overarching themes. Each week, groups of eight students discuss a trigger problem connected to the relevant theme. The steps the groups use in the PBL process have been amended to encourage students to link their discussion with clinical experience. EVALUATION: At the end of each module, all 309 students were requested to complete an evaluation questionnaire. The response rates were 80% (n=247) and 89% (n=275) for the two core modules. RESULTS: The students have remained 'happy with the way the course is going' (83% at the end of module 2). They were also asked to rate a number of statements on a 5-point Likert scale (5=strongly agree). Concerning PBL, the students remained confident about working in a group (median 4), producing a set of learning objectives (median 4) and linking clinical experience with other knowledge (median 4). However, there were changes over the year. Fewer students agreed at the end of module 2 that 'the working problems were stimulating' (P=0.002) or 'motivated them to learn' (P < 0.001), but the clinical firms were seen as providing more appropriate experience (P=0.01) and being aware of the new curriculum and responding to it (P=0.018). We also surveyed the PBL tutors and had 65 returns from 78 people involved in the 38 PBL groups in year 3. The great majority of these are doctors employed by the National Health service. Virtually all the responders were happy to continue being a tutor (97%) and would recommend it to a colleague (93%). CONCLUSIONS: The evaluation has been positive with PBL having been successfully implemented in a clinical environment. We have identified significant changes over the year, which we need to address as we consolidate the curriculum.     

Pedagogical methods and affect tolerance in medical students

OBJECTIVES: There has been little evaluation, by means other than cognitive variables, of medical school curricula that include problem-based learning (PBL). This study aimed to investigate whether medical students' affect tolerance, an important prerequisite of empathy, was influenced by individual courses. DESIGN: The study is pseudo-randomised and cross-sectional, using a test of affect tolerance in students in their first, sixth and eighth term of medical school, during which they were kept together as one group for their pre-clinical studies, but were subsequently separated during the clinical part and were sent to two different university hospitals that used different teaching methods. SUBJECTS: Medical students. SETTING: University of Lund Medical School, Sweden. RESULTS: After receiving a short course in communications skills training, students in the sixth term had significantly higher mean scores on the test than students in their first term. In the eighth term, which is the surgery term, the mean scores for students attending the PBL course were still as high as those for students in the sixth term, while students in the course using conventional pedagogical methods had significantly lower mean scores. DISCUSSION: Since the content of the courses was similar and the composition of the two groups also fairly similar, we attribute the difference to the differing teaching methods. In the PBL course, the students were given continued and integrated communication skills instruction, in which it was possible for them to learn strategies to counteract the development of rigid psychic defences, which constitute an obstacle to affect tolerance and empathy.     

Does problem‐based learning lead to deficiencies in basic science knowledge? An empirical case on anatomy

INTRODUCTION: Problem-based learning (PBL) is supposed to enhance the integration of basic and clinical sciences. In a non-integrative curriculum, these disciplines are generally taught in separate courses. Problem-based learning students perceive deficiencies in their knowledge of basic sciences, particularly in important areas such as anatomy. Outcome studies on PBL show controversial results, sometimes indicating that medical students at PBL schools have less knowledge of basic sciences than do their colleagues at more traditional medical schools. We aimed to identify differences between PBL and non-PBL students in perceived and actual levels of knowledge of anatomy. METHODS: Samples of Year 4 students in all eight medical schools in the Netherlands completed a questionnaire on perceived knowledge and took part in a computerised anatomy test consisting of both clinically contextualised items and items without context. RESULTS: Problem-based learning students were found to have the same perceived level of anatomy knowledge as students at other medical schools. Differences in actual levels of knowledge were found between schools. No significant effects on knowledge levels were found for PBL schools versus non-PBL schools. CONCLUSION: The results of this study show that PBL does not result in a lower level of anatomy knowledge than more traditional educational approaches. It remains to be ascertained whether the levels students attain are adequate. Subjects for further study are the desired level of anatomy knowledge at the end of undergraduate medical education and the effectiveness of basic science learning within a clinical context and with repetition over the course of the curriculum.     

医学研究生PBL教学效果评价及影响因素分析

目的:评价医学研究生PBL课程的教学效果及其主要影响因素,为推进研究生教学改革提供依据。方法:设计信度、效度较好的PBL教学质量评价问卷,选取某医科大学参与PBL课程的研究生开展问卷调查。结果:PBL在医学研究生中应用有较好的教学效果。多因素分析结果表明,学生课前资料准备情况、学生所修课程与专业的相关程度、课程类型、学生同一学期选课门数、教师是否担任研究生导师、学生课堂讨论参与度、学生对PBL模式的认知程度以及学生有既往是否有工作经历是影响PBL课程教学质量的主要因素。结论:PBL模式在医学研究生中的教学效果可通过完善教学管理、合理组建教学团队、加强研究生自主学习意识培养等环节进一步改善。     

The effectiveness of problem-based learning compared to traditional teaching in undergraduate psychiatry

OBJECTIVES: A change from traditional to problem-based learning (PBL) methods in a psychiatry attachment was evaluated by comparing the learning styles, attitudes to psychiatry and examination performance of 2 cohorts of students. It was hypothesised that the PBL curriculum would result in increased deep learning, decreased surface learning, more favourable attitudes to psychiatry and improved examination performance. It was predicted that students' examination success would be related to the use of deep and strategic learning and favourable attitudes. METHODS: Consecutive cohorts of Year 2 clinical students taught using a traditional psychiatry curriculum (n = 188) and a PBL curriculum (n = 191) were compared. Students completed the Study Process Questionnaire to assess their learning styles and the Attitudes to Psychiatry Scale at the beginning and end of the attachment. Students completed 2 end-of-attachment examinations, a multiple-choice paper and a viva. RESULTS: The PBL curriculum resulted in significantly better examination performance than did the traditional teaching curriculum, both for multiple-choice questions and the viva. No differences in learning styles or attitudes to psychiatry were found between the curricula. Students were significantly more successful in the examinations if they had received the PBL curriculum, were female, and used strategic learning. CONCLUSIONS: Examination performance indicated that the PBL curriculum was more successful than the previous course, but that this improvement was not due to students using more effective learning styles or having more favourable attitudes towards psychiatry. It is possible that students learned more effectively during the teaching sessions in the PBL curriculum, but did not change their preferred learning styles.     

A lesson from the introduction of a problem-based, graduate entry course: the effects of different views of self-direction

OBJECTIVES: Difficulties in the early years of a new curriculum are to be expected as staff and students come to terms with new structures, and with different approaches to teaching and learning. During the first year of implementation of the Graduate Medical Course at the Graduate School of Medicine, The University of Queensland, we experienced our share of 'teething troubles'. One source of difficulty was different interpretations of the concept of 'self-directed learning' as it was to be applied in the new course. This paper presents an analysis of the effects of these differences on the development of the curriculum. DESIGN: An orientation programme was designed to introduce students to staff, facilities and the PBL process. SETTING: The University of Queensland. SUBJECTS: Problem-based learning (PBL) tutors, medical students. RESULTS: The overall effect was to place in jeopardy the achievement of student self-direction and commitment to lifelong learning as a goal of the course. To counter the undesirable effects of different interpretations, we have developed a conceptual framework to promote an agreed understanding of the meaning of self-direction, and to guide review and further development of the curriculum. A further paper describes the framework. CONCLUSIONS: Consistency in interpretation of key concepts is an important factor in the success of problem-based curricula.     

Faculty opinions about a revised pre-clinical curriculum

INTRODUCTION: Medical schools having innovative curricula have been encouraged to ascertain the levels of satisfaction of faculty members with the curriculum. Faculty at schools that employ problem-based learning (PBL) have been shown to have positive perceptions, but not all schools are in a position to adopt PBL on a large scale. This study sought to determine faculty members' opinions about a new curriculum that is less ambitious than one utilizing true PBL. CONTEXT AND SETTING: Since 1997, the University of Otago Medical School (Dunedin, New Zealand) has had an integrated, modular pre-clinical curriculum that emphasizes clinical relevance. It has proved popular with students. This study focused on faculty members' impressions. METHODS: We surveyed faculty members' opinions with a questionnaire identical to one used in studies at PBL schools. Faculty compared the students and their own levels of satisfaction in the old and new curricula on 7 to 10 items. The overall response rate was 85.4% (152 of 178). RESULTS: Perceptions of the new curriculum were positive among teachers who taught during the pre-clinical years and those who taught the students only after they reached the clinical years. Results for individual questions were in the same direction and generally similar in magnitude to those reported on identical items for PBL. CONCLUSION: We conclude that a hybrid curriculum that is more acceptable to many traditional teachers and students than is PBL has almost as great a positive effect on faculty members' perceptions of students' abilities and of the curriculum as does PBL.     

A comparison of learning outcomes and attitudes in student- versus faculty-led problem-based learning: an experimental study

OBJECTIVES: To compare learning outcomes and perceptions of facilitator behaviours and small-group process in problem-based learning (PBL) groups led by students and those led by faculty. DESIGN: A prospective, Latin-square cross-over design was employed. Second-year medical students participated in 11 PBL cases over the course of the academic year. For each case, half the student groups were led by faculty and the other half by a student group member selected randomly to serve in the facilitator role. Learning outcomes were assessed by performance on objective examinations covering factual materials pertinent to the case. Perceptions of facilitator behaviours and of group functioning were assessed with a questionnaire completed at the end of each individual case. Focus-group discussions were held to gain more in-depth information about student perceptions and experience. Student-led sessions were observed at random by the investigators. SETTING: A state-supported, US medical school with a hybrid lecture-based and problem-based curriculum. SUBJECTS: One hundred and twenty-seven second-year medical students and 30 basic science and clinical faculty. RESULTS: No differences were detected in student performance on the objective evaluation based on whether the facilitator was a faculty member or peer group member, nor were there any differences in the perceptions of group process. Students gave peer facilitators slightly higher ratings in the second semester of the experiment. In the focus-group discussions, students voiced a general preference for student-led groups because they felt they were more efficient. Observation and focus-group reports suggest that groups led by students sometimes took short cuts in the PBL process. CONCLUSION: In a hybrid lecture- and PBL-based curriculum, student performance on objective examinations covering PBL materials is unaffected by the status of the facilitator (student vs. faculty). However, in peer-facilitated groups, students sometimes took short cuts in the PBL process that may undermine some of the intended goals of PBL.     

Medical faculty as humanistic physicians and teachers: the perceptions of students at innovative and traditional medical schools

BACKGROUND AND OBJECTIVES: The training of caring physicians represents an important goal of medical education. Little is known however, on whether medical faculty constitute good role models for teaching humanistic skills to medical students. In this study, we examined to what extent medical students at innovative and traditional schools perceived their teachers as humanistic physicians and teachers. We also explored whether pre-clinical and clinical students shared the same perceptions. METHODS: A mail survey was conducted in Canada of all second-year students and senior clerks at one innovative medical school (problem-based learning (PBL), patient-centred, community-oriented) and three traditional medical schools. Students were asked to what extent they agreed or disagreed that the majority of their teachers behaved as humanistic physicians and teachers; 10 statements were used. Overall, 65% of the 1039 students returned the questionnaire. RESULTS: Over 25% of second-year students and 40% of senior clerks did not agree that their teachers behaved as humanistic caregivers with patients or were good role models in teaching the doctor-patient relationship. More than half of second-year students and senior clerks did not agree that their teachers valued human contact with them or were supportive of students who had difficulties. There were few differences in the way medical students at innovative and traditional schools perceived their teachers' humanistic qualities. At the pre-clinical level however, there were more students from the innovative school than from the traditional schools (around 60% vs. 40%, P < 0.005) who agreed that their teachers valued human contact with them and were supportive of students. CONCLUSION: Our results indicate that the PBL curriculum fosters better teacher-student relationships during the pre-clinical years. They also suggest that an unacceptably large number of medical students are taught by physicians who seem to lack compassion and caring in their interactions with patients. This study questions the adequacy of medical faculty as role models for the acquisition of caring competence by medical students.     

Basic clinical skills: don't leave teaching to the teaching hospitals

OBJECTIVE: To compare student perception of teaching in general practice (GP), district general hospitals (DGHs) and teaching hospitals (THs) and their examination results. SETTING: The medical school at Queen's University, Belfast. SUBJECTS AND METHODS: A total of 161 medical and 34 dental students completed an objective structured clinical examination and questionnaire at the end of their second semester of basic skills teaching. They scored the course for teaching style, educational value and enjoyment. Teaching attributes of the tutors were similarly recorded. Students were also asked to quantify how time was used and to comment on the course. INTERVENTIONS: A new programme for teaching first- and second-year students basic clinical skills in the community. RESULTS: Teaching in GP and DGHs was reported to be more educational and enjoyable than in the TH. In GP most time was spent being lectured, in DGHs most time was spent with the patient, and in THs, waiting for the tutor. General practitioners and doctors in DGHs were more likely to model positive teaching attitudes such as showing interest in students and providing feedback. The most common complaints related to insufficient time spent with patients in GP and poor tutor preparation in THs. All teaching sites achieved similar examination results. CONCLUSION: Clinical skills can be taught to medical students early in their curriculum using GP tutors. Student preference was strongly for being taught by GPs rather than in THs. Simple steps such as prior preparation and the locating of a suitable patient could markedly improve student experience both in GP and in hospitals.     

Basic sciences in problem-based learning and conventional curricula: students' attitudes

The purpose of this study was to compare the attitudes toward basic sciences of students in a preclinical problem-based curriculum and a conventional lecture-based curriculum at the end of their second year of medical school. The results showed that the PBL class had more positive attitudes toward basic sciences than students in the conventional class. These results may reflect a learning environment where students meet many scientist role models as teachers and where basic science is learnt in the context of clinical problems.     

Problem-based learning versus lecture-based learning in a course of basic pharmacology: a controlled, randomized study

Since its first implementation in a medical programme at McMaster University, Canada, problem-based learning (PBL) has become a well-established means of teaching and learning medicine. Extensive research has been conducted and a number of strengths of the method are well supported. Several items, however, remain unclear although there is evidence that no relevant difference exists in factual knowledge among students from PBL and traditional curricula, a controlled, randomized study has not been conducted to address this issue. The Medical Faculty of the University of Cologne is in the process of integrating elements of PBL into its curriculum. In the spring term of 1997, after seven semesters of experience with PBL supplementing the traditional course of basic pharmacology, we did for the first time use PBL instead of the lecture-based course (LBL) and conducted a controlled prospective study to determine the effects of this intervention. One-hundred and twenty-three students were randomly assigned to either PBL (n = 63), with tutorial groups of up to nine students, or to the traditional, lecture-based course (n = 60). Analysis of the results of both groups in the examination of basic pharmacology, consisting of multiple-choice and short-essay questions, revealed similar scores with a tendency favouring PBL students in the category of short-essay questions. Hence, it seems clear that PBL does not imply a disadvantage in terms of factual knowledge. Students considered PBL to be an effective learning method and favoured it over the lecture format. Furthermore, students reported positive effects of PBL in terms of use of additional learning resources, interdisciplinarity, team work and learning fun.     

An experiment in problem-based learning

Summary: Problem-solving skills are important for medical students and problem-based learning (PBL) is especially suited to general practice. Therefore an experiment using a form of PBL was introduced into a new 4-week course in general practice for final rotation students at the University of Glasgow in the session 1992–93. The experiment aimed to introduce students to an alternative method of learning to the traditional one previously used by them in their course, to encourage teamwork and to encourage the use of alternative methods of obtaining information. The method, centred around allowing the students to investigate problems they choose themselves, is described. The evaluation of the course by written standard form, free written comments and audiotape recorded interviews with a one in four sample of the class is presented.
Summary: The students selected many interesting problems and used many different and unusual sources of information in researching them. This method of learning was compared with the parallel lecture course and was thought by the students to be more interesting but less relevant than the lecture course.
Summary: The experiment showed that it is possible to introduce a problem-based form of learning into a new course in parallel with more traditional methods of teaching and for it to be at least partially successful for students much more used to a traditional didactic curriculum. Ways of improving the course in the future to make it more sensitive to the students' learning needs are discussed.     

The impact of curricular change on medical students' knowledge of anatomy

BACKGROUND: In recent years, following the publication of Tomorrow's Doctors, the undergraduate medical curriculum in most UK medical schools has undergone major revision. This has resulted in a significant reduction in the time allocated to the teaching of the basic medical sciences, including anatomy. However, it is not clear what impact these changes have had on medical students' knowledge of surface anatomy. AIM: This study aimed to assess the impact of these curricular changes on medical students' knowledge of surface anatomy. SETTING: Medical student intakes for 1995-98 at the Queen's University of Belfast, UK. METHODS: The students were invited to complete a simple examination paper testing their knowledge of surface anatomy. Results from the student intake of 1995, which undertook a traditional, 'old' curriculum, were compared with those from the student intakes of 1996-98, which undertook a new, 'systems-based' curriculum. To enhance linear response and enable the use of linear models for analysis, all data were adjusted using probit transformations of the proportion (percentage) of correct answers for each item and each year group. RESULTS: The student intake of 1995 (old curriculum) were more likely to score higher than the students who undertook the new, systems-based curriculum. CONCLUSION: The introduction of the new, systems-based course has had a negative impact on medical students' knowledge of surface anatomy.     

Not knowing that they do not know: self-assessment accuracy of third-year medical students

PURPOSE: The development of self-regulated learning is a major focus of our problem-based learning (PBL) medical programme. Students who are unsuccessful in assessments often seem to lack insight into the standard of their own performance, yet the ability to self-assess accurately is essential for the effective self-management of learning. The aim of this project was to evaluate the accuracy of self- and peer-assessment according to academic performance. METHOD: In 2004, 175 3rd-year students undertook an integrated, case-based, short-essay, formative assessment. After the assessment they were provided with model answers and marking criteria. Students marked their own assessment paper and the paper of one of their peers. Assessment papers were subsequently marked by faculty members. The following data was available for each student: self-mark, faculty-mark, score awarded by a peer and the score that they awarded to their peer. Self-assessment and peer-assessment ability was compared to overall academic performance. RESULTS: Low-achieving students score themselves and their peers generously. High-achieving students score themselves more harshly than faculty. However, they score their peers accurately. CONCLUSION: In the 3rd year of the programme low-achieving students are unable to assess accurately the quality of their own work or the work of their peers in a formative written assessment. The PBL curriculum does not guarantee the appropriate development of self-assessment skills.     

The parallel rural community curriculum: an integrated clinical curriculum based in rural general practice

INTRODUCTION: In an attempt to address the rural medical workforce maldistribution and the concurrent inappropriate caseload at the urban tertiary teaching hospitals, Flinders University and the Riverland Division of General Practice decided to pilot, in 1997, an entire year of undergraduate clinical curriculum in Australian rural general practice. This program is called the Parallel Rural Community Curriculum (PRCC). This paper is a discussion of the aims of the programme; student selection; practice recruitment; curriculum structure, and academic content, together with lessons learnt from the evaluation of the first cohort of students' experience of the course. METHODS: Independent external evaluators undertook a thematic analysis of a series of structured interviews of students and faculty involved in both the PRCC and the traditional curriculum. The mean examination results were determined and a rank order comparison of student academic performance was undertaken. RESULTS: The eight selected volunteer students reported greater access to patients and clinical learning opportunities than their mainstream counterparts and learned clinical decision making in the context of the whole patient, their family, and the available community resources. They identified patients with 'core' clinical conditions and had a longitudinal exposure to common diseases, whereas hospital-based peers had a cross-sectional exposure to highly filtered illness. The PRCC students' academic performance improved in comparison with that of their tertiary hospital peers' and in comparison to their own results in previous years. CONCLUSION: The PRCC curriculum has cut across the traditional clinical discipline boundaries by teaching in an integrated way in rural general practice. It has affirmed the potential role of true generalist physicians in undergraduate medical education.     

Change in student attitudes to medical school after the introduction of problem-based learning in spite of low ratings

Students' attitudes to, and opinions of, their studies at medical school were investigated with the help of a questionnaire. They were asked to what extent the medical school encouraged independent, critical thinking, problem-solving skills, decision-making, studying outside the textbook and other behaviours and skills that teachers in higher education usually put forward as important. It was found that students generally had a low opinion of the extent to which their education encouraged such virtues, mean figures ranging between 3·5 and 4·6 on a 10-grade scale. The students felt that their studies to a large extent encouraged focus on details and preparation for examinations. The questionnaire was given to the students after 2½ years of traditional preclinical studies and at the end of the first clinical year. There were significant but numerically small differences for some of the items at the end of the year. However, when problem-based learning (PBL) was introduced during the first clinical year, there was a substantial change: there were now significant and numerically larger differences for seven of the nine items, even though the students were asked to give their opinion of the whole of their time at medical school on both occasions, not only of the last year. There were no other changes in the curriculum or the teaching methods other than the introduction of PBL. The change in attitudes did not depend on the student's appreciation of PBL; students' opinion of PBL was low, indicating that most of them disliked it.     

Development of knowledge in basic sciences: a comparison of two medical curricula

Medical Education 2012: 46 : 1206–1214 Context Basic medical sciences education differs among medicine courses, especially as traditional and integrated problem‐based learning (PBL) curricula teach basic sciences in very different ways. The literature shows no clear differences in the performance of students of these different educational philosophies. The Charité Medical University of Berlin (Charité Universitätsmedizin Berlin) teaches both a traditional medical curriculum (TMC) and a PBL reformed medical curriculum (RMC). Both curricula conduct the Progress Test in Medicine (PTM), which examines competence in the basic and clinical sciences from the first to the last semester. Objectives The aim of this study was to compare the development and retention of knowledge in the basic medical sciences between students on the traditional and reformed undergraduate medical curricula, respectively. Methods For each student and single PTM, relative frequencies of correct answers were computed for basic sciences items only and for the whole curriculum. Frequencies were averaged and grouped by semester and curriculum. Analyses of variance (anova s) were performed at all measurement points with a Bonferroni‐corrected p‐value at the level of p < 0.005. Eta‐squared (η²) was used to classify effect size. Results In the first three semesters, RMC students slightly outperform TMC students in the basic sciences, although TMC students receive more systematic teaching. After this, TMC students develop a peak of knowledge in basic sciences and overtake RMC students. The knowledge of TMC students then decreases over time, but despite this, they perform better in the final semester. Students on the RMC show constant progress throughout their undergraduate studies. Overall, the development of medical knowledge is consistent in both curricula. There is no significant difference in this outcome between the traditional and PBL courses. Conclusions Progress testing as a longitudinal method allows us to better understand the development of knowledge during formal undergraduate education. The main difference between traditional and problem‐based medical education seems to be provoked by the high‐stakes national examination undertaken in the traditional course (the Physikum).