Does problem‐based learning lead to deficiencies in basic science knowledge? An empirical case on anatomy

INTRODUCTION: Problem-based learning (PBL) is supposed to enhance the integration of basic and clinical sciences. In a non-integrative curriculum, these disciplines are generally taught in separate courses. Problem-based learning students perceive deficiencies in their knowledge of basic sciences, particularly in important areas such as anatomy. Outcome studies on PBL show controversial results, sometimes indicating that medical students at PBL schools have less knowledge of basic sciences than do their colleagues at more traditional medical schools. We aimed to identify differences between PBL and non-PBL students in perceived and actual levels of knowledge of anatomy. METHODS: Samples of Year 4 students in all eight medical schools in the Netherlands completed a questionnaire on perceived knowledge and took part in a computerised anatomy test consisting of both clinically contextualised items and items without context. RESULTS: Problem-based learning students were found to have the same perceived level of anatomy knowledge as students at other medical schools. Differences in actual levels of knowledge were found between schools. No significant effects on knowledge levels were found for PBL schools versus non-PBL schools. CONCLUSION: The results of this study show that PBL does not result in a lower level of anatomy knowledge than more traditional educational approaches. It remains to be ascertained whether the levels students attain are adequate. Subjects for further study are the desired level of anatomy knowledge at the end of undergraduate medical education and the effectiveness of basic science learning within a clinical context and with repetition over the course of the curriculum.     

General competencies of problem-based learning (PBL) and non-PBL graduates

INTRODUCTION: Junior doctors have reported shortcomings in their general competencies, such as organisational skills and teamwork. We explored graduates' perceptions of how well their training had prepared them for medical practice and in general competencies in particular. We compared the opinions of graduates from problem-based learning (PBL) and non-PBL schools, because PBL is supposed to enhance general competencies. METHOD: We analysed the responses of 1159 graduates from 1 PBL and 4 non-PBL schools to a questionnaire survey administered 18 months after graduation. RESULTS: Compared with their non-PBL colleagues, the PBL graduates gave higher ratings for the connection between school and work, their medical training and preparation for practice. According to the graduates, the most frequently used competencies with sufficient coverage during medical training were expert knowledge, profession-specific skills and communication skills. The majority of the PBL graduates, but less than half of the non-PBL graduates, indicated that communication skills had been covered sufficiently. All the graduates called for more curriculum attention on working with computers, planning and organisation, and leadership skills. More PBL graduates than non-PBL graduates indicated that they had learned profession-specific methods, communication skills and teamwork in medical school. DISCUSSION: Overall, the graduates appeared to be satisfied with their knowledge and skills. The results suggest that the PBL school provided better preparation with respect to several of the competencies. However, both PBL and non-PBL graduates identified deficits in their general competencies, such as working with computers and planning and organising work. These competencies should feature more prominently in undergraduate medical education.     

An investigation into problem solving in education: a problem-solving curricular framework

The purpose of this study was to examine how two aspects of teaching, mastery of content and problem solving, could be linked in a curricular framework. A professional educational program in physical therapy which had been developed to teach both content and problem solving was evaluated. The subjects for the study were 81 students in a baccalaureate program in a Midwestern medical school who participated in this problem-solving curriculum. The primary assessment instrument used was the Watson-Glaser Critical Thinking Appraisal. Findings indicated that performance on a test of critical thinking was affected by the curriculum. Regression analysis indicated that one course designed as an introduction to problem solving was significantly related to changes in problem-solving skill scores. Although significant change in the test scores did occur, these changes were not evident until the completion of the year-long program. Differing effects for lecture and field experience (or patient care) courses were not observed, and traditional measures such as grade point averages had no statistical relationship to problem-solving skill scores.     

Implementation of problem-based learning in Asian medical schools and students' perceptions of their experience

BACKGROUND: Since the introduction of problem-based learning (PBL) at McMaster University in 1969, many medical schools in the USA, Canada and Europe have included PBL in their curricula. In the past decade, many medical schools in Asia have also done so. However, so far no one has questioned whether the outcomes expected of the learner in a PBL setting are applicable to students from different cultural upbringings. AIM: The aim of this study was to investigate the implementation of PBL in Asian medical schools, their students' perceptions of this new mode of teaching/learning and how the problems that have arisen may be overcome. METHOD: Published reports and conference presentations were gathered on the implementation of PBL in some Asian medical schools and comparisons of the experiences in PBL of Asian and students of other ethnic backgrounds. RESULTS: Most Asian medical schools and their students appear to be positive about adapting to PBL in their curriculum. The positive and negative observations appear to be similar to those experienced in non-Asian medical schools. The problems that arose for students in Asian medical schools in the early stages of implementing PBL appear to have been overcome after a period of adjustment with the help of supportive and open-minded tutors. The reports also suggested that trigger problems should be carefully designed to make them relevant and interesting for the students. CONCLUSION: Strong support from the academic administrators (dean and other staff responsible for implementation of the curriculum) in the introduction of PBL into the curriculum and careful training of both faculty and students appear to be key factors to ensure the successful implementation of PBL in Asian medical schools.     

Influence of PBL with open-book tests on knowledge retention measured with progress tests

The influence of problem-based learning (PBL) and open-book tests on long-term knowledge retention is unclear and subject of discussion. Hypotheses were that PBL as well as open-book tests positively affect long-term knowledge retention. Four progress test results of fifth and sixth-year medical students (n = 1,648) of three medical schools were analyzed. Two schools had PBL driven curricula, and the third one had a traditional curriculum (TC). One of the PBL schools (PBLob) used a combination of open-book (assessing backup knowledge) and closed-book tests (assessing core knowledge); the other two schools (TC and PBLcb) only used closed-book tests. The items of the progress tests were divided into core and backup knowledge. T tests (with Bonferroni correction) were used to analyze differences between curricula. PBL students performed significantly better than TC students on core knowledge (average effect size (av ES) = 0.37–0.74) and PBL students tested with open-book tests scored somewhat higher than PBL students tested without such tests (av ES = 0.23–0.30). Concerning backup knowledge, no differences were found between the scores of the three curricula. Students of the two PBL curricula showed a substantially better long-term knowledge retention than TC students. PBLob students performed somewhat better on core knowledge than PBLcb students. These outcomes suggest that a problem-based instructional approach in particular can stimulate long-term knowledge retention. Distinguishing knowledge into core and backup knowledge and using open-book tests alongside closed-book tests could enhance long-term core knowledge retention.     

PBL in Undergraduate Medical Education: A Qualitative Study of the Views of Canadian Residents

Background and Objectives: At McMaster University, the birthplace of problem-based learning (PBL), administrators and curriculum planners have begun the process of renewing the undergraduate MD curriculum. One step has been to conduct an environmental scan that includes input from medical residents. Methods: Individual interviews with 17 medical residents and fellows currently enrolled at McMaster University and are graduates of six Canadian medical schools. Results: PBL appears to be well known even by graduates of non-PBL Canadian medical schools. Tutors are key to a successful PBL program, should be knowledgeable about the content area under study and able to effectively facilitate groups. Tutorial problems should be realistic, up-to-date, and challenge students to investigate more than the medical aspects of the case in question. Students need to be prepared, willing to participate in peer teaching, and supportive of the group learning process. PBL programs can be improved if they incorporate elements of traditional medical programs (e.g., mini-lectures, clear learning objectives, and unbiased evaluation of student progress) while retaining the essence of student-generated learning. Conclusions: Medical residents are an underutilized source of information about undergraduate medical programs. According to our participants, more emphasis on faculty development and upgrading health care problems will improve PBL-based undergraduate medical education.     

Change in student attitudes to medical school after the introduction of problem-based learning in spite of low ratings

Students' attitudes to, and opinions of, their studies at medical school were investigated with the help of a questionnaire. They were asked to what extent the medical school encouraged independent, critical thinking, problem-solving skills, decision-making, studying outside the textbook and other behaviours and skills that teachers in higher education usually put forward as important. It was found that students generally had a low opinion of the extent to which their education encouraged such virtues, mean figures ranging between 3·5 and 4·6 on a 10-grade scale. The students felt that their studies to a large extent encouraged focus on details and preparation for examinations. The questionnaire was given to the students after 2½ years of traditional preclinical studies and at the end of the first clinical year. There were significant but numerically small differences for some of the items at the end of the year. However, when problem-based learning (PBL) was introduced during the first clinical year, there was a substantial change: there were now significant and numerically larger differences for seven of the nine items, even though the students were asked to give their opinion of the whole of their time at medical school on both occasions, not only of the last year. There were no other changes in the curriculum or the teaching methods other than the introduction of PBL. The change in attitudes did not depend on the student's appreciation of PBL; students' opinion of PBL was low, indicating that most of them disliked it.     

Problem-solving instruction during the clinical clerkship: description and preliminary evaluation of a programme

A clerkship programme in general surgery is described whereby students acquire factual knowledge about disease entities through independent learning rather than through formal teaching. The objectives of the programme are to promote problem-solving skills. It consists of clinical work (patient work-up, clinical rounds, participation in the activities in the operating room, out-patient clinic and emergency room) and of small-group tutorial sessions. The described programme has met with approval and satisfaction from both students and teachers. There were no significant differences in the average grades on the written and oral final examinations between the graduates of this clerkship programme and those of a traditional one. Independent learning and problem-solving instruction, which have been adopted by some medical schools in the preclinical phase of the curriculum, can be effectively implemented during the clinical phase as well.     

Faculty opinions about a revised pre-clinical curriculum

INTRODUCTION: Medical schools having innovative curricula have been encouraged to ascertain the levels of satisfaction of faculty members with the curriculum. Faculty at schools that employ problem-based learning (PBL) have been shown to have positive perceptions, but not all schools are in a position to adopt PBL on a large scale. This study sought to determine faculty members' opinions about a new curriculum that is less ambitious than one utilizing true PBL. CONTEXT AND SETTING: Since 1997, the University of Otago Medical School (Dunedin, New Zealand) has had an integrated, modular pre-clinical curriculum that emphasizes clinical relevance. It has proved popular with students. This study focused on faculty members' impressions. METHODS: We surveyed faculty members' opinions with a questionnaire identical to one used in studies at PBL schools. Faculty compared the students and their own levels of satisfaction in the old and new curricula on 7 to 10 items. The overall response rate was 85.4% (152 of 178). RESULTS: Perceptions of the new curriculum were positive among teachers who taught during the pre-clinical years and those who taught the students only after they reached the clinical years. Results for individual questions were in the same direction and generally similar in magnitude to those reported on identical items for PBL. CONCLUSION: We conclude that a hybrid curriculum that is more acceptable to many traditional teachers and students than is PBL has almost as great a positive effect on faculty members' perceptions of students' abilities and of the curriculum as does PBL.     

PBL教学模式下医学生问题解决能力问卷调查

目的研究PBL教学是否对学生的问题解决能力有促进作用,为PBL教学更好的开展提供依据。方法分层抽取某医学院校大一、大二、大三临床专业学生l258人,以自编信效度较高的医学生问题解决能力问卷为调查工具。结果PBL教学模式下的学生在问题意识、问题定义和表征、监控3个方面优于传统教学学生,并且PBL教学的问卷总分优于传统教学。人口学特征对PBL教学的影响差异无统计学意义。结论PBL教学影响学生的问题解决能力,PBL教学应加强对医学生问题解决策略的培养,发展更好的评估方式。     

Development of knowledge in basic sciences: a comparison of two medical curricula

Medical Education 2012: 46 : 1206–1214 Context Basic medical sciences education differs among medicine courses, especially as traditional and integrated problem‐based learning (PBL) curricula teach basic sciences in very different ways. The literature shows no clear differences in the performance of students of these different educational philosophies. The Charité Medical University of Berlin (Charité Universitätsmedizin Berlin) teaches both a traditional medical curriculum (TMC) and a PBL reformed medical curriculum (RMC). Both curricula conduct the Progress Test in Medicine (PTM), which examines competence in the basic and clinical sciences from the first to the last semester. Objectives The aim of this study was to compare the development and retention of knowledge in the basic medical sciences between students on the traditional and reformed undergraduate medical curricula, respectively. Methods For each student and single PTM, relative frequencies of correct answers were computed for basic sciences items only and for the whole curriculum. Frequencies were averaged and grouped by semester and curriculum. Analyses of variance (anova s) were performed at all measurement points with a Bonferroni‐corrected p‐value at the level of p < 0.005. Eta‐squared (η²) was used to classify effect size. Results In the first three semesters, RMC students slightly outperform TMC students in the basic sciences, although TMC students receive more systematic teaching. After this, TMC students develop a peak of knowledge in basic sciences and overtake RMC students. The knowledge of TMC students then decreases over time, but despite this, they perform better in the final semester. Students on the RMC show constant progress throughout their undergraduate studies. Overall, the development of medical knowledge is consistent in both curricula. There is no significant difference in this outcome between the traditional and PBL courses. Conclusions Progress testing as a longitudinal method allows us to better understand the development of knowledge during formal undergraduate education. The main difference between traditional and problem‐based medical education seems to be provoked by the high‐stakes national examination undertaken in the traditional course (the Physikum).     

Do conventional and innovative medical schools recruit different students?

A mail questionnaire was used to survey the social and demographic characteristics, educational background, attitudinal profiles and expected career choice of 243 first-year students enrolled in three US medical schools. The aim was to determine whether different types of schools selected different types of students. Two schools were considered as conventional whereas one school was considered as innovative both in its admission policies and in its curriculum which emphasizes a biopsychosocial approach to health care. The survey achieved an 84% response rate. The results showed no difference in students' career expectations. Students recruited in the innovative school, however, differed from students recruited in the conventional schools with regard to their social and demographic characteristics, educational background and attitudinal profiles. This study suggests that as some medical schools are innovating in their curriculum and admission policies, new types of medical students are entering medicine. Implications of these results are discussed.     

Active and problem-based learning: two years'' experience in physiology at the Medical School of the University of Barcelona

Traditional educational methods are used in most medical schools. The introduction of new methods including active and problem-solving learning in traditional medical schools is difficult. The aims of this experiment were: (1) to introduce a self-learning system with a problem-solving approach in physiology; (2) to promote active student participation; (3) to introduce early clinical exposure; (4) to evaluate the response of the students to this experiment; and (5) to evaluate the feasibility and usefulness of a self-learning and problem-solving approach in only one discipline. Our experience has shown that it is possible to change the learning system in a traditional medical school, with good acceptance by the students and with a high level of satisfaction on the part of the teachers.     

Student feedback in problem based learning: a survey of 103 final year students across five Ontario medical schools

CONTEXT: Problem based learning (PBL) has become an integral component of medical curricula around the world. In Ontario, Canada, PBL has been implemented in all five Ontario medical schools for several years. Although proper and timely feedback is an essential component of medical education, the types of feedback that students receive in PBL have not been systematically investigated. OBJECTIVES: In the first multischool study of PBL in Canada, we sought to determine the types of feedback (grades, written comments, group feedback from tutor, individual feedback from tutor, peer feedback, self-assessment, no feedback) that students receive as well as their satisfaction with these different feedback modalities. SUBJECTS AND METHODS: We surveyed a sample of 103 final year medical students at the five Ontario schools (University of Toronto, McMaster University, Queens University, University of Ottawa and University of Western Ontario). Subjects were recruited via E-mail and were asked to fill out a questionnaire. RESULTS: Many students felt that the most helpful type of feedback in PBL was individual feedback from the tutor, and indeed, individual feedback was one of the more common types of feedback provided. However, although students also indicated a strong preference for peer and group feedback, these forms of feedback were not widely reported. There were significant differences between schools in the use of grades, written comments, self-assessment and peer feedback, as well as the immediacy of the feedback given. CONCLUSIONS: Across Ontario, students do receive frequent feedback in PBL. However, significant differences exist in the types of feedback students receive, as well as the timing. Although rated highly by students at all schools, the use of peer feedback and self-assessment is limited at most, but not all, medical schools.     

Early effects of a new problem-based clinically oriented curriculum on students' perceptions of teaching

OBJECTIVES: To compare the course experiences of medical students in a new problem-based (PBL) undergraduate medical course with those of their peers in a conventional curriculum. DESIGN: Whole class questionnaire survey using a pre-validated research instrument. SETTING: University of Liverpool, UK. SUBJECTS: First and second year medical students RESULTS: New curriculum students were more satisfied with their course when compared to their conventional course peers. Problem solving, team working and motivation scores were significantly higher amongst new course (PBL) students. New course students were more anxious about clarity of objectives and standard of work required. CONCLUSIONS: Early evidence suggests that curriculum reform from conventional teaching to a small group problem analysis programme results in improvement in student satisfaction with teaching and the development of appropriate learning skills.     

Non-cognitive characteristics of medical students: entry to problem-based and lecture-based curricula

The effectiveness of problem-based learning (PBL) versus lecture-based learning (LBL) continues to be debated all over the world. These arguments have often been based on students' cognitive measures of performance. Little emphasis has been placed on non-cognitive factors that may directly or indirectly affect the medical school performance of students in either curriculum. The purpose of this study was to (1) document possible differences in student cognitive and non-cognitive characteristics at entry between the two curricula and (2) to explore the relationships that exist between cognitive and noncognitive factors. Data were obtained from three medical school classes (   n = 281  ). The results indicate that students who entered the PBL curriculum at this medical school had higher total Medical College Admission Test and undergraduate grade point average than students who entered the LBL curriculum. Students who entered the PBL curriculum were also more self-sufficient and were more likely to do well in individualistic and less structured settings. There were no strong correlations between cognitive and non-cognitive variables. Before conclusions can be drawn about the effectiveness of either PBL or LBL curricula, we need to document patterns in entry characteristics to control for a priori differences that affect student performance.     

Evolutionary trends of problem-based learning practices throughout a two-year preclinical program: a comparison of students’ and teachers’ perceptions

Implementation of a pedagogical approach is a continuous and evolving process. As an institution with more than 15 years problem-based learning (PBL), we studied how the learning and teaching processes are currently practiced in a 2-year preclinical basic sciences program to assess whether they still match the intended objectives. Using both students’ and tutors’ evaluations, we analyzed and compared their perceptions on the program content and its organization, on tutors’ functioning and on the duration of PBL sessions throughout 11 instructional units of the second and third-year of a 6 years medical curriculum. Whereas both tutors and students indicated that the content and problems selected for the curriculum were well adapted to the PBL process, they felt the references as well as the self-study time as moderately appropriate. Over the course of the 2-year program, tutorial sessions got linearly shorter, whereas reporting sessions got longer. While tutors knew well the PBL approach and were suitably prepared to their tutorials, they however, became less regular in providing feedback and in evaluating group functioning over the 2 years. Our results suggest that the practice of the PBL process evolves within and throughout a 2-year preclinical program and moves away from the original intentions. Possible underlying reasons and their implications are discussed within the context of tutors’ and students’ concepts of teaching and learning, the medical schools’ learning environment and teaching practices and the difficulty of developing and maintaining in the long term a deep and self-directed learning approach.     

Medical faculty as humanistic physicians and teachers: the perceptions of students at innovative and traditional medical schools

BACKGROUND AND OBJECTIVES: The training of caring physicians represents an important goal of medical education. Little is known however, on whether medical faculty constitute good role models for teaching humanistic skills to medical students. In this study, we examined to what extent medical students at innovative and traditional schools perceived their teachers as humanistic physicians and teachers. We also explored whether pre-clinical and clinical students shared the same perceptions. METHODS: A mail survey was conducted in Canada of all second-year students and senior clerks at one innovative medical school (problem-based learning (PBL), patient-centred, community-oriented) and three traditional medical schools. Students were asked to what extent they agreed or disagreed that the majority of their teachers behaved as humanistic physicians and teachers; 10 statements were used. Overall, 65% of the 1039 students returned the questionnaire. RESULTS: Over 25% of second-year students and 40% of senior clerks did not agree that their teachers behaved as humanistic caregivers with patients or were good role models in teaching the doctor-patient relationship. More than half of second-year students and senior clerks did not agree that their teachers valued human contact with them or were supportive of students who had difficulties. There were few differences in the way medical students at innovative and traditional schools perceived their teachers' humanistic qualities. At the pre-clinical level however, there were more students from the innovative school than from the traditional schools (around 60% vs. 40%, P < 0.005) who agreed that their teachers valued human contact with them and were supportive of students. CONCLUSION: Our results indicate that the PBL curriculum fosters better teacher-student relationships during the pre-clinical years. They also suggest that an unacceptably large number of medical students are taught by physicians who seem to lack compassion and caring in their interactions with patients. This study questions the adequacy of medical faculty as role models for the acquisition of caring competence by medical students.     

Integration of pharmacology into a problem–based learning curriculum for medical students

The purpose of this study is threefold: (1) to describe a method of integration of pharmacology subject matter with other disciplines, in a problem-based learning (PBL) curriculum employed at the Northwest Center for Medical Education (NWCME), Indiana University School of Medicine; (2) to present various evaluation methods employed to assess students' learning of pharmacology knowledge; and (3) to compare the academic performance of students who underwent a traditional curriculum versus the PBL curriculum in terms of class evaluations and the standard national board medical licensure examinations. The PBL curriculum is designed for the first 2 years of medical education and consists of six sequential steps: steps 1 and 2 deal with biochemistry and anatomy respectively; steps 3, 4 and 5 deal with physiology, neuroscience and general pathology/microbiology respectively; and step 6 is a multidisciplinary step, which integrates basic science subjects with clinical medicine, emphasizing the mechanism of disease in an organ-system approach. In the PBL curriculum students start learning pharmacology within 6 months of admission. The content and process of pharmacology are spread across the first and in the second year. The pharmacology content is divided into three segments, each of which is integrated with other basic science subjects that have maximum mutual relevance. The three segments are as follows: the general and systemic pharmacology (50%) was included in step 3; the neuropharmacology and toxicology (35%) part was included in step 4; the third segment consisted of antimicrobial agents, anticancer and antiinflammatory agents (15%) and was included in step 5. The class evaluation of student performance in the PBL curriculum consisted of two elements, the content examinations and the process evaluations, which include the tutorial and the triple-jump evaluations of problem-solving skills. In order to assess the overall academic performance of the PBL curriculum and traditional curriculum groups, three classes of students who took the PBLC were compared with three classes of students who underwent a TC for performance in terms of class grades and scores of National Board examinations (NBME I and/or USMLE I). The PBL curriculum students performed as well as or better than the TC students as measured by the NMBE I and/or USMLE I. The gain in pharmacology knowledge of PBL students is accompanied by the presence of a positive experience that learning pharmacology is enjoyable. Our experience suggests that the segmental integration approach of instruction coupled with a system of content (internal and external examinations) and process (tutorial and triple-jump) evaluations, as outlined in this paper is a contextualized learning method that offers an effective way of imparting pharmacology knowledge to medical students.     

Longterm effects of problem-based learning: a comparison of competencies acquired by graduates of a problem-based and a conventional medical school

BACKGROUND: Problem-based learning (PBL) as an approach to the instruction of medical students has attracted much attention in recent years. However, its effect on the performance of its graduates is the subject of considerable debate. This article presents data from a large-scale study among graduates of a problem-based medical school and those of a conventional medical school to contribute to this discussion. PURPOSE: To study the longterm effects of problem-based medical training on the professional competencies of graduates. METHODS: A questionnaire was sent to all graduates since 1980 of a problem-based and a conventional medical school. Participants were requested to rate themselves on 18 professional competencies derived from the literature. RESULTS: The graduates of the PBL school scored higher on 14 of 18 professional competencies. Graduates of the problem-based school rated themselves as having much better interpersonal skills, better competencies in problem solving, self-directed learning and information gathering, and somewhat better task-supporting skills, such as the ability to work and plan efficiently. There were no sizeable differences with regard to general academic competencies, such as conducting research or writing a paper. Graduates from the conventional school rated themselves as having slightly more medical knowledge. The findings were shown to be valid and robust against possible response bias. CONCLUSION: The findings suggest that PBL not only affects the typical PBL-related competencies in the interpersonal and cognitive domains, but also the more general work-related skills that are deemed important for success in professional practice.