The effect of compulsory participation of medical students in problem-based learning

Problem-based learning (PBL) is an instructional method that has attracted many advocates since its introduction in medical education almost 20 years ago. PBL features the use of student-directed tutorials, medically relevant problems to set study objectives, and independent learning. Educators have worried that not all students will do well with this method. This study compared a group of students who had chosen to be in a PBL curriculum with a group who had not, as they undertook a curriculum that contained both PBL and lecture-based courses. Academic performance was virtually identical regardless of learning method. Students slightly favoured the courses that featured the method they had originally chosen, but a significantly larger proportion of students shifted their preference from the lecture to the problem-based approach than vice versa. Students' academic performance does not appear to suffer when they are involuntarily enrolled in a PBL curriculum and many come to prefer this type of curriculum.     

Does problem‐based learning lead to deficiencies in basic science knowledge? An empirical case on anatomy

INTRODUCTION: Problem-based learning (PBL) is supposed to enhance the integration of basic and clinical sciences. In a non-integrative curriculum, these disciplines are generally taught in separate courses. Problem-based learning students perceive deficiencies in their knowledge of basic sciences, particularly in important areas such as anatomy. Outcome studies on PBL show controversial results, sometimes indicating that medical students at PBL schools have less knowledge of basic sciences than do their colleagues at more traditional medical schools. We aimed to identify differences between PBL and non-PBL students in perceived and actual levels of knowledge of anatomy. METHODS: Samples of Year 4 students in all eight medical schools in the Netherlands completed a questionnaire on perceived knowledge and took part in a computerised anatomy test consisting of both clinically contextualised items and items without context. RESULTS: Problem-based learning students were found to have the same perceived level of anatomy knowledge as students at other medical schools. Differences in actual levels of knowledge were found between schools. No significant effects on knowledge levels were found for PBL schools versus non-PBL schools. CONCLUSION: The results of this study show that PBL does not result in a lower level of anatomy knowledge than more traditional educational approaches. It remains to be ascertained whether the levels students attain are adequate. Subjects for further study are the desired level of anatomy knowledge at the end of undergraduate medical education and the effectiveness of basic science learning within a clinical context and with repetition over the course of the curriculum.     

PBL in Undergraduate Medical Education: A Qualitative Study of the Views of Canadian Residents

Background and Objectives: At McMaster University, the birthplace of problem-based learning (PBL), administrators and curriculum planners have begun the process of renewing the undergraduate MD curriculum. One step has been to conduct an environmental scan that includes input from medical residents. Methods: Individual interviews with 17 medical residents and fellows currently enrolled at McMaster University and are graduates of six Canadian medical schools. Results: PBL appears to be well known even by graduates of non-PBL Canadian medical schools. Tutors are key to a successful PBL program, should be knowledgeable about the content area under study and able to effectively facilitate groups. Tutorial problems should be realistic, up-to-date, and challenge students to investigate more than the medical aspects of the case in question. Students need to be prepared, willing to participate in peer teaching, and supportive of the group learning process. PBL programs can be improved if they incorporate elements of traditional medical programs (e.g., mini-lectures, clear learning objectives, and unbiased evaluation of student progress) while retaining the essence of student-generated learning. Conclusions: Medical residents are an underutilized source of information about undergraduate medical programs. According to our participants, more emphasis on faculty development and upgrading health care problems will improve PBL-based undergraduate medical education.     

Faculty opinions about a revised pre-clinical curriculum

INTRODUCTION: Medical schools having innovative curricula have been encouraged to ascertain the levels of satisfaction of faculty members with the curriculum. Faculty at schools that employ problem-based learning (PBL) have been shown to have positive perceptions, but not all schools are in a position to adopt PBL on a large scale. This study sought to determine faculty members' opinions about a new curriculum that is less ambitious than one utilizing true PBL. CONTEXT AND SETTING: Since 1997, the University of Otago Medical School (Dunedin, New Zealand) has had an integrated, modular pre-clinical curriculum that emphasizes clinical relevance. It has proved popular with students. This study focused on faculty members' impressions. METHODS: We surveyed faculty members' opinions with a questionnaire identical to one used in studies at PBL schools. Faculty compared the students and their own levels of satisfaction in the old and new curricula on 7 to 10 items. The overall response rate was 85.4% (152 of 178). RESULTS: Perceptions of the new curriculum were positive among teachers who taught during the pre-clinical years and those who taught the students only after they reached the clinical years. Results for individual questions were in the same direction and generally similar in magnitude to those reported on identical items for PBL. CONCLUSION: We conclude that a hybrid curriculum that is more acceptable to many traditional teachers and students than is PBL has almost as great a positive effect on faculty members' perceptions of students' abilities and of the curriculum as does PBL.     

Deep and surface learning in problem-based learning: a review of the literature

In problem-based learning (PBL), implemented worldwide, students learn by discussing professionally relevant problems enhancing application and integration of knowledge, which is assumed to encourage students towards a deep learning approach in which students are intrinsically interested and try to understand what is being studied. This review investigates: (1) the effects of PBL on students’ deep and surface approaches to learning, (2) whether and why these effects do differ across (a) the context of the learning environment (single vs. curriculum wide implementation), and (b) study quality. Studies were searched dealing with PBL and students’ approaches to learning. Twenty-one studies were included. The results indicate that PBL does enhance deep learning with a small positive average effect size of .11 and a positive effect in eleven of the 21 studies. Four studies show a decrease in deep learning and six studies show no effect. PBL does not seem to have an effect on surface learning as indicated by a very small average effect size (.08) and eleven studies showing no increase in the surface approach. Six studies demonstrate a decrease and four an increase in surface learning. It is concluded that PBL does seem to enhance deep learning and has little effect on surface learning, although more longitudinal research using high quality measurement instruments is needed to support this conclusion with stronger evidence. Differences cannot be explained by the study quality but a curriculum wide implementation of PBL has a more positive impact on the deep approach (effect size .18) compared to an implementation within a single course (effect size of ?.05). PBL is assumed to enhance active learning and students’ intrinsic motivation, which enhances deep learning. A high perceived workload and assessment that is perceived as not rewarding deep learning are assumed to enhance surface learning.     

The influence of tutoring competencies on problems, group functioning and student achievement in problem-based learning

CONTEXT: Prominent factors in problem-based learning (PBL) are the problems to be solved, tutorial group functioning and tutors' competencies. These factors mutually affect one another and largely determine whether a powerful learning environment will be created. It is a tutor's task to stimulate active, self-directed, contextual and collaborative learning and display interpersonal behaviour that is conducive to students' learning. We investigated the effects of tutors' competencies on students' learning and on other variables, such as group functioning and student achievement. OBJECTIVES: We investigated whether tutors who stimulate active, self-directed, contextual and collaborative learning make better use of problems and meaningful contexts in PBL and also enhance group functioning. We also investigated whether the quality of problems has a positive impact on group functioning and whether group functioning advanced student achievements. METHODS: Questionnaires were used to collect data from students at the end of 11 modules in Years 1 and 2 of a PBL undergraduate medical curriculum. We used structural equation modelling to test the fit of a theoretical model representing the factors of interest and their relationships. RESULTS: Stimulation of active and constructive learning, self-directed learning and collaborative learning by tutors enhanced the quality of the problems and group functioning. The quality of the problems promoted group functioning, which was found to have a positive effect on student achievement. CONCLUSIONS: Tutors' competencies had a positive effect on the learning of students. This suggests that it would be worthwhile including these competencies in staff development.     

Rethinking the globalisation of problem-based learning: how culture challenges self-directed learning

Medical Education 2012: 46: 738–747 Context  Medical schools worldwide are increasingly switching to student‐centred methods such as problem‐based learning (PBL) to foster lifelong self‐directed learning (SDL). The cross‐cultural applicability of these methods has been questioned because of their Western origins and because education contexts and learning approaches differ across cultures. Objectives  This study evaluated PBL’s cross‐cultural applicability by investigating how it is applied in three medical schools in regions with different cultures in, respectively, East Asia, the Middle East and Western Europe. Specifically, it investigated how students’ cultural backgrounds impact on SDL in PBL and how this impact affects students. Methods  A qualitative, cross‐cultural, comparative case study was conducted in three medical schools. Data were collected through 88 semi‐structured, in‐depth interviews with Year 1 and 3 students, tutors and key persons involved in PBL, 32 observations of Year 1 and 3 PBL tutorials, document analysis, and contextual information. The data were thematically analysed using the template analysis method. Comparisons were made among the three medical schools and between Year 1 and 3 students across and within the schools. Results  The cultural factors of uncertainty and tradition posed a challenge to Middle Eastern students’ SDL. Hierarchy posed a challenge to Asian students and achievement impacted on both sets of non‐Western students. These factors were less applicable to European students, although the latter did experience some challenges. Several contextual factors inhibited or enhanced SDL across the cases. As students grew used to PBL, SDL skills increased across the cases, albeit to different degrees. Conclusions  Although cultural factors can pose a challenge to the application of PBL in non‐Western settings, it appears that PBL can be applied in different cultural contexts. However, its globalisation does not postulate uniform processes and outcomes, and culturally sensitive alternatives might be developed.     

From traditional to problem-based learning: a case report of complete curriculum reform

The Sherbrooke School of Medicine, Quebec, has restructured its entire curriculum to make problem-based learning (PBL) the main instructional format. This complete reform is explained both in terms of process and content. The curriculum problems were clearly identified and overcome by a major structural shift-over following the stages of a strategic planning of change. Implementation over a period of 7 years is described according to a four-stage framework: need for change; selection of the PBL solution; planning for implementation; and the full-scale adoption of the PBL method. The programme is described in relation to the congruence of goals, learning and evaluation activities. Initial impact on student learning and evaluation, attracting better quality students, academic staff roles, and on financing the operation are discussed. Changing the undergraduate programme has become an institutional project directed by the Office of the Dean.     

Basic sciences in problem-based learning and conventional curricula: students' attitudes

The purpose of this study was to compare the attitudes toward basic sciences of students in a preclinical problem-based curriculum and a conventional lecture-based curriculum at the end of their second year of medical school. The results showed that the PBL class had more positive attitudes toward basic sciences than students in the conventional class. These results may reflect a learning environment where students meet many scientist role models as teachers and where basic science is learnt in the context of clinical problems.     

Evolutionary trends of problem-based learning practices throughout a two-year preclinical program: a comparison of students’ and teachers’ perceptions

Implementation of a pedagogical approach is a continuous and evolving process. As an institution with more than 15 years problem-based learning (PBL), we studied how the learning and teaching processes are currently practiced in a 2-year preclinical basic sciences program to assess whether they still match the intended objectives. Using both students’ and tutors’ evaluations, we analyzed and compared their perceptions on the program content and its organization, on tutors’ functioning and on the duration of PBL sessions throughout 11 instructional units of the second and third-year of a 6 years medical curriculum. Whereas both tutors and students indicated that the content and problems selected for the curriculum were well adapted to the PBL process, they felt the references as well as the self-study time as moderately appropriate. Over the course of the 2-year program, tutorial sessions got linearly shorter, whereas reporting sessions got longer. While tutors knew well the PBL approach and were suitably prepared to their tutorials, they however, became less regular in providing feedback and in evaluating group functioning over the 2 years. Our results suggest that the practice of the PBL process evolves within and throughout a 2-year preclinical program and moves away from the original intentions. Possible underlying reasons and their implications are discussed within the context of tutors’ and students’ concepts of teaching and learning, the medical schools’ learning environment and teaching practices and the difficulty of developing and maintaining in the long term a deep and self-directed learning approach.     

Early effects of a new problem-based clinically oriented curriculum on students' perceptions of teaching

OBJECTIVES: To compare the course experiences of medical students in a new problem-based (PBL) undergraduate medical course with those of their peers in a conventional curriculum. DESIGN: Whole class questionnaire survey using a pre-validated research instrument. SETTING: University of Liverpool, UK. SUBJECTS: First and second year medical students RESULTS: New curriculum students were more satisfied with their course when compared to their conventional course peers. Problem solving, team working and motivation scores were significantly higher amongst new course (PBL) students. New course students were more anxious about clarity of objectives and standard of work required. CONCLUSIONS: Early evidence suggests that curriculum reform from conventional teaching to a small group problem analysis programme results in improvement in student satisfaction with teaching and the development of appropriate learning skills.     

Problem-based learning: why curricula are likely to show little effect on knowledge and clinical skills

OBJECTIVES: A recent review of problem-based learning's effect on knowledge and clinical skills updated findings reported in 1993. The author argues that effect sizes (ES) seen with PBL have not lived up to expectations (0.8-1.0) and the theoretical basis for PBL, contextual learning theory, is weak. The purposes of this study were to analyse what constitutes reasonable ES in terms of the impacts on individuals and published reports, and to elaborate upon various theories pertaining to PBL. DESIGN: Normal theory is used to demonstrate what various ESs would mean for individual change and a large meta-analysis of over 10 000 studies is referred to in identifying typical ESs. Additional theories bearing upon PBL are presented. RESULTS: Effect sizes of 0.8-1.0 would require some students to move from the bottom quartile to the top half of the class or more. The average ES reported in the literature was 0.50 and many commonly used and accepted medical procedures and therapies are based upon studies with ESs below 0.50. CONCLUSIONS: Effect sizes of 0.8-1.0 are an unreasonable expectation from PBL because, firstly, the degree of changes that would be required of individuals would be excessive, secondly, leading up to medical school, students are groomed and selected for success in a traditional curriculum, expecting them to do better in a PBL curriculum than a traditional curriculum is an unreasonable expectation, and, thirdly, the average study reported in the literature and many commonly used and accepted medical procedures and therapies are based upon studies having lesser ESs. Information-processing theory, Cooperative learning, Self-determination theory and Control theory are suggested as providing better theoretical support for PBL than Contextual learning theory. Even if knowledge acquisition and clinical skills are not improved by PBL, the enhanced work environment for students and faculty that has been consistently found with PBL is a worthwhile goal.     

Integration of pharmacology into a problem–based learning curriculum for medical students

The purpose of this study is threefold: (1) to describe a method of integration of pharmacology subject matter with other disciplines, in a problem-based learning (PBL) curriculum employed at the Northwest Center for Medical Education (NWCME), Indiana University School of Medicine; (2) to present various evaluation methods employed to assess students' learning of pharmacology knowledge; and (3) to compare the academic performance of students who underwent a traditional curriculum versus the PBL curriculum in terms of class evaluations and the standard national board medical licensure examinations. The PBL curriculum is designed for the first 2 years of medical education and consists of six sequential steps: steps 1 and 2 deal with biochemistry and anatomy respectively; steps 3, 4 and 5 deal with physiology, neuroscience and general pathology/microbiology respectively; and step 6 is a multidisciplinary step, which integrates basic science subjects with clinical medicine, emphasizing the mechanism of disease in an organ-system approach. In the PBL curriculum students start learning pharmacology within 6 months of admission. The content and process of pharmacology are spread across the first and in the second year. The pharmacology content is divided into three segments, each of which is integrated with other basic science subjects that have maximum mutual relevance. The three segments are as follows: the general and systemic pharmacology (50%) was included in step 3; the neuropharmacology and toxicology (35%) part was included in step 4; the third segment consisted of antimicrobial agents, anticancer and antiinflammatory agents (15%) and was included in step 5. The class evaluation of student performance in the PBL curriculum consisted of two elements, the content examinations and the process evaluations, which include the tutorial and the triple-jump evaluations of problem-solving skills. In order to assess the overall academic performance of the PBL curriculum and traditional curriculum groups, three classes of students who took the PBLC were compared with three classes of students who underwent a TC for performance in terms of class grades and scores of National Board examinations (NBME I and/or USMLE I). The PBL curriculum students performed as well as or better than the TC students as measured by the NMBE I and/or USMLE I. The gain in pharmacology knowledge of PBL students is accompanied by the presence of a positive experience that learning pharmacology is enjoyable. Our experience suggests that the segmental integration approach of instruction coupled with a system of content (internal and external examinations) and process (tutorial and triple-jump) evaluations, as outlined in this paper is a contextualized learning method that offers an effective way of imparting pharmacology knowledge to medical students.     

Validation of the Tutotest in a hybrid problem-based learning curriculum

The Tutotest is one of the few structured instruments developed for the assessment of students’ learning skills in a problem-based learning (PBL) curriculum. This study was designed to validate the Tutotest in a hybrid PBL curriculum. Forty-four tutors completed 370 evaluations on second to fourth year medical students at the end of the first semester in 2004 using the Chinese version of the Tutotest. There was significant correlation between global rating and Tutotest-C (r = 0.44, P < 0.001). The Cronbach’s α coefficient was 0.97. Two-week test–retest correlation coefficient was 0.85. Factor analysis revealed four factors, where three were similar to the factors of “effectiveness in group”, “communication and leadership skills”, and “respect for others” identified in the original Tutotest. “Hypothesis forming and testing” instead of “scientific curiosity” became the fourth factor in our data. Our study validated the Tutotest-C in a hybrid PBL curriculum and students from the Chinese educational system. The test–retest reliability measure with a 2-week interval at the end of the PBL tutorial confirmed the stability of the Tutotest, which has not been previously reported. Since most Asian medical schools adopted a hybrid PBL curriculum, a valid student evaluation instrument for this type of curriculum is valuable.     

Students' Conceptions of Constructivist Learning: A Comparison between a Traditional and a Problem-based Learning Curriculum

This study investigated students' conceptions of constructivist learning activities in a problem-based learning (PBL) and a traditional curriculum. We examined whether students who have chosen for a problem-based curriculum have different conceptions of constructivist assumptions compared to students who have chosen to be enrolled in a traditional, lecture-based curriculum when they enter university. Although constructivism represents an influential view of learning, studies investigating how students conceptualize this perspective have not been conducted before. A structural equation modelling approach was adopted to test the hypothesized model in both student populations and to calculate latent means. Results suggested that students in the PBL environment agree more on constructivist assumptions of cooperative learning and the use of authentic problems, while students in the traditional curriculum acknowledge the importance of motivation to learn more. It is discussed that conceptions of constructivist learning activities can act as an important moderator of PBL effects and should be considered in examining the effects of PBL and probably in all comparative education research.     

Medical faculty as humanistic physicians and teachers: the perceptions of students at innovative and traditional medical schools

BACKGROUND AND OBJECTIVES: The training of caring physicians represents an important goal of medical education. Little is known however, on whether medical faculty constitute good role models for teaching humanistic skills to medical students. In this study, we examined to what extent medical students at innovative and traditional schools perceived their teachers as humanistic physicians and teachers. We also explored whether pre-clinical and clinical students shared the same perceptions. METHODS: A mail survey was conducted in Canada of all second-year students and senior clerks at one innovative medical school (problem-based learning (PBL), patient-centred, community-oriented) and three traditional medical schools. Students were asked to what extent they agreed or disagreed that the majority of their teachers behaved as humanistic physicians and teachers; 10 statements were used. Overall, 65% of the 1039 students returned the questionnaire. RESULTS: Over 25% of second-year students and 40% of senior clerks did not agree that their teachers behaved as humanistic caregivers with patients or were good role models in teaching the doctor-patient relationship. More than half of second-year students and senior clerks did not agree that their teachers valued human contact with them or were supportive of students who had difficulties. There were few differences in the way medical students at innovative and traditional schools perceived their teachers' humanistic qualities. At the pre-clinical level however, there were more students from the innovative school than from the traditional schools (around 60% vs. 40%, P < 0.005) who agreed that their teachers valued human contact with them and were supportive of students. CONCLUSION: Our results indicate that the PBL curriculum fosters better teacher-student relationships during the pre-clinical years. They also suggest that an unacceptably large number of medical students are taught by physicians who seem to lack compassion and caring in their interactions with patients. This study questions the adequacy of medical faculty as role models for the acquisition of caring competence by medical students.     

Learning in a problem-based medical curriculum: students' conceptions

The purpose of this study was to examine students' conception of their learning in a problem-based learning medical curriculum. A multiple case study design was used with two units of analyses: two PBL lab groups; and 15 individual students within each lab group. Data collected included weekly journals by students, video-tapes of PBL sessions, focus group interviews with students, two open-ended questionnaires completed by students, and interviews with the PBL tutors. Three thematic categories of students' conceptions of their learning emerged: (1) awareness of PBL goals and expectations; (2) efficiency and expertise; and (3) the role of the tutor.     

Task-based learning: the answer to integration and problem-based learning in the clinical years

INTRODUCTION: Integrated teaching and problem-based learning (PBL) are powerful educational strategies. Difficulties arise, however, in their application in the later years of the undergraduate medical curriculum, particularly in clinical attachments. Two solutions have been proposed - the use of integrated clinical teaching teams and time allocated during the week for PBL separate from the clinical work. Both approaches have significant disadvantages. Task-based learning (TBL) is a preferred strategy. In TBL, a range of tasks undertaken by a doctor are identified, e.g. management of a patient with abdominal pain, and these are used as the focus for learning. Students have responsibility for integrating their learning round the tasks as they move through a range of clinical attachments in different disciplines. They are assisted in this process by study guides. METHOD: The implementation of TBL is described in one medical school. One hundred and thirteen tasks, arranged in 16 groups, serve to integrate the student learning as they rotate through 10 clinical attachments. RESULTS: This trans-disciplinary approach to integration, which incorporates the principles of PBL offers advantages to both teachers and students. It recognizes that clinical attachments in individual disciplines can offer rich learning opportunities and that such attachments can play a role in an integrated, as well as in a traditional, curriculum. In TBL, the contributions of the clinical attachments to the curriculum learning outcomes must be clearly defined and tasks selected which will serve as a focus for the integration of the students' learning over the range of attachments.     

Solving problems with group work in problem-based learning: hold on to the philosophy

INTRODUCTION: Problem-based learning (PBL) has gained a foothold within many schools in higher education as a response to the problems faced within traditional education. DISCUSSION: Working with PBL tutorial groups is assumed to have positive effects on student learning. Several studies provide empirical evidence that PBL stimulates cognitive effects and leads to restructuring of knowledge and enhanced intrinsic interest in the subject matter. However, staff members do not always experience the positive effects of group work which they had hoped for. When confronted with problems in group work, such as students who only maintain an appearance of being actively involved and students who let others do the work, teachers all too often implement solutions which can be characterized as teacher- directed rather than student-directed. Teachers tend to choose solutions which are familiar from their own experience during professional training, i.e. using the teacher-directed model. These solutions are not effective in improving group work and the negative experiences persist. CONCLUSION: It is argued that teachers should hold on to the underlying educational philosophy when solving problems arising from group work in PBL, by choosing actions which are consistent with the student-directed view of education in PBL.     

Teaching public health: an innovative method using computer-based project work

Restructuring of training in public health in the Hungarian medical schools is being undertaken in the context of a major European Union tempus Joint European Project. Under the aegis of this project a common core curriculum of public health has been developed. As part of the implementation of the curriculum, new approaches to learning are being explored that should enable students to appreciate the nature and magnitude of the major challenges to public health in Hungary and promote the development of their analytic, interpretative and presentational skills. One of the approaches is based on the individual preparation of reports on important public health issues, making use of secondary data from electronic databases (WHO HFA/PC and OECD Health Data) and traditional printed sources (annuals). This method called 'computer-based project work' was introduced in Debrecen in 1992–1993 with a secondary objective to develop basic computing skills. The initial experiences of introducing computer-based project work to the curriculum have been positive. This paper describes a practical example of the implementation of innovative approaches to teaching in a highly traditional setting in Central Europe, and one that provides ideas and encouragement to those facing similar problems in the countries of Central and Eastern Europe and the former Soviet Union.