Faculty opinions about a revised pre-clinical curriculum

INTRODUCTION: Medical schools having innovative curricula have been encouraged to ascertain the levels of satisfaction of faculty members with the curriculum. Faculty at schools that employ problem-based learning (PBL) have been shown to have positive perceptions, but not all schools are in a position to adopt PBL on a large scale. This study sought to determine faculty members' opinions about a new curriculum that is less ambitious than one utilizing true PBL. CONTEXT AND SETTING: Since 1997, the University of Otago Medical School (Dunedin, New Zealand) has had an integrated, modular pre-clinical curriculum that emphasizes clinical relevance. It has proved popular with students. This study focused on faculty members' impressions. METHODS: We surveyed faculty members' opinions with a questionnaire identical to one used in studies at PBL schools. Faculty compared the students and their own levels of satisfaction in the old and new curricula on 7 to 10 items. The overall response rate was 85.4% (152 of 178). RESULTS: Perceptions of the new curriculum were positive among teachers who taught during the pre-clinical years and those who taught the students only after they reached the clinical years. Results for individual questions were in the same direction and generally similar in magnitude to those reported on identical items for PBL. CONCLUSION: We conclude that a hybrid curriculum that is more acceptable to many traditional teachers and students than is PBL has almost as great a positive effect on faculty members' perceptions of students' abilities and of the curriculum as does PBL.     

Medical education: the observations of pre-clinical and clinical teachers

A questionnaire was distributed to staff who teach medical students at some stage in their 5-year course. Their views were sought on various aspects of medical education, including staff-student relationships and student problems. Differences between clinical and pre-clinical teachers were identified and their implications discussed. The views of the clinical teachers, when different from those of their pre-clinical colleagues, were frequently consistent with those of medical students.     

Implementation of problem-based learning in Asian medical schools and students' perceptions of their experience

BACKGROUND: Since the introduction of problem-based learning (PBL) at McMaster University in 1969, many medical schools in the USA, Canada and Europe have included PBL in their curricula. In the past decade, many medical schools in Asia have also done so. However, so far no one has questioned whether the outcomes expected of the learner in a PBL setting are applicable to students from different cultural upbringings. AIM: The aim of this study was to investigate the implementation of PBL in Asian medical schools, their students' perceptions of this new mode of teaching/learning and how the problems that have arisen may be overcome. METHOD: Published reports and conference presentations were gathered on the implementation of PBL in some Asian medical schools and comparisons of the experiences in PBL of Asian and students of other ethnic backgrounds. RESULTS: Most Asian medical schools and their students appear to be positive about adapting to PBL in their curriculum. The positive and negative observations appear to be similar to those experienced in non-Asian medical schools. The problems that arose for students in Asian medical schools in the early stages of implementing PBL appear to have been overcome after a period of adjustment with the help of supportive and open-minded tutors. The reports also suggested that trigger problems should be carefully designed to make them relevant and interesting for the students. CONCLUSION: Strong support from the academic administrators (dean and other staff responsible for implementation of the curriculum) in the introduction of PBL into the curriculum and careful training of both faculty and students appear to be key factors to ensure the successful implementation of PBL in Asian medical schools.     

A comparison of learning outcomes and attitudes in student- versus faculty-led problem-based learning: an experimental study

OBJECTIVES: To compare learning outcomes and perceptions of facilitator behaviours and small-group process in problem-based learning (PBL) groups led by students and those led by faculty. DESIGN: A prospective, Latin-square cross-over design was employed. Second-year medical students participated in 11 PBL cases over the course of the academic year. For each case, half the student groups were led by faculty and the other half by a student group member selected randomly to serve in the facilitator role. Learning outcomes were assessed by performance on objective examinations covering factual materials pertinent to the case. Perceptions of facilitator behaviours and of group functioning were assessed with a questionnaire completed at the end of each individual case. Focus-group discussions were held to gain more in-depth information about student perceptions and experience. Student-led sessions were observed at random by the investigators. SETTING: A state-supported, US medical school with a hybrid lecture-based and problem-based curriculum. SUBJECTS: One hundred and twenty-seven second-year medical students and 30 basic science and clinical faculty. RESULTS: No differences were detected in student performance on the objective evaluation based on whether the facilitator was a faculty member or peer group member, nor were there any differences in the perceptions of group process. Students gave peer facilitators slightly higher ratings in the second semester of the experiment. In the focus-group discussions, students voiced a general preference for student-led groups because they felt they were more efficient. Observation and focus-group reports suggest that groups led by students sometimes took short cuts in the PBL process. CONCLUSION: In a hybrid lecture- and PBL-based curriculum, student performance on objective examinations covering PBL materials is unaffected by the status of the facilitator (student vs. faculty). However, in peer-facilitated groups, students sometimes took short cuts in the PBL process that may undermine some of the intended goals of PBL.     

Understanding the experience of being taught by peers: the value of social and cognitive congruence

Background  Medical schools use supplemental peer-teaching programs even though there is little research on students’ actual experiences with this form of instruction. Purpose  To understand the student experience of being taught by peers instead of by faculty. Methods  We conducted focus groups with first- and second-year medical students participating in a supplemental peer-teaching program at one institution. From the learner focus group themes, we developed a questionnaire and surveyed all first-year students. Results  Focus groups revealed four learner themes: learning from near-peers, exposure to second-year students, need for review and synthesis, teaching modalities and for the peer-teachers, the theme of benefits for the teacher. Factor analysis of the survey responses resulted in three factors: second-year students as teachers, the benefit of peer-teachers instead of faculty, and the peer-teaching process. Scores on these factors correlated with attendance in the peer-teaching program (P < .05). Conclusions  Students valued learning from near-peers because of their recent experience with the materials and their ability to understand the students’ struggles in medical school. Students with the highest participation in the program valued the unique aspects of this kind of teaching most. Areas for improvement for this program were identified.     

The influence of gender and specialty on reporting of abusive and discriminatory behaviour by medical students, residents and physician teachers

INTRODUCTION: The perception of whether a given behaviour is abusive differs between students and teachers. We speculated that attitudes towards reporting abusive and discriminatory behaviour may vary by specialty as well as by gender. METHODS: We report a cross-sectional survey of incoming medical students, medical students, residents, and teaching faculty at one Canadian medical school. The discrimination and abuse questions were in the following domains: (i) psychological abuse, (ii) sexual abuse, (iii) physical abuse, (iv) gender discrimination, (v) racial discrimination, (vi) disability discrimination, (vii) derogatory remarks regarding homosexuality. The frequency of self-reported witnessed or experienced abusive and discriminatory behaviour was compared by gender, specialty choice and stage of training. RESULTS: The response rates varied by respondent group: 44/56 (79%) of incoming medical students, 177/218 (81%) of medical students, 134/206 (65%) of residents and 215/554 (38%) of physician teachers. The frequency of these behaviours was perceived to be low by both male and female respondents. Abusive and discriminatory behaviour by physician teachers was noted more frequently by residents (P < 0.001) and physician teachers themselves (P < 0.001) compared with incoming medical students. As well, in general, women noted more abusive and discriminatory behaviour by all teachers, compared with men (P < 0. 003). Each response to the abuse/discrimination questions was also modelled as the independent variable using stepwise multiple regression. The area of specialization (surgical versus non-surgical) altered the reporting of abusive and discriminatory behaviour by women. CONCLUSION: We conclude that female surgical residents and medical students undergo a process of acclimatization to the patriarchal surgical culture. As female surgeons become physician teachers they revert to a culture more similar to that of their female non-surgical colleagues. Although a process of deidealization occurs in medical training, these attitudes are not necessarily retained throughout the practising lifetime of physicians as they regain autonomy and more personal control.     

Providing early clinical experience in primary care

Undergraduate courses in British medical schools are changing following recommendations from the General Medical Council. Increasing emphasis has been placed on teaching in the community. Nottingham Medical School has pioneered the teaching of basic clinical skills in primary care during the pre-clinical course to help produce an integrated curriculum. This qualitative study evaluated the first two years of the new early clinical experience course at Nottingham by using interviews with 19 students and their GP tutors. Students claimed to have gained confidence in talking to patients, their understanding of the role of the doctor and the importance of the doctor-patient relationship. Students were less confident about examining patients and some reported having had little opportunity to practice examination skills. Half the students thought that the early clinical visits had helped them to understand and be more motivated to learn their basic medical sciences course. The newly recruited GP teachers were highly motivated, very positive about the early clinical teaching and all wanted to continue to teach the pre-clinical students. Difficulties in providing the course included communication with students and staff, organization of student travel and variation in the quality of teaching. However, the Nottingham early clinical experience course has shown that basic clinical skills can be successfully taught to pre-clinical students in primary care.     

Student feedback in problem based learning: a survey of 103 final year students across five Ontario medical schools

CONTEXT: Problem based learning (PBL) has become an integral component of medical curricula around the world. In Ontario, Canada, PBL has been implemented in all five Ontario medical schools for several years. Although proper and timely feedback is an essential component of medical education, the types of feedback that students receive in PBL have not been systematically investigated. OBJECTIVES: In the first multischool study of PBL in Canada, we sought to determine the types of feedback (grades, written comments, group feedback from tutor, individual feedback from tutor, peer feedback, self-assessment, no feedback) that students receive as well as their satisfaction with these different feedback modalities. SUBJECTS AND METHODS: We surveyed a sample of 103 final year medical students at the five Ontario schools (University of Toronto, McMaster University, Queens University, University of Ottawa and University of Western Ontario). Subjects were recruited via E-mail and were asked to fill out a questionnaire. RESULTS: Many students felt that the most helpful type of feedback in PBL was individual feedback from the tutor, and indeed, individual feedback was one of the more common types of feedback provided. However, although students also indicated a strong preference for peer and group feedback, these forms of feedback were not widely reported. There were significant differences between schools in the use of grades, written comments, self-assessment and peer feedback, as well as the immediacy of the feedback given. CONCLUSIONS: Across Ontario, students do receive frequent feedback in PBL. However, significant differences exist in the types of feedback students receive, as well as the timing. Although rated highly by students at all schools, the use of peer feedback and self-assessment is limited at most, but not all, medical schools.     

Teachers'' perceptions concerning the relative values of personal and clinical characteristics and their influence on the assignment of students'' clinical grades

Twenty senior teachers were asked to rank, in order of influence, the seven clinical and five personal characteristics used to grade third-year medicine clerks. Seventeen perceived themselves to be more influenced by clinical characteristics when assigning grades. Independently, the actual ratings completed over a 3-year period by these same teachers were analysed to measure the congruency between their perceived and actual grading behaviour. When actually rating students only nine raters were more influenced by clinical characteristics and just one half of the teachers displayed a congruency between their perceived and actual rating behaviour. The implications of these findings are discussed.     

Assessment of student performance in problem-based learning tutorial sessions

OBJECTIVES: To assess student performance during tutorial sessions in problem-based learning (PBL). DESIGN: A 24-item rating scale was developed to assess student performance during tutorial sessions in problem-based learning (PBL) as conducted during the pre-clinical years of Medical School at the National Autonomous University of Mexico. Items were divided into three categories: Independent study, Group interaction and Reasoning skills. Fourteen tutors assessed 152 first and second-year students in 16 tutorial groups. An exploratory factor analysis with an Oblimin rotation was carried out to identify the underlying dimensions of the questionnaire. SETTING: Medical School at the National Autonomous University of Mexico. SUBJECTS: Medical students. RESULTS: Factor analysis yielded four factors (Independent study, Group interaction, Reasoning skills, and Active participation) which together accounted for 76.6% of the variance. Their Cronbach reliability coefficients were 0.95, 0.83, 0.94 and 0. 93, respectively, and 0.96 for the scale as a whole. CONCLUSIONS: It was concluded that the questionnaire provides a reliable identification of the fundamental components of the PBL method as observable in tutorial groups and could be a useful assessment instrument for tutors wishing to monitor students' progress in each of these components.     

Interns'' evaluation of their preparation for general practice: a comparison between the University of Tromsø and the University of Bergen

A total of 168 interns who have graduated from the Medical Schools of Bergen and Tromsø were asked about various aspects of the medical curriculum. In Bergen the curriculum has a traditional structure with a pre-clinical and a clinical part, but in Tromsø the pre-clinical and clinical subjects are integrated. In addition, the students in Tromsø spend long periods in municipal hospitals and in the primary health care service. We were interested in how the interns from the two universities evaluated their respective curricula and how prepared they felt for their current work. There was a response rate of 86% to the questionnaire. The results showed that the interns from Tromsø are more satisfied with their education and feel more confident in their practical skills than the interns from Bergen. They are also more motivated for future work in general practice. In our opinion the main reason for these results is the difference in curricula in the two medical schools. Other possible reasons are also discussed.     

Tutoring in problem-based learning: perceptions of teachers and students

This study examined teacher and student perceptions during the first 2 years of a complete transition from a conventional to a problem-based learning (PBL) curriculum at Dalhousie University. Teaching staff who had tutored in the two pre-clinical years (   n = 88  ) completed a questionnaire at the end of the 1993–94 academic year, and student assessments of their tutors were collated for all nine units (   n = 597  ).
Seven research questions were addressed in the study which examined the faculty, student and administrative aspects of tutoring. The results showed that faculty tutors rated PBL more highly than traditional medical school methods on eight of the nine items. Teaching staff were very satisfied with their tutoring experience, but expressed a need for further training in group facilitation, questioning, handling 'difficult' situations and evaluating students. They reported that their workload outside tutorials was cut almost in half in their second year of tutoring. Students expected a tutor to be a skilled group facilitator who would guide them in their learning, while helping to maintain a positive group climate. They did not want the tutor to teach the content as they perceived the task of learning to be their responsibility.
Several major administrative factors affected tutors' and students' perceptions of tutorials, including: changing tutorial group composition and tutor every 8–10 weeks; team tutoring; end-of-unit exam; conflicting demands of basic science 'vertical' units and ongoing 'horizontal' units; departmental budgetary requirements for basic medical education; recognition of tutoring in promotion and tenure decisions; and recruitment of tutors.     

Problem-based learning: why curricula are likely to show little effect on knowledge and clinical skills

OBJECTIVES: A recent review of problem-based learning's effect on knowledge and clinical skills updated findings reported in 1993. The author argues that effect sizes (ES) seen with PBL have not lived up to expectations (0.8-1.0) and the theoretical basis for PBL, contextual learning theory, is weak. The purposes of this study were to analyse what constitutes reasonable ES in terms of the impacts on individuals and published reports, and to elaborate upon various theories pertaining to PBL. DESIGN: Normal theory is used to demonstrate what various ESs would mean for individual change and a large meta-analysis of over 10 000 studies is referred to in identifying typical ESs. Additional theories bearing upon PBL are presented. RESULTS: Effect sizes of 0.8-1.0 would require some students to move from the bottom quartile to the top half of the class or more. The average ES reported in the literature was 0.50 and many commonly used and accepted medical procedures and therapies are based upon studies with ESs below 0.50. CONCLUSIONS: Effect sizes of 0.8-1.0 are an unreasonable expectation from PBL because, firstly, the degree of changes that would be required of individuals would be excessive, secondly, leading up to medical school, students are groomed and selected for success in a traditional curriculum, expecting them to do better in a PBL curriculum than a traditional curriculum is an unreasonable expectation, and, thirdly, the average study reported in the literature and many commonly used and accepted medical procedures and therapies are based upon studies having lesser ESs. Information-processing theory, Cooperative learning, Self-determination theory and Control theory are suggested as providing better theoretical support for PBL than Contextual learning theory. Even if knowledge acquisition and clinical skills are not improved by PBL, the enhanced work environment for students and faculty that has been consistently found with PBL is a worthwhile goal.     

Do conventional and innovative medical schools recruit different students?

A mail questionnaire was used to survey the social and demographic characteristics, educational background, attitudinal profiles and expected career choice of 243 first-year students enrolled in three US medical schools. The aim was to determine whether different types of schools selected different types of students. Two schools were considered as conventional whereas one school was considered as innovative both in its admission policies and in its curriculum which emphasizes a biopsychosocial approach to health care. The survey achieved an 84% response rate. The results showed no difference in students' career expectations. Students recruited in the innovative school, however, differed from students recruited in the conventional schools with regard to their social and demographic characteristics, educational background and attitudinal profiles. This study suggests that as some medical schools are innovating in their curriculum and admission policies, new types of medical students are entering medicine. Implications of these results are discussed.     

Communication skills teaching, learning and assessment

This paper outlines an introductory course in teaching communication skills to medical students in a preclinical context. The aims of the course, its content and teaching methods are described. Novel features include the active participation of selected patients in teaching and assessment, and the use of a form of role-play named 'listening triads'. The main focus of the paper is assessment, and results are recorded, relating to a class of 114 second-year students during the academic session 1983-84. Assessment of the students' learning was measured by Modified Essay Question (MEQ); students' problems face-to-face with patients were identified by patients, students, and by staff members observing interactions. Problems of fitting these educational assessments into a traditional academic 'certifying' type of assessment remain unresolved at present. This course was found to be acceptable by the preclinical students, and their lack of clinical knowledge did not appear to interfere with their learning. They were enthusiastic about the supervised contact with patients, which appeared to contribute significantly to the way the course was received.     

Medical students' attitudes towards and perception of the basic sciences: a comparison between students in the old and the new curriculum at the University Medical Center Utrecht,The Netherlands

OBJECTIVES: The attitudes towards the basic sciences of medical students enrolled in either of 2 different curricula at the University of Utrecht Medical School in The Netherlands were investigated. The purpose of this study was threefold: first, to compare students (beginning clerks) in a conventional and an innovative curriculum; second, to compare beginning clerks with advanced clerks; and third to compare the present results with those of 2 previous American and Canadian studies in which the same questionnaire was used. SETTING: Beginning clerks in the old and in the innovative curriculum, and advanced clerks in the old curriculum, rated 9 statements on a 5-point (disagree - agree) Likert scale. The statements assessed students' attitudes toward the basic sciences. RESULTS: The results showed that beginning clerks in our innovative curriculum, unlike those in a conventional curriculum, consider the basic sciences as somewhat less important for medical practice and do not think that as many biomedical facts as possible should be learned before entering clinical practice. On the other hand, students in the innovative curriculum are more excited by the faculty's teaching of the basic sciences. This latter result confirms the findings in a previous Canadian study. No significant differences were found between beginning and advanced clerks in the conventional curriculum. CONCLUSION: Students experience teaching of the basic sciences as more exciting when they are integrated in organ system blocks with clinical bearings, though they are somewhat less positive about the actual importance of these sciences.     

Current status of curriculum mapping in Canada and the UK

Context  As part of curriculum evaluation, management and quality assurance strategies, many undergraduate medical schools are in the process of constructing computer-based curriculum maps.
Methods  A survey was distributed to Canadian and UK medical schools to determine the current status, characteristics, and challenging and successful aspects of their efforts in curriculum mapping. Quantitative and qualitative analyses were performed.
Results  The majority of schools are in the process of building maps and about 20% of schools have completed maps but continue to upgrade them. The software used to construct the maps and the educational elements included in them vary among schools. A variety of educational outcome frameworks are employed for curriculum evaluation. Current major challenges include human resource demands, the use of medical ontologies, faculty development and interface design.
Conclusions  Given that these problems are common and their solutions are resource-intensive, there is a place for collaboration and a need for further research.     

Assessing performance in final year medical students. Can a postgraduate measure be used in an undergraduate setting?

BACKGROUND: The transition between medical school and graduate performance should be a continuum. This study aimed to evaluate an assessment tool developed for practising doctors when applied to undergraduates. METHODS: A 12-item rating form was developed from that used for practising doctors by the Royal Australasian College of Physicians. Over a 2-year period, senior doctors, junior doctors and nurses completed the rating form on final year medical students. Some students completed self-assessments. We performed factor analysis and correlated scores between raters and attachments. Correlating ratings with concurrent traditional assessment results across the year tested construct validity. RESULTS: Ten forms per student were distributed for all 123 students and 856 were returned (70%). Internal consistency was very high. In all, 71.1% of the variance was accounted for by two factors (clinical skills and humanistic). This factor structure is unchanged when restricted to different raters and is the same as that noted previously when rating practising doctors. There were good correlations between raters (including self) and between attachments. Nurse ratings were reliable but nurses rated students significantly lower on humanistic qualities. Correlations with traditional assessments were high when all traditional assessments were combined. Women scored more favourably than men on humanistic qualities. CONCLUSION: A rating instrument for doctors in practice retains the same factor structure and a high degree of reliability and validity for senior medical students. Reliable ratings by nurses have implications for measures of collegiality and teamwork. We believe the instrument could be a useful outcome measure for medical programmes and employers.     

Smoking patterns at a British and at an American medical school

Cigarette smoking among medical students at the University of Bristol (Bristol) and the New York University School of Medicine (NYU) was investigated and differences were subjected to statistical analysis.
At Bristol 34–6% and at NYU 14–3% of respondents classified themselves as regular smokers. Among students in the pre-clinical phase of training the difference between the number of smokers at Bristol and at NYU was not significant. At both schools more clinical students smoked than preclinical students, but only at Bristol did the difference between the number of smokers in the two grade levels reach statistical significance.
There are fewer heavy smokers (consumers of more than twenty cigarettes per day) among the pre-clinical students at Bristol than among preclinicals at NYU. In the clinical year, however, there were slightly (insignificantly) fewer heavy smokers at NYU while there were significantly more at Bristol.
Smokers at NYU acquired the habit at a somewhat earlier age than the smokers at Bristol.
The majority of students at both schools indicated that medical education had not influenced their decision to smoke or not to smoke.
Most smokers—more among the clinical than the pre-clinical students—reported that they were displeased with their habit and that they wished to give it up. Somewhat fewer smokers at Bristol gave that response than students at NYU.
Factors contributing, at least in part, to the differences between smoking patterns observed may be variables of age and years of education.
The widely held but untested belief that precept and example by medical school teachers may be a potent force for modifying the smoking behaviour of health professionals, is in need of research.