Peer tutoring and student outcomes in a problem-based course

Summary: Summary. Does peer-tutoring affect students’ educational outcomes in problem-based learning? Students’ characteristics and outcomes were compared along 14 successive classes of a problem-based learning course in the University of Brasilia medical programme. In the first stage of this time series, 26 teacher-tutored groups were formed; in the second stage, 50 groups had both teacher- and peer-tutoring. Both groups had equivalent characteristics in stages one and two as regards membership size and composition (students’ learning style, self-confidence and motivation to learn). Results showed that scores for problem-solving tests and self-evaluation of skills were not significantly different between first and second stage groups. However, scores of meaningfulness of course experience and group work usefulness were significantly higher in the peer-tutoring stage. Significant positive correlations were found between scores of meaningfulness of course experience and both self-evaluation and group work usefulness but not between the first measure and group size or motivation to learn. The findings suggest that peer-tutoring can facilitate group work without sustained loss of cognitive achievement in long range conditions of problem-based learning experience.     

Benefiting from clinical experience: the influence of learning style and clinical experience on performance in an undergraduate objective structured clinical examination

OBJECTIVE: To assess the relationship between clinical experience, learning style and performance in an objective structured clinical examination (OSCE) in medical students at the end of their first clinical year. DESIGN: Prospective study of undergraduate students taking an OSCE examination at the end of their first clinical year. SUBJECTS: 194 undergraduate medical students (95 male). MAIN OUTCOME MEASURES: Performance in the OSCE examination, the Entwhistle Learning Style Inventory1 and a composite self-reported score of clinical activity during the students first clinical year. RESULTS: Performance in the OSCE examination was related to well-organized study methods but not to clinical experience. A significant relationship between clinical experience and organized deep-learning styles suggests that knowledge gained from clinical experience is related to learning style. CONCLUSIONS: The relationship between clinical experience and student performance is complex. Well-organized and strategic learning styles appear to influence the benefits of increased clinical exposure. Further work is required to elucidate the most beneficial aspects of clinical teaching.     

Students' perceptions of the relative advantages and disadvantages of community-based and hospital-based teaching: a qualitative study

AIMS: To obtain the perceptions of first-year clinical medical students of the relative advantages and disadvantages of community-based and hospital-based clinical teaching. METHODS: A qualitative study. A purposive sample of first-year clinical medical students who had experienced both community-based and hospital-based teaching was invited to participate in individual semistructured interviews or focus groups. Interviews and focus groups were audiotaped and transcribed to facilitate content analysis of the data. A total of 24 students participated in individual interviews and a further 18 took part in focus groups. RESULTS: Respondents identified advantages and disadvantages specific to teaching in each setting. Chief advantages of hospital-based learning were perceived to include learning about specialties and the management of acute conditions, and gaining experience of procedures and investigations. Community-based learning was perceived as particularly appropriate for learning about psychosocial issues in medicine, for increasing students' awareness of patient autonomy and for improving communication skills. In addition, aspects of organization and of teaching methods employed by community tutors, although not site-specific, were viewed as conducive to a positive educational experience. Students perceived some areas, such as clinical skills acquisition, to be equally well learned in either setting. DISCUSSION: As community-based teaching forms a greater proportion of the undergraduate medical experience, medical educators must find ways of determining the specific advantages that community and hospital settings can contribute to undergraduate learning and of using these resources effectively to develop comprehensive and integrated curricula. Innovations in teaching methods may also be necessary to provide an effective educational experience and promote active learning.     

Teaching and learning about human sexuality in undergraduate medical education

BACKGROUND: Effective management of the doctor's role in relation to human sexuality requires sensitivity and tact, an ability to put patients at ease, use of appropriate language, and therapeutic, non-discriminatory attitudes. However, previous research suggests that medical students and doctors may hold negative attitudes towards homosexuality and some forms of sexual behaviour. Some educational programmes have started to help students develop communication skills for sexual health consultations, but little work has addressed the broader issue of attitudes and values which may underlie behaviour. It is vital that medical students begin early the process of reflection and recognition of how their attitudes and values might influence their care of patients. In this paper we report on a course designed to initiate this process at Leicester-Warwick Medical School (LWMS). COURSE DESCRIPTION: The course utilizes techniques of desensitization, problem-solving and reflection to enable the students to achieve the learning outcomes, which are primarily oriented towards reflection and self-development. It uses a variety of teaching and learning strategies, combining peer learning with self-directed learning, and small-group learning with whole class learning. COURSE EVALUATION: We report observations and a before-and-after questionnaire study of students' views and attitudes. This evaluation suggests that the course is successful in reducing students' anxieties about human sexuality and improving their confidence in developing appropriate skills. CONCLUSIONS: The LWMS course is one model which might be used to begin the process of encouraging medical students to develop ways of appropriately managing their responsibilities in relation to human sexuality.     

What kind of motivation drives medical students' learning quests?

AIMS: To describe the patterns of medical students' motivation early in the undergraduate programme and to examine their relationships with learning features and motivational outcomes. METHODS: The Academic Motivation Scale (AMS) was administered after the first medical year to 297 students of both sexes from consecutive classes within a 4-year timeframe. Measures of learner orientation and reflection in learning were also obtained. Academic achievement and peer tutoring experience were recorded during a 2-year follow-up. Quantitative approaches included analysis of variance, correlational and classificatory analyses of the data. RESULTS: The profile of the students' responses revealed higher levels of autonomous motivation than of controlled motivation although such measures were positively related. Correlation analysis showed significant association of autonomous motivation with higher levels of meaning orientation, reflection in learning, academic achievement, cross-year peer-tutoring experience, and intention to continue with studies. Classificatory analysis identified 4 student groups with distinct patterns of motivation. Analysis of variance revealed significant and consistent differences in learning features and outcomes among such groups. CONCLUSIONS: The findings indicate that medical students portray distinct patterns of autonomous and controlled motivation that seem to relate to the learners' frame of mind towards learning as well as the educational environment. Autonomous motivation had closer relationships than controlled motivation with measures of self-regulation of learning and academic success in the context of a demanding medical programme.     

Health promotion projects: skill and attitude learning for medical students

OBJECTIVES: The aim of this health promotion project is to introduce students to appropriate skills and attitudes--as well as knowledge about health promotion strategies and methods. As part of this process, standardized procedures have been established to ensure that the projects are scientifically and ethically appropriate and adequately supervised. This project-centred course introduces the discipline of health promotion to third-year medical students at Monash University. It is aimed at introducing students to the range of health promotion concepts, providing them with experience of health promotion activities and involving them in consideration of the scientific, political and ethical issues arising from doctors' participation in health promotion. DESIGN: As the major learning and assessment component of the unit, students participate in self-selected project groups of three to five students. Each group develops a topic for a health promotion activity in the community, carries out that project and presents the results as a poster as well as a written report. SETTING: Monash University. SUBJECTS: Third-year medical students. RESULTS: Sixty per cent of each student's mark for the unit is based on the project. The posters produced by the project groups are placed on public display in a major teaching hospital for a week at the end of the unit. Public display of the posters helps each student to appreciate the variety of possible health promotion activities, and to appreciate health promotion as a scientific discipline. It also makes the project findings available to the public. CONCLUSIONS: Student evaluation of the project, and community response to the projects--especially the poster display-- indicate that the project is both a highly effective learning experience and a health-promoting activity in its own right.     

A home visit programme to teach medical students about children with special needs

OBJECTIVES: During an 8-week clinical rotation in paediatrics and child health, fifth-year medical students at the University of Cape Town are required to visit children with special needs in their homes. The home visit allows students to learn, first-hand, from children with special needs and their families about living with chronic disease and disability. DESIGN: During 1998 students anonymously completed home visit evaluation questionnaires (90% response rate, 160/177). Through verbal presentations, students are assessed on their ability to make a comprehensive evaluation of the impact of chronic disease and disability on a child and family. SETTING: University of Cape Town Medical School. SUBJECTS: Fifth-year medical students. RESULTS: A content analysis of verbal presentations found students were more likely to identify medical, psychosocial and economic than spiritual and ethical issues. As a learning experience, 37% (n=57) of students rated the home visit as 'extremely worthwhile', 62% (n=100) found it 'worthwhile' and only 2% (n=3) felt it was 'a waste of time'. Most (97%, n=155) students felt the programme should continue in the future. CONCLUSIONS: As an educational tool, home visiting grounds learning in families' experience and encourages reflection beyond the medical aspects of care for children with special needs.     

Providing early clinical experience in primary care

Undergraduate courses in British medical schools are changing following recommendations from the General Medical Council. Increasing emphasis has been placed on teaching in the community. Nottingham Medical School has pioneered the teaching of basic clinical skills in primary care during the pre-clinical course to help produce an integrated curriculum. This qualitative study evaluated the first two years of the new early clinical experience course at Nottingham by using interviews with 19 students and their GP tutors. Students claimed to have gained confidence in talking to patients, their understanding of the role of the doctor and the importance of the doctor-patient relationship. Students were less confident about examining patients and some reported having had little opportunity to practice examination skills. Half the students thought that the early clinical visits had helped them to understand and be more motivated to learn their basic medical sciences course. The newly recruited GP teachers were highly motivated, very positive about the early clinical teaching and all wanted to continue to teach the pre-clinical students. Difficulties in providing the course included communication with students and staff, organization of student travel and variation in the quality of teaching. However, the Nottingham early clinical experience course has shown that basic clinical skills can be successfully taught to pre-clinical students in primary care.     

What can students learn from studying medicine in literature?

OBJECTIVE: To identify what students can learn from studying medicine and literature as part of a final-year special study module in general practice. METHOD: The project reports and evaluation forms completed by all eight students who had chosen to study medicine and literature as part of their special study module in general practice at Nottingham University Medical School were analysed qualitatively. RESULTS: Students said that they gained a greater understanding of the patient's experience of illness, as a result of the texts they had read. They learned how illness can affect family or friends of the patient and about the psychological impact of physical illness. Most students thought their future care of patients would be influenced by what they had learned. Studying medicine in literature during a clinical attachment allowed students to draw comparisons between literature and their clinical experience. DISCUSSION: This study is based on a small number of students who chose to study medicine in literature. The results may not be generalizable to all medical students and not all students may be receptive to this method of learning. However, we recommend that students who are interested should be given the opportunity to study medicine in literature during their clinical years. This can enable them to reflect on their clinical experience and can provide a more profound understanding of the consequences of illness for the patient and their family.     

Assessing student reflection in medical practice. The development of an observer-rated instrument: reliability, validity and initial experiences

INTRODUCTION: This study describes the development of an instrument to measure the ability of medical students to reflect on their performance in medical practice. METHODS: A total of 195 Year 4 medical students attending a 9-hour clinical ethics course filled in a semi-structured questionnaire consisting of reflection-evoking case vignettes. Two independent raters scored their answers. Respondents were scored on a 10-point scale for overall reflection score and on a scale of 0-2 for the extent to which they mentioned a series of perspectives in their reflections. We analysed the distribution of scores, the internal validity and the effect of being pre-tested with an alternate form of the test on the scores. The relationships between overall reflection score and perspective score, and between overall reflection score and gender, career preference and work experience were also calculated. RESULTS: The interrater reliability was sufficient. The range of scores on overall reflection was large (1-10), with a mean reflection score of 4.5-4.7 for each case vignette. This means that only 1 or 2 perspectives were mentioned, and hardly any weighing of perspectives took place. The values over the 2 measurements were comparable and were strongly related. Women had slightly higher scores than men, as had students with work experience in health care, and students considering general practice as a career. CONCLUSIONS: Reflection in medical practice can be measured using this semistructured questionnaire built on case vignettes. The mean score allows for the measurement of improvement by future educational efforts. The wide range of individual differences allows for comparisons between groups. The differences found between groups of students were as expected and support the validity of the instrument.     

Medical students' perceptions of their educational environment: expected versus actual perceptions

Objective To compare Year 1 medical students' perceptions of their educational environment at the end of Year 1, with their expectations at the beginning of the year using the Dundee Ready Education Environment Measure (DREEM). Methods Year 1 students (n = 130) at the University of East Anglia Medical School were asked to complete the DREEM during their induction week at the beginning of Year 1, thinking about the educational environment they expected to encounter (Expected DREEM), and again as part of a compulsory evaluation at the end of Year 1, thinking about the educational environment they had actually experienced (Actual DREEM). A total of 87 students (66.92% of the starting cohort) completed the DREEM on both occasions and gave permission for their data to be published. Results The Expected DREEM score was 153 out of a maximum of 200, and the Actual DREEM score was 143. Student's expected perceptions of learning and teachers, and their expected academic self- and social self-perceptions were all more positive than their actual perceptions. There was no difference between expected and actual perceptions of atmosphere. Specific aspects of the educational environment showing dissonance were identified. In some areas students' low expectations had been matched by their actual experience. Conclusions Medical students had started Year 1 with expectations about the educational environment that had not been met. However, areas showing dissonance received low item scores on the Actual DREEM and as such would be picked up for remediation, even without information about student expectations.     

Effectiveness of basic clinical skills training programmes: a cross-sectional comparison of four medical schools

OBJECTIVE: Training in physical diagnostic skills is an important part of undergraduate medical education. The objective of this study was to study the outcome of skills training at four medical schools. CONTEXT: At the time of the study, three schools had a traditional lecture-based curriculum and one school had a problem-based learning curriculum with a longitudinal skills training programme. All schools offer extended exposure to clerkships. METHOD: A cross-sectional study in four medical schools was performed, using a written test of skills that has good correlation with actual student performance. The scores attained from four student groups were compared within and between the four medical schools. A total of 859 volunteer students from the later four years at each medical school participated in the study. RESULTS: The mean scores in the traditional medical schools increased with the start of skill training and the hands-on experience offered during the clerkships. Students from the school with the longitudinal skills training programme and the problem-based learning approach had significantly higher mean scores at the start of the clerkships, and maintained their lead in the subsequent clinical years. CONCLUSIONS: Longitudinal skills training seems to offer the students a superior preparation for clerkships as well as influencing the students' learning abilities during the clerkships. The effect of the problem-based learning approach, also related to the innovative philosophy of the curriculum, could not be accounted for.     

Patient-centred medicine through student-centred teaching: a student perspective on the key impacts of community- based learning in undergraduate medical education

CONTEXT: The UK General Medical Council has proposed that increased use of community settings is essential to enhancement of medical education. However, such curriculum developments have been directed by educationalists and clinical faculty; there is to date little to show whether student perspectives accord with such expectations. AIM: To examine student views on whether community-based learning during a UK undergraduate medical education course results in new learning in the areas expected, and to elucidate any process factors which enhance attainment of learning objectives. METHOD: Nominal group technique, to develop consensus on important learning outcomes and process factors, and questionnaire survey, developed from the views of the nominal groups. RESULTS: 89 students participated (response rate 70% for the nominal groups, and 88% for questionnaire). Students perceived increased learning in many of the areas expected. In particular, students reported significant learning from: witnessing the impact of a longer term and more personal relationship with patients; the visible impact of social environment on health; the importance of dealing with people rather than diseases, and the use of the whole team for care. In addition, they emphasized that tutor, staff and patient enthusiasm for student presence and learning greatly enhanced the student learning experience. CONCLUSIONS: Community settings appear to achieve the expected attitudinal adaptation of students. The role of the committed tutor and team is seen as pivotal to learning. The conclusions support an increased emphasis in contemporary medical education and related research activity on the key impact of relationships in the learning environment.     

Portfolios as a learning tool in obstetrics and gynaecology undergraduate training

CONTEXT: We developed a structured portfolio for medical students to use during their obstetrics and gynaecology undergraduate training. The main objective was to support the learning process of the students. We also wanted feedback information to enhance teaching. METHODS: The study population consisted of 91 medical students who completed the portfolio during their training course. The portfolio consisted of a 28-page A5-size booklet. The students entered all the clinical procedures they had performed and all the deliveries they had attended. After each group session, they answered questions about what they had learned and evaluated the performance of the teacher. They also indicated their general evaluation of the course and the portfolio itself. The teachers listed the 13 most important skills to be learned during the course. The students were asked to evaluate their own development on a scale of 0-5 before and after the course. A content analysis was performed on all the texts the students produced, and all quantitative variables were coded. RESULTS: The amount of text written in the portfolio correlated (P < 0.001, F-value 4.2) with success in the final exam. In addition to acting as a logbook, use of the portfolio enhanced the learning process during the course. Students' attitudes towards the portfolio were mainly positive. Students appreciated the departmental interest in their learning process. CONCLUSION: Portfolios support the personal and professional development of medical students. A portfolio clarifies the learning goals and helps students to monitor how these goals are achieved. A portfolio encourages constant self-reflection.     

Structured packs for independent learning: a comparison of learning outcome and acceptability with conventional teaching

OBJECTIVES: The GMC recommends that students become independent learners, while tutor time is an increasingly precious resource. A set of structured learning materials requiring students to undertake and reflect on practical tasks in five learning areas was developed. DESIGN: The study used a randomized control trial to evaluate the effectiveness of using these structured learning materials in place of conventional teaching for 228 third-year undergraduate students and 55 teachers, on both hospital and community based medical and general practice firms. Evaluation involved assessing student performance on an examination question and a writing task, together with a student and tutor satisfaction questionnaire. SETTING: King's College School of Medicine and Dentistry, London. SUBJECTS: Third-year medical (first-year clinical) undergraduates. RESULTS: No significant difference in learning outcome was found for students on community- and hospital-based medical and general practice firms between students who had used the structured materials and those who had had conventional teaching on the same topic. The packs were acceptable to tutors and students. CONCLUSIONS: Such resources represent a mid-point between formal didactic teaching and self-directed learning. They may be particularly suitable for promoting independent learning for students on traditional medical courses. They offer an appropriate way to cover certain topics in the clinical curriculum and help to protect tutor time for topics which cannot be effectively taught in other ways.     

Teaching in the new NHS: the specialised ward based teacher

OBJECTIVES: To evaluate the effects of introducing specialised ward based teachers (WBTs) who had a broad remit to improve third year medical undergraduates' clinical experience. DESIGN: Quantitative and qualitative methods including interviews with WBTs, participating consultants and SIFT co-ordinator; student questionnaire and evaluations; analysis of Objective Structured Clinical Examination (OSCE) scores to ascertain if exposure to WBTs affected OSCE scores. SETTING: Two university teaching hospitals. PARTICIPANTS: Third year undergraduate medical students from one school of medicine; four WBTs; 25 consultants; SIFT co-ordinator. MAIN OUTCOME MEASURES: Student evaluations. Student questionnaires. Student OSCE scores. Interview data. RESULTS: WBTs had a demonstrable effect on student performance in OSCE examinations. 94% of students either agreed or strongly agreed that WBTs had helped them develop their examination skills and 87% either agreed or strongly agreed that WBTs had helped them develop their history taking skills. Interview data indicated that the consultants and SIFT co-ordinator considered that WBTs made an important contribution to clinical teaching. CONCLUSIONS: This study suggests that specialised WBTs are one way to manage clinical experience and enhance learning of undergraduate medical students. As clinical teaching moves into earlier parts of the undergraduate curriculum and into the community there is potential for this role to be developed.     

Graduate evaluation of undergraduate teaching programmes in paediatrics

In a new undergraduate teaching course in child health, medical students were encouraged to prepare and present topics to their colleagues. These presentations covered major subjects in paediatric medicine and were supervised by an experienced teacher. Students were then asked to evaluate the programme at the end of their course in child health and after graduation. Evaluation scores for these presentations were high at the end of the course. Spontaneous comments suggested some disadvantages such as poor or too-detailed student presentations. However, some noted the value of personal research. After graduation, more positive comments were made and the majority felt that the course had advantages in the area of personal research, that it was better than or as good as other teaching methods, and that it should be continued in its present format.     

Problem-based learning versus lecture-based learning in a course of basic pharmacology: a controlled, randomized study

Since its first implementation in a medical programme at McMaster University, Canada, problem-based learning (PBL) has become a well-established means of teaching and learning medicine. Extensive research has been conducted and a number of strengths of the method are well supported. Several items, however, remain unclear although there is evidence that no relevant difference exists in factual knowledge among students from PBL and traditional curricula, a controlled, randomized study has not been conducted to address this issue. The Medical Faculty of the University of Cologne is in the process of integrating elements of PBL into its curriculum. In the spring term of 1997, after seven semesters of experience with PBL supplementing the traditional course of basic pharmacology, we did for the first time use PBL instead of the lecture-based course (LBL) and conducted a controlled prospective study to determine the effects of this intervention. One-hundred and twenty-three students were randomly assigned to either PBL (n = 63), with tutorial groups of up to nine students, or to the traditional, lecture-based course (n = 60). Analysis of the results of both groups in the examination of basic pharmacology, consisting of multiple-choice and short-essay questions, revealed similar scores with a tendency favouring PBL students in the category of short-essay questions. Hence, it seems clear that PBL does not imply a disadvantage in terms of factual knowledge. Students considered PBL to be an effective learning method and favoured it over the lecture format. Furthermore, students reported positive effects of PBL in terms of use of additional learning resources, interdisciplinarity, team work and learning fun.     

Diagnostic ability of medical students in relation to their learning characteristics and preclinical background

Is the diagnostic ability of medical students — as appraised by the Diagnostic Thinking Inventory (DTI) — influenced by the learners’ characteristics, or the way they acquired basic knowledge? This question was explored in a 4-year consecutive sampling of clinical clerkship students. DTI inventory scores (flexibility in thinking and structure in memory), learners’ characteristics (learning style, self-confidence as a learner, and motivation to learn), together with knowledge scores (grade-point average and problem-solving test) were measured and analysed for their relationships and the differences between groups. Results revealed that higher scores of the DTI measures were associated with students’ high self-confidence, high motivation to learn, and abstract learning types. Correlation coefficients showed significant relationships between the DTI scores and both knowledge measures. In addition, t-tests showed that students with an integrated teaching background and problem-based learning (PBL) experience obtained significantly higher scores for structure in memory. The findings suggest that the inventory scores are sensitive to both cognitive and non-cognitive factors. The inventory may be useful in detecting subtle influences on diagnostic ability differentiation in medical students.     

A process evaluation of medical ethics education in the first year of a new medical curriculum

BACKGROUND: Despite the recent increase in activity in the field of medical ethics education, few evaluative studies have been carried out. Most studies have taken place in North America, in curricula where teaching is discipline-based, and have concentrated on outcome rather than on the curricular processes adopted. AIM: To evaluate the process of medical ethics education in the first year of a new learner-centred, problem-based, integrated medical curriculum. METHOD: A qualitative, multi-method approach was adopted using open questionnaires, focus groups and tutor evaluation rating scales. The study involved all 238 students in the first year of the new medical curriculum, and the 30 clinical tutors who facilitated ethics learning. A stratified sampling technique was used to choose focus group participants. RESULTS: Small group teaching proved highly acceptable to both students and tutors. Tutors' teaching skills were central to its effectiveness. Tutors played an important role in promoting students' appreciation of the relevance of medical ethics to clinical practice, and in establishing a climate where constructive criticism of colleagues' actions is acceptable. Course integration, including the provision for students of clinical experiences on which to reflect, was an important aid to learning. Students and tutors were noted to be driving the ethics curriculum towards having a contextual rather than theoretical base. CONCLUSION: This evaluation identified those aspects of the medical ethics course which contributed to its effectiveness and those which detracted from it. This information will be used to inform future development.