Achievement goal orientation and situational motivation for a low-stakes test of content knowledge

Objective. To determine the extent of the relationship between students’ inherent motivation to achieve in a doctor of pharmacy program and their motivation to achieve on a single low-stakes test of content knowledge.Method. The Attitude Toward Learning Questionnaire (ATL) was administered to 66 third-year pharmacy students at the beginning of the spring 2011 semester, and the Student Opinion Scale (SOS) was administered to the same group immediately following completion of the Pharmacy Curricular Outcomes Assessment (PCOA).Results. Significant differences were found in performance approach and work avoidance based on situational motivation scores. Situational motivation was also found to be directly correlated with performance and mastery approaches and inversely correlated with work avoidance. Criteria were met for predicting importance and effort from performance and mastery approaches and work avoidance scores of pharmacy students.Conclusions. The ability to predict pharmacy students’ motivation to perform on a low-stakes standardized test of content knowledge increases the test’s usefulness as a measure of curricular effectiveness.     

An Elective Course in Adult Acute Care Medicine Using a Hybrid Delivery System

Objective

To develop and assess the effectiveness of an elective course modeled after activities students encounter on internal medicine advanced pharmacy practice experiences (APPEs).

Design

This hybrid elective course used a Web-based course management system linking pre-class lectures and assignments, classroom discussions, and projects to promote active student learning.

Assessment

Assessment of student performance was based on assignments, quizzes, and participation in classroom discussions. Students were surveyed to ascertain their opinion of the elective.

Conclusion

This elective in adult acute care medicine increased student exposure to inpatient settings and provided students additional opportunities to communicate effectively, evaluate medical literature, and think critically.     

Factors Influencing Pharmacy Students' Attendance Decisions in Large Lectures

Objectives

To identify reasons for pharmacy student attendance and absenteeism in large lectures and to determine whether certain student characteristics affect student absenteeism.

Methods

Pharmacy students'' reasons to attend and not attend 3 large lecture courses were identified. Using a Web-based survey instrument, second-year pharmacy students were asked to rate to what degree various reasons affected their decision to attend or not attend classes for 3 courses. Bivariate analyses were used to assess the relationships between student characteristics and degree of absenteeism.

Results

Ninety-eight students (75%) completed the survey instrument. The degree of student absenteeism differed among the 3 courses. Most student demographic characteristics examined were not related to the degree of absenteeism. Different reasons to attend and not to attend class were identified for each of the 3 courses, suggesting that attendance decisions were complex.

Conclusions

Respondents wanted to take their own notes and the instructor highlighted what was important to know were the top 2 common reasons for pharmacy students to attend classes. Better understanding of factors influencing student absenteeism may help pharmacy educators design effective interventions to facilitate student attendance.     

An Elective Psychiatric Course to Reduce Pharmacy Students�� Social Distance Toward People With Severe Mental Illness

Objective

To determine whether an elective course on mental health could reduce pharmacy students’ social distance toward people with severe mental illness.

Design

Course activities included assigned readings, class discussions, student presentations, review of video and other media for examples of social distance, presentations by patients with mental illness, and visits to hospitalized patients in a variety of psychiatric settings.

Assessment

The Social Distance Scale (SDS) was administered at the beginning and end of the semester to students enrolled in the elective and to a comparator group of students not enrolled in the course. Pharmacy students who did not complete the elective had significantly higher SDS scores than students who completed the elective (18.7 vs. 15.6, p < 0.001). Students enrolled in the course had lower precourse SDS scores, were more likely than their peers to have a personal association with mental illness, and had a decrease in precourse to postcourse scores.

Conclusion

A course designed to reduce stigma towards the mentally ill can reduce pharmacy students'' social distance.     

Pharmaceutical Care Plan Examinations to Identify Students at Risk for Poor Performance in Advanced Pharmacy Practice Experiences

Objectives

To evaluate early predictors of advanced pharmacy practice experience (APPE) performance using either timed pharmaceutical care plan (TPCP) reports of 4 case histories or traditional lecture-based pharmacotherapy course examinations.

Methods

Statistical process control (SPC) methods were used to identify a group of third-year pharmacy students “at risk” for poor APPE performance (defined as an APPE grade point average of < 3.0). Examination scores from an integrated lecture-based pharmacotherapy sequence were used for comparison.

Results

TPCP scores but not lecture-based examination scores successfully identified 6 of 10 students who ultimately performed poorly in their APPEs.

Conclusion

Adaptation of SPC methods to assess student performance during problem-based learning (PBL) case reports is a useful technique for identifying students “at risk” for poor APPE performance.     

A Simulated Interprofessional Rounding Experience in a Clinical Assessment Course

Objective

To implement a simulated interprofessional rounding experience using human patient simulators as a required activity for third-year pharmacy students in a clinical assessment course.

Design

Interprofessional student teams consisting of pharmacy, medical, and physician assistant students participated in a simulated interprofessional rounding experience in which they provided comprehensive medical care for a simulated patient in an inpatient setting.

Assessment

Students completed a survey instrument to assess interprofessional attitudes and satisfaction before and after participation in the simulated interprofessional rounding experience. Overall student attitudes regarding interprofessional teamwork and communication significantly improved; student satisfaction with the experience was high and students’ self-perceived clinical confidence improved after participation. The mean team clinical performance scores were 65% and 75% for each simulated interprofessional rounding experience.

Conclusion

Incorporating a simulated interprofessional rounding experience into a required clinical assessment course improved student attitudes regarding interprofessional teamwork and was associated with high student satisfaction.     

Pharmacy Students' Approaches to Learning in an Australian University

Objectives

To investigate how pharmacy students'' approaches to learning change over the duration of a bachelor of pharmacy degree program.

Methods

Data were obtained from a cross-sectional, repeated measures design, using a validated self-report survey instrument. Areas examined included processing and regulation strategies, motivational preferences for learning, and the relationship between approaches to learning and academic performance.

Results

Pharmacy students were strongly vocationally oriented in their studies across all year groups. This approach had a significant relationship to academic performance. Overall, students indicated a preference for external regulation strategies. There was little evidence of maturation in approaches to learning as students progressed through the curriculum.

Conclusions

Students'' preference for vocationally related strategies can be harnessed to increase both adoption of self-regulation behaviors and motivation for mastery of material. Comparison of our results with other studies indicates that approaches to learning may be influenced more by the learning environment than the discipline of study.     

Canadian Pharmacy Students' Knowledge of Herbal Medicine

Objective

To determine fourth-year Canadian pharmacy students'' knowledge of herbal medicine and whether that knowledge is associated with mandatory instruction in herbal medicine.

Methods

Standardized multiple-choice tests assessing students'' herbal knowledge were distributed to all fourth-year BSc pharmacy students at 5 pharmacy schools in Canada.

Results

The Quebec response rate was too low to include in the analysis. Herbal knowledge test scores were positively associated with having previously taken an herbal medicine class and completion of a pharmacy practicum. However, postsecondary education, age, and gender were not associated with herbal knowledge test scores. Students at the University of British Columbia had the highest score, followed by Alberta, Nova Scotia, and Ontario.

Conclusion

Pharmacy students'' knowledge of herbal medicine varies depending on the school attended and higher herbal knowledge test scores appear to be most closely related to mandatory herbal instruction.     

Development of a Reliable,Valid Annual Skills Mastery Assessment Examination

Objective

To develop a methodology for a reliable, valid annual skills mastery assessment examination to provide formative student feedback, inform curricular review, and comply with the Accreditation Council for Pharmacy Education (ACPE) Standards 2007.

Design

A sample of program-level ability-based outcomes skills were chosen for the examination. Test items were written, underwent quality control, and were scored for level of difficulty. Versions of the examination for first-, second-, third-, and fourth-year pharmacy students were developed and administered, the results were analyzed, reliability and validity were evaluated, and reports were generated. Item-writing guidelines, quality control procedures, and examination production steps were codified to create a criterion-referenced examination. Students and faculty advisors received detailed score reports and results were used to guide student performance and stimulate a review of curricular outcomes.

Assessment

Content, criterion, and construct validity were analyzed as defined in the literature for the intended use of this assessment tool. Data suggest the Annual Skills Mastery Assessment (ASMA) examination is both reliable and valid. Students and faculty members were surveyed regarding the usefulness of the examination. Results indicate general satisfaction with the assessment program.

Conclusion

A reasonably reliable, reasonably valid multiple-choice annual skills mastery assessment for selected outcomes statements providing formative feedback and informed curricular review was developed.     

Systematic Review of Predictors of Success for the North American Pharmacist Licensure Examination

Objective. Studies have examined possible predictors of success on the North American Pharmacist Licensure Examination (NAPLEX). This systematic review investigated the literature on potential predictors of success on the NAPLEX.Findings. Articles were included in the review if they studied student characteristics and academic performance as independent variables and NAPLEX scores and/or pass rates as an outcome. Data were extracted from each article for students’ demographics or variables, sample size, methods of statistical analyses, and results reporting correlation or predictability. From 40 articles retrieved from the initial search and sorting, 20 studies were included in the final review per inclusion criteria. Three studies included all the pharmacy programs, 15 were single-institution studies, two were multi-institution studies, and four had been published as posters. Among 30 different variables identified as potential predictors of success on the NAPLEX, the most examined variables were student age at matriculation, having a prior degree, Pharmacy College Admission Test (PCAT) scores, cumulative pharmacy school grade point average (GPA), overall Pharmacy Curriculum Outcomes Assessment (PCOA) scores, and PCOA content areas scores. Positively correlated factors included PCAT scores, not having a prior degree, prepharmacy and pharmacy school GPA, institutional characteristics, and PCOA scores. Negatively correlated factors included older age at admission.Summary. Cumulative pharmacy school GPA and PCOA scores were predictors of NAPLEX success consistently in the studies. The effects of preadmission student characteristics on NAPLEX success varied and were not consistently correlated or predictive.     

A Required Course in the Development, Implementation, and Evaluation of Clinical Pharmacy Services

Objective

To develop, implement, and assess a required pharmacy practice course to prepare pharmacy students to develop, implement, and evaluate clinical pharmacy services using a business plan model.

Design

Course content centered around the process of business planning and pharmacoeconomic evaluations. Selected business planning topics included literature evaluation, mission statement development, market evaluation, policy and procedure development, and marketing strategy. Selected pharmacoeconomic topics included cost-minimization analysis, cost-benefit analysis, cost-effectiveness analysis, cost-utility analysis, and health-related quality of life (HRQoL). Assessment methods included objective examinations, student participation, performance on a group project, and peer evaluation.

Assessment

One hundred fifty-three students were enrolled in the course. The mean scores on the objective examinations (100 points per examination) ranged from 82 to 85 points, with 25%-35% of students in the class scoring over 90, and 40%-50% of students scoring from 80 to 89. The mean scores on the group project (200 points) and classroom participation (50 points) were 183.5 and 46.1, respectively. The mean score on the peer evaluation was 30.8, with scores ranging from 27.5 to 31.7.

Conclusion

The course provided pharmacy students with the framework necessary to develop and implement evidence-based disease management programs and to assure efficient, cost-effective utilization of pertinent resources in the provision of patient care.     

A case-based toxicology elective course to enhance student learning in pharmacotherapy

Objective. To assess the impact of a case-based toxicology elective course on student learning in related required courses and student performance on the Pharmacy Curriculum Outcomes Assessment (PCOA) examination.Design. A case-based clinical toxicology elective course that contained topics from 2 required courses, Pharmacology III and Pharmacotherapy II, was offered in the spring 2009 to second- and third-year pharmacy students.Assessment. Scores on the Toxicology subsection of the PCOA of students enrolled in the elective were higher than those of students not enrolled (91.3% ± 4.1 vs. 67.2% ± 5.7). Enrollment in the elective was related to increased examination scores among Pharmacotherapy II students (89.5% ± 2.0 vs. 83.9% ± 1.8). Students indicated on course survey instruments that they were satisfied with the new elective offering.Conclusions. A toxicology elective provided a clinically relevant, active-learning experience for pharmacy students that addressed a curricular need within the college and increased examination scores.     

Multiple rubric-based assessments of student case presentations

Objectives

To evaluate a rubric-based method of assessing pharmacy students'' case presentations in the recitation component of a therapeutics course.

Methods

A rubric was developed to assess knowledge, skills, and professional behavior. The rubric was used for instructor, student peer, and student self-assessment of case presentations. Rubric-based composite scores were compared to the previous dichotomous checklist-based scores.

Results

Rubric-based instructor scores were significantly lower and had a broader score distribution than those resulting from the checklist method. Spring 2007 rubric-based composite scores from instructors and peers were significantly lower than those from the pilot study results, but self-assessment composite scores were not significantly different.

Conclusions

Successful development and implementation of a grading rubric facilitated evaluation of knowledge, skills, and professional behavior from the viewpoints of instructor, peer, and self in a didactic course.Key words: rubric, pharmacy, peer assessment, self-assessment, assessment     

Heart of Pharmacy: A Course Exploring the Psychosocial Issues of Patient Care

Objective

To implement and assess the impact of a course utilizing reflective learning to explore the complex, psychosocial human issues encountered in pharmacy practice.

Design

A 1-credit-hour elective course, The Heart of Pharmacy, was offered to all pharmacy students. The course utilized both content and reflective techniques to produce a mutual exploratory learning experience for students, staff, and faculty members. Faculty and staff facilitators observed competencies and used a single group posttest design to assess students’ attitudes. In year four, students’ written reflections for each session were added and reviewed on a continuous basis throughout the course.

Assessment

Faculty and staff observations indicated that educational outcomes were achieved and student perceptions and evaluations of the course were highly positive. Three major themes were identified in the students’ qualitative responses: a recognition of communal support among student and faculty colleagues; a grounding for personal growth and professional formation; a deeper insight into and experience with the role of the pharmacist as compassionate listener and caregiver.

Conclusion

Faculty observations of student competencies and students’ perceptions of this course point to the need for pharmacy education to provide organized, structured reflective learning opportunities for students and faculty members to explore the deeper human issues of pharmacy practice and patient care.     

Learning bridge tool to improve student learning, preceptor training, and faculty teamwork

Objectives

To implement a Learning Bridge tool to improve educational outcomes for pharmacy students as well as for preceptors and faculty members.

Design

Pharmacy faculty members collaborated to write 9 case-based assignments that first-year pharmacy (P1) students worked with preceptors to complete while at experiential sites.

Assessment

Students, faculty members, and preceptors were surveyed about their perceptions of the Learning Bridge process. As in our pilot study,¹ the Learning Bridge process promoted student learning. Additionally, the Learning Bridge assignments familiarized preceptors with the school''s P1 curriculum and its content. Faculty teamwork also was increased through collaborating on the assignments.

Conclusions

The Learning Bridge assignments provided a compelling learning environment and benefited students, preceptors, and faculty members.     

Comparison of Two Lecture Delivery Platforms in a Hybrid Distance Education Program

Objective

To compare students'' preferences for and academic performance using 2 different distance education course content delivery platforms.

Methods

A randomized, crossover research design was used to compare traditional video with a 4-panel platform among learners on multiple campuses within 1 college of pharmacy.¹ The outcomes were students'' preferences for delivery platform and examination scores. Rasch analysis was used to assess unidimensionality and the difficulty of examination items. Hierarchical logistic and multiple regression models were used to assess students'' preferences and academic performance.

Results

The logistic model predicting preference for the 4-panel or traditional platform was not significant, but African-Americans and Hispanics were more likely to prefer the 4-panel platform than Caucasian and Asian students. The delivery platform did not impact students'' academic performance. Students who did well on the semester''s previous 2 examinations scored higher on the questions related to schizophrenia. Students with higher Pharmacy College Admission Test (PCAT) scores performed better on the bipolar questions than students who preferred the traditional video platform.

Conclusion

The additional faculty time, effort, and cost invested in presenting the class material in a 4-panel platform, and the students'' extra time and effort spent viewing the 4-panel platform did not produce a comparable benefit in student preference and performance.     

Pharmacy Students' Reading Ability and the Readability of Required Reading Materials

Objective

To determine the reading level of third-professional year doctor of pharmacy students and whether a significant correlation existed between Nelson-Denny Reading Test (NDRT) grade equivalence scores and the Pharmacy College Admission Test (PCAT) percentile scores, and to determine the reading level of selected course materials.

Methods

The NDRT was administered to third-professional year (P3) pharmacy students. Scores from the NDRT were compared to the percentile rankings of the students'' PCAT scores to determine whether significant correlations existed. Chapters from a pharmacy textbook and published medical guidelines were assessed using the Gunning FOG readability formula.

Results

Based upon the NDRT, the average reading grade level for pharmacy students was 16.5 years. There was a strong correlation between the vocabulary scores from the NDRT and the PCAT verbal percentile (ρ = 0.776, p < 0.001). The average readability grade level of the materials assessed was 18.0 years for the textbook and 19.2 years for the medical guidelines.

Conclusions

The verbal PCAT percentiles strongly correlate with the vocabulary grade equivalence scores on the NDRT. A moderate correlation was found between the composite PCAT percentiles and NDRT total grade equivalence scores. There was also a disparity between the average reading level of the students and that of the reading samples that were assessed.     

Impact of Hybrid Delivery of Education on Student Academic Performance and the Student Experience

Objectives

To compare student academic performance and the student experience in the first-year doctor of pharmacy (PharmD) program between the main and newly opened satellite campuses of the University of Maryland.

Methods

Student performance indicators including graded assessments, course averages, cumulative first-year grade point average (GPA), and introductory pharmacy practice experience (IPPE) evaluations were analyzed retrospectively. Student experience indicators were obtained via an online survey instrument and included involvement in student organizations; time-budgeting practices; and stress levels and their perceived effect on performance.

Results

Graded assessments, course averages, GPA, and IPPE evaluations were indistinguishable between campuses. Students'' time allocation was not different between campuses, except for time spent attending class and watching lecture videos. There was no difference between students'' stress levels at each campus.

Conclusions

The implementation of a satellite campus to expand pharmacy education yielded academic performance and student engagement comparable to those from traditional delivery methods.     

Pharmacy Students' Ability to Identify Potential Drug-Drug Interactions

Objective

To evaluate the ability of third- and fourth-year pharmacy students to identify clinically significant drug-drug interactions (DDIs)

Methods

A questionnaire designed to measure DDI knowledge was disseminated to fourth-year pharmacy students in a school of pharmacy. A second questionnaire was distributed to third-year pharmacy students in 2 schools of pharmacy (schools A and B) and re-administered to students in 1 of the schools 1 year later.

Results

Class of 2005 fourth-year pharmacy students correctly categorized an average of 52% ± 13% DDI pairs on the first questionnaire. Third-year pharmacy students at schools A and B correctly categorized an average of 61% ± 18% and 66% ± 15% of DDI pairs, respectively. The average percentage of correct responses for fourth-year students from the class of 2007 was 65% (± 17%).

Conclusion

Pharmacy students'' ability to identify important DDIs is far from optimal, even after completing experiential requirements.     

Evaluation of curricula content based on Thai pharmacy competency standards

Objective

To evaluate the curricula content of Thai pharmacy schools based on the Thai pharmacy competency standards.

Methods

Course syllabi were collected from 11 pharmacy schools. A questionnaire was developed based on the Thai pharmacy competency standards. Course coordinators completed the questionnaire assessing the curricula content.

Results

The curricula for both the bachelor of science in pharmacy degree (BS Pharm) and doctor of pharmacy (PharmD) degree programs included the minimum content required by the 8 competency domains. The dominant content area in BS Pharm degree programs was product-oriented material. The content ratio of patient to product to social and administrative pharmacy in the BS Pharm degree programs was 2:3:1, respectively. However, the content ratio suggested by the Thai Pharmacy Council was 3:2:1, respectively. For the PharmD programs, the largest content area was patient-oriented material, which was in agreement with the framework suggested by the Thai Pharmacy Council.

Conclusions

The curricula of all Thai pharmacy schools met the competency standards; however, some patient-oriented material should be expanded and some product-oriented content deleted in order to meet the recommended content ratio.