Instrument Refinement for Measuring Self-Efficacy for Competence in Interprofessional Collaborative Practice: Development and Psychometric Analysis of IPECC-SET 27 and IPECC-SET 9

Assessing competence in interprofessional collaborative practice (ICP) among health professions students is a high priority. This cross-sectional study built on the authors’ prior work that led to the development of the 38-item Interprofessional Education Collaborative Competency Self Efficacy Tool (IPECC-SET), an instrument to evaluate health professions students’ self-efficacy in interprofessional collaborative competency, and addressed two primary questions. First, could a unidimensional scale based on the IPEC competencies and assessing perceived self-efficacy for competence in ICP and be constructed? Second, could a shorter version of that instrument still meet criteria for unidimensionality and retain the ability to separate students in distinct levels of perceived self-efficacy for competence in ICP?

Study participants were two cohorts of students from 11 health professions programs participating in an institutional interprofessional immersion event in 2015 and 2016. Statistical stepwise analyses were conducted using a Rasch rating scale model. The original 38 IPECC-SET items did not meet the criteria to generate a valid unidimensional measure of self-efficacy for competence in ICP, but could be condensed into a 27-item scale that met all set criteria for unidimensionality, with an explained variance of 61.2% and a separation index of 3.02. A shorter, 9-item scale demonstrated a separation index of 2.21. The nine items included also demonstrated a relatively equivalent range (54.93–45.65) as compared to the 27-item scale (57.26–46.16). Findings confirm empirically the conceptual suggestion from our earlier work that the four dimensions in the original IPEC competencies contribute to a shared underlying construct: perceived competence in interprofessional collaboration. Given the emphasis on ICP, psychometrically sound instruments are needed to evaluate the effectiveness of educational efforts to promote competency for ICP. Based on the findings from this study, both the IPECC-SET 27 and IPECC-SET 9 can be used to measure perceived self-efficacy for competence in ICP.     

Interprofessional education day – an evaluation of an introductory experience for first-year students

Interprofessional health care teams have been shown to improve patient safety and reduce medical errors, among other benefits. Introducing interprofessional concepts to students in full day events is an established model that allows students to learn together. Our group developed an academic day for first-year students devoted to an introductory interprofessional education (IPE) experience, ‘IPE Day’. In total, 438 students representing medicine, dentistry, pharmacy and optometry gathered together, along with 25 facilitators, for IPE Day. Following the day’s program, students completed the evaluation consisting of the Interprofessional Collaborative Competencies Attainment Survey and open-ended questions. Narrative responses were analyzed for content and coded using the Canadian Interprofessional Health Collaborative competency domains. Three hundred and eight evaluations were completed. Students reported increased self-ratings of competency across all 20 items (p < 0.05). Their comments were organized into the six domains: interprofessional communication, collaborative leadership, role clarification, patient-centred care, conflict resolution, and team functioning. Based on these findings, we suggest that this IPE activity may be useful for improving learner perceptions about their interprofessional collaborative practice competence.     

Validity evidence and use of the IPEC Competency Self-Assessment,Version 3

ABSTRACT

To guide interprofessional education (IPE), a variety of frameworks have been suggested for defining competency in interprofessional practice, but competency-based assessment remains challenging. One self-report measure developed to facilitate competency-based assessment in IPE is the IPEC Competency Self-Assessment. It was originally described as a 42-item measure constructed on the four domains defined by the Interprofessional Education Collaborative (IPEC) Expert Panel. Response data, however, identified only two factors labeled Interprofessional Interaction and Interprofessional Values. In this study, we tested a revised 19-item, two-factor scale based on these prior findings with a new sample (n = 608) and found good model fit with three items not loading on either factor. This led to a 16-item instrument, which was then tested with an additional sample (n = 676). Internal consistency was high, and scores for both subscales showed variance based on prior healthcare experience. The interprofessional interaction subscale was primarily comprised of items from the Teams and Teamwork domain, with one item each based on competencies from the Interprofessional Communication and Values/Ethics domains; and scores varied by year of enrollment. The interprofessional values subscale was comprised solely of items from the Values/Ethics domain. Scores for both subscales were strongly correlated with scores from the Interprofessional Socialization and Valuing Scale. This study further establishes the validity, reliability, and usability of an assessment tool based on interprofessional competency. The findings also suggest the constructs underlying the subscales may be affected differently by experience and training. Additional study using longitudinal data is needed to test this hypothesis.     

The intersection of professionalism and interprofessional care: development and initial testing of the interprofessional professionalism assessment (IPA)

Valid assessment of interprofessional education and collaborative practice (IPECP) is challenging. The number of instruments that measure various aspects of IPECP, or in various sites is growing, however. The Interprofessional Professionalism Assessment (IPA) measures observable behaviors of health care professionals-in-training that demonstrate professionalism and collaboration when working with other health care providers in the context of people-centered care. The IPA instrument was created by the Interprofessional Professionalism Collaborative (IPC), a national group representing 12 entry-level health professions and one medical education assessment organization. The instrument was created and evaluated over several years through a comprehensive, multi-phasic process: 1) development of construct and observable behaviors, 2) instrument design, expert review and cognitive interviews, and 3) psychometric testing. The IPA contains 26 items representing six domains of professionalism (altruism and caring, excellence, ethics, respect, communication, accountability), and was tested by 233 preceptors rating health profession learners in the final year of their practical training. These preceptors represented 30 different academic institutions across the U.S., worked in various types of practice sites, and evaluated learners representing 10 different entry-level health professions. Exploratory factor analysis suggested four factors (communication, respect, excellence, altruism and caring) using 21 items with the least amount of missing data, and confirmed, for the most part, a priori expectations. Internal consistency reliability coefficients for the entire instrument and its four subscales were high (all greater than 0.9). Psychometric results demonstrate aspects of the IPA’s reliability and validity and its use across multiple health professions and in various practice sites.     

Validation of the interprofessional collaborative competency attainment survey (ICCAS)

Abstract

The purpose of this study was to obtain evidence regarding the validity and reliability of an instrument to measure the self-reported competencies of interprofessional care in interprofessional education programs. Five hundred and eighty-four students and clinicians in Canada and New Zealand who were registered in 15 interprofessional education undergraduate, postgraduate, and continuing professional development programs completed the Interprofessional Collaborative Competency Attainment Survey (ICCAS) using a retrospective pre-test/post-test design. Factor analyses showed the presence of two factors in the pre-program items and one factor in the post-program items. Tests conducted provided evidence in support of the validity and reliability of the ICCAS as a self-assessment instrument for interprofessional collaborative practice. Internal consistency was high for items loading on factor 1 (α?=?0.96) and factor 2 (α?=?0.94) in the pre-program assessment and for the items in the post-program assessment (α?=?0.98). The transition from a two factor solution to a single factor structure suggests interventions influence learners’ understanding of interprofessional care by promoting the recognition of the high degree of interrelation among interprofessional care competencies. Scores on the ICCAS are reliable and predict meaningful outcomes with regard to attitudes toward interprofessional competency attainment.     

Consensus group session of experts to describe interprofessional collaboration processes in team meetings

Abstract

Linking the outcomes from interprofessional education to improvements in patient care has been hampered by educational assessments that primarily measure the short-term benefits of specific curricular interventions. Competencies, recently published by the Interprofessional Education Collaborative (IPEC), elaborate overarching goals for interprofessional education by specifying desired outcomes for graduating health professions students. The competencies define a transition point between the prescribed and structured educational experience of a professional degree program and the more self-directed, patient-oriented learning associated with professional practice. Drawing on the IPEC competencies for validity, we created a 42-item questionnaire to assess outcomes related to collaborative practice at the degree program level. To establish the usability and psychometric properties of the questionnaire, it was administered to all the students on a health science campus at a large urban university in the mid-Atlantic of the United States. The student responses (n?=?481) defined four components aligned in part with the four domains of the IPEC competencies. In addition, the results demonstrated differences in scores by domain that can be used to structure future curricula. These findings suggest a questionnaire based on the IPEC competencies might provide a measure to assess programmatic outcomes related to interprofessional education. We discuss directions for future research, such as a comparison of results within and between institutions, and how these results could provide valuable insights about the effect of different curricular approaches to interprofessional education and the success of various educational programs at preparing students for collaborative practice.     

Interprofessional service-learning definition

ABSTRACT

In 2010, the World Health Organization (WHO) published the WHO’s Framework for Action on Interprofessional Education and Collaborative Practice recognizing the significance of improved quality of patient care, lower healthcare costs and decrease medical errors through the use of interprofessional teams. This concept was embraced by the Midwest Interprofessional Practice Education and Research Center (MIPERC) and its Service-Learning workgroup, through the development of multiple interprofessional service-learning experiential opportunities for area health and medical students. Throughout MIPERC’s journey of developing and providing interprofessional service-learning opportunities, we have unsuccessfully sought to find a definition of interprofessional service-learning to assist us in better framing our work. We have found definitions of service-learning and interprofessional learning as well as case examples of service-learning, interprofessional learning, and interprofessional service-learning but, no definition of interprofessional service-learning. Following a review of the relevant literature, we have developed a definition of interprofessional service-learning that we believe is comprehensive and will be of use to other interprofessional service-learning organizations in framing and developing interprofessional service-learning opportunities for their health and medical students.     

Interprofessional ethics education seminar for undergraduate health science students: A pilot study

To prepare for the modern collaborative healthcare system, health science academia is charged with educating future professionals to be competent members of the interprofessional team. The purpose of this pilot study was to assess self-efficacy for interprofessional education (IPE) in medical laboratory technology, dental hygiene, and nursing students before and after an IPE session. The specific topic of ethics was the focus of the session. The interprofessional seminar was designed to compare the codes of ethics from each programme through discussion and a case-based approach. The Self-Efficacy for Interprofessional Experiential Learning scale was used to collect quantitative data. A total of 75 participants rated self-efficacy for IPE before and after the educational offering. A paired sample t-test was used to analyse data. Significant results were found in students’ pre- and post-test scores that indicated increased levels of self-efficacy related to working as a collaborative team for the benefit of the patient. Overall, there was an increase in participants’ self-efficacy after collaborating with students from different health professions programmes. Healthcare students that learn together are more confident in their abilities to implement a team-structured approach, and understand that doing so will foster optimal patient wellbeing.     

The Interprofessional Collaborative Competency Attainment Survey (ICCAS): A replication validation study

This study replicates a validation of the Interprofessional Collaboration Competency Attainment Survey (ICCAS), a 20-item self-report instrument designed to assess behaviours associated with patient-centred, team-based, collaborative care. We appraised the content validity of the ICCAS for a foundation course in interprofessional collaboration, investigated its internal (factor) structure and concurrent validity, and compared results with those obtained previously by ICCAS authors. Self-assessed competency ratings were obtained from a broad spectrum of pre-licensure, health professions students (n = 785) using a retrospective, pre-/post-design. Moderate to large effect sizes emerged for 16 of 20 items. Largest effects (1.01, 0.94) were for competencies emphasized in the course; the smallest effect (0.35) was for an area not directly taught. Positive correlations were seen between all individual item change scores and a separate item assessing overall change, and item-total correlations were moderate to strong. Exploratory factor analysis was used to understand the interrelationship of ICCAS items. Principal component analysis identified a single factor (Cronbach’s alpha = 0.96) accounting for 85% of the total variance—slightly higher than the 73% reported previously. Findings suggest strong overlaps in the proposed constructs being assessed; use of a total average score is justifiable for assessment and evaluation.     

Development of a scale to measure health professions students' self-efficacy beliefs in interprofessional learning

A need exists for measures to evaluate the impact of interprofessional education (IPE) interventions. We undertook development and evaluation of a scale to measure self-efficacy perceptions of pre-licensure students in medicine, dentistry and health professions. The scale was developed in the context of a project entitled, “Seamless Care: An Experiential Model of Interprofessional Education for Collaborative Patient-Centered Practice”. As self-efficacy perceptions are associated with the likelihood of taking on certain tasks, the difficulty of those tasks, and perseverance in the face of barriers, we reasoned that understanding changes in students' perceptions and their relation to other outcomes was important. A 16-item scale was developed from a conceptual analysis of relevant tasks and the existing literature. Content validity was assessed by six Canadian IPE experts. Pre-licensure students (n = 209) participated in a pilot test of the instrument. Content validity was rated highly by the six judges; internal consistency of the scale (Cronbach's α = 96) and subscales 1 (α = .94) and 2 (α = .93) were high. Principal components analysis resulted in identification of two factors, each accounting for 34% of the variance: interprofessional interaction, and interprofessional team evaluation and feedback. We conclude that this scale can be useful in evaluating IPE interventions.     

Interprofessional education and service learning: a model for the future of health professions education

Abstract

The implementation of interprofessional education for healthcare professionals has been lackluster, at best, since it was recommended by the Institute of Medicine. There have been various attempts in institutions of higher learning to meet this goal with mixed results. Herbert Wertheim College of Medicine, Florida International University has developed the Green Family NeighborhoodHELP? (GFNHelp) program to meet this challenge. GFNHelp is an interprofessional, longitudinal, service-learning program for healthcare students. Through participation in this program medical students team up with students from other professions, such as nursing, social work, and law, and collaborate to improve health outcomes for medically underserved families in the community. This educational program emphasizes the Core Competencies of the Interprofessional Education Collaborative through community-based service-learning, allowing student teams to engage firsthand and address the impact of social determinants on health.     

Self-efficacy perceptions of interprofessional education and practice in undergraduate healthcare students

Self-efficacy is an individual’s perception of their ability to be successful in a given endeavour and it has been shown to have an important role in successful university education and clinical performance of healthcare workers. This article examines the self-efficacy beliefs of undergraduate healthcare students (n = 388) for the skills required for interprofessional education and interprofessional collaboration. The students were enrolled at an Australian university from the disciplines of public health, social work, and paramedic practice. The Self-Efficacy for Interprofessional Experiential Learning (SEIEL) scale, which is a valid and reliable scale, was used to determine the self-reported perceptions of self-efficacy in this cohort. The 16-item scale was developed for use with medicine and other healthcare professional undergraduate students. Student t-tests were used to compare scores between males and females, with one-way ANOVAs used to explore SEIEL scores across disciplines and year level. A significant difference was found between genders for the scores on SEIEL subscale 2 “Interprofessional evaluation and feedback” (p = 0.01) with the male mean being 2.65 units higher (Cohen’s d = 0.29). There was also a significant gender difference for the overall SEIEL scale (p = 0.029) with the male mean being 4.1 units higher (Cohen’s d = 0.238). No significant gender differences were demonstrated for the subscale “Interprofessional interaction.” Neither subscale demonstrated significant differences between healthcare disciplines or course year. Further investigation is required to explore the reasons for the outcomes of this study. With the increasing importance of interprofessional education and practice within healthcare, it would also appear reasonable to consider further research into the development and support of student self-efficacy for the skills required for interprofessional education and interprofessional collaboration within healthcare curricula.     

A comparison of the validity of two instruments assessing health professional student perceptions of interprofessional education and practice

Abstract

Health professional education programs increasingly incorporate interprofessional education (IPE) activities into curricula in response to evolving health policy and accreditation requirements in an effort to highlight the benefits of, and prepare students for, interprofessional collaborative practice (IPCP). As such, there is a need for statistically valid instruments designed to assess baseline student perceptions regarding IPE and IPCP. Using confirmatory factor analysis, this study compared the reliability and construct validity of a revised 21-item Attitudes Toward Health Care Teams (ATHCT-R) instrument and a 10-item Student Perceptions of Interprofessional Clinical Education-Revised (SPICE-R) instrument. The instruments were concurrently administered online and completed by a total of 221 first year nursing, optometry, pharmacy, physical therapy, and health administration students. In this study, the SPICE-R exhibited better performance in terms of goodness of fit, construct validity, and reliability compared with the ATHCT-R. The SPICE-R instrument demonstrates promise as a parsimonious, valid, and reliable tool for measuring health professional students’ perceptions of IPE and IPCP.     

Interprofessional Education and Practice Guide No. 8: Team-based interprofessional practice placements

Whilst interest in interprofessional learning (IPL) in practice contexts has grown in recent years, the complexities involved have led many universities to rely on IPL in the classroom, online, and/or simulated contexts. Curtin University’s Faculty of Health Sciences has successfully implemented a multi-award winning, large-scale Interprofessional Practice Programme. This programme, which began with five small pilots in 2009, provides team-based interprofessional practice placements for over 550 students from nine professions per annum. Drawing on both the literature and Curtin University’s experience, this Interprofessional Education and Practice Guide aims to assist university and practice-based educators to “weigh the case” for introducing team-based interprofessional placements. The key lessons learned at Curtin University are identified to offer guidance to others towards establishing a similar programme for students during their prequalifying courses in health, social care, and related fields.     

Partnering to provide simulated learning to address Interprofessional Education Collaborative core competencies

Abstract

Learning to effectively communicate and work with other professionals requires skill, yet interprofessional education is often not included in the undergraduate healthcare provider curriculum. Simulation is an effective pedagogy to bring students from multiple professions together for learning. This article describes a pilot study where nursing and social work students learned together in a simulated learning activity, which was evaluated to by the Readiness for Interprofessional Learning Scale (RIPLS). The RIPLS was used before and after the simulated activity to determine if this form of education impacted students’ perceptions of readiness to learn together. Students from both professions improved in their RIPLS scores. Students were also asked to identify their interprofessional strengths and challenges before and after the simulation. Changes were identified in qualitative data where reports of strengths and challenges indicated learning and growth had occurred. In conclusion, this pilot study suggests that interprofessional simulation can be an effective method to integrate Interprofessional Education Collaborative core competencies into the curriculum.     

Development of a scale to measure health professions students' self-efficacy beliefs in interprofessional learning

A need exists for measures to evaluate the impact of interprofessional education (IPE) interventions. We undertook development and evaluation of a scale to measure self-efficacy perceptions of pre-licensure students in medicine, dentistry and health professions. The scale was developed in the context of a project entitled, "Seamless Care: An Experiential Model of Interprofessional Education for Collaborative Patient-Centered Practice". As self-efficacy perceptions are associated with the likelihood of taking on certain tasks, the difficulty of those tasks, and perseverance in the face of barriers, we reasoned that understanding changes in students' perceptions and their relation to other outcomes was important. A 16-item scale was developed from a conceptual analysis of relevant tasks and the existing literature. Content validity was assessed by six Canadian IPE experts. Pre-licensure students (n = 209) participated in a pilot test of the instrument. Content validity was rated highly by the six judges; internal consistency of the scale (Cronbach's α = 96) and subscales 1 (α = .94) and 2 (α = .93) were high. Principal components analysis resulted in identification of two factors, each accounting for 34% of the variance: interprofessional interaction, and interprofessional team evaluation and feedback. We conclude that this scale can be useful in evaluating IPE interventions.     

Promotion of role clarification in the Health Care Team Challenge

Interprofessional collaboration has consistently been associated with positive client-care outcomes. Role clarification is one facet of interprofessional collaboration that is thought to be crucial for effective interprofessional team functioning. Given the positive outcomes associated with interprofessional collaboration, educators have begun to integrate formal interprofessional education events into healthcare curricula. The Health Care Team Challenge (HCTC) is a collaborative competition designed to promote interprofessional competencies among students in healthcare fields. The current study empirically investigated whether this event promoted role clarification among participants. Sixteen participants in five healthcare professions (occupational therapy, physiotherapy, clinical psychology, nursing, and medicine) completed two questionnaires to assess role clarification before and after participating in this event. Results indicate that participants’ understanding of their own and other professions’ roles improved after participating in this team activity. These results suggest that the HCTC is effective in promoting role clarification and collaboration among healthcare students.     

Student perceptions towards interprofessional education: Findings from a longitudinal study based in a Middle Eastern university

The Lebanese American University Interprofessional Education (LAU IPE) Steps Framework consists of a five-step workshop-based series that is offered throughout the curriculum of health and social care students at an American university in Lebanon. The aim of the present study was to report students’ perceptions of their readiness for interprofessional learning before and after completing the IPE steps, their evaluations of interprofessional learning outcomes, as well as their satisfaction with the learning experience as a whole. A longitudinal survey design was used: questionnaires were completed by students before IPE exposure and after each step. The results showed that before IPE exposure, students’ perceptions of their readiness for interprofessional learning were generally favourable, with differences across genders (stronger professional identity in females compared to males) and across professions (higher teamwork and collaboration in pharmacy and nutrition students compared to other professions and lower patient centredness in nursing students compared to others). After participation in the IPE steps, students showed enhanced readiness for interprofessional learning and differences between genders and professions decreased. Participants were satisfied with the learning experience and assessment scores showed that all IPE learning outcomes were met. The LAU IPE Steps Framework may be of value to other interprofessional education course developers.     

Perceptions of interprofessionalism in health professional students participating in a novel community service initiative

Interprofessional collaboration is integral to effective patient care in today’s healthcare system. Early exposure to other professions in a hands-on manner during education can be helpful for future practice. However, opportunities for interprofessional education are typically faculty driven and remain limited. Thirty-eight students from different health professions at the University of British Columbia worked collaboratively to promote cardiovascular risk reduction in Vancouver’s Downtown Eastside. Student attitudes toward interprofessionalism were assessed using the Interdisciplinary Education Perception Scale (IEPS). While 38 participants (55%) completed the survey prior to participation in this initiative, only 21 individuals completed the follow-up survey After participation, there were significant improvements in the competency and autonomy (p = 0.02) and perception of actual cooperation (p = 0.04). Students did not report any difference in their perceived need for cooperation after participation in the initiative. These results suggest that student-led community service initiatives can be an effective method for interprofessional education amongst health professional students.     

Circles of care: A novel tool for interprofessional health education

Abstract

The Canadian Interprofessional Health Collaborative recommends that future professionals be prepared for collaborative practice. To do so, it is necessary for them to learn about the principles of interprofessional collaboration. Therefore, to ascertain if students are predisposed, their attitude toward interprofessional learning must be assessed. In the French Canadian context such a measuring tool has not been published yet. The purpose of this study is to translate in French an adapted version of the RIPLS questionnaire and to validate it for use with undergraduate students from seven various health and social care programmes in a Canadian university. According to Vallerand’s methodology, a method for translating measuring instruments: (i) the forward–backward translation indicated that six items of the experimental French version of the RIPLS needed to be more specific; (ii) the experimental French version of the RIPLS seemed clear according to the pre-test assessing items clarity; (iii) evaluation of the content validity indicated that the experimental French version of the RIPLS presents good content validity and (iv) a very good internal consistency was obtained (α?=?0.90; n?=?141). Results indicate that the psychometric properties of the RIPLS in French are comparable to the English version, although a different factorial structure was found. The relevance of three of the 19 items on the RIPLS scale is questionable, resulting in a revised 16-item scale. Future research aimed at validating the translated French version of the RIPLS could also be conducted in another francophone cultural context.