Assessment of student nurses in practice: a comparison of theoretical and practical assessment results in England

This study was undertaken in response to concerns raised by Duffy (2003) that assessors of practice were reluctant to fail student nurses in assessments. This generated doubts about the fitness to practice of some registered nurses. An investigation was undertaken into whether quantitative evidence supported the view that pre-registration nurses rarely failed practical assessments. Comparative failure rates from theoretical and practical assessments were requested from all 52 universities in England that offered pre-registration nursing programmes. Responses were received from 27. Findings indicated that a very small proportion of students failed practical assessments; failure rates for theory outstripped practice by a ratio of 5:1. A quarter of universities failed no students in practice. Students were most likely to fail in year one and least likely in year three. This study supports the belief that assessors of practice are reluctant to fail student nurses. It raises a number of questions about the influence that the systems and practices of professional bodies and universities have on practical assessment. However it also indicates that some student nurses have failed practical assessments and that some universities do have systems in place to address this issue.     

Airflow Obstruction and Reversibility in Spinal Cord Injury: Evidence for Functional Sympathetic Innervation

Radulovic M, Schilero GJ, Wecht JM, Weir JP, Spungen AM, Bauman WA, Lesser M. Airflow obstruction and reversibility in spinal cord injury: evidence for functional sympathetic innervation.

Objectives

The first objective was to assess group differences for specific airway conductance (sGaw) among subjects with tetraplegia, high paraplegia (HP: T2-T6), and low paraplegia (LP: T10-L4). The second objective was to determine the significance of responsiveness to ipratropium bromide (IB) by the assessment of the inherent variability of baseline measurements for impulse oscillation (IOS), body plethysmography, and spirometry.

Design

Prospective cross-sectional intervention study.

Setting

James J. Peters Veterans Administration Medical Center.

Participants

Subjects (N=43): 12 with tetraplegia (C4-8), 11 with HP, 11 with LP, and 9 controls.

Interventions

Not applicable.

Main Outcome Measures

Measurement of IOS, body plethysmography, and spirometry parameters at baseline and 30 minutes after IB.

Results

Baseline sGaw was significantly lower in tetraplegia (0.14±0.03) compared with HP (0.19±0.05) and LP (0.19±0.04) patients. By use of minimal difference to evaluate IB responsiveness in tetraplegia, 4 of 12 and 12 of 12 subjects had significant increases in forced expiratory volume in 1 second and sGaw, respectively, whereas 11 of 12 and 10 of 12 subjects had significant decreases in respiratory resistances measured at 5 and 20Hz (R5 and R20), respectively.

Conclusions

The finding of group differences for baseline sGaw supports the hypothesis that human lung contains functional sympathetic innervation. Body plethysmography and IOS were comparable in detecting IB-induced bronchodilation in tetraplegia and significantly more sensitive than spirometry.     

Validity and Reliability of Assessment Tools for Measuring Unsupported Sitting in People With a Spinal Cord Injury

Boswell-Ruys CL, Sturnieks DL, Harvey LA, Sherrington C, Middleton JW, Lord SR. Validity and reliability of assessment tools for measuring unsupported sitting in people with a spinal cord injury.

Objectives

To develop simple tests to assess the abilities of people with spinal cord injury (SCI) to sit unsupported and to assess the construct validity and test-retest reliability of these tests.

Design

Cross-sectional comparisons, convenience sample.

Setting

Biomechanical laboratory.

Participants

People (N=30) with SCI between the C6 and the L2 level of 2 months to 37 years duration before assessment. The sample was stratified by impairment level (at T8) and time since injury (1y postinjury).

Interventions

Not applicable.

Main Outcome Measures

On 2 separate occasions, participants performed tests that measured the distance of upper-body sway and maximal torso leaning, errors made during a coordinated stability task, timed dressing/undressing of the upper body and alternating arm reaching, and percentage change in seated upper body/arm reaching.

Results

All tests showed good construct validity in that they distinguished between participants with higher (C6-T7) and lower (T8-L2) level impairments (P<.05) and between participants with acute (≤1y) and chronic (>1y) lesions (P<.05). The tests also showed good to excellent test-retest reliability (intraclass correlation coeffiecient_3,1 range, .51-.91).

Conclusions

These simple and quick-to-administer tests have both construct validity and test-retest reliability. They would be appropriate for research and clinical purposes to quantify the abilities of people with SCI to sit unsupported.     

Development of the professional competence and professional self-concept of undergraduate nursing students during the clinical practice period: A cross-lagged panel analysis

AimTo explore the relationship of the development of professional competence and professional self-concept of undergraduate nursing students during the clinical practice period.BackgroundClinical practice is one of the most important aspects of nursing education. Nursing students combine theoretical knowledge, psychomotor skills and emotions in a professional socialization process through clinical practice sessions.DesignA two-time point longitudinal design was performed. A cross-lagged model was employed to analyze the relationship between the development of professional competence and professional self-concept of undergraduate nursing students during their clinical practice period.MethodsA total of 210 undergraduate nursing students were included in this study. The questionnaire was distributed two months and six months after their clinical practice started. Professional Self Concept of Nurses Instrument and Professional Competence Scale for Undergraduate Nursing Students were the two main instruments.ResultsBoth the professional competence and professional self-concept of Undergraduate nursing students increase at the end of the sixth month compared with the end of the second month after their clinical practice started. The results of the cross-lagged analysis showed that the professional self-concept was partially responsible for the development of professional competence. The effect of professional competence on the development of professional self-concept, in contrast, was not found in this study.ConclusionsClinical nursing educators should pay greater attention to the development of the professional self-concept of undergraduate nursing students. More attention should be paid to creating a supportive clinical learning environment to facilitate the improvement of undergraduate nursing students’ professional self-concept and professional competence.     

Factor Structure and Predictive Validity of Somatic and Nonsomatic Symptoms From the Patient Health Questionnaire-9: A Longitudinal Study After Spinal Cord Injury

Krause JS, Reed KS, McArdle JJ. Factor structure and predictive validity of somatic and nonsomatic symptoms from the Patient Health Questionnaire-9: a longitudinal study after spinal cord injury.

Objective

To investigate the factor structure and predictive validity of somatic and nonsomatic depressive symptoms over the first 2.5 years after spinal cord injury (SCI) using the Patient Health Questionnaire-9 (PHQ-9).

Design

Somatic and nonsomatic symptoms were assessed at baseline during inpatient hospitalization (average of 50 days after onset) and during 2 follow-ups (average of 498 and 874 days after onset).

Setting

Data were collected at a specialty hospital in the Southeastern United States and analyzed at a medical university. We performed time-lag regression between inpatient baseline and follow-up somatic and nonsomatic latent factors of the PHQ-9.

Participants

Adults with traumatic SCI (N=584) entered the study during inpatient rehabilitation.

Interventions

Not applicable.

Main Outcome Measure

PHQ-9, a 9-item measure of depressive symptoms.

Results

The inpatient baseline nonsomatic latent factor was significantly predictive of the nonsomatic (r=.40; P=.000) and somatic latent factors at the second follow-up (r=.29; P=.006), whereas the somatic factor at inpatient baseline did not significantly predict either factor. In contrast, when regressing latent factors between the 2 follow-ups, the nonsomatic factor predicted only the nonsomatic factor (r=.66; P=.002), and the somatic factor predicted only future somatic symptoms (r=.66; P=.000). In addition, the factor structure was not stable over time. Item analysis verified the instability of somatic items between inpatient baseline and follow-up and also indicated that self-harm at inpatient baseline was highly predictive of future self-harm.

Conclusions

Nonsomatic symptoms are better predictors of future depressive symptoms when first assessed during inpatient rehabilitation, whereas somatic symptoms become stable predictors only after inpatient rehabilitation. Self-harm (suicidal ideation) is the most stable symptom over time. Clinicians should routinely assess for suicidal ideation and use nonsomatic symptoms when performing assessments during inpatient rehabilitation.     

Determining Pressure Injury Risk on Admission to Inpatient Spinal Cord Injury Rehabilitation: A Comparison of the FIM,Spinal Cord Injury Pressure Ulcer Scale,and Braden Scale

ObjectiveAssess the utility of the admission Spinal Cord Injury Pressure Ulcer Scale (SCIPUS), Braden Scale, and the FIM for identifying individuals at risk for developing pressure injury during inpatient spinal cord injury (SCI) rehabilitation.DesignRetrospective cohort.SettingTwo tertiary rehabilitation centers.ParticipantsIndividuals (N=754) participating in inpatient SCI rehabilitation.InterventionsNot applicable.Main Outcome MeasuresLogistic regression analysis was performed to determine the utility of the SCIPUS, Braden Scale, and FIM for identifying individuals at risk for developing pressure injury (PI) during inpatient SCI rehabilitation. Sensitivity, specificity, positive predictive value, negative predictive value, false negative rate, odds ratio, likelihood ratio, and area under the curve (AUC) are reported.ResultsThe SCIPUS total score and its individual items did not demonstrate acceptable accuracy (AUC≥0.7) whereas the Braden Scale (0.73) and the FIM score (0.74) did. Once items were dichotomized into high and low risk categories, 1 Braden item (friction and shear), 5 FIM items (bathing, toileting, bed/chair transfer, tub/shower transfer, toilet transfer), the FIM transfers subscale, FIM Motor subscale, and the FIM instrument as a whole, maintained AUCs ≥0.7 and negative predictive values ≥0.95. The FIM bed/chair transfer score demonstrated the highest likelihood ratio (2.62) and overall was the most promising measure for determining PI risk.ConclusionStudy findings suggest that a simple measure of mobility, admission FIM bed/chair transfer score of 1 (total assist), can identify at-risk individuals with greater accuracy than both an SCI specific instrument (SCIPUS) and a PI specific instrument (Braden). The FIM bed/chair transfer score can be readily determined at rehabilitation admission with minimal administrative and clinical burden.     

Validity and Responsiveness of the Care and Needs Scale for Assessing Support Needs After Traumatic Brain Injury

So C, Tate RL, Aird V, Allaous J, Browne S, Carr B, Coulston C, Diffley L, Gurka J, Hummell J. Validity and responsiveness of the Care and Needs Scale for assessing support needs after traumatic brain injury.

Objective

To investigate the validity and responsiveness of the Care and Needs Scale (CANS), which was designed to assess support needs of people with traumatic brain injury (TBI).

Design

Two samples of community clients (n=38, n=30) were recruited to examine concurrent, convergent/divergent, and discriminant validity. The ability of the CANS to detect change over a 6-month period from the time of inpatient rehabilitation discharge (predictive validity and responsiveness) was investigated in a third sample of 40 rehabilitation inpatients.

Setting

Two Brain Injury Rehabilitation Units in Sydney, Australia.

Participants

People (N=108) aged between 16 and 70 years admitted for rehabilitation after TBI.

Interventions

Not applicable.

Main Outcome Measures

The CANS, Supervision Rating Scale, FIM, Sydney Psychosocial Reintegration Scale, and Disability Rating Scale.

Results

Evidence for concurrent validity was shown with fair to moderate correlation coefficients between the CANS and measures of supervision, functional independence, and psychosocial functioning (absolute value, r_s=.43-.68; P<.01). Support for convergent and divergent validity was provided by correlation coefficients that were higher for measures tapping similar constructs (absolute value, r_s=46; P<.01) but lower for measures of dissimilar constructs (absolute value, r_s=.07-.26; not significant). In addition, the CANS discriminated between levels of injury severity, functional independence, and overall functioning (P<.01). In terms of predictive validity and responsiveness, CANS scores at inpatient rehabilitation discharge predicted the participant's functioning 6 months later.

Conclusions

These results show the CANS is a valid and responsive tool and, together with its previously shown reliability, is suitable for routine application in clinical and research practice.     

Development and Assessment of a Community Follow-Up Questionnaire for the Rick Hansen Spinal Cord Injury Registry

Objective

To develop a comprehensive community follow-up questionnaire for participants enrolled in the Rick Hansen Spinal Cord Injury Registry (RHSCIR).

Design

Development and preliminary assessment of measurement properties (reliability and validity) of instruments used during a community follow-up and aligned with the International Classification of Functioning, Disability and Health (ICF).

Setting

General community setting.

Participants

People with spinal cord injury (N=50) living in the community.

Intervention

Not applicable.

Main Outcome Measures

A comprehensive follow-up questionnaire, referred to as the RHSCIR Community Follow-up Questionnaire Version 2.0 (CFQ-V2.0), includes 8 instruments. Four new instruments were developed, 2 existing instruments were modified, and 2 previously published instruments were included.

Results

Intra- and interrater reliability statistics (Gwet's AC1) support the measurement properties of the new and modified instruments. Correlations between new and existing instruments and between groups based on the severity of injury support the construct validity of the secondary complications and person-perceived participation instruments.

Conclusions

The RHSCIR CFQ-V2.0 is a comprehensive community follow-up questionnaire that aligns to the ICF. Initial study results suggest that it covers all relevant aspects of community living, and the measurement properties are promising.     

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE)

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students’ performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark’s four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process.This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students’ expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students’ performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education.     

Optimal Bladder Management Following Spinal Cord Injury: Evidence,Practice and a Cooperative Approach Driving Future Directions in Australia

We examined spinal cord injury (SCI) catheterization practices in Australia to understand practice patterns and consistency with research evidence. A national facilitated discussion forum was held during the annual Australian and New Zealand Spinal Cord Society conference attended by 66 conference delegates. Initially, presentations were given on the latest laboratory research examining bladder changes following SCI; an overview of evidence-based recommendations indicating that intermittent catheterization is best practice; and results of a single-center practice audit that demonstrated substantial delay in transition between acute SCI and intermittent catheterization. The ensuing discussion covered current catheterization practices in both inpatient SCI units and the community and highlighted gaps between evidence and practice, with considerable variation in practice between centers and settings. Reported challenges to implementing best practice included social, economic, and resource factors. A disconnect between hospital and community practice was also identified as an important barrier to long-term uptake of intermittent catheterization following acute SCI. The discussion identified 3 proposed activities: (1) explore current practice and bladder health following SCI in greater depth across SCI units and in local communities through audits and standardized biochemical analysis; (2) determine the behavioral drivers of current practice; and (3) develop a knowledge translation strategy to better align practice with current clinical practice guidelines.     

Self-Scoring Templates for Motor and Cognitive Subscales of the FIM Instrument for Persons With Spinal Cord Injury

Objective

To provide self-scoring templates for the FIM instrument's motor and cognitive scales that enable clinicians to monitor progress during rehabilitation using equal-interval Rasch-calibrated measures instead of ordinal raw scores.

Design

Secondary analysis of a prospective, observational cohort study.

Setting

Six geographically dispersed hospital-based rehabilitation centers in the United States.

Participants

Subset of consecutively enrolled individuals with new traumatic spinal cord injuries discharged from participating rehabilitation centers (N=1146).

Intervention

Not applicable.

Main Outcome Measures

Subscores of the FIM instrument, including a 13-item motor scale, a 5-item cognitive scale, an 11-item (without sphincter control items) motor scale, a 3-item transfer scale, a 6-item self-care scale, a 3-item self-care upper extremity scale, and a 3-item self-care lower extremity scale.

Results

KeyForms for the FIM instrument scales allow clinicians and investigators to estimate patients' functional status and monitor progress. In cases with no missing data, the look-up tables provide more accurate estimates of patients' functional status.

Conclusion

Clinicians can use KeyForms and look-up tables for FIM instrument subscales to monitor patients' progress and communicate improvement in equal-interval units.     

Towards the Development of Clinical Measures for Spinal Cord Injury Based on the International Classification of Functioning,Disability and Health With Rasch Analyses

Objectives

To determine whether the International Classification of Functioning, Disability and Health (ICF) categories relevant to spinal cord injury (SCI) can be integrated in clinical measures and to obtain insights to guide their future operationalization. Specific aims are to find out whether the ICF categories relevant to SCI fit a Rasch model taking into consideration the dimensionality found in previous investigations, local item dependencies, or differential item functioning.

Design

All second-level ICF categories collected in the Development of ICF Core Sets for SCI project in specialized centers within 15 countries from 2006 through 2008.

Setting

Secondary data analysis.

Participants

Adults (N=1048) with SCI from the early postacute and long-term living context.

Interventions

Not applicable.

Main Outcome Measures

Two unidimensional Rasch analyses: one for the ICF categories from body functions and body structures components and another for the ICF categories from the activities and participation component.

Results

Results support good reliability and targeting of the ICF categories in both dimensions. In each dimension, few ICF categories were subject to misfit. Local item dependency was observed between ICF categories of the same chapters. Group effects for age and sex were observed only to a small extent.

Conclusions

The validity of ICF categories to develop measures of functioning in SCI for clinical practice and research is to some extent supported. Model adjustments were suggested to further improve their operationalization and psychometrics.     

Translation and further validation of a global rating scale for the assessment of clinical competence in prehospital emergency care

Global rating scales are useful to assess clinical competence at a general level based on specific word dimensions. The aim of this study was to translate and culturally adapt the Paramedic Global Rating Scale, and to contribute validity evidence and instrument usefulness in training results and clinical competence assessments of students undergoing training to become ambulance nurses and paramedics at Swedish and Finnish universities. The study included translation, expert review and inter-rater reliability (IRR) tests. The scale was translated and culturally adapted to clinical and educational settings in both countries. A content validity index (CVI) was calculated using eight experts. IRR tests were performed with five registered nurses working as university lecturers, and with six clinicians working as ambulance nurses. They individually rated the same simulated ambulance assignment. Based on the ratings IRR was calculated with intra-class correlation (ICC). The scale showed excellent CVI for items and scale. The ICC indicated substantial agreement in the group of lecturers and a high degree of agreement in the group of clinicians. This study provides validity evidence for a Swedish version of the scale, supporting its use in measuring clinical competence among students undergoing training to become ambulance nurses and paramedics.     

Coffee,Chaos, and Competence: A Day in the Life of a Radiology Nurse

The role of a radiology nurse is not clearly understood by patients or nursing colleagues. Following a radiology float nurse through a day in a complex radiology practice in a Magnet-designated facility illustrates how a radiology nurse must incorporate specialty education and training, clinical competence, and a professional nursing practice model to provide quality patient care.