Development and psychometric evaluation of an information literacy self-efficacy survey and an information literacy knowledge test

Objective

To develop and psychometrically evaluate an information literacy (IL) self-efficacy survey and an IL knowledge test.

Methods

In this test–retest reliability study, a 25-item IL self-efficacy survey and a 50-item IL knowledge test were developed and administered to a convenience sample of 53 chiropractic students. Item analyses were performed on all questions.

Results

The IL self-efficacy survey demonstrated good reliability (test–retest correlation = 0.81) and good/very good internal consistency (mean κ = .56 and Cronbach''s α = .92). A total of 25 questions with the best item analysis characteristics were chosen from the 50-item IL knowledge test, resulting in a 25-item IL knowledge test that demonstrated good reliability (test–retest correlation = 0.87), very good internal consistency (mean κ = .69, KR20 = 0.85), and good item discrimination (mean point-biserial = 0.48).

Conclusions

This study resulted in the development of three instruments: a 25-item IL self-efficacy survey, a 50-item IL knowledge test, and a 25-item IL knowledge test. The information literacy self-efficacy survey and the 25-item version of the information literacy knowledge test have shown preliminary evidence of adequate reliability and validity to justify continuing study with these instruments.Key Indexing Terms: Chiropractic, Evidence-Based Practice, Information Literacy, Psychometrics, Questionnaire Design     

Reliability of the Balance Evaluation Systems Test (BESTest) and BESTest sections for adults with hemiparesis

BACKGROUND:

The Balance Evaluation Systems Test (BESTest) was recently created to allow the development of treatments according to the specific balance system affected in each patient. The Brazilian version of the BESTest has not been specifically tested after stroke.

OBJECTIVE:

To evaluate the intra- and inter-rater reliability and concurrent and convergent validity of the total score of the BESTest and BESTest sections for adults with hemiparesis after stroke.

METHOD:

The study included 16 subjects (61.1±7.5 years) with chronic hemiparesis (54.5±43.5 months after stroke). The BESTest was administered by two raters in the same week and one of the raters repeated the test after a one-week interval. Intraclass correlation coefficient (ICC) was calculated to assess intra- and interrater reliability. Concurrent validity with the Berg Balance Scale (BBS) and convergent validity with the Activities-specific Balance Confidence scale (ABC-Brazil) were assessed using Pearson''s correlation coefficient.

RESULTS:

Both the BESTest total score (ICC=0.98) and the BESTest sections (ICC between 0.85 and 0.96) have excellent intrarater reliability. Interrater reliability for the total score was excellent (ICC=0.93) and, for the sections, it ranged between 0.71 and 0.94. The correlation coefficient between the BESTest and the BBS and ABC-Brazil were 0.78 and 0.59, respectively.

CONCLUSIONS:

The Brazilian version of the BESTest demonstrated adequate reliability when measured by sections and could identify what balance system was affected in patients after stroke. Concurrent validity was excellent with the BBS total score and good to excellent with the sections. The total scores but not the sections present adequate convergent validity with the ABC-Brazil. However, other psychometric properties should be further investigated.     

EVALUATING CHANGE IN CLINICAL STATUS: RELIABILITY AND MEASURES OF AGREEMENT FOR THE ASSESSMENT OF GLENOHUMERAL RANGE OF MOTION

Objectives:

To evaluate intra-rater and inter-rater reliability and measurement error in glenohumeral range of motion (ROM) measurements using a standard goniometer.

Study design:

17 adult subjects with and without shoulder pathology were evaluated for active and passive range of motion. Fifteen shoulder motions were assessed by two raters to determine reliability. The intra-class correlation coefficients (ICC) were calculated and examined to determine if reliability of ICC ≥ 0.70 existed. The standard error of measurement (SEM) and the minimal clinical difference (MCD) were also calculated.

Results:

Thxe criterion reliability was achieved in both groups for intra-rater reliability of standing AROM abduction; supine AROM and PROM abduction, flexion, external rotation at 0° abduction; and for inter-rater reliability of supine AROM and PROM abduction, external rotation at 0° abduction. The SEM ranged from 4°-7° for intra-rater and 6°-9° for inter-rater agreement on movements that achieved the criterion reliability. The MCD ranged from 11°-16° for a single evaluator and 14°-24° for two evaluators.

Conclusions:

Assessment of AROM and PROM in supine achieves superior reliability. The use of either a single or multiple raters affects the number of movements that achieved clinically meaningful reliability. Some movements consistently did not achieve the criterion and may not be the best movements to monitor treatment outcome.     

Validation of the Arabic Version of the Early Inflammatory Arthritis Detection Tool

Objective

To evaluate the reliability and validity of the Arabic version of the Early Inflammatory Arthritis Questionnaire (EIAQ-A), a detection tool for screening for early inflammatory arthritis (EIA) in Arabic-speaking populations.

Subjects and Methods

A cross-sectional study was conducted among 30 consecutive participants (21 female and 9 male) attending the Internal Medicine Outpatient Clinic at Mubarak Al-Kabeer Hospital. They completed the self-administered EIAQ-A twice within a 2-week period. Their disease activity was evaluated during the visits based on clinical and laboratory variables. Cross-cultural adaptation was performed using forward and backward translations of the original questionnaire. Test-retest reliability of the EIAQ-A was evaluated using the measure of agreement, kappa (κ), between the response of participants in the two interviews. Internal consistency of the EIAQ-A was measured using the Kudar-Richardson-20 coefficient (KR-20), a binary response equivalent to Cronbach''s a. External construct validity was assessed by Spearman''s rank correlation coefficient (r_s) between the score of EIAQ-A and both clinical and laboratory variables of disease activity.

Results

The test-retest reliability for EIAQ-A was good (κ = 0.558) for the overall score and between 0.841 and 0.368 for the subscale scores. Internal consistency had an acceptable value of KR-20 = 0.869. The construct validity for EIAQ-A was high for all disease activity variables tested, r_s was between 0.727 (swollen joint count) and 0.896 (visual analog scale pain score).

Conclusion

The EIAQ-A was a reliable and valid tool for population screening for EIA. Its use may accelerate the early detection of EIA in Arabic-speaking communities.Key Words: Arthritis, Inflammation, Questionnaire, Reliability, Validity     

Measurement properties and feasibility of clinical tests to assess sit-to-stand/stand-to-sit tasks in subjects with neurological disease: a systematic review

Background

Subjects with neurological disease (ND) usually show impaired performance during sit-to-stand and stand-to-sit tasks, with a consequent reduction in their mobility levels.

Objective

To determine the measurement properties and feasibility previously investigated for clinical tests that evaluate sit-to-stand and stand-to-sit in subjects with ND.

Method

A systematic literature review following the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) protocol was performed. Systematic literature searches of databases (MEDLINE/SCIELO/LILACS/PEDro) were performed to identify relevant studies. In all studies, the following inclusion criteria were assessed: investigation of any measurement property or the feasibility of clinical tests that evaluate sit-to-stand and stand-to-sit tasks in subjects with ND published in any language through December 2012. The COSMIN checklist was used to evaluate the methodological quality of the included studies.

Results

Eleven studies were included. The measurement properties/feasibility were most commonly investigated for the five-repetition sit-to-stand test, which showed good test-retest reliability (Intraclass Correlation Coefficient:ICC=0.94-0.99) for subjects with stroke, cerebral palsy and dementia. The ICC values were higher for this test than for the number of repetitions in the 30-s test. The five-repetition sit-to-stand test also showed good inter/intra-rater reliabilities (ICC=0.97-0.99) for stroke and inter-rater reliability (ICC=0.99) for subjects with Parkinson disease and incomplete spinal cord injury. For this test, the criterion-related validity for subjects with stroke, cerebral palsy and incomplete spinal cord injury was, in general, moderate (correlation=0.40-0.77), and the feasibility and safety were good for subjects with Alzheimer''s disease.

Conclusions

The five-repetition sit-to-stand test was used more often in subjects with ND, and most of the measurement properties were investigated and showed adequate results.     

Reliability of different methodologies of infrared image analysis of myofascial trigger points in the upper trapezius muscle

BACKGROUND:

Infrared thermography is recognized as a viable method for evaluation of subjects with myofascial pain.

OBJECTIVE:

The aim of the present study was to assess the intra- and inter-rater reliability of infrared image analysis of myofascial trigger points in the upper trapezius muscle.

METHOD:

A reliability study was conducted with 24 volunteers of both genders (23 females) between 18 and 30 years of age (22.12±2.54), all having cervical pain and presence of active myofascial trigger point in the upper trapezius muscle. Two trained examiners performed analysis of point, line, and area of the infrared images at two different periods with a 1-week interval. The intra-class correlation coefficient (ICC_2,1) was used to assess the intra- and inter-rater reliability.

RESULTS:

With regard to the intra-rater reliability, ICC values were between 0.591 and 0.993, with temperatures between 0.13 and 1.57 °C for values of standard error of measurement (SEM) and between 0.36 and 4.35 °C for the minimal detectable change (MDC). For the inter-rater reliability, ICC ranged from 0.615 to 0.918, with temperatures between 0.43 and 1.22 °C for the SEM and between 1.19 and 3.38 °C for the MDC.

CONCLUSION:

The methods of infrared image analyses of myofascial trigger points in the upper trapezius muscle employed in the present study are suitable for clinical and research practices.     

Development and Testing of Self-Management Scale for PD Patients

♦ Objectives:

To develop and evaluate the self-management scale for peritoneal dialysis (PD) patients.

♦ Methods:

The item pool was formulated based on literature reviews and in-depth interviews. An initial scale containing five factors and 44 items was constructed through two rounds of Delphi expert consultation and a preliminary test. A total of 313 PD patients from the Jiangsu-Zhejiang-Shanghai area were surveyed to test the reliability and validity of the scale.

♦ Results:

Five factors, namely solution bag replacement, troubleshooting during operation, diet management, complication monitoring, emotion management and return to social life, were extracted by exploratory factor analysis: the 28 items could explain 64.567% of the total variance; the content validity index was 0.963; the Cronbach’s α coefficient and split-half coefficient were 0.926 and 0.960 respectively; and test-retest reliability was 0.937.

♦ Conclusion:

The scale has been proved to be a reliable and valid tool which allows PD nurses to evaluate the self-management ability of PD patients. The evaluation outcomes can serve as a basis for individualized nursing plans and interventions so as to provide highly effective nursing care.     

Psychometric comparison of three behavioural scales for the assessment of pain in critically ill patients unable to self-report

Introduction

Pain assessment is associated with important outcomes in ICU patients but remains challenging, particularly in non-communicative patients. Use of a reliable tool is paramount to allow any implementation of sedation/analgesia protocols in a multidisciplinary team. This study compared psychometric properties (inter-rater agreement primarily; validity, responsiveness and feasibility secondarily) of three pain scales: Behavioural Pain Scale (BPS/BPS-NI, that is BPS for Non-Intubated patients), Critical Care Pain Observation Tool (CPOT) and Non-verbal Pain Scale (NVPS), the pain tool routinely used in this 16-bed medical ICU.

Methods

Pain was assessed by at least one of four investigators and one of the 20 bedside nurses before, during and 10 minutes after routine care procedures in non-comatose patients (Richmond Agitation Sedation Scale ≥ -3) who were unable to self-report their pain intensity. The Confusion Assessment Method for the ICU was used to assess delirium. Non-parametric tests were used for statistical analysis. Quantitative data are presented as median (25^th to 75^th).

Results

A total of 258 paired assessments of pain were performed in 30 patients (43% lightly sedated, 57% with delirium, 63% mechanically ventilated). All three scales demonstrated good psychometric properties. However, BPS and CPOT exhibited the best inter-rater reliability (weighted-κ 0.81 for BPS and CPOT) and the best internal consistency (Cronbach-α 0.80 for BPS, 0.81 for CPOT), which were higher than for NVPS (weighted-κ 0.71, P <0.05; Cronbach-α 0.76, P <0.01). Responsiveness was significantly higher for BPS compared to CPOT and for CPOT compared to NVPS. For feasibility, BPS was rated as the easiest scale to remember but there was no significant difference in regards to users’ preference.

Conclusions

BPS and CPOT demonstrate similar psychometric properties in non-communicative intubated and non-intubated ICU patients.

Electronic supplementary material

The online version of this article (doi:10.1186/cc14000) contains supplementary material, which is available to authorized users.     

Detecting acute distress and risk of future psychological morbidity in critically ill patients: validation of the intensive care psychological assessment tool

Introduction

The psychological impact of critical illness on a patient can be severe, and frequently results in acute distress as well as psychological morbidity after leaving hospital. A UK guideline states that patients should be assessed in critical care units, both for acute distress and risk of future psychological morbidity; but no suitable method for carrying out this assessment exists. The Intensive care psychological assessment tool (IPAT) was developed as a simple, quick screening tool to be used routinely to detect acute distress, and the risk of future psychological morbidity, in critical care units.

Methods

A validation study of IPAT was conducted in the critical care unit of a London hospital. Once un-sedated, orientated and alert, critical care patients were assessed with the IPAT and validated tools for distress, to determine the IPAT’s concurrent validity. Fifty six patients took IPAT again to establish test-retest reliability. Finally, patients completed posttraumatic stress disorder (PTSD), depression and anxiety questionnaires at three months, to determine predictive validity of the IPAT.

Results

One hundred and sixty six patients completed the IPAT, and 106 completed follow-up questionnaires at 3 months. Scale analysis showed IPAT was a reliable 10-item measure of critical care-related psychological distress. Test-retest reliability was good (r =0.8). There was good concurrent validity with measures of anxiety and depression (r =0.7, P <0.01; r =0.6, P <0.01). With a cut-point of ≥7, the IPAT had 82% sensitivity and 65% specificity to detect concurrent anxiety; and 80% sensitivity and 66% specificity to detect concurrent low mood (area under the curve (AUC) =0.8 for both). Predictive validity for psychological morbidity was good (r =0.4, P <0.01; r =0.64, P <0.01 for PTSD with days 1 and 2 data). The IPAT had 69% specificity and 57% sensitivity to predict future psychological morbidity (AUC =0.7).

Conclusions

The IPAT was found to have good reliability and validity. Sensitivity and specificity analysis suggest the IPAT could provide a way of allowing staff to assess psychological distress among critical care patients after further replication and validation. Further work is also needed to determine its utility in predicting future psychological morbidity.

Electronic supplementary material

The online version of this article (doi:10.1186/s13054-014-0519-8) contains supplementary material, which is available to authorized users.     

The reliability and validity study of the Kinesthetic and Visual Imagery Questionnaire in individuals with Multiple Sclerosis

Objective

Motor imagery (MI) has been recently considered as an adjunct to physical rehabilitation in patients with multiple sclerosis (MS). It is necessary to assess MI abilities and benefits in patients with MS by using a reliable tool. The Kinesthetic and Visual Imagery Questionnaire (KVIQ) was recently developed to assess MI ability in patients with stroke and other disabilities. Considering the different underlying pathologies, the present study aimed to examine the validity and reliability of the KVIQ in MS patients.

Method

Fifteen MS patients were assessed using the KVIQ in 2 sessions (5-14days apart) by the same examiner. In the second session, the participants also completed a revised MI questionnaire (MIQ-R) as the gold standard. Intra-class correlation coefficients (ICCs) were measured to determine test-retest reliability. Spearman''s correlation analysis was performed to assess concurrent validity with the MIQ-R. Furthermore, the internal consistency (Cronbach''s alpha) and factorial structure of the KVIQ were studied.

Results

The test-retest reliability for the KVIQ was good (ICCs: total KVIQ=0.89, visual KVIQ=0.85, and kinesthetic KVIQ=0.93), and the concurrent validity between the KVIQ and MIQ-R was good (r=0.79). The KVIQ had good internal consistency, with high Cronbach''s alpha (alpha=0.84). Factorial analysis showed the bi-factorial structure of the KVIQ, which was explained by visual=57.6% and kinesthetic=32.4%.

Conclusions

The results of the present study revealed that the KVIQ is a valid and reliable tool for assessing MI in MS patients.     

Reliability,validity and description of timed performance of the Jebsen–Taylor Test in patients with muscular dystrophies

Background

The Jebsen–Taylor Test evaluates upper limb function by measuring timed performance on everyday activities. The test is used to assess and monitor the progression of patients with Parkinson disease, cerebral palsy, stroke and brain injury.

CROSS‐CULTURAL ADAPTATION AND VALIDATION OF THE KOREAN VERSION OF THE CUMBERLAND ANKLE INSTABILITY TOOL

Background

The Cumberland Ankle Instability Tool (CAIT) is a valid and reliable patient reported outcome used to assess the presence and severity of chronic ankle instability (CAI). The CAIT has been cross‐culturally adapted into other languages for use in non‐English speaking populations. However, there are no valid questionnaires to assess CAI in individuals who speak Korean.

Purpose

The purpose of this study was to translate, cross‐culturally adapt, and validate the CAIT, for use in a Korean‐speaking population with CAI.

Study Design

Cross‐cultural reliability study.

Methods

The CAIT was cross‐culturally adapted into Korean according to accepted guidelines and renamed the Cumberland Ankle Instability Tool‐Korean (CAIT‐K). Twenty‐three participants (12 males, 11 females) who were bilingual in English and Korean were recruited and completed the original and adapted versions to assess agreement between versions. An additional 168 national level Korean athletes (106 male, 62 females; age = 20.3 ± 1.1 yrs), who participated in ≥ 90 minutes of physical activity per week, completed the final version of the CAIT‐K twice within 14 days. Their completed questionnaires were assessed for internal consistency, test‐retest reliability, criterion validity, and construct validity.

Results

For bilingual participants, intra‐class correlation coefficients (ICC_2,1) between the CAIT and the CAIT‐K for test‐retest reliability were 0.95 (SEM=1.83) and 0.96 (SEM=1.50) in right and left limbs, respectively. The Cronbach''s alpha coefficients were 0.92 and 0.90 for the CAIT‐K in right and left limbs, respectively. For native Korean speakers, the CAIT‐K had high internal consistency (Cronbach''s α=0.89) and intra‐class correlation coefficient (ICC_2,1 = 0.94, SEM=1.72), correlation with the physical component score (rho=0.70, p = 0.001) of the Short‐Form Health Survey (SF‐36), and the Kaiser‐Meyer‐Olkin score was 0.87.

Conclusions

The original CAIT was translated, cross‐culturally adapted, and validated from English to Korean. The CAIT‐K appears to be valid and reliable and could be useful in assessing the Korean speaking population with CAI.     

Development and Cross-Validation of the Short Form of the Cultural Competence Scale for Nurses

Purpose

To develop and validate the short form of the Korean adaptation of the Cultural Competence Scale for Nurses.

The psychometric properties of the mindful attention awareness scale among Arab parents of children with autism spectrum disorder

Aim

The purpose of this study was to examine the psychometric properties and the theoretical structure of the mindful attention awareness scale (MAAS) with parents of children with autism spectrum disorder (ASD) in Jordan.

A NOVEL TECHNIQUE FOR DETERMINING SCAPULOHUMERAL TRANSLATION: A CASE-CONTROL AND INTER-RATER RELIABILITY STUDY

Background:

Alterations in scapular and glenohumeral kinematics in patients with shoulder dysfunction have been recognized by this studies authors'' and described in multiple other studies available in the literature. A reliability study was developed to assess a new technique for measuring scapulohumeral kinematics. Previous scapular position measuring techniques may require expensive equipment which decreases clinical utility. Other techniques require identification of multiple anatomic landmarks that may decrease accuracy, precision, and reliability.

Methods:

A sample of asymptomatic controls and symptomatic study subjects were recruited. Each subject had markers placed on each acromion and stood at a standardized distance in front of a light. The shadow projected from the acromial marker onto a standardized, data collection board was measured during the resting, flexion, and scaption positions for bilateral shoulders. The horizontal and vertical translations of the shadows were measured compared to the resting point for both flexion and scaption.

Results:

The scapula translated superiorly and medially during both flexion and scaption movements in all subjects and controls. There was good inter-rater reliability for measuring scapular translation with scaption (ICC= 0.81) and moderate reliability for measuring scapular translation with flexion (ICC = 0.62). There was increased superior and medial scapular translation in the subjects with flexion (p= 0.004 and p=0.002) and scaption (p= 0.01 and p=0.007) in the symptomatic shoulder compared to the asymptomatic shoulder. Superior scapular translation with flexion (p=0.0003) and scaption (p=0.006) and medial scapular translation with flexion (p<0.0001) and scaption (p<0.0001) was greater in the symptomatic subjects compared to controls.

Conclusions:

The scapula translates both superiorly and medially with flexion and scaption in asymptomatic and symptomatic subjects. After shoulder surgery, patients have increased superior and medial translation of the scapula compared to 1) their asymptomatic shoulder and 2) an asymptomatic control group. The current technique has good inter-rater reliability (ICC=0.81) when measuring scaption and moderate reliability when measuring flexion (ICC=0.62).

Level of Evidence:

III Diagnostic Case-Control Study     

RELIABILITY OF AND THE RELATIONSHIP BETWEEN ULTRASOUND MEASUREMENT AND THREE CLINICAL ASSESSMENTS OF HUMERAL TORSION

Purpose/Background:

Differences in humeral torsion have been observed between overhead athletes and non‐athletes. Although humeral torsion may be an adaptive process for athletic performance, it may be associated with injury. Methods for measuring humeral torsion have consisted of radiography, computer tomography, and ultrasound imaging. However, diagnostic imaging may be costly and not available to all clinicians. The implementation of clinical assessments may be an alternative way to measure humeral torsion. Before clinical measures can be recommended, these assessments need to be evaluated for validity and reliability of each test. The purpose of this study was to assess the intratester and intertester reliability of three clinical tests, intratester reliability of ultrasound measures, and the validity of each clinical test to ultrasound measures.

Methods

Thirty participants (male: 12, female: 18; age: 20±2 years; height: 174.24±9.35 cm; mass: 70.53±11.06 kg; body mass index: 23.13±2.47 kg/m²; years in sport: 9±4 years) with experience in overhead sports were assessed for humeral torsion, bilaterally. Humeral torsion was assessed using musculoskeletal ultrasound by a single assessor, and using three separate clinical assessments by two independent assessors. Clinical assessments included the angle of rotation during both the bicipital tuberosity palpation with the shoulder abducted at 90 degrees (Palp90) or 45 degrees (Palp45), and the angle of external rotation during horizontal adduction (HADD).

Results

Intratester reliability for the ultrasound measure was good (ICC=0.907), along with intratester reliability for both assessors across each clinical assessment (ICC''s > 0.769). Poor to moderate reliability was observed between assessors for each clinical assessment (ICC=0.256 Palp90, ICC=0.419 Palp45, ICC=0.243 HADD. Only the Palp90 measure had a fair but significant (r=0.326, p=0.011) relationship with ultrasound measures.

Conclusion

Individual assessors can achieve reliable ultrasound, bicipital tuberosity palpation and HADD values across multiple trials; however, these measures are not consistent between assessors. Additionally, only one clinical test had a fair but significant relationship with ultrasound measures. Improved testing procedures may be needed to increase between assessor reliability and strength of relationships to ultrasound measures. Current application of clinical assessments to measure humeral torsion is limited.

Level of Evidence:

3b; Grade of Recommendation C     

RELIABILITY OF THE SITTING HAND PRESS-UP TEST FOR IDENTIFYING AND QUANTIFYING THE LEVEL OF SCAPULAR MEDIAL BORDER POSTERIOR DISPLACEMENT IN OVERHEAD ATHLETES

Background:

The lack of proper scapular kinematics can limit the function of the entire shoulder complex.^1,3 Many forms of scapular dyskinesis have been proposed along with tests to measure for the position and motion associated with those positional and movement faults (2,4-6). While scapular internal rotation has been listed among the forms of scapular dyskinesis there has not been a reliable test documented in the literature that examines this motion. The purpose of this study was to determine whether an innovative scapular medial border posterior displacement measurement device has adequate inter-rater and intra-rater reliability when used at rest and during the sitting hand press up test.

Methods:

16 male Division III baseball players free of upper limb injury for the previous 12 months participated in the study. Posterior scapular displacement measures were taken on each subject in a resting static posture and while performing a sitting hand press up test. Subjects were tested twice within 24 hours by two separate examiners. Intraclass correlation coefficients (ICC) were calculated to determine intra-rater and inter-rater reliability.

Results:

The intra-rater reliability for rater 1 was .97 (95% confidence interval [CI]= .91-.98), for the rest position and .95 (95% CI= .86-.98) for the sitting hand press-up position. Intra-rater reliability for rater 2 was .99 (95% CI= .97-.99) for the rest position and .98 (95% CI=. 95-.99) for the sitting hand press-up position. The ICCs for inter-rater reliability of the scapular medial border posterior displacement measurement in at the rest position and the sitting hand press-up position were .89 (95% CI= .81-.96) and .89 (95% CI= .80-.96) respectively.

Conclusions:

The findings of this study indicate that the measurement of medial border posterior displacement using this device demonstrates good to excellent inter-rater and intra-rater reliability.     

Development and Psychometric Evaluation of the HPV Clinical Trial Survey for Parents (CTSP‐HPV) Using Traditional Survey Development Methods and Community Engagement Principles

Objective

This study describes the development and psychometric evaluation of HPV Clinical Trial Survey for Parents with Children Aged 9 to 15 (CTSP‐HPV) using traditional instrument development methods and community engagement principles.

Methods

An expert panel and parental input informed survey content and parents recommended study design changes (e.g., flyer wording). A convenience sample of 256 parents completed the final survey measuring parental willingness to consent to HPV clinical trial (CT) participation and other factors hypothesized to influence willingness (e.g., HPV vaccine benefits). Cronbach''s a, Spearman correlations, and multiple linear regression were used to estimate internal consistency, convergent and discriminant validity, and predictively validity, respectively.

Results

Internal reliability was confirmed for all scales (a ≥ 0.70.). Parental willingness was positively associated (p < 0.05) with trust in medical researchers, adolescent CT knowledge, HPV vaccine benefits, advantages of adolescent CTs (r range 0.33–0.42), supporting convergent validity. Moderate discriminant construct validity was also demonstrated. Regression results indicate reasonable predictive validity with the six scales accounting for 31% of the variance in parents’ willingness.

Conclusions

This instrument can inform interventions based on factors that influence parental willingness, which may lead to the eventual increase in trial participation. Further psychometric testing is warranted.     

THE RELIABILITY,MINIMAL DETECTABLE CHANGE AND CONSTRUCT VALIDITY OF A CLINICAL MEASUREMENT FOR QUANTIFYING POSTERIOR SHOULDER TIGHTNESS IN THE POST‐OPERATIVE POPULATION

Background:

Posterior shoulder tightness (PST) has been implicated in the etiology of numerous shoulder disorders. Although reliable and valid measures have been described for the non‐operative population one does not exist for the post‐operative population.

Study Design:

Blinded repeated measures design.

Purpose:

Investigate the intrarater reliability, minimal detectable change at the 90% confidence interval (MDC₉₀) and construct validity of an inclinometric measurement designed to quantify PST in the post‐operative population.

Methods:

One investigator performed PST measurements on the operative shoulder of 23 participants. Passive internal and external rotation measurements were performed for the validity component of the investigation.

Results:

Intrarater reliability using an intraclass correlation coefficient (ICC) model 3,k was good (ICC = 0.79). The MDC₉₀ indicated that a change of greater than or equal to 8 degrees would be required to be 90% certain that a change in the measurement would not be the result of inter‐trial variability or measurement error. Construct validity was supported by a statistically significant relationship between PST and internal rotation r = 0.54 and by a relationship between PST and external rotation r = 0.30 which was not statistically significant.

Conclusion:

The sidelying procedure described in this investigation appears to be a reliable and valid means for quantifying PST in the post‐operative population. Moreover, the use of inclinometry provides an absolute angle of tightness that may be used for intersubject comparison, documenting change, and to determine reference values.

Level of Evidence:

Therapy, level 2b     

REAL‐TIME TEST‐RETEST AND INTERRATER RELIABILITY OF SELECT PHYSICAL PERFORMANCE MEASURES IN PHYSICALLY ACTIVE COLLEGE‐AGED STUDENTS

Background:

A new 16‐item physical performance measure screening battery (16‐PPM) was developed in order to expand on established movement based qualitatively scored functional screening batteries to encompass a broader spectrum of quantitatively scored functional constructs such as strength, endurance, and power.

Purpose/Hypothesis:

The purpose of this study was quantify the real‐time tests‐retest and expert versus novice interrater reliability of the 16‐PPM screen on a group of physically active college‐aged individuals. The authors'' hypothesized that the test‐retest and interrater reliability of quantitatively‐scored performance measures would be highly correlated (ICC ≥ 0.75) and that qualitatively‐scored movement screening tests would be moderately correlated (K_w = 0.41‐0.60).

Study Design:

Cohort reliability study

Methods:

Nineteen (8 males, 11 females) healthy physically active college‐aged students completed the 16‐PPM on two days, one week apart.

Results:

The majority of the quantitatively scored components of the 16‐PPMs demonstrated good expert‐novice interrater reliability (ICC > 0.75), while qualitatively scored tests had moderate (K_w = 0.41‐0.60) to substantial (K_w = 0.61‐0.80) agreement. Test‐retest reliability was consistent between raters, with most quantitatively scored PPMs exhibiting superior reliability to the qualitatively scored PPMs.

Conclusions:

The 16‐PPM test items showed good test‐retest and interrater reliability. However, results indicate that expert raters may be more reliable than novice raters for qualitatively scored tests. The validity of this 16‐PPM needs to be determined in future studies.

Clinical Relevance:

Physical performance screening batteries may be used to help identify individuals at risk for future athletic injury; however, current PPMs that rely on qualitatively scored movement screens have exhibited inconsistent and questionable injury prediction validity. The addition of reliable quantitatively scored PPMs may complement qualitatively scored PPMs to improve the battery''s predictive ability.

Level of Evidence:

Level III