Objective Measurements of Neck Function. A Critical Review of their Validity and Reliability

Abstract

Neck pain and headache are very common symptoms, especially in western societies. Clinical research is often confounded by the multiplicity of aetiological factors and is usually based on subjective assessment of these symptoms. A comprehensive clinical evaluation of the cervical spine should include both subjective and objective assessment. Quantification of neck function requires evaluation of all parameters, including range of motion, strength, endurance and proprioception. Recently, there has been increased effort towards reliability and validity studies concerning mainly the cervical range of motion and strength. Neck endurance and proprioception have been investigated, but to a smaller extent. A review of the literature has revealed the lack of reliable and valid instruments, as well as flaws regarding the methodologies and statistical techniques of the studies. Thus, further research is needed to establish 'gold standards' with the most appropriate protocols.     

The reliability of lumbar motion palpation.

OBJECTIVE: This review surveys the literature regarding reliability studies of lumbar motion palpation. DATA SOURCES: Using the indexing terms motion palpation lumbar spine and palpation, the following English language databases were surveyed: a) Medline, including back file; b) Embase; c) Cinahl; and d) Epic. Additionally, a manual search of the Chiropractic Research Archives Collection and JMPT was performed and researchers at Western States Chiropractic College were consulted. Pertinent references cited in bibliographies of retrieved papers were included if contributory. STUDY SELECTION: Studies pertaining to intra- and interexaminer reliability of lumbar motion palpation were reviewed. DATA EXTRACTION: Statistical analysis, subject selection, method of palpation and sources of error are discussed. DATA SYNTHESIS: Multiple variations were noted in type of palpation, subjects examined, statistical analysis and experience of examiners. CONCLUSIONS: To date, most studies have demonstrated marginal to poor interexaminer reliability, while good to moderate intrarater reliability has generally been reported.     

Effects of microwave diathermy on signs and symptoms of delayed onset muscle soreness: a systematic review of Japanese primary studies

Background: Delayed onset muscle soreness (DOMS) is a common problem experienced after exercise. The use of heat has been proposed to relieve symptoms. Microwave diathermy (MWD) is a physical modality that produces deep heat in the tissues. Although its use in the Western world has become less common since the 1980s, it is still frequently used in Japan.

Objective: The purpose of this systematic review was to collect and assess Japanese language experimental research regarding the effect of MWD on signs and symptoms of DOMS.

Methods: Three Japanese databases (CiNii, Ichushi and Medical*Online) and five English databases (CINAHL, Embase, MEDLINE, Scopus and Web of Science) were searched until 2 March 2015. Only Japanese-language experimental studies were included. Two Japanese native speakers independently assessed the methodological quality of included studies using the McMaster Critical Review Form. Data were synthesised qualitatively.

Results: Three non-randomised experimental trials investigating the effects of MWD at 2450 MHz on DOMS in elbow flexors were included. All studies had moderate methodological qualities. Two studies reported significant positive effects on active range of motion (ROM) after eccentric exercises. No significant effect was identified in pain, circumference, maximal isometric strength and biochemical markers.

Conclusion: Our systematic review found limited formal evidence about the effect of MWD to improve active elbow ROM for subjects with DOMS. Real effects were difficult to assess due to the potential lack of statistical precision in data derived from small sample sizes. Future research should address the methodological flaws identified in this review, to provide more conclusive evidence.     

Instruments evaluating the quality of the clinical learning environment in nursing education: A systematic review of psychometric properties

BackgroundThe clinical learning environment is fundamental to nursing education paths, capable of affecting learning processes and outcomes. Several instruments have been developed in nursing education, aimed at evaluating the quality of the clinical learning environments; however, no systematic review of the psychometric properties and methodological quality of these studies has been performed to date.ObjectivesThe aims of the study were: 1) to identify validated instruments evaluating the clinical learning environments in nursing education; 2) to evaluate critically the methodological quality of the psychometric property estimation used; and 3) to compare psychometric properties across the instruments available.DesignA systematic review of the literature (using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines) and an evaluation of the methodological quality of psychometric properties (using the COnsensus-based Standards for the selection of health Measurement INstruments guidelines).Data sourcesThe Medline and CINAHL databases were searched. Eligible studies were those that satisfied the following criteria: a) validation studies of instruments evaluating the quality of clinical learning environments; b) in nursing education; c) published in English or Italian; d) before April 2016.Review methodsThe included studies were evaluated for the methodological quality of the psychometric properties measured and then compared in terms of both the psychometric properties and the methodological quality of the processes used.ResultsThe search strategy yielded a total of 26 studies and eight clinical learning environment evaluation instruments. A variety of psychometric properties have been estimated for each instrument, with differing qualities in the methodology used. Concept and construct validity were poorly assessed in terms of their significance and rarely judged by the target population (nursing students). Some properties were rarely considered (e.g., reliability, measurement error, criterion validity), whereas others were frequently estimated, but using different coefficients and statistical analyses (e.g., internal consistency, structural validity), thus rendering comparison across instruments difficult. Moreover, the methodological quality adopted in the property assessments was poor or fair in most studies, compromising the goodness of the psychometric values estimated.ConclusionsClinical learning placements represent the key strategies in educating the future nursing workforce: instruments evaluating the quality of the settings, as well as their capacity to promote significant learning, are strongly recommended. Studies estimating psychometric properties, using an increased quality of research methodologies are needed in order to support nursing educators in the process of clinical placements accreditation and quality improvement.     

What may alter the conclusions of reviews?

Abstract

Background: four out of five selected review articles concluded that no evidence of effect from physiotherapy was found. We decided to assess their methodology and analyse how the selections made by the review authors affected the review conclusions.

Materials and methods: a new literature search was performed before the methodology of the review articles were assessed according to a list of nine validity criteria and 25 subcriteria.

Results: all five reviews were found to have methodological shortcomings. Prevalent methodological flaws were: incomplete literature search, inadequate validity assessment, sensitivity to change of inclusion criteria, errors in data synthesis and conclusions not adhering strictly to evidence. No review assessed if treatment procedure was adequately performed. All the reviews could have altered parts of their conclusions if the authors had made other relevant selections in the reviewing process.

Conclusion: poor methodological quality and selections made in the reviewing process can bias the conclusions in review articles on physiotherapy.     

Measurement properties of existing clinical assessment methods evaluating scapular positioning and function. A systematic review

Abstract

The aims were to compile a schematic overview of clinical scapular assessment methods and critically appraise the methodological quality of the involved studies. A systematic, computer-assisted literature search using Medline, CINAHL, SportDiscus and EMBASE was performed from inception to October 2013. Reference lists in articles were also screened for publications. From 50 articles, 54 method names were identified and categorized into three groups: (1) Static positioning assessment (n?=?19); (2) Semi-dynamic (n?=?13); and (3) Dynamic functional assessment (n?=?22). Fifteen studies were excluded for evaluation due to no/few clinimetric results, leaving 35 studies for evaluation. Graded according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN checklist), the methodological quality in the reliability and validity domains was “fair” (57%) to “poor” (43%), with only one study rated as “good”. The reliability domain was most often investigated. Few of the assessment methods in the included studies that had “fair” or “good” measurement property ratings demonstrated acceptable results for both reliability and validity. We found a substantially larger number of clinical scapular assessment methods than previously reported. Using the COSMIN checklist the methodological quality of the included measurement properties in the reliability and validity domains were in general “fair” to “poor”. None were examined for all three domains: (1) reliability; (2) validity; and (3) responsiveness. Observational evaluation systems and assessment of scapular upward rotation seem suitably evidence-based for clinical use. Future studies should test and improve the clinimetric properties, and especially diagnostic accuracy and responsiveness, to increase utility for clinical practice.     

Simulated patient scenario development: A methodological review of validity and reliability reporting

IntroductionSome healthcare scholars (educators and researchers) develop their own simulated patient scenarios to address specific learning objectives. Clear processes of validity and reliability are needed in the development of simulated scenarios for the purpose of replication and the transfer of findings to other contexts.MethodsThis paper reports a methodological review of CINAHL to determine how valid and reliable simulated patient scenarios are developed. We reviewed 375 abstracts based on specific inclusion and exclusion criteria to yield 17 qualifying records. Data about the discipline, population, type of simulation, and validity and reliability processes were extracted.ResultsSelected records were from nursing, medicine, and paramedicine. While some studies used high-fidelity simulations, some used low-fidelity or a combination of high- and low-fidelity simulations. Scholars validated scenarios by using personal experience, consulting experts, or requesting participant feedback. They also examined different types of validity (face, content, construct). Most studies did not address how reliability of scenarios was determined. To ensure consistency in scenario delivery, some studies piloted scenarios with participants, or examined performance through video-tapes or virtual patients.ConclusionsThis review shows that scholars use inconsistent processes to develop valid and reliable simulated patient scenarios, often overlooking evidence-based approaches to determining validity and reliability. Future practices pertaining to scenario development should use systematic processes in determining validity and reliability so simulation exercises can be replicated in other contexts.     

Turkish Validity and Reliability Study of the Surgical Anxiety Questionnaire for Adult Patients

PurposeThis research aims to adapt the Surgical Anxiety Questionnaire (SAQ) to Turkish culture and conduct validity and reliability studies.DesignThis research is a methodological study.MethodsThe sample of the research consisted of 311 patients and research data were collected between April 2019 and May 2021.FindingsThe scale content validity index was 0.931. As a result of the factor analysis, the items were distributed in four subdimensions and explained 58.745% of the variance, and the model had good fit values. The Cronbach's α coefficient of the scale was 0.890.ConclusionsThe Turkish version of SAQ is a valid and reliable measurement tool and can be used for adult patients.     

Methodological quality of studies on the measurement properties of neck pain and disability questionnaires: a systematic review

Objective

The aim of this study was to obtain an overview of the methodological quality of studies on the measurement properties of neck pain and disability questionnaires and to describe how well various aspects of the design and statistical analyses of studies on measurement properties are performed.

Methods

A systematic review was performed of published studies on the measurement properties of neck pain and disability questionnaires. Two reviewers independently rated the quality of the studies using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. This checklist was developed in an international Delphi consensus study.

Results

A total of 47 articles were included on the measurement properties of 8 different questionnaires. The methodological quality of the included studies was adequate on some aspects (often, adequate statistical analyses are used for assessing reliability, measurement error, and construct validity) but can be improved on other aspects. The most important methodological aspects that need to be improved are as follows: assessing unidimensionality in internal consistency analysis, stable patients and similar test conditions in studies on reliability and measurement error, and more emphasis on the relevance and comprehensiveness of the items in content validity studies. Furthermore, it is recommended that studies on construct validity and responsiveness should be based on predefined hypotheses and that better statistical methods should be used in responsiveness studies.

Conclusion

Considering the importance of adequate measurement properties, it is concluded that, in the field of measuring neck pain and disability, there is room for improvement in the methodological quality of studies measurement properties.     

Psychometric Properties of Brief-Balance Evaluation Systems Test Among Multiple Populations: A Systematic Review and Meta-analysis

ObjectiveTo synthesize evidence regarding the psychometric properties of the Brief-Balance Evaluation Systems Test (BESTest) in assessing postural controls across various populations.Data SourcesArticles were searched in 9 databases from inception to March 2020.Study SelectionTwo reviewers independently screened titles, abstracts, and full-text articles to include studies that reported at least 1 psychometric property of the Brief-BESTest. There were no language restrictions.Data ExtractionThe 2 independent reviewers extracted data (including psychometric properties of Brief-BESTest) from the included studies. The methodological quality of the included studies was appraised by the Consensus-based Standards for the Selection of Health Status Measurement Instruments checklist, and the quality of statistical outcomes was assessed by the Terwee et al method. A best-evidence synthesis for each measurement property of the Brief-BESTest in each population was conducted.Data SynthesisTwenty-four studies encompassing 13 populations were included. There was moderate to strong positive evidence to support the internal consistency (Cronbach α>0.82), criterion validity (ρ≥0.73, r≥0.71), and construct validity (ρ≥0.66, r≥0.50, area under curve>0.72) of the Brief-BESTest in different populations. Moderate to strong positive evidence supported the responsiveness of the Brief-BESTest in detecting changes in postural controls of patients 4 weeks after total knee arthroplasty or patients with subacute stroke after 4-week rehabilitation. However, there was strong negative evidence for the structural validity of this scale in patients with various neurologic conditions. The evidence for the reliability of individual items and measurement errors remains unknown.ConclusionsThe Brief-BESTest is a valid (criterion- and construct-related) tool to assess postural control in multiple populations. However, further studies on the reliability of individual items and minimal clinically important difference of the Brief-BESTest are warranted before recommending it as an alternative to the BESTest and Mini-BESTest in clinical research/practice.     

Validity and Reliability of Palpatory Clinical Tests of Sacroiliac Joint Mobility: A Systematic Review and Meta-analysis

ObjectiveThe primary objective of this review was to investigate the reliability and validity of palpatory clinical tests of sacroiliac mobility. The secondary objective was to investigate which palpatory clinical tests of sacroiliac mobility exist in the literature.MethodsPubMed, Embase, Scopus, Medline, and the Physiotherapy Evidence Database were searched. There was no restriction on the study design or participants. The data extracted from each study were sample size, study deign, and clinical test used. If there was information on reliability values, number of examiners, concurrent validity values, gold standard used, or inferential statistical test used, that was also extracted. For intraexaminer reliability, the data were expressed as κ values that were meta-analyzed using random effects.ResultsFifteen palpatory clinical tests of sacroiliac mobility were identified from 28 studies; 14 studies performed inferential statistical analysis, all including analysis of interexaminer reliability, with κ values ranging from ?0.05 to 0.77. Analysis of intraexaminer reliability was performed in 8 studies, with κ values ranging from 0.08 to 0.73. No study included in this systematic review verified the concurrent validity of the tests. Our meta-analysis of intraexaminer reliability showed moderate to good agreement results for the Gillet test (κ = 0.46), the standing flexion test (κ = 0.61), and the sitting flexion test (κ = 0.68).ConclusionWe found 15 palpatory clinical tests of sacroiliac mobility in this systematic review. According to our meta-analysis, only the sitting flexion test obtained a good and statistically significant intraexaminer agreement. Further studies are necessary to evaluate the reliability and validity of these tests.     

Concurrent Criterion-Related Validity of Acromioclavicular Joint Physical Examination Tests: A Systematic Review

Abstract

This article systematically reviews the available research on concurrent criterionrelated validity of physical examination tests for the diagnosis of acromioclavicular joint (ACJ) dysfunction. A literature search yielded four research studies on the topic of concurrent criterion-related validity of physical examination tests of the ACJ. These studies had various methodological shortcomings. Methodological scores on the STARD (Standards for Reporting of Diagnostic Accuracy) criteria yielded scores from 1/22 to 16/22. All studies examined pain provocation tests only. The currently available best research evidence supports the inclusion of a number of tests with a specific interpretation in a physical examination format for the diagnosis of painful ACJ dysfunction. A negative finding on the cross-body adduction test, tenderness on palpation of the ACJ, and the Paxinos sign may serve to rule out a painful ACJ dysfunction. A positive finding on the active compression test, the cross-body adduction test, and the acromioclavicular resisted extension test may serve to rule in a painful ACJ dysfunction. A positive finding on all three tests for the cross-body adduction, active compression, and resisted acromioclavicular extension may be relevant when the physical therapist is considering a medical-surgical referral and associated higher-risk interventions. This review indicates that future research is required 1) to evaluate the diagnostic utility of the gold standard tests used in the studies retrieved; 2) to examine the reliability and concurrent criterion-related validity (with validated gold standard tests) of these and other physical tests and history items commonly used in the diagnosis of ACJ lesions, both isolated and in the form of multi-test regimens; and 3) to study predictive validity of findings on tests and multi-test regimens for ACJ dysfunction coupled to outcomes with diagnosis-specific (orthopedic manual) physical therapy, medical, and surgical interventions.     

Psychometric Properties of 2-Minute Walk Test: A Systematic Review

Objective

To systematically review the psychometric evidence on the 2-minute walk test (2MWT).

Data Sources

Electronic searches of databases including MEDLINE, CINAHL, Academic Search Premier, SPORTDiscus, PsycINFO, EMBASE, the Cochrane Library, and DARE were done until February 2014 using a combination of subject headings and free texts.

Study Selection

Studies were included if psychometric properties of the 2MWT were (1) evaluated; (2) written as full reports; and (3) published in English language peer-reviewed journals.

Data Extraction

A modified consensus-based standard for the selection of health measurement instruments checklist was used to rate the methodological quality of the included studies. A quality assessment for statistical outcomes was used to assess the measurement properties of the 2MWT.

Data Synthesis

Best-evidence synthesis was collated from 25 studies of 14 patient groups. Only 1 study was found that examined the 2MWT in the pediatric population. The testing procedures of the 2MWT varied across the included studies. Reliability, validity (construct and criterion), and responsiveness of the 2MWT also varied across different patient groups. Moderate to strong evidence was found for reliability, convergent validity, discriminative validity, and responsiveness of the 2MWT in frail elderly patients. Moderate to strong evidence for reliability, convergent validity, and responsiveness was found in adults with lower limb amputations. Moderate to strong evidence for validity (convergent and discriminative) was found in adults who received rehabilitation after hip fractures or cardiac surgery. Limited evidence for the psychometric properties of the 2MWT was found in other population groups because of methodological flaws.

Conclusions

There is inadequate breadth and depth of psychometric evidence of the 2MWT for clinical and research purposes—specifically, minimal clinically important changes and responsiveness. More good-quality studies are needed, especially in the pediatric population. Consensus on standardized testing procedures of the 2MWT is also required.     

Are chiropractic tests for the lumbo-pelvic spine reliable and valid? A systematic critical literature review

OBJECTIVE: To systematically review the peer-reviewed literature about the reliability and validity of chiropractic tests used to determine the need for spinal manipulative therapy of the lumbo-pelvic spine, taking into account the quality of the studies. DATA SOURCES: The CHIROLARS database was searched for the years 1976 to 1995 with the following index terms: "chiropractic tests," "chiropractic adjusting technique," "motion palpation," "movement palpation," "leg length," "applied kinesiology," and "sacrooccipital technique." In addition, a manual search was performed at the libraries of the Nordic Institute of Chiropractic and Clinical Biomechanics, Odense, Denmark, and the Anglo-European College of Chiropractic, Bournemouth, United Kingdom. STUDY SELECTION: Studies pertaining to intraexaminer reliability, interexaminer reliability, and/or validity of chiropractic evaluation of the lumbo-pelvic spine were included. DATA EXTRACTION: Data quality were assessed independently by the two reviewers, with a quality score based on predefined methodologic criteria. Results of the studies were then evaluated in relation to quality. DATA SYNTHESIS: None of the tests studied had been sufficiently evaluated in relation to reliability and validity. Only tests for palpation for pain had consistently acceptable results. Motion palpation of the lumbar spine might be valid but showed poor reliability, whereas motion palpation of the sacroiliac joints seemed to be slightly reliable but was not shown to be valid. Measures of leg-length inequality seemed to correlate with radiographic measurements but consensus on method and interpretation is lacking. For the sacrooccipital technique, some evidence favors the validity of the arm-fossa test but the rest of the test regimen remains poorly documented. Documentation of applied kinesiology was not available. Palpation for muscle tension, palpation for misalignment, and visual inspection were either undocumented, unreliable, or not valid. CONCLUSION: The detection of the manipulative lesion in the lumbo-pelvic spine depends on valid and reliable tests. Because such tests have not been established, the presence of the manipulative lesion remains hypothetical. Great effort is needed to develop, establish, and enforce valid and reliable test procedures.     

Inter-rater Accuracy and Reliability of a Palpation Protocol of the C7 Spinous Process Comprising a Combination of 3 Traditional Palpation Techniques

ObjectiveThe purpose of this study was to determine the accuracy and intrarater reliability of a palpatory protocol based on a combination of 3 palpatory methods to identify both the C7 spinous process (C7 SP) and the factors that affect the errors and inaccuracy of palpation.MethodsTwenty-five women between the ages of 18 and 60 years were submitted to a palpation protocol of the C7 SP, and a radiopaque marker was fixed on the skin at the possible location of the vertebrae. A radiograph and a photograph of the cervical spine were obtained in the same posture by a first rater. A second rater performed the same palpation protocol and took a second photograph. The accuracy and measurement error of the palpation protocol of C7 SP were assessed through radiographic images. The inter-rater reliability was estimated by the interclass correlation coefficient and assessed using photographs of each rater. The Pearson's correlation coefficients (r), the Fisher exact test, and the χ² test were used to identify the factors associated with the error and inaccuracy of palpation.ResultsAccuracy of the C7 palpation was 76% with excellent reliability (interclass correlation coefficient = 0.99). There was a moderate correlation between weight and the measurement of palpation error (r = –0.6; P = .003). One hundred percent of inaccuracy palpation was related to the increased soft-tissue thickness (P = .005) in the cervical region.ConclusionThe palpation protocol described in this study was accurate and presented excellent reliability in identifying the C7 SP. Increased weight and dorsocervical fat pad were associated to error and palpation inaccuracy, respectively.     

Quality Assessment of Neonatal Pain Scales Translated and Validated to Brazilian Portuguese: A Systematic Review of Psychometric Properties

ObjectivesThe objective of this systematic review was to identify and describe the psychometric properties of neonatal pain scales that were translated into Brazilian Portuguese and to verify the methodological quality of these translation, transcultural adaptations and validation.DesignThe present study is a systematic review. A systematic search in the literature included studies of development, validation, and transcultural adaptation of neonatal pain scales to Brazilian Portuguese. The instruments must have been developed for health care professionals to evaluate neonatal pain and stress in full-term and preterm newborns.Data SourcesThe search strategy was conducted in PubMed, Web of Science, Scopus, and Scielo databases following The PRISMA guidelines (Preferred Reporting Items for Systematic Reviews and Meta-Analyses).Review /Analysis MethodsA total of 1,479 publications were identified and 5 fulfilled the inclusion criteria, with 4 instruments evaluated. For the methodological quality analysis of the measurement properties of the instruments the Consensus-based Standards for Health Measurement Instruments (COSMIN) Risk of Bias checklist was used. The psychometric properties verified were internal consistency, content validity, reliability, and construct validity.ResultsThree instruments reviewed were inadequate and one was doubtful.ConclusionsThe neonatal pain scales wich were cross culturally adapted to Brazilian Portuguese were shown to be of low methodological quality based on COSMIM checklist. Caution should be considered for clinical decisions about pain management judgment coming from these instruments.     

Psychometric properties of the Pain Attitudes and Beliefs Scale for Physiotherapists: a systematic review

ObjectiveEvidence suggests that care providers' attitudes influence their perception of patient characteristics and the way they manage their cases. Attitudes and beliefs of care providers can be measured with the Pain Attitude and Beliefs Scale for Physiotherapists (PABS-PT). This study evaluates the measurement properties of the PABS-PT.MethodsDatabases (PubMed-Medline, Embase, Cinahl and Pedro) were searched for studies on the development or evaluation of measurement properties of the PABS-PT. Methodological quality was assessed and rated using the COSMIN checklist and scoring system.ResultsOf the 139 identified publications, 10 met the selection criteria. Most of the included studies had fair to excellent methodological quality scores. Positive results were found for internal consistency, construct validity, reliability and responsiveness. No psychometric data were found for the content validity and interpretability of the PABS-PT.ConclusionThe PABS-PT is still in a developmental stage. Results for the psychometric properties are promising, but content validity and interpretability need more study. The relationship between implicit and explicit attitudes, and their influence on test scores, remains unclear.