Reproducibility of physiological track-and-trigger warning systems for identifying at-risk patients on the ward

OBJECTIVE: Physiological track-and-trigger warning systems are used to identify patients on acute wards at risk of deterioration, as early as possible. The objective of this study was to assess the inter-rater and intra-rater reliability of the physiological measurements, aggregate scores and triggering events of three such systems. DESIGN: Prospective cohort study. SETTING: General medical and surgical wards in one non-university acute hospital. PATIENTS AND PARTICIPANTS: Unselected ward patients: 114 patients in the inter-rater study and 45 patients in the intra-rater study were examined by four raters. MEASUREMENTS AND RESULTS: Physiological observations obtained at the bedside were evaluated using three systems: the medical emergency team call-out criteria (MET); the modified early warning score (MEWS); and the assessment score of sick-patient identification and step-up in treatment (ASSIST). Inter-rater and intra-rater reliability were assessed by intra-class correlation coefficients, kappa statistics and percentage agreement. There was fair to moderate agreement on most physiological parameters, and fair agreement on the scores, but better levels of agreement on triggers. Reliability was partially a function of simplicity: MET achieved a higher percentage of agreement than ASSIST, and ASSIST higher than MEWS. Intra-rater reliability was better then inter-rater reliability. Using corrected calculations improved the level of inter-rater agreement but not intra-rater agreement. CONCLUSION: There was significant variation in the reproducibility of different track-and-trigger warning systems. The systems examined showed better levels of agreement on triggers than on aggregate scores. Simpler systems had better reliability. Inter-rater agreement might improve by using electronic calculations of scores.     

Molecular markers for urothelial bladder cancer prognosis: Toward implementation in clinical practice

ObjectivesTo summarize the current status of clinicopathological and molecular markers for the prediction of recurrence or progression or both in non–muscle-invasive and survival in muscle-invasive urothelial bladder cancer, to address the reproducibility of pathology and molecular markers, and to provide directions toward implementation of molecular markers in future clinical decision making.Methods and materialsImmunohistochemistry, gene signatures, and FGFR3-based molecular grading were used as molecular examples focussing on prognostics and issues related to robustness of pathological and molecular assays.ResultsThe role of molecular markers to predict recurrence is limited, as clinical variables are currently more important. The prediction of progression and survival using molecular markers holds considerable promise. Despite a plethora of prognostic (clinical and molecular) marker studies, reproducibility of pathology and molecular assays has been understudied, and lack of reproducibility is probably the main reason that individual prediction of disease outcome is currently not reliable.ConclusionsMolecular markers are promising to predict progression and survival, but not recurrence. However, none of these are used in the daily clinical routine because of reproducibility issues. Future studies should focus on reproducibility of marker assessment and consistency of study results by incorporating scoring systems to reduce heterogeneity of reporting. This may ultimately lead to incorporation of molecular markers in clinical practice.     

The interrater reliability of a pain mechanisms-based classification for patients with nonspecific neck pain

ObjectiveTo examine the interrater reliability and agreement of a pain mechanisms-based classification for patients with nonspecific neck pain (NSNP).MethodsDesign – Observational, cross-sectional reliability study with a simultaneous examiner design. Setting: University hospital-based outpatient physical therapy clinic. Participants: A random sample of 48 patients, aged between 18 and 75 years old, with a primary complaint of neck pain was included. Interventions: Subjects underwent a standardized subjective and clinical examination, performed by 1 experienced physical therapist. Two assessors independently classified the participants’ NSNP on 3 main outcome measures. Main outcome measures: The Cohen kappa, percent agreement, and 95% confidence intervals (CIs) were calculated to determine the interrater reliability for (1) the predominant pain mechanism; (2) the predominant pain pattern; and (3) the predominant dysfunction pattern (DP).ResultsThere was almost perfect agreement between the 2 physical therapists’ judgements on the predominant pain mechanism, kappa = .84 (95% CI, .65–1.00), p < .001. There was substantial agreement between the raters’ judgements on the predominant pain pattern and predominant DP with respectively kappa = .61 (95% CI, .42–.80); and kappa = .62 (95% CI, .44–.79), p < .001.Conclusion(s)The proposed classification exhibits substantial to almost perfect interrater reliability. Further validity testing in larger neck pain populations is required before the information is used in clinical settings.Clinical trial registration numberNCT03147508 (https://clinicaltrials.gov/ct2/show/NCT03147508).     

Emerging parameters of the insulin and glucose response on the oral glucose tolerance test: Reproducibility and implications for glucose homeostasis in individuals with and without diabetes

Aims

Recent studies have suggested that novel parameters of the insulin and glucose response on the oral glucose tolerance test (OGTT) can provide metabolic insight beyond glucose tolerance, but have not evaluated their reproducibility. Thus, our aim was to evaluate the reproducibility of these parameters and, if confirmed, characterize their clinical/pathophysiologic relevance in healthy and diabetic individuals.

Methods

Thirty healthy adults each underwent 3 replicate OGTTs, enabling assessment of the reproducibility of the following 5 parameters: time to insulin peak, shape of the glucose curve, glucose nadir below baseline, 1-h post-challenge glucose, and time to glucose peak. The only reproducible parameter was then further evaluated in 63 patients with early type 2 diabetes (T2DM) before and after 4-weeks of intensive insulin therapy (IIT) designed to improve beta-cell function (measured by Insulin Secretion-Sensitivity-Index-2 (ISSI-2)).

Results

Of the five parameters, only time to glucose peak displayed reliable reproducibility on replicate testing (κ = 0.76). Over 80% of controls had their glucose peak at 30-min post-load, whereas all but one of the diabetic patients had their peak at 60-min or later. ISSI-2 was lower in T2DM patients with peak at ≥90-min than in those with peak at ≤60-min (P = 0.012). In patients in whom IIT improved beta-cell function by ≥20% from baseline, 39.1% had glucose peak on the post-therapy OGTT shift to an earlier timepoint, as compared to 15.4% with similar shift in those without such improvement(P = 0.03).

Conclusion

Time to glucose peak is a reproducible characteristic on the OGTT and associated with beta-cell function in early T2DM.     

Reliability of indicators of nursing care quality: testing interexaminer agreement and reliability

Objective

this study sought to test the interexaminer agreement and reliability of 15 indicators of nursing care quality.

Methods

this was a quantitative, methodological, experimental, and applied study conducted at a large, tertiary, public teaching hospital in the state of Paraná. For data analysis, the Kappa (k) statistic was applied to the categorical variables - indicators 1 to 11 and 15 - and the interclass correlation coefficient (ICC) to the continuous variables - indicators 12, 13, and 14, with the corresponding 95% confidence intervals. The categorical data were analyzed using the Lee software, elaborated by the Laboratory of Epidemiology and Statistics of Dante Pazzanese Institute of Cardiology - Brazil, and the continuous data were assessed using BioEstat 5.0.

Results

the k-statistic results indicated excellent agreement, which was statistically significant, and the values of the ICC denoted excellent and statistically significant reproducibility/agreement relative to the investigated indicators.

Conclusion

the investigated indicators exhibited excellent reliability and reproducibility, thus showing that it is possible to formulate valid and reliable assessment instruments for the management of nursing care.     

Repeatability and reproducibility of the Tekscan HR-Walkway system in healthy children

This study investigated the repeatability and reproducibility of the HR Walkway system with regards to peak pressure values (PP) and pressure time integral (PTI) in healthy children, ranging between 5 and 18 years of age. Subjects recruited took part in two non-invasive clinical assessments, at baseline and 1 week later. Gait analysis was carried out using the PP box approach, and plantar foot recording was divided into 10 anatomical areas. The PP and PTI was investigated for the left, right and both feet accounted together. Interclass Correlation Coefficient (ICC) test was adopted for statistical analysis. Overall, 30 healthy patients were recruited and 60 appointments were completed, 53.3% (n = 16) were female and 46.7% (n = 14) were male. Mean age was 13.3 years (SD = 4.5), with an age-range of 5–18.6 years old. Results indicated that for all variables tested the repeatability data were ‘good’ ICC for 73.8% (n = 121) and ‘moderate’ ICC for 26.2% (n = 43). For all variables tested, the reproducibility data showed that ‘good’ ICC for 70.7% (n = 58) and ‘moderate’ ICC for 29.3% (n = 24). In conclusion, the HR Walkway system is able to provide repeatable and reproducible data.     

Reproducibility of habitual intercuspation in vivo

Objectives

The aim of this in vivo study was to investigate how reproducible individuals find their habitual intercuspation.

Methods

A new type of highly accurate measuring procedure was involved using an intraoral optical scanning device (Cerec Bluecam). First, a pilot test investigated the accuracy of the procedure within a standardized setting. With regard to the in vivo study, fifteen participants with full dentition were selected. For each of these individuals, eight scans were taken both in the morning and in the afternoon. Furthermore, during each session, scans were taken both in horizontal and upright position. In order to compare this to ubiquitous used processes, plaster replicas of five individuals were investigated as well. The scans were analysed, and the differences in the position of the lower jaw were calculated by a specialized superimposition program (n = 570 comparisons/OraCheck).

Results

The results showed that there was no significant difference between the time of day and the position of the patient. The overall mean ± SD value for locating the habitual intercuspation was 42 ± 34 μm, however ranging from 22 ± 9 μm to 77 ± 58 μm for single individuals. On the other hand, the differences in positioning plaster replicas reached a mean of 135 ± 77 μm.

Conclusions

The reproducibility of the habitual intercuspation can be obtained under in vivo conditions by a newly developed and highly accurate measuring procedure. Individuals with full dentition show values in average of 42 μm.

Clinical significance

Determining the occlusal jaw relation is an important precondition in restorative dentistry and many methods are proposed for a proper occlusal registration. Although much is known about in vitro accuracy of these techniques, little is known how reproducible the habitual occlusal position itself is found between individuals.     

Accuracy and reproducibility of probe forces during simulated periodontal pocket depth measurements

AimThe aim of the present study was to measure the accuracy and reproducibility of probe forces in simulated assessments of periodontal pocket depth. The study included experienced and inexperienced examiners and used manual and pressure-sensitive probes.Materials and methodsSixty-one participants were divided into seven groups and asked to probe selected anterior and posterior sites with three different probes (Williams 14W, Chapple UB-CF-15, and Vivacare TPS probes). The model was positioned on a digital electronic balance to measure force, which was recorded initially and after 15 min. Probe preferences were recorded. Accuracy was measured by comparing to a standardized 25 g force, and reproducibility was calculated for all duplicate measurements.ResultsThe Vivacare probe produced the most accurate and most reproducible forces, whereas the Williams probe produced the least accurate and least reproducible forces. Probe forces were lighter at anterior sites compared to posterior sites at baseline. Probe forces were reduced at both sites after 15 min compared to baseline.ConclusionsVivacare TPS periodontal probes are more accurate and reproducible than Chapple and Williams probes. Many clinicians in this study preferred the Chapple probe.     

In-vitro accuracy and reproducibility evaluation of probing depth measurements of selected periodontal probes

AimThe purpose of the present in vitro study was to measure the accuracy and reproducibility of three periodontal probes. To eliminate environment- or examiner-related probing errors, two aluminum blocks with predrilled holes of varying depths were examined by participants who had been trained in probing before the study. This methodology improved the likelihood that any probing errors identified were generated by the probes themselves.Materials and methodsThree probes, Williams 14 W (Hu-Friedy Mfg. Co., LLC, UK), Chapple UB-CF-15 (Implantium, Shrewsbury, UK), and Vivacare TPS (Ivoclar Vivadent, Enderby, UK), were randomly distributed to 23 participants (9 males and 14 females; mean age: 31.35 years). Participants measured 30 holes in two aluminum blocks, average 20 days, SD = 341.05. For each hole, the mean measured depth was calculated for each participant and compared to the true depth. Intra- and inter-examiner accuracy and reproducibility for each of the duplicate measurements were calculated. Data were analyzed by paired-samples t-test with the SPSS 18 software package (IBM Portsmouth, UK). A p-value <0.05 indicated statistical significance. Tables were constructed from the data.ResultsWhen used by participants, the Williams 14 W probe was reproducible but not necessarily accurate; Vivacare TPS was neither accurate nor reproducible; and Chapple UBCF-15 was both accurate and reproducible.ConclusionDepth measurements with the Chapple UB-CF-15 probe were more accurate and reproducible compared to measurements with the Vivacare TPS and Williams 14 W probes. This in vitro model may be useful for intra-examiner calibration or clinician training prior to the clinical evaluation of patients or in longitudinal studies involving periodontal evaluation.