The reliability and validity of the modified Unified Classification System for periprosthetic femoral fractures after hip arthroplasty

BackgroundThis study assessed the reliability and validity of the modified Unified Classification System for femur fractures after hip arthroplasty.MethodsFour hundred and two cases were evaluated by 6 observers, 3 experts and 3 trainee surgeons. Each observer read the radiographs on 2 separate occasions and classified each case as to its type. Reliability was assessed by looking at the intraobserver and interobserver agreement using the Kappa statistic. Validity was assessed within the B group by looking at the agreement between the radiographic classification and the intraoperative findings. Interobserver and intraobserver agreement and validity were analyzed, using weighted kappa statistics.ResultsThe mean k value for interobserver agreement was found to be 0.882 (0.833–0.929) for consultants (almost perfect agreement) and 0.776 (0.706–0.836) for the trainees (substantial agreement). Intraobserver k values ranged from 0.701 to 0.972, showing substantial to almost perfect agreement. Validity analysis of 299 type B cases revealed 89.854% agreement with a mean k value of 0.849 (0.770–0.946) (almost perfect agreement).ConclusionsThis study has shown that the modified Unified Classification System is reliable and valid. We believe it is useful to improve the judgment of the implant stability, and establish the therapeutic strategy for periprosthetic femoral fracture.     

The reliability and validity of the Vancouver classification of femoral fractures after hip replacement

This study assessed the reliability and validity of a new classification system for fractures of the femur after hip arthroplasty. Forty radiographs were evaluated by 6 observers, 3 experts and 3 nonexperts. Each observer read the radiographs on 2 separate occasions and classified each case as to its type (A, B, C) and subtype (B1, B2, B3). Reliability was assessed by looking at the intraobserver and interobserver agreement using the kappa statistic. Validity was assessed within the B group by looking at the agreement between the radiographic classification and the intraoperative findings. Our findings suggest that this classification system is reliable and valid. Intraobserver agreement was consistent across observers, ranging from 0.73 to 0.83. There was a negligible difference between experts and nonexperts. Interobserver agreement was 0.61 for the first reading and 0.64 for the second reading by kappa analysis, indicating substantial agreement between observers. Validity analysis revealed an observed agreement kappa value of 0.78, indicating substantial agreement. This study has shown that this classification is reliable and valid.     

Rapid prototyping in the assessment, classification and preoperative planning of acetabular fractures

AIM: To evaluate the use of rapid prototyping in the assessment, classification and preoperative planning of acetabular fractures. INTRODUCTION: The complex three-dimensional anatomy of the pelvis and acetabulum make assessment, classification and treatment of fractures of these structures notoriously difficult. Conventional imaging only provides two-dimensional images of these fractures. While interpretation of traditional imaging techniques becomes better with experience, novel techniques may assist in the understanding of these complex injuries. METHODS: Twenty patients with acetabular fractures were studied. Life size three-dimensional models were manufactured from standardised CT scans, using the rapid prototyping process, selective laser sintering. Each model was presented to the operating surgeon prior to surgery. The surgeons found that the models greatly assisted in their understanding of the personality of the fracture. Three consultant orthopaedic surgeons and three senior trainees were asked to classify each fracture using conventional radiographs (AP pelvis, Judet views and CT scans) and then using the model. The kappa statistic was used to evaluate inter- and intraobserver agreement. RESULTS: Interobserver agreement was not absolute using either conventional radiographs or the models. For the consultants the kappa statistic using conventional radiographs was 0.61 while the kappa value using the model was 0.76 (p<0.05). For the trainees the kappa value was 0.42, using conventional radiographs and 0.71 using the model (p<0.01). CONCLUSION: Full sized models of acetabular fractures greatly assisted surgeons understand the personality of complex fractures prior to surgery and have been shown in this study to significantly reduced the degree of interobserver variability in fracture classification. This effect is particularly evident for less experienced surgeons. This technique is available and relatively inexpensive. The use of these models should prove invaluable as a tool to aid clinical practice.     

A comparison of the reliability and validity of bone stock loss classification systems used for revision hip surgery

Three femoral (Paprosky, American Academy of Orthopaedic Surgeons [AAOS], and Endo-Klinik) and 2 acetabular (Paprosky, AAOS) bone stock loss classification systems were evaluated for reliability. Four observers (2 consultants, 2 registrars) graded the bone loss in 25 patients using preoperative radiographs. Grading was repeated after a minimum of 2 weeks. Interobserver and intraobserver reliability was investigated. The kappa statistic was used to assess levels of agreement. Intraobserver agreement ranged from poor to good. Interobserver agreement ranged from fair to moderate. The validity of the Paprosky classification system was evaluated, comparing preoperative bone stock loss assessment with intraoperative findings. Agreement levels of moderate (femoral classification system) to good (acetabular classification system) were achieved. Bone stock loss classification systems are shown to be inconsistent and unreliable.     

Improving reliability in the classification of fractures of the acetabulum

BACKGROUND: Plain radiographs of the pelvis are routinely used in the initial assessment of patients with suspected fractures of the acetabulum. It is necessary for orthopaedic resident trainees, emergency physicians as well as orthopaedic surgeons who infrequently treat trauma patients to be able to describe these fracture patterns reliably to traumatologist orthopaedic surgeons who ultimately take over the patient care. Our purpose was two-fold: (1) to determine the reliability of the component parts of the Letournel classification of acetabular fractures involving six anteroposterior (AP) radiographic lines, and (2) to examine whether the addition of oblique radiograph views (Judet views) would improve the reliability. METHODS: Thirty sets of AP and oblique radiographs (Judet views) of the pelvis were selected from a hospital database to represent various types of acetabular fractures. Six reviewers (three orthopaedic trainees and three community orthopaedic surgeons) independently reviewed the radiographs. For each radiograph, the reviewer classified the acetabular fracture according to the Letournel classification. In addition, each reviewer utilized a simplified classification scheme using six radiographic lines on the AP pelvic radiograph. Interobserver reliabilities among reviewers were reported along with the intraclass correlation coefficient (ICC) and kappa values. RESULTS: Agreement for the Letournel classification increased with increasing physician experience (trainees ICC=-0.14 and community surgeons ICC=0.56). Interobserver reliability between trainees and community surgeons improved when the six radiographic lines were used (range kappa=0.09-0.89). The oblique pelvic radiographs (Judet views) did not significantly improve reliability among physicians. CONCLUSIONS: In this study we report the following: (1) the reliability of the Letournel classification improves with level of training, (2) physicians with less experience with acetabular fractures have significantly better agreement in identifying fractures using the six radiographic lines on the AP film than the Letournel classification, and (3) agreement among the reviewers for the AP pelvic radiograph is not improved with additional oblique (Judet) views.     

3D-radiographic analysis does not improve the Neer and AO classifications of proximal humeral fractures

The Neer and AO fracture classifications for fractures of the proximal humerus have shown poor reproducibility based on plain radiography. We wanted to investigate whether the addition of 3-dimensional (3D) reconstructions would increase the reproducibility of classification. 7 observers independently classified 24 fractures of the proximal humerus using both plain radiographs, CT and 3D and the classification was repeated 2 months later. There was a moderate interobserver agreement when using the Neer classification, but only a fair agreement with the AO classification. The Neer system had a mean kappa value of 0.44 and the AO had a value of 0.32 for the first assessment. In the second assessment, the mean kappa values were 0.49 and 0.34, respectively. Intraobserver reproducibility was fair to substantial agreement for Neer (kappa range 0.27-0.73) and for AO (kappa range 0.29-0.74). In conclusion, the addition of CT and 3D to plain radiographs did not improve the reproducibility of the classifications of Neer and AO of the proximal humerus.     

Reliability and validity of the Hartofilakidis classification system of congenital hip disease in adults

The reliability and validity of the Hartofilakidis et al. classification system in adults with congenital hip disease (CHD) were examined. The radiographs of 102 adult patients (158 hips) with CHD were independently assessed by three senior surgeons. Interobserver variability was assessed by examining the agreement between the three raters while validity of the classification system was assessed by examining the agreement between the assessment by either one of the three raters and the intraoperative finding (reference standard). The interobserver agreement between the three observers was high ranging from 0.720 to 0.854 (substantial to excellent) while the agreement of the preoperative prediction with the intraoperative findings was 87.4% (K = 0.823, excellent agreement). The Hartofilakidis et al. classification system reliably predicts from preoperative pelvis radiographs the bone deficiencies encountered during the operation.     

Plain films are not accurate in planning internal fixation in vancouver type B1 periprosthetic femoral fractures and in distinguishing between subtypes B1 And B2

BackgroundWhile few studies analysed the diagnostic validity of preoperative radiographs in distinguishing between Vancouver type B1 and B2 periprosthetic femoral fractures (PFFs), no investigation has been conducted to assess the degree of diagnostic validity of preoperative radiographs in identifying the fracture course and planning the most appropriate treatment. We analysed the diagnostic validity of radiographs in detecting the fracture course and stem stability in Vancouver type B PFFs.MethodsVancouver type B PFFs with different fracture courses were randomly performed in 36 dried cadaveric femurs in which a femoral broach had previously been implanted. Radiographic images, taken in the coronal and sagittal views, were analysed by 5 orthopaedic surgeons and 2 radiologists who were asked to reproduce the fracture course and to evaluate stem stability. A scoring system was used to determine the injured femoral cortex correctly identified by the examiners.ResultsThe identification of the fracture course was scored as poor in 52.4% and 56.%, fair in 23% and 23.4% and good in 24.6% and 19.8%, The identification of the fracture course in the coronal and axial vies radiographs was scored in coronal and axial view radiographs respectively. There was no significant difference in the average score obtained by senior and young examiners. In the coronal plane, the fracture course was poorly identified by all examiners in 11 (30.5%) femurs and by 5 or more examiners in 17 (47%). The fracture course was correctly identified by 5 or more examiners in 8 femurs (22%). A vertical fracture involving an emidiaphysis was found in 8 of the 11 femurs in which the PFF was poorly diagnosed by all examiners. Stem instability was correctly diagnosed in 45% of cases.ConclusionsIn type B PFFs preoperative radiographs show a reduced diagnostic validity in identifying the fracture course and, hence, in planning a correct treatment. Potentially unstable vertical fractures involving an emidiaphysis are likely to be poorly diagnosed since most of the fracture course is hidden by the femoral stem. In cementless stems the diagnostic validity of radiographs in diagnosing between Vancouver type B1 and B2 seems to be lower than that reported for cemented stems.     

Inter-observer reliability and intra-observer reproducibility of the Weber classification of ankle fractures

Our aim was to assess the reproducibility and the reliability of the Weber classification system for fractures of the ankle based on anteroposterior and lateral radiographs. Five observers with varying clinical experience reviewed 50 sets of blinded radiographs. The same observers reviewed the same radiographs again after an interval of four weeks. Inter- and intra-observer agreement was assessed based on the proportion of agreement and the values of the kappa coefficient. For inter-observer agreement, the mean kappa value was 0.61 (0.59 to 0.63) and the proportion of agreement was 78% (76% to 79%) and for intra-observer agreement the mean kappa value was 0.74 (0.39 to 0.86) with an 85% (60% to 93%) observed agreement. These results show that the Weber classification of fractures of the ankle based on two radiological views has substantial inter-observer reliability and intra-observer reproducibility.     

Interobserver and Intraobserver Reliability Assessment of Calcaneal Fracture Classification Systems

The aim of the present study was to assess the reliability of commonly used intra-articular calcaneal fracture classification systems and to compare them with the newer AO Integral Classification of Injuries (ICI) system. Forty computed tomography and radiographic images of 40 intra-articular calcaneal fractures were reviewed independently by 3 reviewers on 2 separate occasions and classified according to the Essex-Lopresti, Atkins, Zwipp and Tscherne, Sanders, and AO-ICI classification systems. The reviewers were unaware of the patients' identity and all aspects of clinical care. The data were analyzed using kappa (κ) statistics to assess the intra- and interobserver reliability. The κ values were calculated for Essex-Lopresti (κ = 0.85 intraobserver, κ = 0.78 interobserver), Atkins (κ = 0.42 intraobserver, κ = 0.73 interobserver), Zwipp and Tscherne (κ = 0.40 intraobserver, κ = 0.47 interobserver), Sanders (κ = 0.31 intraobserver, κ = 0.35 interobserver), and AO-ICI (κ = 0.41 intraobserver, κ = 0.33 interobserver). The AO-ICI classification system had levels of reproducibility similar to that of the Sanders classification, currently the most widely used system. The Essex-Lopresti classification demonstrated improved reliability compared with that reported in previous studies. This can be attributed to using sagittal computed tomography images, in addition to the originally described plain radiographs, for assessment. This improvement is relevant because of its accepted prognostic predictability.     

Pre-operative planning in orthopaedics:a study of surgeons'' opinions

Pre-operative planning is important in orthopaedic surgery in both trauma and elective orthopaedic surgery. We know of no study into surgeons attitudes to pre-operative planning.

A postal questionnaire was used to ascertain attitudes to planning. 94% of consultants and 100% of trainees felt that planning was important but half, respectively, routinely planned fracture treatment. Only 24% of trainees and 44% consultants traced fracture configurations from radiographs. 88% of trainees and 91% of consultants felt that planning should be undertaken more often with 94% of consultants expressing a view that trainees should do more planning. Pre-operative planning is good practice and from our study we have shown both trainees and consultants feel it should be undertaken more often.     

Inter- and intra-observer variability of the Crowe and Hartofilakidis classification systems for congenital hip disease in adults

Our study evaluated the reliability of the Crowe and Hartofilakidis classification systems for developmental dysplasia of the hip in adults. The anteroposterior radiographs of the pelvis of 145 patients with 209 osteoarthritic hips were examined twice by three experienced hip surgeons from three European countries and the abnormal hips were rated using both classifications. The inter- and intra-observer agreement was calculated. Interobserver reliability was evaluated using weighted and unweighted kappa coefficients and for the Crowe classification, among the three pairs there was a minimum kappa coefficient with linear weighting of 0.90 for observers A and C and a maximum kappa coefficient of 0.92 for observers B and C. For the Hartofilakidis classification, the minimum kappa value was 0.85 for observers A and B, and the maximum value was 0.93 for observers B and C. With regard to intra-observer reliability, the kappa coefficients with linear weighting between the two evaluations of the same observer ranged between 0.86 and 0.95 for the Crowe classification and between 0.80 and 0.93 for the Hartofilakidis classification. The reliability of both systems was substantial to almost perfect both for serial measurements by individual readers and between different readers, although the information offered was dissimilar.     

Inter- and intraobserver reliability of the Crowe and Hartofilakidis classifications in the assessment of developmental dysplasia of the hip in adult patients

Background

The purpose of this study is to investigate the inter- and intraobserver reliability of Crowe and Hartofilakidis classifications in the assessment of developmental dysplasia of the hip in adult patients.

Materials and methods

Two consultant orthopedic surgeons classified 141 dysplastic hips on 103 standard anterior–posterior pelvis radiographs according to the Crowe and Hartofilakidis classifications. Assessments were performed in random order by each observer on two separate occasions, at least 4?weeks apart. Kappa statistics were used to establish a relative level of agreement between observers for the two readings and between separate readings by the same observer.

Results

At the first readings, interobserver reliability analysis revealed kappa coefficient of 0.71 for the Crowe classification and 0.54 for the Hartofilakidis classification. At the second reading, the kappa coefficient was 0.72 for the Crowe classification and 0.75 for the Hartofilakidis classification. Intraobserver reliability analysis revealed kappa coefficients of 0.71 for the Crowe and 0.80 for the Hartofilakidis classification for observer A, and 0.76 and 0.70 for observer B.

Conclusions

In conclusion, we have found substantial inter- and intraobserver agreement for Crowe classification and substantial to moderate agreement for Hartofilakidis classification in this study. Both classification systems assess the different aspects of developmental dysplasia of hip in adults. Each system has advantages and disadvantages. We suggest using both of these classifications together to increase the accuracy.     

Do supervised colorectal trainees differ from consultants in terms of quality of TME surgery?

OBJECTIVE: The quality of surgical excision is held to be a major determinant of outcome following surgery for rectal cancer. Macroscopic examination of the excised mesorectum allows for reproducible assessment of the quality of surgery. We aimed to determine whether quality of excision undertaken by colorectal trainees under supervision was comparable with that performed by consultants, as measured using mesorectal grades. METHOD: A total of 130 consecutive patients undergoing potentially curative resection for primary adenocarcinoma of the rectum in our centre from 2001 to 2003 were included in the study. The pathologists graded the excised mesorectum according to staged classification proposed by Quirke. The outcome (quality of mesorectal excision and secondary outcomes including local recurrence and overall recurrence) of operations performed by consultants was compared with that of trainees. Statistical significance was tested using Pearson chi(2) test. RESULTS: Eighty-nine operations were performed by consultants and 41 by senior colorectal trainees with consultant supervision. Forty-four patients (49%) had good mesorectum when operated by consultants in comparison with 17 (41.5%) by the trainees. There was no statistically significant difference (P = 0.717) between the two groups in terms of quality of mesorectum excised after potentially curative resection. Furthermore, there were seven local recurrences in patients operated by consultants (7.8%) when compared with four in the trainee group (9.5%) and once again there was no statistical significance between the two groups (P = 0.719). CONCLUSION: We conclude that the quality of rectal cancer excision, as defined by mesorectal grades, achieved by supervised colorectal trainees is comparable with that achieved by consultants.     

Clinical and radiologic outcome of total hip arthroplasty performed by trainee compared with consultant orthopedic surgeons

Data were prospectively collected on 139 total hip arthroplasties (THAs) performed by supervised specialist registrars (residents) and 397 THAs performed by consultants. The Harris Hip Score and data on comorbidity, blood loss, transfusion requirements, re-operation, dislocation, and death were recorded. Radiologic assessment of acetabular and femoral component alignment and cementation was made using 114 trainee radiographs that were available for review at 6 months. These were compared with 114 matched consultant radiographs. At 18 months, there was no significant difference in clinical outcome. Acetabular anteversion was significantly less in trainee-performed THA. This article reveals no difference in the short-term clinical results of THA performed by consultants and supervised trainees. There is radiographic evidence of decreased anteversion of the acetabulum by trainees, although the dislocation rates are not different. Our results show that quality can be maintained while training juniors to perform surgery.     

Assessment of operative competence during carotid endarterectomy

BACKGROUND: Objective Structured Assessment of Technical Skills (OSATS) has been used to assess operative competence. The aim was to evaluate its role in carotid endarterectomy (CEA). METHODS: Over 2 years, 17 trainees and 11 consultants were assessed by a single observer using a task-specific checklist and global ratings. Operating time and previous experience were also recorded. RESULTS: Trainees had previously performed fewer CEAs than consultants (median (interquartile range, i.q.r.) 15 (7-24) versus 94 (61-133) respectively; P < 0.001) and they took longer to perform operations (median (i.q.r.) 128 (119-143) versus 90 (82.5-98.5) min; P < 0.001). Trainees achieved lower task-specific (median (i.q.r.) 23 (17-26) versus 25 (24.5-27.5); P = 0.031) and global (33 (30-35) versus 40 (36.5-43); P = 0.001) scores than consultants. There was a strong positive correlation between task-specific scores and experience for trainees (r = 0.83, P < 0.001), but not for consultants. Global ratings correlated with experience for trainees (r = 0.69, P = 0.002) and more so for consultants (r = 0.82, P = 0.002). There was a positive correlation between task-specific and global scores for trainees (r = 0.67, P = 0.003), but not for consultants. CONCLUSION: Task-specific checklists were more discriminatory between trainees and may be useful for formative assessment (training). Global ratings were more discriminatory for consultants and may be useful for summative assessment (examination or revalidation).     

The Reliability to Determine "Healing" in Osteochondritis Dissecans From Radiographic Assessment

BACKGROUND:: Current literature supporting treatment strategies for osteochondritis dissecans (OCD) has limited prognostic utility. Presently, there is no gold standard for an OCD "healing" outcome. Accurate and reliable determination of the OCD healed status on the basis of radiographs would be valuable to provide a guide for evidence-based treatment of OCD. The purpose of this study was to determine interrater and intrarater reliability of radiographic assessment of OCD lesion healing in the knee. METHODS:: A hospital database identified 39 consecutive patients with OCD in 42 knees, who were treated conservatively for at least 6 months. Patients were an average age of 11.9 years (±2.4 y). A total of 102 presentation slides were prepared, each containing 2 similar radiographic views from the same patient taken 6 months (±1 mo) apart. These slides were then categorized by 4 reviewers (1 orthopaedic surgeon, 1 orthopaedic fellow, and 2 musculoskeletal radiologists) blinded to patient data, as healed, not healed, or unable to evaluate the OCD lesion. Reviewers repeated their assessment at a minimum of 3 weeks after their first read. Intrarater and interrater reliability were measured with the Cohen κ coefficient and Randolph's free-marginal multirater κ, respectively, and with the percent agreement. RESULTS:: OCD lesion categorization demonstrated insufficient interrater reliability with a κ of 0.44 and 63% agreement. The notch view had the highest interrater reliability with a κ of 0.63% and 76% agreement, and the lateral view had the lowest interrater reliability with a κ of 0.29% and 53% agreement. The OCD lesion categorization demonstrated substantial intrarater reliability with a κ of 0.68% and 81% agreement. CONCLUSIONS:: Reviewers did not consistently agree on the "healing" status of the OCD lesions on the basis of radiographic assessments. Standard criteria to assess healing are needed to consistently evaluate OCD knee lesions in children. LEVEL OF EVIDENCE:: Not applicable.     

Accuracy of detecting screw penetration of the radiocarpal joint following volar plating using plain radiographs versus computed tomography

We compared standard and specialized plain radiographs with computed tomography (CT) for their ability to detect screw penetration of the articular surface of the distal radius in volar plating. Eight human cadaveric specimens were implanted with a fixed angle volar plate and 5 screws. Two groups were evaluated: (1) no articular screw penetration or (2) intra-articular screw penetration. Radiographs were obtained of each specimen. CT using 0.4 mm thickness slices were obtained and images were reconstructed in the sagittal and coronal planes. The radiographs and CTs were evaluated based on whether or not articular penetration occurred. The sensitivity, specificity, and accuracy of each radiographic modality were evaluated. CT was found to be much more sensitive and specific in detecting screw penetration than plain radiographs. The kappa (κ) statistic demonstrated "almost perfect interobserver agreement" based on CT readings, but only "substantial interobserver agreement based on plain radiographs." CT is more sensitive and specific and achieves a higher κ statistic than plain radiographs in detecting radiocarpal screw penetration after volar plating. CT should be used in detecting screw penetration when there is suspicion for radiocarpal joint penetration.     

Reliability and reproducibility of dens fracture classification with use of plain radiography and reformatted computer-aided tomography

BACKGROUND: The classification system of dens fractures by Anderson and D'Alonzo has been widely used in clinical studies. Of the three types of fractures, Type II and Type III are of particular importance because the distinction between them may affect treatment decisions. The purposes of this study were to assess whether this classification is reliable and reproducible and to determine whether computed tomography can improve its reliability and reproducibility. METHODS: Plain radiographs and spiral computed tomography images of dens fractures in eleven patients were assessed, and the fractures were assigned a classification of Type II or Type III at two readings, separated by six months, by two spine surgeons and three neuroradiologists. Kappa coefficients of agreement between the raters as well as the reproducibility of the classifications made by the individual raters were calculated independently for the fracture classifications based on the plain radiographs and those based on the reformatted computed tomography scans. RESULTS: The kappa coefficient for classifications based on plain radiographs was 0.30 and 0.25 (fair agreement) at the first and second readings, respectively. For classifications based on computed tomography scans, the corresponding kappa coefficients were 0.46 (moderate agreement) and 0.67 (substantial agreement). The kappa coefficients for intrarater reliability among the five raters averaged 0.56 (moderate agreement) when computed tomography scans were used and 0.28 (fair agreement) when plain radiographs were used. CONCLUSIONS: Substantial variation with regard to the classification of dens fractures was found within our group of raters. Greater agreement occurred when reformatted computed tomography scans rather than plain radiographs were used as the basis for classification. When classifying dens fractures according to the system of Anderson and D'Alonzo, one should consider using reformatted computed tomography scans and reaching a consensus with multiple raters.