Evaluating healthcare education: Issues and methods

This paper analyses the methodological issues inherent in evaluating healthcare education and considers approaches for addressing these.Recent policies have exhorted practitioners to base their practice on evidence; however in healthcare education the evidence base is not extensive. Whilst educational evaluation has advanced in the last decades, standardised designs and toolkits are not available. Each evaluation has different aims and occurs in specific contexts, thus the design has to fit the circumstances, yet meet the challenge of scientific credibility. Indicators of educational processes and outcomes are not scientifically verified; no toolkit of standardised ‘off-the-shelf’ valid, reliable and sensitive measures exists. The evidence base of educational practice is largely derived from small-scale, single case studies; the majority of measures are self-devised, unvalidated tools of unproven reliability, thus meta-synthesis is not appropriate and results are not generalisable. Healthcare educational evaluators need valid and reliable assessments of both knowledge acquisition and its application to practice. The need to establish and explain attribution, i.e. the relationship between educational inputs and outcomes is complex and requires experimental/quasi-experimental design. In addition, educational evaluators face the pragmatic challenge of practice in healthcare contexts, where confounding variables are hard to control and resources are scarce.     

Prediction and prevention of anastomotic complications of esophageal atresia and tracheoesophageal fistula

We analyzed our experience with 64 infants with esophageal atresia (EA) and tracheoesophageal fistula (TEF), to determine the possibility of prediction and prevention of anastomotic complications (leak, stricture, and recurrent TEF). In most of the infants, the anatomical level of the fistula was documented preoperatively by bronchoscopy. The level of the fistula, in turn, correlated with the esophageal anatomy at thoracotomy, ie, carinal fistulas had a wide gap between esophageal pouches, whereas midtracheal or cervical fistulas had a minimal gap. Major anastomotic complications were defined as leak requiring reoperation, symptomatic strictures requiring four or more dilatations, or a recurrent TEF. The complication rates wre: leak (major and minor), 21%; major stricture, 15%; and recurrent TEF, 5%. Major complications occurred in 42% (11/26) of infants with wide gaps, compared with 8% (3/36) of infants with minimal gaps. Route of repair (transpleural or retropleural) made no difference in incidence of anastomotic complications. No infant died of an anastomotic complication. Survival was 100% for Waterston A and B infants, 83% for Waterston C, and 90% overall. Severe gastroesophageal reflux, requiring Nissen fundoplication, was more common among infants with wide gaps than those with minimal gaps (32% v 3%). The most important pathogenetic factor, present in 79% (11/14) of major anastomotic complications, was anastomotic tension, determined by the gap between esophageal pouches, and predicted by preoperative bronchoscopy. Thus the bronchoscopic finding of a carinal fistula signals the need for technical measures that may limit anastomotic morbidity, such as myotomy, patching the anastomosis, retropleural approach, or delayed repair. Assuming precise technique and gentle handling of tissues, the anatomy of the anomaly determines the anastomotic morbidity of EA and TEF.     

Infusion clearance of subcutaneous iothalamate versus standard renal clearance

 Accurate, timed urine collections for the measurement of glomerular filtration rate (GFR) may be impractical in infants or in patients with urological abnormalities. GFR may be measured without urine collection using a constant subcutaneous infusion of iothalamate. We compare the infusion clearance with conventional renal clearance in 14 children and young adults. The mean clearance ratio (infusion clearance/renal clearance ± 1 SD) was 0.99±0.1 and the mean discrepancy between the two methods was 8.5%±4.7%. The 95% limits of agreement for the ratio of the two methods are 0.83–1.23. These data indicate that subcutaneous infusion of iothalamate is a practical method for measuring GFR in children without a urine collection. Received March 18, 1996; received in revised form February 12, 1997; accepted March 26, 1997     

Application of magnetic resonance imaging to evaluation of femoral neck structure in growing girls.

Conventional density measures by dual-energy X-ray absorptiometry (DXA) are confounded by increases in bone size and do not assess bone geometry. We assessed precision of magnetic resonance imaging (MRI) and used MRI, DXA, and hip structure analysis (HSA) to assess 7-mo changes in bone structure at the femoral neck in 18 prepubertal girls. At baseline, girls were 10.4 (0.5) yr, 144.0 (8.2) cm, and 35.2 (7.0) kg, on average. Total bone and cortical cross-sectional area (ToA and CoA) were calculated from high-resolution T1-weighted MRI oblique axial images of the femoral neck. We used proximal femur DXA scans (Hologic QDR-4500) and the HSA program to estimate bone cross-sectional area (CSA), and calculate section modulus. MRI precision was determined by scanning 10 volunteers (13-46 yr old) three times with and without repositioning. Precision (CVrms) was 2% for ToA and 7% for CoA. Significant correlations were observed between FN area and MRI-derived ToA (r = 0.57, p = 0.013) and CoA (r = 0.47, p = 0.050). There were significant positive changes over 7 mo by both methods. In conclusion, MRI provides useful information on femoral neck bone area in children. The reproducibility of cortical dimensions at the femoral neck needs improvement through technical modifications and appropriate analysis software.     

Clinical Importance of Identifying Coagulase-Negative Staphylococci Isolated from Blood Cultures: Evaluation of MicroScan Rapid and Dried Overnight Gram-Positive Panels versus a Conventional Reference Method

We evaluated the clinical usefulness of species identification of blood isolates of coagulase-negative staphylococci as a predictor of the clinical significance of the isolates. In addition, we compared results of species identification obtained with MicroScan Rapid Gram-Positive Identification panels and Dried Overnight (Conventional) Gram-Positive Identification panels with those obtained by a tube reference method. Two hundred eighty-five blood isolates were tested, including 92 judged to represent true bacteremia and 193 judged to represent contamination. The most common species detected were Staphylococcus epidermidis, Staphylococcus hominis, and Staphylococcus haemolyticus. These three species accounted for nearly 98% of the clinically significant isolates and 89% of the contaminants. The isolation of other species almost always represented contamination. However, identification of the three most common species did not help distinguish pathogens from contaminants. Both the Rapid and the Dried Overnight Gram-Positive panels identified S. epidermidis strains accurately, but the panels performed less well for the other species. Analysis revealed that S. hominis was frequently misidentified due to the presence of a previously unknown subspecies. Based on the initial results, revised investigational Dried Overnight Gram-Positive Identification panels (CPID-2) were prepared and tested. The CPID-2 panels identified 85 to 95% of S. epidermidis strains, 76 to 86% of S. hominis strains, and 88 to 92% of S. haemolyticus strains with high probability (>85%) and, overall, represented a significant improvement over the other panels for identification of these staphylococcal species.     

Recruiting and retaining GPs and patients in intervention studies: the DEPS-GP project as a case study

Background  

Recruiting and retaining GPs for research can prove difficult, and may result in sub-optimal patient participation where GPs are required to recruit patients. Low participation rates may affect the validity of research.     

Phosphorylation of SMC1 is a critical downstream event in the ATM-NBS1-BRCA1 pathway

The ATM protein kinase is activated by intermolecular autophosphorylation in response to DNA damage and initiates cellular signaling pathways that facilitate cell survival and reduce chromosomal breakage. Here, we show that NBS1 and BRCA1 are required for the recruitment of previously activated ATM to the sites of DNA breaks after ionizing irradiation, and that this recruitment is required for the phosphorylation of SMC1 by ATM. To explore the functional importance of SMC1 phosphorylation, murine cells were generated, in which the two damage-induced phosphorylation sites in SMC1 are mutated. Although these cells demonstrate normal phosphorylation and focus formation of ATM, NBS1, and BRCA1 proteins after IR, they exhibit a defective S-phase checkpoint, decreased survival, and increased chromosomal aberrations after DNA damage. These observations suggest that many of the abnormal stress responses seen in cells lacking ATM, NBS1, or BRCA1 result from a failure of ATM migration to sites of DNA breaks and a resultant lack of SMC1 phosphorylation.     

A mouse model of spinal and bulbar muscular atrophy

Spinal and bulbar muscular atrophy (SBMA) is an adult-onset motor neuron disease, caused by the expansion of a trinucleotide repeat (TNR) in exon 1 of the androgen receptor (AR) gene. This disorder is characterized by degeneration of motor and sensory neurons, proximal muscular atrophy, and endocrine abnormalities, such as gynecomastia and reduced fertility. We describe the development of a transgenic model of SBMA expressing a full-length human AR (hAR) cDNA carrying 65 (AR(65)) or 120 CAG repeats (AR(120)), with widespread expression driven by the cytomegalovirus promoter. Mice carrying the AR(120) transgene displayed behavioral and motor dysfunction, while mice carrying 65 CAG repeats showed a mild phenotype. Progressive muscle weakness and atrophy was observed in AR(120) mice and was associated with the loss of alpha-motor neurons in the spinal cord. There was no evidence of neurodegeneration in other brain structures. Motor dysfunction was observed in both male and female animals, showing that in SBMA the polyglutamine repeat expansion causes a dominant gain-of-function mutation in the AR. The male mice displayed a progressive reduction in sperm production consistent with testis defects reported in human patients. These mice represent the first model to reproduce the key features of SBMA, making them a useful resource for characterizing disease progression, and for testing therapeutic strategies for both polyglutamine and motor neuron diseases.