The journeys of three ASPIRE winning medical schools toward excellence in student assessment

Abstract

Introduction: ASPIRE Excellence Awards in Student Assessment are offered to medical schools with innovative and comprehensive assessment programmes adjudged by international experts, using evidence-based criteria.

The journeys of three ASPIRE-winning medical schools toward “assessment excellence” are presented. These schools include Aga Khan University Medical College (AKU-MC), Pakistan, Southern Illinois University School of Medicine (SIUSOM), USA, and University of Leeds School of Medicine, UK.

Methods: The unfolding journeys highlighting achievements, innovations, and essential components of each assessment programme were compared to identify differences and commonalities.

Results: Cultural contextual differences included developed-versus-developing country, east-west, type of regulatory bodies, and institutional-versus-national certifying/licensing examinations, which influence curricula and assessments.

In all, 12 essential commonalities were found: alignment with institutional vision; sustained assessment leadership; stakeholder engagement; communication between curriculum and assessment; assessment-for-learning and feedback; longitudinal student profiling of outcome achievement; assessment rigor and robustness; 360° feedback from-and-to assessment; continuous enrichment through rigorous quality assurance; societal sensitivity; influencing others; and a “wow factor.”

Conclusions: Although the journeys of the three medical schools were undertaken in different cultural contexts, similar core components highlight strong foundations in student assessment. The journeys continue as assessment programmes remain dynamic and measurement science expands. This article may be helpful to other institutions pursuing excellence in assessment.     

Effects of Family-Centered Media Literacy Training on Family Nutrition Outcomes

Prevention Science - Parents frustrated about food marketing influences need media management skills to challenge marketing messages and interpret factual content. We tested a media literacy-based,...     

Graphical calibration curves and the integrated calibration index (ICI) for survival models

In the context of survival analysis, calibration refers to the agreement between predicted probabilities and observed event rates or frequencies of the outcome within a given duration of time. We aimed to describe and evaluate methods for graphically assessing the calibration of survival models. We focus on hazard regression models and restricted cubic splines in conjunction with a Cox proportional hazards model. We also describe modifications of the Integrated Calibration Index, of E50 and of E90. In this context, this is the average (respectively, median or 90th percentile) absolute difference between predicted survival probabilities and smoothed survival frequencies. We conducted a series of Monte Carlo simulations to evaluate the performance of these calibration measures when the underlying model has been correctly specified and under different types of model mis-specification. We illustrate the utility of calibration curves and the three calibration metrics by using them to compare the calibration of a Cox proportional hazards regression model with that of a random survival forest for predicting mortality in patients hospitalized with heart failure. Under a correctly specified regression model, differences between the two methods for constructing calibration curves were minimal, although the performance of the method based on restricted cubic splines tended to be slightly better. In contrast, under a mis-specified model, the smoothed calibration curved constructed using hazard regression tended to be closer to the true calibration curve. The use of calibration curves and of these numeric calibration metrics permits for a comprehensive comparison of the calibration of competing survival models.     

Impact of duplicate CT scan rate after implementation of transfer image repository system at a level 1 trauma center

Purpose

The regionalization of trauma in the USA results in frequent transfers of patients from a primary hospital ED to a higher level trauma facility. While many hospitals have a Picture Archive Communication System (PACS) which captures digital radiological images, these are often not available to the receiving institution resulting in duplicate imaging. The state of Arkansas instituted a trauma image repository (TIR) in July 2013. We examined whether implementation of this repository would impact CT scan duplication in the trauma system.

Methods

This was a retrospective analysis of trauma patients transferred from outlying hospitals in Arkansas and Missouri to a single level 1 trauma hospital in Missouri between July 2012 and June 2015. We compared the duplicate CT rate for patients transferred from Arkansas and Missouri hospitals before and after the repository was implemented for Arkansas.

Results

Prior to implementation (July 2012–June 2013) of Arkansas TIR, duplicate CT rates were similar for patients transferred from Arkansas (11.5%?±?2.8) or Missouri (16.3%?±?7.5). Following implementation (July 2013–June 2014), the duplicate CT rate for patients transferred from Arkansas was significantly lower (Arkansas?=?10.1% vs. Missouri 16.2%; CI 95%, p?=?0.02), and significance continued (Arkansas?=?9.0% vs. Missouri?=?17.8%; CI 95%, p?=?0.02) during follow-up (July 2014–June 2015).

Conclusion

Fewer patients received duplicated scans within the Arkansas as compared with the Missouri-based trauma referral systems regardless of Injury Severity Scores (ISS). Our findings suggest that TIR adoption coupled with PACS improved transferability of radiographic studies and could improve patient care while reducing costs in trauma transfers.

     

Diagnostic accuracy of MRI texture analysis for grading gliomas

Treatment-related changes can be difficult to differentiate from progressive glioma using MRI with contrast (CE). The purpose of this study is to compare the sensitivity and specificity of 18F-DOPA-PET and MRI in patients with recurrent glioma. Thirteen patients with MRI findings suspicious for recurrent glioma were prospectively enrolled and underwent 18F-DOPA-PET and MRI for neurosurgical planning. Stereotactic biopsies were obtained from regions of concordant and discordant PET and MRI CE, all within regions of T2/FLAIR signal hyperintensity. The sensitivity and specificity of 18F-DOPA-PET and CE were calculated based on histopathologic analysis. Receiver operating characteristic curve analysis revealed optimal tumor to normal (T/N) and SUVmax thresholds. In the 37 specimens obtained, 51% exhibited MRI contrast enhancement (M+) and 78% demonstrated 18F-DOPA-PET avidity (P+). Imaging characteristics included M?P? in 16%, M?P+ in 32%, M+P+ in 46% and M+P? in 5%. Histopathologic review of biopsies revealed grade II components in 16%, grade III in 43%, grade IV in 30% and no tumor in 11%. MRI CE sensitivity for recurrent tumor was 52% and specificity was 50%. PET sensitivity for tumor was 82% and specificity was 50%. A T/N threshold?>?2.0 altered sensitivity to 76% and specificity to 100% and SUVmax?>?1.36 improved sensitivity and specificity to 94 and 75%, respectively. 18F-DOPA-PET can provide increased sensitivity and specificity compared with MRI CE for visualizing the spatial distribution of recurrent gliomas. Future studies will incorporate 18F-DOPA-PET into re-irradiation target volume delineation for RT planning.     

Singleplex quantitative real-time PCR for the assessment of human mitochondrial DNA quantity and quality

Mitochondrial DNA (mtDNA) can provide a means for forensic identity testing when genotyping of nuclear DNA (nuDNA) targets is not possible due to degradation or lack of template. For degraded samples, an indication of the quantity and quality of mtDNA is essential to allow selection of appropriately sized targets for hypervariable region (HVR) analysis, which may conserve sample and resources. Three human-specific mtDNA targets of increasing length (86, 190 and 452 base pairs) were amplified by singleplex quantitative real-time PCR (qPCR), capable of providing an index of mtDNA degradation from fragment length information. Quantification was achieved by preparation of a standard curve for each target, using a purified mtDNA standard containing all three targets of interest, which produced a linear, accurate and precise result from 1×10⁸ to 10 copies. These novel assays demonstrated excellent sensitivity, specificity and reproducibility in line with the minimum information for qPCR experiments (MIQE) guidelines. Further, a separate inhibition control reaction was included to guide sample clean-up and ensure the validity of degradation assays. This protocol assists the selection and analysis of appropriately sized targets to maximize the chance of obtaining an informative result in downstream assays like sequencing.     

Use of psychotropic medications in breast-feeding women: acute and prophylactic treatment

OBJECTIVES: The postnatal period is a time of increased onset and relapse of mental illness. It poses a clinical dilemma, as many mothers requiring medication acutely or prophylactically will also choose to breast feed. The present paper first reviews the safety of psychotropes in breast-fed infants and the usefulness of prophylaxis for women at risk of postpartum affective relapse and, second, provides guidelines in the use of psychotropic drugs in breast-feeding women. METHODS: A Medline review was conducted reviewing all papers published during the period 1993-1998 (and their associated bibliographies) on the use of psychotropes in breast-feeding women and the prophylactic usefulness of medications in women at risk of affective postpartum relapse. RESULTS: Findings are based on case reports and small, mostly uncontrolled studies. Both tricyclic antidepressants (TCA) and specific serotonin re-uptake inhibitors (SSRIs) appear to be relatively safe in breast feeding. Antidepressants commenced in the early postpartum period may reduce depressive relapse. While prophylactic lithium appears to significantly reduce relapse of affective psychosis in the puerperium, there have been no studies of the anticonvulsants in the puerperium. Finally, high dose antipsychotics should be avoided, as they may be associated with long-term adverse sequelae in the infant. CONCLUSIONS: On the basis of current knowledge, the use of SSRIs, TCA, carbamazepine, sodium valproate and short-acting benzodiazepines in breast feeding is relatively safe. If lithium is to be used, close collaboration with a paediatrician is essential. The long-term risks of antipsychotics, especially at high doses, remain to be clarified. Before a decision can be made, the risk-benefit ratio must be clearly outlined and discussed with the mother and her partner.