The journeys of three ASPIRE winning medical schools toward excellence in student assessment

Abstract

Introduction: ASPIRE Excellence Awards in Student Assessment are offered to medical schools with innovative and comprehensive assessment programmes adjudged by international experts, using evidence-based criteria.

The journeys of three ASPIRE-winning medical schools toward “assessment excellence” are presented. These schools include Aga Khan University Medical College (AKU-MC), Pakistan, Southern Illinois University School of Medicine (SIUSOM), USA, and University of Leeds School of Medicine, UK.

Methods: The unfolding journeys highlighting achievements, innovations, and essential components of each assessment programme were compared to identify differences and commonalities.

Results: Cultural contextual differences included developed-versus-developing country, east-west, type of regulatory bodies, and institutional-versus-national certifying/licensing examinations, which influence curricula and assessments.

In all, 12 essential commonalities were found: alignment with institutional vision; sustained assessment leadership; stakeholder engagement; communication between curriculum and assessment; assessment-for-learning and feedback; longitudinal student profiling of outcome achievement; assessment rigor and robustness; 360° feedback from-and-to assessment; continuous enrichment through rigorous quality assurance; societal sensitivity; influencing others; and a “wow factor.”

Conclusions: Although the journeys of the three medical schools were undertaken in different cultural contexts, similar core components highlight strong foundations in student assessment. The journeys continue as assessment programmes remain dynamic and measurement science expands. This article may be helpful to other institutions pursuing excellence in assessment.     

Using cognitive models to develop quality multiple-choice questions

With the recent interest in competency-based education, educators are being challenged to develop more assessment opportunities. As such, there is increased demand for exam content development, which can be a very labor-intense process. An innovative solution to this challenge has been the use of automatic item generation (AIG) to develop multiple-choice questions (MCQs). In AIG, computer technology is used to generate test items from cognitive models (i.e. representations of the knowledge and skills that are required to solve a problem). The main advantage yielded by AIG is the efficiency in generating items. Although technology for AIG relies on a linear programming approach, the same principles can also be used to improve traditional committee-based processes used in the development of MCQs. Using this approach, content experts deconstruct their clinical reasoning process to develop a cognitive model which, in turn, is used to create MCQs. This approach is appealing because it: (1) is efficient; (2) has been shown to produce items with psychometric properties comparable to those generated using a traditional approach; and (3) can be used to assess higher order skills (i.e. application of knowledge). The purpose of this article is to provide a novel framework for the development of high-quality MCQs using cognitive models.     

Discovery of Bacterial Fatty Acid Synthase Type II Inhibitors Using a Novel Cellular Bioluminescent Reporter Assay

Novel, cellular, gain-of-signal, bioluminescent reporter assays for fatty acid synthesis type II (FASII) inhibitors were constructed in an efflux-deficient strain of Pseudomonas aeruginosa and based on the discovery that FASII genes in P. aeruginosa are coordinately upregulated in response to pathway disruption. A screen of 115,000 compounds identified a series of sulfonamidobenzamide (SABA) analogs, which generated strong luminescent signals in two FASII reporter strains but not in four control reporter strains designed to respond to inhibitors of pathways other than FASII. The SABA analogs selectively inhibited lipid biosynthesis in P. aeruginosa and exhibited minimal cytotoxicity to mammalian cells (50% cytotoxic concentration [CC₅₀] ≥ 80 μM). The most potent SABA analogs had MICs of 0.5 to 7.0 μM (0.2 to 3.0 μg/ml) against an efflux-deficient Escherichia coli (ΔtolC) strain but had no detectable MIC against efflux-proficient E. coli or against P. aeruginosa (efflux deficient or proficient). Genetic, molecular genetic, and biochemical studies revealed that SABA analogs target the enzyme (AccC) catalyzing the biotin carboxylase half-reaction of the acetyl coenzyme A (acetyl-CoA) carboxylase step in the initiation phase of FASII in E. coli and P. aeruginosa. These results validate the capability and the sensitivity of this novel bioluminescent reporter screen to identify inhibitors of E. coli and P. aeruginosa FASII.