Artificial intelligence model validation before its application in clinical diagnosis assistance

The process of selecting an artificial intelligence(AI)model to assist clinical diagnosis of a particular pathology and its validation tests is relevant since the values of accuracy,sensitivity and specificity may not reflect the behavior of the method in a real environment.Here,we provide helpful considerations to increase the success of using an AI model in clinical practice.     

Endoscopic ultrasound-guided through-the-needle microforceps biopsy and needle-based confocal laser-endomicroscopy increase detection of potentially malignant pancreatic cystic lesions: A single-center study

BACKGROUNDCurrently, there is insufficient data about the accuracy in the diagnosing of pancreatic cystic lesions (PCLs), especially with novel endoscopic techniques such as with direct intracystic micro-forceps biopsy (mFB) and needle-based confocal laser-endomicroscopy (nCLE).AIMTo compare the accuracy of endoscopic ultrasound (EUS) and associated techniques for the detection of potentially malignant PCLs: EUS-guided fine needle aspiration (EUS-FNA), contrast-enhanced EUS (CE-EUS), EUS-guided fiberoptic probe cystoscopy (cystoscopy), mFB, and nCLE.METHODSThis was a single-center, retrospective study. We identified patients who had undergone EUS, with or without additional diagnostic techniques, and had been diagnosed with PCLs. We determined agreement among malignancy after 24-mo follow-up findings with detection of potentially malignant PCLs via the EUS-guided techniques and/or EUS-guided biopsy when available (EUS malignancy detection). RESULTSA total of 129 patients were included, with EUS performed alone in 47/129. In 82/129 patients, EUS procedures were performed with additional EUS-FNA (21/82), CE-EUS (20/82), cystoscopy (27/82), mFB (36/82), nCLE (44/82). Agreement between EUS malignancy detection and the 24-mo follow-up findings was higher when associated with additional diagnostic techniques than EUS alone [62/82 (75.6%) vs 8/47 (17%); OR 4.35, 95%CI: 2.70-7.37; P < 0.001]. The highest malignancy detection accuracy was reached when nCLE and direct intracystic mFB were both performed, with a sensitivity, specificity, positive predictive value, negative predictive value and observed agreement of 100%, 89.4%, 77.8%, 100% and 92.3%, respectively (P < 0.001 compared with EUS-alone). CONCLUSIONThe combined use of EUS-guided mFB and nCLE improves detection of potentially malignant PCLs compared with EUS-alone, EUS-FNA, CE-EUS or cystoscopy.     

Multicenter evaluation of the Panbio™ COVID-19 rapid antigen-detection test for the diagnosis of SARS-CoV-2 infection

ObjectivesThe standard RT-PCR assay for coronavirus disease 2019 (COVID-19) is laborious and time-consuming, limiting testing availability. Rapid antigen-detection tests are faster and less expensive; however, the reliability of these tests must be validated before they can be used widely. The objective of this study was to determine the performance of the Panbio? COVID-19 Ag Rapid Test Device (PanbioRT) (Abbott) in detecting severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in nasopharyngeal swab specimens.MethodsThis prospective multicentre study was carried out in ten Spanish university hospitals and included individuals with clinical symptoms or epidemiological criteria of COVID-19. Only individuals with ≤7 days from the onset of symptoms or from exposure to a confirmed case of COVID-19 were included. Two nasopharyngeal samples were taken to perform the PanbioRT as a point-of-care test and a diagnostic RT-PCR test.ResultsAmong the 958 patients studied, 325 (90.5%) had true-positive results. The overall sensitivity and specificity for the PanbioRT were 90.5% (95%CI 87.5–93.6) and 98.8% (95%CI 98–99.7), respectively. Sensitivity in participants who had a threshold cycle (C_T) < 25 for the RT-PCR test was 99.5% (95%CI 98.4–100), and in participants with ≤5 days of the clinical course it was 91.8% (95%CI 88.8–94.8). Agreement between techniques was 95.7% (κ score 0.90; 95%CI 0.88–0.93).ConclusionsThe PanbioRT performs well clinically, with even more reliable results for patients with a shorter clinical course of the disease or a higher viral load. The results must be interpreted based on the local epidemiological context.     

Simultaneous detection of West Nile and Japanese encephalitis virus RNA by duplex TaqMan RT-PCR

West Nile virus (WNV) and Japanese encephalitis virus (JEV) are important mosquito-borne viruses of the Flaviviridae family, associated with encephalitis, mainly in humans and horses. WNV is also pathogen for many bird species. The incidence of human and animal WNV infections in Europe has risen, mostly in recent years, and JEV was detected in 2011 in mosquitoes collected in Italy and may emerge in Europe in the same way as other flaviviruses had emerged recently (USUTU and Bagaza virus) and should be regarded as a potential threat to public health.