基于多目标交叉变异粒子群算法的多模医学图像非刚性配准

以互信息为相似性测度,采用B样条变换对多模态医学图像进行非刚性配准时,由于噪声及图像插值等原因造成的互信息局部极值使得传统优化方法不能搜索到最佳配准参数。为此,使用粒子群智能优化方法作为搜索策略,以降低对图像预处理的要求,进一步提高基于互信息的非刚性配准的鲁棒性。为了克服粒子群算法受初始值选取等因素的影响易陷于局部最优的缺点,使用LBFGS优化得到的结果构造初始粒子群,采用多目标优化方法结合交叉变异策略加以改进,使得算法在解空间搜索的遍历性得到改善,优化结果更接近全局最优。MR-T2与MR-PD图像的配准实验证明,该方法提高了基于互信息的B样条非刚性配准的鲁棒性,配准率达到94%;CT与PET图像的配准实验表明该方法相比惯性权重粒子群算法提高了配准精度,互信息增加了0.026;另外,CT与CBCT图像的配准实验也验证了本方法的有效性。     

结合卷积神经网络与图卷积网络的乳腺癌病理图像分类研究

目的乳腺癌的精确诊断对于后续治疗具有重要临床意义,组织病理学分析是肿瘤诊断的金标准。卷积神经网络(convolution neural network,CNN)具有良好的局部特征提取能力,但无法有效捕捉细胞组织间的空间关系。为了有效利用这种空间关系,本文提出一种新的结合CNN与图卷积网络(graph convolution network,GCN)的病理图像分类框架,应用于乳腺癌病理图像的辅助诊断。方法首先对病理图像进行卷积及下采样得到一组特征图,然后将特征图上每个像素位置的特征向量表示为1个节点,构建具有空间结构的图,并通过GCN学习图中蕴含的空间结构特征。最后,将基于GCN的空间结构特征与基于CNN的全局特征融合,并同时对整个网络进行优化,实现基于融合特征的病理图像分类。结果本研究在提出框架下进行了3种GCN的比较,其中CNN-sGCN-fusion算法在2015生物成像挑战赛乳腺组织学数据集上获得93.53%±1.80%的准确率,在Databiox乳腺数据集上获得78.47%±5.33%的准确率。结论与传统基于CNN的病理图像分类算法相比,本文提出的结合CNN与GCN的算法有效融合了病理图像的全局特征与空间结构特征,从而提升了分类性能,具有潜在的应用可行性。     

High-temporal resolution DCE-MRI improves assessment of intra- and peri-breast lesions categorized as BI-RADS 4

Grading of cancer histopathology slides requires more pathologists and expert clinicians as well as it is time consuming to look manually into whole-slide images. Hence, an automated classification of histopathological breast cancer sub-type is useful for clinical diagnosis and therapeutic responses. Recent deep learning methods for medical image analysis suggest the utility of automated radiologic imaging classification for relating disease characteristics or diagnosis and patient stratification. To develop a hybrid model using the convolutional neural network (CNN) and the long short-term memory recurrent neural network (LSTM RNN) to classify four benign and four malignant breast cancer subtypes. The proposed CNN-LSTM leveraging on ImageNet uses a transfer learning approach in classifying and predicting four subtypes of each. The proposed model was evaluated on the BreakHis dataset comprises 2480 benign and 5429 malignant cancer images acquired at magnifications of 40×, 100×, 200× and 400×. The proposed hybrid CNN-LSTM model was compared with the existing CNN models used for breast histopathological image classification such as VGG-16, ResNet50, and Inception models. All the models were built using three different optimizers such as adaptive moment estimator (Adam), root mean square propagation (RMSProp), and stochastic gradient descent (SGD) optimizers by varying numbers of epochs. From the results, we noticed that the Adam optimizer was the best optimizer with maximum accuracy and minimum model loss for both the training and validation sets. The proposed hybrid CNN-LSTM model showed the highest overall accuracy of 99% for binary classification of benign and malignant cancer, and, whereas, 92.5% for multi-class classifier of benign and malignant cancer subtypes, respectively. To conclude, the proposed transfer learning approach outperformed the state-of-the-art machine and deep learning models in classifying benign and malignant cancer subtypes. The proposed method is feasible in classification of other cancers as well as diseases.     

基于改进的模糊C-均值聚类算法及支持向量机的眼底图像中硬性渗出检测方法

目的提出一种基于改进的模糊C-均值(improved fuzzy C-means,IFCM)聚类算法及支持向量机(support vector machine,SVM)的检测算法,以实现对眼底图像中硬性渗出的自动识别。方法首先利用改进的FCM算法对由江苏省中医院眼科提供的120幅彩色眼底图像进行粗分割以获取硬性渗出候选区域;其次,利用Logistic回归对候选区域提取出的特征进行选择,并利用候选区域的优化特征集及相应判定结果建立SVM分类器,实现眼底图像中硬性渗出的自动检测;最后利用该方法对65幅眼底图像进行硬性渗出自动检测。结果硬性渗出自动检测得到的病灶区域水平灵敏度96.47%,阳性预测值90.13%;图像水平灵敏度100%,特异性95.00%,准确率98.46%;平均一幅图像处理时间4.56 s。结论利用改进的FCM算法与识别率较高的SVM分类器相结合的方法能够高效自动地识别出眼底图像中的硬性渗出。     

An Efficient Approach for Automated Mass Segmentation and Classification in Mammograms

Breast cancer is becoming a leading death of women all over the world; clinical experiments demonstrate that early detection and accurate diagnosis can increase the potential of treatment. In order to improve the breast cancer diagnosis precision, this paper presents a novel automated segmentation and classification method for mammograms. We conduct the experiment on both DDSM database and MIAS database, firstly extract the region of interests (ROIs) with chain codes and using the rough set (RS) method to enhance the ROIs, secondly segment the mass region from the location ROIs with an improved vector field convolution (VFC) snake and following extract features from the mass region and its surroundings, and then establish features database with 32 dimensions; finally, these features are used as input to several classification techniques. In our work, the random forest is used and compared with support vector machine (SVM), genetic algorithm support vector machine (GA-SVM), particle swarm optimization support vector machine (PSO-SVM), and decision tree. The effectiveness of our method is evaluated by a comprehensive and objective evaluation system; also, Matthew’s correlation coefficient (MCC) indicator is used. Among the state-of-the-art classifiers, our method achieves the best performance with best accuracy of 97.73 %, and the MCC value reaches 0.8668 and 0.8652 in unique DDSM database and both two databases, respectively. Experimental results prove that the proposed method outperforms the other methods; it could consider applying in CAD systems to assist the physicians for breast cancer diagnosis.     

Detection of Hard Exudates in Colour Fundus Images Using Fuzzy Support Vector Machine-Based Expert System

Diabetic retinopathy is a major cause of vision loss in diabetic patients. Currently, there is a need for making decisions using intelligent computer algorithms when screening a large volume of data. This paper presents an expert decision-making system designed using a fuzzy support vector machine (FSVM) classifier to detect hard exudates in fundus images. The optic discs in the colour fundus images are segmented to avoid false alarms using morphological operations and based on circular Hough transform. To discriminate between the exudates and the non-exudates pixels, colour and texture features are extracted from the images. These features are given as input to the FSVM classifier. The classifier analysed 200 retinal images collected from diabetic retinopathy screening programmes. The tests made on the retinal images show that the proposed detection system has better discriminating power than the conventional support vector machine. With the best combination of FSVM and features sets, the area under the receiver operating characteristic curve reached 0.9606, which corresponds to a sensitivity of 94.1 % with a specificity of 90.0 %. The results suggest that detecting hard exudates using FSVM contribute to computer-assisted detection of diabetic retinopathy and as a decision support system for ophthalmologists.     

Analysis on diagnosing diabetic retinopathy by segmenting blood vessels,optic disc and retinal abnormalities

Abstract

The main intention of mass screening programmes for Diabetic Retinopathy (DR) is to detect and diagnose the disorder earlier than it leads to vision loss. Automated analysis of retinal images has the likelihood to improve the efficacy of screening programmes when compared over the manual image analysis. This article plans to develop a framework for the detection of DR from the retinal fundus images using three evaluations based on optic disc, blood vessels and retinal abnormalities. Initially, the pre-processing steps like green channel conversion and Contrast Limited Adaptive Histogram Equalisation is done. Further, the segmentation procedure starts with optic disc segmentation by open-close watershed transform, blood vessel segmentation by grey level thresholding and abnormality segmentation (hard exudates, haemorrhages, Microaneurysm and soft exudates) by top hat transform and Gabor filtering mechanisms. From the three segmented images, the feature like local binary pattern, texture energy measurement, Shanon’s and Kapur’s entropy are extracted, which is subjected to optimal feature selection process using the new hybrid optimisation algorithm termed as Trial-based Bypass Improved Dragonfly Algorithm (TB – DA). These features are given to hybrid machine learning algorithm with the combination of NN and DBN. As a modification, the same hybrid TB – DA is used to enhance the training of hybrid classifier, which outputs the categorisation as normal, mild, moderate or severe images based on three components.     

Contourlet-Based Features for Computerized Tumor Detection in Capsule Endoscopy Images

This article presents a computer-aided detection system for capsule endoscopy (CE) images using contourlet-based color textural features to recognize tumors in the digestive tract. As tumor exhibits rich information in color texture, a novel color texture feature based on contourlet transform is proposed to describe characteristics of tumor in CE images. The proposed features are a hybrid of contourlet transform and uniform local binary pattern, yielding detailed and robust color texture features in multi-directions for CE images. Sequential floating forward search approach is further applied to refine the proposed features. With support vector machine for classification, comprehensive experiments on our present data reveal an encouraging accuracy of 93.6% for tumor detection in CE images using the proposed features.     

Hybrid Convolution Neural Network in Classification of Cancer in Histopathology Images

Cancer statistics in 2020 reveals that breast cancer is the most common form of cancer among women in India. One in 28 women is likely to develop breast cancer during their lifetime. The mortality rate is 1.6 to 1.7 times higher than maternal mortality rates. According to the US statistics, about 42,170 women in the US are expected to die in 2020 from breast cancer. The chance of survival can be increased through early and accurate diagnosis of cancer. The pathologists manually analyze the histopathology images using high-resolution microscopes to detect the mitotic cells. This is a time-consuming process because there is a minute difference between the normal and mitotic cells. To overcome these challenges, an automatic analysis and detection of breast cancer by using histopathology images play a vital role in prognosis. Earlier researchers used conventional image processing techniques for the detection of mitotic cells. These methods were found to be producing results with low accuracy and time-consuming. Therefore, several deep learning techniques were adopted by researchers to increase the accuracy and minimize the time. The hybrid deep learning model is proposed for selecting abstract features from the histopathology images. In the proposed approach, we have concatenated two different CNN architectures into a single model for effective classification of mitotic cells. Convolution neural network (CNN) automatically detects efficient features without human intervention and classifies cancerous and non-cancerous images using a hybrid fully connected network. It is a computationally efficient, very powerful, and efficient model for performing automatic feature extraction. It detects different phenotypic signatures of nuclei. In order to enhance the accuracy and computational efficiency, the histopathology images are preprocessed, segmented, and feature extracted through CNN and fed into a hybrid CNN for classification. The hybrid CNN is obtained by concatenating two CNN models; together, this is called model leveraging. Model averaging can be improved by weighting the contributions of each sub-model to the combined prediction by the expected performance of the sub-model. The proposed hybrid CNN architecture with data preprocessing with median filter and Otsu-based segmentation technique is trained using 50,000 images and tested using 50,000 images. It provides an overall accuracy of 98.9%.

     

基于生成对抗网络的彩色眼底图像硬性渗出检测方法

糖尿病视网膜病变(DR)是糖尿病严重的并发症,是视力损害最常见的原因之一。硬性渗出物(HE)是DR早期的症状之一,从眼底图像中对硬性渗出的准确检测是DR筛查的关键步骤。提出一种基于生成对抗网络(GANs)的视网膜硬性渗出的自动检测方法。相比一般的卷积神经网络,生成对抗网络由生成式模型G和判别式模型D组成,两者之间的博弈与竞争使得生成对抗网络能够更加精确地检测眼底图像中的硬性渗出。首先,为了避免视盘对后续硬性渗出检测的干扰,根据血管分布信息与全局灰度信息,准确定位视盘(OD)中心并掩盖视盘;然后,交替迭代训练生成式模型G和判别式模型D,得到在验证集上分割效果最佳的模型并保存。所提出的算法在e-ophtha EX数据库上训练和验证,并进行像素级评估,获得88.6％、84.3％和86.4％的平均灵敏度、PPV和F-score。在另一个独立的DIARETDB1数据库上进行测试,获得的平均灵敏度、特异性和准确性分别为100％、96.2％和97.8％。综上所述,两个视网膜图像数据库的评估结果证明,生成对抗网络的博弈模式能够有效地检测彩色眼底图像中的硬性渗出。     

Ensemble selection for feature-based classification of diabetic maculopathy images

As diabetic maculopathy (DM) is a prevalent cause of blindness in the world, it is increasingly important to use automated techniques for the early detection of the disease. In this paper, we propose a decision system to classify DM fundus images into normal, clinically significant macular edema (CMSE), and non-clinically significant macular edema (non-CMSE) classes. The objective of the proposed decision system is three fold namely, to automatically extract textural features (both region specific and global), to effectively choose subset of discriminatory features, and to classify DM fundus images to their corresponding class of disease severity. The system uses a gamut of textural features and an ensemble classifier derived from four popular classifiers such as the hidden naïve Bayes, naïve Bayes, sequential minimal optimization (SMO), and the tree-based J48 classifiers. We achieved an average classification accuracy of 96.7% using five-fold cross validation.     

Automated patient-specific classification of long-term Electroencephalography

This paper presents a novel systematic approach for patient-specific classification of long-term Electroencephalography (EEG). The goal is to extract the seizure sections with a high accuracy to ease the Neurologist’s burden of inspecting such long-term EEG data. We aim to achieve this using the minimum feedback from the Neurologist. To accomplish this, we use the majority of the state-of-the-art features proposed in this domain for evolving a collective network of binary classifiers (CNBC) using multi-dimensional particle swarm optimization (MD PSO). Multiple CNBCs are then used to form a CNBC ensemble (CNBC-E), which aggregates epileptic seizure frames from the classification map of each CNBC in order to maximize the sensitivity rate. Finally, a morphological filter forms the final epileptic segments while filtering out the outliers in the form of classification noise. The proposed system is fully generic, which does not require any a priori information about the patient such as the list of relevant EEG channels. The results of the classification experiments, which are performed over the benchmark CHB-MIT scalp long-term EEG database show that the proposed system can achieve all the aforementioned objectives and exhibits a significantly superior performance compared to several other state-of-the-art methods. Using a limited training dataset that is formed by less than 2 min of seizure and 24 min of non-seizure data on the average taken from the early 25% section of the EEG record of each patient, the proposed system establishes an average sensitivity rate above 89% along with an average specificity rate above 93% over the test set.     

Deep learning approach to detect seizure using reconstructed phase space images

Epilepsy is a chronic neurological disorder that affects the function of the brain in people of all ages. It manifests in the electroencephalogram (EEG) signal which records the electrical activity of the brain. Various image processing, signal processing, and machine-learning based techniques are employed to analyze epilepsy, using spatial and temporal features. The nervous system that generates the EEG signal is considered nonlinear and the EEG signals exhibit chaotic behavior. In order to capture these nonlinear dynamics, we use reconstructed phase space (RPS) representation of the signal. Earlier studies have primarily addressed seizure detection as a binary classification (normal vs. ictal) problem and rarely as a ternary class (normal vs. interictal vs. ictal) problem. We employ transfer learning on a pre-trained deep neural network model and retrain it using RPS images of the EEG signal. The classification accuracy of the model for the binary classes is (98.5±1.5)% and (95±2)% for the ternary classes. The performance of the convolution neural network (CNN) model is better than the other existing statistical approach for all performance indicators such as accuracy, sensitivity, and specificity. The result of the proposed approach shows the prospect of employing RPS images with CNN for predicting epileptic seizures.     

Study on Spot Addressing and Segmentation Method for Microarray Image

This paper presents a novel method of spot addressing and segmentation about the foreground segmentation of microarray image. In this paper,a spot addressing method based on particle swarm optimization(PSO),algorithm is proposed to have a further search for the center coordinate and radius of the spot whose region is determined by the projection method. Then,a foreground segmentation method is put forward to make the spot foreground segmentation based on the center coordinate and radius of the spot. The spot addressing and segmentation experiments on synthetic and real microarray images show that the proposed method is effective and feasible for the foreground segmentation of microarray image.     

Simultaneous genes and training samples selection by modified particle swarm optimization for gene expression data classification

Gene expression datasets is a means to classify and predict the diagnostic categories of a patient. Informative genes and representative samples selection are two important aspects for reducing gene expression data. Identifying and pruning redundant genes and samples simultaneously can improve the performance of classification and circumvent the local optima problem. In the present paper, the modified particle swarm optimization was applied to selecting optimal genes and samples simultaneously and support vector machine was used as an objective function to determine the optimum set of genes and samples. To evaluate the performance of the new proposed method, it was applied to three publicly available microarray datasets. It has been demonstrated that the proposed method for gene and sample selection is a useful tool for mining high dimension data.     

Lung sounds classification using convolutional neural networks

Lung sounds convey relevant information related to pulmonary disorders, and to evaluate patients with pulmonary conditions, the physician or the doctor uses the traditional auscultation technique. However, this technique suffers from limitations. For example, if the physician is not well trained, this may lead to a wrong diagnosis. Moreover, lung sounds are non-stationary, complicating the tasks of analysis, recognition, and distinction. This is why developing automatic recognition systems can help to deal with these limitations. In this paper, we compare three machine learning approaches for lung sounds classification. The first two approaches are based on the extraction of a set of handcrafted features trained by three different classifiers (support vector machines, k-nearest neighbor, and Gaussian mixture models) while the third approach is based on the design of convolutional neural networks (CNN). In the first approach, we extracted the 12 MFCC coefficients from the audio files then calculated six MFCCs statistics. We also experimented normalization using zero mean and unity variance to enhance accuracy. In the second approach, the local binary pattern (LBP) features are extracted from the visual representation of the audio files (spectrograms). The features are normalized using whitening. The dataset used in this work consists of seven classes (normal, coarse crackle, fine crackle, monophonic wheeze, polyphonic wheeze, squawk, and stridor). We have also experimentally tested dataset augmentation techniques on the spectrograms to enhance the ultimate accuracy of the CNN. The results show that CNN outperformed the handcrafted feature based classifiers.     

Prostate cancer multi-feature analysis using trans-rectal ultrasound images

This note focuses on extracting and analysing prostate texture features from trans-rectal ultrasound (TRUS) images for tissue characterization. One of the principal contributions of this investigation is the use of the information of the images' frequency domain features and spatial domain features to attain a more accurate diagnosis. Each image is divided into regions of interest (ROIs) by the Gabor multi-resolution analysis, a crucial stage, in which segmentation is achieved according to the frequency response of the image pixels. The pixels with a similar response to the same filter are grouped to form one ROI. Next, from each ROI two different statistical feature sets are constructed; the first set includes four grey level dependence matrix (GLDM) features and the second set consists of five grey level difference vector (GLDV) features. These constructed feature sets are then ranked by the mutual information feature selection (MIFS) algorithm. Here, the features that provide the maximum mutual information of each feature and class (cancerous and non-cancerous) and the minimum mutual information of the selected features are chosen, yielding a reduced feature subset. The two constructed feature sets, GLDM and GLDV, as well as the reduced feature subset, are examined in terms of three different classifiers: the condensed k-nearest neighbour (CNN), the decision tree (DT) and the support vector machine (SVM). The accuracy classification results range from 87.5% to 93.75%, where the performance of the SVM and that of the DT are significantly better than the performance of the CNN.     

糖尿病性视网膜病变图像黄斑水肿等级自动分析方法

糖尿病性黄斑水肿（DME）可以出现在糖尿病性视网膜病变（DR）的任何阶段,是导致糖尿病患者视力损伤的主要原因,因此DME自动分析是DR筛查的关键内容。依据DME国际临床分级标准,通过检测并判断硬性渗出（HEs）是否接近或涉及黄斑中心,可对眼底图像进行DME等级的自动分析。HEs检测选择基于现有的数学形态学方法的综合改进;黄斑中心定位则引入定向局部对比度滤波结合局部血管密度的新方法,可同步确定并去除视盘区域,以消除对HEs检测的影响,其中血管密度仅需提取粗血管网络。经开放的HEI MED数据集中169幅眼底图像的测试,HEs检测在图像水平上获得100%敏感性和922%特异性;黄斑中心定位正确率982%;各DME等级评价正确率均在88%以上,具有重要的临床参考和应用价值。     

基于功能磁共振图像转换在阿尔茨海默症分类中的应用

为了能识别阿尔茨海默症（AD）早期症状,提出一种改进的3DPCANet网络模型,并结合患者功能磁共振成像（fMRI）转换,对AD不同阶段患者进行分类。首先预处理患者的fMRI,并对预处理后的图像进行局部一致性（ReHo）图像转换;然后采用改进的3DPCANet模型对fMRI转换后的图像进行特征提取;最后使用支持向量机进行分类。实验结果显示,改进后的3DPCANet模型可以对fMRI转换后的图像提取有效的分类特征,其中,晚期轻度认知障碍与AD、主观记忆衰退与AD、主观记忆衰退与早期轻度认知障碍的分类准确率分别达到90.00%、88.89%、88.00%,验证了本方法的有效性和可行性。