A Robust Multi-Class Feature Selection Strategy Based on Rotation Forest Ensemble Algorithm for Diagnosis of Erythemato-Squamous Diseases

In biomedical studies, accuracy of classification algorithms used in disease diagnosis systems is certainly an important task and the accuracy of system is strictly related to extraction of discriminatory features from data. In this paper, we propose a new multi-class feature selection method based on Rotation Forest meta-learner algorithm. The feature selection performance of this newly proposed ensemble approach is tested on Erythemato-Squamous diseases dataset. The discrimination ability of selected features is evaluated by the use of several machine learning algorithms. In order to evaluate the performance of Rotation Forest Ensemble Feature Selection approach quantitatively, we also used various and widely utilized ensemble algorithms to compare effectiveness of resultant features. The new multi-class or ensemble feature selection algorithm exhibited promising results in eliminating redundant attributes. The Rotation Forest selection based features demonstrated accuracies between 98% and 99% in various classifiers and this is a quite high performance for Erythemato-Squamous Diseases diagnosis.     

SVM Feature Selection Based Rotation Forest Ensemble Classifiers to Improve Computer-Aided Diagnosis of Parkinson Disease

Parkinson disease (PD) is an age-related deterioration of certain nerve systems, which affects movement, balance, and muscle control of clients. PD is one of the common diseases which affect 1% of people older than 60?years. A new classification scheme based on support vector machine (SVM) selected features to train rotation forest (RF) ensemble classifiers is presented for improving diagnosis of PD. The dataset contains records of voice measurements from 31 people, 23 with PD and each record in the dataset is defined with 22 features. The diagnosis model first makes use of a linear SVM to select ten most relevant features from 22. As a second step of the classification model, six different classifiers are trained with the subset of features. Subsequently, at the third step, the accuracies of classifiers are improved by the utilization of RF ensemble classification strategy. The results of the experiments are evaluated using three metrics; classification accuracy (ACC), Kappa Error (KE) and Area under the Receiver Operating Characteristic (ROC) Curve (AUC). Performance measures of two base classifiers, i.e. KStar and IBk, demonstrated an apparent increase in PD diagnosis accuracy compared to similar studies in literature. After all, application of RF ensemble classification scheme improved PD diagnosis in 5 of 6 classifiers significantly. We, numerically, obtained about 97% accuracy in RF ensemble of IBk (a K-Nearest Neighbor variant) algorithm, which is a quite high performance for Parkinson disease diagnosis.     

Diagnosis of Chronic Kidney Disease Based on Support Vector Machine by Feature Selection Methods

As Chronic Kidney Disease progresses slowly, early detection and effective treatment are the only cure to reduce the mortality rate. Machine learning techniques are gaining significance in medical diagnosis because of their classification ability with high accuracy rates. The accuracy of classification algorithms depend on the use of correct feature selection algorithms to reduce the dimension of datasets. In this study, Support Vector Machine classification algorithm was used to diagnose Chronic Kidney Disease. To diagnose the Chronic Kidney Disease, two essential types of feature selection methods namely, wrapper and filter approaches were chosen to reduce the dimension of Chronic Kidney Disease dataset. In wrapper approach, classifier subset evaluator with greedy stepwise search engine and wrapper subset evaluator with the Best First search engine were used. In filter approach, correlation feature selection subset evaluator with greedy stepwise search engine and filtered subset evaluator with the Best First search engine were used. The results showed that the Support Vector Machine classifier by using filtered subset evaluator with the Best First search engine feature selection method has higher accuracy rate (98.5%) in the diagnosis of Chronic Kidney Disease compared to other selected methods.     

基于主动被动近邻算法的肺癌计算机辅助诊断

CT图像的肺癌计算机辅助诊断一般可分为三大模块,即：CT的图像处理、肺肿块的特征提取,以及使用智能分类器对肿块的分类和诊断.研究主要实现计算机CT图像辅助诊断的最后一个模块的计算机化,为医生在最后诊断环节上提供一些参考信息.项目首先需要收集病例,当拿到一个病例,并通过医生辨认出结节后,医生再提供辨认出结节的特征,包括大小、数目、毛刺、分叶等16个.研究共收集到204个恶性病例和46个良性病例,共250个病例,并确定了它们的特征.这些特征通过翻译,转换为一组数字信号,即以数字向量来表示病例.把250个向量输入到新开发的主动被动近邻算法中进行分类诊断,结果显示,对204个恶性病例和46个良性病例进行分类的准确度在90%以上.     

A New Approach to Diagnosing of Importance Degree of Obstructive Sleep Apnea Syndrome: Pairwise AIRS and Fuzzy-AIRS Classifiers

Artificial Immune Recognition System (AIRS) classifier algorithm is robust and effective in medical dataset classification applications such as breast cancer, heart disease, diabetes diagnosis etc. In our previous work, we have proposed a new resource allocation mechanism called fuzzy resource allocation in AIRS algorithm both to improve the classification accuracy and to decrease the computation time in classification process. Here, AIRS and Fuzzy-AIRS classifier algorithms and one against all approach have been combined to increase the classification accuracy of obstructive sleep apnea syndrome (OSAS) that is an important disease that influences both the right and the left cardiac ventricle. The OSAS dataset consists of four classes including of normal (25 subjects), mild OSAS (AHI (Apnea and Hypoapnea Index) =5-15 and 14 subjects), moderate OSAS (AHI < 15-30 and 18 subjects), and serious OSAS (AHI > 30 and 26 subjects). In the extracting of features that is characterized the OSAS disease, the clinical features obtained from Polysomnography used diagnostic tool for obstructive sleep apnea in patients clinically suspected of suffering from this disease have been used. The used clinical features are Arousals Index (ARI), Apnea and Hypoapnea Index (AHI), SaO2 minimum value in stage of REM, and Percent Sleep Time (PST) in stage of SaO2 intervals bigger than 89%. Even though AIRS and Fuzzy-AIRS classifiers have been used in the classifying multi-class problems, theirs classification performances are low in the case of multi-class classification problems. Therefore, we have used two classes in AIRS and Fuzzy-AIRS classifiers by means of one against all approach instead of four classes comprising the healthy subjects, mild OSAS, moderate OSAS, and serious OSAS. We have applied the AIRS, Fuzzy-AIRS, AIRS with one against all approach (Pairwise AIRS), and Fuzzy-AIRS with one against all approach (Pairwise Fuzzy-AIRS) to OSAS dataset. The obtained classification accuracies are 63.41%, 63.41%, 87.19%, and 84.14% using the above methods for 200 resources, respectively. These results show that the best method for diagnosis of OSAS is the combination of AIRS and one against all approach (Pairwise AIRS).     

基于核谱回归与随机森林的脑电情感识别

利用DEAP情感数据库研究脑电的情感识别问题。首先,使用聚类算法确定情感状态的目标类别;然后,比较了两种不同的特征提取方法：一种是小波变换,另一种是非线性动力学,并研究了基线特征对情感分类效果的影响;最后,研究了5种特征降维方法对分类性能的影响,同时比较了4种不同分类器的性能,包括K-最近邻（KNN）、朴素贝叶斯（NB）、支持向量机（SVM）和随机森林（RF）。研究结果表明,核谱回归（KSR）降维方法和随机森林分类器的组合对情感状态的分类效果最好。通过对脑区与情感关系的研究发现,只使用部分脑区的少量电极也可以达到90%的分类准确度,这些电极主要分布在额叶皮层。     

Luminance Sticker Based Facial Expression Recognition Using Discrete Wavelet Transform for Physically Disabled Persons

Developing tools to assist physically disabled and immobilized people through facial expression is a challenging area of research and has attracted many researchers recently. In this paper, luminance stickers based facial expression recognition is proposed. Recognition of facial expression is carried out by employing Discrete Wavelet Transform (DWT) as a feature extraction method. Different wavelet families with their different orders (db1 to db20, Coif1 to Coif 5 and Sym2 to Sym8) are utilized to investigate their performance in recognizing facial expression and to evaluate their computational time. Standard deviation is computed for the coefficients of first level of wavelet decomposition for every order of wavelet family. This standard deviation is used to form a set of feature vectors for classification. In this study, conventional validation and cross validation are performed to evaluate the efficiency of the suggested feature vectors. Three different classifiers namely Artificial Neural Network (ANN), k-Nearest Neighborhood (kNN) and Linear Discriminant Analysis (LDA) are used to classify a set of eight facial expressions. The experimental results demonstrate that the proposed method gives very promising classification accuracies.     

A New Approach to Detection of ECG Arrhythmias: Complex Discrete Wavelet Transform Based Complex Valued Artificial Neural Network

This paper presents the new automated detection method for electrocardiogram (ECG) arrhythmias. The detection system is implemented with integration of complex valued feature extraction and classification parts. In feature extraction phase of proposed method, the feature values for each arrhythmia are extracted using complex discrete wavelet transform (CWT). The aim of using CWT is to compress data and to reduce training time of network without decreasing accuracy rate. Obtained complex valued features are used as input to the complex valued artificial neural network (CVANN) for classification of ECG arrhythmias. Ten types of the ECG arrhythmias used in this study were selected from MIT-BIH ECG Arrhythmias Database. Two different classification tasks were performed by the proposed method. In first classification task (CT-1), whether CWT-CVANN can distinguish ECG arrhythmia from normal sinus rhythm was examined one by one. For this purpose, nine classifiers were improved and executed in CT-1. Second classification task (CT-2) was to recognize ten different ECG arrhythmias by one complex valued classifier with ten outputs. Training and test sets were formed by mixing the arrhythmias in a certain order. Accuracy rates were obtained as 99.8% (averaged) and 99.2% for the first and second classification tasks, respectively. All arrhythmias in training and test phases were classified correctly for both of the classification tasks.     

Study on Contribution of Biological Interpretable and Computer-Aided Features Towards the Classification of Childhood Medulloblastoma Cells

Diagnosis and Prognosis of brain tumour in children is always a critical case. Medulloblastoma is that subtype of brain tumour which occurs most frequently amongst children. Post-operation, the classification of its subtype is most vital for further clinical management. In this paper a novel approach of pathological subtype classification using biological interpretable and computer-aided textural features is forwarded. The classifier for accurate features prediction is built purely on the feature set obtained by segmentation of the ground truth cells from the original histological tissue images, marked by an experienced pathologist. The work is divided into five stages: marking of ground truth, segmentation of ground truth images, feature extraction, feature reduction and finally classification. Kmeans colour segmentation is used to segment out the ground truth cells from histological images. For feature extraction we used morphological, colour and textural features of the cells followed by feature reduction using Principal Component Analysis. Finally both binary and multiclass classification is done using Support Vector Method (SVM). The classification was compared using six different classifiers and performance was evaluated employing five-fold cross-validation technique. The accuracy achieved for binary and multiclass classification before applying PCA were 95.4 and 62.1% and after applying PCA were 100 and 84.9% respectively. The run-time analysis are also shown. Results reveal that this technique of cell level classification can be successfully adopted as architectural view can be confusing. Moreover it conforms substantially to the pathologist’s point of view regarding morphological and colour features, with the addition of computer assisted texture feature.     

Automated Screening of Arrhythmia Using Wavelet Based Machine Learning Techniques

Arrhythmia is one of the preventive cardiac problems frequently occurs all over the globe. In order to screen such disease at early stage, this work attempts to develop a system approach based on registration, feature extraction using discrete wavelet transform (DWT), feature validation and classification of electrocardiogram (ECG). This diagnostic issue is set as a two-class pattern classification problem (normal sinus rhythm versus arrhythmia) where MIT-BIH database is considered for training, testing and clinical validation. Here DWT is applied to extract multi-resolution coefficients followed by registration using Pan Tompkins algorithm based R point detection. Moreover, feature space is compressed using sub-band principal component analysis (PCA) and statistically validated using independent sample t-test. Thereafter, the machine learning algorithms viz., Gaussian mixture model (GMM), error back propagation neural network (EBPNN) and support vector machine (SVM) are employed for pattern classification. Results are studied and compared. It is observed that both supervised classifiers EBPNN and SVM lead to higher (93.41% and 95.60% respectively) accuracy in comparison with GMM (87.36%) for arrhythmia screening.     

Adaptive Neuro-Fuzzy Inference Systems for Automatic Detection of Breast Cancer

This paper intends to an integrated view of implementing adaptive neuro-fuzzy inference system (ANFIS) for breast cancer detection. The Wisconsin breast cancer database contained records of patients with known diagnosis. The ANFIS classifiers learned how to differentiate a new case in the domain by given a training set of such records. The ANFIS classifier was used to detect the breast cancer when nine features defining breast cancer indications were used as inputs. The proposed ANFIS model combined the neural network adaptive capabilities and the fuzzy logic qualitative approach. Some conclusions concerning the impacts of features on the detection of breast cancer were obtained through analysis of the ANFIS. The performance of the ANFIS model was evaluated in terms of training performances and classification accuracies and the results confirmed that the proposed ANFIS model has potential in detecting the breast cancer.     

Classification of Speech Dysfluencies Using LPC Based Parameterization Techniques

The goal of this paper is to discuss and compare three feature extraction methods: Linear Predictive Coefficients (LPC), Linear Prediction Cepstral Coefficients (LPCC) and Weighted Linear Prediction Cepstral Coefficients (WLPCC) for recognizing the stuttered events. Speech samples from the University College London Archive of Stuttered Speech (UCLASS) were used for our analysis. The stuttered events were identified through manual segmentation and were used for feature extraction. Two simple classifiers namely, k-nearest neighbour (kNN) and Linear Discriminant Analysis (LDA) were employed for speech dysfluencies classification. Conventional validation method was used for testing the reliability of the classifier results. The study on the effect of different frame length, percentage of overlapping, value of ã in a first order pre-emphasizer and different order p were discussed. The speech dysfluencies classification accuracy was found to be improved by applying statistical normalization before feature extraction. The experimental investigation elucidated LPC, LPCC and WLPCC features can be used for identifying the stuttered events and WLPCC features slightly outperforms LPCC features and LPC features.     

基于多模态特征和多分类器融合的前列腺癌放疗中直肠并发症预测模型

目的为了评估前列腺癌放疗中直肠并发症的预后,提出一种新型的基于多模态特征及多分类器融合的预测模型。方法 本研究回顾性收集了44例接受外照射放疗的前列腺癌患者的临床数据,从中提取临床参数特征和剂量学特征两种不同模态特 征,并利用筛选后的特征子集分别对五种基分类器（向量机、决策树、K近邻、随机森林和XGBoost）进行训练得到不同模态下的 多个基分类器,然后采用一种新型的基于多准则决策的权重分配算法依次对同一模态下多个基分类器以及不同模态信息的模 型进行融合,最终实现基于多模态特征及多分类器融合的预测模型。本研究采用五折交叉验证方法和ROC曲线下所围面积 （AUC）、准确率、灵敏度和特异性四种评价指标来定量评价所提出的预测模型。此外,本研究还将所提出模型与不同特征选择 方法、不同的权重分配算法、基于单模态单分类器的模型,以及两种使用其他融合方法的集成模型进行定量比较。结果五折交 叉验证结果显示本研究所提出的模型的平均准确率、AUC、特异性、灵敏度分别为：0.78、0.83、0.79、0.76。结论与基于单模态单 分类器的模型以及其他融合模型相比,本文所提出的基于多模态特征及多分类器融合的模型能更准确地预测前列腺癌放疗中 的直肠并发症。     

Measuring Saliency of Features Using Signal-to-noise Ratios for Detection of Electrocardiographic Changes in Partial Epileptic Patients

Medical diagnostic accuracies can be improved when the pattern is simplified through representation by important features. The feature vector, which is comprised of the set of all features used to describe a pattern, is a reduced-dimensional representation of that pattern. By identifying a set of salient features, the noise in a classification model can be reduced, resulting in more accurate classification. In this study, a signal-to-noise ratio (SNR) saliency measure was employed to determine saliency of input features of probabilistic neural networks (PNNs) used in classification of two types of electrocardiogram (ECG) beats (normal and partial epilepsy). In order to extract features representing the ECG signals, discrete wavelet transform was used. The PNNs used in the ECG signals classification were trained for the SNR screening method. The application results of the SNR screening method to the ECG signals demonstrated that classification accuracies of the PNNs with salient input features are higher than that of the PNNs with salient and non-salient input features.     

The effect of electronic medical record application on the length of stay in a Chinese general hospital: a department- and disease-focused interrupted time-series study

Liver-shape analysis and quantification is still an open research subject. Quantitative assessment of the liver is of clinical importance in various procedures such as diagnosis, treatment planning, and monitoring. Liver-shape classification is of clinical importance for corresponding intra-subject and inter-subject studies. In this research, we propose a novel technique for the liver-shape classification based on Spherical Harmonics (SH) coefficients. The proposed liver-shape classification algorithm consists of the following steps: (a) Preprocessing, including mesh generation and simplification, point-set matching, and surface to template alignment; (b) Liver-shape parameterization, including surface normalization, SH expansion followed by parameter space registration; (c) Feature selection and classification, including frequency based feature selection, feature space reduction by Principal Component Analysis (PCA), and classification. The above multi-step approach is novel in the sense that registration and feature selection for liver-shape classification is proposed and implemented and validated for the normal and diseases liver in the SH domain. Various groups of SH features after applying conventional PCA and/or ordered by p-value PCA are employed in two classifiers including Support Vector Machine (SVM) and k-Nearest Neighbor (k-NN) in the presence of 101 liver data sets. Results show that the proposed specific features combined with classifiers outperform existing liver-shape classification techniques that employ liver surface information in the spatial domain. In the available data sets, the proposed method can successful classify normal and diseased livers with a correct classification rate of above 90 %. The performed result in average is higher than conventional liver-shape classification method. Several standard metrics such as Leave-one-out cross-validation and Receiver Operating Characteristic (ROC) analysis are employed in the experiments and confirm the effectiveness of the proposed liver-shape classification with respect to conventional techniques.     

Applying Data Mining Techniques to Improve Breast Cancer Diagnosis

In the field of breast cancer research, and more than ever, new computer aided diagnosis based systems have been developed aiming to reduce diagnostic tests false-positives. Within this work, we present a data mining based approach which might support oncologists in the process of breast cancer classification and diagnosis. The present study aims to compare two breast cancer datasets and find the best methods in predicting benign/malignant lesions, breast density classification, and even for finding identification (mass / microcalcification distinction). To carry out these tasks, two matrices of texture features extraction were implemented using Matlab, and classified using data mining algorithms, on WEKA. Results revealed good percentages of accuracy for each class: 89.3 to 64.7 % - benign/malignant; 75.8 to 78.3 % - dense/fatty tissue; 71.0 to 83.1 % - finding identification. Among the different tests classifiers, Naive Bayes was the best to identify masses texture, and Random Forests was the first or second best classifier for the majority of tested groups.     

Framework of Computer Aided Diagnosis Systems for Cancer Classification Based on Medical Images

Early detection of cancer can increase patients’ survivability and treatment options. Medical images such as Mammogram, Ultrasound, Magnetic Resonance Imaging, and microscopic images are the common method for cancer diagnosis. Recently, computer-aided diagnosis (CAD) systems have been used to help physicians in cancer diagnosis so that the diagnosis accuracy can be improved. CAD can help in decreasing missed cancer lesions due to physician fatigue, reducing the burden of workload and data overloading, and decreasing variability of inter- and intra-readers of images. In this research, a framework of CAD systems for cancer diagnosis based on medical images has been proposed. The proposed work helps physicians in detection of suspicion regions using different medical images modalities and in classifying the detected suspicious regions as normal or abnormal with the highest possible accuracy. The proposed framework of CAD system consists of four stages which are: preprocessing, segmentation of regions of interest, feature extraction and selection, and finally classification. In this research, the framework has been applied on blood smear images to diagnose the cases as normal or abnormal for Acute Lymphoblastic Leukemia (ALL) cases. Ant Colony Optimization (ACO) has been used to select the subsets of features from the features extracted from segmented cell parts which can maximize the classification performance as possible. Different classifiers which are Decision Tree (DT), K-nearest neighbor (K-NN), Naïve Bayes (NB), and Support Vector Machine (SVM) have been applied. The framework has been yielding promising results which reached 96.25% accuracy, 97.3% sensitivity, and 95.35% specificity using decision tree classifier.     

Incorporating EBO-HSIC with SVM for Gene Selection Associated with Cervical Cancer Classification

Microarray technology is utilized by the biologists, in order to compute the expression levels of thousands of genes. Cervical cancer classification utilizing gene expression data depends upon conventional supervised learning methods, wherein only labeled data could be used for learning. The previous methodologies had problem with appropriate feature selection as well as accurateness of classification outcomes. So, the entire performance of the cancer classification is decreased meaningfully. With the aim of overcoming the aforesaid problems, Enhanced Bat Optimization Algorithm with Hilbert-Schmidt Independence Criterion (EBO-HSIC) and Support Vector Machine (SVM) algorithm is presented in this research for identifying the specific genes from the gene expression dataset that belongs to cancer microarray. This proposed system contains phases of instance normalization, module detection, gene selection and classification. By Fuzzy C Means (FCM) algorithm, the normalization is performed for eliminating the inappropriate features from the gene dataset. Meanwhile, for effective feature selection, the EBO algorithm is used for producing more appropriate features via improved objective function values. For determining a subset of the most informative genes utilizing a rapid as well as scalable bat algorithm, this proposed method focuses on measuring the dependence amid Differentially Expressed Genes (DEGs) as well as the gene significance. The algorithm is dependent upon the HSIC and was partially enthused by EBO. With the help of SVM classifier, these gene features are categorized very precisely. Experimentation outcomes demonstrate that the presented EBO with SVM algorithm confirms a clear-cut classification performance for the given gene expression datasets. Hence the result provides higher performance by launching EBO with SVM algorithm to obtain greater accuracy, recall, precision, f-measure and less time complexity more willingly than the previous techniques.     

基于增强CT影像组学预测非肌层浸润性膀胱癌的病理分级

目的 探讨基于增强CT影像组学建立的非肌层浸润性膀胱癌（non-muscle-invasive bladder cancer，NMIBC）病理分级预测模型的诊断价值。方法 回顾性分析2015年1月至2018年12月嘉兴市第二医院病理确诊的81例NMIBC患者的临床资料，患者术前接受增强CT检查，收集其皮髓期和实质期影像资料，对膀胱肿瘤轮廓进行勾勒，提取一阶变量、纹理变量、形状特征、小波变换变量，总计1980个特征变量。采用最大相关最小冗余（max-relevance and min-redundancy，mRMR）算法与最小绝对收缩和选择算子（least absolute shrinkage and selection operator，LASSO）算法进行特征选择，最后利用多种机器学习算法结合有意义的特征变量建立预测模型，用于比较其预测NMIBC病理分级的敏感度、特异性和准确率。结果 运用mRMR联合LASSO筛选出19个特征变量，使用K近邻分类（K-nearest neighbor，KNN）、神经网络（neural networks，NNET）、随机森林（random forest，RF）、支持向量机（support vector machines，SVM）4种机器学习算法建立模型并验证。4种模型建立成功且结果相对一致，其中RF模型表现相对稳定，在验证集中准确率为91.4%。在测试集中准确率为70.0%。结论 通过术前增强CT影像组学结合机器学习算法可精准预测NMIBC病理分级，对推动膀胱癌个性化治疗具有科学意义。     

An Intelligent System for Lung Cancer Diagnosis Using a New Genetic Algorithm Based Feature Selection Method

In these days, there are many various diseases, whose diagnosis is very hardly. Breast cancer is one of these type diseases. In this paper, accuracy diagnosis of normal, benign, and malign breast cancer cell were found by combining mean success rates Jensen Shannon, Hellinger, and Triangle measure which connected with each other. In this article, an diagnostic method based on feature extraction Discrete Wavelet Entropy Energy (DWEE) and Jensen Shannon, Hellinger, Triangle Measure (JHT) Classifier for diagnosis of breast cancer. This diagnosis method is called as DWEE—JHT this paper. With this diagnosis method have found optimal feature subset using discrete wavelet transform feature extraction. Then these convenient features are given to Jensen Shannon, Hellinger, Triangle Measure (JHT) classifier. Then, between classifiers which are Jensen Shannon, Hellinger, and triangle distance have been validated the measures via relationships. Afterwards, breast cancer cells are classified using Jensen Shannon, Hellinger, and Triangle distance. Mean success rate of 16 feature vector with Jensen Shannon classifier is found % 97.81. Mean success rate of 16 feature vector with Hellinger classifier is found % 97.75. Mean success rate of 16 feature vector with Triangle classifier is found % 97.87. By averaging of results obtained from these 3 classifiers are found as 97.81 % average of accuracy diagnosis.