基于脑电的情绪识别研究综述

情绪是综合了人的感觉、思想和行为的一种状态,在人与人的交流中发挥着重要作用。情绪识别是通过获取人的生理或非生理信号对人的情绪状态进行自动辨别,以实现更加友好和自然的人-机交互。基于脑电的识别方法是一种常用且有效的情绪识别方式。文中从脑电获取及预处理、特征提取和特征选择、情绪模式的学习和分类等几个方面,介绍了基于脑电的情绪识别的研究进展、应用前景以及目前存在的主要问题。     

基于深浅特征融合的深度卷积残差网络的脑电情绪识别模型

基于脑电信号的智能情绪识别系统具有便携性、高时间分辨率、实时性等特点,能够在健康、娱乐、教育等多个领域实现情绪监控与调节的应用.但由于脑电信号的非平稳性和个体差异性,传统分类器难以深入提取脑电信号中潜在的与情绪语义相关的特征.为了有效地提取脑电特征,提高脑电-情绪识别的准确性,提出一种新型的基于深浅特征融合的深度卷积残...     

Neural network for photoplethysmographic respiratory rate monitoring

The reflection mode photoplethysmographic (PPG) signal was studied with the aim of determining respiratory rate. The PPG signal includes respiratory synchronous components, seen as frequency modulation of the heart rate (respiratory sinus arrhythmia), amplitude modulation of the cardiac pulse and respiratory-induced intensity variations (RIIVs) in the PPG baseline. PPG signals were recorded from the foreheads of 15 healthy subjects. From these signals, the systolic wavefrm diastolic waveform, respiratory sinus arrhythmia, pulse amplitude and RIIVs were extracted. Using basic algorithms, the rates of false positive and false negative detection of breaths were calculated separately for each of the five components. Furthermore, a neural network was assessed in a combined pattern recognition approach. The error rates (sum of false positive and false negative breath detections) for the basic algorithms ranged from 9.7% (pulse amplitude) to 14.5% (systolic waveform). The corresponding values for the neural network analysis were 9.5–9.6%. These results suggest the use of a combined PPG system for simultaneous monitoring of respiratory rate and arterial oxygen saturation (pulse oximetry).     

Statistics over features for internal carotid arterial disorders detection

The objective of the present study is to extract the representative features of the internal carotid arterial (ICA) Doppler ultrasound signals and to present the accurate classification model. This paper presented the usage of statistics over the set of the extracted features (Lyapunov exponents and the power levels of the power spectral density estimates obtained by the eigenvector methods) in order to reduce the dimensionality of the extracted feature vectors. Since classification is more accurate when the pattern is simplified through representation by important features, feature extraction and selection play an important role in classifying systems such as neural networks. Mixture of experts (ME) and modified mixture of experts (MME) architectures were formulated and used as basis for detection of arterial disorders. Three types of ICA Doppler signals (Doppler signals recorded from healthy subjects, subjects having stenosis, and subjects having occlusion) were classified. The classification results confirmed that the proposed ME and MME has potential in detecting the arterial disorders.     

An intelligent system for diagnosis of the heart valve diseases with wavelet packet neural networks

In this paper, an intelligent system is presented for interpretation of the Doppler signals of the heart valve diseases based on the pattern recognition. This paper especially deals with combination of the feature extraction and classification from measured Doppler signal waveforms at the heart valve using the Doppler Ultrasound. Because of this, a wavelet packet neural network model developed by us is used. The model consists of two layers: wavelet and multi-layer perceptron. The wavelet layer is used for adaptive feature extraction in the time-frequency domain and is composed of wavelet packet decomposition and wavelet packet entropy. The multi-layer perceptron used for classification is a feed-forward neural network. The performance of the developed system has been evaluated in 215 samples. The test results showed that this system was effective in detecting Doppler heart sounds. The correct classification rate was about 94% for abnormal and normal subjects.     

Feature-based classification of myoelectric signals using artificial neural networks

A pattern classification system, designed to separate myoelectric signal records based on contraction tasks, is described. The amplitude of the myoelectric signal during the first 200 ms following the onset of a contraction has a non-random structure that is specific to the task performed. This permits the application of advanced pattern recognition techniques to separate these signals. The pattern classification system described consists of a spectrographic preprocessor, a feature extraction stage and a classifier stage. The preprocessor creates a spectrogram by generating a series of power spectral densities over adjacent time segments of the input signal. The feature extraction stage reduces the dimensionality of the spectrogram by identifying features that correspond to subtle underlying structures in the input signal data. This is realised by a self-organising artificial neural network (ANN) that performs an advanced statistical analysis procedure known as exploratory projection pursuit. The extracted features are then classified by a supervised-learning ANN. An evaluation of the system, in terms of system performance and the complexity of the ANNs, is presented.     

Analysis of EEG signals by combining eigenvector methods and multiclass support vector machines

A new approach based on the implementation of multiclass support vector machine (SVM) with the error correcting output codes (ECOC) is presented for classification of electroencephalogram (EEG) signals. In practical applications of pattern recognition, there are often diverse features extracted from raw data which needs recognizing. Decision making was performed in two stages: feature extraction by eigenvector methods and classification using the classifiers trained on the extracted features. The aim of the study is classification of the EEG signals by the combination of eigenvector methods and multiclass SVM. The purpose is to determine an optimum classification scheme for this problem and also to infer clues about the extracted features. The present research demonstrated that the eigenvector methods are the features which well represent the EEG signals and the multiclass SVM trained on these features achieved high classification accuracies.     

Assessment of four statistical pattern recognition techniques to assist in obstructive sleep apnoea diagnosis from nocturnal oximetry

The aim of this study is to assess the utility of traditional statistical pattern recognition techniques to help in obstructive sleep apnoea (OSA) diagnosis. Classifiers based on quadratic (QDA) and linear (LDA) discriminant analysis, K-nearest neighbours (KNN) and logistic regression (LR) were evaluated. Spectral and nonlinear input features from oxygen saturation (SaO₂) signals were applied. A total of 187 recordings from patients suspected of suffering from OSA were available. This initial dataset was divided into training set (74 subjects) and test set (113 subjects). Twelve classification algorithms were developed by applying QDA, LDA, KNN and LR with spectral features, nonlinear features and combination of both groups. The performance of each algorithm was measured on the test set by means of classification accuracy and receiver operating characteristic (ROC) analysis. QDA, LDA and LR showed better classification capability than KNN. The classifier based on LDA with spectral features provided the best diagnostic ability with an accuracy of 87.61% (91.05% sensitivity and 82.61% specificity) and an area under the ROC curve (AROC) of 0.925. The proposed statistical pattern recognition techniques could be applied as an OSA screening tool.     

Usage of eigenvector methods to improve reliable classifier for Doppler ultrasound signals

A new approach based on the implementation of the automated diagnostic systems for Doppler ultrasound signals classification with the features extracted by eigenvector methods is presented. In practical applications of pattern recognition, there are often diverse features extracted from raw data which needs recognizing. Because of the importance of making the right decision, the present work is carried out for searching better classification procedures for the Doppler ultrasound signals. Decision making was performed in two stages: feature extraction by the eigenvector methods and classification using the classifiers trained on the extracted features. The aim of the study is classification of the Doppler ultrasound signals by the combination of eigenvector methods and the classifiers. The present research demonstrated that the power levels of the power spectral density (PSD) estimates obtained by the eigenvector methods are the features which well represent the Doppler ultrasound signals and the probabilistic neural networks (PNNs), recurrent neural networks (RNNs) trained on these features achieved high classification accuracies.     

基于CNN算法的稳态体感诱发电位的特征识别

脑-机接口研究可为瘫痪病人的康复带来一种新的治疗方法。已有研究表明对手指或者正中神经施加一定频率的体感刺激,会引发相同频率且具有空间特异性的稳态体感诱发电位。为优化基于稳态体感诱发电位的脑-机接口的性能,通过快速傅里叶变换寻找12个健康被试的个人左手特定共振频率,采用事件相关谱扰动进行时频分析,检测其稳态体感诱发电位信号。基于共振频率对实验诱发的脑电信号进行1 Hz带通滤波,获得特定频带的数据,采用卷积神经网络(CNN)学习算法对其进行分类,并与采用共空间模式和支持向量机的特征提取及特征分类的方法(CSP+SVM)进行比较。所有被试的结果显示:基于共振频率滤波方法,采用CNN学习算法获得的离线分类准确率均高于85%,并且CNN学习算法的分类准确率显著性优于CSP+SVM的分类准确率(91.8%±5.9% vs 77.4%±8.5%,P<0.05)。因此,在基于稳态体感诱发电位的脑机接口的特征识别中,CNN学习算法相比传统使用的机器学习分类算法(如共空间模式+支持向量机)能够显著提升分类准确率,提高脑机接口的整体性能。     

Spatio-spectral filters for low-density surface electromyographic signal classification

In this paper, we proposed to utilize a novel spatio-spectral filter, common spatio-spectral pattern (CSSP), to improve the classification accuracy in identifying intended motions based on low-density surface electromyography (EMG). Five able-bodied subjects and a transradial amputee participated in an experiment of eight-task wrist and hand motion recognition. Low-density (six channels) surface EMG signals were collected on forearms. Since surface EMG signals are contaminated by large amount of noises from various sources, the performance of the conventional time-domain feature extraction method is limited. The CSSP method is a classification-oriented optimal spatio-spectral filter, which is capable of separating discriminative information from noise and, thus, leads to better classification accuracy. The substantially improved classification accuracy of the CSSP method over the time-domain and other methods is observed in all five able-bodied subjects and verified via the cross-validation. The CSSP method can also achieve better classification accuracy in the amputee, which shows its potential use for functional prosthetic control.     

Feature dimensionality reduction for myoelectric pattern recognition: A comparison study of feature selection and feature projection methods

This study investigates the effect of the feature dimensionality reduction strategies on the classification of surface electromyography (EMG) signals toward developing a practical myoelectric control system. Two dimensionality reduction strategies, feature selection and feature projection, were tested on both EMG feature sets, respectively. A feature selection based myoelectric pattern recognition system was introduced to select the features by eliminating the redundant features of EMG recordings instead of directly choosing a subset of EMG channels. The Markov random field (MRF) method and a forward orthogonal search algorithm were employed to evaluate the contribution of each individual feature to the classification, respectively. Our results from 15 healthy subjects indicate that, with a feature selection analysis, independent of the type of feature set, across all subjects high overall accuracies can be achieved in classification of seven different forearm motions with a small number of top ranked original EMG features obtained from the forearm muscles (average overall classification accuracy >95% with 12 selected EMG features). Compared to various feature dimensionality reduction techniques in myoelectric pattern recognition, the proposed filter-based feature selection approach is independent of the type of classification algorithms and features, which can effectively reduce the redundant information not only across different channels, but also cross different features in the same channel. This may enable robust EMG feature dimensionality reduction without needing to change ongoing, practical use of classification algorithms, an important step toward clinical utility.     

基于多通道线性描述符的脑-机接口分类算法的研究

脑电信号的特征提取是脑—机接口(BCI)中的一个关键部分,对提高分类正确率和信息传输率起着决定性的作用。本研究利用多通道线性描述符提取脑电信号的分类特征信息,将三个描述符单独和联合地施加于三个感兴趣的电极子集,导出12个特征矢量。五个受试参加了一个在线反馈BCI实验。实验期间他们被要求想象左手或右手运动,记录的脑电图数据用于离线分析。对来自7导和11导两个电极子集的8个特征矢量,五个受试平均的分类精度在89%和93.5%之间,而最好的分类精度在85%与99.9%之间。比较基于描述符的特征与基于自回归(AR)模型的特征分类性能,结果表明多通道线性描述符是一种有效的特征提取方法。使用该方法提取特征时,理想的电极数应在7与11之间。     

基于表面肌电信号的手势识别与分析

目的 研究利用前臂及手部表面肌电( surface electromyography,sEMG)信号进行手势识别的方法,以及不同 手势下拇指、食指的关节角度,探讨 sEMG 信号控制外骨骼手的可行性。 方法 采集 20 名健康右利手受试者右侧 前臂及手部 6 块肌肉 sEMG 信号。 提取 sEMG 信号的时域特征值,对比人工神经网络( artificial neural network, ANN)、K-近邻(K-nearest neighbor, KNN)、决策树(decision tree, DT)、随机森林( random forest, RF)和支持向量机(support vector machine, SVM)等多种分类器对 6 种日常手势进行识别。 同时,采用 Vicon 摄像机跟踪系统捕捉右手拇指、食指运动轨迹,计算拇指、食指关节角度。 结果 利用前臂及手部 sEMG 信号可以实现 6 种手势的模式识别,其中 ANN 分类器的分类预测效果最好,测试集预测精度可达 97. 9% ,Kappa 系数可达 0. 975。 同时,计算得到不同手势下拇指、食指的关节角度,并进行不同手势下关节角度相关性分析。 结论 利用前臂及手部 sEMG 信号进 行手势识别,能够实现具有几乎完全一致的分类预测结果。 研究结果证明了 sEMG 信号手势识别应用于外骨骼手 控制的可行性。     

Phonocardiographic Signal Analysis Method Using a Modified Hidden Markov Model

Auscultation is an important diagnostic indicator for cardiovascular analysis. Heart sound classification and analysis play an important role in the auscultative diagnosis. This study uses a combination of Mel-frequency cepstral coefficient (MFCC) and hidden Markov model (HMM) to efficiently extract the features for pre-processed heart sound cycles for the purpose of classification. A system was developed for the interpretation of heart sounds acquired by phonocardiography using pattern recognition. The task of feature extraction was performed using three methods: time-domain feature, short-time Fourier transforms (STFT) and MFCC. The performances of these feature extraction methods were then compared. The results demonstrated that the proposed method using MFCC yielded improved interpretative information. Following the feature extraction, an automatic classification process was performed using HMM. Satisfactory classification results (sensitivity > or =0.952; specificity > or =0.953) were achieved for normal subjects and those with various murmur characteristics. These results were based on 1398 datasets obtained from 41 recruited subjects and downloaded from a public domain. Constituents characteristics of heart sounds were also evaluated using the proposed system. The findings herein suggest that the described system may have the potential to be used to assist doctors for a more objective diagnosis.     

基于脑肌电融合的混合脑机接口研究

动作模式识别是脑机接口技术的核心内容之一。针对目前脑机接口动作识别模式单一、识别率低等问题,基于混合脑机接口思想,提出一种脑电和肌电特征融合策略,可实现单侧肢体不同动作模式的有效分类,进而可用于脑机接口技术。同步采集9名健康受试者单侧手腕屈/伸两种动作模式下的脑电信号和表面肌电信号,分别提取脑电信号事件相关去同步化特征和表面肌电信号的积分肌电值特征,构建基于支持向量机和粒子群优化算法的脑肌电融合及运动模式识别模型,通过调整“特征融合系数”来实现动作模式最优分类,从而提高模式识别的准确率;进一步通过递降健康人的肌电信号幅值来模拟患者和运动疲劳状态下的肌电信号,验证所提出方法对动作模式识别的有效性。实验结果表明,基于脑肌电融合特征的动作模式识别率(98%)比单纯依靠脑电特征的识别率(73%)提高25%;在运动疲劳状态下,基于脑肌电融合特征的识别率稳定在80%以上,比单纯依靠肌电特征的识别率提高14%。可见,脑肌电融合策略能提高动作模式识别的准确性和鲁棒性,为混合脑机接口技术提供条件。     

EMG feature assessment for myoelectric pattern recognition and channel selection: A study with incomplete spinal cord injury

Myoelectric pattern recognition with a large number of electromyogram (EMG) channels provides an approach to assessing motor control information available from the recorded muscles. In order to develop a practical myoelectric control system, a feature dependent channel reduction method was developed in this study to determine a small number of EMG channels for myoelectric pattern recognition analysis. The method selects appropriate raw EMG features for classification of different movements, using the minimum Redundancy Maximum Relevance (mRMR) and the Markov random field (MRF) methods to rank a large number of EMG features, respectively. A k-nearest neighbor (KNN) classifier was used to evaluate the performance of the selected features in terms of classification accuracy. The method was tested using 57 channels’ surface EMG signals recorded from forearm and hand muscles of individuals with incomplete spinal cord injury (SCI). Our results demonstrate that appropriate selection of a small number of raw EMG features from different recording channels resulted in similar high classification accuracies as achieved by using all the EMG channels or features. Compared with the conventional sequential forward selection (SFS) method, the feature dependent method does not require repeated classifier implementation. It can effectively reduce redundant information not only cross different channels, but also cross different features in the same channel. Such hybrid feature-channel selection from a large number of EMG recording channels can reduce computational cost for implementation of a myoelectric pattern recognition based control system.     

基于Local Jet变换空间纹理特征的肺结节分类方法

为了在纹理特征下改善肺结节良、恶性的模式识别,提出一种基于local jet变换空间的纹理特征提取方法。首先利用二维高斯函数的前三阶偏微分函数将结节原图像变换到local jet纹理图像空间,然后利用纹理描述子在该空间提取特征参数。以灰度值的前四阶矩和基于灰度共生矩阵的特征参数作为纹理描述子,分别提取结节原图像和变换后纹理图像的特征参数,以BP神经网络作为分类器,对同一纹理描述子下的2个不同图像空间的经核主成分分析优化后的特征参数集进行结节良、恶性分类。以157个肺结节(51个良性,106个恶性)作为实验数据进行对比实验,结果显示:两种纹理描述子基于local jet变换空间提取的特征参数分别获得82.69%和86.54%的分类正确率,较原图像空间提高6%～8%,同时AUC值提高约10%。实验结果表明,基于local jet变换空间提取的纹理特征可以有效地改善肺结节良、恶性的模式识别。     

Respiratory variations in the reflection mode photoplethysmographic signal. Relationships to peripheral venous pressure

Photoplethysmography (PPG) is a non-invasive optical way of measuring variations in blood volume and perfusion in the tissue, used in pulse oximetry for instance. Respiratory-induced intensity variations (RIIVs) in the PPG signal exist, but the physiological background is not fully understood. Respiration causes variations in the blood volume in the peripheral vascular bed. It was hypothesised that the filling of peripheral veins is one of the important factors involved. In 16 healthy subjects, the respiratory synchronous variations from a PPG reflection mode signal and the peripheral venous pressure (PVP) were recorded. Variations of tidal volume, respiratory rate and contribution from abdominal and thoracic muscles gave significant and similar amplitude changes in both RIIV and the respiratory variation of PVP (p<0.01). The highest amplitudes of both signals were found at the largest tidal volume, lowest respiratory rate and during mainly thoracic breathing, respectively. The coherence between PVP and RIIV signals was high, the median (quartile range) being 0.78 (0.42). Phase analysis showed that RIIV was usually leading PVP, but variations between subjects were large. Although respiratory-induced variations in PVP and PPG showed a close correlation in amplitude variation, a causal relationship between the signals could not be demonstrated.     

Ant colony optimization-based feature selection method for surface electromyography signals classification

This paper presented a new ant colony optimization (ACO) feature selection method to classify hand motion surface electromyography (sEMG) signals. The multiple channels of sEMG recordings make the dimensionality of sEMG feature grow dramatically. It is known that the informative feature subset with small size is a precondition for the accurate and computationally efficient classification strategy. Therefore, this study proposed an ACO based feature selection scheme using the heuristic information measured by the minimum redundancy maximum relevance criterion (ACO-mRMR). The experiments were conducted on ten subjects with eight upper limb motions. Two feature sets, i.e., time domain features combined with autoregressive model coefficients (TDAR) and wavelet transform (WT) features, were extracted from the recorded sEMG signals. The average classification accuracies of using ACO reduced TDAR and WT features were 95.45±2.2% and 96.08±3.3%, respectively. The principal component analysis (PCA) was also conducted on the same data sets for comparison. The average classification accuracies of using PCA reduced TDAR and WT features were 91.51±4.9% and 89.87±4.4%, respectively. The results demonstrated that the proposed ACO-mRMR based feature selection method can achieve considerably high classification rates in sEMG motion classification task and be applicable to other biomedical signals pattern analysis.