联合稀疏表示的医学图像融合及同步去噪

将多模态医学图像的互补信息有机地融合在一起,可为临床诊断和辅助治疗提供丰富信息和有效帮助。基于联合稀疏模型,提出一种联合稀疏表示的医学图像融合算法,当图像被噪声污染时,该算法在融合的同时兼有去噪功能。首先,将配准的源图像编纂成列向量并组成联合矩阵,通过在线字典学习算法(ODL)得到该矩阵的超完备字典;其次,利用该字典得到联合稀疏模型下的联合字典,之后利用最小角回归算法(LARS)计算基于联合字典的公共稀疏系数和各图像的独特稀疏系数,并根据“选择最大化”融合规则得到融合图像的稀疏系数;最后,根据融合系数和超完备字典重构融合图像。将该算法与3种经典算法比较,结果显示其主观上亮度失真和对比度失真较小,边缘纹理清晰,客观参数指标MI、Q^AB/F在无噪声干扰和有噪声干扰时的统计均值分别为：3.992 3、2.896 4、2.505 5和0.658、0.552 4、0.439 6,可以为临床诊断和辅助治疗提供有效帮助。     

基于稀疏表示和脉冲耦合神经网络的医学影像融合算法

为满足医学图像辅助诊断的需要,提出一种基于稀疏表示和脉冲耦合神经网络（PCNN）的CT和MR影像融合算法。首先,原始图像通过滑动窗方法构成联合矩阵,通过K-SVD算法得到该联合矩阵的冗余字典,采用正交匹配追踪算法得到该联合矩阵的稀疏系数;然后,根据稀疏系数的特点,采用脉冲耦合神经网络来融合稀疏系数;最后,由融合后的稀疏系数和冗余字典得到融合矩阵,反变换得到融合图像。实验图像为10组配准的脑部CT和MR图像,采用5种性能指标来评价融合图像的质量,同2种流行的医学影像融合算法进行比较,结果显示算法除Q^AB/F指数外,其他4项指标均为最优,Piella指数、Q^AB/F指数和BSSIM指数的均值分别为0.760 4、0.877 1和0.537 3,融合图像的纹理和边缘清晰,对比度高。主观和客观分析显示,算法的融合性能比较优越。     

基于多小波变换的医学图像融合算法研究

目的:研究一种基于多小波变换的医学影像融合的算法。方法:对已配准的PET图像和CT图像进行预滤波后进行多小波分解,对分解后的图像低频分量采用平均梯度法及高频分量采用自适应加权法的融合规则进行图像融合,经过多小波重构及后滤波得到融合图像。结果:融合图像通过结合源图像的信息,增加了更多的细节和纹理信息,从而得到了良好的融合效果。结论:实验证明,基于该算法,可以得到图像的最佳融合结果。     

Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain

Multimodality medical image fusion plays a vital role in diagnosis, treatment planning, and follow-up studies of various diseases. It provides a composite image containing critical information of source images required for better localization and definition of different organs and lesions. In the state-of-the-art image fusion methods based on nonsubsampled shearlet transform (NSST) and pulse-coupled neural network (PCNN), authors have used normalized coefficient value to motivate the PCNN-processing both low-frequency (LF) and high-frequency (HF) sub-bands. This makes the fused image blurred and decreases its contrast. The main objective of this work is to design an image fusion method that gives the fused image with better contrast, more detail information, and suitable for clinical use. We propose a novel image fusion method utilizing feature-motivated adaptive PCNN in NSST domain for fusion of anatomical images. The basic PCNN model is simplified, and adaptive-linking strength is used. Different features are used to motivate the PCNN-processing LF and HF sub-bands. The proposed method is extended for fusion of functional image with an anatomical image in improved nonlinear intensity hue and saturation (INIHS) color model. Extensive fusion experiments have been performed on CT-MRI and SPECT-MRI datasets. Visual and quantitative analysis of experimental results proved that the proposed method provides satisfactory fusion outcome compared to other image fusion methods.     

小波变换在医学图像融合中的应用

图像融合是医学图像处理中的关键技术。文中探讨了基于小波变换的医学图像融合方法。首先对源图像进行小波多尺度分解,然后采用基于窗口的融合规则进行小波系数融合,最后通过小波逆变换重构融合图像。实验结果表明,该方法能在保留原图像信息的情况下增强融合图像的细节信息。     

基于在线字典学习的医学图像特征提取与融合

提出一种基于在线字典学习(ODL)的医学图像特征提取与融合的新算法。首先,采用大小为8像素×8像素的滑动窗处理源图像,得到联合矩阵;通过ODL算法得到该联合矩阵的冗余字典,并利用最小角回归算法(LARS)计算该联合矩阵的稀疏编码;将稀疏编码列向量的1范数作为稀疏编码的活动级测量准则,然后根据活动级最大准则融合稀疏编码;最后根据融合后的稀疏编码和冗余字典重构融合图像。实验图像为20位患者的已配准脑部CT和MR图像,采用5种性能指标评价融合图像的质量,同两种流行的融合算法比较。结果显示,所提出算法的各项客观指标均值最优,Piella指数、QAB/F指数、MIAB/F指数、BSSIM指数和空间频率的均值分别为0.800 4、0.552 4、3.630 2、0.726 9和31.941 3,融合图像对比度、清晰度高,病灶的边缘清晰,运行速度较快,可以辅助医生诊断和临床治疗。     

基于自由变形法的多模态医学图像的配准与融合

本研究提出了一种自动识别颈部PET-CT图像特征点的算法，它应用自由变形（FFD）方法以CT图像的特征点为参考使PET图像产生变形，再结合最大互信息法对颈部PET与CT图像进行非刚体配准，最后用改进的小波图像融合法把两者进行融合得出视觉效果比较理想的融合图像。经实际计算得出的变形PET图像与对应CT图像的互信息量大于原始PET图像，并且最后用改进的小波图像融合法得出的融合图像的信息量比一般小波融合大，由此证明本研究所用方法是有效的。     

人脑MRI和PET图像的融合方法

目的：研究MRI和PET医学图像融合的方法并且应用在人脑神经解剖中。方法：以Chamfer matching为基本配准方法和以模糊数学为理论基础的融合方法。结果：使得融合后图像有很强的抗配准偏差能力,并且能极大程度地保留原来解剖性信息图像和功能性图像的信息。能根据融合算子的不同组合,得到倾向于不同检查仪器结果的图像。结论：通过本文方法得出的融合后图像,能在人脑解剖结构上显示出该区域的功能状态,对于了解该结构的存在、变异、病变提供了很大的便利。对人脑神经解剖学研究和临床应用都有很大的理论和实践意义。     

一种基于图像分割的医学图像融合方法

提出一种新的图像融合算法 ,用于临床治疗计划设计时对病灶的确定。文中采用改进的Canny算子对病灶边缘提取方法进行了研究 ,根据局部直方图计算对非目标轮廓进行抑制。通过对图像配准建立空间映射关系 ,将一种图像中的病灶边缘特征与其它相应的图像进行叠加 ,获得具有病灶边缘和解剖结构特征的融合图像。本文的融合算法简单、直观 ,临床实用性强     

Research and Realization of Medical Image Fusion Based on Three-Dimensional Reconstruction

A new medical image fusion technique is presented. The method is based on three-dimensional reconstruction. After reconstruction, the three-dimensional volume data is normalized by three-dimensional coordinate conversion in the same way and intercepted through setting up cutting plane including anatomical structure,as a result two images in entire registration on space and geometry are obtained and the images are fused at last. Compared with traditional two-dimensional fusion technique,three-dimensional fusion technique can not only resolve the different problems existed in the two kinds of images,but also avoid the registration error of the two kinds of images when they have different scan and imaging parameter. The research proves this fusion technique is more exact and has no registration, so it is more adapt to arbitrary medical image fusion with different equipments.     

基于双稀疏字典的医学图像融合算法及在脑血管疾病诊断中的应用

目的通过图像融合方法结合解剖和功能医学图像以提供更多有用的信息并辅助医生诊断。方法利用稀疏表示能很好地反映图像特征的优势。首先,选取医院脑梗死和脑出血的CT和MRI的临床图像,采用双稀疏字典算法得到稀疏字典,再通过结合空间域信息的最大选择法作为融合规则对其进行融合,并与基于主成分分析(principal component analysis,PCA)和离散小波变换(discrete wavelet transform,DWT)方法的图像融合结果在主观方面以及客观方面的QAB/F和Piella指标上进行比较。结果本文提出的方法所获得的融合图像主观评价优于另外两种方法。QAB/F和Piella的均值分别为0.9139和0.7213,客观评价指标也优于另外两种方法。结论基于双稀疏字典的图像融合算法得到的融合图像更清晰,对比度更高,并且特征保留效果更好,有助于医生的诊断。     

基于小波变换的多分辨率医学图像融合

多模医学图像融合在医学图像分析和诊断上具有极为重要的应用价值。本文采用了基于小波变换的多分辨率分析对人脑MRI PET图像进行了融合。结果表明此方法能够充分有效地将解剖信息与功能信息集成在一起 ,并保留原始图像的边缘和纹理特征 ,具有广阔的应用前景     

MRI-PET image fusion based on NSCT transform using local energy and local variance fusion rules

Image fusion means to integrate information from one image to another image. Medical images according to the nature of the images are divided into structural (such as CT and MRI) and functional (such as SPECT, PET). This article fused MRI and PET images and the purpose is adding structural information from MRI to functional information of PET images. The images decomposed with Nonsubsampled Contourlet Transform and then two images were fused with applying fusion rules. The coefficients of the low frequency band are combined by a maximal energy rule and coefficients of the high frequency bands are combined by a maximal variance rule. Finally, visual and quantitative criteria were used to evaluate the fusion result. In visual evaluation the opinion of two radiologists was used and in quantitative evaluation the proposed fusion method was compared with six existing methods and used criteria were entropy, mutual information, discrepancy and overall performance.     

基于三次样条层间插值的多模态医学图像配准

我们从PET-CT多模态图像序列的特点出发,提出了一种全新的图像配准及融合方法,它采用三次样条插值法对PET-CT图像进行层间插值,然后再利用最大互信息法进行配准,最后应用改进的主成分分析(PCA)法融合PET-CT图像用以增强PET显像效果,从而得到满意的配准以及融合结果。用三次样条插值法进行层间插值并恢复层间缺失图像的信息,弥补了现有配准方法的不足,提高了配准精度,使融合后的图像更加接近实际的物理断层。该方法已经成功应用于三维适形放疗(3D-CRT)系统的开发中。     

融合图像放疗靶区定位精度的检验和初步临床结果

目的：探讨以图像融合技术为基础的肿瘤三维适形放疗靶区定位精度的检验及依据融合图像放疗靶区的确定与单纯CT影像放疗靶区确定的初步临床结果。方法：利用定制的模体分别行CT、MRI和PET成像，进行CT与MRI，CT与PET融合。检验融合后定制标记点的定位精度。对3例特殊病例分别以单纯CT图像为基础和融合图像为基础，进行三维适形放疗靶区认定，对不同医生之间和同一医生在不同时间，放疗靶区定义情况进行对照分析。结果：MRI／CT融合图像总定位精度小于2mm，PET／CT图像融合图像融合精度情况（包括同机融合和异机融合），采用不同的融合算法。定位精度有显著差异（P〈0．01，t=5．385）。单纯利用CT图像进行靶区的定义，不同医生之间，在不同的时间存在差异（P〈0．05），而采用融合技术可减少他们的争议和差异。结论：利用多模式图像融合可以提高靶区定义的准确性．有利于三维适形精确放射治疗。     

基于深度学习的多模态医学图像融合方法研究进展

医学图像融合方法可以将有用的信息整合到一张图上，提高单张图像的信息量。对多模态医学图像进行融合时，如何对图像进行有效的变换，提取到不同图像中独有的特征，并施以适当的融合规则是医学图像融合领域研究的重点。近年随着深度学习的快速发展，深度学习被广泛应用于医学图像领域，代替传统方法中的一些人工操作，并在图像表示、图像特征提取以及融合规则的选择方面显示出独特优势。本文针对基于深度学习的医学图像融合进展予以探讨，介绍了卷积神经网络、卷积稀疏表示、深度自编码和深度信念网络这些常用于医学图像融合的框架，对一些应用于融合过程不同步骤的深度学习方法进行分析和总结，最后，分析了当前基于深度学习的融合方法的不足并展望了未来的研究方向。     

基于改进SUSAN算法的医学图像边缘检测

背景：医学图像的边缘检测是医学图像处理中的一项重要的技术,也是医学图像进一步处理的基础。 目的：运用改进的SUSAN算法对医学图像进行边缘检测,取得更丰富的医学图像边缘信息,以便于医学图像的进一步处理。 方法：运用Sobel算子对SUSAN算法进行了改进,采用C++语言编程,并在VC++6.0开发平台上实现了改进算法。 结果与结论：实验结果表明,该算法能实现阈值的自适应选取,对医学图像中的低对比度的图像边缘有较好的检测效果。      

Detail-enhanced multimodality medical image fusion based on gradient minimization smoothing filter and shearing filter

In this paper, a detail-enhanced multimodality medical image fusion algorithm is proposed by using proposed multi-scale joint decomposition framework (MJDF) and shearing filter (SF). The MJDF constructed with gradient minimization smoothing filter (GMSF) and Gaussian low-pass filter (GLF) is used to decompose source images into low-pass layers, edge layers, and detail layers at multiple scales. In order to highlight the detail information in the fused image, the edge layer and the detail layer in each scale are weighted combined into a detail-enhanced layer. As directional filter is effective in capturing salient information, so SF is applied to the detail-enhanced layer to extract geometrical features and obtain directional coefficients. Visual saliency map-based fusion rule is designed for fusing low-pass layers, and the sum of standard deviation is used as activity level measurement for directional coefficients fusion. The final fusion result is obtained by synthesizing the fused low-pass layers and directional coefficients. Experimental results show that the proposed method with shift-invariance, directional selectivity, and detail-enhanced property is efficient in preserving and enhancing detail information of multimodality medical images.

Open image in new window

Graphical abstract The detailed implementation of the proposed medical image fusion algorithm.

     

Medical Image Fusion Based on Sparse Representation with KSVD

Medical image fusion is a process by which two different models of images are combined into a single image, in order to provide doctors with accurate diagnoses, and take right action. This paper proposes an image fusion method based on sparse representation with KSVD. Firstly, all source images are combined into a joint-matrix, which can be represented with sparse coefficients using an overcompletedictionary trained by KSVD algorithm. Secondly, the coefficients which are considered as image features are combined with the choose-max fusion rule. Finally, the fused image is reconstructed from the concatenated coefficients and the overcomplete dictionary. Compared with three state-of-the-art algorithms, the proposed method has better fusion performance.