[go: up one dir, main page]

CN106408017A - Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning - Google Patents

Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning Download PDF

Info

Publication number
CN106408017A
CN106408017A CN201610819047.XA CN201610819047A CN106408017A CN 106408017 A CN106408017 A CN 106408017A CN 201610819047 A CN201610819047 A CN 201610819047A CN 106408017 A CN106408017 A CN 106408017A
Authority
CN
China
Prior art keywords
sigma
layer
classification
area
input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610819047.XA
Other languages
Chinese (zh)
Inventor
孙萍
李锵
关欣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201610819047.XA priority Critical patent/CN106408017A/en
Publication of CN106408017A publication Critical patent/CN106408017A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Biology (AREA)
  • Multimedia (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)

Abstract

本发明涉及医学图像处理,为提供一种总体性能较好的IMT测量算法,即无需人为参与,时间复杂度相对较低,自动测量结果与专家手动测量结果一致性较高,对不同形态结构的内种膜均能获得较满意的测量结果,本发明基于深度学习的超生颈动脉内中膜厚度测量方法,步骤如下:1)ROI获取:采用卷积神经网络CNN自动识别超声颈动脉血管的远端,进而提取ROI;2)像素分类:进行更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类;3)边界提取:利用目标分类区域的面积信息和位置对分类区域进行甄选,对分类边界进行多项式曲线拟合。本发明主要应用于医学图像处理。

The invention relates to medical image processing, in order to provide an IMT measurement algorithm with better overall performance, that is, without human participation, relatively low time complexity, high consistency between automatic measurement results and expert manual measurement results, and for different morphological structures Satisfactory measurement results can be obtained for the intima. The method for measuring the intima-media thickness of the ultrasonic carotid artery based on deep learning in the present invention has the following steps: 1) ROI acquisition: the convolutional neural network (CNN) is used to automatically identify the distant part of the ultrasonic carotid artery. 2) Pixel classification: perform more advanced feature extraction, and add a logistic regression classification layer after feature extraction to build a pattern classifier to complete the classification of image pixels; 3) Boundary extraction: use the area information and position of the target classification area The classification area is selected, and the polynomial curve fitting is performed on the classification boundary. The invention is mainly applied to medical image processing.

Description

基于深度学习的超生颈动脉内中膜厚度测量装置和方法Ultrasonic carotid artery intima-media thickness measurement device and method based on deep learning

技术领域technical field

本发明涉及医学图像处理,具体讲,涉及基于深度学习的超生颈动脉内中膜厚度测量装置和方法。The present invention relates to medical image processing, in particular, to a device and method for measuring the intima-media thickness of an ultrasonic carotid artery based on deep learning.

背景技术Background technique

心脑血管疾病已经成为危害人类健康的首要疾病。世界卫生组织的调查显示,2012年全球死于心脑血管疾病人数高达1750万,约占全球总死亡人口的30%。动脉粥样硬化是引发心脑血管疾病的首要原因,主要表现为血液中的类脂质和胆固醇在血管内壁的沉积使其内中膜增厚、弹性降低,这种病变情况可能会持续多年而不被发现,但是血管中的斑块会导致血管的完全阻塞,致脑中风、心肌梗塞。因此,动脉粥样硬化的早期追踪诊断对于心脑血管疾病的预防及其重要。众多研究表明颈动脉血管内中膜厚度(Intima MediaThickness,IMT),如图1所示管腔-内膜边界(Lumn-Intima Interface,LII)和中膜-外膜边界(Media-Adventitia Interface,MAI)之间的距离,可以有效反映动脉粥样硬化程度,是预测心脑血管疾病的重要指标。Cardiovascular and cerebrovascular diseases have become the primary diseases that endanger human health. According to the survey of the World Health Organization, the number of people who died of cardiovascular and cerebrovascular diseases in the world in 2012 was as high as 17.5 million, accounting for about 30% of the total global death population. Atherosclerosis is the primary cause of cardiovascular and cerebrovascular diseases. It is mainly manifested by the deposition of lipids and cholesterol in the blood on the inner wall of blood vessels, which makes the intima media thicker and less elastic. This pathological condition may last for many years and It is not discovered, but plaque in blood vessels can lead to complete blockage of blood vessels, resulting in stroke and myocardial infarction. Therefore, early follow-up diagnosis of atherosclerosis is extremely important for the prevention of cardiovascular and cerebrovascular diseases. Numerous studies have shown that carotid artery intima-media thickness (Intima MediaThickness, IMT), as shown in Figure 1, lumen-intima boundary (Lumn-Intima Interface, LII) and media-adventitia boundary (Media-Adventitia Interface, MAI ) can effectively reflect the degree of atherosclerosis and is an important indicator for predicting cardiovascular and cerebrovascular diseases.

超声图像因具有无侵入、价格低、成像快等优点在临床中得到广泛应用。为了保证IMT测量的可重复性,IMT在无斑块的颈动脉远端处测量,一般在颈动脉分叉以下至少5mm处,该部位存在明显的双线性结构。Ultrasound images are widely used in clinical practice because of their non-invasive, low price, and fast imaging. In order to ensure the reproducibility of IMT measurement, IMT was measured at the distal end of the carotid artery without plaque, generally at least 5 mm below the carotid bifurcation, where there was an obvious bilinear structure.

临床中内中膜厚度由医务人员手动进行标定、勾勒出LII和MAI边界来计算。由于操作人员的受训练程度以及经验不同,对边界的界定受主观认识的影响,导致不同操作人员得出不同的测量结果,即存在观察者间差异;即使同一操作者,在不同时间测量的结果也会出现不同,即观察者内误差,且不可重复,耗时、繁琐,无法满足现代医学海量数据处理的需要。基于以上原因,采用数字图像处理技术,实现一种全自动、快速、准确、鲁棒性强的IMT测量算法十分必要。Clinically, the intima-media thickness was calculated manually by medical staff, and by drawing the boundaries of LII and MAI. Due to the different levels of training and experience of operators, the definition of boundaries is affected by subjective cognition, resulting in different measurement results obtained by different operators, that is, there are differences between observers; even if the same operator, the results measured at different times There will also be differences, that is, intra-observer errors, which are not repeatable, time-consuming and cumbersome, and cannot meet the needs of massive data processing in modern medicine. Based on the above reasons, it is necessary to implement a fully automatic, fast, accurate and robust IMT measurement algorithm using digital image processing technology.

1986年,第一个IMT分割算法被提出,之后的30年中大量算法和方案相继被提出。IMT测量方案大致由两部分组成,第一步提取感兴趣区域(Region of Interest,ROI)并获取初始轮廓线,第二部获取精确轮廓线。就第一步而言,依据人工干预程度,现存的这些算法可以分为全自动测量算法和半自动测量算法。半自动分割需要人为选定ROI或感兴趣点,而全自动的方法则不需要人为干预,有学者利用水平集获得初始轮廓线并获得ROI,分水岭和模板匹配的方法也被应用于ROI的获取;第二步涉及动态规划、活动轮廓模型、神经网络模型、统计建模等众多理论。In 1986, the first IMT segmentation algorithm was proposed, and a large number of algorithms and schemes were proposed successively in the following 30 years. The IMT measurement scheme is roughly composed of two parts. The first step is to extract the region of interest (Region of Interest, ROI) and obtain the initial contour line, and the second part is to obtain the precise contour line. As far as the first step is concerned, according to the degree of manual intervention, these existing algorithms can be divided into fully automatic measurement algorithms and semi-automatic measurement algorithms. Semi-automatic segmentation requires artificial selection of ROI or points of interest, while fully automatic methods do not require human intervention. Some scholars use level sets to obtain initial contours and obtain ROIs. The methods of watershed and template matching are also applied to the acquisition of ROIs; The second step involves dynamic programming, active contour models, neural network models, statistical modeling and many other theories.

发明内容Contents of the invention

为克服现有技术的不足,本发明旨在提供一种总体性能较好的IMT测量算法,即无需人为参与,时间复杂度相对较低,自动测量结果与专家手动测量结果一致性较高,对不同形态结构的内种膜均能获得较满意的测量结果。针对第一阶段,本发明应用卷积神经网络自动识 别超生颈动脉远端,进而提取ROI。然后采用堆栈式自编码器加逻辑回归层构造的模式分类器对像素进行分类,并利用分类区域的面积信息和位置信息对分类结果进行甄别,去除错误分类的像素点,选择可靠的分类区域,运用曲线拟合提取边界完成IMT测量。本发明采用的技术方案是,基于深度学习的超生颈动脉内中膜厚度测量装置和方法,步骤如下:In order to overcome the deficiencies in the prior art, the present invention aims to provide an IMT measurement algorithm with better overall performance, that is, no human participation is required, the time complexity is relatively low, and the automatic measurement results are consistent with the expert manual measurement results. Satisfactory measurement results can be obtained for the inner seed membranes with different morphological structures. For the first stage, the present invention applies the convolutional neural network to automatically identify the distal end of the supercarotid artery, and then extracts the ROI. Then, the pattern classifier constructed by stacked autoencoder and logistic regression layer is used to classify the pixels, and the area information and position information of the classification area are used to screen the classification results, remove the wrongly classified pixels, and select a reliable classification area. Using curve fitting to extract the boundary to complete the IMT measurement. The technical scheme adopted in the present invention is a device and method for measuring intima-media thickness of the ultrasonic carotid artery based on deep learning, and the steps are as follows:

1)ROI获取:采用卷积神经网络CNN(Convolution Neural Network)自动识别超声颈动脉血管的远端,进而提取ROI;1) ROI acquisition: the convolutional neural network CNN (Convolution Neural Network) is used to automatically identify the distal end of the ultrasonic carotid artery, and then extract the ROI;

2)像素分类:以待分类像素为中心一定区域的像素灰度值信息作为堆栈式自编码器的输入,其输出作为输入的更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类;2) Pixel classification: The pixel gray value information of a certain area centered on the pixel to be classified is used as the input of the stacked autoencoder, and its output is used as the input for higher-level feature extraction. After the feature extraction, a logistic regression classification layer is added to construct a pattern classifier , to complete the classification of image pixels;

3)边界提取:利用目标分类区域的面积信息和位置对分类区域进行甄选。利用定位颈动脉最远端的行索引值与待判定区域的重心行值和面积信息去除距离目标区域近但是面积较大的错分类区域,利用目标最大区域与其余待判定的较小区域的重心行值进行比较,结合较小区域的面积信息去除距离目标区域较远且面积较小的区域,最后按列索引,去除内中膜结构不完整的区域;根据偏差平方和最小原理,对分类边界进行多项式曲线拟合。3) Boundary extraction: Use the area information and position of the target classification area to select the classification area. Use the row index value of the farthest end of the carotid artery and the barycenter row value and area information of the area to be determined to remove misclassified areas that are close to the target area but have a large area, and use the center of gravity between the largest area of the target and the remaining smaller areas to be determined Compare the row values, combine the area information of the smaller area to remove the area that is farther away from the target area and have a smaller area, and finally index by column to remove the area with incomplete intima-media structure; Perform a polynomial curve fit.

采用卷积神经网络CNN提取ROI具体步骤如下:The specific steps of ROI extraction using convolutional neural network CNN are as follows:

(1)裁剪图像,剪除图像中与图像分析无关的信息;(1) Crop the image, and cut out the information irrelevant to the image analysis in the image;

(2)将裁剪后的图像按列均匀五等分,沿等分的子图像的对称轴顺次取出一定大小的图像块;(2) the cropped image is evenly divided into five equal columns, and image blocks of a certain size are sequentially taken out along the symmetrical axis of the equally divided sub-image;

(3)将图像块作为已经训练好的CNN的输入,进行预测分类,类别数为2,即包含“暗-亮-暗-亮”结构的图像和无此结构的图像,选出同一子图像中归属包含“暗-亮-暗-亮”结构类的预测值最大的图像块;(3) The image block is used as the input of the trained CNN for predictive classification, the number of categories is 2, that is, the image containing the "dark-bright-dark-bright" structure and the image without this structure, and the same sub-image is selected The middle attribute contains the image block with the largest predicted value of the "dark-bright-dark-bright" structure class;

(4)将所得图像块的行索引值进行排序,甄选出能有效标定颈动脉远端的行索引值,并依据该索引值提取ROI,选取规则如下。(4) Sorting the row index values of the obtained image blocks, selecting the row index values that can effectively calibrate the distal end of the carotid artery, and extracting the ROI based on the index values, the selection rules are as follows.

r1、r2和r3分别为行索引值的最大值、次大值和中间值。m1,m2分别为r1、r2和r3、r2的均值,v为一设定的阈值,首选r3作为有效颈动脉远端索引值,如果r3小于某一阈值,则认为r3不能有效定义颈动脉远端,此时借助m1或m2。r1, r2 and r3 are the maximum value, the second maximum value and the middle value of the row index value respectively. m1, m2 are the mean values of r1, r2 and r3, r2 respectively, v is a set threshold, and r3 is preferred as the effective index value of the distal end of the carotid artery. If r3 is less than a certain threshold, it is considered that r3 cannot effectively define the distal end of the carotid artery. At this time, use m1 or m2.

自编码解码器AE(Auto Encoder)的算法执行过程包括编码过程和解码过程。其运算过程如式(1)(2)所示:The algorithm execution process of the Auto Encoder AE (Auto Encoder) includes an encoding process and a decoding process. Its operation process is shown in formula (1) (2):

y=f(wy*x+by) (1)y=f(w y *x+b y ) (1)

z=f(wz*y+bz) (2)z=f(w z *y+b z ) (2)

式中,x代表AE的输入,也代表隐藏层的输出,z代表AE的输出,wy、by分别为输入层到隐藏层的权重和偏置,wz、bz分别为隐藏层到输出层的权重和偏置,f(.)为激活函数;In the formula, x represents the input of AE, and also represents the output of the hidden layer, z represents the output of AE, w y , b y are the weights and biases from the input layer to the hidden layer, w z , b z are the weights and biases from the hidden layer to the hidden layer, respectively. The weight and bias of the output layer, f(.) is the activation function;

AE的训练过程即最小化误差函数的过程,The training process of AE is the process of minimizing the error function,

为了减少训练参数的个数,通常设定In order to reduce the number of training parameters, usually set

Wy=Wz=W (3)W y =W z =W (3)

选择下列规则更新权重项和偏置项,实现误差函数的最小化:Choose the following rules to update the weight term and bias term to minimize the error function:

堆栈式自编码器SAE(Stacked Auto Encoder)由多层自编码器组成,其前一层自编码器的输出作为其后一层自编码器的输入,最深隐藏层单元的激活值向量是对输入值的更高阶的表示;The stacked autoencoder SAE (Stacked Auto Encoder) is composed of a multi-layer autoencoder, the output of the previous layer of autoencoder is used as the input of the next layer of autoencoder, and the activation value vector of the deepest hidden layer unit is the input higher-order representation of values;

选取sigmoid函数作为编解码器的激活函数,在预训练过程中,网络主要学习三个参数W,by,bz,在设定参数更新规则前,需要合理确定误差项,即代价函数,选择交叉熵作为代价函数,同时将整个训练数据均分为小块数据,因此对于整个数据集,以小块数据更新参数:Select the sigmoid function as the activation function of the codec. In the pre-training process, the network mainly learns three parameters W, b y , b z . Before setting the parameter update rules, it is necessary to reasonably determine the error term, that is, the cost function. Select Cross entropy is used as a cost function, and at the same time the entire training data is divided into small pieces of data, so for the entire data set, the parameters are updated with small pieces of data:

式中,d为输入向量维数,m为数据块大小,xik、zik分别为所选块中第i个输入数据的第k个分量;In the formula, d is the dimension of the input vector, m is the size of the data block, x ik and z ik are the kth component of the i-th input data in the selected block respectively;

以随机梯度下降法优化(8)式,首先以标量的形式表示重构层:To optimize formula (8) with stochastic gradient descent method, first express the reconstruction layer in the form of scalar:

其中,netip y为隐藏层单元的第p维,netikz i为输出单元的第p维,代表块数据的编号,d代表输入数据的维度,h代表隐藏层的维度,zik为输入数据的第k维重建;Among them, net ip y is the p-th dimension of the hidden layer unit, netikz i is the p-th dimension of the output unit, which represents the number of the block data, d represents the dimension of the input data, h represents the dimension of the hidden layer, z ik is the dimension of the input data k-th dimension reconstruction;

(7)式的一阶和二阶导数分别为:The first and second derivatives of (7) are:

f'(x)=f(x)1-f(x) (12)f'(x)=f(x)1-f(x) (12)

f”(x)=f(x)1-f(x)1-2f(x) (13)f"(x)=f(x)1-f(x)1-2f(x) (13)

依据(9)-(11)式,计算重建层关于w,by,bz的偏导数;According to (9)-(11), calculate the partial derivative of the reconstruction layer with respect to w, b y , b z ;

式中Wrs为连接第r个输入和第s个隐藏层单元的权值,byr为隐藏层第r个单元的偏置,bzr为重建层第r个单元的偏置;In the formula, Wrs is the weight connecting the rth input and the sth hidden layer unit, b yr is the bias of the rth unit in the hidden layer, and b zr is the bias of the rth unit in the reconstruction layer;

由(9)-(16)式得出代价函数关于W,by,bz的偏导数:The partial derivatives of the cost function with respect to W, b y , b z are obtained from equations (9)-(16):

网络训练完成后,去除网络的数据重建,隐藏层的输出为所学特征,后续的网络层以前一层的输出为输入,并用同样的方式训练,即逐层贪婪训练网络,避免网络因初始权值过小而陷入局部最优解;最后将网络的各层结合在一起,利用网络学习到的特征进行分类,在预训练网络后面添加soft-max分类层精细调整整个预训练网络完成分类任务,若给定一组输入数据,输入属于某一类别i的概率等于After the network training is completed, the data reconstruction of the network is removed, the output of the hidden layer is the learned feature, and the output of the subsequent network layer is the input of the previous layer, and it is trained in the same way, that is, the network is greedily trained layer by layer, so as to avoid the loss of the network due to the initial weight loss. The value is too small to fall into the local optimal solution; finally, combine the layers of the network together, use the features learned by the network to classify, and add a soft-max classification layer after the pre-training network to fine-tune the entire pre-training network to complete the classification task. Given a set of input data, the probability that the input belongs to a certain class i is equal to

式中R为逻辑回归层的输入,W,b为逻辑回归层的权重和偏置,所有输出的总和为1。In the formula, R is the input of the logistic regression layer, W, b are the weight and bias of the logistic regression layer, and the sum of all outputs is 1.

逻辑回归层与堆栈式自编码器构成深度分类器,训练该深度分类器的过程如下:The logistic regression layer and the stacked autoencoder form a deep classifier. The process of training the deep classifier is as follows:

根据实际需要搭建两个不同的模式分类器,记为SAE_NB和SAE_LM,分别利用上述训练规则,在已选定的有代表性的训练集中训练两个深度模式分类器,利用SAE_NB将像素分为边界像素和非边界像素,再利用SAE_LM将边界像素分为LII和MAI像素。Build two different pattern classifiers according to actual needs, denoted as SAE_NB and SAE_LM, respectively use the above training rules to train two deep pattern classifiers in the selected representative training set, and use SAE_NB to divide pixels into boundaries pixels and non-boundary pixels, and then use SAE_LM to divide the boundary pixels into LII and MAI pixels.

根据偏差平方和最小原理,对分类边界进行多项式曲线拟合,其过程如下:According to the principle of the minimum sum of squared deviations, polynomial curve fitting is performed on the classification boundary, and the process is as follows:

设拟合多项式为:Let the fitting polynomial be:

f=a0+a1·e+...+ak·ek (21)f=a 0 +a 1 e+...+a k e k (21)

其中,e、f分别为边界点像素的列值和行值,ak为多项式系数,k为多项式次数。Among them, e and f are the column value and row value of the boundary point pixel respectively, a k is the polynomial coefficient, and k is the polynomial degree.

(2)各点到这条曲线的距离之和,即偏差平方如下:(2) The sum of the distances from each point to this curve, that is, the square of the deviation is as follows:

其中,n为数据集大小,(ei,fi)为第i个像素点的列式和行值,R代表偏差。Among them, n is the size of the data set, (e i , f i ) is the column and row values of the i-th pixel, and R represents the deviation.

(3)对等式右边求ai偏导数可得(3) Calculate the partial derivative of a i on the right side of the equation to get

(4)将左式化简,可得如下式(4) Simplify the left formula to get the following formula

(5)将等式表示成矩阵形式(5) Express the equation in matrix form

(6)将(5)所得的范德蒙矩阵简化可得(6) Simplify the Vandermonde matrix obtained in (5) to get

(7)(6)式即为E*A=F,则(7) (6) formula is E*A=F, then

A=(E*E)-1*E*F (27)A=(E*E) -1 *E*F (27)

得到系数矩阵同时也就得到了拟合曲线。When the coefficient matrix is obtained, the fitting curve is obtained at the same time.

本发明的特点及有益效果是:Features and beneficial effects of the present invention are:

本发明能有效解决目前IMT算法中普遍存在的总体性能欠佳的问题,能实现对IMT全自动、快速、准确、鲁棒性强的测量。The invention can effectively solve the problem of generally poor overall performance in current IMT algorithms, and can realize fully automatic, fast, accurate and robust measurement of IMT.

在在ROI选取阶段,应用CNN识别超生颈动脉的远端,CNN对有较大形变的输入数据具有一定的容忍能力,对噪声具有一定的鲁棒性;对CNN的识别结果进行判别以保证对不同图像都能准确定位颈动脉远端,正确提取ROI。In the ROI selection stage, the CNN is used to identify the distal end of the ultrasonic carotid artery. CNN has a certain tolerance to the input data with large deformation and has certain robustness to noise; Different images can accurately locate the distal end of the carotid artery and correctly extract the ROI.

在像素分类阶段,根据分类集的不同特点,搭建不同的栈式自编码器;栈式自编码器逐层提取输入数据数据的特征,最终得到数据的深层特征并进行分类,保证了分类的高效性和有效性。In the pixel classification stage, according to the different characteristics of the classification set, different stacked autoencoders are built; the stacked autoencoder extracts the features of the input data layer by layer, and finally obtains the deep features of the data and classifies them to ensure the efficiency of classification. sex and effectiveness.

在边界提取阶段,考虑到所用超生图像的内中膜结构不完全,难免会出现断裂,在选定可靠分类区域时不仅考虑区域的面积而且考虑区域的位置。In the boundary extraction stage, considering the incomplete intima-media structure of the ultrasound images used, it is inevitable that there will be fractures. When selecting reliable classification regions, not only the area of the region but also the location of the region should be considered.

附图说明:Description of drawings:

图1颈动脉超声轴向截面。Figure 1 Ultrasound axial section of the carotid artery.

图2单层自编码器示意图。Figure 2. Schematic diagram of a single-layer autoencoder.

图3本发明采用的算法流程图。Fig. 3 is an algorithm flow chart adopted by the present invention.

图4模式分类器分类像素的示意图。Figure 4. Schematic diagram of pattern classifier classifying pixels.

具体实施方式detailed description

尽管近些年IMT分割算法已经取得了突破性进展,但是现存的这些算法很难同时满足全自动、快速、准确、鲁棒性强等方面的要求。本发明旨在开发一种总体性能较好的IMT测量算法,即无需人为参与,时间复杂度相对较低,自动测量结果与专家手动测量结果一致性较高,对不同形态结构的内种膜均能获得较满意的测量结果。针对第一阶段,本发明应用卷积神经网络自动识别超生颈动脉远端,进而提取ROI。然后采用堆栈式自编码器加逻辑回归层构造的模式分类器对像素进行分类,并利用分类区域的面积信息和位置信息对分类结果进行甄别,去除错误分类的像素点,选择可靠的分类区域,运用曲线拟合提取边界完成IMT测量。Although IMT segmentation algorithms have made breakthroughs in recent years, it is difficult for these existing algorithms to meet the requirements of full automation, speed, accuracy, and robustness at the same time. The present invention aims to develop an IMT measurement algorithm with better overall performance, that is, without human participation, relatively low time complexity, high consistency between automatic measurement results and expert manual measurement results, and uniform for internal seed films with different morphological structures. Satisfactory measurement results can be obtained. For the first stage, the present invention applies the convolutional neural network to automatically identify the distal end of the superborn carotid artery, and then extracts the ROI. Then, the pattern classifier constructed by stacked autoencoder and logistic regression layer is used to classify the pixels, and the area information and position information of the classification area are used to screen the classification results, remove the wrongly classified pixels, and select a reliable classification area. Using curve fitting to extract the boundary to complete the IMT measurement.

1ROI获取1ROI acquisition

为了保证全自动、快速、准确获取ROI,本发明采用卷积神经网络(ConvolutionNeural Network,CNN)自动识别超声颈动脉血管的远端,进而提取ROI,具体步骤如下:In order to ensure fully automatic, fast and accurate ROI acquisition, the present invention adopts a convolution neural network (ConvolutionNeural Network, CNN) to automatically identify the distal end of the ultrasonic carotid artery vessel, and then extract the ROI. The specific steps are as follows:

(1)裁剪图像,剪除图像中与图像分析无关的信息,如原始的超生图像边缘中包含的受试者的个人信息。(1) Crop the image, cut out the information irrelevant to the image analysis in the image, such as the personal information of the subject contained in the edge of the original ultrasound image.

(2)将裁剪后的图像按列均匀五等分。沿等分的子图像的对称轴顺次取出一定大小的图像块。(2) Evenly divide the cropped image into five equal columns. Image blocks of a certain size are sequentially taken out along the symmetry axis of the equally divided sub-image.

(3)将图像块作为已经训练好的CNN的输入,进行预测分类,类别数为2,即包含“暗-亮-暗-亮”结构的图像和无此结构的图像,选出同一子图像中归属包含“暗-亮-暗-亮”结构类的预测值最大的图像块。(3) The image block is used as the input of the trained CNN for predictive classification, the number of categories is 2, that is, the image containing the "dark-bright-dark-bright" structure and the image without this structure, and the same sub-image is selected The medium belongs to the image block containing the largest predicted value of the "dark-bright-dark-bright" structure class.

(4)将所得图像块的行索引值进行排序,甄选出能有效标定颈动脉远端的行索引值,并依据该索引值提取ROI,选取规则如下。(4) Sorting the row index values of the obtained image blocks, selecting the row index values that can effectively calibrate the distal end of the carotid artery, and extracting the ROI based on the index values, the selection rules are as follows.

r1、r2和r3分别为行索引值的最大值、次大值和中间值。m1,m2分别为r1、r2和r3、r2的均值。v为一设定的阈值,本发明中首选r3作为有效颈动脉远端索引值,一般颈动脉远端位于整张超声图像中间偏下位置,因此如果r3小于某一阈值,则认为r3不能有效定义颈动脉远端,此时借助m1或m2。r1, r2 and r3 are the maximum value, the second maximum value and the middle value of the row index value respectively. m1, m2 are the mean values of r1, r2 and r3, r2 respectively. v is a set threshold. In the present invention, r3 is preferred as the effective index value of the distal end of the carotid artery. Generally, the distal end of the carotid artery is located in the middle and lower position of the entire ultrasound image. Therefore, if r3 is less than a certain threshold, r3 is considered to be ineffective. Define the distal end of the carotid artery, this time with m1 or m2.

2像素分类2 pixel classification

深度学习架构由多层非线性运算单元组成,研究表明函数族提取出的深层特征表达较单一函数提取的浅层特征更有效。堆栈自编码网络(Stacked Autoencoder,SAE)以数值模型来构建的深度神经网络,其隐层节点是具有实际意义的计算单元。对于具备连续性和确定性的数值数据,数值模型会获得更好的训练效果。The deep learning architecture is composed of multi-layer nonlinear computing units. Studies have shown that the deep feature expression extracted by the function family is more effective than the shallow feature extracted by a single function. Stacked Autoencoder (SAE) is a deep neural network built with a numerical model, and its hidden layer nodes are computational units with practical significance. For numerical data with continuity and determinism, the numerical model will obtain better training results.

自编码器(Auto Encoder,AE)是一种无监督学习算法,使用反向传播算法,并让目标值等于输入值,即z≈x。Auto Encoder (AE) is an unsupervised learning algorithm that uses the backpropagation algorithm and makes the target value equal to the input value, ie z≈x.

如图2单层自编码器示意图所示。A schematic diagram of a single-layer autoencoder is shown in Figure 2.

AE的算法执行过程包括编码过程和解码过程。其运算过程如式(1)(2)所示:The algorithm execution process of AE includes encoding process and decoding process. Its operation process is shown in formula (1) (2):

y=f(wy*x+by) (1)y=f(w y *x+b y ) (1)

z=f(wz*y+bz) (2)z=f(w z *y+b z ) (2)

式中,wy、by分别为输入层到隐藏层的权重和偏置,wz、bz分别为隐藏层到输出层的权重和偏置,f(.)为激活函数。In the formula, wy and by are the weight and bias from the input layer to the hidden layer respectively, wz and bz are the weight and bias from the hidden layer to the output layer respectively, and f(.) is the activation function.

AE的训练过程即最小化误差函数的过程,The training process of AE is the process of minimizing the error function,

为了减少训练参数的个数,通常设定In order to reduce the number of training parameters, usually set

Wy=Wz=W (3)W y =W z =W (3)

一般选择下列规则更新权重项和偏置项,实现误差函数的最小化:Generally, the following rules are selected to update the weight term and bias term to minimize the error function:

栈式自编码神经网络是一个由多层自编码器组成的神经网络,其前一层自编码器的输出作为其后一层自编码器的输入,最深层隐藏单元的激活值向量是对输入值的更高阶的表示。The stacked autoencoder neural network is a neural network composed of multi-layer autoencoders, the output of the previous layer of autoencoder is used as the input of the next layer of autoencoder, and the activation value vector of the deepest hidden unit is the input A higher-order representation of a value.

本发明运用模式识别的相关技术解决图像像素分类的问题,完成图像分割。具体地,以待分类像素为中心一定区域的像素灰度值信息作为堆栈式自编码器的输入,其输出作为输入的更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类。sigmoid函数能进行非线性映,其输出范围有限,数据在传递的过程中不容易发散,因此本文中选取sigmoid函数作为编解码器的激活函数。在预训练过程中,网络主要学习三个参数W,by,bz。在设定参数更新规则前,需要合理确定误差项,即代价函数。因为激活函数选用sigmoid函数,所以代价函数的导数会因为神经元输出为0或1而趋近于0。如果采用交叉熵,即使网络节点趋于饱和,参数仍会继续更新,最终选择交叉熵作为代价函数。同时将整个训 练数据均分为小块数据,因此对于整个数据集,采用以小块数据更新参数。The invention uses the relevant technology of pattern recognition to solve the problem of image pixel classification and completes image segmentation. Specifically, the pixel gray value information of a certain area centered on the pixel to be classified is used as the input of the stacked autoencoder, and its output is used as the input for higher-level feature extraction. After the feature extraction, a logistic regression classification layer is added to construct a pattern classifier, and the model is completed. Classification of image pixels. The sigmoid function can perform nonlinear mapping, its output range is limited, and the data is not easy to diverge in the process of transmission, so the sigmoid function is selected as the activation function of the codec in this paper. During the pre-training process, the network mainly learns three parameters W, by, bz. Before setting the parameter update rules, it is necessary to reasonably determine the error term, that is, the cost function. Because the activation function uses the sigmoid function, the derivative of the cost function will approach 0 because the neuron output is 0 or 1. If cross-entropy is used, even if the network nodes tend to be saturated, the parameters will continue to be updated, and finally cross-entropy is selected as the cost function. At the same time, the entire training data is divided into small pieces of data, so for the entire data set, the parameters are updated with small pieces of data.

式中,d为输入向量维数,m为数据块大小,xik(zik)为所选块中第i个输入数据的第k个分量。where d is the dimension of the input vector, m is the size of the data block, and x ik (zi ik ) is the kth component of the i-th input data in the selected block.

以随机梯度下降法优化(8)式,首先以标量的形式表示重构层:To optimize formula (8) with stochastic gradient descent method, first express the reconstruction layer in the form of scalar:

其中,netip y(netik z)为隐藏层(输出)单元的第p维,i代表块数据的编号,d代表输入数据的维度,h代表隐藏层的维度。zik为输入数据的第k维重建。Among them, net ip y (net ik z ) is the p-th dimension of the hidden layer (output) unit, i represents the number of the block data, d represents the dimension of the input data, and h represents the dimension of the hidden layer. z ik is the k-th dimensional reconstruction of the input data.

(7)式的一阶和二阶导数分别为:The first and second derivatives of (7) are:

f'(x)=f(x)1-f(x) (12)f'(x)=f(x)1-f(x) (12)

f”(x)=f(x)1-f(x)1-2f(x) (13)f"(x)=f(x)1-f(x)1-2f(x) (13)

依据(9)-(11)式,计算重建层关于w,by,bz的偏导数;According to (9)-(11), calculate the partial derivative of the reconstruction layer with respect to w, b y , b z ;

式中Wrs为连接第r个输入和第s个隐藏层单元的权值,byr(bzr)为隐藏层(重建层)第r个单元的偏置。In the formula, Wrs is the weight connecting the rth input and the sth hidden layer unit, b yr (b zr ) is the bias of the rth unit in the hidden layer (reconstruction layer).

由(9)-(16)式得出代价函数关于W,by,bz的偏导数:The partial derivatives of the cost function with respect to W, b y , b z are obtained from equations (9)-(16):

网络训练完成后,去除网络的数据重建,隐藏层的输出为所学特征,后续的网络层以前一层的输出为输入,并用同样的方式训练,即逐层贪婪训练网络,避免网络因初始权值过小而陷入局部最优解;最后将网络的各层结合在一起,利用网络学习到的特征进行分类,在预训练网络后面添加soft-max分类层精细调整整个预训练网络完成分类任务,若给定一组输入数据,输入属于某一类别i的概率等于After the network training is completed, the data reconstruction of the network is removed, the output of the hidden layer is the learned feature, and the output of the subsequent network layer is the input of the previous layer, and it is trained in the same way, that is, the network is greedily trained layer by layer, so as to avoid the loss of the network due to the initial weight loss. The value is too small to fall into the local optimal solution; finally, combine the layers of the network together, use the features learned by the network to classify, and add a soft-max classification layer after the pre-training network to fine-tune the entire pre-training network to complete the classification task. Given a set of input data, the probability that the input belongs to a certain class i is equal to

式中R为逻辑回归层的输入,W,b为逻辑回归层的权重和偏置,所有输出的总和为1。In the formula, R is the input of the logistic regression layer, W, b are the weight and bias of the logistic regression layer, and the sum of all outputs is 1.

逻辑回归层与堆栈式自编码器构成深度分类器,训练该深度分类器的过程如下:The logistic regression layer and the stacked autoencoder form a deep classifier. The process of training the deep classifier is as follows:

本发明中根据实际需要搭建两个不同的模式分类器,记为SAE_NB和SAE_LM,分别利用上述训练规则,在已选定的有代表性的训练集中训练两个深度模式分类器。利用SAE_NB将像素分为边界像素和非边界像素,再利用SAE_LM将边界像素分为LII和MAI像素。In the present invention, two different pattern classifiers are built according to actual needs, which are recorded as SAE_NB and SAE_LM, and the above-mentioned training rules are used respectively to train two deep pattern classifiers in the selected representative training set. Use SAE_NB to divide the pixels into boundary pixels and non-boundary pixels, and then use SAE_LM to divide the boundary pixels into LII and MAI pixels.

3边界提取3 boundary extraction

由于超声图像的分辨率和信噪比较低,且模式的相似性比较高,会出现错误分类现象。假阳性错误,即将非边界点错误地分类为边界点,对最终的结果影响较大,因此需要对分类结果进行筛选甄别,本发明利用目标分类区域的面积信息和位置对分类区域进行甄选。利用定位颈动脉最远端的行索引值与待判定区域的重心行值和面积信息去除距离目标区域近但是面积较大的错分类区域,利用目标最大区域与其余待判定的较小区域的重心行值进行比较,结合较小区域的面积信息去除距离目标区域较远且面积较小的区域,最后按列索引,去除内中膜结构不完整的区域。Due to the low resolution and signal-to-noise ratio of ultrasound images and the relatively high similarity of patterns, misclassification occurs. False positive errors, that is, wrongly classify non-boundary points as boundary points, have a great impact on the final result. Therefore, it is necessary to screen the classification results. The present invention uses the area information and position of the target classification area to select the classification area. Use the row index value of the farthest end of the carotid artery and the barycenter row value and area information of the area to be determined to remove misclassified areas that are close to the target area but have a large area, and use the center of gravity between the largest area of the target and the remaining smaller areas to be determined The row values are compared, combined with the area information of the smaller area to remove the area that is far away from the target area and the area is small, and finally indexed by column to remove the area with incomplete intima-media structure.

由于超声图像的质量较差,得出的边界并不是单像素宽度,这也是手动测量出现观察者间差异的主要原因。为消除此差异性,根据偏差平方和最小原理,对分类边界进行多项式曲线拟合,其过程如下:Due to the poor quality of the ultrasound images, the derived borders are not a single pixel wide, which is the main reason for interobserver variability in manual measurements. In order to eliminate this difference, according to the principle of the minimum sum of squared deviations, polynomial curve fitting is carried out on the classification boundary, and the process is as follows:

设拟合多项式为:Let the fitting polynomial be:

f=a0+a1·e+...+ak·ek (21)f=a 0 +a 1 e+...+a k e k (21)

其中,e、f分别为边界点像素的列值和行值,ak、为多项式系数,k为多项式次数。Among them, e and f are the column value and row value of the boundary point pixel respectively, ak and are the polynomial coefficients, and k is the degree of the polynomial.

(2)各点到这条曲线的距离之和,即偏差平方如下:(2) The sum of the distances from each point to this curve, that is, the square of the deviation is as follows:

其中,n为数据集大小,(ei,fi)为第i个像素点的列式和行值,R代表偏差。Among them, n is the size of the data set, (ei, fi) is the column and row values of the i-th pixel, and R represents the deviation.

(3)对等式右边求ai偏导数可得(3) Calculate the partial derivative of ai on the right side of the equation to get

(4)将左式化简,可得如下式(4) Simplify the left formula to get the following formula

(5)将等式表示成矩阵形式(5) Express the equation in matrix form

(6)将(5)所得的范德蒙矩阵简化可得(6) Simplify the Vandermonde matrix obtained in (5) to get

(7)(6)式即为E*A=F,则(7) (6) formula is E*A=F, then

A=(E*E)-1*E*F (27)A=(E*E) -1 *E*F (27)

得到系数矩阵同时也就得到了拟合曲线。When the coefficient matrix is obtained, the fitting curve is obtained at the same time.

有益效果Beneficial effect

本发明能有效解决目前IMT算法中普遍存在的总体性能欠佳的问题,能实现对IMT全自动、快速、准确、鲁棒性强的测量。The invention can effectively solve the problem of generally poor overall performance in current IMT algorithms, and can realize fully automatic, fast, accurate and robust measurement of IMT.

在在ROI选取阶段,应用CNN识别超生颈动脉的远端,CNN对有较大形变的输入数据具有一定的容忍能力,对噪声具有一定的鲁棒性;对CNN的识别结果进行判别以保证对不同图像都能准确定位颈动脉远端,正确提取ROI。In the ROI selection stage, the CNN is used to identify the distal end of the ultrasonic carotid artery. CNN has a certain tolerance to the input data with large deformation and has certain robustness to noise; Different images can accurately locate the distal end of the carotid artery and correctly extract the ROI.

在像素分类阶段,根据分类集的不同特点,搭建不同的栈式自编码器;栈式自编码器逐层提取输入数据数据的特征,最终得到数据的深层特征并进行分类,保证了分类的高效性和 有效性。In the pixel classification stage, according to the different characteristics of the classification set, different stacked autoencoders are built; the stacked autoencoder extracts the features of the input data layer by layer, and finally obtains the deep features of the data and classifies them to ensure the efficiency of classification. sex and effectiveness.

在边界提取阶段,考虑到所用超生图像的内中膜结构不完全,难免会出现断裂,在选定可靠分类区域时不仅考虑区域的面积而且考虑区域的位置。In the boundary extraction stage, considering the incomplete intima-media structure of the ultrasound images used, it is inevitable that there will be fractures. When selecting reliable classification regions, not only the area of the region but also the location of the region should be considered.

图3描述了本发明所提出的一种基于深度学习的IMT测量算法流程图。首先对输入的超声颈动脉图像进行裁剪、均分、获取子图像,对子图像进行分类预测,获取能有效标定颈动脉远端的行索引值,并获取ROI。用特定的窗对ROI进行处理,先将经过窗处理的像素模式信息作为SAE_NB分类器的输入,将像素分类为非边界像素和边界像素,然后再利用SAE_LM分类器将边界像素分类为LII和MAI像素,最后利用分类区域的面积信息和位置信息对分类结果进行甄选,搜索含有完整内中膜结构的分类区域,依据最小偏差平方和原理,拟合最终出边界,完成IMT测量。Fig. 3 describes a flow chart of an IMT measurement algorithm based on deep learning proposed by the present invention. Firstly, the input ultrasonic carotid artery image is cropped, averaged, and sub-images are obtained, and the sub-images are classified and predicted, and the row index value that can effectively calibrate the distal end of the carotid artery is obtained, and the ROI is obtained. Use a specific window to process the ROI, first use the window-processed pixel pattern information as the input of the SAE_NB classifier, classify the pixels into non-boundary pixels and boundary pixels, and then use the SAE_LM classifier to classify the boundary pixels into LII and MAI Pixel, and finally use the area information and position information of the classification area to select the classification results, search for the classification area containing the complete intima-media structure, and fit the final boundary according to the principle of the least square sum of deviations to complete the IMT measurement.

Claims (5)

1.一种基于深度学习的超生颈动脉内中膜厚度测量方法,其特征是,步骤如下:1. a method for measuring carotid intima-media thickness based on deep learning, is characterized in that, the steps are as follows: 1)ROI获取:采用卷积神经网络CNN(Convolution Neural Network)自动识别超声颈动脉血管的远端,进而提取ROI;1) ROI acquisition: the convolutional neural network CNN (Convolution Neural Network) is used to automatically identify the distal end of the ultrasonic carotid artery, and then extract the ROI; 2)像素分类:以待分类像素为中心一定区域的像素灰度值信息作为堆栈式自编码器的输入,其输出作为输入的更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类;2) Pixel classification: The pixel gray value information of a certain area centered on the pixel to be classified is used as the input of the stacked autoencoder, and its output is used as the input for higher-level feature extraction. After the feature extraction, a logistic regression classification layer is added to construct a pattern classifier , to complete the classification of image pixels; 3)边界提取:利用目标分类区域的面积信息和位置对分类区域进行甄选,利用定位颈动脉最远端的行索引值与待判定区域的重心行值和面积信息去除距离目标区域近但是面积较大的错分类区域,利用目标最大区域与其余待判定的较小区域的重心行值进行比较,结合较小区域的面积信息去除距离目标区域较远且面积较小的区域,最后按列索引,去除内中膜结构不完整的区域;根据偏差平方和最小原理,对分类边界进行多项式曲线拟合。3) Boundary extraction: use the area information and position of the target classification area to select the classification area, and use the row index value of the farthest end of the carotid artery and the barycenter row value and area information of the area to be determined to remove the area that is close to the target area but has a smaller area. For large misclassified areas, use the largest area of the target to compare the barycenter row values of the remaining smaller areas to be determined, combine the area information of the smaller areas to remove areas that are farther away from the target area and have a smaller area, and finally index by column, Regions with incomplete intima-media structure were removed; polynomial curve fitting was performed on the classification boundary according to the principle of minimum sum of squared deviations. 2.如权利要求1所述的基于深度学习的超生颈动脉内中膜厚度测量方法,其特征是,采用卷积神经网络CNN提取ROI具体步骤如下:2. the ultrasonography carotid artery intima-media thickness measurement method based on deep learning as claimed in claim 1, is characterized in that, adopts convolutional neural network (CNN) to extract ROI concrete steps are as follows: (1)裁剪图像,剪除图像中与图像分析无关的信息;(1) Crop the image, and cut out the information irrelevant to the image analysis in the image; (2)将裁剪后的图像按列均匀五等分,沿等分的子图像的对称轴顺次取出一定大小的图像块;(2) the cropped image is evenly divided into five equal columns, and image blocks of a certain size are sequentially taken out along the symmetrical axis of the equally divided sub-image; (3)将图像块作为已经训练好的CNN的输入,进行预测分类,类别数为2,即包含“暗-亮-暗-亮”结构的图像和无此结构的图像,选出同一子图像中归属包含“暗-亮-暗-亮”结构类的预测值最大的图像块;(3) The image block is used as the input of the trained CNN for predictive classification, the number of categories is 2, that is, the image containing the "dark-bright-dark-bright" structure and the image without this structure, and the same sub-image is selected The middle attribute contains the image block with the largest predicted value of the "dark-bright-dark-bright" structure class; (4)将所得图像块的行索引值进行排序,甄选出能有效标定颈动脉远端的行索引值,并依据该索引值提取ROI,选取规则如下。(4) Sorting the row index values of the obtained image blocks, selecting the row index values that can effectively calibrate the distal end of the carotid artery, and extracting the ROI based on the index values, the selection rules are as follows. r1、r2和r3分别为行索引值的最大值、次大值和中间值。m1,m2分别为r1、r2和r3、r2的均值,v为一设定的阈值,首选r3作为有效颈动脉远端索引值,如果r3小于某一阈值,则认为r3不能有效定义颈动脉远端,此时借助m1或m2。 r1, r2 and r3 are the maximum value, the second maximum value and the middle value of the row index value respectively. m1, m2 are the mean values of r1, r2 and r3, r2 respectively, v is a set threshold, and r3 is preferred as the effective index value of the distal end of the carotid artery. If r3 is less than a certain threshold, it is considered that r3 cannot effectively define the distal end of the carotid artery. At this time, use m1 or m2. 3.如权利要求1所述的基于深度学习的超生颈动脉内中膜厚度测量方法,其特征是,自编码解码器AE(Auto Encoder)的算法执行过程包括编码过程和解码过程,其运算过程如式(1)(2)所示:3. the ultrasonography carotid artery intima-media thickness measurement method based on deep learning as claimed in claim 1, is characterized in that, the algorithm execution process of self-encoding decoder AE (Auto Encoder) comprises encoding process and decoding process, and its operation process As shown in formula (1) (2): y=f(wy*x+by) (1)y=f(w y *x+b y ) (1) z=f(wz*y+bz) (2)z=f(w z *y+b z ) (2) 式中,x代表AE的输入,也代表隐藏层的输出,z代表AE的输出,wy、by分别为输入层到隐藏层的权重和偏置,wz、bz分别为隐藏层到输出层的权重和偏置,f(.)为激活函数;In the formula, x represents the input of AE, and also represents the output of the hidden layer, z represents the output of AE, w y , b y are the weights and biases from the input layer to the hidden layer, w z , b z are the weights and biases from the hidden layer to the hidden layer, respectively. The weight and bias of the output layer, f(.) is the activation function; AE的训练过程即最小化误差函数的过程,The training process of AE is the process of minimizing the error function, argarg minmin ww ythe y ,, ww zz ,, bb ythe y ,, bb zz [[ cc (( xx ,, ythe y )) ]] 为了减少训练参数的个数,通常设定In order to reduce the number of training parameters, usually set Wy=Wz=W (3)W y =W z =W (3) 选择下列规则更新权重项和偏置项,实现误差函数的最小化:Choose the following rules to update the weight term and bias term to minimize the error function: WW == WW -- ηη ∂∂ cc (( xx ,, zz )) ∂∂ ww -- -- -- (( 44 )) bb ythe y == bb ythe y -- ηη ∂∂ cc (( xx ,, zz )) ∂∂ bb ythe y -- -- -- (( 55 )) bb zz == bb zz -- ηη ∂∂ cc (( xx ,, zz )) ∂∂ bb zz -- -- -- (( 66 )) 堆栈式自编码器SAE(Stacked Auto Encoder)由多层自编码器组成,其前一层自编码器的输出作为其后一层自编码器的输入,最深隐藏层单元的激活值向量是对输入值的更高阶的表示; The stacked autoencoder SAE (Stacked Auto Encoder) is composed of a multi-layer autoencoder, the output of the previous layer of autoencoder is used as the input of the next layer of autoencoder, and the activation value vector of the deepest hidden layer unit is the input higher-order representation of values; 选取sigmoid函数作为编解码器的激活函数,在预训练过程中,网络主要学习三个参数W,by,bz,在设定参数更新规则前,需要合理确定误差项,即代价函数,选择交叉熵作为代价函数,同时将整个训练数据均分为小块数据,因此对于整个数据集,以小块数据更新参数:Select the sigmoid function as the activation function of the codec. In the pre-training process, the network mainly learns three parameters W, b y , b z . Before setting the parameter update rules, it is necessary to reasonably determine the error term, that is, the cost function. Select Cross entropy is used as a cost function, and at the same time the entire training data is divided into small pieces of data, so for the entire data set, the parameters are updated with small pieces of data: ff (( xx )) == 11 11 ++ ee xx -- -- -- (( 77 )) cc == 11 mm ΣΣ ii == 11 mm ΣΣ kk == 11 dd xx ii kk ·· ll oo gg (( zz ii kk )) ++ (( 11 -- xx ii kk )) ·· ll oo gg (( 11 -- zz ii kk )) -- -- -- (( 88 )) 式中,d为输入向量维数,m为数据块大小,xik、zik分别为所选块中第i个输入数据的第k个分量;In the formula, d is the dimension of the input vector, m is the size of the data block, x ik and z ik are the kth component of the i-th input data in the selected block respectively; 以随机梯度下降法优化(8)式,首先以标量的形式表示重构层: To optimize formula (8) with stochastic gradient descent method, first express the reconstruction layer in the form of scalar: netnet ii pp ythe y == ΣΣ qq == 11 dd xx ii qq WW qq pp ++ bb ythe y pp -- -- -- (( 99 )) netnet ii kk zz == ΣΣ pp == 11 hh WW kk pp ·&Center Dot; ff (( netnet ii pp ythe y )) ++ bb zz kk -- -- -- (( 1010 )) zz ii kk == ff (( netnet ii kk zz )) == ff (( ΣΣ pp == 11 hh WW kk pp ·&Center Dot; ff (( ΣΣ qq == 11 dd xx ii qq WW qq pp ++ bb ythe y pp )) ++ bb zz kk )) -- -- -- (( 1111 )) 其中,netip y为隐藏层单元的第p维,netikz i为输出单元的第p维,代表块数据的编号,d代表输入数据的维度,h代表隐藏层的维度,zik为输入数据的第k维重建;Among them, net ip y is the p-th dimension of the hidden layer unit, netikz i is the p-th dimension of the output unit, which represents the number of the block data, d represents the dimension of the input data, h represents the dimension of the hidden layer, z ik is the dimension of the input data k-th dimension reconstruction; (7)式的一阶和二阶导数分别为: The first and second derivatives of (7) are: f'(x)=f(x)1-f(x) (12) f'(x)=f(x)1-f(x) (12) f”(x)=f(x)1-f(x)1-2f(x) (13) f”(x)=f(x)1-f(x)1-2f(x) (13) 依据(9)-(11)式,计算重建层关于w,by,bz的偏导数;According to (9)-(11), calculate the partial derivative of the reconstruction layer with respect to w, b y , b z ; ∂∂ zz ii kk ∂∂ WW rr sthe s == ff ′′ (( netnet ii kk zz )) [[ WW kk sthe s ff ′′ (( netnet ii sthe s ythe y )) xx ii rr ++ ff (( netnet ii sthe s ythe y )) ]] (( kk == rr )) ff ′′ (( netnet ii kk zz )) [[ WW kk sthe s ff ′′ (( netnet ii sthe s ythe y )) xx ii rr ]] (( kk ≠≠ rr )) -- -- -- (( 1414 )) ∂∂ zz ii kk ∂∂ bb ythe y rr == ff ′′ (( netnet ii kk zz )) [[ WW kk rr ff ′′ (( netnet ii rr ythe y )) ]] -- -- -- (( 1515 )) ∂∂ zz ii kk ∂∂ bb zz rr == ff ′′ (( netnet ii kk zz )) -- -- -- (( 1616 )) 式中Wrs为连接第r个输入和第s个隐藏层单元的权值,byr为隐藏层第r个单元的偏置,bzr为重建层第r个单元的偏置;In the formula, Wrs is the weight connecting the rth input and the sth hidden layer unit, b yr is the bias of the rth unit in the hidden layer, and b zr is the bias of the rth unit in the reconstruction layer; 由(9)-(16)式得出代价函数关于W,by,bz的偏导数:The partial derivatives of the cost function with respect to W, b y , b z are obtained from equations (9)-(16): ∂∂ cc ∂∂ WW rr sthe s == 11 mm ΣΣ ii == 11 mm {{ ΣΣ kk == 11 dd [[ xx ii kk -- zz ii kk zz ii kk (( 11 -- zz ii kk )) ff ′′ (( netnet ii kk zz )) WW kk sthe s ff ′′ (( netnet ii sthe s ythe y )) xx ii rr ]] ++ ff ′′ (( netnet ii kk zz )) ff (( netnet ii sthe s ythe y )) }} -- -- -- (( 1717 )) ∂∂ cc ∂∂ bb ythe y rr == -- 11 mm ΣΣ ii == 11 mm ΣΣ kk == 11 dd xx ii kk -- zz ii kk zz ii kk (( 11 -- zz ii kk )) ff ′′ (( netnet ii kk zz )) WW kk rr ff ′′ (( netnet ii rr ythe y )) -- -- -- (( 1818 )) ∂∂ cc ∂∂ bb zz rr == -- 11 mm ΣΣ ii == 11 mm ΣΣ kk == 11 dd xx ii kk -- zz ii kk zz ii kk (( 11 -- zz ii kk )) ff ′′ (( netnet ii kk zz )) -- -- -- (( 1919 )) 网络训练完成后,去除网络的数据重建,隐藏层的输出为所学特征,后续的网络层以前一层的输出为输入,并用同样的方式训练,即逐层贪婪训练网络,避免网络因初始权值过小而陷入局部最优解;最后将网络的各层结合在一起,利用网络学习到的特征进行分类,在预训练网络后面添加soft-max分类层精细调整整个预训练网络完成分类任务,若给定一组输入数据,输入属于某一类别i的概率等于 After the network training is completed, the data reconstruction of the network is removed, the output of the hidden layer is the learned feature, and the output of the subsequent network layer is the input of the previous layer, and it is trained in the same way, that is, the network is greedily trained layer by layer, so as to avoid the loss of the initial weight of the network. The value is too small to fall into the local optimal solution; finally, combine the layers of the network together, use the features learned by the network to classify, and add a soft-max classification layer after the pre-training network to fine-tune the entire pre-training network to complete the classification task. Given a set of input data, the probability that the input belongs to a certain class i is equal to PP (( YY == ii || RR ,, WW ,, bb )) == sthe s (( WW RR ++ bb )) == ee WW ii RR ++ bb jj ΣΣ jj ee WW ii RR ++ bb jj -- -- -- (( 2020 )) 式中R为逻辑回归层的输入,W,b为逻辑回归层的权重和偏置,所有输出的总和为1。 In the formula, R is the input of the logistic regression layer, W, b are the weight and bias of the logistic regression layer, and the sum of all outputs is 1. 4.如权利要求3所述的基于深度学习的超生颈动脉内中膜厚度测量方法,其特征是,逻辑回归层与堆栈式自编码器构成深度分类器,训练该深度分类器的过程如下:4. as claimed in claim 3, based on the deep learning method for measuring the thickness of the supersonic carotid artery intima-media, it is characterized in that the logistic regression layer and the stacked autoencoder constitute the depth classifier, and the process of training the depth classifier is as follows: (1).开始(1). Start (2).初始化分块数据的数据块大小b,预训练次数pt,预训练学习率pl,精细调节(fine-tuning)次数ft与学习率fl,隐藏层层数d,各隐藏层的神经元数目[d],输入数据的维数D,分类类别数C;(2). Initialize the data block size b of the block data, the number of pre-training pt, the pre-training learning rate pl, the number of fine-tuning (fine-tuning) times ft and the learning rate fl, the number of hidden layers d, the neural network of each hidden layer The number of elements [d], the dimension of the input data D, the number of classification categories C; (3)for每层L(1≤L≤d)(3) for each layer L (1≤L≤d) (4)构造d-vis的输入神经元,d-hid的隐藏层神经元(4) Construct the input neurons of d-vis and the hidden layer neurons of d-hid (5)if L是第一层,L=1(5) if L is the first layer, L=1 (6)d-vis=D(6) d-vis=D (7)d-hid=n[1](7) d-hid=n[1] (8)此时原始数据即为AE的输入(8) At this time, the original data is the input of AE (9)else(9)else (10)d-vis=n[L-1](10) d-vis=n[L-1] (11)d-hid=n[L](11)d-hid=n[L] (12)此时AE的输入为前一个AE的输出(12) At this time, the input of AE is the output of the previous AE (13)end(13) end (14)以随机变量初始化AE的权重矩阵W,by,bz初始化为零(14) Initialize the weight matrix W of AE with random variables, by, bz are initialized to zero (15)for每一次预训练(15) for each pre-training (16)for每个数据块(16) for each data block (17)计算重建层:(17) Calculate the reconstruction layer: z=f(W·f(W·x+by)+bz)z=f(W·f(W·x+b y )+b z ) (18)计算代价函数:(18) Calculate the cost function: cc == -- 11 bb [[ xx loglog (( zz )) -- (( 11 -- xx )) loglog (( 11 -- zz )) ]] (19)利用(17)-(19)式更新权重,学习率为pl(19) Utilize formula (17)-(19) to update the weight, and the learning rate is pl (20)end(20) end (21)end(21) end (22)去除数据重建层(22) Remove the data reconstruction layer (23)end(23) end (24)初始化逻辑回归层,输入神经元数目为n[d],输出神经元数目C(24) Initialize the logistic regression layer, the number of input neurons is n[d], and the number of output neurons is C (25)for每一次精细调节(25) for every fine adjustment (26)for每一个数据块(26) for each data block (27)由(20)式计算每一类别的可能性(27) Calculate the possibility of each category by formula (20) (28)用经典的后向传播法更新网络的权重项和偏置项,学习率为fl(28) Use the classic backpropagation method to update the weight and bias items of the network, and the learning rate is fl (29)end(29) end (30)end(30) end (31)结束(31) end 根据实际需要搭建两个不同的模式分类器,记为SAE_NB和SAE_LM,分别利用上述训练规则,在已选定的有代表性的训练集中训练两个深度模式分类器,利用SAE_NB将像素分为边界像素和非边界像素,再利用SAE_LM将边界像素分为LII和MAI像素。Build two different pattern classifiers according to actual needs, denoted as SAE_NB and SAE_LM, respectively use the above training rules to train two deep pattern classifiers in the selected representative training set, and use SAE_NB to divide pixels into boundaries pixels and non-boundary pixels, and then use SAE_LM to divide the boundary pixels into LII and MAI pixels. 根据偏差平方和最小原理,对分类边界进行多项式曲线拟合,其过程如下:According to the principle of the minimum sum of squared deviations, polynomial curve fitting is performed on the classification boundary, and the process is as follows: 设拟合多项式为:Let the fitting polynomial be: f=a0+a1·e+...+ak·ek (21)f=a 0 +a 1 e+...+a k e k (21) 其中,e、f分别为边界点像素的列值和行值,ak为多项式系数,k为多项式次数。Among them, e and f are the column value and row value of the boundary point pixel respectively, a k is the polynomial coefficient, and k is the polynomial degree. (2)各点到这条曲线的距离之和,即偏差平方如下: (2) The sum of the distances from each point to this curve, that is, the square of the deviation is as follows: RR 22 == ΣΣ ii == 11 nno [[ ff ii -- (( aa 00 ++ aa 11 ·· ee ii ++ aa kk ·&Center Dot; ee ii kk )) ]] 22 -- -- -- (( 22twenty two )) 其中,n为数据集大小,(ei,fi)为第i个像素点的列式和行值,R代表偏差。Among them, n is the size of the data set, (e i , f i ) is the column and row values of the i-th pixel, and R represents the deviation. (3)对等式右边求ai偏导数可得(3) Calculate the partial derivative of a i on the right side of the equation to get -- 22 ΣΣ ii == 11 nno [[ ff ii -- (( aa 00 ++ aa 11 ·&Center Dot; ee ii ++ ...... ++ aa kk ·&Center Dot; ee ii kk )) ]] ·&Center Dot; ff ii == 00 -- 22 ΣΣ ii == 11 nno [[ ff ii -- (( aa 00 ++ aa 11 ·&Center Dot; ee ii ++ ...... ++ aa kk ·&Center Dot; ee ii kk )) ]] ·&Center Dot; ff ii 22 == 00 ... ... -- 22 ΣΣ ii == 11 nno [[ ff ii -- (( aa 00 ++ aa 11 ·&Center Dot; ee ii ++ ...... ++ aa kk ·&Center Dot; ee ii kk )) ]] ·&Center Dot; ff ii kk == 00 -- -- -- (( 23twenty three )) (4)将左式化简,可得如下式 (4) Simplify the left formula to get the following formula aa 00 ·&Center Dot; ee ii 00 ++ aa 11 ΣΣ ii == 11 nno ee ii ++ ...... ++ aa kk ΣΣ ii == 11 nno ee ii kk aa 00 ·&Center Dot; ee ii 11 ++ aa 11 ΣΣ ii == 11 nno ee ii 22 ++ ...... ++ aa kk ΣΣ ii == 11 nno ee ii kk ++ 11 ... ... aa 00 ·&Center Dot; ee ii kk ++ aa 11 ΣΣ ii == 11 nno ee ii kk ++ 11 ++ ...... ++ aa kk ΣΣ ii == 11 nno ee ii 22 kk -- -- -- (( 24twenty four )) (5)将等式表示成矩阵形式 (5) Express the equation in matrix form nno ΣΣ ii == 11 nno ee ii ...... ΣΣ ii == 11 nno ee ii kk ΣΣ ii == 11 nno ee ii ΣΣ ii == 11 nno ee ii 22 ...... ΣΣ ii == 11 nno ee ii kk ++ 11 ...... ...... ...... ...... ΣΣ ii == 11 nno ee ii kk ΣΣ ii == 11 nno ee ii kk ++ 11 ...... ΣΣ ii == 11 nno ee ii 22 kk aa 00 aa 11 ...... aa kk == ΣΣ ii == 11 nno ff ii ΣΣ ii == 11 nno ee ii ff ii ...... ΣΣ ii == 11 nno ee ii kk ff ii -- -- -- (( 2525 )) (6)将(5)所得的范德蒙矩阵简化可得 (6) Simplify the Vandermonde matrix obtained in (5) to get 11 ee 11 ...... ee 11 kk 11 ee 22 ...... ee 22 kk ...... ...... ...... ...... 11 ee nno ...... ee nno kk aa 00 aa 11 ...... aa kk == ff 11 ff 22 ...... ff nno -- -- -- (( 2626 )) (7)(6)式即为E*A=F,则 (7) (6) formula is E*A=F, then A=(E*E)-1*E*F (27)A=(E*E) -1 *E*F (27) 得到系数矩阵同时也就得到了拟合曲线。When the coefficient matrix is obtained, the fitting curve is obtained at the same time. 5.一种基于深度学习的超生颈动脉内中膜厚度测量装置,其特征是,包括超声波检查仪和计算机构成,超声波检查仪产生的图像信号由计算机处理,计算机上设置有如下模块处理超声波图像:5. An ultrasonic carotid artery intima-media thickness measuring device based on deep learning is characterized in that it comprises an ultrasonograph and a computer, and the image signal generated by the ultrasonograph is processed by a computer, and the computer is provided with the following modules to process ultrasonic images : 1)ROI获取模块:采用卷积神经网络CNN(Convolution Neural Network)自动识别超声颈动脉血管的远端,进而提取ROI;1) ROI acquisition module: the convolutional neural network CNN (Convolution Neural Network) is used to automatically identify the distal end of the ultrasonic carotid artery, and then extract the ROI; 2)像素分类模块:以待分类像素为中心一定区域的像素灰度值信息作为堆栈式自编码器的输入,其输出作为输入的更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类;2) Pixel classification module: The pixel gray value information of a certain area centered on the pixel to be classified is used as the input of the stacked autoencoder, and its output is used as the input for higher-level feature extraction. After the feature extraction, a logistic regression classification layer is added to construct the pattern classification device to complete the classification of image pixels; 3)边界提取模块:利用目标分类区域的面积信息和位置对分类区域进行甄选。利用定位颈动脉最远端的行索引值与待判定区域的重心行值和面积信息去除距离目标区域近但是面积较大的错分类区域,利用目标最大区域与其余待判定的较小区域的重心行值进行比较,结合较小区域的面积信息去除距离目标区域较远且面积较小的区域,最后按列索引,去除内中膜结构不完整的区域;根据偏差平方和最小原理,对分类边界进行多项式曲线拟合。3) Boundary extraction module: use the area information and position of the target classification area to select the classification area. Use the row index value of the farthest end of the carotid artery and the barycenter row value and area information of the area to be determined to remove misclassified areas that are close to the target area but have a large area, and use the barycenter of the largest area of the target and the remaining smaller areas to be determined Compare the row values, combine the area information of the smaller area to remove the area that is farther away from the target area and have a smaller area, and finally index by column to remove the area with incomplete intima-media structure; Perform a polynomial curve fit.
CN201610819047.XA 2016-09-13 2016-09-13 Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning Pending CN106408017A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610819047.XA CN106408017A (en) 2016-09-13 2016-09-13 Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610819047.XA CN106408017A (en) 2016-09-13 2016-09-13 Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning

Publications (1)

Publication Number Publication Date
CN106408017A true CN106408017A (en) 2017-02-15

Family

ID=57999974

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610819047.XA Pending CN106408017A (en) 2016-09-13 2016-09-13 Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning

Country Status (1)

Country Link
CN (1) CN106408017A (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107832339A (en) * 2017-10-12 2018-03-23 赵胜男 Audiograph picture based on convolutional neural networks turns acoustic method
CN107871318A (en) * 2017-11-16 2018-04-03 吉林大学 A Model Migration-Based Method for Coronary Calcified Plaque Detection
CN108573491A (en) * 2017-03-10 2018-09-25 南京大学 A kind of three-dimensional ultrasound pattern dividing method based on machine learning
CN108962381A (en) * 2017-05-19 2018-12-07 西门子保健有限责任公司 The method based on study of personalized evaluation, long-term forecast and management for atherosclerosis
CN109166107A (en) * 2018-04-28 2019-01-08 北京市商汤科技开发有限公司 A kind of medical image cutting method and device, electronic equipment and storage medium
CN109285158A (en) * 2018-07-24 2019-01-29 深圳先进技术研究院 Vessel wall plaque segmentation method, device and computer readable storage medium
CN110047086A (en) * 2019-04-24 2019-07-23 飞依诺科技(苏州)有限公司 Carotic Intima-media Thinkness method for automatic measurement and system
CN110326004A (en) * 2017-02-24 2019-10-11 谷歌有限责任公司 Training strategy neural network using path consistency learning
CN110415239A (en) * 2019-08-01 2019-11-05 腾讯科技(深圳)有限公司 Image processing method, device, equipment, medical treatment electronic equipment and medium
CN112102233A (en) * 2020-08-05 2020-12-18 深圳市第二人民医院(深圳市转化医学研究院) Method, device, equipment and medium for discriminating cerebral apoplexy causes based on magnetic resonance image
CN112419283A (en) * 2019-11-27 2021-02-26 上海联影智能医疗科技有限公司 Neural network and method for estimating thickness
CN112932542A (en) * 2021-01-27 2021-06-11 深圳中科乐普医疗技术有限公司 Method and system for measuring thickness of intravascular medium membrane and ultrasonic imaging equipment
CN112967251A (en) * 2021-03-03 2021-06-15 网易(杭州)网络有限公司 Picture detection method, and training method and device of picture detection model
CN113439289A (en) * 2019-02-20 2021-09-24 帝国科学、技术与医学学院 Image processing for determining the thickness of an object
CN113838028A (en) * 2021-09-24 2021-12-24 无锡祥生医疗科技股份有限公司 Carotid artery ultrasonic automatic Doppler method, ultrasonic equipment and storage medium
CN114391878A (en) * 2022-01-27 2022-04-26 南京市溧水区人民医院 Ultrasonic imaging equipment
CN115334976A (en) * 2020-03-30 2022-11-11 泰尔茂株式会社 Computer program, information processing method, information processing device, and model generation method
US12548296B2 (en) 2022-08-25 2026-02-10 International Business Machines Corporation Spatially preserving flattening in deep learning neural networks

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104200224A (en) * 2014-08-28 2014-12-10 西北工业大学 Valueless image removing method based on deep convolutional neural networks
CN105930793A (en) * 2016-04-19 2016-09-07 中山大学 Human body detection method based on SAE characteristic visual learning

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104200224A (en) * 2014-08-28 2014-12-10 西北工业大学 Valueless image removing method based on deep convolutional neural networks
CN105930793A (en) * 2016-04-19 2016-09-07 中山大学 Human body detection method based on SAE characteristic visual learning

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
J. JIANG, ET AL.: "Medical image analysis with artificial neural networks", 《COMPUTERIZED MEDICAL IMAGING》 *
ROSA-MARÍA MENCHÓN-LARA,ET AL.: "Estimation of the ArterialDiameter in Ultrasound Images of the Common Carotid Artery", 《SPRINGER INTERNATIONAL PUBLISHING SWITZERLAND 2015》 *
刘一学 等: "基于支持向量机的颈动脉超声图像内中膜厚度测量", 《中国医学物理学杂志》 *
邓俊峰 等: "基于自动编码器组合的深度学习优化方法", 《计算机应用》 *

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110326004A (en) * 2017-02-24 2019-10-11 谷歌有限责任公司 Training strategy neural network using path consistency learning
CN108573491A (en) * 2017-03-10 2018-09-25 南京大学 A kind of three-dimensional ultrasound pattern dividing method based on machine learning
CN108962381A (en) * 2017-05-19 2018-12-07 西门子保健有限责任公司 The method based on study of personalized evaluation, long-term forecast and management for atherosclerosis
CN107832339A (en) * 2017-10-12 2018-03-23 赵胜男 Audiograph picture based on convolutional neural networks turns acoustic method
CN107871318A (en) * 2017-11-16 2018-04-03 吉林大学 A Model Migration-Based Method for Coronary Calcified Plaque Detection
CN109166107A (en) * 2018-04-28 2019-01-08 北京市商汤科技开发有限公司 A kind of medical image cutting method and device, electronic equipment and storage medium
CN109285158A (en) * 2018-07-24 2019-01-29 深圳先进技术研究院 Vessel wall plaque segmentation method, device and computer readable storage medium
CN113439289A (en) * 2019-02-20 2021-09-24 帝国科学、技术与医学学院 Image processing for determining the thickness of an object
CN110047086B (en) * 2019-04-24 2021-02-09 飞依诺科技(苏州)有限公司 Automatic carotid intimal thickness measuring method and system
CN110047086A (en) * 2019-04-24 2019-07-23 飞依诺科技(苏州)有限公司 Carotic Intima-media Thinkness method for automatic measurement and system
CN110415239B (en) * 2019-08-01 2022-12-16 腾讯科技(深圳)有限公司 Image processing method, image processing apparatus, medical electronic device, and medium
CN110415239A (en) * 2019-08-01 2019-11-05 腾讯科技(深圳)有限公司 Image processing method, device, equipment, medical treatment electronic equipment and medium
CN112419283A (en) * 2019-11-27 2021-02-26 上海联影智能医疗科技有限公司 Neural network and method for estimating thickness
CN115334976A (en) * 2020-03-30 2022-11-11 泰尔茂株式会社 Computer program, information processing method, information processing device, and model generation method
US12333718B2 (en) 2020-03-30 2025-06-17 Terumo Kabushiki Kaisha Method for generating model by recognizing cross-section regions in units of pixels
CN112102233A (en) * 2020-08-05 2020-12-18 深圳市第二人民医院(深圳市转化医学研究院) Method, device, equipment and medium for discriminating cerebral apoplexy causes based on magnetic resonance image
CN112102233B (en) * 2020-08-05 2023-12-26 深圳市第二人民医院(深圳市转化医学研究院) Brain stroke etiology screening method, device, equipment and medium based on magnetic resonance image
CN112932542A (en) * 2021-01-27 2021-06-11 深圳中科乐普医疗技术有限公司 Method and system for measuring thickness of intravascular medium membrane and ultrasonic imaging equipment
CN112967251A (en) * 2021-03-03 2021-06-15 网易(杭州)网络有限公司 Picture detection method, and training method and device of picture detection model
CN112967251B (en) * 2021-03-03 2024-06-04 网易(杭州)网络有限公司 Picture detection method, training method and device of picture detection model
CN113838028A (en) * 2021-09-24 2021-12-24 无锡祥生医疗科技股份有限公司 Carotid artery ultrasonic automatic Doppler method, ultrasonic equipment and storage medium
CN114391878A (en) * 2022-01-27 2022-04-26 南京市溧水区人民医院 Ultrasonic imaging equipment
CN114391878B (en) * 2022-01-27 2024-05-17 南京市溧水区人民医院 Ultrasonic imaging equipment
US12548296B2 (en) 2022-08-25 2026-02-10 International Business Machines Corporation Spatially preserving flattening in deep learning neural networks

Similar Documents

Publication Publication Date Title
CN106408017A (en) Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning
Edupuganti et al. Automatic optic disk and cup segmentation of fundus images using deep learning
CN109117864B (en) Coronary heart disease risk prediction method, model and system based on heterogeneous feature fusion
Fiorentino et al. A regression framework to head-circumference delineation from US fetal images
CN107610087B (en) Tongue coating automatic segmentation method based on deep learning
CN110599448A (en) Migratory learning lung lesion tissue detection system based on MaskScoring R-CNN network
CN108629370B (en) Classification recognition algorithm and device based on deep belief network
Samiappan et al. Classification of carotid artery abnormalities in ultrasound images using an artificial neural classifier.
CN118799693A (en) Intelligent identification method and system of carotid artery plaque based on multimodal image fusion
CN115147600A (en) GBM Multimodal MR Image Segmentation Method Based on Classifier Weight Converter
CN116704305A (en) Multi-modal and multi-section classification method for echocardiography based on deep learning algorithm
Wang OCT image recognition of cardiovascular vulnerable plaque based on CNN
Dhindsa et al. Grading prenatal hydronephrosis from ultrasound imaging using deep convolutional neural networks
Yasrab et al. End-to-end first trimester fetal ultrasound video automated crl and nt segmentation
Chu et al. Bone age assessment based on two-stage deep neural networks
CN115239695A (en) A system and method for pulmonary nodule recognition based on time series images
CN110956610A (en) Method and system for predicting thrombolytic curative effect of lower limb deep venous thrombosis based on sparse representation
Malik et al. Lung cancer detection at initial stage by using image processing and classification techniques
CN110705615A (en) Thyroid nodule detection and classification method based on TV model and GoogLeNet model
Yasmin et al. Impact of fuzziness for skin lesion classification with transformer-based model
CN110084796A (en) A kind of analysis method of complex texture CT image
CN114998195B (en) Pig B ultrasonic image fat content detection method based on depth regression network
Rani et al. A deep convolutional architectural framework for radiograph image processing at bit plane level for gender & age assessment
CN113066054B (en) A method for visualizing features of cervical OCT images for computer-aided diagnosis
CN106355578B (en) Ultrasound carotid artery distal recognition device and method based on convolutional neural network

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170215