CN106408017A - Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning - Google Patents
Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning Download PDFInfo
- Publication number
- CN106408017A CN106408017A CN201610819047.XA CN201610819047A CN106408017A CN 106408017 A CN106408017 A CN 106408017A CN 201610819047 A CN201610819047 A CN 201610819047A CN 106408017 A CN106408017 A CN 106408017A
- Authority
- CN
- China
- Prior art keywords
- sigma
- layer
- classification
- area
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Evolutionary Biology (AREA)
- Multimedia (AREA)
- Bioinformatics & Computational Biology (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Bioinformatics & Cheminformatics (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Image Analysis (AREA)
Abstract
本发明涉及医学图像处理,为提供一种总体性能较好的IMT测量算法,即无需人为参与,时间复杂度相对较低,自动测量结果与专家手动测量结果一致性较高,对不同形态结构的内种膜均能获得较满意的测量结果,本发明基于深度学习的超生颈动脉内中膜厚度测量方法,步骤如下:1)ROI获取:采用卷积神经网络CNN自动识别超声颈动脉血管的远端,进而提取ROI;2)像素分类:进行更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类;3)边界提取:利用目标分类区域的面积信息和位置对分类区域进行甄选,对分类边界进行多项式曲线拟合。本发明主要应用于医学图像处理。
The invention relates to medical image processing, in order to provide an IMT measurement algorithm with better overall performance, that is, without human participation, relatively low time complexity, high consistency between automatic measurement results and expert manual measurement results, and for different morphological structures Satisfactory measurement results can be obtained for the intima. The method for measuring the intima-media thickness of the ultrasonic carotid artery based on deep learning in the present invention has the following steps: 1) ROI acquisition: the convolutional neural network (CNN) is used to automatically identify the distant part of the ultrasonic carotid artery. 2) Pixel classification: perform more advanced feature extraction, and add a logistic regression classification layer after feature extraction to build a pattern classifier to complete the classification of image pixels; 3) Boundary extraction: use the area information and position of the target classification area The classification area is selected, and the polynomial curve fitting is performed on the classification boundary. The invention is mainly applied to medical image processing.
Description
技术领域technical field
本发明涉及医学图像处理,具体讲,涉及基于深度学习的超生颈动脉内中膜厚度测量装置和方法。The present invention relates to medical image processing, in particular, to a device and method for measuring the intima-media thickness of an ultrasonic carotid artery based on deep learning.
背景技术Background technique
心脑血管疾病已经成为危害人类健康的首要疾病。世界卫生组织的调查显示,2012年全球死于心脑血管疾病人数高达1750万,约占全球总死亡人口的30%。动脉粥样硬化是引发心脑血管疾病的首要原因,主要表现为血液中的类脂质和胆固醇在血管内壁的沉积使其内中膜增厚、弹性降低,这种病变情况可能会持续多年而不被发现,但是血管中的斑块会导致血管的完全阻塞,致脑中风、心肌梗塞。因此,动脉粥样硬化的早期追踪诊断对于心脑血管疾病的预防及其重要。众多研究表明颈动脉血管内中膜厚度(Intima MediaThickness,IMT),如图1所示管腔-内膜边界(Lumn-Intima Interface,LII)和中膜-外膜边界(Media-Adventitia Interface,MAI)之间的距离,可以有效反映动脉粥样硬化程度,是预测心脑血管疾病的重要指标。Cardiovascular and cerebrovascular diseases have become the primary diseases that endanger human health. According to the survey of the World Health Organization, the number of people who died of cardiovascular and cerebrovascular diseases in the world in 2012 was as high as 17.5 million, accounting for about 30% of the total global death population. Atherosclerosis is the primary cause of cardiovascular and cerebrovascular diseases. It is mainly manifested by the deposition of lipids and cholesterol in the blood on the inner wall of blood vessels, which makes the intima media thicker and less elastic. This pathological condition may last for many years and It is not discovered, but plaque in blood vessels can lead to complete blockage of blood vessels, resulting in stroke and myocardial infarction. Therefore, early follow-up diagnosis of atherosclerosis is extremely important for the prevention of cardiovascular and cerebrovascular diseases. Numerous studies have shown that carotid artery intima-media thickness (Intima MediaThickness, IMT), as shown in Figure 1, lumen-intima boundary (Lumn-Intima Interface, LII) and media-adventitia boundary (Media-Adventitia Interface, MAI ) can effectively reflect the degree of atherosclerosis and is an important indicator for predicting cardiovascular and cerebrovascular diseases.
超声图像因具有无侵入、价格低、成像快等优点在临床中得到广泛应用。为了保证IMT测量的可重复性,IMT在无斑块的颈动脉远端处测量,一般在颈动脉分叉以下至少5mm处,该部位存在明显的双线性结构。Ultrasound images are widely used in clinical practice because of their non-invasive, low price, and fast imaging. In order to ensure the reproducibility of IMT measurement, IMT was measured at the distal end of the carotid artery without plaque, generally at least 5 mm below the carotid bifurcation, where there was an obvious bilinear structure.
临床中内中膜厚度由医务人员手动进行标定、勾勒出LII和MAI边界来计算。由于操作人员的受训练程度以及经验不同,对边界的界定受主观认识的影响,导致不同操作人员得出不同的测量结果,即存在观察者间差异;即使同一操作者,在不同时间测量的结果也会出现不同,即观察者内误差,且不可重复,耗时、繁琐,无法满足现代医学海量数据处理的需要。基于以上原因,采用数字图像处理技术,实现一种全自动、快速、准确、鲁棒性强的IMT测量算法十分必要。Clinically, the intima-media thickness was calculated manually by medical staff, and by drawing the boundaries of LII and MAI. Due to the different levels of training and experience of operators, the definition of boundaries is affected by subjective cognition, resulting in different measurement results obtained by different operators, that is, there are differences between observers; even if the same operator, the results measured at different times There will also be differences, that is, intra-observer errors, which are not repeatable, time-consuming and cumbersome, and cannot meet the needs of massive data processing in modern medicine. Based on the above reasons, it is necessary to implement a fully automatic, fast, accurate and robust IMT measurement algorithm using digital image processing technology.
1986年,第一个IMT分割算法被提出,之后的30年中大量算法和方案相继被提出。IMT测量方案大致由两部分组成,第一步提取感兴趣区域(Region of Interest,ROI)并获取初始轮廓线,第二部获取精确轮廓线。就第一步而言,依据人工干预程度,现存的这些算法可以分为全自动测量算法和半自动测量算法。半自动分割需要人为选定ROI或感兴趣点,而全自动的方法则不需要人为干预,有学者利用水平集获得初始轮廓线并获得ROI,分水岭和模板匹配的方法也被应用于ROI的获取;第二步涉及动态规划、活动轮廓模型、神经网络模型、统计建模等众多理论。In 1986, the first IMT segmentation algorithm was proposed, and a large number of algorithms and schemes were proposed successively in the following 30 years. The IMT measurement scheme is roughly composed of two parts. The first step is to extract the region of interest (Region of Interest, ROI) and obtain the initial contour line, and the second part is to obtain the precise contour line. As far as the first step is concerned, according to the degree of manual intervention, these existing algorithms can be divided into fully automatic measurement algorithms and semi-automatic measurement algorithms. Semi-automatic segmentation requires artificial selection of ROI or points of interest, while fully automatic methods do not require human intervention. Some scholars use level sets to obtain initial contours and obtain ROIs. The methods of watershed and template matching are also applied to the acquisition of ROIs; The second step involves dynamic programming, active contour models, neural network models, statistical modeling and many other theories.
发明内容Contents of the invention
为克服现有技术的不足,本发明旨在提供一种总体性能较好的IMT测量算法,即无需人为参与,时间复杂度相对较低,自动测量结果与专家手动测量结果一致性较高,对不同形态结构的内种膜均能获得较满意的测量结果。针对第一阶段,本发明应用卷积神经网络自动识 别超生颈动脉远端,进而提取ROI。然后采用堆栈式自编码器加逻辑回归层构造的模式分类器对像素进行分类,并利用分类区域的面积信息和位置信息对分类结果进行甄别,去除错误分类的像素点,选择可靠的分类区域,运用曲线拟合提取边界完成IMT测量。本发明采用的技术方案是,基于深度学习的超生颈动脉内中膜厚度测量装置和方法,步骤如下:In order to overcome the deficiencies in the prior art, the present invention aims to provide an IMT measurement algorithm with better overall performance, that is, no human participation is required, the time complexity is relatively low, and the automatic measurement results are consistent with the expert manual measurement results. Satisfactory measurement results can be obtained for the inner seed membranes with different morphological structures. For the first stage, the present invention applies the convolutional neural network to automatically identify the distal end of the supercarotid artery, and then extracts the ROI. Then, the pattern classifier constructed by stacked autoencoder and logistic regression layer is used to classify the pixels, and the area information and position information of the classification area are used to screen the classification results, remove the wrongly classified pixels, and select a reliable classification area. Using curve fitting to extract the boundary to complete the IMT measurement. The technical scheme adopted in the present invention is a device and method for measuring intima-media thickness of the ultrasonic carotid artery based on deep learning, and the steps are as follows:
1)ROI获取:采用卷积神经网络CNN(Convolution Neural Network)自动识别超声颈动脉血管的远端,进而提取ROI;1) ROI acquisition: the convolutional neural network CNN (Convolution Neural Network) is used to automatically identify the distal end of the ultrasonic carotid artery, and then extract the ROI;
2)像素分类:以待分类像素为中心一定区域的像素灰度值信息作为堆栈式自编码器的输入,其输出作为输入的更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类;2) Pixel classification: The pixel gray value information of a certain area centered on the pixel to be classified is used as the input of the stacked autoencoder, and its output is used as the input for higher-level feature extraction. After the feature extraction, a logistic regression classification layer is added to construct a pattern classifier , to complete the classification of image pixels;
3)边界提取:利用目标分类区域的面积信息和位置对分类区域进行甄选。利用定位颈动脉最远端的行索引值与待判定区域的重心行值和面积信息去除距离目标区域近但是面积较大的错分类区域,利用目标最大区域与其余待判定的较小区域的重心行值进行比较,结合较小区域的面积信息去除距离目标区域较远且面积较小的区域,最后按列索引,去除内中膜结构不完整的区域;根据偏差平方和最小原理,对分类边界进行多项式曲线拟合。3) Boundary extraction: Use the area information and position of the target classification area to select the classification area. Use the row index value of the farthest end of the carotid artery and the barycenter row value and area information of the area to be determined to remove misclassified areas that are close to the target area but have a large area, and use the center of gravity between the largest area of the target and the remaining smaller areas to be determined Compare the row values, combine the area information of the smaller area to remove the area that is farther away from the target area and have a smaller area, and finally index by column to remove the area with incomplete intima-media structure; Perform a polynomial curve fit.
采用卷积神经网络CNN提取ROI具体步骤如下:The specific steps of ROI extraction using convolutional neural network CNN are as follows:
(1)裁剪图像,剪除图像中与图像分析无关的信息;(1) Crop the image, and cut out the information irrelevant to the image analysis in the image;
(2)将裁剪后的图像按列均匀五等分,沿等分的子图像的对称轴顺次取出一定大小的图像块;(2) the cropped image is evenly divided into five equal columns, and image blocks of a certain size are sequentially taken out along the symmetrical axis of the equally divided sub-image;
(3)将图像块作为已经训练好的CNN的输入,进行预测分类,类别数为2,即包含“暗-亮-暗-亮”结构的图像和无此结构的图像,选出同一子图像中归属包含“暗-亮-暗-亮”结构类的预测值最大的图像块;(3) The image block is used as the input of the trained CNN for predictive classification, the number of categories is 2, that is, the image containing the "dark-bright-dark-bright" structure and the image without this structure, and the same sub-image is selected The middle attribute contains the image block with the largest predicted value of the "dark-bright-dark-bright" structure class;
(4)将所得图像块的行索引值进行排序,甄选出能有效标定颈动脉远端的行索引值,并依据该索引值提取ROI,选取规则如下。(4) Sorting the row index values of the obtained image blocks, selecting the row index values that can effectively calibrate the distal end of the carotid artery, and extracting the ROI based on the index values, the selection rules are as follows.
r1、r2和r3分别为行索引值的最大值、次大值和中间值。m1,m2分别为r1、r2和r3、r2的均值,v为一设定的阈值,首选r3作为有效颈动脉远端索引值,如果r3小于某一阈值,则认为r3不能有效定义颈动脉远端,此时借助m1或m2。r1, r2 and r3 are the maximum value, the second maximum value and the middle value of the row index value respectively. m1, m2 are the mean values of r1, r2 and r3, r2 respectively, v is a set threshold, and r3 is preferred as the effective index value of the distal end of the carotid artery. If r3 is less than a certain threshold, it is considered that r3 cannot effectively define the distal end of the carotid artery. At this time, use m1 or m2.
自编码解码器AE(Auto Encoder)的算法执行过程包括编码过程和解码过程。其运算过程如式(1)(2)所示:The algorithm execution process of the Auto Encoder AE (Auto Encoder) includes an encoding process and a decoding process. Its operation process is shown in formula (1) (2):
y=f(wy*x+by) (1)y=f(w y *x+b y ) (1)
z=f(wz*y+bz) (2)z=f(w z *y+b z ) (2)
式中,x代表AE的输入,也代表隐藏层的输出,z代表AE的输出,wy、by分别为输入层到隐藏层的权重和偏置,wz、bz分别为隐藏层到输出层的权重和偏置,f(.)为激活函数;In the formula, x represents the input of AE, and also represents the output of the hidden layer, z represents the output of AE, w y , b y are the weights and biases from the input layer to the hidden layer, w z , b z are the weights and biases from the hidden layer to the hidden layer, respectively. The weight and bias of the output layer, f(.) is the activation function;
AE的训练过程即最小化误差函数的过程,The training process of AE is the process of minimizing the error function,
为了减少训练参数的个数,通常设定In order to reduce the number of training parameters, usually set
Wy=Wz=W (3)W y =W z =W (3)
选择下列规则更新权重项和偏置项,实现误差函数的最小化:Choose the following rules to update the weight term and bias term to minimize the error function:
堆栈式自编码器SAE(Stacked Auto Encoder)由多层自编码器组成,其前一层自编码器的输出作为其后一层自编码器的输入,最深隐藏层单元的激活值向量是对输入值的更高阶的表示;The stacked autoencoder SAE (Stacked Auto Encoder) is composed of a multi-layer autoencoder, the output of the previous layer of autoencoder is used as the input of the next layer of autoencoder, and the activation value vector of the deepest hidden layer unit is the input higher-order representation of values;
选取sigmoid函数作为编解码器的激活函数,在预训练过程中,网络主要学习三个参数W,by,bz,在设定参数更新规则前,需要合理确定误差项,即代价函数,选择交叉熵作为代价函数,同时将整个训练数据均分为小块数据,因此对于整个数据集,以小块数据更新参数:Select the sigmoid function as the activation function of the codec. In the pre-training process, the network mainly learns three parameters W, b y , b z . Before setting the parameter update rules, it is necessary to reasonably determine the error term, that is, the cost function. Select Cross entropy is used as a cost function, and at the same time the entire training data is divided into small pieces of data, so for the entire data set, the parameters are updated with small pieces of data:
式中,d为输入向量维数,m为数据块大小,xik、zik分别为所选块中第i个输入数据的第k个分量;In the formula, d is the dimension of the input vector, m is the size of the data block, x ik and z ik are the kth component of the i-th input data in the selected block respectively;
以随机梯度下降法优化(8)式,首先以标量的形式表示重构层:To optimize formula (8) with stochastic gradient descent method, first express the reconstruction layer in the form of scalar:
其中,netip y为隐藏层单元的第p维,netikz i为输出单元的第p维,代表块数据的编号,d代表输入数据的维度,h代表隐藏层的维度,zik为输入数据的第k维重建;Among them, net ip y is the p-th dimension of the hidden layer unit, netikz i is the p-th dimension of the output unit, which represents the number of the block data, d represents the dimension of the input data, h represents the dimension of the hidden layer, z ik is the dimension of the input data k-th dimension reconstruction;
(7)式的一阶和二阶导数分别为:The first and second derivatives of (7) are:
f'(x)=f(x)1-f(x) (12)f'(x)=f(x)1-f(x) (12)
f”(x)=f(x)1-f(x)1-2f(x) (13)f"(x)=f(x)1-f(x)1-2f(x) (13)
依据(9)-(11)式,计算重建层关于w,by,bz的偏导数;According to (9)-(11), calculate the partial derivative of the reconstruction layer with respect to w, b y , b z ;
式中Wrs为连接第r个输入和第s个隐藏层单元的权值,byr为隐藏层第r个单元的偏置,bzr为重建层第r个单元的偏置;In the formula, Wrs is the weight connecting the rth input and the sth hidden layer unit, b yr is the bias of the rth unit in the hidden layer, and b zr is the bias of the rth unit in the reconstruction layer;
由(9)-(16)式得出代价函数关于W,by,bz的偏导数:The partial derivatives of the cost function with respect to W, b y , b z are obtained from equations (9)-(16):
网络训练完成后,去除网络的数据重建,隐藏层的输出为所学特征,后续的网络层以前一层的输出为输入,并用同样的方式训练,即逐层贪婪训练网络,避免网络因初始权值过小而陷入局部最优解;最后将网络的各层结合在一起,利用网络学习到的特征进行分类,在预训练网络后面添加soft-max分类层精细调整整个预训练网络完成分类任务,若给定一组输入数据,输入属于某一类别i的概率等于After the network training is completed, the data reconstruction of the network is removed, the output of the hidden layer is the learned feature, and the output of the subsequent network layer is the input of the previous layer, and it is trained in the same way, that is, the network is greedily trained layer by layer, so as to avoid the loss of the network due to the initial weight loss. The value is too small to fall into the local optimal solution; finally, combine the layers of the network together, use the features learned by the network to classify, and add a soft-max classification layer after the pre-training network to fine-tune the entire pre-training network to complete the classification task. Given a set of input data, the probability that the input belongs to a certain class i is equal to
式中R为逻辑回归层的输入,W,b为逻辑回归层的权重和偏置,所有输出的总和为1。In the formula, R is the input of the logistic regression layer, W, b are the weight and bias of the logistic regression layer, and the sum of all outputs is 1.
逻辑回归层与堆栈式自编码器构成深度分类器,训练该深度分类器的过程如下:The logistic regression layer and the stacked autoencoder form a deep classifier. The process of training the deep classifier is as follows:
根据实际需要搭建两个不同的模式分类器,记为SAE_NB和SAE_LM,分别利用上述训练规则,在已选定的有代表性的训练集中训练两个深度模式分类器,利用SAE_NB将像素分为边界像素和非边界像素,再利用SAE_LM将边界像素分为LII和MAI像素。Build two different pattern classifiers according to actual needs, denoted as SAE_NB and SAE_LM, respectively use the above training rules to train two deep pattern classifiers in the selected representative training set, and use SAE_NB to divide pixels into boundaries pixels and non-boundary pixels, and then use SAE_LM to divide the boundary pixels into LII and MAI pixels.
根据偏差平方和最小原理,对分类边界进行多项式曲线拟合,其过程如下:According to the principle of the minimum sum of squared deviations, polynomial curve fitting is performed on the classification boundary, and the process is as follows:
设拟合多项式为:Let the fitting polynomial be:
f=a0+a1·e+...+ak·ek (21)f=a 0 +a 1 e+...+a k e k (21)
其中,e、f分别为边界点像素的列值和行值,ak为多项式系数,k为多项式次数。Among them, e and f are the column value and row value of the boundary point pixel respectively, a k is the polynomial coefficient, and k is the polynomial degree.
(2)各点到这条曲线的距离之和,即偏差平方如下:(2) The sum of the distances from each point to this curve, that is, the square of the deviation is as follows:
其中,n为数据集大小,(ei,fi)为第i个像素点的列式和行值,R代表偏差。Among them, n is the size of the data set, (e i , f i ) is the column and row values of the i-th pixel, and R represents the deviation.
(3)对等式右边求ai偏导数可得(3) Calculate the partial derivative of a i on the right side of the equation to get
(4)将左式化简,可得如下式(4) Simplify the left formula to get the following formula
(5)将等式表示成矩阵形式(5) Express the equation in matrix form
(6)将(5)所得的范德蒙矩阵简化可得(6) Simplify the Vandermonde matrix obtained in (5) to get
(7)(6)式即为E*A=F,则(7) (6) formula is E*A=F, then
A=(E*E)-1*E*F (27)A=(E*E) -1 *E*F (27)
得到系数矩阵同时也就得到了拟合曲线。When the coefficient matrix is obtained, the fitting curve is obtained at the same time.
本发明的特点及有益效果是:Features and beneficial effects of the present invention are:
本发明能有效解决目前IMT算法中普遍存在的总体性能欠佳的问题,能实现对IMT全自动、快速、准确、鲁棒性强的测量。The invention can effectively solve the problem of generally poor overall performance in current IMT algorithms, and can realize fully automatic, fast, accurate and robust measurement of IMT.
在在ROI选取阶段,应用CNN识别超生颈动脉的远端,CNN对有较大形变的输入数据具有一定的容忍能力,对噪声具有一定的鲁棒性;对CNN的识别结果进行判别以保证对不同图像都能准确定位颈动脉远端,正确提取ROI。In the ROI selection stage, the CNN is used to identify the distal end of the ultrasonic carotid artery. CNN has a certain tolerance to the input data with large deformation and has certain robustness to noise; Different images can accurately locate the distal end of the carotid artery and correctly extract the ROI.
在像素分类阶段,根据分类集的不同特点,搭建不同的栈式自编码器;栈式自编码器逐层提取输入数据数据的特征,最终得到数据的深层特征并进行分类,保证了分类的高效性和有效性。In the pixel classification stage, according to the different characteristics of the classification set, different stacked autoencoders are built; the stacked autoencoder extracts the features of the input data layer by layer, and finally obtains the deep features of the data and classifies them to ensure the efficiency of classification. sex and effectiveness.
在边界提取阶段,考虑到所用超生图像的内中膜结构不完全,难免会出现断裂,在选定可靠分类区域时不仅考虑区域的面积而且考虑区域的位置。In the boundary extraction stage, considering the incomplete intima-media structure of the ultrasound images used, it is inevitable that there will be fractures. When selecting reliable classification regions, not only the area of the region but also the location of the region should be considered.
附图说明:Description of drawings:
图1颈动脉超声轴向截面。Figure 1 Ultrasound axial section of the carotid artery.
图2单层自编码器示意图。Figure 2. Schematic diagram of a single-layer autoencoder.
图3本发明采用的算法流程图。Fig. 3 is an algorithm flow chart adopted by the present invention.
图4模式分类器分类像素的示意图。Figure 4. Schematic diagram of pattern classifier classifying pixels.
具体实施方式detailed description
尽管近些年IMT分割算法已经取得了突破性进展,但是现存的这些算法很难同时满足全自动、快速、准确、鲁棒性强等方面的要求。本发明旨在开发一种总体性能较好的IMT测量算法,即无需人为参与,时间复杂度相对较低,自动测量结果与专家手动测量结果一致性较高,对不同形态结构的内种膜均能获得较满意的测量结果。针对第一阶段,本发明应用卷积神经网络自动识别超生颈动脉远端,进而提取ROI。然后采用堆栈式自编码器加逻辑回归层构造的模式分类器对像素进行分类,并利用分类区域的面积信息和位置信息对分类结果进行甄别,去除错误分类的像素点,选择可靠的分类区域,运用曲线拟合提取边界完成IMT测量。Although IMT segmentation algorithms have made breakthroughs in recent years, it is difficult for these existing algorithms to meet the requirements of full automation, speed, accuracy, and robustness at the same time. The present invention aims to develop an IMT measurement algorithm with better overall performance, that is, without human participation, relatively low time complexity, high consistency between automatic measurement results and expert manual measurement results, and uniform for internal seed films with different morphological structures. Satisfactory measurement results can be obtained. For the first stage, the present invention applies the convolutional neural network to automatically identify the distal end of the superborn carotid artery, and then extracts the ROI. Then, the pattern classifier constructed by stacked autoencoder and logistic regression layer is used to classify the pixels, and the area information and position information of the classification area are used to screen the classification results, remove the wrongly classified pixels, and select a reliable classification area. Using curve fitting to extract the boundary to complete the IMT measurement.
1ROI获取1ROI acquisition
为了保证全自动、快速、准确获取ROI,本发明采用卷积神经网络(ConvolutionNeural Network,CNN)自动识别超声颈动脉血管的远端,进而提取ROI,具体步骤如下:In order to ensure fully automatic, fast and accurate ROI acquisition, the present invention adopts a convolution neural network (ConvolutionNeural Network, CNN) to automatically identify the distal end of the ultrasonic carotid artery vessel, and then extract the ROI. The specific steps are as follows:
(1)裁剪图像,剪除图像中与图像分析无关的信息,如原始的超生图像边缘中包含的受试者的个人信息。(1) Crop the image, cut out the information irrelevant to the image analysis in the image, such as the personal information of the subject contained in the edge of the original ultrasound image.
(2)将裁剪后的图像按列均匀五等分。沿等分的子图像的对称轴顺次取出一定大小的图像块。(2) Evenly divide the cropped image into five equal columns. Image blocks of a certain size are sequentially taken out along the symmetry axis of the equally divided sub-image.
(3)将图像块作为已经训练好的CNN的输入,进行预测分类,类别数为2,即包含“暗-亮-暗-亮”结构的图像和无此结构的图像,选出同一子图像中归属包含“暗-亮-暗-亮”结构类的预测值最大的图像块。(3) The image block is used as the input of the trained CNN for predictive classification, the number of categories is 2, that is, the image containing the "dark-bright-dark-bright" structure and the image without this structure, and the same sub-image is selected The medium belongs to the image block containing the largest predicted value of the "dark-bright-dark-bright" structure class.
(4)将所得图像块的行索引值进行排序,甄选出能有效标定颈动脉远端的行索引值,并依据该索引值提取ROI,选取规则如下。(4) Sorting the row index values of the obtained image blocks, selecting the row index values that can effectively calibrate the distal end of the carotid artery, and extracting the ROI based on the index values, the selection rules are as follows.
r1、r2和r3分别为行索引值的最大值、次大值和中间值。m1,m2分别为r1、r2和r3、r2的均值。v为一设定的阈值,本发明中首选r3作为有效颈动脉远端索引值,一般颈动脉远端位于整张超声图像中间偏下位置,因此如果r3小于某一阈值,则认为r3不能有效定义颈动脉远端,此时借助m1或m2。r1, r2 and r3 are the maximum value, the second maximum value and the middle value of the row index value respectively. m1, m2 are the mean values of r1, r2 and r3, r2 respectively. v is a set threshold. In the present invention, r3 is preferred as the effective index value of the distal end of the carotid artery. Generally, the distal end of the carotid artery is located in the middle and lower position of the entire ultrasound image. Therefore, if r3 is less than a certain threshold, r3 is considered to be ineffective. Define the distal end of the carotid artery, this time with m1 or m2.
2像素分类2 pixel classification
深度学习架构由多层非线性运算单元组成,研究表明函数族提取出的深层特征表达较单一函数提取的浅层特征更有效。堆栈自编码网络(Stacked Autoencoder,SAE)以数值模型来构建的深度神经网络,其隐层节点是具有实际意义的计算单元。对于具备连续性和确定性的数值数据,数值模型会获得更好的训练效果。The deep learning architecture is composed of multi-layer nonlinear computing units. Studies have shown that the deep feature expression extracted by the function family is more effective than the shallow feature extracted by a single function. Stacked Autoencoder (SAE) is a deep neural network built with a numerical model, and its hidden layer nodes are computational units with practical significance. For numerical data with continuity and determinism, the numerical model will obtain better training results.
自编码器(Auto Encoder,AE)是一种无监督学习算法,使用反向传播算法,并让目标值等于输入值,即z≈x。Auto Encoder (AE) is an unsupervised learning algorithm that uses the backpropagation algorithm and makes the target value equal to the input value, ie z≈x.
如图2单层自编码器示意图所示。A schematic diagram of a single-layer autoencoder is shown in Figure 2.
AE的算法执行过程包括编码过程和解码过程。其运算过程如式(1)(2)所示:The algorithm execution process of AE includes encoding process and decoding process. Its operation process is shown in formula (1) (2):
y=f(wy*x+by) (1)y=f(w y *x+b y ) (1)
z=f(wz*y+bz) (2)z=f(w z *y+b z ) (2)
式中,wy、by分别为输入层到隐藏层的权重和偏置,wz、bz分别为隐藏层到输出层的权重和偏置,f(.)为激活函数。In the formula, wy and by are the weight and bias from the input layer to the hidden layer respectively, wz and bz are the weight and bias from the hidden layer to the output layer respectively, and f(.) is the activation function.
AE的训练过程即最小化误差函数的过程,The training process of AE is the process of minimizing the error function,
为了减少训练参数的个数,通常设定In order to reduce the number of training parameters, usually set
Wy=Wz=W (3)W y =W z =W (3)
一般选择下列规则更新权重项和偏置项,实现误差函数的最小化:Generally, the following rules are selected to update the weight term and bias term to minimize the error function:
栈式自编码神经网络是一个由多层自编码器组成的神经网络,其前一层自编码器的输出作为其后一层自编码器的输入,最深层隐藏单元的激活值向量是对输入值的更高阶的表示。The stacked autoencoder neural network is a neural network composed of multi-layer autoencoders, the output of the previous layer of autoencoder is used as the input of the next layer of autoencoder, and the activation value vector of the deepest hidden unit is the input A higher-order representation of a value.
本发明运用模式识别的相关技术解决图像像素分类的问题,完成图像分割。具体地,以待分类像素为中心一定区域的像素灰度值信息作为堆栈式自编码器的输入,其输出作为输入的更高级特征提取,特征提取后加逻辑回归分类层构建模式分类器,完成图像像素的分类。sigmoid函数能进行非线性映,其输出范围有限,数据在传递的过程中不容易发散,因此本文中选取sigmoid函数作为编解码器的激活函数。在预训练过程中,网络主要学习三个参数W,by,bz。在设定参数更新规则前,需要合理确定误差项,即代价函数。因为激活函数选用sigmoid函数,所以代价函数的导数会因为神经元输出为0或1而趋近于0。如果采用交叉熵,即使网络节点趋于饱和,参数仍会继续更新,最终选择交叉熵作为代价函数。同时将整个训 练数据均分为小块数据,因此对于整个数据集,采用以小块数据更新参数。The invention uses the relevant technology of pattern recognition to solve the problem of image pixel classification and completes image segmentation. Specifically, the pixel gray value information of a certain area centered on the pixel to be classified is used as the input of the stacked autoencoder, and its output is used as the input for higher-level feature extraction. After the feature extraction, a logistic regression classification layer is added to construct a pattern classifier, and the model is completed. Classification of image pixels. The sigmoid function can perform nonlinear mapping, its output range is limited, and the data is not easy to diverge in the process of transmission, so the sigmoid function is selected as the activation function of the codec in this paper. During the pre-training process, the network mainly learns three parameters W, by, bz. Before setting the parameter update rules, it is necessary to reasonably determine the error term, that is, the cost function. Because the activation function uses the sigmoid function, the derivative of the cost function will approach 0 because the neuron output is 0 or 1. If cross-entropy is used, even if the network nodes tend to be saturated, the parameters will continue to be updated, and finally cross-entropy is selected as the cost function. At the same time, the entire training data is divided into small pieces of data, so for the entire data set, the parameters are updated with small pieces of data.
式中,d为输入向量维数,m为数据块大小,xik(zik)为所选块中第i个输入数据的第k个分量。where d is the dimension of the input vector, m is the size of the data block, and x ik (zi ik ) is the kth component of the i-th input data in the selected block.
以随机梯度下降法优化(8)式,首先以标量的形式表示重构层:To optimize formula (8) with stochastic gradient descent method, first express the reconstruction layer in the form of scalar:
其中,netip y(netik z)为隐藏层(输出)单元的第p维,i代表块数据的编号,d代表输入数据的维度,h代表隐藏层的维度。zik为输入数据的第k维重建。Among them, net ip y (net ik z ) is the p-th dimension of the hidden layer (output) unit, i represents the number of the block data, d represents the dimension of the input data, and h represents the dimension of the hidden layer. z ik is the k-th dimensional reconstruction of the input data.
(7)式的一阶和二阶导数分别为:The first and second derivatives of (7) are:
f'(x)=f(x)1-f(x) (12)f'(x)=f(x)1-f(x) (12)
f”(x)=f(x)1-f(x)1-2f(x) (13)f"(x)=f(x)1-f(x)1-2f(x) (13)
依据(9)-(11)式,计算重建层关于w,by,bz的偏导数;According to (9)-(11), calculate the partial derivative of the reconstruction layer with respect to w, b y , b z ;
式中Wrs为连接第r个输入和第s个隐藏层单元的权值,byr(bzr)为隐藏层(重建层)第r个单元的偏置。In the formula, Wrs is the weight connecting the rth input and the sth hidden layer unit, b yr (b zr ) is the bias of the rth unit in the hidden layer (reconstruction layer).
由(9)-(16)式得出代价函数关于W,by,bz的偏导数:The partial derivatives of the cost function with respect to W, b y , b z are obtained from equations (9)-(16):
网络训练完成后,去除网络的数据重建,隐藏层的输出为所学特征,后续的网络层以前一层的输出为输入,并用同样的方式训练,即逐层贪婪训练网络,避免网络因初始权值过小而陷入局部最优解;最后将网络的各层结合在一起,利用网络学习到的特征进行分类,在预训练网络后面添加soft-max分类层精细调整整个预训练网络完成分类任务,若给定一组输入数据,输入属于某一类别i的概率等于After the network training is completed, the data reconstruction of the network is removed, the output of the hidden layer is the learned feature, and the output of the subsequent network layer is the input of the previous layer, and it is trained in the same way, that is, the network is greedily trained layer by layer, so as to avoid the loss of the network due to the initial weight loss. The value is too small to fall into the local optimal solution; finally, combine the layers of the network together, use the features learned by the network to classify, and add a soft-max classification layer after the pre-training network to fine-tune the entire pre-training network to complete the classification task. Given a set of input data, the probability that the input belongs to a certain class i is equal to
式中R为逻辑回归层的输入,W,b为逻辑回归层的权重和偏置,所有输出的总和为1。In the formula, R is the input of the logistic regression layer, W, b are the weight and bias of the logistic regression layer, and the sum of all outputs is 1.
逻辑回归层与堆栈式自编码器构成深度分类器,训练该深度分类器的过程如下:The logistic regression layer and the stacked autoencoder form a deep classifier. The process of training the deep classifier is as follows:
本发明中根据实际需要搭建两个不同的模式分类器,记为SAE_NB和SAE_LM,分别利用上述训练规则,在已选定的有代表性的训练集中训练两个深度模式分类器。利用SAE_NB将像素分为边界像素和非边界像素,再利用SAE_LM将边界像素分为LII和MAI像素。In the present invention, two different pattern classifiers are built according to actual needs, which are recorded as SAE_NB and SAE_LM, and the above-mentioned training rules are used respectively to train two deep pattern classifiers in the selected representative training set. Use SAE_NB to divide the pixels into boundary pixels and non-boundary pixels, and then use SAE_LM to divide the boundary pixels into LII and MAI pixels.
3边界提取3 boundary extraction
由于超声图像的分辨率和信噪比较低,且模式的相似性比较高,会出现错误分类现象。假阳性错误,即将非边界点错误地分类为边界点,对最终的结果影响较大,因此需要对分类结果进行筛选甄别,本发明利用目标分类区域的面积信息和位置对分类区域进行甄选。利用定位颈动脉最远端的行索引值与待判定区域的重心行值和面积信息去除距离目标区域近但是面积较大的错分类区域,利用目标最大区域与其余待判定的较小区域的重心行值进行比较,结合较小区域的面积信息去除距离目标区域较远且面积较小的区域,最后按列索引,去除内中膜结构不完整的区域。Due to the low resolution and signal-to-noise ratio of ultrasound images and the relatively high similarity of patterns, misclassification occurs. False positive errors, that is, wrongly classify non-boundary points as boundary points, have a great impact on the final result. Therefore, it is necessary to screen the classification results. The present invention uses the area information and position of the target classification area to select the classification area. Use the row index value of the farthest end of the carotid artery and the barycenter row value and area information of the area to be determined to remove misclassified areas that are close to the target area but have a large area, and use the center of gravity between the largest area of the target and the remaining smaller areas to be determined The row values are compared, combined with the area information of the smaller area to remove the area that is far away from the target area and the area is small, and finally indexed by column to remove the area with incomplete intima-media structure.
由于超声图像的质量较差,得出的边界并不是单像素宽度,这也是手动测量出现观察者间差异的主要原因。为消除此差异性,根据偏差平方和最小原理,对分类边界进行多项式曲线拟合,其过程如下:Due to the poor quality of the ultrasound images, the derived borders are not a single pixel wide, which is the main reason for interobserver variability in manual measurements. In order to eliminate this difference, according to the principle of the minimum sum of squared deviations, polynomial curve fitting is carried out on the classification boundary, and the process is as follows:
设拟合多项式为:Let the fitting polynomial be:
f=a0+a1·e+...+ak·ek (21)f=a 0 +a 1 e+...+a k e k (21)
其中,e、f分别为边界点像素的列值和行值,ak、为多项式系数,k为多项式次数。Among them, e and f are the column value and row value of the boundary point pixel respectively, ak and are the polynomial coefficients, and k is the degree of the polynomial.
(2)各点到这条曲线的距离之和,即偏差平方如下:(2) The sum of the distances from each point to this curve, that is, the square of the deviation is as follows:
其中,n为数据集大小,(ei,fi)为第i个像素点的列式和行值,R代表偏差。Among them, n is the size of the data set, (ei, fi) is the column and row values of the i-th pixel, and R represents the deviation.
(3)对等式右边求ai偏导数可得(3) Calculate the partial derivative of ai on the right side of the equation to get
(4)将左式化简,可得如下式(4) Simplify the left formula to get the following formula
(5)将等式表示成矩阵形式(5) Express the equation in matrix form
(6)将(5)所得的范德蒙矩阵简化可得(6) Simplify the Vandermonde matrix obtained in (5) to get
(7)(6)式即为E*A=F,则(7) (6) formula is E*A=F, then
A=(E*E)-1*E*F (27)A=(E*E) -1 *E*F (27)
得到系数矩阵同时也就得到了拟合曲线。When the coefficient matrix is obtained, the fitting curve is obtained at the same time.
有益效果Beneficial effect
本发明能有效解决目前IMT算法中普遍存在的总体性能欠佳的问题,能实现对IMT全自动、快速、准确、鲁棒性强的测量。The invention can effectively solve the problem of generally poor overall performance in current IMT algorithms, and can realize fully automatic, fast, accurate and robust measurement of IMT.
在在ROI选取阶段,应用CNN识别超生颈动脉的远端,CNN对有较大形变的输入数据具有一定的容忍能力,对噪声具有一定的鲁棒性;对CNN的识别结果进行判别以保证对不同图像都能准确定位颈动脉远端,正确提取ROI。In the ROI selection stage, the CNN is used to identify the distal end of the ultrasonic carotid artery. CNN has a certain tolerance to the input data with large deformation and has certain robustness to noise; Different images can accurately locate the distal end of the carotid artery and correctly extract the ROI.
在像素分类阶段,根据分类集的不同特点,搭建不同的栈式自编码器;栈式自编码器逐层提取输入数据数据的特征,最终得到数据的深层特征并进行分类,保证了分类的高效性和 有效性。In the pixel classification stage, according to the different characteristics of the classification set, different stacked autoencoders are built; the stacked autoencoder extracts the features of the input data layer by layer, and finally obtains the deep features of the data and classifies them to ensure the efficiency of classification. sex and effectiveness.
在边界提取阶段,考虑到所用超生图像的内中膜结构不完全,难免会出现断裂,在选定可靠分类区域时不仅考虑区域的面积而且考虑区域的位置。In the boundary extraction stage, considering the incomplete intima-media structure of the ultrasound images used, it is inevitable that there will be fractures. When selecting reliable classification regions, not only the area of the region but also the location of the region should be considered.
图3描述了本发明所提出的一种基于深度学习的IMT测量算法流程图。首先对输入的超声颈动脉图像进行裁剪、均分、获取子图像,对子图像进行分类预测,获取能有效标定颈动脉远端的行索引值,并获取ROI。用特定的窗对ROI进行处理,先将经过窗处理的像素模式信息作为SAE_NB分类器的输入,将像素分类为非边界像素和边界像素,然后再利用SAE_LM分类器将边界像素分类为LII和MAI像素,最后利用分类区域的面积信息和位置信息对分类结果进行甄选,搜索含有完整内中膜结构的分类区域,依据最小偏差平方和原理,拟合最终出边界,完成IMT测量。Fig. 3 describes a flow chart of an IMT measurement algorithm based on deep learning proposed by the present invention. Firstly, the input ultrasonic carotid artery image is cropped, averaged, and sub-images are obtained, and the sub-images are classified and predicted, and the row index value that can effectively calibrate the distal end of the carotid artery is obtained, and the ROI is obtained. Use a specific window to process the ROI, first use the window-processed pixel pattern information as the input of the SAE_NB classifier, classify the pixels into non-boundary pixels and boundary pixels, and then use the SAE_LM classifier to classify the boundary pixels into LII and MAI Pixel, and finally use the area information and position information of the classification area to select the classification results, search for the classification area containing the complete intima-media structure, and fit the final boundary according to the principle of the least square sum of deviations to complete the IMT measurement.
Claims (5)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610819047.XA CN106408017A (en) | 2016-09-13 | 2016-09-13 | Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610819047.XA CN106408017A (en) | 2016-09-13 | 2016-09-13 | Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106408017A true CN106408017A (en) | 2017-02-15 |
Family
ID=57999974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610819047.XA Pending CN106408017A (en) | 2016-09-13 | 2016-09-13 | Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106408017A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107832339A (en) * | 2017-10-12 | 2018-03-23 | 赵胜男 | Audiograph picture based on convolutional neural networks turns acoustic method |
| CN107871318A (en) * | 2017-11-16 | 2018-04-03 | 吉林大学 | A Model Migration-Based Method for Coronary Calcified Plaque Detection |
| CN108573491A (en) * | 2017-03-10 | 2018-09-25 | 南京大学 | A kind of three-dimensional ultrasound pattern dividing method based on machine learning |
| CN108962381A (en) * | 2017-05-19 | 2018-12-07 | 西门子保健有限责任公司 | The method based on study of personalized evaluation, long-term forecast and management for atherosclerosis |
| CN109166107A (en) * | 2018-04-28 | 2019-01-08 | 北京市商汤科技开发有限公司 | A kind of medical image cutting method and device, electronic equipment and storage medium |
| CN109285158A (en) * | 2018-07-24 | 2019-01-29 | 深圳先进技术研究院 | Vessel wall plaque segmentation method, device and computer readable storage medium |
| CN110047086A (en) * | 2019-04-24 | 2019-07-23 | 飞依诺科技(苏州)有限公司 | Carotic Intima-media Thinkness method for automatic measurement and system |
| CN110326004A (en) * | 2017-02-24 | 2019-10-11 | 谷歌有限责任公司 | Training strategy neural network using path consistency learning |
| CN110415239A (en) * | 2019-08-01 | 2019-11-05 | 腾讯科技(深圳)有限公司 | Image processing method, device, equipment, medical treatment electronic equipment and medium |
| CN112102233A (en) * | 2020-08-05 | 2020-12-18 | 深圳市第二人民医院(深圳市转化医学研究院) | Method, device, equipment and medium for discriminating cerebral apoplexy causes based on magnetic resonance image |
| CN112419283A (en) * | 2019-11-27 | 2021-02-26 | 上海联影智能医疗科技有限公司 | Neural network and method for estimating thickness |
| CN112932542A (en) * | 2021-01-27 | 2021-06-11 | 深圳中科乐普医疗技术有限公司 | Method and system for measuring thickness of intravascular medium membrane and ultrasonic imaging equipment |
| CN112967251A (en) * | 2021-03-03 | 2021-06-15 | 网易(杭州)网络有限公司 | Picture detection method, and training method and device of picture detection model |
| CN113439289A (en) * | 2019-02-20 | 2021-09-24 | 帝国科学、技术与医学学院 | Image processing for determining the thickness of an object |
| CN113838028A (en) * | 2021-09-24 | 2021-12-24 | 无锡祥生医疗科技股份有限公司 | Carotid artery ultrasonic automatic Doppler method, ultrasonic equipment and storage medium |
| CN114391878A (en) * | 2022-01-27 | 2022-04-26 | 南京市溧水区人民医院 | Ultrasonic imaging equipment |
| CN115334976A (en) * | 2020-03-30 | 2022-11-11 | 泰尔茂株式会社 | Computer program, information processing method, information processing device, and model generation method |
| US12548296B2 (en) | 2022-08-25 | 2026-02-10 | International Business Machines Corporation | Spatially preserving flattening in deep learning neural networks |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104200224A (en) * | 2014-08-28 | 2014-12-10 | 西北工业大学 | Valueless image removing method based on deep convolutional neural networks |
| CN105930793A (en) * | 2016-04-19 | 2016-09-07 | 中山大学 | Human body detection method based on SAE characteristic visual learning |
-
2016
- 2016-09-13 CN CN201610819047.XA patent/CN106408017A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104200224A (en) * | 2014-08-28 | 2014-12-10 | 西北工业大学 | Valueless image removing method based on deep convolutional neural networks |
| CN105930793A (en) * | 2016-04-19 | 2016-09-07 | 中山大学 | Human body detection method based on SAE characteristic visual learning |
Non-Patent Citations (4)
| Title |
|---|
| J. JIANG, ET AL.: "Medical image analysis with artificial neural networks", 《COMPUTERIZED MEDICAL IMAGING》 * |
| ROSA-MARÍA MENCHÓN-LARA,ET AL.: "Estimation of the ArterialDiameter in Ultrasound Images of the Common Carotid Artery", 《SPRINGER INTERNATIONAL PUBLISHING SWITZERLAND 2015》 * |
| 刘一学 等: "基于支持向量机的颈动脉超声图像内中膜厚度测量", 《中国医学物理学杂志》 * |
| 邓俊峰 等: "基于自动编码器组合的深度学习优化方法", 《计算机应用》 * |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110326004A (en) * | 2017-02-24 | 2019-10-11 | 谷歌有限责任公司 | Training strategy neural network using path consistency learning |
| CN108573491A (en) * | 2017-03-10 | 2018-09-25 | 南京大学 | A kind of three-dimensional ultrasound pattern dividing method based on machine learning |
| CN108962381A (en) * | 2017-05-19 | 2018-12-07 | 西门子保健有限责任公司 | The method based on study of personalized evaluation, long-term forecast and management for atherosclerosis |
| CN107832339A (en) * | 2017-10-12 | 2018-03-23 | 赵胜男 | Audiograph picture based on convolutional neural networks turns acoustic method |
| CN107871318A (en) * | 2017-11-16 | 2018-04-03 | 吉林大学 | A Model Migration-Based Method for Coronary Calcified Plaque Detection |
| CN109166107A (en) * | 2018-04-28 | 2019-01-08 | 北京市商汤科技开发有限公司 | A kind of medical image cutting method and device, electronic equipment and storage medium |
| CN109285158A (en) * | 2018-07-24 | 2019-01-29 | 深圳先进技术研究院 | Vessel wall plaque segmentation method, device and computer readable storage medium |
| CN113439289A (en) * | 2019-02-20 | 2021-09-24 | 帝国科学、技术与医学学院 | Image processing for determining the thickness of an object |
| CN110047086B (en) * | 2019-04-24 | 2021-02-09 | 飞依诺科技(苏州)有限公司 | Automatic carotid intimal thickness measuring method and system |
| CN110047086A (en) * | 2019-04-24 | 2019-07-23 | 飞依诺科技(苏州)有限公司 | Carotic Intima-media Thinkness method for automatic measurement and system |
| CN110415239B (en) * | 2019-08-01 | 2022-12-16 | 腾讯科技(深圳)有限公司 | Image processing method, image processing apparatus, medical electronic device, and medium |
| CN110415239A (en) * | 2019-08-01 | 2019-11-05 | 腾讯科技(深圳)有限公司 | Image processing method, device, equipment, medical treatment electronic equipment and medium |
| CN112419283A (en) * | 2019-11-27 | 2021-02-26 | 上海联影智能医疗科技有限公司 | Neural network and method for estimating thickness |
| CN115334976A (en) * | 2020-03-30 | 2022-11-11 | 泰尔茂株式会社 | Computer program, information processing method, information processing device, and model generation method |
| US12333718B2 (en) | 2020-03-30 | 2025-06-17 | Terumo Kabushiki Kaisha | Method for generating model by recognizing cross-section regions in units of pixels |
| CN112102233A (en) * | 2020-08-05 | 2020-12-18 | 深圳市第二人民医院(深圳市转化医学研究院) | Method, device, equipment and medium for discriminating cerebral apoplexy causes based on magnetic resonance image |
| CN112102233B (en) * | 2020-08-05 | 2023-12-26 | 深圳市第二人民医院(深圳市转化医学研究院) | Brain stroke etiology screening method, device, equipment and medium based on magnetic resonance image |
| CN112932542A (en) * | 2021-01-27 | 2021-06-11 | 深圳中科乐普医疗技术有限公司 | Method and system for measuring thickness of intravascular medium membrane and ultrasonic imaging equipment |
| CN112967251A (en) * | 2021-03-03 | 2021-06-15 | 网易(杭州)网络有限公司 | Picture detection method, and training method and device of picture detection model |
| CN112967251B (en) * | 2021-03-03 | 2024-06-04 | 网易(杭州)网络有限公司 | Picture detection method, training method and device of picture detection model |
| CN113838028A (en) * | 2021-09-24 | 2021-12-24 | 无锡祥生医疗科技股份有限公司 | Carotid artery ultrasonic automatic Doppler method, ultrasonic equipment and storage medium |
| CN114391878A (en) * | 2022-01-27 | 2022-04-26 | 南京市溧水区人民医院 | Ultrasonic imaging equipment |
| CN114391878B (en) * | 2022-01-27 | 2024-05-17 | 南京市溧水区人民医院 | Ultrasonic imaging equipment |
| US12548296B2 (en) | 2022-08-25 | 2026-02-10 | International Business Machines Corporation | Spatially preserving flattening in deep learning neural networks |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106408017A (en) | Ultrasonic carotid artery intima media thickness measurement device and method based on deep learning | |
| Edupuganti et al. | Automatic optic disk and cup segmentation of fundus images using deep learning | |
| CN109117864B (en) | Coronary heart disease risk prediction method, model and system based on heterogeneous feature fusion | |
| Fiorentino et al. | A regression framework to head-circumference delineation from US fetal images | |
| CN107610087B (en) | Tongue coating automatic segmentation method based on deep learning | |
| CN110599448A (en) | Migratory learning lung lesion tissue detection system based on MaskScoring R-CNN network | |
| CN108629370B (en) | Classification recognition algorithm and device based on deep belief network | |
| Samiappan et al. | Classification of carotid artery abnormalities in ultrasound images using an artificial neural classifier. | |
| CN118799693A (en) | Intelligent identification method and system of carotid artery plaque based on multimodal image fusion | |
| CN115147600A (en) | GBM Multimodal MR Image Segmentation Method Based on Classifier Weight Converter | |
| CN116704305A (en) | Multi-modal and multi-section classification method for echocardiography based on deep learning algorithm | |
| Wang | OCT image recognition of cardiovascular vulnerable plaque based on CNN | |
| Dhindsa et al. | Grading prenatal hydronephrosis from ultrasound imaging using deep convolutional neural networks | |
| Yasrab et al. | End-to-end first trimester fetal ultrasound video automated crl and nt segmentation | |
| Chu et al. | Bone age assessment based on two-stage deep neural networks | |
| CN115239695A (en) | A system and method for pulmonary nodule recognition based on time series images | |
| CN110956610A (en) | Method and system for predicting thrombolytic curative effect of lower limb deep venous thrombosis based on sparse representation | |
| Malik et al. | Lung cancer detection at initial stage by using image processing and classification techniques | |
| CN110705615A (en) | Thyroid nodule detection and classification method based on TV model and GoogLeNet model | |
| Yasmin et al. | Impact of fuzziness for skin lesion classification with transformer-based model | |
| CN110084796A (en) | A kind of analysis method of complex texture CT image | |
| CN114998195B (en) | Pig B ultrasonic image fat content detection method based on depth regression network | |
| Rani et al. | A deep convolutional architectural framework for radiograph image processing at bit plane level for gender & age assessment | |
| CN113066054B (en) | A method for visualizing features of cervical OCT images for computer-aided diagnosis | |
| CN106355578B (en) | Ultrasound carotid artery distal recognition device and method based on convolutional neural network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170215 |