[go: up one dir, main page]

CN105741264A - Two-phase image segmentation method based on semi-local texture features - Google Patents

Two-phase image segmentation method based on semi-local texture features Download PDF

Info

Publication number
CN105741264A
CN105741264A CN201610041186.4A CN201610041186A CN105741264A CN 105741264 A CN105741264 A CN 105741264A CN 201610041186 A CN201610041186 A CN 201610041186A CN 105741264 A CN105741264 A CN 105741264A
Authority
CN
China
Prior art keywords
image
segmentation
semi
target
texture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610041186.4A
Other languages
Chinese (zh)
Inventor
狄岚
许洁
梁久祯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangnan University
Original Assignee
Jiangnan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangnan University filed Critical Jiangnan University
Priority to CN201610041186.4A priority Critical patent/CN105741264A/en
Publication of CN105741264A publication Critical patent/CN105741264A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20024Filtering details

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

本发明公开了一种基于半局部纹理特征的二阶段图像分割方法,主要包括:将图像分割成M×M像素的非重叠的小块;提取每个块的基于Beltrami框架和半局部信息的纹理特征,然后用K?means算法进行块聚类,将图片划分为四个区域;根据摄影构图原理确定目标的最佳位置,从而提取出目标,完成粗分割;用几何活动轮廓模型对已经提取出来的目标进行细分割,从而得到更加精确的分割结果。本发明的有益效果是:提出了一种先进行粗分割提取出目标物体后进行细分割的分割方法,这种由粗到精的分割策略可用来分割具有模糊或复杂背景的图片;定义了一种基于Beltrami框架和半局部信息的新型纹理特征,具有比单个特征更强的鉴别力,并且具有很强的抗噪能力,将该纹理特征用于聚类和图像分割中,能够得到更加精确的实验结果。The invention discloses a two-stage image segmentation method based on semi-local texture features, which mainly includes: dividing the image into non-overlapping small blocks of M×M pixels; extracting the texture of each block based on Beltrami framework and semi-local information features, and then use the K?means algorithm for block clustering to divide the picture into four regions; determine the best position of the target according to the principle of photographic composition, thereby extracting the target and completing the rough segmentation; use the geometric active contour model to extract the Targets are finely segmented to obtain more accurate segmentation results. The beneficial effect of the present invention is: a kind of segmentation method that carries out rough segmentation to extract target object first and then fine segmentation is proposed, this segmentation strategy from coarse to fine can be used for segmenting the picture with fuzzy or complicated background; Define a A new type of texture feature based on the Beltrami framework and semi-local information has stronger discrimination than a single feature and has a strong anti-noise ability. Using this texture feature in clustering and image segmentation can get more accurate Experimental results.

Description

一种基于半局部纹理特征的二阶段图像分割方法A two-stage image segmentation method based on semi-local texture features

技术领域 technical field

本发明涉及图像分割方法、图像处理、模式识别、人工智能领域,具体涉及一种基于半局部纹理特征的二阶段图像分割方法。 The invention relates to the fields of image segmentation method, image processing, pattern recognition and artificial intelligence, in particular to a two-stage image segmentation method based on semi-local texture features.

背景技术 Background technique

纹理分割是图像分割中一个非常有挑战性的问题。人眼能够很容易得分辨出不同的纹理,但从数学术语的层面上是很难对纹理进行定义的,因此也很难用一个模型来描述它。此外,纹理可能导致重要边缘的丢失和灰度分布的不均匀。目前被广泛认可的一个定义是:纹理是一系列具有周期性和振荡性的精细的特征细节。 Texture segmentation is a very challenging problem in image segmentation. Human eyes can easily distinguish different textures, but it is difficult to define texture in mathematical terms, so it is difficult to describe it with a model. In addition, texture may lead to loss of important edges and uneven distribution of gray levels. A currently widely accepted definition is that texture is a series of fine feature details with periodicity and oscillation.

通常使用的图像特征包括:基于滤波的特征、基于半局部信息的特征以及基于Beltrami框架的特征。其中基于滤波的特征比如梯度滤波、小波多孔滤波已经被应用到特征提取和图像分割中,通过Gabor或Morlet小波变换提取的特征是区分不同方向和尺度的纹理的重要依据;获得基于半局部信息的特征的主要方法是:将与现有像素相邻的块的灰度信息提取出来,从而得到每个像素的半局部信息,这种基于块的特征向量的想法在介绍纹理合成时首次提出,后来,Buades等人基于块差异性和非局部平均提出给图像降噪的想法,Gilboa和Osher基于变化的框架提出非局部降噪模型,最后,Bresson和Chan同样基于块之间的差异性提出了一种可变的无监督的分割方法;基于Beltrami框架的特征是图像的一种新的几何表示,它将图像特征看成是镶嵌在高维空间的黎曼流形,这种方法的优点是它允许使用不同的几何工具来进行不同的图像处理(如降噪和分割),并且能处理任意N维的图像,缺点是对噪声十分敏感。因此,本发明对后两种特征进行结合,通过映射将所提取的基于半局部信息的特征引入Beltrami框架下,从而得到一个抗噪性很强的新的纹理特征。 Commonly used image features include: features based on filtering, features based on semi-local information, and features based on the Beltrami framework. Among them, filtering-based features such as gradient filtering and wavelet porous filtering have been applied to feature extraction and image segmentation. Features extracted by Gabor or Morlet wavelet transform are an important basis for distinguishing textures of different directions and scales; obtaining semi-local information based The main method of feature is: extract the gray information of the blocks adjacent to the existing pixels, so as to obtain the semi-local information of each pixel. The idea of this block-based feature vector was first proposed when texture synthesis was introduced, and later , Buades et al. proposed the idea of image denoising based on block differences and non-local averages, Gilboa and Osher proposed a non-local denoising model based on a variable framework, and finally, Bresson and Chan also proposed a model based on the differences between blocks A variable unsupervised segmentation method; the feature based on the Beltrami framework is a new geometric representation of the image, which regards the image feature as a Riemannian manifold embedded in a high-dimensional space. The advantage of this method is that it allows the use of Different geometric tools are used for different image processing (such as noise reduction and segmentation), and can handle any N-dimensional image, but the disadvantage is that it is very sensitive to noise. Therefore, the present invention combines the latter two features, and introduces the extracted features based on semi-local information into the Beltrami framework through mapping, thereby obtaining a new texture feature with strong noise resistance.

在图像分割中最广为人知并且最成功的模型就是由Kass,Witkin等人首先提出的活动轮廓模型,它被成功应用于在医学成像中提取解剖结构。但这种模型的缺点是对活动轮廓的初始位置很敏感,并且在目标的凹陷边界处收敛性不好。随后Caselles,kimmel等人对活动轮廓模型进行了改进,提出几何活动轮廓模型(GAC),该模型在图像分割中能取得较好的分割结果,因此本发明的细分割阶段就采用此种模型。 The most widely known and successful model in image segmentation is the active contour model first proposed by Kass, Witkin et al., which has been successfully applied to extract anatomical structures in medical imaging. But the disadvantage of this model is that it is sensitive to the initial position of the active contour and does not converge well at the concave boundary of the object. Then Caselles, people such as kimmel improved active contour model, proposed geometric active contour model (GAC), this model can obtain better segmentation result in image segmentation, so the subdivision stage of the present invention just adopts this kind of model.

本发明提出了一种不同于传统分割思路的分割方法,主要分为粗分割和细分割两个阶段。首先,将图像分割成M×M像素的非重叠的块,提取每个块的基于Beltrami框架和半局部信息的纹理特征,然后用K-means算法进行块聚类,将图片划分为四个区域,根据摄影构原理确定目标的最佳位置,从而提取出目标,完成粗分割;最后用几何活动轮廓模型(GAC)对已经提取出来的目标进行细分割,从而得到更加精确的分割结果。 The present invention proposes a segmentation method different from traditional segmentation ideas, which is mainly divided into two stages: rough segmentation and fine segmentation. First, divide the image into non-overlapping blocks of M×M pixels, extract the texture features of each block based on the Beltrami framework and semi-local information, and then use the K-means algorithm for block clustering to divide the image into four regions According to the principle of photographic composition , the optimal position of the target is determined, and the target is extracted to complete the rough segmentation; finally, the extracted target is finely segmented by the geometric active contour model (GAC), so as to obtain a more accurate segmentation result.

发明内容 Contents of the invention

本发明的主要目的在于,提出一种先粗分割出目标物体再进行细分割的思想,并结合一种基于Beltrami框架和半局部信息的新的纹理特征,将其应用到聚类和图像分割中,得到更加准确的分割结果。 The main purpose of the present invention is to propose an idea of coarsely segmenting the target object and then performing fine segmentation, and combine a new texture feature based on the Beltrami framework and semi-local information to apply it to clustering and image segmentation , to obtain more accurate segmentation results.

本发明的目的及解决其技术问题是采用的技术方案是:一种基于半局部纹理特征的二阶段图像分割方法,包括以下内容: The technical scheme that the purpose of the present invention and the solution to its technical problem is to adopt is: a kind of two-stage image segmentation method based on semi-local texture features, comprising the following contents:

设Px y是以像素(x,y)为中心,大小为τ×τ的块,则有 Let P x , y be a block with pixel (x, y) as the center and size τ×τ, then we have

采用如下映射X将纹理特征引入到Beltrami框架下: Use the following mapping X to introduce texture features into the Beltrami framework:

X:(x,y)→(X1=x,X2=y,X3=Px y(I)) (2) X: (x, y)→(X 1 =x, X 2 =y, X 3 =P x , y (I)) (2)

该映射包含了局部信息(空间位置)和半局部图像信息(中心像素周围的像素块的值)。假设给定一幅复杂的纹理图案,通过映射(2)的镶嵌到高维空间的几何流形与我们所观察到纹理是一致的(该假设对大多数的自然图像都是成立的)。这就意味着相同纹理区域的流形的度量张量是相同的,度量张量是用来测量流形上两点之间的距离的一个变量,当某个特定区域的流形几乎呈一个平面时,该区域中任意两点之间的距离都是相等的,再结合半局部图像信息可知由映射(2)得到的流形几乎呈平面,因此该区域有相同的纹理。映射(2)中相应的度量张量定义为: This map contains local information (spatial location) and semi-local image information (values of pixel blocks around the central pixel). Assume that given a complex texture pattern, the geometric manifold mosaicked to the high-dimensional space by mapping (2) is consistent with the texture we observe (this assumption is true for most natural images). This means that the metric tensor of the manifold in the same texture area is the same. The metric tensor is a variable used to measure the distance between two points on the manifold. When the manifold in a particular area is almost a plane When , the distance between any two points in this area is equal, combined with semi-local image information, it can be seen that the manifold obtained by mapping (2) is almost flat, so this area has the same texture. The corresponding metric tensor in mapping (2) is defined as:

最后,纹理特征描述子F定义为 Finally, the texture feature descriptor F is defined as

Ff == expexp (( -- detdet (( gg xx ythe y )) σσ 22 )) -- -- -- (( 44 ))

其中σ>0是尺度参数,采用高斯核函数作为低通滤波,控制描述图像细节的程度。 Among them, σ>0 is a scale parameter, and the Gaussian kernel function is used as a low-pass filter to control the degree of describing image details.

另外,对于彩色图像来说,推导过程也十分简单。令彩色图像为I=(I1,I2,…,Ik),其中k是图像的维数,相应的半局部映射为: In addition, for color images, the derivation process is also very simple. Let the color image be I=(I 1 , I 2 , . . . , I k ), where k is the dimension of the image, and the corresponding semi-local mapping is:

X:(x,y)→(X1=x,X2=y,X3=Px y(I1),…,X2+k=Px y(Ik)) (5) X: (x, y) → (X 1 = x, X 2 = y, X 3 = P x , y (I 1 ), ..., X 2+k = P x , y (I k )) (5)

对应的度量张量写成以下形式: The corresponding metric tensor is written in the following form:

另外,几何活动轮廓模型可转化为如下最小化问题: In addition, the geometric active contour model can be transformed into the following minimization problem:

mm ii nno CC {{ EE. GG 44 CC (( CC )) == ∫∫ 00 LL (( CC )) gg (( || ▿▿ II 00 (( CC (( sthe s )) )) || )) dd sthe s }} -- -- -- (( 77 ))

其中ds为欧几里得元素的长度,为曲线C的长度。因此,能量泛函(7)其实是由ds对包含物体边界信息的函数g进行积分得到的一个新的长度,函数g是边缘指示函数用来消除如这样的物体边缘,I0是原始图像,β为任意正常数。由变分法可得到函数EGAC的欧拉-拉格朗日方程式,梯度下降法能尽可能快地最小化EGACwhere ds is the length of the Euclidean element, is the length of curve C. Therefore, the energy functional (7) is actually a new length obtained by integrating the function g containing object boundary information by ds. The function g is an edge indicator function used to eliminate such as For the edge of such an object, I 0 is the original image, and β is an arbitrary constant. The Euler-Lagrange equation of the function E GAC can be obtained by the variational method, and the gradient descent method can minimize E GAC as quickly as possible:

其中,t为人为规定的时间参数,k,N分别为曲率和曲线C的法线,式(8)中定义的活动轮廓的演化方程存在唯一解。Osher和Sethian提出的水平集方法有效地解决了轮廓延伸问题并处理了拓扑变化问题,等式(8)可写成如下水平集形式: in, t is an artificially specified time parameter, k and N are the curvature and the normal of the curve C, respectively, and there is a unique solution to the evolution equation of the active contour defined in formula (8). The level set method proposed by Osher and Sethian effectively solves the contour extension problem and handles the topology change problem. Equation (8) can be written in the following level set form:

其中,φ是嵌入到不断演化的活动轮廓C(如C(t)={x∈RN|φ(x,t)=0})的水平集函数,基于双曲守恒定律,偏微分方程(9)可应用到多种数值化求解中,得到相当精确的分割结果。 Among them, φ is the level set function embedded in the constantly evolving activity profile C (such as C(t)={x∈R N |φ(x,t)=0}), based on the law of hyperbolic conservation, the partial differential equation ( 9) It can be applied to various numerical solutions to obtain quite accurate segmentation results.

与现有技术相比,本发明的优点和效果在于:1)提出了一种先进行粗分割提取出目标物体后进行细分割的分割方法,这种由粗到精的分割策略可用来分割具有模糊或复杂背景的图片。2)定义了一种基于Beltrami框架和半局部信息的新型纹理特征,具有比单个特征更强的鉴别力,并且具有很强的抗噪能力,将该纹理特征用于聚类和图像分割中,能够得到更加精确的实验结果。 Compared with the prior art, the advantages and effects of the present invention are: 1) It proposes a segmentation method that first performs rough segmentation to extract the target object and then performs fine segmentation. This coarse-to-fine segmentation strategy can be used to segment objects with Pictures with blurry or complex backgrounds. 2) A new type of texture feature based on the Beltrami framework and semi-local information is defined, which has stronger discrimination than a single feature and has a strong anti-noise ability. The texture feature is used in clustering and image segmentation. More accurate experimental results can be obtained.

附图说明 Description of drawings

1一种基于半局部纹理特征的二阶段图像分割方法流程 Fig.1 Flow chart of a two-stage image segmentation method based on semi-local texture features

具体实施方式 detailed description

如图 1所示,本发明总体流程如下:首先,将图像分割成M×M像素的非重叠的小块;其次,提取每个块的基于Beltrami框架和半局部信息的纹理特征,然后用K-means算法进行块聚类,将图片划分为四个区域;然后根据摄影构原理确定目标的最佳位置,从而提取出目标,完成粗分割;最后用几何活动轮廓模型(GAC)对已经提取出来的目标进行细分割,从而得到更加精确的分割结果。 As shown in Figure 1 , the overall process of the present invention is as follows: firstly, the image is divided into non-overlapping small blocks of M×M pixels; secondly, the texture features based on the Beltrami framework and semi-local information of each block are extracted, and then K -means algorithm for block clustering, divide the picture into four areas; then determine the best position of the target according to the principle of photographic composition , so as to extract the target and complete the rough segmentation; finally use the geometric active contour model (GAC) to analyze the extracted The resulting target is finely segmented to obtain more accurate segmentation results.

本发明具体步骤如下: Concrete steps of the present invention are as follows:

步骤S101:将图像分割成M×M像素的非重叠的小块 Step S101: Divide the image into non-overlapping small blocks of M×M pixels

综合考虑纹理特征的效果和算法的时间复杂度,将所有图片标准化为126×189或189×126,所分割的小块尺寸为3×3,因此每幅标准化的图像中包括2646个小块。 Considering the effect of texture features and the time complexity of the algorithm, all pictures are normalized to 126×189 or 189×126, and the size of the divided small blocks is 3×3, so each normalized image includes 2646 small blocks.

步骤S102:提取每个块的基于Beltrami框架和半局部信息的纹理特征,然后用K-means算法进行块聚类,将图片划分为四个区域 Step S102: Extract the texture features of each block based on the Beltrami framework and semi-local information, and then use the K-means algorithm for block clustering to divide the picture into four regions

1)选取以像素(x,y)为中心,大小为τ×τ的块Px y1) Select a block P x , y whose size is τ×τ centered on the pixel (x, y):

2)采用如下映射X将纹理特征引入到Beltrami框架下: 2) Use the following mapping X to introduce texture features into the Beltrami framework:

X:(x,y)→(X1=x,X2=y,X3=Px y(I)) (11) X: (x, y) → (X 1 =x, X 2 =y, X 3 =P x , y (I)) (11)

该映射包含了局部信息(空间位置)和半局部图像信息(中心像素周围的像素块的值)。假设给定一幅复杂的纹理图案,通过映射(11)的镶嵌到高维空间的几何流形与我们所观察到纹理是一致的,映射(11)中相应的度量张量定义为: This map contains local information (spatial location) and semi-local image information (values of pixel blocks around the central pixel). Assuming that given a complex texture pattern, the geometric manifold mosaiced into the high-dimensional space by mapping (11) is consistent with the texture we observe, the corresponding metric tensor in mapping (11) is defined as:

3)提取每个块的基于Beltrami框架和半局部信息的纹理特征 3) Extract the texture features of each block based on the Beltrami framework and semi-local information

最后,得到纹理特征描述子F为 Finally, the texture feature descriptor F is obtained as

Ff == expexp (( -- detdet (( gg xx ythe y )) σσ 22 )) -- -- -- (( 1313 ))

其中σ>0是尺度参数,采用高斯核函数作为低通滤波,控制描述图像细节的程度。 Among them, σ>0 is a scale parameter, and the Gaussian kernel function is used as a low-pass filter to control the degree of describing image details.

4)用K-means方法进行聚类,将图像聚成四类 4) Clustering with the K-means method, clustering the images into four categories

步骤S103:根据摄影构原理确定目标的最佳位置,从而提取出目标,完成粗分割 Step S103: Determine the best position of the target according to the principle of photographic composition , so as to extract the target and complete the rough segmentation

1)对上一步得到的结果进行合并 1) Merge the results obtained in the previous step

一副给定的图像最终只需要分为前景区域和背景区域,对上一步得到的图像中满足一定相似性的区域进行合并,相似性度量定义为: A given image only needs to be divided into the foreground area and the background area in the end, and the areas that meet a certain similarity in the image obtained in the previous step are merged. The similarity measure is defined as:

sthe s ii mm (( RR ii ,, RR jj )) == -- dd (( RR ii ,, RR jj )) ;; dd (( RR ii ,, RR jj )) == || || RR →&Right Arrow; ii -- RR →&Right Arrow; jj || ||

i,j=0,1,…,Nr,i≠j (14) i, j=0, 1, ..., N r , i≠j (14)

其中,Ri为纹理特征向量,d(Ri,Rj)为向量Ri和Rj之间的距离,相似性度量与距离成反比,因此对具有最大相似性(最小距离)的区域进行合并,新的合并区域的特征向量要重新计算,直到图像中只留下两个区域。 Among them, R i is the texture feature vector, d(R i , R j ) is the distance between the vectors R i and R j , the similarity measure is inversely proportional to the distance, so the region with the largest similarity (minimum distance) is calculated After merging, the eigenvectors of the new merged regions are recomputed until only two regions are left in the image.

2)根据摄影构原理确定目标的最佳位置 2) Determine the best position of the target according to the principle of photographic composition

摄影构确定最佳位置一般有两种方法:三分构法和动态对称法。三分构法是指将图像横向和竖向分别分为三等分,图像中四个交点的位置即为目标的最佳位置,也就是前景区域。动态对称法是指作出图像的一条对角线,然后从另外两个角分别向该对角线作垂直线,图像中两个交点的位置即为目标的最佳位置,其他区域则为背景区域。 There are generally two methods for determining the best position in photographic composition : the method of thirds and the method of dynamic symmetry. The method of thirds composition refers to dividing the image into thirds horizontally and vertically, and the position of the four intersection points in the image is the best position of the target, that is, the foreground area. The dynamic symmetry method refers to making a diagonal line of the image, and then drawing vertical lines from the other two corners to the diagonal line. The position of the two intersection points in the image is the best position of the target, and the other areas are the background area. .

3)提取目标物体 3) Extract the target object

首先分别得到前景和背景区域的二值图像,然后将三分构法或动态对称法的mask表分别与两幅二值图像做与操作,对像素数最大的二值图像进行目标提取,另一幅默认为背景区域。 First obtain the binary images of the foreground and background regions respectively, and then perform the AND operation on the mask table of the thirds composition method or the dynamic symmetry method with the two binary images, and extract the target from the binary image with the largest number of pixels, and then One is the background area by default.

步骤S104:用几何活动轮廓模型对已经提取出来的目标进行细分割,从而得到更加精确的分割结果 Step S104: use the geometric active contour model to subdivide the extracted target, so as to obtain a more accurate segmentation result

1)几何活动轮廓模型(GAC) 1) Geometric active contour model (GAC)

几何活动轮廓模型(GAC)可转化为如下最小化问题: The geometric active contour model (GAC) can be transformed into the following minimization problem:

mm ii nno CC {{ EE. GG 44 CC (( CC )) == ∫∫ 00 LL (( CC )) gg (( || ▿▿ II 00 (( CC (( sthe s )) )) || )) dd sthe s }} -- -- -- (( 1515 ))

其中ds为欧几里得元素的长度,为曲线C的长度。因此,能量泛函(15)其实是由ds对包含物体边界信息的函数g进行积分得到的一个新的长度,函数g是边缘指示函数用来消除如这样的物体边缘,I0是原始图像,β为任意正常数。由变分法可得到函数EGAC的欧拉-拉格朗日方程式,梯度下降法能尽可能快地最小化EGACwhere ds is the length of the Euclidean element, is the length of curve C. Therefore, the energy functional (15) is actually a new length obtained by integrating the function g containing object boundary information by ds. The function g is an edge indicator function used to eliminate such as For the edge of such an object, I 0 is the original image, and β is an arbitrary constant. The Euler-Lagrange equation of the function E GAC can be obtained by the variational method, and the gradient descent method can minimize E GAC as quickly as possible:

其中,t为人为规定的时间参数,k,N分别为曲率和曲线C的法线,式(16)中定义的活动轮廓的演化方程存在唯一解。 in, t is an artificially specified time parameter, k and N are the curvature and the normal of the curve C, respectively, and there is a unique solution to the evolution equation of the active contour defined in formula (16).

2)改写水平集函数 2) Rewrite the level set function

Osher和Sethian提出的水平集方法有效地解决了轮廓延伸问题并处理了拓扑变化问题,等式(16)可写成如下水平集形式: The level set method proposed by Osher and Sethian effectively solves the contour extension problem and handles the topology change problem. Equation (16) can be written in the following level set form:

其中,φ是嵌入到不断演化的活动轮廓C(如C(t)={x∈RN|φ(x,t)=0})的水平集函数,基于双曲守恒定律,偏微分方程(17)可应用到多种数值化求解中,得到相当精确的分割结果。 Among them, φ is the level set function embedded in the constantly evolving activity profile C (such as C(t)={x∈R N |φ(x,t)=0}), based on the law of hyperbolic conservation, the partial differential equation ( 17) It can be applied to various numerical solutions to obtain quite accurate segmentation results.

3)对粗分割提取出的目标物体进行细分割,得到分割结果。 3) Perform fine segmentation on the target object extracted by the rough segmentation to obtain the segmentation result.

Claims (5)

1.一种基于半局部纹理特征的二阶段图像分割方法,其特征在于,包括以下步骤: 1. a two-stage image segmentation method based on semi-local texture feature, is characterized in that, comprises the following steps: 步骤1、将图像分割成M×M像素的非重叠的小块; Step 1, dividing the image into non-overlapping small blocks of M×M pixels; 步骤2、提取每个块的基于Beltrami框架和半局部信息的纹理特征,然后用K-means算法进行块聚类,将图片划分为四个区域; Step 2, extract the texture features based on the Beltrami framework and semi-local information of each block, then use the K-means algorithm to cluster the blocks, and divide the picture into four regions; 步骤3、根据摄影构原理确定目标的最佳位置,从而提取出目标,完成粗分割; Step 3. Determine the best position of the target according to the principle of photographic composition , so as to extract the target and complete the rough segmentation; 步骤4、用几何活动轮廓模型对已经提取出来的目标进行细分割,从而得到更加精确的分割结果。 Step 4, use the geometric active contour model to subdivide the extracted target, so as to obtain a more accurate segmentation result. 2.根据权利要求1所述的基于半局部纹理特征的二阶段图像分割方法,所述步骤1中,将图像分割成M×M像素的非重叠的小块,其特征在于: 2. the two-stage image segmentation method based on semi-local texture features according to claim 1, in said step 1, the image is segmented into non-overlapping small blocks of M * M pixels, characterized in that: 综合考虑纹理特征的效果和算法的时间复杂度,将所有图片标准化为126×189或189×126,所分割的小块尺寸为3×3,因此每幅标准化的图像中包括2646个小块。 Considering the effect of texture features and the time complexity of the algorithm, all pictures are normalized to 126×189 or 189×126, and the size of the divided small blocks is 3×3, so each normalized image includes 2646 small blocks. 3.根据权利要求1所述的基于半局部纹理特征的二阶段图像分割方法,所述步骤2中,提取每个块的基于Beltrami框架和半局部信息的纹理特征,然后用K-means算法进行块聚类,将图片划分为四个区域,其特征在于: 3. the two-stage image segmentation method based on semi-local texture feature according to claim 1, in the described step 2, extract the texture feature based on Beltrami framework and semi-local information of each block, then carry out with K-means algorithm Block clustering, which divides the picture into four regions, is characterized by: 1)选取以像素(x,y)为中心,大小为τ×τ的块Px y1) Select a block P x , y whose size is τ×τ centered on the pixel (x, y): 2)采用如下映射X将纹理特征引入到Beltrami框架下: 2) Use the following mapping X to introduce texture features into the Beltrami framework: X:(x,y)→(X1=x,X2=y,X3=Px y(I)) (2) X: (x, y) → (X 1 =x, X 2 =y, X 3 =P x , y (I)) (2) 该映射包含了局部信息(空间位置)和半局部图像信息(中心像素周围的像素块的值)。假设给定一幅复杂的纹理图案,通过映射(2)的镶嵌到高维空间的几何流形与我们所观察到纹理是一致的,映射(2)中相应的度量张量定义为: This map contains local information (spatial location) and semi-local image information (values of pixel blocks around the central pixel). Assuming a complex texture pattern is given, the geometric manifold mosaiced into the high-dimensional space by mapping (2) is consistent with the texture we observe, and the corresponding metric tensor in mapping (2) is defined as: 3)提取每个块的基于Beltrami框架和半局部信息的纹理特征 3) Extract the texture features of each block based on the Beltrami framework and semi-local information 最后,得到纹理特征描述子F为 Finally, the texture feature descriptor F is obtained as 其中σ>0是尺度参数,采用高斯核函数作为低通滤波,控制描述图像细节的程度。 Among them, σ>0 is a scale parameter, and the Gaussian kernel function is used as a low-pass filter to control the degree of describing image details. 4)用K-means方法进行聚类,将图像聚成四类。 4) Carry out clustering with the K-means method, and cluster the images into four categories. 4.根据权利要求1所述的基于半局部纹理特征的二阶段图像分割方法,所述步骤3中,根据摄影构原理确定目标的最佳位置,从而提取出目标,完成粗分割,其特征在于: 4. the two-stage image segmentation method based on semi-local texture features according to claim 1, in said step 3, determine the optimal position of the target according to the photographic composition principle, thereby extracting the target, and completing the rough segmentation, its feature in: 1)对上一步得到的结果进行合并 1) Merge the results obtained in the previous step 一副给定的图像最终只需要分为前景区域和背景区域,对上一步得到的图像中满足一定相似性的区域进行合并,相似性度量定义为: A given image only needs to be divided into the foreground area and the background area in the end, and the areas that meet a certain similarity in the image obtained in the previous step are merged. The similarity measure is defined as: 其中,Ri为纹理特征向量,d(Ri,Rj)为向量Ri和Rj之间的距离,相似性度量与距离成反比,因此对具有最大相似性(最小距离)的区域进行合并,新的合并区域的特征向量要重新计算,直到图像中只留下两个区域。 Among them, R i is the texture feature vector, d(R i , R j ) is the distance between the vectors R i and R j , the similarity measure is inversely proportional to the distance, so the region with the largest similarity (minimum distance) is calculated After merging, the eigenvectors of the new merged regions are recomputed until only two regions are left in the image. 2)根据摄影构原理确定目标的最佳位置 2) Determine the best position of the target according to the principle of photographic composition 摄影构确定最佳位置一般有两种方法:三分构法和动态对称法。三分构法是指将图像横向和竖向分别分为三等分,图像中四个交点的位置即为目标的最佳位置,也就是前景区域。动态对称法是指作出图像的一条对角线,然后从另外两个角分别向该对角线作垂直线,图像中两个交点的位置即为目标的最佳位置,其他区域则为背景区域。 There are generally two methods for determining the best position in photographic composition : the method of thirds and the method of dynamic symmetry. The method of thirds composition refers to dividing the image into thirds horizontally and vertically, and the position of the four intersection points in the image is the best position of the target, that is, the foreground area. The dynamic symmetry method refers to making a diagonal line of the image, and then drawing vertical lines from the other two corners to the diagonal line. The position of the two intersection points in the image is the best position of the target, and the other areas are the background area. . 3)提取目标物体 3) Extract the target object 首先分别得到前景和背景区域的二值图像,然后将三分构法或动态对称法的mask表分别与两幅二值图像做与操作,对像素数最大的二值图像进行目标提取,另一幅默认为背景区域。 First obtain the binary images of the foreground and background regions respectively, and then perform the AND operation on the mask table of the thirds composition method or the dynamic symmetry method with the two binary images, and extract the target from the binary image with the largest number of pixels, and then One is the background area by default. 5.根据权利要求1所述的基于半局部纹理特征的二阶段图像分割方法,所述步骤4中,用几何活动轮廓模型对已经提取出来的目标进行细分割,从而得到更加精确的分割结果,其特征在于: 5. The two-stage image segmentation method based on semi-local texture features according to claim 1, in said step 4, the extracted target is finely segmented with a geometric active contour model, thereby obtaining a more accurate segmentation result, It is characterized by: 1)几何活动轮廓模型(GAC) 1) Geometric active contour model (GAC) 几何活动轮廓模型(GAC)可转化为如下最小化问题: The geometric active contour model (GAC) can be transformed into the following minimization problem: 其中ds为欧几里得元素的长度,为曲线C的长度。因此,能量泛函(6)其实是由ds对包含物体边界信息的函数g进行积分得到的一个新的长度,函数g是边缘指示函数用来消除如这样的物体边缘,I0是原始图像,β为任意正常数。由变分法可得到函数的欧拉-拉格朗日方程式,梯度下降法能尽可能快地最小化 where ds is the length of the Euclidean element, is the length of curve C. Therefore, the energy functional (6) is actually a new length obtained by integrating the function g containing object boundary information by ds. The function g is an edge indicator function used to eliminate such as For the edge of such an object, I 0 is the original image, and β is an arbitrary constant. The function can be obtained by the method of variation The Euler-Lagrangian equation, the gradient descent method can minimize as quickly as possible 其中,t为人为规定的时间参数,k,N分别为曲率和曲线C的法线,式(7)中定义的活动轮廓的演化方程存在唯一解。 in, t is an artificially specified time parameter, k and N are the curvature and the normal of the curve C, respectively, and there is a unique solution to the evolution equation of the active contour defined in formula (7). 2)改写水平集函数 2) Rewrite the level set function Osher和Sethian提出的水平集方法有效地解决了轮廓延伸问题并处理了拓扑变化问题,等式(7)可写成如下水平集形式: The level set method proposed by Osher and Sethian effectively solves the contour extension problem and handles the topology change problem. Equation (7) can be written in the following level set form: 其中,φ是嵌入到不断演化的活动轮廓C(如C(t)={x∈RN|φ(x,t)=0})的水平集函数,基于双曲守恒定律,偏微分方程(8)可应用到多种数值化求解中,得到相当精确的分割结果。 Among them, φ is the level set function embedded in the constantly evolving activity profile C (such as C(t)={x∈R N |φ(x,t)=0}), based on the law of hyperbolic conservation, the partial differential equation ( 8) It can be applied to various numerical solutions to obtain quite accurate segmentation results. 3)对粗分割提取出的目标物体进行细分割,得到分割结果。 3) Perform fine segmentation on the target object extracted by the rough segmentation to obtain the segmentation result.
CN201610041186.4A 2016-01-20 2016-01-20 Two-phase image segmentation method based on semi-local texture features Pending CN105741264A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610041186.4A CN105741264A (en) 2016-01-20 2016-01-20 Two-phase image segmentation method based on semi-local texture features

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610041186.4A CN105741264A (en) 2016-01-20 2016-01-20 Two-phase image segmentation method based on semi-local texture features

Publications (1)

Publication Number Publication Date
CN105741264A true CN105741264A (en) 2016-07-06

Family

ID=56247342

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610041186.4A Pending CN105741264A (en) 2016-01-20 2016-01-20 Two-phase image segmentation method based on semi-local texture features

Country Status (1)

Country Link
CN (1) CN105741264A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106340013A (en) * 2016-08-25 2017-01-18 上海航天控制技术研究所 Infrared target contour segmentation method based on dual Kmeans clustering
CN107480593A (en) * 2017-07-12 2017-12-15 广东交通职业技术学院 Beltrami flows and the hyperspectral image classification method of recursive filtering
CN113674840A (en) * 2021-08-24 2021-11-19 平安国际智慧城市科技股份有限公司 Medical image sharing method and device, electronic equipment and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
VICENT CASELLES ET AL: "Geodesic Active Contours", 《INTERNATIONAL JOURNAL OF COMPUTER VISION》 *
朱蓉: "基于语义的Web图像分类研究", 《中国博士学位论文全文数据库 信息科技辑》 *
赵在新 等: "结合半局部信息与结构张量的无监督纹理图像分割", 《中国图象图形学报》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106340013A (en) * 2016-08-25 2017-01-18 上海航天控制技术研究所 Infrared target contour segmentation method based on dual Kmeans clustering
CN107480593A (en) * 2017-07-12 2017-12-15 广东交通职业技术学院 Beltrami flows and the hyperspectral image classification method of recursive filtering
CN107480593B (en) * 2017-07-12 2020-07-03 广东交通职业技术学院 Hyperspectral image classification method of Beltrami flow and recursive filtering
CN113674840A (en) * 2021-08-24 2021-11-19 平安国际智慧城市科技股份有限公司 Medical image sharing method and device, electronic equipment and storage medium
CN113674840B (en) * 2021-08-24 2023-11-03 深圳平安智慧医健科技有限公司 Medical image sharing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN110334762B (en) Feature matching method based on quad tree combined with ORB and SIFT
CN110363719B (en) Cell layered image processing method and system
CN105957063B (en) A method and system for liver segmentation in CT images based on multi-scale weighted similarity measure
CN104933709B (en) Random walk CT lung tissue image automatic segmentation methods based on prior information
WO2017219391A1 (en) Face recognition system based on three-dimensional data
Rad et al. Evaluation of current dental radiographs segmentation approaches in computer-aided applications
Lozes et al. Partial difference operators on weighted graphs for image processing on surfaces and point clouds
Houhou et al. Fast texture segmentation based on semi-local region descriptor and active contour
CN107248155A (en) A kind of Cerebral venous dividing method based on SWI images
CN104123749A (en) Picture processing method and system
CN107194937A (en) Tongue image partition method under a kind of open environment
CN105894496A (en) Semi-local-texture-feature-based two-stage image segmentation method
CN102663762B (en) The dividing method of symmetrical organ in medical image
CN103971122B (en) Three-dimensional face based on depth image describes method
CN105512670B (en) Divided based on KECA Feature Dimension Reduction and the HRCT peripheral nerve of cluster
CN105741264A (en) Two-phase image segmentation method based on semi-local texture features
Telea Feature preserving smoothing of shapes using saliency skeletons
Silvoster et al. Watershed based algorithms for the segmentation of spine MRI
Kama et al. Segmentation of soft tissues and tumors from biomedical images using optimized k-means clustering via level set formulation
Abdel-Nasser et al. Analyzing the evolution of breast tumors through flow fields and strain tensors
Ramadhanu et al. Development of affine transformation method in the reconstruction of songket motif
CN112348767A (en) Wood counting model based on object edge detection and feature matching
CN108717699B (en) Ultrasonic image segmentation method based on continuous minimum segmentation
CN108765384B (en) Significance detection method for joint manifold sequencing and improved convex hull
CN112258532A (en) A method for localization and segmentation of the corpus callosum in ultrasound images

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160706