CN114755243A - A method for detecting surface cracks of FPC connectors based on machine vision - Google Patents
A method for detecting surface cracks of FPC connectors based on machine vision Download PDFInfo
- Publication number
- CN114755243A CN114755243A CN202210395228.XA CN202210395228A CN114755243A CN 114755243 A CN114755243 A CN 114755243A CN 202210395228 A CN202210395228 A CN 202210395228A CN 114755243 A CN114755243 A CN 114755243A
- Authority
- CN
- China
- Prior art keywords
- crack
- image
- detected
- connected domain
- lower boundary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
- G01N2021/0106—General arrangement of respective parts
- G01N2021/0112—Apparatus in one mechanical, optical or electronic block
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Image Analysis (AREA)
Abstract
本发明公开了一种基于机器视觉的FPC连接器表面裂纹检测方法,涉及半导体技术领域,该方法获取待检测FPC连接器的待检测区域的待处理图像后,利用各种典型表面裂纹特征的结构元素对待处理图像进行多尺度形态学运算得到二维裂纹概率图,并利用分割阈值进行全局自适应阈值分割,确定得到的裂纹二值图中满足预设连通域特征的目标连通域后,在二维裂纹概率图中定位目标连通域的位置处的候选裂纹区域;根据目标连通域的尺寸位置信息及其对应的候选裂纹区域的响应强度值即可检测该待检测FPC连接器的表面是否存在裂纹;该方法通过机器视觉实现表面裂纹的自动化检测,具有效率高、非接触、精度高、响应速度快、适应非光学恶劣环境等许多优势。
The invention discloses a method for detecting surface cracks of FPC connectors based on machine vision, which relates to the technical field of semiconductors. The element performs multi-scale morphological operations on the image to be processed to obtain a two-dimensional crack probability map, and uses the segmentation threshold to perform global adaptive threshold segmentation. The candidate crack region at the position of the target connected domain is located in the dimensional crack probability map; according to the size and position information of the target connected domain and the response intensity value of the corresponding candidate crack region, it can be detected whether there is a crack on the surface of the FPC connector to be detected. The method realizes the automatic detection of surface cracks through machine vision, and has many advantages such as high efficiency, non-contact, high precision, fast response speed, and adaptability to non-optical harsh environments.
Description
技术领域technical field
本发明涉及半导体技术领域,尤其是一种基于机器视觉的FPC连接器表面裂纹检测方法。The invention relates to the technical field of semiconductors, in particular to a method for detecting surface cracks of FPC connectors based on machine vision.
背景技术Background technique
表面贴装连接器是以贴装的安装方式与印制电路板(PCB)连接的结构,它能够满足表面贴装技术(SMT)的自动贴及回流焊的工艺要求,可以大幅度提高整机装配效率,增加安装密度,节约整机空间。The surface mount connector is a structure that is connected to the printed circuit board (PCB) in a mountable installation method. It can meet the process requirements of surface mount technology (SMT) automatic sticking and reflow soldering, and can greatly improve the overall performance of the machine. Assembly efficiency, increase the installation density, save the space of the whole machine.
随着SMT技术的普及,表面贴装连接器的应用也越来越广泛,各种类型的PCB都随之有相应的表面贴装连接器出现。FPC连接器就是一种用于连接柔性电路板(FPC)与普通PCB的连接器,FPC又称软性电路板、挠性电路板,其以质量轻、厚度薄、可自由弯曲折叠等优良特性而备受青睐。FPC连接器常被用于液晶显示屏(LCD)到驱动电路PCB的连接,主要以0.5mm pitch产品为主,0.3mm pitch产品也已大量使用。With the popularity of SMT technology, the application of surface mount connectors has become more and more extensive, and various types of PCBs have corresponding surface mount connectors. FPC connector is a connector used to connect flexible circuit board (FPC) and ordinary PCB. FPC is also called flexible circuit board and flexible circuit board. It has excellent characteristics such as light weight, thin thickness, and free bending and folding. and favored. FPC connectors are often used for the connection of liquid crystal display (LCD) to the driving circuit PCB, mainly 0.5mm pitch products, and 0.3mm pitch products have also been widely used.
随着FPC连接器生产规模的扩大,对产品质量的要求也迅速提升,这就导致产品质量检测成为连接器生产步骤中至关重要的环节。随着新技术、新材料的出现,连接器开始向外观尺寸的微小化、薄型化,线槽及主体的高精度化趋势发展,由此对连接器的质量检测提出了更高的要求,为满足在SMT制程的要求,整个产品的塑胶端面都要求有良好的平整度和共面度,如果塑胶端面存在裂纹,则会导致连接器与排线连接不良,从而影响产品的使用。With the expansion of the production scale of FPC connectors, the requirements for product quality are also rapidly increasing, which leads to product quality inspection becoming a crucial link in the connector production steps. With the emergence of new technologies and new materials, connectors have begun to miniaturize and thin the appearance size, and the high-precision trend of wire grooves and main bodies has developed, which has put forward higher requirements for the quality inspection of connectors. To meet the requirements of the SMT process, the plastic end face of the entire product is required to have good flatness and coplanarity. If the plastic end face has cracks, it will lead to poor connection between the connector and the cable, thus affecting the use of the product.
目前大多数工厂仍然采用传统的人工检测方法,有经验的员工通过对产品的认知对批量待检产品进行判别分类。人工检测方法简单、投资小,但主要依靠人工目视识别和手工操作,效率低下,误判可能性较高且缺乏一定的客观性。At present, most factories still use the traditional manual inspection method, and experienced employees classify the batches of products to be inspected through their knowledge of the products. The manual detection method is simple and the investment is small, but it mainly relies on manual visual recognition and manual operation, which is inefficient, has a high possibility of misjudgment and lacks a certain degree of objectivity.
发明内容SUMMARY OF THE INVENTION
本发明人针对上述问题及技术需求,提出了一种基于机器视觉的FPC连接器表面裂纹检测方法,本发明的技术方案如下:In view of the above problems and technical requirements, the present inventor proposes a method for detecting surface cracks of FPC connectors based on machine vision. The technical solution of the present invention is as follows:
一种基于机器视觉的FPC连接器表面裂纹检测方法,该方法包括:A method for detecting surface cracks of FPC connectors based on machine vision, the method includes:
获取待检测FPC连接器的待检测区域的待处理图像F(x,y);Obtain the to-be-processed image F(x,y) of the to-be-detected area of the to-be-detected FPC connector;
利用各种典型表面裂纹特征的结构元素S(x,y)对待处理图像F(x,y)进行多尺度形态学运算得到二维裂纹概率图P(x,y);The two-dimensional crack probability map P(x,y) is obtained by performing multi-scale morphological operations on the to-be-processed image F(x,y) using the structural elements S(x,y) of various typical surface crack characteristics;
利用分割阈值t对二维裂纹概率图P(x,y)进行全局自适应阈值分割,得到裂纹二值图Q(x,y);Use the segmentation threshold t to perform global adaptive threshold segmentation on the two-dimensional crack probability map P(x,y), and obtain the crack binary map Q(x,y);
对裂纹二值图Q(x,y)进行连通域搜索标记,确定其中满足预设连通域特征的目标连通域,并确定二维裂纹概率图P(x,y)中在目标连通域的位置处的候选裂纹区域的响应强度值mean;Search and mark the connected domain of the crack binary map Q(x,y), determine the target connected domain that satisfies the preset connected domain characteristics, and determine the position of the target connected domain in the two-dimensional crack probability map P(x,y) The response intensity value mean of the candidate crack region at ;
若目标连通域的尺寸位置信息及其对应的候选裂纹区域的响应强度值mean均满足对应的预设条件,则确定待检测FPC连接器的表面存在裂纹。If the size and position information of the target connected domain and the response intensity value mean of the corresponding candidate crack region both satisfy the corresponding preset conditions, it is determined that there is a crack on the surface of the FPC connector to be detected.
其进一步的技术方案为,获取待检测FPC连接器的待检测区域的待处理图像,包括:Its further technical solution is to obtain the to-be-processed image of the to-be-detected area of the to-be-detected FPC connector, including:
获取待检测FPC连接器的感兴趣区域的原始图像,感兴趣区域在纵向的列方向上包含待检测FPC连接器的上下边界之间的区域,感兴趣区域在横向的行方向的左边界为待检测FPC连接器的第一根金属引脚、右边界为待检测FPC连接器的最后一根金属引脚;Obtain the original image of the region of interest of the FPC connector to be detected. The region of interest includes the area between the upper and lower boundaries of the FPC connector to be detected in the vertical column direction, and the left boundary of the region of interest in the horizontal row direction is the region to be detected. Detect the first metal pin of the FPC connector, and the right border is the last metal pin of the FPC connector to be detected;
将感兴趣区域的原始图像处理为二值图像并确定下边界像素点所在位置的坐标,下边界像素点是二值图像中位于待检测FPC连接器的下边界处且与相邻的像素点的像素值不同的像素点;The original image of the region of interest is processed into a binary image and the coordinates of the lower boundary pixel are determined. The lower boundary pixel is located at the lower boundary of the FPC connector to be detected in the binary image and is adjacent to the pixel point. Pixels with different pixel values;
基于二值图像中的下边界像素点的坐标进行直线拟合得到下边界拟合线,将下边界拟合线按待检测区域的宽度d向上平移得到上边界拟合线;Perform straight line fitting based on the coordinates of the lower boundary pixel points in the binary image to obtain the lower boundary fitting line, and translate the lower boundary fitting line upward according to the width d of the area to be detected to obtain the upper boundary fitting line;
从感兴趣区域的原始图像中截取上边界拟合线和下边界拟合线之间的图像得到待处理图像。The image to be processed is obtained by intercepting the image between the upper boundary fitting line and the lower boundary fitting line from the original image of the region of interest.
其进一步的技术方案为,基于二值图像中的下边界像素点的坐标进行直线拟合得到下边界拟合线,包括:Its further technical solution is to perform straight line fitting based on the coordinates of the lower boundary pixel points in the binary image to obtain the lower boundary fitting line, including:
任选两个下边界像素点的坐标进行直线拟合得到候选拟合线,并确定与候选拟合线之间的距离在误差范围内的下边界像素点的个数作为候选拟合线的拟合准确数据点数;The coordinates of any two lower boundary pixel points are fitted with a straight line to obtain a candidate fitting line, and the number of lower boundary pixel points whose distance from the candidate fitting line is within the error range is determined as the fitting line of the candidate fitting line. the exact number of data points;
重新执行任选两个下边界像素点的坐标进行直线拟合得到候选拟合线的步骤,直至达到迭代终止条件,将每次迭代得到的候选拟合线中对应的拟合准确数据点数最多的一条候选拟合线作为下边界拟合线。Re-execute the steps of performing straight line fitting on the coordinates of any two lower boundary pixel points to obtain a candidate fitting line until the iteration termination condition is reached, and select the candidate fitting line obtained by each iteration with the largest number of corresponding fitting accurate data points. A candidate fit line serves as the lower bound fit line.
其进一步的技术方案为,将感兴趣区域的原始图像处理为二值图像并确定下边界像素点所在位置的坐标,包括:Its further technical solution is to process the original image of the region of interest into a binary image and determine the coordinates of the location of the lower boundary pixel point, including:
将RGB三通道的感兴趣区域的原始图像转换为HSV三通的图像,并提取V通道作为预处理灰度图像;Convert the original image of the region of interest of the RGB three-channel into the image of the HSV three-pass, and extract the V channel as the preprocessed grayscale image;
对预处理灰度图像进行阈值分割得到二值图像,并提取二值图像的下半部分区域中与相邻的像素点的像素值发生突变的下边界像素点所在位置的坐标。Threshold segmentation is performed on the preprocessed grayscale image to obtain a binary image, and the coordinates of the position of the lower boundary pixel point where the pixel value of the adjacent pixel point in the lower half of the binary image is abruptly changed are extracted.
其进一步的技术方案为,利用各种典型表面裂纹特征的结构元素S(x,y)对待处理图像F(x,y)进行多尺度形态学运算得到二维裂纹概率图P(x,y),包括得到二维裂纹概率图P(x,y)为:Its further technical solution is to use the structural elements S(x,y) of various typical surface crack characteristics to perform multi-scale morphological operations on the to-be-processed image F(x,y) to obtain a two-dimensional crack probability map P(x,y) , including obtaining a two-dimensional crack probability map P(x,y) as:
P(x,y)=max{(F·Si)(x,y)}-F(x,y);P(x,y)=max{(F·S i )(x,y)}-F(x,y);
其中,Si(x,y)是第i种典型表面裂纹特征的结构元素,(F·Si)(x,y)-F(x,y)表示灰度级黑帽运算,(F·Si)(x,y)表示灰度级闭运算且Among them, S i (x,y) is the structuring element of the i-th typical surface crack feature, (F·S i )(x,y)-F(x,y) represents the gray-level black hat operation, (F· S i )(x,y) represents the gray level closing operation and
其进一步的技术方案为,该方法还包括:Its further technical scheme is, the method also includes:
将二维裂纹概率图P(x,y)按纵向的列方向进行投影转换得到一维裂纹概率图P′(x,y);The two-dimensional crack probability map P(x,y) is projected and transformed in the longitudinal column direction to obtain a one-dimensional crack probability map P'(x,y);
根据预设间隔h对一维裂纹概率图P′(x,y)进行高斯滤波,并确定滤波结果中最大值对应的中心像素列;Perform Gaussian filtering on the one-dimensional crack probability map P'(x, y) according to the preset interval h, and determine the central pixel column corresponding to the maximum value in the filtering result;
提取二维裂纹概率图P(x,y)中以中心像素列为中心包含两侧若干个像素列的局部区域f(x,y);Extract the local area f(x,y) in the two-dimensional crack probability map P(x,y) with the center pixel column including several pixel columns on both sides in the center;
在局部区域f(x,y)内使用最大类间方差法求解得到分割阈值t。The segmentation threshold t is obtained by solving the maximum inter-class variance method in the local area f(x, y).
其进一步的技术方案为,当一个连通域的拟合路径长度l大于长度阈值、且面积达到面积阈值、且主方向与横向的行方向夹角达到角度阈值时,确定连通域是满足预设连通域特征的目标连通域。Its further technical scheme is, when the fitting path length l of a connected domain is greater than the length threshold, and the area reaches the area threshold, and the included angle between the main direction and the horizontal row direction reaches the angle threshold, it is determined that the connected domain satisfies the preset connectivity. The target connected domain of the domain feature.
其进一步的技术方案为,确定二维裂纹概率图P(x,y)中在目标连通域的位置处的候选裂纹区域的响应强度值mean,包括:Its further technical solution is to determine the response intensity value mean of the candidate crack region at the position of the target connected domain in the two-dimensional crack probability map P(x,y), including:
确定二维裂纹概率图P(x,y)中在目标连通域处的候选裂纹区域,并将候选裂纹区域包含的像素点的灰度平均值作为候选裂纹区域的响应强度值mean。Determine the candidate crack region at the target connected domain in the two-dimensional crack probability map P(x, y), and use the gray average value of the pixels contained in the candidate crack region as the response intensity value mean of the candidate crack region.
其进一步的技术方案为,目标连通域的尺寸位置信息包括目标连通域的拟合路径长度l、目标连通域的上端点与待检测区域的上边界之间的第一距离Lu、目标连通域的下端点与待检测区域的下边界之间的第二距离Ld。Its further technical scheme is that the size and position information of the target connected domain includes the fitting path length l of the target connected domain, the first distance Lu between the upper end point of the target connected domain and the upper boundary of the area to be detected, and the target connected domain. The second distance L d between the lower end point of and the lower boundary of the area to be detected.
其进一步的技术方案为,当l>L且Lu和Ld中有至少一个达到相应的距离阈值时,确定目标连通域的尺寸位置信息满足对应的预设条件;当mean>M时确定候选裂纹区域的响应强度值mean满足对应预设条件,L为拟合路径长度阈值,M为响应强度阈值。Its further technical scheme is, when l>L and at least one of L u and L d reaches the corresponding distance threshold, determine that the size and position information of the target connected domain satisfies the corresponding preset condition; when mean>M, determine the candidate. The response intensity value mean of the crack area satisfies the corresponding preset conditions, L is the fitting path length threshold, and M is the response intensity threshold.
本发明的有益技术效果是:The beneficial technical effects of the present invention are:
本申请公开了一种基于机器视觉的FPC连接器表面裂纹检测方法,该方法通过机器视觉实现表面裂纹的自动化检测,具有非接触、精度高、响应速度快、适应非光学恶劣环境等许多优势,可以在相对恶劣的条件下进行工作,在检测的同时不会对产品造成损坏,也不会在检测过程中引入二次不良,而且相比于人工检测具有更快的速度、更大的稳定性和可重复性,同时还可以提高企业的生产效率和降低劳动成本。The present application discloses a method for detecting surface cracks of FPC connectors based on machine vision. The method realizes automatic detection of surface cracks through machine vision, and has many advantages such as non-contact, high precision, fast response speed, and adaptability to non-optical harsh environments. It can work under relatively harsh conditions, and will not cause damage to the product during inspection, nor will it introduce secondary defects in the inspection process, and has faster speed and greater stability than manual inspection. and repeatability, while also improving enterprise productivity and reducing labor costs.
该方法在在获取到的全区域原始图像后通过感兴趣区域划分的方法对待检测区域进行粗定位,再通过方法对待检测区域的下边界进行精确提取,完成对上下边界的精确拟合,并通过上下边界,在感兴趣区域内精确定位到实际的待检测区域,准确度高。The method uses the method of dividing the region of interest to roughly locate the area to be detected after obtaining the original image of the entire area, and then accurately extracts the lower boundary of the area to be detected by the method to complete the accurate fitting of the upper and lower boundaries. The upper and lower boundaries are precisely located in the area of interest to the actual area to be detected, with high accuracy.
在待检测区域内通过提出的多尺度形态学运算方法求解出待检测区域的裂纹概率图,基于提出的自适应阈值分割方法完成对上述概率图的阈值分割,对阈值分割后的二值图像进行连通域分析及连通域筛选,保留裂纹疑似区域,最后通过设定裂纹相关特征的阈值完成对待检测区域内裂纹的检测,能满足多种类型FPC连接器表面裂纹的实时在线检测,同时具有较高的检测准确率。In the area to be inspected, the crack probability map of the area to be inspected is obtained by the proposed multi-scale morphological operation method, and the threshold segmentation of the above probability map is completed based on the proposed adaptive threshold segmentation method. Connected domain analysis and connected domain screening, retain the suspected crack area, and finally complete the detection of cracks in the area to be detected by setting the threshold of crack-related characteristics, which can meet the real-time online detection of surface cracks of various types of FPC connectors, and has high detection accuracy.
附图说明Description of drawings
图1是一个实施例的FPC连接器表面裂纹检测方法的流程示意图。FIG. 1 is a schematic flowchart of a method for detecting surface cracks of an FPC connector according to an embodiment.
图2是一个实施例中由全区域原始图像逐步处理得到待检测区域的待处理图像F(x,y)的示意图。FIG. 2 is a schematic diagram of a to-be-processed image F(x, y) of a to-be-detected area obtained by step-by-step processing of a full-area original image in an embodiment.
图3是6种典型的表面裂纹特征的结构元素。Figure 3 shows the structural elements of six typical surface crack features.
图4是另一个实施例的FPC连接器表面裂纹检测方法的流程示意图。FIG. 4 is a schematic flowchart of a method for detecting surface cracks of an FPC connector according to another embodiment.
图5是一个实施例中的二维裂纹概率图P(x,y)的示意图。FIG. 5 is a schematic diagram of a two-dimensional crack probability map P(x,y) in one embodiment.
图6是对图5进行全局自适应阈值分割得到的裂纹二值图Q(x,y)的示意图。FIG. 6 is a schematic diagram of the crack binary map Q(x, y) obtained by performing global adaptive threshold segmentation on FIG. 5 .
图7是图5所示的实例中标识出的待检测FPC连接器的表面的裂纹的示意图。FIG. 7 is a schematic diagram of cracks on the surface of the FPC connector to be inspected identified in the example shown in FIG. 5 .
具体实施方式Detailed ways
下面结合附图对本发明的具体实施方式做进一步说明。The specific embodiments of the present invention will be further described below with reference to the accompanying drawings.
本申请公开了一种基于机器视觉的FPC连接器表面裂纹检测方法,该方法包括如下步骤,请参考图1:The present application discloses a method for detecting surface cracks of FPC connectors based on machine vision. The method includes the following steps, please refer to FIG. 1 :
步骤110,获取待检测FPC连接器的待检测区域的待处理图像F(x,y)。待检测区域可以是整个待检测FPC连接器的区域,或者是待检测FPC连接器的部分结构的区域,根据实际所要执行表面裂纹检测的区域来决定。根据实际情况,FPC连接器一般在塑胶端面处会产生表面裂纹,因此表面裂纹检测也可以重点针对这一部分,则待检测区域即待检测FPC连接器的端面区域,本申请以此为例进行后续的说明。Step 110: Obtain the to-be-processed image F(x, y) of the to-be-detected area of the to-be-detected FPC connector. The area to be inspected may be the entire area of the FPC connector to be inspected, or the area of a part of the structure of the FPC connector to be inspected, which is determined according to the area where the surface crack inspection is actually to be performed. According to the actual situation, FPC connectors generally have surface cracks at the plastic end face, so the surface crack detection can also focus on this part, and the area to be detected is the end face area of the FPC connector to be detected. This application uses this as an example for follow-up instruction of.
获取待处理图像F(x,y)的方法包括如下步骤,请参考图2的实例图:The method for obtaining the image to be processed F(x,y) includes the following steps, please refer to the example diagram of FIG. 2:
(1)获取待检测FPC连接器的感兴趣区域的原始图像。感兴趣区域包含待检测区域以及其他区域,通常是整个待检测FPC连接器的区域,这是因为在实际操作时较难直接获取准确的待检测区域的待处理图像F(x,y)。(1) Obtain the original image of the region of interest of the FPC connector to be detected. The region of interest includes the region to be detected and other regions, usually the entire region of the FPC connector to be detected, because it is difficult to directly obtain an accurate to-be-processed image F(x,y) of the region to be detected in actual operation.
而在实际获取原始图像时,通常是利用工装卡槽夹持待检测FPC连接器进行拍摄,通常也很难准确的直接采集到感兴趣区域的原始图像,而是首先拍摄全区域原始图像,如图2中的(a)所示,该全区域原始图像包含感兴趣区域以及背景区域,也即包含待检测FPC连接器的图像和工装卡槽以及其他背景的图像,然后可以从全区域原始图像中提取出感兴趣区域的原始图像,如图2种的(b)所示,感兴趣区域提取的方法本申请不再赘述。本申请使用一款USB3.0接口的510万像素的工业显微相机进行图像采集,该相机可满足本例FPC连接器表面微米级裂纹高精度成像,同时为保证成像效果稳定,采用白色LED环形光源进行补光。When actually acquiring the original image, the tooling slot is usually used to clamp the FPC connector to be tested for shooting, and it is usually difficult to directly acquire the original image of the region of interest. As shown in (a) of Figure 2, the full-area original image contains the region of interest and the background area, that is, the image containing the FPC connector to be tested, the tooling slot and other background images, and then the full-area original image can be obtained from the original image. The original image of the region of interest is extracted from the original image, as shown in (b) of Figure 2, the method of extracting the region of interest is not repeated in this application. This application uses a 5.1 million-pixel industrial microscope camera with USB3.0 interface for image acquisition. This camera can meet the high-precision imaging of micron-scale cracks on the surface of the FPC connector in this example. At the same time, to ensure stable imaging effect, a white LED ring The light source fills in light.
提取得到的待检测FPC连接器的感兴趣区域的原始图像在纵向的列方向上包含待检测FPC连接器的上下边界之间的区域,感兴趣区域在横向的行方向的左边界为待检测FPC连接器的第一根金属引脚、右边界为待检测FPC连接器的最后一根金属引脚;The extracted original image of the region of interest of the FPC connector to be detected contains the area between the upper and lower boundaries of the FPC connector to be detected in the vertical column direction, and the left boundary of the region of interest in the horizontal row direction is the FPC to be detected. The first metal pin of the connector and the right border are the last metal pin of the FPC connector to be detected;
(2)将感兴趣区域的原始图像处理为二值图像并确定下边界像素点所在位置的坐标,为了减少数据处理量,可以先粗略截取感兴趣区域的原始图像的下半部分,如图2中的(c)所示。然后将感兴趣区域的下半部分的原始图像处理为二值图像,如图2中的(d)所示,为了清楚展示,该实施例还对(d)进行了颜色翻转得到(e),继而提取下边界像素点所在位置的坐标。(2) Process the original image of the region of interest into a binary image and determine the coordinates of the lower boundary pixel points. In order to reduce the amount of data processing, the lower half of the original image of the region of interest can be roughly intercepted, as shown in Figure 2 shown in (c). Then, the original image of the lower half of the region of interest is processed into a binary image, as shown in (d) in FIG. 2 . For the sake of clarity, this embodiment also performs color inversion on (d) to obtain (e), Then extract the coordinates of the location of the lower boundary pixel point.
下边界像素点是二值图像中位于待检测FPC连接器的下边界处且与相邻的像素点的像素值不同的像素点。具体的:将RGB三通道的感兴趣区域的原始图像转换为HSV三通的图像,并提取V通道作为预处理灰度图像。The lower boundary pixel point is a pixel point in the binary image that is located at the lower boundary of the FPC connector to be detected and whose pixel value is different from that of the adjacent pixel point. Specifically: Convert the original image of the region of interest with RGB three channels to the image of the HSV three-pass, and extract the V channel as the preprocessed grayscale image.
对预处理灰度图像进行阈值分割得到二值图像,分割阈值可以取为0.5。并提取二值图像的下半部分区域中与相邻的像素点的像素值发生突变的下边界像素点所在位置的坐标。Threshold segmentation is performed on the preprocessed grayscale image to obtain a binary image, and the segmentation threshold can be taken as 0.5. And extract the coordinates of the position of the lower boundary pixel where the pixel value of the adjacent pixel in the lower half of the binary image is abruptly changed.
(3)基于二值图像中的下边界像素点的坐标进行直线拟合得到下边界拟合线。具体的:(3) Perform straight line fitting based on the coordinates of the lower boundary pixel points in the binary image to obtain the lower boundary fitting line. specific:
任选两个下边界像素点的坐标进行直线拟合得到候选拟合线,并确定与候选拟合线之间的距离在误差范围内的下边界像素点的个数作为候选拟合线的拟合准确数据点数,误差范围可以自定义设置,以避免坐标的噪声影响。The coordinates of any two lower boundary pixel points are fitted with a straight line to obtain a candidate fitting line, and the number of lower boundary pixel points whose distance from the candidate fitting line is within the error range is determined as the fitting line of the candidate fitting line. According to the exact number of data points, the error range can be customized to avoid the influence of the noise of the coordinates.
重新执行任选两个下边界像素点的坐标进行直线拟合得到候选拟合线的步骤,直至达到迭代终止条件,得到各个候选拟合线的拟合准确数据点数,迭代终止条件可以是迭代的次数达到次数阈值。将每次迭代得到的候选拟合线中对应的拟合准确数据点数最多的一条候选拟合线作为下边界拟合线。Re-execute the steps of performing straight line fitting on the coordinates of two optional lower boundary pixel points to obtain candidate fitting lines, until the iteration termination condition is reached, and the number of accurate fitting data points of each candidate fitting line is obtained. The iteration termination condition can be iterative The count reaches the count threshold. The candidate fitting line with the largest number of corresponding fitting accurate data points among the candidate fitting lines obtained in each iteration is used as the lower boundary fitting line.
(4)将下边界拟合线按待检测区域的宽度d向上平移得到上边界拟合线。宽度d是基于待检测FPC连接器的尺寸预先确定的。(4) Translate the lower boundary fitting line upward according to the width d of the area to be detected to obtain the upper boundary fitting line. The width d is predetermined based on the size of the FPC connector to be inspected.
(5)从感兴趣区域的原始图像中截取上边界拟合线和下边界拟合线之间的图像得到待处理图像,由此提取得到的待检测区域的待处理图像F(x,y),在本申请的举例中,也即待检测FPC连接器的端面区域的图像。如图2所示,利用上边界拟合线和下边界拟合线构成的如图2中的(f)的掩膜即可以从(b)中提取得到待检测区域的待处理图像F(x,y),如图2中的(g)所示。(5) Intercept the image between the upper boundary fitting line and the lower boundary fitting line from the original image of the region of interest to obtain the to-be-processed image, and then extract the to-be-processed image F(x,y) of the to-be-detected area. , in the example of this application, that is, the image of the end face area of the FPC connector to be detected. As shown in Fig. 2, the mask as shown in Fig. 2 (f) formed by the upper boundary fitting line and the lower boundary fitting line can be extracted from (b) to obtain the to-be-processed image F(x) of the area to be detected. , y), as shown in (g) in Figure 2.
步骤120,利用各种典型表面裂纹特征的结构元素S(x,y)对待处理图像F(x,y)进行多尺度形态学运算得到二维裂纹概率图P(x,y)。Step 120 , using the structural elements S(x,y) of various typical surface crack features to perform multi-scale morphological operations on the to-be-processed image F(x,y) to obtain a two-dimensional crack probability map P(x,y).
各种典型表面裂纹特征的结构元素S(x,y)是根据FPC连接器常见的几种典型的表面裂纹特征预先建立得到的,实际应用时比较典型的有6种,如图3所示。得到二维裂纹概率图P(x,y)为:The structural elements S(x, y) of various typical surface crack features are pre-established according to several typical surface crack features common to FPC connectors, and there are six typical ones in practical applications, as shown in Figure 3. The two-dimensional crack probability map P(x, y) is obtained as:
P(x,y)=max{(F·Si)(x,y)}-F(x,y);P(x,y)=max{(F·S i )(x,y)}-F(x,y);
其中,Si(x,y)是第i种典型表面裂纹特征的结构元素,(F·Si)(x,y)-F(x,y)表示灰度级黑帽运算,(F·Si)(x,y)表示灰度级闭运算且 表示膨胀运算的算子,Θ表示腐蚀运算的算子,具体的计算过程本申请不详细展开。Among them, S i (x,y) is the structuring element of the i-th typical surface crack feature, (F·S i )(x,y)-F(x,y) represents the gray-level black hat operation, (F· S i )(x,y) represents the gray level closing operation and represents an operator of dilation operation, Θ represents an operator of erosion operation, and the specific calculation process is not detailed in this application.
步骤130,利用分割阈值t对二维裂纹概率图P(x,y)进行全局自适应阈值分割,得到裂纹二值图Q(x,y)。Step 130, using the segmentation threshold t to perform global adaptive threshold segmentation on the two-dimensional crack probability map P(x, y) to obtain the crack binary map Q(x, y).
请参考图4,该步骤的分割阈值t利用如下方法计算得到:Please refer to Figure 4, the segmentation threshold t of this step is calculated by the following method:
(1)根据裂纹实际结构为竖裂纹的特征,将二维裂纹概率图P(x,y)按纵向的列方向进行投影转换得到一维裂纹概率图P′(x,y);(1) According to the fact that the actual structure of the crack is a vertical crack, the two-dimensional crack probability map P(x, y) is projected and transformed in the longitudinal column direction to obtain a one-dimensional crack probability map P'(x, y);
(2)根据预设间隔h对一维裂纹概率图P′(x,y)进行高斯滤波,并确定滤波结果中最大值对应的中心像素列,预设间隔h是根据裂纹大致宽度以及裂纹可能出现的倾斜范围预先设定的,比如取h=15。(2) Perform Gaussian filtering on the one-dimensional crack probability map P'(x, y) according to the preset interval h, and determine the central pixel column corresponding to the maximum value in the filtering result. The preset interval h is based on the approximate crack width and crack probability. The inclination range that appears is preset, for example, h=15.
(3)提取二维裂纹概率图P(x,y)中以中心像素列为中心包含两侧若干个像素列的局部区域f(x,y),局部区域f(x,y)包含的中心像素列左右像素列的列数预先设定,比如局部区域f(x,y)包含以中心像素列为中心左右各延伸10个像素列的区域。(3) Extract the local area f(x,y) in the two-dimensional crack probability map P(x,y) that contains several pixel columns on both sides with the center pixel column in the center, and the center contained in the local area f(x,y) The number of the left and right pixel rows of the pixel row is preset, for example, the local area f(x, y) includes an area extending 10 pixel rows to the left and right from the center of the central pixel row.
(4)在局部区域f(x,y)内使用最大类间方差法求解得到分割阈值t。(4) Use the maximum inter-class variance method to solve the segmentation threshold t in the local area f(x, y).
然后可以利用局部区域f(x,y)求解得到的分割阈值t对全局的二维裂纹概率图P(x,y)进行全局自适应阈值分割得到Q(x,y),二维裂纹概率图P(x,y)如图5所示,进行全局自适应阈值分割得到的Q(x,y)如图6所示。Then, the global two-dimensional crack probability map P(x, y) can be globally adaptively segmented by using the segmentation threshold t obtained by solving the local area f(x, y) to obtain Q(x, y), the two-dimensional crack probability map P(x,y) is shown in Figure 5, and Q(x,y) obtained by global adaptive threshold segmentation is shown in Figure 6.
步骤140,对裂纹二值图Q(x,y)进行连通域搜索标记,一个实施例中采用8连通方式。确定其中满足预设连通域特征的目标连通域,并确定二维裂纹概率图P(x,y)中在目标连通域的位置处的候选裂纹区域的响应强度值mean。In step 140, the connected domain search mark is performed on the crack binary image Q(x, y). In one embodiment, an 8-connection mode is adopted. Determine the target connected domain in which the preset connected domain characteristics are satisfied, and determine the response intensity value mean of the candidate crack region at the position of the target connected domain in the two-dimensional crack probability map P(x,y).
当一个连通域的拟合路径长度l大于长度阈值、且面积达到面积阈值、且主方向与横向的行方向夹角达到角度阈值时,确定连通域是满足预设连通域特征的目标连通域。在一个实施例中,取长度阈值为15个像素点,面积阈值为20,角度阈值为50°。When the fitting path length l of a connected domain is greater than the length threshold, and the area reaches the area threshold, and the included angle between the main direction and the horizontal row direction reaches the angle threshold, it is determined that the connected domain is a target connected domain that satisfies the preset connected domain characteristics. In one embodiment, the length threshold is 15 pixels, the area threshold is 20, and the angle threshold is 50°.
在搜索标记连通域的过程中,可以确定目标连通域的上端点位置、下端点位置、上端点与待检测区域的上边界之间的第一距离Lu、下端点与待检测区域的下边界之间的第二距离Ld等位置标识的信息,基于这些位置标识的信息即可以定位P(x,y)中在目标连通域的位置处的候选裂纹区域。然后将候选裂纹区域包含的像素点的灰度平均值作为候选裂纹区域的响应强度值mean。In the process of searching the marked connected domain, the position of the upper end point, the position of the lower end point of the target connected domain, the first distance Lu between the upper end point and the upper boundary of the area to be detected, the lower end point and the lower boundary of the area to be detected can be determined The second distance between L d and other position identification information, based on these position identification information, the candidate crack region at the position of the target connected domain in P(x, y) can be located. Then, the grayscale average value of the pixels contained in the candidate crack region is taken as the response intensity value mean of the candidate crack region.
步骤150,若目标连通域的尺寸位置信息及其对应的候选裂纹区域的响应强度值mean均满足对应的预设条件,则确定待检测FPC连接器的表面存在裂纹,否则确定待检测FPC连接器的表面不存在裂纹。Step 150: If the size and position information of the target connected domain and the response intensity value mean of the corresponding candidate crack region both satisfy the corresponding preset conditions, it is determined that there is a crack on the surface of the FPC connector to be detected, otherwise it is determined that the FPC connector to be detected is cracked. There are no cracks on the surface.
在一个实施例中,目标连通域的尺寸位置信息包括目标连通域的拟合路径长度l、目标连通域的上端点与待检测区域的上边界之间的第一距离Lu、目标连通域的下端点与待检测区域的下边界之间的第二距离Ld。In one embodiment, the size and position information of the target connected domain includes the fitting path length l of the target connected domain, the first distance Lu between the upper end point of the target connected domain and the upper boundary of the to-be - detected area, the length of the target connected domain The second distance L d between the lower end point and the lower boundary of the area to be detected.
则当l>L且Lu和Ld中有至少一个达到相应的距离阈值时,确定目标连通域的尺寸位置信息满足对应的预设条件。当mean>M时确定候选裂纹区域的响应强度值mean满足对应预设条件,L为拟合路径长度阈值,M为响应强度阈值。也即记载为当满足和/或,时,确定待检测FPC连接器的表面存在裂纹,LU是第一距离对应的距离阈值,LD是第二距离对应的距离阈值。Then, when l>L and at least one of L u and L d reaches the corresponding distance threshold, it is determined that the size and position information of the target connected domain satisfies the corresponding preset condition. When mean>M, it is determined that the response intensity value mean of the candidate crack region satisfies the corresponding preset condition, L is the fitting path length threshold, and M is the response intensity threshold. That is to say, when satisfied and / or, , it is determined that there is a crack on the surface of the FPC connector to be detected, LU is the distance threshold corresponding to the first distance, and LD is the distance threshold corresponding to the second distance.
除了可以确定待检测FPC连接器的表面存在裂纹之外,还可以指标标识出候选裂纹区域指示裂纹的位置和形态,如图7所示。In addition to determining that there is a crack on the surface of the FPC connector to be tested, the candidate crack area can also be identified by an index to indicate the location and shape of the crack, as shown in Figure 7.
以上所述的仅是本申请的优选实施方式,本发明不限于以上实施例。可以理解,本领域技术人员在不脱离本发明的精神和构思的前提下直接导出或联想到的其他改进和变化,均应认为包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present application, and the present invention is not limited to the above embodiments. It can be understood that other improvements and changes directly derived or thought of by those skilled in the art without departing from the spirit and concept of the present invention should be considered to be included within the protection scope of the present invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210395228.XA CN114755243A (en) | 2022-04-15 | 2022-04-15 | A method for detecting surface cracks of FPC connectors based on machine vision |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210395228.XA CN114755243A (en) | 2022-04-15 | 2022-04-15 | A method for detecting surface cracks of FPC connectors based on machine vision |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114755243A true CN114755243A (en) | 2022-07-15 |
Family
ID=82331554
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210395228.XA Pending CN114755243A (en) | 2022-04-15 | 2022-04-15 | A method for detecting surface cracks of FPC connectors based on machine vision |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114755243A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115082436A (en) * | 2022-07-22 | 2022-09-20 | 山东易斯特工程工具有限公司 | Shield tunneling machine tool bit production defect detection method |
| CN116309436A (en) * | 2023-03-15 | 2023-06-23 | 广东科研世智能科技有限公司 | Fracture state detection method and device, electronic equipment and storage medium |
| CN116993696A (en) * | 2023-08-03 | 2023-11-03 | 苏州阿普奇物联网科技有限公司 | Diamond saw blade crack detection method and device based on machine vision |
| CN117095004A (en) * | 2023-10-20 | 2023-11-21 | 金成技术股份有限公司 | Excavator walking frame main body welding deformation detection method based on computer vision |
| CN118552529A (en) * | 2024-07-26 | 2024-08-27 | 东莞市南谷第电子有限公司 | A method for detecting the quality of insulation layer of new energy high-voltage and high-current energy storage wiring harness |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110274353A1 (en) * | 2010-05-07 | 2011-11-10 | Hailong Yu | Screen area detection method and screen area detection system |
| CN106353324A (en) * | 2016-08-10 | 2017-01-25 | 浙江理工大学 | Magnet ring surface defect extraction method |
| CN108830838A (en) * | 2018-05-28 | 2018-11-16 | 江苏大学 | A kind of pcb board incompleteness Trigger jitter detection method of sub-pixel |
| CN110223296A (en) * | 2019-07-08 | 2019-09-10 | 山东建筑大学 | A kind of screw-thread steel detection method of surface flaw and system based on machine vision |
| CN110223276A (en) * | 2019-05-28 | 2019-09-10 | 武汉楚锐视觉检测科技有限公司 | A kind of bottle cap detection method and device based on image procossing |
| CN111179243A (en) * | 2019-12-25 | 2020-05-19 | 武汉昕竺科技服务有限公司 | Small-size chip crack detection method and system based on computer vision |
-
2022
- 2022-04-15 CN CN202210395228.XA patent/CN114755243A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110274353A1 (en) * | 2010-05-07 | 2011-11-10 | Hailong Yu | Screen area detection method and screen area detection system |
| CN106353324A (en) * | 2016-08-10 | 2017-01-25 | 浙江理工大学 | Magnet ring surface defect extraction method |
| CN108830838A (en) * | 2018-05-28 | 2018-11-16 | 江苏大学 | A kind of pcb board incompleteness Trigger jitter detection method of sub-pixel |
| CN110223276A (en) * | 2019-05-28 | 2019-09-10 | 武汉楚锐视觉检测科技有限公司 | A kind of bottle cap detection method and device based on image procossing |
| CN110223296A (en) * | 2019-07-08 | 2019-09-10 | 山东建筑大学 | A kind of screw-thread steel detection method of surface flaw and system based on machine vision |
| CN111179243A (en) * | 2019-12-25 | 2020-05-19 | 武汉昕竺科技服务有限公司 | Small-size chip crack detection method and system based on computer vision |
Non-Patent Citations (6)
| Title |
|---|
| 刘国成等: "人群异常行为数字图像处理与分析", 31 January 2020, 西南交通大学出版社, pages: 128 - 130 * |
| 刘永波等: "基于计算机视觉的农作物病害图像识别与分级技术研究", 30 September 2021, 四川科学技术出版社, pages: 65 - 67 * |
| 厉荣宣;史东东;: "工件表面裂纹机器视觉检测研究", 自动化仪表, no. 09, 20 September 2017 (2017-09-20), pages 89 - 92 * |
| 徐进军: "工业测量技术与数据处理", 28 February 2014, 武汉大学出版社, pages: 203 - 205 * |
| 章新友等: "医学图形图像处理", 30 April 2015, 中国中医药出版社, pages: 176 - 177 * |
| 陈亮: "基于形态学的磁粉检测焊缝裂纹缺陷识别技术研究", 中国优秀硕士学位论文全文数据库工程科技Ⅰ辑, 15 February 2017 (2017-02-15), pages 30 - 62 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115082436A (en) * | 2022-07-22 | 2022-09-20 | 山东易斯特工程工具有限公司 | Shield tunneling machine tool bit production defect detection method |
| CN116309436A (en) * | 2023-03-15 | 2023-06-23 | 广东科研世智能科技有限公司 | Fracture state detection method and device, electronic equipment and storage medium |
| CN116309436B (en) * | 2023-03-15 | 2023-12-12 | 广东科研世智能科技有限公司 | Fracture state detection method and device, electronic equipment and storage medium |
| CN116993696A (en) * | 2023-08-03 | 2023-11-03 | 苏州阿普奇物联网科技有限公司 | Diamond saw blade crack detection method and device based on machine vision |
| CN117095004A (en) * | 2023-10-20 | 2023-11-21 | 金成技术股份有限公司 | Excavator walking frame main body welding deformation detection method based on computer vision |
| CN117095004B (en) * | 2023-10-20 | 2024-01-12 | 金成技术股份有限公司 | Excavator walking frame main body welding deformation detection method based on computer vision |
| CN118552529A (en) * | 2024-07-26 | 2024-08-27 | 东莞市南谷第电子有限公司 | A method for detecting the quality of insulation layer of new energy high-voltage and high-current energy storage wiring harness |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114755243A (en) | A method for detecting surface cracks of FPC connectors based on machine vision | |
| CN107941808B (en) | 3D printing forming quality detection system and method based on machine vision | |
| CN108510476B (en) | Mobile phone screen circuit detection method based on machine vision | |
| CN109472271B (en) | Printed circuit board image contour extraction method and device | |
| CN114627089B (en) | Defect identification method, defect identification device, computer equipment and computer readable storage medium | |
| CN113177924A (en) | Industrial production line product flaw detection method | |
| CN112419225B (en) | A SOP-type chip detection method and system based on pin segmentation | |
| CN113705564B (en) | Pointer type instrument identification reading method | |
| CN109409290B (en) | A system and method for automatic identification of thermometer verification readings | |
| CN112308854B (en) | Automatic detection method and system for chip surface flaws and electronic equipment | |
| CN116664570B (en) | Flat connector production defect detection method based on industrial vision | |
| CN112115948A (en) | Chip surface character recognition method based on deep learning | |
| CN106680086A (en) | Video extensometer applied to high-speed tensile experiment of plastic material | |
| WO2021227289A1 (en) | Deep learning-based low-quality two-dimensional barcode detection method in complex background | |
| CN117953062A (en) | A BGA chip positioning and detection method based on dot matrix fitting | |
| CN114037682A (en) | A two-dimensional automatic detection method for surface defects of optical components | |
| CN119048837A (en) | A PCB board component defect detection method, system, device and medium | |
| CN114170246B (en) | Positioning method for precision displacement platform | |
| CN116703803A (en) | Method, device and system for detecting burrs on the edges of battery pole pieces | |
| CN117764952B (en) | High-speed cable quality detection method for vision robot | |
| CN112634259A (en) | Automatic modeling and positioning method for keyboard keycaps | |
| CN114496860B (en) | Surface imaging system and method for IC photoetching character recognition and detection device | |
| CN115035071B (en) | Visual detection method for black point defect of PAD light guide plate | |
| CN114926417B (en) | Microscopic imaging detection method and system for weak scratches on high-density flexible FPC surface | |
| CN111192261A (en) | Method for identifying lens defect types |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: 214000 No. 5, Huiqian Road, Liangxi District, Wuxi City, Jiangsu Province Applicant after: Jiangsu Yiteng Electronic Technology Co.,Ltd. Applicant after: Nanjing University of Aeronautics and Astronautics Address before: 214000 No. 5, Huiqian Road, Liangxi District, Wuxi City, Jiangsu Province Applicant before: YITENG ELECTRONIC SCIENCE & TECHNOLOGY (KUNSHAN) CO.,LTD. Country or region before: China Applicant before: Nanjing University of Aeronautics and Astronautics |