[go: up one dir, main page]

CN1716281A - Visual quick identifying method for football robot - Google Patents

Visual quick identifying method for football robot Download PDF

Info

Publication number
CN1716281A
CN1716281A CN 200510027280 CN200510027280A CN1716281A CN 1716281 A CN1716281 A CN 1716281A CN 200510027280 CN200510027280 CN 200510027280 CN 200510027280 A CN200510027280 A CN 200510027280A CN 1716281 A CN1716281 A CN 1716281A
Authority
CN
China
Prior art keywords
correction
color
target
robot
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200510027280
Other languages
Chinese (zh)
Other versions
CN100345154C (en
Inventor
陈万米
魏延钦
蒋征波
张冰
费敏锐
郭梦琦
夏冰玉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Shanghai for Science and Technology
Original Assignee
University of Shanghai for Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Shanghai for Science and Technology filed Critical University of Shanghai for Science and Technology
Priority to CNB2005100272806A priority Critical patent/CN100345154C/en
Publication of CN1716281A publication Critical patent/CN1716281A/en
Application granted granted Critical
Publication of CN100345154C publication Critical patent/CN100345154C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Image Analysis (AREA)

Abstract

本发明涉及一种足球机器人视觉快速识别方法。它包括将摄像机安装在场地上方使其拍摄范围完全覆盖球场;将视频采集卡安装在工作站上,其输入连接摄像机的输出,视频采集卡输出数字化的图像数据,由计算机对数字化图像处理,达到确定球门和边线位置,实时提供场上队员的位置、方向、速度和加速度,以及球的位置数据,程序通过VC++MFC实现;步骤为:(1)目标的特征提取和校正参数的整定;(2)图像预处理;(3)目标识别;(4)校正处理。本发明的识别方法具有搜索速度快、识别精度高和对环境适应性强等特点。

The invention relates to a fast visual identification method for a football robot. It includes installing the camera above the field so that its shooting range completely covers the field; installing the video capture card on the workstation, its input is connected to the output of the camera, the video capture card outputs digital image data, and the digital image is processed by the computer to achieve certainty. The position of the goal and the sideline provides the position, direction, speed and acceleration of the players on the field in real time, as well as the position data of the ball. The program is realized by VC++MFC; the steps are: (1) The feature extraction of the target and the setting of the correction parameters; ( 2) Image preprocessing; (3) Target recognition; (4) Correction processing. The recognition method of the invention has the characteristics of fast search speed, high recognition precision, strong adaptability to the environment and the like.

Description

足球机器人视觉快速识别方法A Fast Vision Recognition Method for Soccer Robots

技术领域technical field

本发明是针对机器人进行足球比赛时的数字化图像处理和识别。涉及到实时软件编程,数字信号处理,计算机科学和工程光学等多个领域。The invention is aimed at digital image processing and recognition when a robot plays a football game. Involves real-time software programming, digital signal processing, computer science and engineering optics and other fields.

背景技术Background technique

机器人足球是由加拿大不列颠哥伦比亚大学的Alan Mackworth教授于1992年正式提出。这一科技及娱乐项目于二十世纪九十年代兴起,并在欧美及闩本等发达地区风行。Robot soccer was formally proposed in 1992 by Professor Alan Mackworth of the University of British Columbia in Canada. This technology and entertainment project emerged in the 1990s and became popular in developed regions such as Europe, America and Japan.

机器人足球赛最重要的目的是检验人工智能的前沿研究、特别是多主体系统研究的最新成果,这些成果可以转化并应用在其他的工业或民用机器人上。可以说足球机器人能作为研究一切机器人和人工智能的标准平台。另外,足球本身就是一项娱乐性很强的运动,因此机器人足球是集科技和娱乐于一体的智能机器人,是以体育竞赛为载体的前沿科研竞争和高科技对抗,是展示高科技进展的生动窗口和促进科技成果实用化和产业化的新途径。The most important purpose of the Robot Soccer Game is to test the cutting-edge research of artificial intelligence, especially the latest results of multi-agent system research, which can be transformed and applied to other industrial or civilian robots. It can be said that the football robot can be used as a standard platform for researching all robots and artificial intelligence. In addition, football itself is a very entertaining sport, so robot football is an intelligent robot integrating technology and entertainment. It is a cutting-edge scientific research competition and high-tech confrontation based on sports competitions. It is a vivid display of high-tech progress. A window and a new way to promote the practicality and industrialization of scientific and technological achievements.

机器人足球赛的比赛规则与人类正规的足球赛类似。机器人在比赛中不受人类控制,完全自主地进行比赛。为了实现这一目标,机器人必须由以下五部分组成,即视觉子系统、决策子系统、无线通讯子系统、运动控制子系统和机械子系统。视觉和决策子系统是机器人的眼睛和大脑,无线通讯子系统是机器人的耳朵和嘴巴,运动控制子系统相当于人类的神经系统,而机械子系统就是机器人的手脚。The game rules of the robot soccer game are similar to the regular football game of human beings. Robots are not controlled by humans during the game and play completely autonomously. In order to achieve this goal, the robot must be composed of the following five parts, namely vision subsystem, decision-making subsystem, wireless communication subsystem, motion control subsystem and mechanical subsystem. The vision and decision-making subsystems are the eyes and brain of the robot, the wireless communication subsystem is the ears and mouth of the robot, the motion control subsystem is equivalent to the human nervous system, and the mechanical subsystem is the hands and feet of the robot.

其中,视觉子系统必须向决策系统提供足够多的场上信息以使机器人能对场上形势做出准确判断并采用适当的策略。由于足球机器人是一个高度动态的系统,故视觉系统处理的快速性和精确性对整个系统有着至关重要的影响。过去的图像识别方法存在着种种弊端。主要体现在搜索速度慢,识别精度低,对不同环境的适应性差,光源一旦改变,就会出现目标丢失和误识别。这直接导致机器人的跑位出现偏差,甚至出现混乱场面。这主要是由以下几点原因造成:Among them, the visual subsystem must provide enough information on the field to the decision-making system so that the robot can make accurate judgments on the situation on the field and adopt appropriate strategies. Since the football robot is a highly dynamic system, the speed and accuracy of the visual system processing have a crucial impact on the entire system. There are various drawbacks in the past image recognition methods. It is mainly reflected in the slow search speed, low recognition accuracy, poor adaptability to different environments, and once the light source is changed, target loss and misidentification will occur. This directly leads to deviations in the robot's running position, and even chaos. This is mainly caused by the following reasons:

1.目前大多数图像识别技术采用的色彩模型都是红绿蓝RGB颜色空间,随着光强不同,相同的颜色经摄像机和图像卡的捕捉后也会发生变化,RGB模型很容易受到光源的影响,系统无法自适应环境所引起的变化情况。1. At present, the color model used by most image recognition technologies is the red, green and blue RGB color space. With different light intensities, the same color will also change after being captured by the camera and image card. The RGB model is easily affected by the light source. The system cannot adapt to changes caused by the environment.

2.摄像头因采用广角镜会产生桶形失真,并且由于机器人与球存在的高度差会产生机器人位置偏差,使得辨识出的机器人位置不精确,影响了图像识别的精确性。2. The wide-angle lens of the camera will produce barrel distortion, and the height difference between the robot and the ball will cause the position deviation of the robot, making the identified robot position inaccurate and affecting the accuracy of image recognition.

3.若对摄像机摄下的所有区域进行识别(即全局识别)会耗用大量的时间。为了解决这一问题,目前的图像搜索方法是以前一帧识别出的目标位置为中心,以一定的顺序向外搜索。但是如果上一帧未识别出或发生了误识别,那么目标将在很长时间内以错误的路径搜寻目标,反而影响了识别速度。3. It will consume a lot of time to recognize all the regions captured by the camera (that is, global recognition). In order to solve this problem, the current image search method is centered on the target position identified in the previous frame, and searches outward in a certain order. However, if the previous frame is not recognized or misidentified, the target will search for the target with a wrong path for a long time, which will affect the recognition speed.

发明内容Contents of the invention

本发明的目的在于提供一种足球机器人视觉快速识别方法,具有搜索速度快,识别精度高,对环境的适应性强的特点,为足球机器人的决策系统提供足够多的场上信息。The purpose of the present invention is to provide a football robot vision fast recognition method, which has the characteristics of fast search speed, high recognition accuracy and strong adaptability to the environment, and provides enough information on the field for the decision-making system of the football robot.

为达到上述目的,本发明采用下述技术方案:To achieve the above object, the present invention adopts the following technical solutions:

一种足球机器人视觉快速识别方法,包括将摄像机安装在场地上方使其拍摄范围完全覆盖球场;将视频采集卡安装在工作站上,其输入连接摄像机的输出,视频采集卡输出数字化的图像数据,由计算机对数字化图像处理,达到确定球门和边线位置,实时提场上队员的位置、方向、速度和加速度,以及球的位置数据;其特征在于程序通过VC++MFC实现,其步骤如下:A kind of football robot vision rapid identification method, comprises that camera is installed above the field so that its shooting range completely covers the field; video capture card is installed on the workstation, its input is connected with the output of camera, and video capture card outputs digitized image data, by The computer processes the digitized image to determine the position of the goal and the sideline, and provides the position, direction, speed and acceleration of the players on the field in real time, as well as the position data of the ball; it is characterized in that the program is realized by VC++MFC, and the steps are as follows:

(1)目标的特征提取和校正参数的整定:(1) The feature extraction of the target and the setting of the correction parameters:

提取的特征是颜色特征,每个机器人的顶盖上均贴有代表球队和个人的色标,这些颜色都与球的颜色相区别;The extracted features are color features, and the top cover of each robot is affixed with color codes representing teams and individuals, which are distinguished from the colors of the ball;

采用由色调·饱和度·亮度组成的HSV模型为进行目标颜色特征提取的色彩模型;The HSV model composed of hue, saturation and brightness is used as the color model for target color feature extraction;

校正是对原图像进行像素坐标的空间几何变换,使像素落在正确的位置,以非线性方程的形式实现,在现场据实际场地和摄像机摆放位置,现场整定校正参数。Correction is the spatial geometric transformation of the pixel coordinates of the original image, so that the pixels fall in the correct position, and it is realized in the form of a nonlinear equation. The correction parameters are set on the spot according to the actual site and the position of the camera.

(2)图像预处理(2) Image preprocessing

对数字化图像均值滤波,去除突变干扰点。Mean filtering of the digitized image to remove mutation interference points.

(3)目标识别(3) Target recognition

设每个机器人上都有4个颜色不同的色标,通过它们的相互关系,以确定机器人的位置和方向。It is assumed that there are 4 color scales of different colors on each robot, and the position and direction of the robot can be determined through their interrelationships.

(4)校正处理(4) Correction processing

将识别到的目标位置进行几何畸变校正和高度误差校正。The recognized target position is corrected for geometric distortion and height error.

上述的目标的特征提取和校正参数的整定按如下具体步骤进行:The feature extraction of the above-mentioned target and the setting of the correction parameters are carried out according to the following specific steps:

(1)通过图像处理卡将图像采集到内存中,并显示在屏幕上;(1) Collect the image into the internal memory through the image processing card and display it on the screen;

(2)通过图像处理卡的库函数调整画面的对比度、亮度、色调和色饱和度,以改变图像采集效果,直到图像中机器人的色标和球与场地颜色区分最大;(2) Adjust the contrast, brightness, hue, and color saturation of the image through the library function of the image processing card to change the image acquisition effect until the color scale of the robot and the color of the ball and the field in the image are the largest;

(3)依次采集小球和色标色彩信息:首先,点击被采集目标的中心,程序就将该像素点及其周围7*7的像素点颜色分开显示出来;使用者将符合实际颜色的点全选中后,程序就能得到该目标HSV的阈值信息;如果用户不满意该值,可直接改变HSV阈值范围;(3) Collect the color information of the ball and the color code in sequence: first, click on the center of the collected object, and the program will display the color of the pixel and the surrounding 7*7 pixels separately; the user will match the actual color of the point After all are selected, the program can get the threshold information of the target HSV; if the user is not satisfied with the value, the HSV threshold range can be changed directly;

(4)用鼠标在计算机屏幕上选取所显示的场地边线上的八个点,程序以将此八点围成的图形校正成矩形为标准,采用以下各种校正方法整定出校正系数:(4) Use the mouse to select eight points on the sideline of the field displayed on the computer screen. The program uses the figure surrounded by these eight points to correct a rectangle as a standard, and uses the following correction methods to set the correction coefficient:

(a)桶形失真校正:(a) Barrel distortion correction:

X’=K11×(1+K12(X2+Y2))XX'=K 11 ×(1+K 12 (X 2 +Y 2 ))X

Y’=K21×(1+K22(X2+Y2))YY'=K 21 ×(1+K 22 (X 2 +Y 2 ))Y

式中K11、K21为图像比例系数,K12K22为失真校正系数;In the formula, K 11 and K 21 are image scale coefficients, K 12 K 22 are distortion correction coefficients;

(b)摄像机倾斜校正:(b) Camera tilt correction:

X’=K1×X/320×Y+XX'=K 1 ×X/320×Y+X

Y’=K2×Y/240×X+YY'=K 2 ×Y/240×X+Y

式中K1、K2为X和Y方向倾斜校正系数;In the formula, K 1 and K 2 are the tilt correction coefficients in the X and Y directions;

(c)摄像机旋转角度校正:(c) Camera rotation angle correction:

X’=(X2+Y2)1/2×cos(arctan(X/Y)+λ)X'=(X 2 +Y 2 ) 1/2 ×cos(arctan(X/Y)+λ)

Y’=(X2+Y2)1/2×sin(arctan(X/Y)+λ)Y'=(X 2 +Y 2 ) 1/2 ×sin(arctan(X/Y)+λ)

式中λ为旋转角度。Where λ is the rotation angle.

以上X、Y为摄像机摄下的图像上的坐标,X’、Y’为几何校正后的坐标;不断改变校正系数,直到校正成功,以此确定所有的校正系数;其中桶形失真校正成功标准为校正后场地四边均为直线,摄像机倾斜参数判断整定成功标准为校正后场地为矩形,摄像机旋转角度参数整定判断成功标准为校正后场地四边与图像边框平行。The above X, Y are the coordinates on the image captured by the camera, and X', Y' are the coordinates after geometric correction; constantly change the correction coefficient until the correction is successful, so as to determine all the correction coefficients; among them, the barrel distortion correction success standard The four sides of the corrected field are all straight lines, the success criterion of the camera tilt parameter setting is that the corrected field is a rectangle, and the successful judgment standard of the camera rotation angle parameter setting is that the corrected four sides of the field are parallel to the image frame.

上述的目标识别按下述具体步骤进行:The above-mentioned target identification is carried out according to the following specific steps:

(1)首先依次以球和机器人球队色标为目标,以该目标上一帧被识别的位置为起点,以矩形螺旋方式向外搜寻与目的具有相同颜色的像素点;矩形螺旋搜索算法即环绕搜索中心点一层一层地作矩形的螺旋状搜索,使用循环方式搜索四条边上的点来完成一次搜索;(1) First, take the ball and the robot team color mark as the target in sequence, and start from the recognized position of the target in the last frame, and search outward in a rectangular spiral manner for pixels with the same color as the target; the rectangular spiral search algorithm is Perform a rectangular spiral search layer by layer around the search center point, and use a circular method to search for points on the four sides to complete a search;

(2)搜索到机器人的队标后,再以队标为中心的一定范围内搜索表示机器人号码和方向的队员色标,根据识别出的队员色标的组合方式判断具体队员号和方向;(2) After searching for the team logo of the robot, search for the team member color code indicating the robot number and direction within a certain range centered on the team logo, and judge the specific team member number and direction according to the combination of the identified team member color code;

(3)若发现识别出的目标位置和方向与正常逻辑不符,就认为该目标被误识别,需要进行误识别处理;(3) If it is found that the identified target position and direction do not match the normal logic, it is considered that the target has been misidentified, and misidentification processing is required;

误识别分如下三种情况:Misidentification is divided into the following three situations:

(a)当发现有超过实际色标大小并符合阈值的像素点群,则判定为误识别;(a) When a pixel point group exceeding the actual color scale size and meeting the threshold is found, it is judged as misidentification;

(b)如果搜到的色标排列方式同实际的色标排列方式不一致,即没有一个队员色标排列与之一致,则可认为搜索到的队员号码不正确,确定为误识别;(b) If the arrangement of the color code found is not consistent with the actual color code arrangement, that is, no player has the same color code arrangement, it can be considered that the number of the searched player is incorrect and it is determined to be a misidentification;

(c)搜索到的机器人号码并非当前搜索号码,则认为是误识别。(c) If the searched robot number is not the current search number, it will be considered as misidentification.

(4)一旦在一定范围内未能找到球或队标,那么将在下一帧中对该目标采用全局搜索算法,该算法将全场划块并分优先级搜索,以丢失前一帧的识别位置为最高优先级由近至远搜索。(4) Once the ball or team logo cannot be found within a certain range, a global search algorithm will be used for the target in the next frame, which will block the entire field and search in priority to lose the recognition of the previous frame Location is the highest priority and is searched from near to far.

本发明与已有技术相比较,具有如下显而易见的突出实质性特点和显著优点:本发明的视觉识别方法是以软件的方式实现的,程序通过VC++MFC实现,达到确定球门和边线位置,实时提供场上队员的位置、方向、速度和加速度以及球的位置等数据给足球机器人的决策系统,具有搜索速度快、识别精度高和对环境适应性强等特点。Compared with the prior art, the present invention has the following obvious outstanding substantive features and significant advantages: the visual recognition method of the present invention is realized in the form of software, and the program is realized by VC++MFC to reach and determine the position of the goal and the sideline, Real-time data such as the position, direction, speed and acceleration of the players on the field and the position of the ball are provided to the decision-making system of the soccer robot. It has the characteristics of fast search speed, high recognition accuracy and strong adaptability to the environment.

附图说明Description of drawings

图1是视觉识别的工作流程框图。Figure 1 is a workflow block diagram of visual recognition.

图2是机器人色标和球的照像图。Figure 2 is a photogram of the color scale and the ball of the robot.

图3是目标颜色阈值采样画面图。Figure 3 is a target color threshold sampling screen diagram.

图4是校正参数整定流程框图。Figure 4 is a block diagram of the calibration parameter tuning process.

图5是目标识别总流程框图。Figure 5 is a block diagram of the overall flow of target recognition.

图6是以上一帧获得的中心点为种子点矩形螺旋形搜索路径示意图。FIG. 6 is a schematic diagram of a rectangular spiral search path with the center point obtained in the previous frame as the seed point.

图7是误识别处理流程框图。Fig. 7 is a block diagram of the flow of misrecognition processing.

图8是几何校正过程框图。Fig. 8 is a block diagram of the geometric correction process.

图9是校正前后对比的示图。FIG. 9 is a graph showing a comparison before and after correction.

具体实施方式Detailed ways

本发明的一个优选实例结合附图详述如下:A preferred example of the present invention is described in detail as follows in conjunction with accompanying drawing:

本足球机器人视觉快速识别方法是以软件的方式实现的,它必须是基于一系列的硬件基础。其基本的硬件设备是摄像机和视频采集卡,摄像机安装在场地上方,拍摄范围必须完全覆盖球场。视频采集卡安装在工作站上(可以是PC机),它的输入连接到摄像机的输出,视频采集卡输出的是数字化的图像数据。本发明就是对这些数据进行处理和识别。The football robot vision fast recognition method is implemented in the form of software, and it must be based on a series of hardware foundations. Its basic hardware equipment is a camera and a video capture card. The camera is installed above the field, and the shooting range must completely cover the field. The video capture card is installed on the workstation (it can be a PC), its input is connected to the output of the camera, and the output of the video capture card is digital image data. The present invention is to process and identify these data.

程序通过VC++MFC实现,达到确定球门和边线位置,实时提供场上队员的位置、方向、速度和加速度以及球的位置等数据的目的。The program is realized by VC++MFC to determine the position of the goal and the sideline, and provide real-time data on the position, direction, speed and acceleration of the players on the field and the position of the ball.

本视觉识别方法的工作流程如附图1所示。The workflow of the visual recognition method is shown in Figure 1.

1.目标的特征提取和校正参数的整定1. Feature extraction of target and tuning of correction parameters

要跟踪目标就先要得到使目标从背景中提取出来所需的区别目标与非目标的特征。本发明提取的特征是颜色特征。每个机器人的顶盖上均贴有代表球队和个人的色标,这些颜色都与球的颜色相区别。(如附图2所示)To track the target, it is necessary to obtain the features needed to distinguish the target from the non-target to extract the target from the background. The features extracted by the present invention are color features. The top cover of each robot is labeled with team and individual color codes, which are differentiated from the color of the ball. (as shown in Figure 2)

进行目标颜色特征提取所采用的色彩模型为色调·饱和度·亮度(HSV)模型。色彩模型的选取对于正确识别颜色有非常大的影响,HSV是相对较好的色彩模型。HSV模型由色调h,饱和度s和亮度v组成,接近人眼对色彩的感知。其中的色调属性能比较准确地反映颜色种类,对外界光照条件的变化敏感程度低。对同一颜色属性物体,h具有比较稳定和较窄的数值变化范围,作为主要判断条件。饱和度s作为辅助判断条件。RGB到HSV的转换公式如下:The color model used in the target color feature extraction is the hue·saturation·value (HSV) model. The selection of the color model has a great influence on the correct identification of colors, and HSV is a relatively good color model. The HSV model consists of hue h, saturation s, and brightness v, which is close to the human eye's perception of color. Among them, the hue attribute can reflect the color type more accurately, and is less sensitive to changes in external lighting conditions. For objects with the same color attribute, h has a relatively stable and narrow range of numerical variation, which is used as the main judgment condition. Saturation s is used as an auxiliary judgment condition. The conversion formula from RGB to HSV is as follows:

v=max(r,g,b);v = max(r, g, b);

s=1-min(r,g,b)/v;s=1-min(r,g,b)/v;

θθ == coscos -- 11 (( (( rr -- gg )) ++ (( rr -- bb )) 22 (( rr -- gg )) 22 ++ (( rr -- bb )) (( gg -- bb )) ))

hh == θθ ,, bb ≤≤ gg 360360 -- θθ ,, bb ≥&Greater Equal; gg

此外,因为成像系统本身具有的非线性和摄像的视角不同造成了图像和实际的偏差,这些就需要校正。校正就是对原图像进行象素坐标的空间几何变换,使象素落在正确的位置。经过反复实践,本发明将这一映射以非线性方程的形式实现。而校正方程系数必须与实际场地和摄像机摆放位置有关,所以,校正参数须现场整定。In addition, due to the non-linearity of the imaging system itself and the different viewing angles of the camera, the image and the actual deviation are caused, and these need to be corrected. Correction is to perform spatial geometric transformation of pixel coordinates on the original image, so that the pixels fall in the correct position. After repeated practice, the present invention realizes this mapping in the form of nonlinear equation. The coefficients of the correction equation must be related to the actual site and the location of the camera, so the correction parameters must be set on site.

以上两部分都是在赛前完成,需要人机互动。就是告诉机器人,什么颜色是球,什么颜色是机器人的色标,以及摄下的图像和实际情况如何对应。这一过程相当于对机器人的训练。The above two parts are completed before the game and require human-computer interaction. It is to tell the robot what color is the ball, what color is the color code of the robot, and how the captured image corresponds to the actual situation. This process is equivalent to training the robot.

目标的特征提取和校正参数整定的具体步骤如下:The specific steps of target feature extraction and correction parameter tuning are as follows:

(a)通过图像处理卡将图像采集到内存中,并显示在屏幕上。(a) The image is collected into the internal memory through the image processing card and displayed on the screen.

(b)通过图像处理卡的库函数调整画面的对比度,亮度,色调和色饱和度,以改变图像采集的效果,直到图像中机器人上的色标和球与场地区分最大。(b) Adjust the contrast, brightness, hue and color saturation of the picture through the library function of the image processing card to change the effect of image acquisition until the color scale and the ball on the robot in the image are most distinguished from the field.

(c)依次采集小球和色标色彩信息。首先,点击被采集目标的中心,程序就将该象素点及其周围7*7的象素点颜色分开显示出来(见附图3)。使用者将符合实际颜色的点全选中后,程序就能得到该目标HSV的阈值信息。如果用户不满意该值可直接改变HSV阈值范围。(c) Collect the color information of the ball and the color scale sequentially. First, click on the center of the collected object, and the program will display the color of the pixel and the surrounding 7*7 pixels separately (see Figure 3). After the user selects all the points that match the actual color, the program can get the threshold information of the target HSV. If the user is not satisfied with the value, the HSV threshold range can be changed directly.

(d)用鼠标在计算机屏幕上选取所显示的场地边线上的八个点。程序以将此八点围成的图形校正成矩形为标准,采用以下各种校正方法整定出校正系数:桶形失真校正(由广角镜引起):(d) Use the mouse to select eight points on the displayed edge of the field on the computer screen. The program corrects the figure surrounded by the eight points into a rectangle as a standard, and uses the following correction methods to set the correction coefficient: Barrel distortion correction (caused by the wide-angle lens):

x’=k11×(1+k12(x2+y2))xx'=k 11 ×(1+k 12 (x 2 +y 2 ))x

                          (k11,k21为图像比例系数。K12,k22为失真校正系数)(k11, k21 are image scale coefficients. K12, k22 are distortion correction coefficients)

y’=k21×(1+k22(x2+y2))xy'=k 21 ×(1+k 22 (x 2 +y 2 ))x

摄像机倾斜校正:Camera Tilt Correction:

x’=k1×x/320×y+xx'=k 1 ×x/320×y+x

                          (k1,k2为x和y方向倾斜校正系数)(k1, k2 are the tilt correction coefficients in the x and y directions)

y’=k2×y/240×x+yy'=k 2 ×y/240×x+y

摄像机旋转角度校正:Camera rotation angle correction:

xx ,, == xx 22 ++ ythe y 22 ×× coscos (( arctanarctan (( xx // ythe y )) ++ αα ))

(α为旋转角度)(α is the rotation angle)

ythe y ,, == xx 22 ++ ythe y 22 ×× sinsin (( arctanarctan (( xx // ythe y )) ++ αα ))

以上x,y为摄像机摄下的图像上的坐标,x’,y’为实际情况的坐标。所有校正系数都必须确定,不断改变校正系数,直到校正成功为止。其中桶形失真校正成功标准为校正后场地四边均为直线。摄像机倾斜参数判断整定成功标准为校正后场地为矩形。摄像机旋转角度参数整定判断成功标准为校正后场地四边与图像边框平行。(整定流程图见附图4)The above x, y are the coordinates on the image taken by the camera, and x', y' are the coordinates of the actual situation. All correction coefficients must be determined, and the correction coefficients are constantly changed until the correction is successful. Among them, the success criterion of barrel distortion correction is that the four sides of the field after correction are straight lines. The criterion for judging the success of the camera tilt parameter setting is that the corrected site is a rectangle. The criterion for judging the success of camera rotation angle parameter setting is that the four sides of the field after correction are parallel to the image frame. (See Figure 4 for the tuning flow chart)

2.图像预处理2. Image preprocessing

由视频采集卡数字化后的图像,于实际情况相比总是存在许多噪音。这些是摄像机和本身精度以及外界干扰决定的。因此,本发明在进行目标识别前要对数字化图像均值滤波。滤波窗口为3×3,即每个象素点的HSV值由其周围3×3范围的象素点的均值共同决定,这样就将突变干扰点去除了。Compared with the actual situation, the image digitized by the video capture card always has a lot of noise. These are determined by the camera and its own precision and external interference. Therefore, the present invention needs to filter the mean value of the digitized image before performing target recognition. The filtering window is 3×3, that is, the HSV value of each pixel is jointly determined by the mean value of the surrounding 3×3 pixels, so that the mutation interference points are removed.

3.目标识别3. Target recognition

本发明识别的目标是规则的几何图形,球和队标均是圆形的。每台小车上都有3个颜色不同的色标,通过它们的相互关系以确定小车的位置和方向。目标识别总流程见附图5。The object identified by the invention is a regular geometric figure, and both the ball and the team logo are circular. There are 3 color codes with different colors on each trolley, and the position and direction of the trolley can be determined through their interrelationship. The overall process of target recognition is shown in Figure 5.

目标识别的具体步骤如下:The specific steps of target recognition are as follows:

(a)首先依次以球和机器人球队色标为目标。以该目标上一帧被识别的位置为起点,以矩形螺旋方式向往搜寻与目标具有相同颜色的象素点。(a) First target the ball and the robot team color code in turn. Starting from the recognized position of the target in the previous frame, search for pixels with the same color as the target in a rectangular spiral manner.

矩形螺旋搜索算法即环绕搜索中心点一层一层地作矩形的螺旋状搜索,使用循环方式搜索四条边上的点来完成一次搜索。此算法从中心向外搜索,并且能够符合像素点的矩形排列方式。如图所示P为上一帧获得的中心点为种子点,搜索顺序如附图6中箭头所示。The rectangular spiral search algorithm is to conduct a rectangular spiral search layer by layer around the search center point, and use a circular method to search for points on the four sides to complete a search. This algorithm searches from the center outward, and can conform to the rectangular arrangement of pixels. As shown in the figure, P is the center point obtained in the previous frame as the seed point, and the search sequence is shown by the arrow in Fig. 6 .

(b)搜索到机器人的队标后,再以队标为中心的一定范围内搜索表示机器人号码和方向的队员标。根据识别出的队员标的组合方式判断具体队员号和方向。(b) After searching for the robot's team logo, search for the team logo indicating the robot's number and direction within a certain range centered on the team logo. Determine the specific team number and direction according to the combination of the identified team members.

(c)若发现识别出的目标位置和方向与正常逻辑不符,就认为该目标被误识别,需要进行误识别处理。(c) If it is found that the identified target position and direction do not match the normal logic, it is considered that the target has been misidentified, and misidentification processing is required.

误识别分为三种情况。Misidentification is divided into three cases.

其一,当发现有超过实际色标大小并符合阈值的象素点群,则判定为误识别。First, when a group of pixel points exceeding the size of the actual color scale and meeting the threshold is found, it is judged as misrecognition.

其二,由于我方队员识别色标的排列有唯一性,所以如果搜到的色标排列方式同实际的色标排列方式不一致,即没有一个队员色标排列与之一致,则可以认为搜索到的队员号码不正确,确定为误识别。Second, due to the uniqueness of the arrangement of the identification color codes of our team members, if the arrangement of the searched color codes is inconsistent with the actual color code arrangement, that is, no team member has the same color code arrangement, it can be considered that the searched The player number is incorrect, and it is determined to be a misidentification.

其三,搜到的机器人号码并非当前搜索号码,则认为是误识别。Third, if the searched robot number is not the current search number, it is considered to be misidentified.

对第一种情况只要不将该象素点群判定为目标即可。For the first case, as long as the pixel point group is not determined as the target.

对后二种情况进行误识别处理。流程图见附图7。Misidentification processing is performed on the latter two cases. See Figure 7 for the flow chart.

搜索中记录识别出的物体位置信息以及当前搜索的队员号码,并且记录这些搜索框并跳过,之后继续进行矩形螺旋搜索,如果搜索到新的队员号码和位置信息,则记录位置信息,直到本轮搜索结束。如果搜索结束之后还没搜索到所要搜索的队员,则进行其他队员的搜索。如果之前认为搜索到的队员在其自己的搜索轮中被搜到了,则可以确定之前误搜索的队员不在记录的疑似位置,则可对之前的误搜索信息进行排除;反之,之前队员确实在疑似的位置处,则对搜到的队员进行位置信息的赋值操作,并且清空之前的疑似信息。所有队员全部搜索完毕之后,查看有没有疑似误搜索的位置信息,如有,查找这一帧没有被赋予位置信息的队员,对其进行位置赋值操作。如果有多个队员有疑似误搜索的现象,则可以参照上一帧的位置信息以及方向和运动指令信息,判断每名队员这一帧的位置,并进行赋值操作。During the search, record the position information of the recognized object and the number of the player currently searching, and record these search boxes and skip them, and then continue the rectangular spiral search. If a new player number and position information are found, record the position information until this time. The search round ends. If the player to be searched has not been found after the search is over, search for other players. If it is believed that the searched player was found in his own search round, it can be determined that the previously mistakenly searched player is not in the recorded suspected position, and the previous wrongly searched information can be excluded; otherwise, the previous player is indeed in the suspected location. At the position of the searched players, the position information assignment operation is performed on the found players, and the previous suspected information is cleared. After all the team members have searched, check to see if there is any position information that is suspected of being searched by mistake. If so, find the team members who have not been assigned position information in this frame, and perform position assignment operations on them. If there are multiple team members suspected of searching by mistake, you can refer to the position information, direction and movement command information of the previous frame to judge the position of each team member in this frame and perform the assignment operation.

因为一旦发生误识别,就无法通过队员识别色标来精确计算队员的实际位置和方向角,只能把搜索到的队标中心作为此队员的位置,而此队员的方向则需要通过对上一帧的方向,与上一帧所发出的行动指令,并且参照队员识别色标的排列方式,来计算一个大概角度作为这一帧时这名队员的方向。虽然这样的定位不够精确,但至少给出了位置信息,并且为下一帧的搜索提供了搜索的起始位置信息,方便下一帧的搜索。Because once misrecognition occurs, it is impossible to accurately calculate the actual position and direction angle of the player through the identification color mark of the player. The center of the team mark that can only be searched can be used as the position of the player, and the direction of the player needs to be determined by aligning with the previous team mark. The direction of the frame, and the action command issued in the previous frame, and referring to the arrangement of the player's identification color code, calculate an approximate angle as the player's direction in this frame. Although such positioning is not precise enough, at least the position information is given, and the search start position information is provided for the search of the next frame, which is convenient for the search of the next frame.

(d)一旦在一定范围内未能找到球或队标,那么将在下一帧中对该目标采用全局搜索算法,该算法将全场划块并分优先级搜索,以丢失前一帧的识别位置为最高优先级最高向外搜索。(d) Once the ball or the team logo cannot be found within a certain range, a global search algorithm will be used for the target in the next frame. This algorithm will block the entire field and search with priority to lose the identification of the previous frame The location is the highest-priority highest-outward search.

4.校正处理4. Correction processing

校正流程图见图8。将识别到的目标位置进行几何校正,校正方程前所述。The calibration flow chart is shown in Figure 8. The recognized target position is geometrically corrected, and the correction equation is described above.

此外,由于机器人存在的高度不可忽略,使得识别出的机器人位置为其投影位置,与实际位置有偏差。因此必须对其进行高度校正,方程如下:In addition, since the height of the robot cannot be ignored, the identified robot position is its projected position, which deviates from the actual position. Therefore it must be corrected for height, the equation is as follows:

rr == xx 22 ++ ythe y 22

r’=r-r/3×hr'=r-r/3×h

                           (h为机器人的高度)(h is the height of the robot)

x’=r’×cos(arctan(y/x))x'=r'×cos(arctan(y/x))

y’=r’×sin(arctan(y/x))y'=r'×sin(arctan(y/x))

进行了以上校正后,图像的场地几何形状达到标准矩形,机器人高度影响消除,使定位更加准确。校正前后效果见附图9。After the above corrections, the site geometry of the image reaches a standard rectangle, and the influence of the height of the robot is eliminated, making the positioning more accurate. The effect before and after correction is shown in Figure 9.

Claims (3)

1.一种足球机器人视觉快速识别方法,包括将摄像机安装在场地上方使其拍摄范围完全覆盖球场;将视频采集卡安装在工作站上,其输入连接摄像机的输出,视频采集卡输出数字化的图像数据,由计算机对数字化图像处理,达到确定球门和边线位置,实时提供场上队员的位置、方向、速度和加速度,以及球的位置数据;其特征在于程序通过VC++MFC实现,其步骤如下:1. A kind of football robot vision fast recognition method, comprises that video camera is installed on the top of the field so that its shooting range covers the field completely; Video capture card is installed on the workstation, its input connects the output of camera, and video capture card outputs digital image data , the digital image is processed by the computer to determine the position of the goal and the sideline, and the position, direction, speed and acceleration of the players on the field are provided in real time, as well as the position data of the ball; it is characterized in that the program is realized by VC++MFC, and its steps are as follows: (1)目标的特征提取和校正参数的整定:(1) The feature extraction of the target and the setting of the correction parameters: 提取的特征是颜色特征,每个机器人的顶盖上均贴有代表球队和个人的色标,这些颜色都与球的颜色相区别;The extracted features are color features, and the top cover of each robot is affixed with color codes representing teams and individuals, which are distinguished from the colors of the ball; 采用由色调·饱和度·亮度组成的HSV模型为进行目标颜色特征提取的色彩模型;The HSV model composed of hue, saturation and brightness is used as the color model for target color feature extraction; 校正是对原图像进行像素坐标的空间几何变换,使像素落在正确的位置,以非线性方程的形式实现,在现场根据实际场地和摄像机摆放位置,现场整定校正参数。Correction is the spatial geometric transformation of the pixel coordinates of the original image, so that the pixels fall in the correct position, and it is realized in the form of a nonlinear equation. The correction parameters are set on the spot according to the actual site and the position of the camera. (2)图像预处理(2) Image preprocessing 对数字化图像均值滤波,去除突变干扰点。Mean filtering of the digitized image to remove mutation interference points. (3)目标识别(3) Target recognition 设每个机器人顶盖上都有4个颜色不同的色标,通过它们的相互关系,以确定机器人的位置和方向。It is assumed that there are 4 color marks of different colors on the top cover of each robot, and the position and direction of the robot can be determined through their interrelationships. (4)校正处理(4) Correction processing 将识别到的目标位置进行几何畸变校正和高度误差校正。The recognized target position is corrected for geometric distortion and height error. 2.根据权利要求1所述的足球机器人视觉快速识别方法,其特征在于所述的目标的特征提取和校正参数的整定按如下具体步骤进行:2. the football robot vision quick recognition method according to claim 1, it is characterized in that the feature extraction of described target and the setting of correction parameter are carried out by following specific steps: (1)通过图像处理卡将图像采集到内存中,并显示在屏幕上;(1) Collect the image into the internal memory through the image processing card and display it on the screen; (2)通过图像处理卡的库函数调整画面的对比度、亮度、色调和色饱和度,以改变图像采集效果,直到图像中机器人的色标和球及场地颜色区分最大;(2) Adjust the contrast, brightness, hue and color saturation of the picture through the library function of the image processing card to change the image acquisition effect until the color scale of the robot in the image is distinguished from the color of the ball and the field; (3)依次采集小球和色标色彩信息:首先,点击被采集目标的中心,程序就将该像素点及其周围7*7的像素点颜色分开显示出来;使用者将符合实际颜色的点全选中后,程序就能得到该目标HSV的阈值信息;如果用户不满意该值,可直接改变HSV阈值范围;(3) Collect the color information of the ball and the color code in sequence: first, click on the center of the collected object, and the program will display the color of the pixel and the surrounding 7*7 pixels separately; the user will match the actual color of the point After all are selected, the program can get the threshold information of the target HSV; if the user is not satisfied with the value, the HSV threshold range can be changed directly; (4)用鼠标在计算机屏幕上选取所显示的场地边线上的八个点,程序以将此八点围成的图形校正成矩形为标准,采用以下各种校正方法整定出校正系数:(4) Use the mouse to select eight points on the sideline of the field displayed on the computer screen. The program uses the figure surrounded by these eight points to correct a rectangle as a standard, and uses the following correction methods to set the correction coefficient: (a)桶形失真校正:(a) Barrel distortion correction: X’=K11×(1+K12(X2+Y2))XX'=K 11 ×(1+K 12 (X 2 +Y 2 ))X Y’=K21×(1+K22(X2+Y2))YY'=K 21 ×(1+K 22 (X 2 +Y 2 ))Y 式中K11、K21为图像比例系数,K12K22为失真校正系数;In the formula, K 11 and K 21 are image scale coefficients, K 12 K 22 are distortion correction coefficients; (b)摄像机倾斜校正:(b) Camera tilt correction: X’=K1×X/320×Y+XX'=K 1 ×X/320×Y+X Y’=K2×Y/240×X+YY'=K 2 ×Y/240×X+Y 式中K1、K2为X和Y方向倾斜校正系数;In the formula, K 1 and K 2 are the tilt correction coefficients in the X and Y directions; (c)摄像机旋转角度校正:(c) Camera rotation angle correction: X’=(X2+Y2)1/2×cos(arctan(X/Y)+λ)X'=(X 2 +Y 2 ) 1/2 ×cos(arctan(X/Y)+λ) Y’=(X2+Y2)1/2×sin(arctan(X/Y)+λ)Y'=(X 2 +Y 2 ) 1/2 ×sin(arctan(X/Y)+λ) 式中λ为旋转角度。Where λ is the rotation angle. 以上X、Y为摄像机摄下的图像上的坐标,X’、Y’为几何校正后的坐标;The above X, Y are the coordinates on the image taken by the camera, and X', Y' are the coordinates after geometric correction; 不断改变校正系数,直到校正成功,以此确定所有的校正系数;其中桶形失真校正成功标准为校正后场地四边均为直线,摄像机倾斜参数判断整定成功标准为校正后场地为矩形,摄像机旋转角度参数整定判断成功标准为校正后场地四边与图像边框平行。Constantly change the correction coefficient until the correction is successful, so as to determine all the correction coefficients; the standard for the success of barrel distortion correction is that the four sides of the field after correction are straight lines, and the judgment of camera tilt parameters. The criterion for judging the success of parameter setting is that the four sides of the field after correction are parallel to the image frame. 3.根据权利要求1所述的足球机器人视觉快速识别方法,其特征在于所述的目标识别按下述具体步骤进行:3. the football robot vision fast recognition method according to claim 1, is characterized in that described target recognition is carried out by following specific steps: (1)首先依次以球和机器人球队色标为目标,以该目标上一帧被识别的位置为起点,以矩形螺旋方式向外搜寻与目标具有相同颜色的像素点;矩形螺旋搜索算法即环绕搜索中心点一层一层地作矩形的螺旋状搜索,使用循环方式搜索四条边上的点来完成一次搜索;(1) First, take the ball and the robot team color mark as the target in sequence, and start from the recognized position of the target in the previous frame, and search for pixels with the same color as the target in a rectangular spiral manner; the rectangular spiral search algorithm is Perform a rectangular spiral search layer by layer around the search center point, and use a circular method to search for points on the four sides to complete a search; (2)搜索到机器人的队标后,再以队标为中心的一定范围内搜索表示机器人号码和方向的队员色标,根据识别出的队员色标的组合方式判断具体队员号和方向;(2) After searching for the team logo of the robot, search for the team member color code indicating the robot number and direction within a certain range centered on the team logo, and judge the specific team member number and direction according to the combination of the identified team member color code; (3)若发现识别出的目标位置和方向与正常逻辑不符,就认为该目标被误识别,需要进行误识别处理;(3) If it is found that the identified target position and direction do not match the normal logic, it is considered that the target has been misidentified, and misidentification processing is required; 误识别分如下三种情况:Misidentification is divided into the following three situations: (a)当发现有超过实际色标大小并符合阈值的像素点群,则判定为误识别;(a) When a pixel point group exceeding the actual color scale size and meeting the threshold is found, it is judged as misidentification; (b)如果搜到的色标排列方式同实际的色标排列方式不一致,即没有一个队员色标排列与之一致,则可认为搜索到的队员号码不正确,确定为误识别;(b) If the arrangement of the color code found is not consistent with the actual color code arrangement, that is, no player has the same color code arrangement, it can be considered that the number of the searched player is incorrect and it is determined to be a misidentification; (c)搜索到的机器人号码并非当前搜索号码,则认为是误识别。(c) If the searched robot number is not the current search number, it will be considered as misidentification. (4)一旦在一定范围内未能找到球或队标,那么将在下一帧中对该目标采用全局搜索算法,该算法将全场划块并分优先级搜索,以丢失前一帧的识别位置为最高优先级由近至远搜索。(4) Once the ball or team logo cannot be found within a certain range, a global search algorithm will be used for the target in the next frame, which will block the entire field and search in priority to lose the recognition of the previous frame Location is the highest priority and is searched from near to far.
CNB2005100272806A 2005-06-29 2005-06-29 Visual quick identifying method for football robot Expired - Fee Related CN100345154C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005100272806A CN100345154C (en) 2005-06-29 2005-06-29 Visual quick identifying method for football robot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005100272806A CN100345154C (en) 2005-06-29 2005-06-29 Visual quick identifying method for football robot

Publications (2)

Publication Number Publication Date
CN1716281A true CN1716281A (en) 2006-01-04
CN100345154C CN100345154C (en) 2007-10-24

Family

ID=35822099

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005100272806A Expired - Fee Related CN100345154C (en) 2005-06-29 2005-06-29 Visual quick identifying method for football robot

Country Status (1)

Country Link
CN (1) CN100345154C (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101814145A (en) * 2009-02-24 2010-08-25 索尼株式会社 Target distinguishing method and target distinguishing device
CN101359225B (en) * 2008-08-29 2010-10-06 北京大学 A collaborative control system for multiple underwater robots
CN101667037B (en) * 2008-09-03 2011-08-31 中国科学院自动化研究所 Feasible channel-based robot target tracking method
CN102542294A (en) * 2011-12-29 2012-07-04 河海大学常州校区 Centralized control type soccer robot identification system and identification method for double visual information fusion
CN102843513A (en) * 2011-06-21 2012-12-26 三星电子株式会社 Camera apparatus and method of recognizing an object by using a camera
CN103056864A (en) * 2013-01-24 2013-04-24 上海理工大学 Device and method for detecting position and angle of wheeled motion robot in real time
CN103142187A (en) * 2013-03-18 2013-06-12 慈溪迈思特电子科技有限公司 Work place recognition system of automatic dust collector
CN104898679A (en) * 2015-04-03 2015-09-09 周凡 Soccer robot dual meet system based on global vision and remote collaborative control
CN112215892A (en) * 2020-10-22 2021-01-12 常州大学 A method for monitoring the position of a field robot and its motion path
CN113222805A (en) * 2021-05-08 2021-08-06 西北工业大学 Rapid high-accuracy NAO type football robot vision processing method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101537618B (en) * 2008-12-19 2010-11-17 北京理工大学 Stadium Ball Picking Robot Vision System

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101359225B (en) * 2008-08-29 2010-10-06 北京大学 A collaborative control system for multiple underwater robots
CN101667037B (en) * 2008-09-03 2011-08-31 中国科学院自动化研究所 Feasible channel-based robot target tracking method
CN101814145B (en) * 2009-02-24 2014-01-29 索尼株式会社 Target distinguishing method and target distinguishing device
CN101814145A (en) * 2009-02-24 2010-08-25 索尼株式会社 Target distinguishing method and target distinguishing device
CN102843513A (en) * 2011-06-21 2012-12-26 三星电子株式会社 Camera apparatus and method of recognizing an object by using a camera
CN102843513B (en) * 2011-06-21 2017-09-22 三星电子株式会社 The camera apparatus and method of target are recognized by using camera
CN102542294A (en) * 2011-12-29 2012-07-04 河海大学常州校区 Centralized control type soccer robot identification system and identification method for double visual information fusion
CN103056864A (en) * 2013-01-24 2013-04-24 上海理工大学 Device and method for detecting position and angle of wheeled motion robot in real time
CN103142187A (en) * 2013-03-18 2013-06-12 慈溪迈思特电子科技有限公司 Work place recognition system of automatic dust collector
CN104898679A (en) * 2015-04-03 2015-09-09 周凡 Soccer robot dual meet system based on global vision and remote collaborative control
CN112215892A (en) * 2020-10-22 2021-01-12 常州大学 A method for monitoring the position of a field robot and its motion path
CN112215892B (en) * 2020-10-22 2024-03-12 常州大学 A method for monitoring the position and movement path of a field robot
CN113222805A (en) * 2021-05-08 2021-08-06 西北工业大学 Rapid high-accuracy NAO type football robot vision processing method
CN113222805B (en) * 2021-05-08 2023-04-07 西北工业大学 Rapid high-accuracy NAO type football robot vision processing method

Also Published As

Publication number Publication date
CN100345154C (en) 2007-10-24

Similar Documents

Publication Publication Date Title
CN100345154C (en) Visual quick identifying method for football robot
Neves et al. An efficient omnidirectional vision system for soccer robots: From calibration to object detection
US11869131B2 (en) Photographic method and system for aiding officials in locating an object
CN1584729A (en) Image projection method and device
CN1198865A (en) Method and apparatus for electronic automatic replacement of billboards in video images
CN1437161A (en) Personal recognition method, personal recognition apparatus and photographic apparatus
CN107967687B (en) A method and system for acquiring the walking posture of a target object
CN1834582A (en) Image processing method, three-dimensional position measuring method and image processing apparatus
CN110288661B (en) Position adjusting method and device for operating lamp, computer equipment and storage medium
CN105678817B (en) A kind of method that high speed extracts circular image central point
CN108074265A (en) A kind of tennis alignment system, the method and device of view-based access control model identification
EP3257026A1 (en) Generating three dimensional models
CN111652069A (en) Target identification and positioning method of mobile robot
US8929629B1 (en) Method and system for image-based ulcer detection
CN101075351A (en) Method for restoring human-body videothree-dimensional movement based on sided shadow and end node
CN119048953B (en) Visual motion testing system based on artificial intelligence algorithm
Chiang et al. Real time self-localization of omni-vision robot by pattern match system
CN114612899B (en) Wheat seedling row centerline detection method based on improved YOLOv3
Trifan et al. A modular real-time vision system for humanoid robots
CN110415256B (en) Rapid multi-target identification method and system based on vision
CN1136685A (en) Method for Recognizing Targets in Three-Dimensional Space
CN1271560C (en) Attribute normalizing method for human face image collecting apparatus
CN119693851B (en) Basketball detection method, basketball detection system and basketball detection equipment based on artificial intelligence
KR20200111850A (en) Image search and matching method for scan region re-tracking and imaging processing apparatus therefor
CN112614182B (en) Deep learning-based method for identifying machining position, storage device and mobile terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20071024

Termination date: 20100629