[go: up one dir, main page]

CN105224908A - A kind of roadmarking acquisition method based on orthogonal projection and device - Google Patents

A kind of roadmarking acquisition method based on orthogonal projection and device Download PDF

Info

Publication number
CN105224908A
CN105224908A CN201410310718.0A CN201410310718A CN105224908A CN 105224908 A CN105224908 A CN 105224908A CN 201410310718 A CN201410310718 A CN 201410310718A CN 105224908 A CN105224908 A CN 105224908A
Authority
CN
China
Prior art keywords
target image
edge
road
described target
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410310718.0A
Other languages
Chinese (zh)
Inventor
张宇腾
曹晓航
向哲
齐同军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Navinfo Co Ltd
Original Assignee
Navinfo Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Navinfo Co Ltd filed Critical Navinfo Co Ltd
Priority to CN201410310718.0A priority Critical patent/CN105224908A/en
Publication of CN105224908A publication Critical patent/CN105224908A/en
Pending legal-status Critical Current

Links

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

本发明提供一种基于正射投影的道路标线采集方法及装置,涉及图像与视频技术领域。其中,上述方法包括:利用安装在采集车上的摄像装置采集道路图像,获取目标图像;对目标图像进行图像处理,获取道路边沿在目标图像中的位置;根据道路边沿在目标图像中的位置确定道路的位置,并基于道路的位置对目标图像进行特征点提取,得到标定特征点;根据标定特征点获取摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵;根据逆透视变换矩阵对目标图像进行图片转换,得到目标图像的正视图。该方法实现了道路标线的实时采集,同时实现了标定、矫正、正视图生成的自动化,极大的节省了后续处理的时间,节省了大量人力、物力。

The invention provides a method and device for collecting road markings based on orthographic projection, and relates to the technical field of images and videos. Wherein, the above-mentioned method includes: using the camera device installed on the acquisition vehicle to collect road images to obtain the target image; performing image processing on the target image to obtain the position of the road edge in the target image; according to the position of the road edge in the target image to determine The position of the road, and based on the position of the road, extract the feature points of the target image to obtain the calibration feature points; obtain the conversion relationship between the camera device coordinate system and the space coordinate system according to the calibration feature points, and generate an inverse perspective transformation matrix; according to the inverse perspective The transformation matrix transforms the image of the target image to obtain the front view of the target image. This method realizes the real-time collection of road markings, and at the same time realizes the automation of calibration, correction, and front view generation, which greatly saves the time for subsequent processing and saves a lot of manpower and material resources.

Description

一种基于正射投影的道路标线采集方法及装置A method and device for collecting road markings based on orthographic projection

技术领域technical field

本发明涉及图像与视频技术领域,特别涉及一种基于正射投影的道路标线采集方法及装置。The invention relates to the field of image and video technology, in particular to a method and device for collecting road markings based on orthographic projection.

背景技术Background technique

地面标线的采集是地图信息采集者比较关注的地图信息之一。在现有的采集方案中,除人工采集方法之外,普遍采用地图采集车的方法。传统的采集车需要专业安装各种传感器,采集地面标识线需固定专业摄像机于车上,并且对摄像机对角度都有严格的要求,同时需要人工对摄像机坐标系和车辆坐标系之间的转换关系进行标定。在标定之后,如果摄像机被重新安装,固定甚至是移动过,都需要再次重新标定。因此,为了保证采集数据的准确性,很多时候都需要采集之前重新标定。当摄像机与车辆之间坐标系的转化关系明晰后,可以将摄像机以一定角度拍摄到的地面图像,转化为垂直从上而下的视角观测到的图像(正视图)。The collection of ground markings is one of the map information that map information collectors pay more attention to. In the existing collection schemes, in addition to manual collection methods, the method of map collection vehicles is generally used. Traditional collection vehicles need to be professionally installed with various sensors. To collect ground marking lines, a professional camera must be fixed on the vehicle, and there are strict requirements on the angle of the camera. At the same time, manual conversion between the camera coordinate system and the vehicle coordinate system is required. Calibrate. After calibration, if the camera is reinstalled, fixed or even moved, it needs to be recalibrated again. Therefore, in order to ensure the accuracy of the collected data, it is often necessary to recalibrate before collecting. When the transformation relationship between the coordinate system between the camera and the vehicle is clear, the ground image captured by the camera at a certain angle can be converted into an image observed vertically from a top-down perspective (front view).

然而这种传统的采集方法有很多不便,如每一辆采集车都需要专门改装,增加摄像头,工程量较大,大量部署时,时间成本和资金成本都比较大;需要人工标定,该方法繁琐费时,并且在摄像机角度意外变化时无法及时做出修正,测量误差较大。However, this traditional collection method has many inconveniences. For example, each collection vehicle needs to be specially modified, and cameras are added, which requires a large amount of work. When deployed in large quantities, the time cost and capital cost are relatively large; manual calibration is required, and this method is cumbersome. It is time-consuming, and it cannot be corrected in time when the camera angle changes unexpectedly, and the measurement error is large.

发明内容Contents of the invention

本发明的目的在于提供一种基于正射投影的道路标线采集方法及装置,实现了标定、矫正、正视图生成的自动化,极大的节省了后续处理的时间,节省了大量人力、物力。The purpose of the present invention is to provide a method and device for collecting road markings based on orthographic projection, which realizes the automation of calibration, correction, and front view generation, greatly saves the time for subsequent processing, and saves a lot of manpower and material resources.

为了达到上述目的,本发明实施例提供一种基于正射投影的道路标线采集方法,包括:In order to achieve the above purpose, an embodiment of the present invention provides a method for collecting road markings based on orthographic projection, including:

利用安装在采集车上的摄像装置采集道路图像,获取目标图像;Use the camera device installed on the acquisition vehicle to collect road images and obtain target images;

对所述目标图像进行图像处理,获取道路边沿在所述目标图像中的位置;performing image processing on the target image to obtain the position of the road edge in the target image;

根据所述道路边沿在所述目标图像中的位置确定道路的位置,并基于所述道路的位置对所述目标图像进行特征点提取,得到标定特征点;Determining the position of the road according to the position of the road edge in the target image, and extracting feature points from the target image based on the position of the road to obtain marked feature points;

根据所述标定特征点获取摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵;Acquiring the conversion relationship between the coordinate system of the camera device and the space coordinate system according to the calibration feature points, and generating an inverse perspective transformation matrix;

根据所述逆透视变换矩阵对所述目标图像进行图片转换,得到所述目标图像的正视图。performing picture conversion on the target image according to the inverse perspective transformation matrix to obtain a front view of the target image.

其中,得到所述目标图像的正视图后还包括:Wherein, after obtaining the front view of the target image, it also includes:

将所述目标图像的正视图进行实时显示并存储。The front view of the target image is displayed and stored in real time.

其中,对所述目标图像进行图像处理,获取道路边沿在所述目标图像中的位置的步骤包括:Wherein, performing image processing on the target image, and obtaining the position of the road edge in the target image comprises:

将所述目标图像转换为灰度图像;converting the target image into a grayscale image;

将所述灰度图像转化为仅显示物体边沿的边沿图;Converting the grayscale image into an edge map showing only the edge of the object;

在所述边沿图中获取第一直线特征,并根据预设道路模型的道路边沿的直线特征对所述第一直线特征进行筛选,获取第二直线特征;Obtaining the first straight line feature in the edge graph, and filtering the first straight line feature according to the straight line feature of the road edge of the preset road model, and obtaining the second straight line feature;

若当前所述目标图像为采集的第一帧图像,所述第二直线特征为目标直线特征;否则,根据当前所述目标图像之前的多帧图像的第二直线特征,获取预测道路边沿信息,并结合所述预测道路边沿信息和当前所述目标图像的第二直线特征,确定目标直线特征;If the current target image is the first frame image collected, the second straight line feature is the target straight line feature; otherwise, according to the second straight line feature of the multi-frame images before the current target image, the predicted road edge information is obtained, And combining the predicted road edge information and the second straight line feature of the current target image to determine the target straight line feature;

根据所述目标直线特征,获取道路边沿在所述目标图像中的位置。According to the target straight line feature, the position of the road edge in the target image is acquired.

进一步的,将所述灰度图像转化为仅显示物体边沿的边沿图的步骤包括:Further, the step of converting the grayscale image into an edge map showing only the edge of the object includes:

利用canny边缘检测算子将所述灰度图像转化为仅显示物体边沿的边沿图。A canny edge detection operator is used to convert the grayscale image into an edge map that only shows the edge of the object.

进一步的,在所述边沿图中获取第一直线特征的步骤包括:Further, the step of obtaining the first straight line feature in the edge graph includes:

应用随机hough变换方法在所述边沿图中获取第一直线特征。A random hough transform method is applied to obtain the first straight line feature in the edge graph.

其中,根据所述标定特征点获取摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵的步骤包括:Wherein, the conversion relationship between the coordinate system of the camera device and the space coordinate system is obtained according to the calibration feature points, and the step of generating an inverse perspective transformation matrix includes:

获取所述标定特征点的实际位置;Obtain the actual position of the calibration feature point;

根据所述标定特征点在所述目标图像上的位置和所述实际位置,利用逆透视变换方法确定摄像装置坐标系与空间坐标系之间的转换关系;According to the position of the calibration feature point on the target image and the actual position, using an inverse perspective transformation method to determine the conversion relationship between the coordinate system of the camera device and the spatial coordinate system;

根据所述摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵。An inverse perspective transformation matrix is generated according to the conversion relationship between the camera coordinate system and the space coordinate system.

其中,根据所述逆透视变换矩阵对所述目标图像进行图片转换,得到所述目标图像的正视图的步骤包括:Wherein, performing image conversion on the target image according to the inverse perspective transformation matrix to obtain a front view of the target image includes:

对所述目标图像进行裁切,仅保留所述目标图像上的地平线以下部分;Crop the target image, and only keep the part below the horizon on the target image;

根据所述逆透视变换矩阵将经过裁切的所述目标图像进行图片转换,得到一扇形图片;performing picture conversion on the cropped target image according to the inverse perspective transformation matrix to obtain a fan-shaped picture;

以所述目标图像上道路边沿的位置为基础对所述扇形图片进行裁切,得到一矩形图片,所述矩形图片为所述目标图像的正视图。Cutting the fan-shaped picture based on the position of the road edge on the target image to obtain a rectangular picture, the rectangular picture being a front view of the target image.

本发明实施例还提供一种基于正射投影的道路标线采集装置,包括:The embodiment of the present invention also provides a road marking collection device based on orthographic projection, including:

采集模块,用于利用安装在采集车上的摄像装置采集道路图像,获取目标图像;The collection module is used to collect road images using the camera installed on the collection vehicle to obtain target images;

获取模块,用于对所述目标图像进行图像处理,获取道路边沿在所述目标图像中的位置;An acquisition module, configured to perform image processing on the target image, and acquire the position of the road edge in the target image;

提取模块,用于根据所述道路边沿在所述目标图像中的位置确定道路的位置,并基于所述道路的位置对所述目标图像进行特征点提取,得到标定特征点;An extraction module, configured to determine the position of the road according to the position of the road edge in the target image, and perform feature point extraction on the target image based on the position of the road to obtain calibration feature points;

转换模块,用于根据所述标定特征点获取摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵;A conversion module, configured to obtain the conversion relationship between the camera coordinate system and the space coordinate system according to the calibration feature points, and generate an inverse perspective transformation matrix;

生成模块,用于根据所述逆透视变换矩阵对所述目标图像进行图片转换,得到所述目标图像的正视图。A generating module, configured to perform picture conversion on the target image according to the inverse perspective transformation matrix, to obtain a front view of the target image.

进一步的,所述道路标线采集装置还包括:Further, the road marking acquisition device also includes:

显示存储模块,用于将所述目标图像的正视图进行实时显示并存储。The display storage module is used to display and store the front view of the target image in real time.

其中,所述获取模块包括:Wherein, the acquisition module includes:

第一获取子模块,用于将所述目标图像转换为灰度图像;The first acquisition submodule is used to convert the target image into a grayscale image;

第二获取子模块,用于将所述灰度图像转化为仅显示物体边沿的边沿图;The second acquisition sub-module is used to convert the grayscale image into an edge image showing only the edge of the object;

第三获取子模块,用于在所述边沿图中获取第一直线特征,并根据预设道路模型的道路边沿的直线特征对所述第一直线特征进行筛选,获取第二直线特征;The third obtaining sub-module is used to obtain the first straight line feature in the edge map, and filter the first straight line feature according to the straight line feature of the road edge of the preset road model, and obtain the second straight line feature;

第四获取子模块,用于若当前所述目标图像为采集的第一帧图像,所述第二直线特征为目标直线特征;否则,根据当前所述目标图像之前的多帧图像的第二直线特征,获取预测道路边沿信息,并结合所述预测道路边沿信息和当前所述目标图像的第二直线特征,确定目标直线特征;The fourth acquisition sub-module is used for if the current target image is the first frame image collected, the second straight line feature is the target straight line feature; otherwise, according to the second straight line of multiple frames of images before the current target image feature, obtaining predicted road edge information, and combining the predicted road edge information and the second straight line feature of the current target image to determine the target straight line feature;

第五获取子模块,用于根据所述目标直线特征,获取道路边沿在所述目标图像中的位置。The fifth acquisition sub-module is configured to acquire the position of the road edge in the target image according to the target straight line feature.

进一步的,所述第二获取子模块包括:Further, the second acquisition submodule includes:

第一转化模块,用于利用canny边缘检测算子将所述灰度图像转化为仅显示物体边沿的边沿图。The first conversion module is used to convert the grayscale image into an edge image showing only object edges by using a canny edge detection operator.

进一步的,所述第三获取子模块包括:Further, the third acquisition submodule includes:

第二转化模块,用于应用随机hough变换方法在所述边沿图中获取第一直线特征。The second conversion module is used to obtain the first straight line feature in the edge graph by applying the random hough transform method.

其中,所述转换模块包括:Wherein, the conversion module includes:

第一转换子模块,用于获取所述标定特征点的实际位置;The first conversion submodule is used to obtain the actual position of the calibration feature point;

第二转换子模块,用于根据所述标定特征点在所述目标图像上的位置和所述实际位置,利用逆透视变换方法确定摄像装置坐标系与空间坐标系之间的转换关系;The second conversion sub-module is used to determine the conversion relationship between the coordinate system of the camera device and the spatial coordinate system by using an inverse perspective transformation method according to the position of the calibration feature point on the target image and the actual position;

第三转换子模块,用于根据所述汽车坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵。The third transformation sub-module is used to generate an inverse perspective transformation matrix according to the transformation relationship between the vehicle coordinate system and the space coordinate system.

其中,所述生成模块包括:Wherein, the generating module includes:

第一生成子模块,用于对所述目标图像进行裁切,仅保留所述目标图像上的地平线以下部分;The first generating submodule is used to crop the target image, and only keep the part below the horizon on the target image;

第二生成子模块,用于根据所述逆透视变换矩阵将经过裁切的所述目标图像进行图片转换,得到一扇形图片;The second generation sub-module is used to perform image conversion on the cropped target image according to the inverse perspective transformation matrix to obtain a fan-shaped image;

第三生成子模块,用于以所述目标图像上道路边沿的位置为基础对所述扇形图片进行裁切,得到一矩形图片,所述矩形图片为所述目标图像的正视图。The third generation sub-module is configured to cut the fan-shaped picture based on the position of the road edge on the target image to obtain a rectangular picture, and the rectangular picture is a front view of the target image.

本发明的上述技术方案至少具有如下有益效果:The technical solution of the present invention has at least the following beneficial effects:

本发明实施例的基于正射投影的道路标线采集方法中,通过对采集的目标图像进行处理,标识出道路边沿,并通过道路的标定特征点检测和累计采样修正的计算,进行自标定,得到逆透视变换矩阵,继而将目标图像转换成正视图,实现了道路标线的实时采集,同时实现了标定、矫正、正视图生成的自动化,极大的节省了后续处理的时间,节省了大量人力、物力。In the method for collecting road markings based on orthographic projection in the embodiment of the present invention, the road edge is identified by processing the collected target image, and self-calibration is performed through the detection of the marked feature points of the road and the calculation of cumulative sampling correction, Obtain the inverse perspective transformation matrix, and then convert the target image into a front view, realize the real-time collection of road markings, and realize the automation of calibration, correction, and front view generation, which greatly saves the time for subsequent processing and saves a lot Manpower and material resources.

附图说明Description of drawings

图1表示本发明实施例的基于正射投影的道路标线采集方法的基本步骤流程图;Fig. 1 shows the flow chart of the basic steps of the road marking collection method based on orthographic projection in an embodiment of the present invention;

图2表示本发明实施例的基于正射投影的道路标线采集方法中确定道路边沿位置的具体流程图;Fig. 2 represents the specific flowchart of determining the road edge position in the method for collecting road markings based on orthographic projection in an embodiment of the present invention;

图3表示本发明实施例的基于正射投影的道路标线采集方法中生成逆变换矩阵的具体流程图;Fig. 3 represents the specific flowchart of generating the inverse transformation matrix in the method for collecting road markings based on orthographic projection in an embodiment of the present invention;

图4表示本发明实施例的基于正射投影的道路标线采集方法中生成逆变换矩阵的坐标映射关系;Fig. 4 shows the coordinate mapping relation of generating the inverse transformation matrix in the method for collecting road markings based on orthographic projection in an embodiment of the present invention;

图5表示本发明实施例的基于正射投影的道路标线采集方法中生成目标图像的正视图的具体流程图;5 shows a specific flow chart of generating a front view of a target image in a method for collecting road markings based on orthographic projection according to an embodiment of the present invention;

图6表示本发明实施例的基于正射投影的道路标线采集装置的组成结构示意图。FIG. 6 shows a schematic diagram of the composition and structure of a device for collecting road markings based on orthographic projection according to an embodiment of the present invention.

具体实施方式detailed description

为使本发明要解决的技术问题、技术方案和优点更加清楚,下面将结合附图及具体实施例进行详细描述。In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments.

本发明针对现有技术中采集道路标线的车辆需要专门改装,工程量大,需要人工标定,繁琐费时,且在摄像机角度意外变化时无法及时做出修正的问题,提供一种基于正射投影的道路标线采集方法及装置,通过对采集的目标图像进行处理,标识出道路边沿,并通过道路的标定特征点检测和累计采样修正的计算,进行自标定,得到逆透视变换矩阵,继而将目标图像转换成正视图,实现了道路标线的实时采集,同时实现了标定、矫正、正视图生成的自动化,极大的节省了后续处理的时间,节省了大量人力、物力。The present invention aims at the problem that vehicles for collecting road markings in the prior art need to be specially refitted, the engineering volume is large, manual calibration is required, which is cumbersome and time-consuming, and it is impossible to make corrections in time when the camera angle changes unexpectedly, and provides a method based on orthographic projection The road marking collection method and device of the present invention process the collected target image to identify the road edge, and perform self-calibration through the calculation of road calibration feature point detection and cumulative sampling correction to obtain an inverse perspective transformation matrix, and then The target image is converted into a front view, which realizes the real-time collection of road markings, and at the same time realizes the automation of calibration, correction, and front view generation, which greatly saves the time for subsequent processing and saves a lot of manpower and material resources.

如图1所示,本发明实施例提供一种基于正射投影的道路标线采集方法,包括:As shown in Figure 1, an embodiment of the present invention provides a method for collecting road markings based on orthographic projection, including:

步骤1,利用安装在采集车上的摄像装置采集道路图像,获取目标图像;Step 1, using the camera installed on the acquisition vehicle to collect road images to obtain target images;

步骤2,对所述目标图像进行图像处理,获取道路边沿在所述目标图像中的位置;Step 2, performing image processing on the target image to obtain the position of the road edge in the target image;

步骤3,根据所述道路边沿在所述目标图像中的位置确定道路的位置,并基于所述道路的位置对所述目标图像进行特征点提取,得到标定特征点;Step 3, determining the position of the road according to the position of the edge of the road in the target image, and extracting feature points from the target image based on the position of the road to obtain calibration feature points;

步骤4,根据所述标定特征点获取摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵;Step 4, obtaining the conversion relationship between the coordinate system of the camera device and the space coordinate system according to the calibration feature points, and generating an inverse perspective transformation matrix;

步骤5,根据所述逆透视变换矩阵对所述目标图像进行图片转换,得到所述目标图像的正视图。Step 5: Perform picture conversion on the target image according to the inverse perspective transformation matrix to obtain a front view of the target image.

本发明的上述实施例中,对摄像装置采集的目标图像进行处理,获取道路边沿在目标图像中的位置;其中,道路包括路面、路沿等信息,而道路边沿就是指路沿;通俗的讲,道路是个面,而道路边沿是两条线;即道路(或者叫车道)指的是两条车道线之间的可通行区域(如实线和虚线之间,双虚线之间等);而道路边沿可以粗略的理解为车道线,但是因为车道线虚线是断续的,而道路边沿是连续的,因此道路边沿可以理解为限制道路可通行区域的两条直线。In the above-mentioned embodiments of the present invention, the target image collected by the camera device is processed to obtain the position of the road edge in the target image; wherein, the road includes information such as the road surface and the road edge, and the road edge refers to the road edge; in layman's terms , the road is a surface, and the road edge is two lines; that is, the road (or lane) refers to the passable area between two lane lines (such as between the solid line and the dashed line, between the double dashed lines, etc.); and the road The edge can be roughly understood as a lane line, but because the dotted line of the lane line is intermittent, and the road edge is continuous, the road edge can be understood as two straight lines that limit the passable area of the road.

进一步的,道路边沿在所述目标图像中的位置能够反映摄像装置与地面之间的角度信息;根据步骤2中确定的道路边沿信息则可确定道路在目标图像中的位置,在道路中选择若干个标定特征点;执行步骤4,根据标定特征点的信息即可获取摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵;继而结合逆透视变换矩阵对目标图像进行转换,得到目标图像的正视图。Further, the position of the road edge in the target image can reflect the angle information between the camera device and the ground; according to the road edge information determined in step 2, the position of the road in the target image can be determined, and several mark feature points; perform step 4, according to the information of the mark feature points, the conversion relationship between the camera coordinate system and the space coordinate system can be obtained, and an inverse perspective transformation matrix is generated; then the target image is converted in combination with the inverse perspective transformation matrix, Get the front view of the target image.

其中,正射投影是指将摄像装置拍到的与地面之间有一定倾斜角的图片,转换成直接垂直朝下(正投影)的图片。本发明提供的方法的直接输出即为实时的正射图片(正视图),同时也极大的简化了地面标线采集的步骤,实现了标定、矫正及正视图的生成的自动化,极大的节省了后续处理的时间,提高了工作效率,节省了大量人力物力。Wherein, the orthographic projection refers to converting the picture captured by the camera device with a certain inclination angle to the ground into a picture directly vertically downward (orthographic projection). The direct output of the method provided by the present invention is the real-time orthophoto picture (front view), which also greatly simplifies the steps of collecting ground markings, realizes the automation of calibration, correction and generation of the front view, and greatly It saves the time for subsequent processing, improves work efficiency, and saves a lot of manpower and material resources.

本发明的上述实施例中,步骤5后还包括:In the above-mentioned embodiment of the present invention, after step 5, it also includes:

步骤6,将所述目标图像的正视图进行实时显示并存储。Step 6, displaying and storing the front view of the target image in real time.

具体的,本发明实施例中,生成正视图后将该正视图进行实时显示并存储,达到地面标线采集的目的,为地图信息的采集提供基础数据。较佳的,可通过屏幕显示该正视图,但不仅限于此方法,也可通过抬头显示系统,如将该正视图映射到前挡风玻璃上等方法,不限于一固定方法,在此不一一赘述。Specifically, in the embodiment of the present invention, after the front view is generated, the front view is displayed and stored in real time, so as to achieve the purpose of collecting ground markings and provide basic data for the collection of map information. Preferably, the front view can be displayed on the screen, but it is not limited to this method. It can also be used through the head-up display system, such as mapping the front view to the front windshield, etc., not limited to a fixed method, and it is not used here. A repeat.

需要说明的是,对所述目标图像的正视图的存储可将其存储到一预设存储器或数据库中,方便后期对其数据进行调用。It should be noted that the storage of the front view of the target image can be stored in a preset memory or database, so that its data can be recalled later.

本发明的上述实施例中,如图2所示,步骤2包括:In the above-mentioned embodiment of the present invention, as shown in Figure 2, step 2 includes:

步骤21,将所述目标图像转换为灰度图像;Step 21, converting the target image into a grayscale image;

步骤22,将所述灰度图像转化为仅显示物体边沿的边沿图;Step 22, converting the grayscale image into an edge map that only shows the edge of the object;

步骤23,在所述边沿图中获取第一直线特征,并根据预设道路模型的道路边沿的直线特征对所述第一直线特征进行筛选,获取第二直线特征;Step 23, obtaining the first straight line feature in the edge map, and filtering the first straight line feature according to the straight line feature of the road edge of the preset road model to obtain the second straight line feature;

步骤24,若当前所述目标图像为采集的第一帧图像,所述第二直线特征为目标直线特征;否则,根据当前所述目标图像之前的多帧图像的第二直线特征,获取预测道路边沿信息,并结合所述预测道路边沿信息和当前所述目标图像的第二直线特征,确定目标直线特征;Step 24, if the current target image is the first frame image collected, the second straight line feature is the target straight line feature; otherwise, obtain the predicted road according to the second straight line features of multiple frames of images before the current target image Edge information, and combining the predicted road edge information and the second straight line feature of the current target image to determine the target straight line feature;

步骤25,根据所述目标直线特征,获取道路边沿在所述目标图像中的位置。Step 25: Acquire the position of the road edge in the target image according to the feature of the target line.

本发明的具体实施例中,步骤21中将目标图像转换为灰度图像的方法可以为通过改变图像的属性改变,也可以通过一些图像编辑软件改变,如photoshop等,在此不一一举例。In a specific embodiment of the present invention, the method of converting the target image into a grayscale image in step 21 can be changed by changing the attributes of the image, or by some image editing software, such as photoshop, etc., which are not listed here.

较佳的,步骤22包括:Preferably, step 22 includes:

步骤221,利用canny边缘检测算子将所述灰度图像转化为仅显示物体边沿的边沿图。Step 221 , using a canny edge detection operator to convert the grayscale image into an edge map that only shows the edge of the object.

Canny边缘检测算子是JohnF.Canny于1986年开发出来的一个多级边缘检测算法;且Canny创立了边缘检测计算理论(Computationaltheoryofedgedetection)解释Canny边缘检测算子的工作原理。Canny边缘检测算子的基本步骤包括a.去噪声;b.寻找图像中的亮度梯度;c.在图像中跟踪边缘。Canny边缘检测算子的目标是找到一个最优的边缘检测算法,最优边缘检测的含义是:算法能够尽可能多地标识出图像中的实际边缘;标识出的边缘要尽可能与实际图像中的实际边缘尽可能接近;图像中的边缘只能标识一次,并且可能存在的图像噪声不应标识为边缘。Canny使用了变分法,Canny算法适用于不同的场合,它的参数允许根据不同实现的特定要求进行调整以识别不同的边缘特性。The Canny edge detection operator is a multi-level edge detection algorithm developed by JohnF.Canny in 1986; and Canny created the Computational theory of edge detection to explain the working principle of the Canny edge detection operator. The basic steps of the Canny edge detection operator include a. Denoising; b. Finding the brightness gradient in the image; c. Tracking the edge in the image. The goal of the Canny edge detection operator is to find an optimal edge detection algorithm. The meaning of optimal edge detection is: the algorithm can identify as many actual edges in the image as possible; the identified edges should be as close as possible to the actual image. As close as possible to the actual edge of ; an edge in an image can only be identified once, and possible image noise should not be identified as an edge. Canny uses a variational method, and the Canny algorithm is suitable for different occasions, and its parameters allow adjustments to identify different edge characteristics according to the specific requirements of different implementations.

本发明的具体实施例中利用canny边缘检测算子显示物体边沿的边沿图的方法仅为本发明的一较佳实施例,不用于限制本发明的保护范围,其他能够较准确的显示物体边沿的方法在本发明实施例中均适用。In the specific embodiment of the present invention, the method of using the canny edge detection operator to display the edge map of the object edge is only a preferred embodiment of the present invention, and is not used to limit the protection scope of the present invention. Other methods that can display the object edge more accurately The method is applicable to all the embodiments of the present invention.

较佳的,步骤23包括:Preferably, step 23 includes:

步骤231,应用随机hough变换方法在所述边沿图中获取第一直线特征。Step 231, applying the random hough transform method to obtain the first straight line feature in the edge graph.

本发明具体实施例中,Hough变换是一种使用表决原理的参数估计技术。其原理是利用图像空间和Hough参数空间的点-线对偶性,把图像空间中的检测问题转换到参数空间。通过在参数空间里进行简单的累加统计,然后在Hough参数空间寻找累加器峰值的方法检测直线。Hough变换的实质是将图像空间内具有一定关系的像元进行聚类,寻找能把这些像元用某一解析形式联系起来的参数空间累积对应点。In the specific embodiment of the present invention, the Hough transform is a parameter estimation technique using the voting principle. Its principle is to use the point-line duality of image space and Hough parameter space to convert the detection problem in image space to parameter space. A straight line is detected by performing simple accumulation statistics in the parameter space, and then finding the peak value of the accumulator in the Hough parameter space. The essence of the Hough transform is to cluster the pixels with a certain relationship in the image space, and to find the cumulative corresponding points in the parameter space that can connect these pixels with a certain analytical form.

该步骤基于随机hough变换的直线特征选取,应用随机hough变换方法,在步骤22中得到的边沿图中寻找直线特征,即第一直线特征;因为道路边沿具有明显的直线特征,因此该步骤能够尽可能的剔除干扰因素。This step is based on the straight line feature selection of the random hough transform, and the random hough transform method is used to find the straight line feature in the edge map obtained in step 22, that is, the first straight line feature; because the road edge has obvious straight line features, this step can be Eliminate distracting factors as much as possible.

进一步的,由于第一直线特征中除道路边沿外,依然会有其他的直线特征干扰,因此步骤23中需结合预设的道路模型的道路边沿的直线特征进行第二次筛选,得到第二直线特征。具体的,步骤23中将与所述预设道路模型的道路边沿的直线特征相似度大于一预设值的第一直线特征判定为第二直线特征;将与所述预设道路模型的道路边沿的直线特征的相似度小于或者等于该预设值的第一直线特征判定为第二直线特征。较佳的,两个直线特征之间的相似度计算可通过具体的数学公式计算出,如某些函数等等,在此不具体描述;且上述的预设值可根据不同的场合不同设定,不限于一固定值。Further, since the first straight line feature will still have other straight line feature interference except for the road edge, in step 23, it is necessary to perform a second screening in combination with the straight line feature of the road edge of the preset road model to obtain the second straight line features. Specifically, in step 23, the first straight line feature whose similarity with the straight line feature of the road edge of the preset road model is greater than a preset value is determined as the second straight line feature; The first straight line feature whose similarity degree of the edge straight line feature is less than or equal to the preset value is determined as the second straight line feature. Preferably, the calculation of the similarity between two straight line features can be calculated through specific mathematical formulas, such as some functions, etc., which are not described in detail here; and the above-mentioned preset values can be set differently according to different occasions , not limited to a fixed value.

承续上例,任何检测都是有误差及不确定性存在,尤其在之前几步中的图像处理中,必定会在个别图像中混入干扰信息,如绿化带,路面上的箭头等一系列可能会被误认为是道路边沿的物体;这些误检出的特征与真实的道路边沿特征接近,难以通过步骤23滤除。同时由于车辆的运行的连续的,在大部分情况下,道路边沿在图像中的位置是固定的,检测结果总会是在这个真实值附近小范围跳动,虽然单个图像的检测结果不完全可信,因此执行步骤24,,结合之前之间若干个图像的结果,在一定数量的结果中做平均,即可发现较为可信的道路边沿的位置,即获取预测道路边沿信息,进而可以推断出道路的宽度等信息。Continuing from the above example, there are errors and uncertainties in any detection, especially in the image processing in the previous steps, interference information must be mixed in individual images, such as green belts, arrows on the road, etc. Objects that will be mistaken for the edge of the road; these falsely detected features are close to the real road edge features, and it is difficult to filter out through step 23. At the same time, due to the continuous operation of the vehicle, in most cases, the position of the road edge in the image is fixed, and the detection result will always jump in a small range around this true value, although the detection result of a single image is not completely reliable , so execute step 24, combine the results of several previous images, average among a certain number of results, you can find a more credible position of the road edge, that is, obtain the predicted road edge information, and then infer the road width and other information.

继而结合所述预测道路边沿信息和当前所述目标图像的第二直线特征,确定目标直线特征,具体的相当于在检测下一图像之前对道路的位置有了大致的预测,即使检测结果只检出了道路的左或右边沿,依然可以根据道路宽度等信息,恢复出另一侧边沿的位置,确定目标直线特征。Then combine the predicted road edge information and the second straight line feature of the current target image to determine the target straight line feature, which is equivalent to roughly predicting the position of the road before detecting the next image, even if the detection result only detects After leaving the left or right edge of the road, the position of the edge on the other side can still be recovered according to information such as the width of the road, and the characteristics of the target straight line can be determined.

较佳的,若当前所述目标图像为采集的第一帧图像,则无法得到预测道路边沿信息,则将第二直线特征确定为目标直线特征;但是通过分析第一帧图像得到的道路边沿信息的结果可信度较低,应采用多帧图像取平均的方法,提高道路边沿的结果的准确性。Preferably, if the current target image is the first frame image collected, the predicted road edge information cannot be obtained, and the second straight line feature is determined as the target straight line feature; but the road edge information obtained by analyzing the first frame image The reliability of the results is low, and the method of averaging multiple frames of images should be used to improve the accuracy of the results on the road edge.

进一步的,执行步骤25,根据目标直线特征,获取道路边沿在所述目标图像中的位置,即该目标直线特征为目标图像中的道路边沿。具体的,道路边沿是指两条直线,通过两条直线共4个端点在目标图像中的位置即可表示道路边沿在目标图像中的位置。Further, step 25 is executed to obtain the position of the road edge in the target image according to the target straight line feature, that is, the target straight line feature is the road edge in the target image. Specifically, the road edge refers to two straight lines, and the positions of the four endpoints of the two straight lines in the target image can represent the position of the road edge in the target image.

本发明的上述实施例中,如图3所示,步骤4包括:In the above-mentioned embodiment of the present invention, as shown in Figure 3, step 4 includes:

步骤41,获取所述标定特征点的实际位置;Step 41, obtaining the actual position of the calibration feature point;

步骤42,根据所述标定特征点在所述目标图像上的位置和所述实际位置,利用逆透视变换方法确定摄像装置坐标系与空间坐标系之间的转换关系;Step 42, according to the position of the calibration feature point on the target image and the actual position, use an inverse perspective transformation method to determine the conversion relationship between the coordinate system of the camera device and the spatial coordinate system;

步骤43,根据所述摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵。Step 43: Generate an inverse perspective transformation matrix according to the transformation relationship between the camera coordinate system and the space coordinate system.

本发明的具体实施例中,对图形逆透视变换,只需对离散点列变换;逆透视变换是较为成熟的公共算法,在此不展开进行具体描述;其基本步骤是在图像中选取若干个点(例如分析图像得到每一行上车道边线或中线的坐标,如此得到一系列离散点),然后测量这些点的实际位置(每一个点有一个横纵坐标,单位为像素,根据感光阵列的大小(若干毫米)将坐标变换到实际摄像装置上,单位变为米),根据如图4所示的坐标映射关系,明确摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵。In the specific embodiment of the present invention, to figure anti-perspective transformation, only need to transform discrete point column; Inverse perspective transformation is a comparatively mature public algorithm, will not expand here and carry out specific description; Its basic step is to select several point (for example, analyze the image to get the coordinates of the sideline or center line of each row, so as to obtain a series of discrete points), and then measure the actual position of these points (each point has a horizontal and vertical coordinates, the unit is pixel, according to the size of the photosensitive array (several millimeters) transform the coordinates to the actual camera device, and the unit becomes meter), according to the coordinate mapping relationship shown in Figure 4, clarify the conversion relationship between the camera device coordinate system and the space coordinate system, and generate an inverse perspective transformation matrix .

本发明的上述实施例中,如图5所示,步骤5包括:In the above-mentioned embodiment of the present invention, as shown in FIG. 5, step 5 includes:

步骤51,对所述目标图像进行裁切,仅保留所述目标图像上的地平线以下部分;Step 51, cropping the target image, keeping only the part below the horizon on the target image;

步骤52,根据所述逆透视变换矩阵将经过裁切的所述目标图像进行图片转换,得到一扇形图片;Step 52, performing picture conversion on the cropped target image according to the inverse perspective transformation matrix to obtain a fan-shaped picture;

步骤53,以所述目标图像上道路边沿的位置为基础对所述扇形图片进行裁切,得到一矩形图片,所述矩形图片为所述目标图像的正视图。Step 53: Crop the fan-shaped picture based on the position of the road edge on the target image to obtain a rectangular picture, and the rectangular picture is a front view of the target image.

本发明具体实施例中,由于道路标线的正视图(直接垂直朝下的图片)中不包含地平线以上的物体,因为为了减小根据逆透视变换矩阵转换时的计算量,步骤51中进行第一次裁切,仅保留目标图像中地平线地下的部分。步骤52中,将地平线以下的图像中每个标定点的坐标代入逆透视变换公式中得到空间坐标系下的坐标,得到一扇形图片。该扇形图片表示的就是目标图像的正视图,又因为道路一般是呈矩形的,因此扇形图片中相当一部分信息的与道路无关的,故需要删去与道路无关的部分,得到关注的目标所在;故执行步骤53,以检出的车道为基础,适当外扩一些,对扇形图片进行第二次裁切,得到一矩形图片,该矩形图片即位关注的目标所在,也就是目标图像的正视图;该方法实现了道路标线的实时采集,同时实现了标定、矫正、正视图生成的自动化,极大的节省了后续处理的时间,节省了大量人力、物力。In the specific embodiment of the present invention, since the front view of the road markings (the picture directly facing downwards) does not contain objects above the horizon, because in order to reduce the calculation amount when converting according to the inverse perspective transformation matrix, the first step is performed in step 51. One crop, keeping only the part below the horizon in the target image. In step 52, the coordinates of each marked point in the image below the horizon are substituted into the inverse perspective transformation formula to obtain the coordinates in the space coordinate system, and a fan-shaped picture is obtained. The fan-shaped picture represents the front view of the target image, and because the road is generally rectangular, a considerable part of the information in the fan-shaped picture has nothing to do with the road, so it is necessary to delete the part that is not related to the road to get the target of attention; Therefore, step 53 is performed, based on the detected lane, appropriately expanded, and the fan-shaped picture is cut for the second time to obtain a rectangular picture, which is the target of interest, that is, the front view of the target image; This method realizes the real-time collection of road markings, and at the same time realizes the automation of calibration, correction, and front view generation, which greatly saves the time for subsequent processing and saves a lot of manpower and material resources.

为了更好的实现上述目的,如图6所示,本发明实施例还提供一种基于正射投影的道路标线采集装置,包括:In order to better achieve the above purpose, as shown in Figure 6, an embodiment of the present invention also provides a road marking collection device based on orthographic projection, including:

采集模块10,用于利用安装在采集车上的摄像装置采集道路图像,获取目标图像;Acquisition module 10, is used for utilizing the camera device installed on the collection vehicle to collect road images and obtain target images;

获取模块20,用于对所述目标图像进行图像处理,获取道路边沿在所述目标图像中的位置;An acquisition module 20, configured to perform image processing on the target image to acquire the position of the road edge in the target image;

提取模块30,用于根据所述道路边沿在所述目标图像中的位置确定道路的位置,并基于所述道路的位置对所述目标图像进行特征点提取,得到标定特征点;An extraction module 30, configured to determine the position of the road according to the position of the road edge in the target image, and extract feature points from the target image based on the position of the road to obtain marked feature points;

转换模块40,用于根据所述标定特征点获取摄像装置坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵;The conversion module 40 is used to obtain the conversion relationship between the coordinate system of the camera device and the spatial coordinate system according to the calibration feature points, and generate an inverse perspective transformation matrix;

生成模块50,用于根据所述逆透视变换矩阵对所述目标图像进行图片转换,得到所述目标图像的正视图。The generating module 50 is configured to perform picture conversion on the target image according to the inverse perspective transformation matrix to obtain a front view of the target image.

具体的,安装在采集车上的摄像装置可以为单独设置的摄像机,也可以为内嵌于该装置的摄像装置,与手机内嵌摄像头的方式的原理相似,且为了准确的获取逆变换矩阵,在初始安装该装置或摄像装置时可手动或自动输入安装高度、安装位置以及其属性参数等等,为后续的计算提供较为准确的数据。Specifically, the camera device installed on the collection vehicle can be a separate camera, or a camera device embedded in the device, which is similar in principle to the method of embedding a camera in a mobile phone, and in order to obtain the inverse transformation matrix accurately, When the device or camera device is initially installed, the installation height, installation location and its attribute parameters, etc. can be manually or automatically input to provide more accurate data for subsequent calculations.

本发明上述实施例中,所述道路标线采集装置还包括:In the above embodiments of the present invention, the road marking collection device further includes:

显示存储模块,用于将所述目标图像的正视图进行实时显示并存储。The display storage module is used to display and store the front view of the target image in real time.

进一步的,本发明上述实施例中,所述获取模块20包括:Further, in the above-mentioned embodiments of the present invention, the acquisition module 20 includes:

第一获取子模块,用于将所述目标图像转换为灰度图像;The first acquisition submodule is used to convert the target image into a grayscale image;

第二获取子模块,用于将所述灰度图像转化为仅显示物体边沿的边沿图;The second acquisition sub-module is used to convert the grayscale image into an edge image showing only the edge of the object;

第三获取子模块,用于在所述边沿图中获取第一直线特征,并根据预设道路模型的道路边沿的直线特征对所述第一直线特征进行筛选,获取第二直线特征;The third obtaining sub-module is used to obtain the first straight line feature in the edge map, and filter the first straight line feature according to the straight line feature of the road edge of the preset road model, and obtain the second straight line feature;

第四获取子模块,用于若当前所述目标图像为采集的第一帧图像,所述第二直线特征为目标直线特征;否则,根据当前所述目标图像之前的多帧图像的第二直线特征,获取预测道路边沿信息,并结合所述预测道路边沿信息和当前所述目标图像的第二直线特征,确定目标直线特征;The fourth acquisition sub-module is used for if the current target image is the first frame image collected, the second straight line feature is the target straight line feature; otherwise, according to the second straight line of multiple frames of images before the current target image feature, obtaining predicted road edge information, and combining the predicted road edge information and the second straight line feature of the current target image to determine the target straight line feature;

第五获取子模块,用于根据所述目标直线特征,获取道路边沿在所述目标图像中的位置。The fifth acquisition sub-module is configured to acquire the position of the road edge in the target image according to the target straight line feature.

较佳的,本发明上述实施例中,所述第二获取子模块包括:Preferably, in the above embodiments of the present invention, the second acquisition submodule includes:

第一转化模块,用于利用canny边缘检测算子将所述灰度图像转化为仅显示物体边沿的边沿图。The first conversion module is used to convert the grayscale image into an edge image showing only object edges by using a canny edge detection operator.

较佳的,本发明上述实施例中,所述第三获取子模块包括:Preferably, in the above embodiments of the present invention, the third acquisition submodule includes:

第二转化模块,用于应用随机hough变换方法在所述边沿图中获取第一直线特征。The second conversion module is used to obtain the first straight line feature in the edge graph by applying the random hough transform method.

本发明上述实施例中,所述转换模块40包括:In the above embodiments of the present invention, the conversion module 40 includes:

第一转换子模块,用于获取所述标定特征点的实际位置;The first conversion submodule is used to obtain the actual position of the calibration feature point;

第二转换子模块,用于根据所述标定特征点在所述目标图像上的位置和所述实际位置,利用逆透视变换方法确定摄像装置坐标系与空间坐标系之间的转换关系;The second conversion sub-module is used to determine the conversion relationship between the coordinate system of the camera device and the spatial coordinate system by using an inverse perspective transformation method according to the position of the calibration feature point on the target image and the actual position;

第三转换子模块,用于根据所述汽车坐标系与空间坐标系之间的转换关系,生成逆透视变换矩阵。The third transformation sub-module is used to generate an inverse perspective transformation matrix according to the transformation relationship between the vehicle coordinate system and the space coordinate system.

本发明上述实施例中,所述生成模块50包括:In the above-mentioned embodiments of the present invention, the generating module 50 includes:

第一生成子模块,用于对所述目标图像进行裁切,仅保留所述目标图像上的地平线以下部分;The first generating submodule is used to crop the target image, and only keep the part below the horizon on the target image;

第二生成子模块,用于根据所述逆透视变换矩阵将经过裁切的所述目标图像进行图片转换,得到一扇形图片;The second generation sub-module is used to perform image conversion on the cropped target image according to the inverse perspective transformation matrix to obtain a fan-shaped image;

第三生成子模块,用于以所述目标图像上道路边沿的位置为基础对所述扇形图片进行裁切,得到一矩形图片,所述矩形图片为所述目标图像的正视图。The third generation sub-module is configured to cut the fan-shaped picture based on the position of the road edge on the target image to obtain a rectangular picture, and the rectangular picture is a front view of the target image.

本发明具体实施例的基于正射投影的道路标线采集方法中,通过对采集的目标图像进行处理,标识出道路边沿,并通过道路的标定特征点检测和累计采样修正的计算,进行自标定,得到逆透视变换矩阵,继而将目标图像转换成正视图,实现了道路标线的实时采集,同时实现了标定、矫正、正视图生成的自动化,极大的节省了后续处理的时间,节省了大量人力、物力。In the road marking acquisition method based on orthographic projection in the specific embodiment of the present invention, the road edge is identified by processing the collected target image, and self-calibration is performed through the calculation of the calibration feature point detection and cumulative sampling correction of the road , get the inverse perspective transformation matrix, and then convert the target image into a front view, realize the real-time collection of road markings, and realize the automation of calibration, correction, and front view generation, which greatly saves the time for subsequent processing and saves A lot of manpower and material resources.

需要说明的是,本发明提供的基于正射投影的道路标线采集装置的应用上述方法的装置,则上述基于正射投影的道路标线采集方法的所有实施例均适用于该装置,且均能达到相同或相似的有益效果。It should be noted that all embodiments of the road marking collection method based on orthographic projection described above are applicable to the device of the road marking collection device based on orthographic projection provided by the present invention, and all of them are Can achieve the same or similar beneficial effects.

以上所述是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明所述原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The above description is a preferred embodiment of the present invention, it should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present invention, some improvements and modifications can also be made, these improvements and modifications It should also be regarded as the protection scope of the present invention.

Claims (14)

1., based on a roadmarking acquisition method for orthogonal projection, it is characterized in that, comprising:
Utilize the camera head collection road image being arranged on and gathering on car, obtain target image;
Image procossing is carried out to described target image, obtains the position of road edge in described target image;
Determine the position of road according to the position of described road edge in described target image, and based on the position of described road, feature point extraction is carried out to described target image, obtain feature point for calibration;
Obtain the transformational relation between camera head coordinate system and space coordinates according to described feature point for calibration, generate inverse perspective mapping matrix;
According to described inverse perspective mapping matrix, picture conversion is carried out to described target image, obtain the front elevation of described target image.
2. the roadmarking acquisition method based on orthogonal projection according to claim 1, is characterized in that, also comprise after obtaining the front elevation of described target image:
The front elevation of described target image is shown in real time and stores.
3. the roadmarking acquisition method based on orthogonal projection according to claim 1, is characterized in that, carry out image procossing to described target image, and the step obtaining the position of road edge in described target image comprises:
Described target image is converted to gray level image;
Described gray level image is converted into the edge figure only showing object edge;
In described edge figure, obtain the first linear feature, and according to the linear feature of the road edge of default road model, described first linear feature is screened, obtain the second linear feature;
If current described target image is the first two field picture gathered, described second linear feature is target line feature; Otherwise, according to the second linear feature of the multiple image before current described target image, obtain predicted link side information, and in conjunction with the second linear feature of described predicted link side information and current described target image, determine target line feature;
According to described target line feature, obtain the position of road edge in described target image.
4. the roadmarking acquisition method based on orthogonal projection according to claim 3, is characterized in that, the step described gray level image being converted into the edge figure only showing object edge comprises:
Canny edge detection operator is utilized described gray level image to be converted into the edge figure only showing object edge.
5. the roadmarking acquisition method based on orthogonal projection according to claim 3, is characterized in that, the step obtaining the first linear feature in described edge figure comprises:
Apply random hough transform method and obtain the first linear feature in described edge figure.
6. the roadmarking acquisition method based on orthogonal projection according to claim 1, is characterized in that, obtains the transformational relation between camera head coordinate system and space coordinates according to described feature point for calibration, and the step generating inverse perspective mapping matrix comprises:
Obtain the physical location of described feature point for calibration;
According to the position of described feature point for calibration on described target image and described physical location, utilize the transformational relation between inverse perspective mapping method determination camera head coordinate system and space coordinates;
According to the transformational relation between described camera head coordinate system and space coordinates, generate inverse perspective mapping matrix.
7. the roadmarking acquisition method based on orthogonal projection according to claim 1, is characterized in that, carry out picture conversion according to described inverse perspective mapping matrix to described target image, the step obtaining the front elevation of described target image comprises:
Described target image is cut, only retains local horizon on described target image with lower part;
According to described inverse perspective mapping matrix, the described target image through cutting being carried out picture conversion, obtaining a fan-shaped picture;
On described target image road edge position based on described fan-shaped picture is cut, obtain a rectangle picture, described rectangle picture is the front elevation of described target image.
8., based on a roadmarking harvester for orthogonal projection, it is characterized in that, comprising:
Acquisition module, for utilizing the camera head collection road image being arranged on and gathering on car, obtains target image;
Acquisition module, for carrying out image procossing to described target image, obtains the position of road edge in described target image;
Extraction module, for determining the position of road according to the position of described road edge in described target image, and carries out feature point extraction based on the position of described road to described target image, obtains feature point for calibration;
Modular converter, for obtaining the transformational relation between camera head coordinate system and space coordinates according to described feature point for calibration, generates inverse perspective mapping matrix;
Generation module, for carrying out picture conversion according to described inverse perspective mapping matrix to described target image, obtains the front elevation of described target image.
9. the roadmarking harvester based on orthogonal projection according to claim 8, is characterized in that, described roadmarking harvester also comprises:
Display memory module, for showing the front elevation of described target image in real time and storing.
10. the roadmarking harvester based on orthogonal projection according to claim 8, it is characterized in that, described acquisition module comprises:
First obtains submodule, for described target image is converted to gray level image;
Second obtains submodule, for described gray level image being converted into the edge figure only showing object edge;
3rd obtains submodule, for obtaining the first linear feature in described edge figure, and screening described first linear feature according to the linear feature of the road edge of default road model, obtaining the second linear feature;
4th obtains submodule, if be the first two field picture gathered for current described target image, described second linear feature is target line feature; Otherwise, according to the second linear feature of the multiple image before current described target image, obtain predicted link side information, and in conjunction with the second linear feature of described predicted link side information and current described target image, determine target line feature;
5th obtains submodule, for according to described target line feature, obtains the position of road edge in described target image.
The 11. roadmarking harvesters based on orthogonal projection according to claim 10, is characterized in that, described second obtains submodule comprises:
First conversion module, is converted into for utilizing canny edge detection operator the edge figure only showing object edge by described gray level image.
The 12. roadmarking harvesters based on orthogonal projection according to claim 10, is characterized in that, the described 3rd obtains submodule comprises:
Second conversion module, obtains the first linear feature for applying random hough transform method in described edge figure.
The 13. roadmarking harvesters based on orthogonal projection according to claim 8, it is characterized in that, described modular converter comprises:
First transform subblock, for obtaining the physical location of described feature point for calibration;
Second transform subblock, for according to the position of described feature point for calibration on described target image and described physical location, utilizes the transformational relation between inverse perspective mapping method determination camera head coordinate system and space coordinates;
3rd transform subblock, for according to the transformational relation between described vehicle axis system and space coordinates, generates inverse perspective mapping matrix.
The 14. roadmarking harvesters based on orthogonal projection according to claim 1, it is characterized in that, described generation module comprises:
First generates submodule, for cutting described target image, only retains local horizon on described target image with lower part;
Second generates submodule, for the described target image through cutting being carried out picture conversion according to described inverse perspective mapping matrix, obtains a fan-shaped picture;
3rd generates submodule, and cut described fan-shaped picture based on the position of road edge on described target image, obtain a rectangle picture, described rectangle picture is the front elevation of described target image.
CN201410310718.0A 2014-07-01 2014-07-01 A kind of roadmarking acquisition method based on orthogonal projection and device Pending CN105224908A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410310718.0A CN105224908A (en) 2014-07-01 2014-07-01 A kind of roadmarking acquisition method based on orthogonal projection and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410310718.0A CN105224908A (en) 2014-07-01 2014-07-01 A kind of roadmarking acquisition method based on orthogonal projection and device

Publications (1)

Publication Number Publication Date
CN105224908A true CN105224908A (en) 2016-01-06

Family

ID=54993868

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410310718.0A Pending CN105224908A (en) 2014-07-01 2014-07-01 A kind of roadmarking acquisition method based on orthogonal projection and device

Country Status (1)

Country Link
CN (1) CN105224908A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106780308A (en) * 2016-12-20 2017-05-31 武汉理工大学 A kind of perspective image transform method
CN106940562A (en) * 2017-03-09 2017-07-11 华南理工大学 A kind of mobile robot wireless clustered system and neutral net vision navigation method
CN107292871A (en) * 2017-06-08 2017-10-24 国网青海省电力公司检修公司 A kind of real-time correction algorithm of transformer station's round meter
CN107729824A (en) * 2017-09-28 2018-02-23 湖北工业大学 A kind of monocular visual positioning method for intelligent scoring of being set a table for Chinese meal dinner party table top
CN108230394A (en) * 2016-12-14 2018-06-29 中南大学 A kind of orbital image auto-correction method
CN108873013A (en) * 2018-06-27 2018-11-23 江苏大学 A kind of road using multi-line laser radar can traffic areas acquisition methods
CN109074078A (en) * 2016-04-26 2018-12-21 高通股份有限公司 Method and apparatus for capturing images of traffic signs
CN109300159A (en) * 2018-09-07 2019-02-01 百度在线网络技术(北京)有限公司 Position detection method, device, device, storage medium and vehicle
CN109559343A (en) * 2017-09-27 2019-04-02 北京京东尚科信息技术有限公司 Image processing method and device for container
CN109842756A (en) * 2017-11-28 2019-06-04 东莞市普灵思智能电子有限公司 A method and system for lens distortion correction and feature extraction
CN110135331A (en) * 2019-05-13 2019-08-16 人加智能机器人技术(北京)有限公司 Interbehavior detection method, device, system, equipment and storage medium
CN110347241A (en) * 2019-05-24 2019-10-18 杨巧雪 It is a kind of can the AR new line display optical system that shows of normotopia outdoor scene
CN110544386A (en) * 2019-09-18 2019-12-06 奇瑞汽车股份有限公司 parking space identification method and device and storage medium
CN111275766A (en) * 2018-12-05 2020-06-12 杭州海康威视数字技术股份有限公司 Image coordinate system and GPS coordinate system calibration method, device and camera
CN112037316A (en) * 2020-09-22 2020-12-04 北京百度网讯科技有限公司 Mapping generation method and device and road side equipment
CN112348876A (en) * 2019-08-08 2021-02-09 北京地平线机器人技术研发有限公司 Method and device for acquiring space coordinates of signboards
CN112464737A (en) * 2020-11-04 2021-03-09 浙江预策科技有限公司 Road marking detection and identification method, electronic device and storage medium
CN112529097A (en) * 2020-12-23 2021-03-19 北京百度网讯科技有限公司 Sample image generation method and device and electronic equipment
CN113176182A (en) * 2021-04-29 2021-07-27 上海易清智觉自动化科技有限公司 Aggregate production line detection system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682292A (en) * 2012-05-10 2012-09-19 清华大学 Method based on monocular vision for detecting and roughly positioning edge of road
CN102722705A (en) * 2012-06-12 2012-10-10 武汉大学 Method for detecting multi-lane line on basis of random sample consensus (RANSAC) algorithm
CN102867414A (en) * 2012-08-18 2013-01-09 湖南大学 Vehicle queue length measurement method based on PTZ (Pan/Tilt/Zoom) camera fast calibration
CN103714538A (en) * 2013-12-20 2014-04-09 中联重科股份有限公司 Road edge detection method and device and vehicle

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682292A (en) * 2012-05-10 2012-09-19 清华大学 Method based on monocular vision for detecting and roughly positioning edge of road
CN102722705A (en) * 2012-06-12 2012-10-10 武汉大学 Method for detecting multi-lane line on basis of random sample consensus (RANSAC) algorithm
CN102867414A (en) * 2012-08-18 2013-01-09 湖南大学 Vehicle queue length measurement method based on PTZ (Pan/Tilt/Zoom) camera fast calibration
CN103714538A (en) * 2013-12-20 2014-04-09 中联重科股份有限公司 Road edge detection method and device and vehicle

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109074078A (en) * 2016-04-26 2018-12-21 高通股份有限公司 Method and apparatus for capturing images of traffic signs
CN108230394A (en) * 2016-12-14 2018-06-29 中南大学 A kind of orbital image auto-correction method
CN106780308B (en) * 2016-12-20 2020-05-05 武汉理工大学 An Image Perspective Transformation Method
CN106780308A (en) * 2016-12-20 2017-05-31 武汉理工大学 A kind of perspective image transform method
CN106940562A (en) * 2017-03-09 2017-07-11 华南理工大学 A kind of mobile robot wireless clustered system and neutral net vision navigation method
CN106940562B (en) * 2017-03-09 2023-04-28 华南理工大学 Mobile robot wireless cluster system and neural network visual navigation method
CN107292871A (en) * 2017-06-08 2017-10-24 国网青海省电力公司检修公司 A kind of real-time correction algorithm of transformer station's round meter
CN109559343A (en) * 2017-09-27 2019-04-02 北京京东尚科信息技术有限公司 Image processing method and device for container
CN107729824A (en) * 2017-09-28 2018-02-23 湖北工业大学 A kind of monocular visual positioning method for intelligent scoring of being set a table for Chinese meal dinner party table top
CN107729824B (en) * 2017-09-28 2021-07-13 湖北工业大学 A monocular visual positioning method for intelligent scoring of Chinese banquet table setting table
CN109842756A (en) * 2017-11-28 2019-06-04 东莞市普灵思智能电子有限公司 A method and system for lens distortion correction and feature extraction
WO2019105044A1 (en) * 2017-11-28 2019-06-06 东莞市普灵思智能电子有限公司 Method and system for lens distortion correction and feature extraction
CN108873013A (en) * 2018-06-27 2018-11-23 江苏大学 A kind of road using multi-line laser radar can traffic areas acquisition methods
CN109300159A (en) * 2018-09-07 2019-02-01 百度在线网络技术(北京)有限公司 Position detection method, device, device, storage medium and vehicle
US11210534B2 (en) 2018-09-07 2021-12-28 Baidu Online Network Technology (Beijing) Co., Ltd. Method for position detection, device, and storage medium
CN111275766A (en) * 2018-12-05 2020-06-12 杭州海康威视数字技术股份有限公司 Image coordinate system and GPS coordinate system calibration method, device and camera
CN111275766B (en) * 2018-12-05 2023-09-05 杭州海康威视数字技术股份有限公司 Calibration method, device and camera for image coordinate system and GPS coordinate system
CN110135331A (en) * 2019-05-13 2019-08-16 人加智能机器人技术(北京)有限公司 Interbehavior detection method, device, system, equipment and storage medium
CN110347241A (en) * 2019-05-24 2019-10-18 杨巧雪 It is a kind of can the AR new line display optical system that shows of normotopia outdoor scene
CN110347241B (en) * 2019-05-24 2022-06-28 深圳市锐思华创技术有限公司 An AR head-up display optical system capable of upright real scene display
CN112348876A (en) * 2019-08-08 2021-02-09 北京地平线机器人技术研发有限公司 Method and device for acquiring space coordinates of signboards
CN112348876B (en) * 2019-08-08 2024-06-11 北京地平线机器人技术研发有限公司 Space coordinate acquisition method and device for signboards
CN110544386A (en) * 2019-09-18 2019-12-06 奇瑞汽车股份有限公司 parking space identification method and device and storage medium
CN112037316A (en) * 2020-09-22 2020-12-04 北京百度网讯科技有限公司 Mapping generation method and device and road side equipment
CN112464737B (en) * 2020-11-04 2022-02-22 浙江预策科技有限公司 Road marking detection and identification method, electronic device and storage medium
CN112464737A (en) * 2020-11-04 2021-03-09 浙江预策科技有限公司 Road marking detection and identification method, electronic device and storage medium
CN112529097A (en) * 2020-12-23 2021-03-19 北京百度网讯科技有限公司 Sample image generation method and device and electronic equipment
CN112529097B (en) * 2020-12-23 2024-03-26 北京百度网讯科技有限公司 Sample image generation method and device and electronic equipment
CN113176182A (en) * 2021-04-29 2021-07-27 上海易清智觉自动化科技有限公司 Aggregate production line detection system and method

Similar Documents

Publication Publication Date Title
CN105224908A (en) A kind of roadmarking acquisition method based on orthogonal projection and device
JP6464337B2 (en) Traffic camera calibration update using scene analysis
CN107463918B (en) Lane line extraction method based on fusion of laser point cloud and image data
CN103218787B (en) Multi-source heterogeneous remote sensing image reference mark automatic acquiring method
CN101794448B (en) Full automatic calibration method of master-slave camera chain
CN103530626B (en) Automatic aerial view image correction method
CN109447945B (en) Quick counting method for basic wheat seedlings based on machine vision and graphic processing
WO2017080102A1 (en) Flying device, flying control system and method
CN101750051A (en) Visual navigation based multi-crop row detection method
CN104331686B (en) A kind of soil surface improving straw mulching rate human assistance identifying system
CN101558355A (en) Focus assist system and method
US20210192251A1 (en) Method and system for selecting image region that facilitates blur kernel estimation
CN104182757A (en) Method of acquiring actual coverage area of measured target and device
CN111724354B (en) Image processing-based method for measuring wheat ear length and wheat ear number of multiple wheat plants
CN108053416A (en) A kind of maximum oil reserve extraction system based on single width satellite image
CN113034583A (en) Vehicle parking distance measuring method and device based on deep learning and electronic equipment
EP2791865B1 (en) System and method for estimating target size
CN111243003A (en) Vehicle-mounted binocular camera and method and device for detecting road height limiting rod
CN117152210B (en) Image dynamic tracking method based on dynamic observation field of view and related device
CN110334583A (en) A kind of small area soil vegetation coverage measurement method, device and electronic equipment
CN113989253A (en) Method and device for acquiring information of farmland target object
CN117557616B (en) A method, device and equipment for determining the pitch angle and estimating the depth of a monocular camera
CN116403183A (en) Method and storage medium for measuring obstacle position
CN117152361A (en) A remote sensing image visibility estimation method based on attention mechanism
CN105989587B (en) Automatic calibration method of multifunctional OCT system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160106

RJ01 Rejection of invention patent application after publication