CN111824003A - A kind of control method and control system of vehicle lamp - Google Patents
A kind of control method and control system of vehicle lamp Download PDFInfo
- Publication number
- CN111824003A CN111824003A CN201910329294.5A CN201910329294A CN111824003A CN 111824003 A CN111824003 A CN 111824003A CN 201910329294 A CN201910329294 A CN 201910329294A CN 111824003 A CN111824003 A CN 111824003A
- Authority
- CN
- China
- Prior art keywords
- information
- target
- vehicle
- dynamic
- relative distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/02—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
- B60Q1/04—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
- B60Q1/06—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle
- B60Q1/076—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle by electrical means including means to transmit the movements, e.g. shafts or joints
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/02—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
- B60Q1/04—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
- B60Q1/06—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle
- B60Q1/08—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle automatically
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/02—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
- B60Q1/04—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
- B60Q1/14—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights having dimming means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/44—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating braking action or preparation for braking, e.g. by detection of the foot approaching the brake pedal
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Lighting Device Outwards From Vehicle And Optical Signal (AREA)
Abstract
本发明提供了一种车灯的控制方法及控制系统,该控制方法获取行驶车辆周围的图像信息,并对图像信息进行识别可以识别出在不同驾驶环境下存在的不同目标,如在交叉路口这一环境下,可以识别出包括红绿灯、相关交通标识的静态目标,在行驶道路上可以识别出当前行驶车辆前方存在的其他车辆、行人等动态目标,在交警指挥的道路上可以识别出交警,并按照识别出的目标信息对应的控制方式对车灯进行控制,实现了在不同驾驶环境下对车灯的不同控制,解决了现有对车灯的控制方法中不能适应多变的驾驶环境的问题。
The present invention provides a control method and control system for a vehicle lamp. The control method obtains image information around a driving vehicle, and recognizes the image information to identify different targets existing in different driving environments, such as at an intersection. In a single environment, static targets including traffic lights and related traffic signs can be identified, and dynamic targets such as other vehicles and pedestrians existing in front of the current vehicle can be identified on the driving road, and traffic police can be identified on the road under the command of the traffic police. The lights are controlled according to the control method corresponding to the identified target information, which realizes different control of the lights in different driving environments, and solves the problem that the existing control methods for the lights cannot adapt to the changing driving environment. .
Description
技术领域technical field
本发明属于智能控制技术领域,尤其涉及一种车灯的控制方法及控制系统。The invention belongs to the technical field of intelligent control, and in particular relates to a control method and a control system for a vehicle lamp.
背景技术Background technique
车辆行驶过程中,需要根据路况以及行驶状态控制车灯的开启和关闭。During the driving process of the vehicle, it is necessary to control the turning on and off of the lights according to the road conditions and the driving state.
现有技术中车灯的控制方法包括手动控制方式和自动控制方式。手动控制方式是根据驾驶员的需求控制车灯的开启和关闭;自动控制方式是基于光电传感器检测车辆行驶环境中的环境光线,根据环境光线的强弱控制车灯的开启和关闭。The control methods for vehicle lamps in the prior art include manual control methods and automatic control methods. The manual control mode is to control the opening and closing of the lights according to the driver's needs; the automatic control mode is to detect the ambient light in the driving environment of the vehicle based on the photoelectric sensor, and control the opening and closing of the lights according to the intensity of the ambient light.
手动控制车灯的方案中由于需要驾驶员操作,不仅导致驾驶员操作复杂,而且准确性低;自动控制车灯的方案中虽然可以自动实现对车灯的控制,但是仅能根据环境光线控制车灯的开启或关闭,功能场景单一,不能适应复杂多变的驾驶环境。In the scheme of manually controlling the lights, the driver is required to operate, which not only causes the driver to operate complicatedly, but also has low accuracy; in the scheme of automatically controlling the lights, although the control of the lights can be automatically realized, it can only control the car according to the ambient light. Turning on or off the lights has a single functional scene and cannot adapt to the complex and changeable driving environment.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本发明的目的在于提供一种车灯的控制方法及控制系统,以解决现有技术中对车灯的控制方案不能适应复杂多变的驾驶环境的问题。In view of this, the purpose of the present invention is to provide a control method and a control system for a vehicle lamp, so as to solve the problem that the control scheme for the vehicle lamp in the prior art cannot adapt to the complex and changeable driving environment.
技术方案如下:The technical solution is as follows:
本发明提供一种车灯的控制方法,包括:The present invention provides a control method for a vehicle lamp, comprising:
采集行驶车辆周围的图像信息;Collect image information around the driving vehicle;
识别所述图像信息,得到目标信息;所述目标信息包括以下至少一项:动态目标、静态目标、交警;Identify the image information to obtain target information; the target information includes at least one of the following: dynamic target, static target, and traffic police;
按照所述目标信息对应的控制方式,对车灯进行控制。The vehicle lights are controlled according to the control mode corresponding to the target information.
优选地,所述目标信息为动态目标,则所述按照所述目标信息对应的控制方式,对车灯进行控制包括:Preferably, the target information is a dynamic target, and the controlling the vehicle lights according to the control mode corresponding to the target information includes:
基于目标跟踪算法对所述动态目标进行跟踪,并计算当前时刻跟踪到的所述动态目标与该行驶车辆之间的相对距离信息;Track the dynamic target based on a target tracking algorithm, and calculate the relative distance information between the dynamic target tracked at the current moment and the traveling vehicle;
计算当前时刻与上一时刻之间的相对距离信息之差,以及当前时刻与上一时刻之间的时间差;Calculate the difference between the relative distance information between the current moment and the previous moment, and the time difference between the current moment and the previous moment;
根据两个时刻之间的时间差以及两个时刻之间的相对距离信息之差,计算得到该动态目标与该行驶车辆之间的相对速度信息;Calculate the relative speed information between the dynamic target and the traveling vehicle according to the time difference between the two moments and the difference between the relative distance information between the two moments;
判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息是否小于与所述相对速度信息匹配的刹车距离阈值;Judging whether the relative distance information between the dynamic target and the traveling vehicle at the current moment is less than the braking distance threshold matching the relative speed information;
若判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息小于与所述相对速度信息匹配的刹车距离阈值,则开启刹车灯。If it is determined that the relative distance information between the dynamic target and the traveling vehicle at the current moment is less than the braking distance threshold matched with the relative speed information, the brake light is turned on.
优选地,所述目标信息为静态目标,则所述按照所述目标信息对应的控制方式,对车灯进行控制包括:Preferably, if the target information is a static target, the controlling the vehicle lights according to the control mode corresponding to the target information includes:
计算所述静态目标与该行驶车辆之间的相对距离信息;Calculate the relative distance information between the static target and the moving vehicle;
判断所述静态目标与该行驶车辆之间的相对距离信息是否小于静态刹车距离阈值;Determine whether the relative distance information between the static target and the traveling vehicle is less than a static braking distance threshold;
若判断所述静态目标与该行驶车辆之间的相对距离信息小于静态刹车距离阈值,则开启刹车灯。If it is determined that the relative distance information between the static target and the traveling vehicle is less than the static braking distance threshold, the brake light is turned on.
优选地,所述目标信息为交警,则所述按照所述目标信息对应的控制方式,对车灯进行控制包括:Preferably, the target information is a traffic policeman, and the controlling the vehicle lights according to the control mode corresponding to the target information includes:
对交警的姿态进行估计,得到估计结果;Estimate the attitude of the traffic policeman, and get the estimation result;
从所述估计结果中提取交警的人体骨骼点;extracting the human skeleton points of the traffic policeman from the estimation result;
利用预先建立的时空图卷积网络对所述人体骨骼点进行处理后,得到交警姿态的语义信息;After processing the human skeleton points by using the pre-established spatiotemporal graph convolution network, the semantic information of the traffic police posture is obtained;
根据语义信息,对与所述语义信息匹配的车灯进行控制。According to the semantic information, the vehicle lights matching the semantic information are controlled.
优选地,还包括:Preferably, it also includes:
根据采集到的图像信息,判断行驶环境是否为夜晚环境;According to the collected image information, determine whether the driving environment is a night environment;
若判断为夜晚环境,则开启远光灯;If it is judged to be a night environment, turn on the high beam;
判断所述目标信息是否包括动态目标;judging whether the target information includes a dynamic target;
若判断所述目标信息包括动态目标,则判断动态目标与行驶车辆之间的相对距离信息是否小于切换距离阈值;If it is determined that the target information includes a dynamic target, then determine whether the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold;
若判断动态目标与行驶车辆之间的相对距离信息小于切换距离阈值,则若当前开启的为远光灯,则将远光灯切换为近光灯,若当前开启的为近光灯,则保持近光灯。If it is determined that the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold, if the high beam is currently turned on, the high beam will be switched to the low beam, and if the low beam is currently turned on, the Low beam lights.
优选地,在所述识别所述图像信息,得到目标信息之前,还包括:Preferably, before the identifying the image information and obtaining the target information, the method further includes:
对所述图像信息进行滤波处理,并对滤波处理后的图像信息进行直方图均衡化处理,得到均衡化处理后的图像信息。Filter processing is performed on the image information, and histogram equalization processing is performed on the filtered image information to obtain image information after equalization processing.
本发明还提供了一种车灯的控制系统,包括:The present invention also provides a control system for a vehicle lamp, comprising:
数据采集模块,用于采集行驶车辆周围的图像信息;The data acquisition module is used to collect image information around the driving vehicle;
机器视觉算法模块,用于识别所述图像信息,得到目标信息;所述目标信息包括以下至少一项:动态目标、静态目标、交警;并按照所述目标信息对应的控制方式,对车灯进行控制。A machine vision algorithm module for identifying the image information and obtaining target information; the target information includes at least one of the following: dynamic target, static target, and traffic police; control.
优选地,所述机器视觉算法模块包括:Preferably, the machine vision algorithm module includes:
距离计算单元,用于基于目标跟踪算法对所述动态目标进行跟踪,并计算当前时刻跟踪到的所述动态目标与该行驶车辆之间的相对距离信息;A distance calculation unit, configured to track the dynamic target based on a target tracking algorithm, and calculate the relative distance information between the dynamic target tracked at the current moment and the traveling vehicle;
速度计算单元,用于计算当前时刻与上一时刻之间的相对距离信息之差,以及当前时刻与上一时刻之间的时间差;根据两个时刻之间的时间差以及两个时刻之间的相对距离信息之差,计算得到该动态目标与该行驶车辆之间的相对速度信息;The speed calculation unit is used to calculate the difference between the relative distance information between the current moment and the previous moment, and the time difference between the current moment and the previous moment; according to the time difference between the two moments and the relative distance between the two moments The difference between the distance information is calculated to obtain the relative speed information between the dynamic target and the driving vehicle;
刹车判断单元,用于判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息是否小于与所述相对速度信息匹配的刹车距离阈值;a braking judgment unit, configured to judge whether the relative distance information between the dynamic target and the traveling vehicle at the current moment is less than a braking distance threshold matched with the relative speed information;
控制单元,用于若判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息小于与所述相对速度信息匹配的刹车距离阈值,则开启刹车灯。The control unit is configured to turn on the brake light if it is determined that the relative distance information between the dynamic target and the traveling vehicle at the current moment is less than the braking distance threshold matched with the relative speed information.
优选地,所述机器视觉算法模块还包括:Preferably, the machine vision algorithm module further includes:
环境判断单元,用于根据采集到的图像信息,判断行驶环境是否为夜晚环境;an environment judging unit, used for judging whether the driving environment is a night environment according to the collected image information;
目标判断单元,用于若判断为夜晚环境,则判断所述目标信息是否包括动态目标;a target judging unit, configured to judge whether the target information includes a dynamic target if it is judged to be a night environment;
切换判断单元,用于在判断所述目标信息包括动态目标时,判断动态目标与行驶车辆之间的相对距离信息是否小于切换距离阈值;a switching judgment unit, configured to judge whether the relative distance information between the dynamic target and the driving vehicle is less than a switching distance threshold when judging that the target information includes a dynamic target;
所述控制单元,用于在所述环境判断单元判断为夜晚环境时,开启远光灯;并在判断动态目标与行驶车辆之间的相对距离信息小于切换距离阈值时,若当前开启的为远光灯,则将远光灯切换为近光灯,若当前开启的为近光灯,则保持近光灯。The control unit is configured to turn on the high beams when the environment judgment unit judges that it is a night environment; and when judging that the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold, if the currently turned on is far If the high beam is switched to the low beam, if the low beam is currently turned on, keep the low beam.
优选地,还包括:Preferably, it also includes:
预处理模块,用于对所述图像信息进行滤波处理,并对滤波处理后的图像信息进行直方图均衡化处理,得到均衡化处理后的图像信息。The preprocessing module is used for filtering the image information, and performing histogram equalization processing on the filtered image information to obtain the equalized image information.
与现有技术相比,本发明提供的上述技术方案具有如下优点:Compared with the prior art, the above-mentioned technical solution provided by the present invention has the following advantages:
从上述技术方案可知,本申请中获取行驶车辆周围的图像信息,并对图像信息进行识别可以识别出在不同驾驶环境下存在的不同目标,如在交叉路口这一环境下,可以识别出包括红绿灯、相关交通标识的静态目标,在行驶道路上可以识别出当前行驶车辆前方存在的其他车辆、行人等动态目标,在交警指挥的道路上可以识别出交警,并按照确定出的目标信息对应的控制方式对车灯进行控制,实现了在不同驾驶环境下对车灯的不同控制,解决了现有对车灯的控制方法中不能适应多变的驾驶环境的问题。It can be seen from the above technical solutions that in the present application, the image information around the driving vehicle can be obtained, and the image information can be identified to identify different targets existing in different driving environments. , The static target of the relevant traffic signs, other dynamic targets such as other vehicles and pedestrians existing in front of the current driving vehicle can be identified on the driving road, and the traffic police can be identified on the road under the command of the traffic police, and control according to the determined target information. The vehicle lights are controlled by the method, different control of the vehicle lights in different driving environments is realized, and the problem that the existing control methods for the vehicle lights cannot be adapted to the changing driving environment is solved.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are For some embodiments of the present invention, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.
图1是本发明实施例提供的一种车灯的控制方法的流程图;1 is a flowchart of a method for controlling a vehicle lamp provided by an embodiment of the present invention;
图2是本发明实施例提供的在动态目标的场景下,对车灯的控制方法的流程图;2 is a flowchart of a method for controlling vehicle lights in a dynamic target scenario provided by an embodiment of the present invention;
图3是本发明实施例提供的在静态目标的场景下,对车灯的控制方法的流程图;3 is a flowchart of a method for controlling vehicle lights in a static target scenario provided by an embodiment of the present invention;
图4是本发明实施例提供的在存在交警的场景下,对车灯的控制方法的流程图;FIG. 4 is a flowchart of a method for controlling a vehicle lamp provided by an embodiment of the present invention in a scenario where a traffic police exists;
图5是本发明实施例提供的在夜晚场景下,对车灯的控制方法的流程图;5 is a flowchart of a method for controlling vehicle lights in a night scene provided by an embodiment of the present invention;
图6是本发明实施例提供的一种车灯的控制系统的结构示意图。FIG. 6 is a schematic structural diagram of a control system for a vehicle lamp provided by an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
本实施例公开了一种车灯的控制方法,应用于高级驾驶辅助系统(AdvancedDriver Assistance Systems,ADAS),参见图1所示,该实施例包括以下步骤:This embodiment discloses a method for controlling a vehicle lamp, which is applied to an advanced driver assistance system (Advanced Driver Assistance Systems, ADAS). Referring to FIG. 1 , this embodiment includes the following steps:
S101、采集行驶车辆周围的图像信息。S101. Collect image information around the traveling vehicle.
车辆行驶过程中,利用车载视觉传感器采集车辆周围的图像信息。During the driving process of the vehicle, the on-board visual sensor is used to collect image information around the vehicle.
本实施例中车载视觉传感器为ADAS系统上的ADAS前视相机,ADAS前视相机的探测距离远,能够获取距离当前行驶车辆较远距离的图像信息。In this embodiment, the vehicle-mounted visual sensor is an ADAS forward-looking camera on the ADAS system. The ADAS forward-looking camera has a long detection distance and can obtain image information farther away from the currently traveling vehicle.
在其他实施例中,除了利用ADAS前视相机获取车辆周围的图像信息外,同时采用车辆的360环视系统中的广角鱼眼相机获取车辆周围的图像信息。广角鱼眼相机的成像视角大,成像清晰,能够获取行驶车辆周围大范围内的图像信息。In other embodiments, in addition to using the ADAS forward-looking camera to obtain image information around the vehicle, the wide-angle fisheye camera in the 360 surround view system of the vehicle is also used to obtain image information around the vehicle. The wide-angle fisheye camera has a large imaging angle and clear imaging, and can obtain image information in a wide range around the driving vehicle.
S102、识别所述图像信息,得到目标信息;所述目标信息包括以下至少一项:动态目标、静态目标、交警。S102. Identify the image information to obtain target information; the target information includes at least one of the following: a dynamic target, a static target, and a traffic policeman.
采集到图像信息后,利用预先建立的视觉目标检测分类网络对图像信息进行识别,得到目标信息。其中,目标信息包括动态目标、静态目标、交警。After the image information is collected, the pre-established visual target detection and classification network is used to identify the image information to obtain target information. The target information includes dynamic targets, static targets, and traffic police.
将实际场景中的车辆以及行人分类为动态目标,将行驶道路上出现的红绿灯装置以及交通标识装置分类为静态目标,将行驶道路上出现的交警分类为交警。Vehicles and pedestrians in the actual scene are classified as dynamic targets, traffic light devices and traffic sign devices appearing on the driving road are classified as static targets, and traffic police appearing on the driving road are classified as traffic police.
示例性的,视觉目标检测分类网络是基于深度学习目标检测算法建立得到的,如YOLO V3目标检测算法,实现分类识别出图像信息中的动态目标、静态目标以及交警。Exemplarily, the visual target detection and classification network is established based on a deep learning target detection algorithm, such as the YOLO V3 target detection algorithm, to achieve classification and identification of dynamic targets, static targets and traffic police in image information.
S103、按照所述目标信息对应的控制方式,对车灯进行控制。S103: Control the vehicle lights according to the control mode corresponding to the target information.
目标信息分类为动态目标、静态目标以及交警,不同类别的目标对应的控制方式是不同的,如得到的目标信息为动态目标,则按照动态目标对应的控制方式对车灯进行控制。其中,车灯包括刹车灯、远光灯、近光灯、转向灯等。对车灯的控制包括开启、关闭以及切换。The target information is classified into dynamic target, static target and traffic police. The control methods corresponding to different types of targets are different. If the obtained target information is a dynamic target, the lights are controlled according to the control method corresponding to the dynamic target. Among them, the lights include brake lights, high beams, low beams, turn signals, etc. The control of the lights includes turning on, off and switching.
从上述技术方案可知,本实施例中获取行驶车辆周围的图像信息,并对图像信息进行识别可以识别出在不同驾驶环境下存在的不同目标,如在交叉路口这一环境下,可以识别出包括红绿灯、相关交通标识的静态目标,在行驶道路上可以识别出当前行驶车辆前方存在的其他车辆、行人等动态目标,在交警指挥的道路上可以识别出交警,并按照确定出的目标信息对应的控制方式对车灯进行控制,实现了在不同驾驶环境下对车灯的不同控制,解决了现有对车灯的控制方法中不能适应多变的驾驶环境的问题。It can be seen from the above technical solutions that in this embodiment, the image information around the driving vehicle is acquired, and the image information can be identified to identify different targets existing in different driving environments. The static targets of traffic lights and related traffic signs can identify dynamic targets such as other vehicles and pedestrians in front of the current driving vehicle on the driving road, and the traffic police can be identified on the road under the command of the traffic police. The control method controls the car lights, realizes different control of the car lights in different driving environments, and solves the problem that the existing control methods for the car lights cannot adapt to the changing driving environment.
下面详细描述在目标信息为动态目标、静态目标以及交警的情况下,对车灯的控制方法。The following describes in detail the control method for vehicle lights when the target information is a dynamic target, a static target and a traffic policeman.
在目标信息为动态目标的情况下,参见图2所示,采用步骤S201-S206实现对车灯的控制。In the case that the target information is a dynamic target, as shown in FIG. 2 , steps S201-S206 are used to realize the control of the vehicle lights.
S201、基于目标跟踪算法对所述动态目标进行跟踪,并确定跟踪到的所述动态目标与该行驶车辆之间的相对距离信息;S201, track the dynamic target based on a target tracking algorithm, and determine relative distance information between the tracked dynamic target and the traveling vehicle;
车辆行驶过程中,在行驶车辆前方存在其他行驶车辆或者行人时,在行驶车辆距离其他行驶车辆或行人一定距离时,需要启动刹车灯,以提醒驾驶员减速慢行,同时对该行驶车辆后方的行驶车辆起到预警作用,以避免出现紧急刹车导致的追尾问题发生。During the driving process of the vehicle, when there are other driving vehicles or pedestrians in front of the driving vehicle, when the driving vehicle is at a certain distance from other driving vehicles or pedestrians, the brake lights need to be turned on to remind the driver to slow down, and at the same time, the vehicle behind the driving vehicle needs to be activated. Driving vehicles play an early warning role to avoid rear-end collisions caused by emergency braking.
但是,该行驶车辆前方的车辆或者行人这类动态目标是移动的,动态目标自身具有移动速度,动态目标与行驶车辆之间的相对速度不同的情况下,需要启动刹车灯的距离是不同的。通常情况下,动态目标与行驶车辆之间的相对速度越大,动态目标与行驶车辆之间的相对距离较远时启动刹车灯;动态目标与行驶车辆之间的相对速度越小,动态目标与行驶车辆之间的相对距离可以稍微近一些时才启动刹车灯。However, dynamic objects such as vehicles or pedestrians in front of the moving vehicle are moving, and the dynamic objects themselves have moving speeds. When the relative speeds between the dynamic objects and the moving vehicle are different, the distances required to activate the brake lights are different. Under normal circumstances, the greater the relative speed between the dynamic target and the moving vehicle, the longer the relative distance between the dynamic target and the moving vehicle, the brake lights are activated; the smaller the relative speed between the dynamic target and the moving vehicle, the less the dynamic target and the moving vehicle are. The brake lights are activated only when the relative distance between the moving vehicles can be slightly closer.
为了追踪到动态目标并获得动态目标与行驶车辆之间的相对距离以及相对速度,本实施例在识别出图像信息中的目标为动态目标时,基于目标跟踪算法对动态目标进行跟踪,在一个时刻跟踪到动态目标后,确定在这一时刻动态目标与该行驶车辆之间的相对距离信息。In order to track the dynamic target and obtain the relative distance and relative speed between the dynamic target and the moving vehicle, in this embodiment, when the target in the image information is identified as the dynamic target, the dynamic target is tracked based on the target tracking algorithm. After the dynamic target is tracked, the relative distance information between the dynamic target and the driving vehicle at this moment is determined.
可选地,目标跟踪算法为KCF目标跟踪算法。Optionally, the target tracking algorithm is a KCF target tracking algorithm.
S202、计算当前时刻与上一时刻之间的相对距离信息之差,以及当前时刻与上一时刻之间的时间差;S202, calculating the difference between the relative distance information between the current moment and the previous moment, and the time difference between the current moment and the previous moment;
在不同时刻确定得到动态目标与该行驶车辆之间的相对距离信息后,计算当前时刻的相对距离信息与上一时刻的相对距离信息之差,以及当前时刻与上一时刻之间的时间差。After determining the relative distance information between the dynamic target and the driving vehicle at different times, calculate the difference between the relative distance information at the current moment and the relative distance information at the previous moment, and the time difference between the current moment and the previous moment.
如,当前时刻为1分30秒,确定动态目标与行驶车辆之间的相对距离信息为30米,上一时刻为1分20秒,确定动态目标与行驶车辆之间的相对距离信息为20米,则两个时刻之间的相对距离信息之差为10米,两个时刻之间的时间差为10秒。For example, if the current time is 1 minute and 30 seconds, the relative distance information between the dynamic target and the driving vehicle is determined to be 30 meters, and the previous moment is 1 minute and 20 seconds, and the relative distance information between the dynamic target and the driving vehicle is determined to be 20 meters. , then the difference between the relative distance information between the two moments is 10 meters, and the time difference between the two moments is 10 seconds.
S203、根据两个时刻之间的时间差以及两个时刻之间的相对距离信息之差,计算得到该动态目标与该行驶车辆之间的相对速度信息;S203, according to the time difference between the two moments and the difference between the relative distance information between the two moments, calculate and obtain the relative speed information between the dynamic target and the traveling vehicle;
基于速度与时间的乘积等于距离这一公式,根据两个时刻之间的时间差,以及两个时刻之间的相对距离信息之差,利用相对距离信息的差值除以时间差,得到该动态目标与该行驶车辆之间的相对速度信息。Based on the formula that the product of speed and time is equal to the distance, according to the time difference between the two moments and the difference between the relative distance information between the two moments, the difference between the relative distance information is divided by the time difference to obtain the dynamic target and Relative speed information between the traveling vehicles.
如步骤S202中,计算得到的两个时刻之间的相对距离信息之差为10米,两个时刻之间的时间差为10秒,那么,计算得到的动态目标与行驶车辆之间的相对速度信息为1米/秒。For example, in step S202, the difference between the calculated relative distance information between the two moments is 10 meters, and the time difference between the two moments is 10 seconds, then, the calculated relative speed information between the dynamic target and the driving vehicle is 1 m/s.
S204、判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息是否小于与所述相对速度信息匹配的刹车距离阈值;S204, judging whether the relative distance information between the dynamic target and the traveling vehicle at the current moment is less than the braking distance threshold matched with the relative speed information;
若判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息小于与所述相对速度信息匹配的刹车距离阈值,则执行步骤S205;If it is determined that the relative distance information between the dynamic target and the driving vehicle at the current moment is less than the braking distance threshold matched with the relative speed information, step S205 is executed;
若判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息大于或等于与所述相对速度信息匹配的刹车距离阈值,则返回执行步骤S201;If it is determined that the relative distance information between the dynamic target and the traveling vehicle at the current moment is greater than or equal to the braking distance threshold matched with the relative speed information, return to step S201;
预先存储相对速度信息与刹车距离阈值之间的对应关系。The correspondence between the relative speed information and the braking distance threshold is stored in advance.
计算得到动态目标与行驶车辆之间的相对距离信息以及相对速度信息后,在预先存储的对应关系中依据相对速度信息查找对应的刹车距离阈值,并在查找到对应的刹车距离阈值后,判断当前时刻动态目标与行驶车辆之间的相对距离信息是否小于该刹车距离阈值。After calculating the relative distance information and relative speed information between the dynamic target and the driving vehicle, find the corresponding braking distance threshold according to the relative speed information in the pre-stored correspondence, and after finding the corresponding braking distance threshold, determine the current Whether the relative distance information between the dynamic target and the moving vehicle is smaller than the braking distance threshold.
在判断当前时刻动态目标与行驶车辆之间的相对距离信息小于该刹车距离阈值,则说明动态目标距离行驶车辆比较近,需要开启刹车灯;在判断当前时刻动态目标与行驶车辆之间的相对距离信息大于或等于该刹车距离阈值,则说明动态目标距离该行驶车辆还有一定距离,返回执行步骤S201。When judging that the relative distance information between the dynamic target and the driving vehicle at the current moment is less than the braking distance threshold, it means that the dynamic target is relatively close to the driving vehicle and the brake lights need to be turned on; when judging the relative distance between the dynamic target and the driving vehicle at the current moment If the information is greater than or equal to the braking distance threshold, it means that the dynamic target still has a certain distance from the driving vehicle, and the process returns to step S201.
S205、开启刹车灯。S205. Turn on the brake light.
在车辆行驶至交叉路口附近时,交叉路口存在红绿灯标志,从而识别出静态目标。目标信息为静态目标时,对车灯的控制方法与动态目标时对车灯的控制方法类似,区别在于静态目标是静止的,其位置不发生变化,参见图3所示,采用步骤S301-S303实现对车灯的控制。When the vehicle is driving near the intersection, there are traffic light signs at the intersection, thereby recognizing static objects. When the target information is a static target, the control method for the lights is similar to the control method for the lights when the dynamic target is used. The difference is that the static target is static and its position does not change. Referring to Figure 3, steps S301-S303 are used. Realize the control of the lights.
S301、计算所述静态目标与该行驶车辆之间的相对距离信息;S301. Calculate relative distance information between the static target and the traveling vehicle;
S302、判断所述静态目标与该行驶车辆之间的相对距离信息是否小于静态刹车距离阈值;S302, judging whether the relative distance information between the static target and the traveling vehicle is less than a static braking distance threshold;
若判断所述相对位置信息小于静态刹车距离阈值,则说明行驶车辆距离静态目标已经很近了,执行步骤S303,以提醒驾驶员减速慢行,同时对该行驶车辆后方的行驶车辆起到预警作用,以避免出现紧急刹车导致的追尾问题发生;If it is judged that the relative position information is less than the static braking distance threshold, it means that the driving vehicle is already very close to the static target, and step S303 is executed to remind the driver to slow down and at the same time play a warning role for the driving vehicle behind the driving vehicle , to avoid rear-end problems caused by emergency braking;
若判断所述相对位置信息大于或等于静态刹车距离阈值,则说明行驶车辆距离静态目标还有一定距离,可以保持正常行驶状态,并返回执行步骤S301。If it is determined that the relative position information is greater than or equal to the static braking distance threshold, it means that the driving vehicle still has a certain distance from the static target, and the normal driving state can be maintained, and the process returns to step S301.
S303、开启刹车灯。S303. Turn on the brake light.
在存在交通干预的场景下,需要交警指挥交通,当识别出交警时,需要对交警的手势动作进行识别,并根据交警的手势动作进行相应的车灯控制。In the scene of traffic intervention, the traffic police need to direct the traffic. When the traffic police is identified, the gesture actions of the traffic police need to be recognized, and the corresponding lights are controlled according to the gesture actions of the traffic police.
参见图4所示,采用步骤S401-S404实现对车灯的控制。Referring to FIG. 4 , steps S401-S404 are used to realize the control of the vehicle lights.
S401、对交警的姿态进行估计,得到估计结果;S401 , estimating the posture of the traffic policeman to obtain an estimation result;
基于人体姿态估计算法,对交警的姿态进行估计。Based on the human body attitude estimation algorithm, the attitude of the traffic police is estimated.
可选地,本实施例中人体姿态估计算法为OpenPose姿态估计算法。Optionally, the human body pose estimation algorithm in this embodiment is the OpenPose pose estimation algorithm.
S402、从所述估计结果中提取交警的人体骨骼点;S402, extracting the human skeleton point of the traffic policeman from the estimation result;
S403、利用预先建立的时空图卷积网络对所述人体骨骼点进行处理后,得到交警姿态的语义信息;S403. After processing the human skeleton points by using a pre-established spatiotemporal graph convolution network, the semantic information of the traffic police posture is obtained;
本实施例中预先建立时空图卷积网络,所述时空图卷积网络用于对行为识别,如,基于ST-GCN行为识别算法建立时空图卷积网络。In this embodiment, a spatiotemporal graph convolution network is pre-established, and the spatiotemporal graph convolution network is used for behavior recognition, for example, a spatiotemporal graph convolution network is established based on the ST-GCN behavior recognition algorithm.
将提取到的人体骨骼点作为时空图卷积网络的输入,通过时空图卷积网络对输入的人体骨骼点的识别,输出识别出的行为,得到交警姿态的语义信息。The extracted human skeleton points are used as the input of the spatiotemporal graph convolutional network, and the inputted human skeleton points are recognized by the spatiotemporal graph convolutional network, and the recognized behaviors are output to obtain the semantic information of the traffic police posture.
本实施例中输出的语义信息包括停车、减速、左转、右转等。The semantic information output in this embodiment includes stop, decelerate, turn left, turn right, and the like.
S404、根据语义信息,对与所述语义信息匹配的车灯进行控制。S404. According to the semantic information, control the vehicle lights matching the semantic information.
语义信息为停车或减速,则开启刹车灯,以提醒驾驶员刹车或减速行驶,同时对后方车辆起到预警作用;If the semantic information is stop or decelerate, turn on the brake light to remind the driver to brake or decelerate, and at the same time act as a warning to the vehicles behind;
语义信息为左转,则开启左转灯,以提醒驾驶员左转,同时对后方车辆起到预警作用;If the semantic information is a left turn, turn on the left turn light to remind the driver to turn left, and at the same time play an early warning role for the vehicles behind;
语义信息为右转,则开启右转灯,以提醒驾驶员右转,同时对后方车辆起到预警作用。If the semantic information is a right turn, the right turn light will be turned on to remind the driver to turn right, and at the same time, it will serve as a warning to the vehicles behind.
上面详细介绍了动态目标场景、静态目标场景以及交警场景下,对车灯进行控制的方法,在实际应用中,当车辆行驶在光线较暗的环境中,如夜晚,除了合理利用刹车灯、转向灯外,还需要利用远光灯以及近光灯,针对光线较暗的场景,在上述公开的对车灯的控制方法的基础上,还包括:The above describes in detail the method of controlling the lights in the dynamic target scene, the static target scene and the traffic police scene. In addition to the lights, it is also necessary to use high beams and low beams. For scenes with low light, on the basis of the above disclosed control method for vehicle lights, it also includes:
S501、根据采集到的图像信息,判断行驶环境是否为夜晚环境;S501, according to the collected image information, determine whether the driving environment is a night environment;
若判断为夜晚环境,则执行步骤S502;If it is determined that it is a night environment, step S502 is executed;
若判断不为夜晚环境,则退出流程。If it is judged that it is not a night environment, exit the process.
在本实施例中,根据采集到的图像信息的灰度,判断行驶环境是否为夜晚环境。In this embodiment, it is determined whether the driving environment is a nighttime environment according to the grayscale of the collected image information.
S502、开启远光灯;S502, turn on the high beam;
在夜晚环境中,开启远光灯使得驾驶员可以观察行驶车辆周围大范围内的环境。但是,在行驶车辆对面存在其他车辆或者行人,开启远光灯将对其他车辆或行人产生影响,为了避免对其他车辆或行人产生影响,本实施例中采用步骤S503-S506,可以实现在识别出存在动态目标的情况下,自动控制远光灯与近光灯之间的切换,提高了行驶安全性。In the night environment, turning on the high beams allows the driver to observe the environment in a large area around the driving vehicle. However, there are other vehicles or pedestrians on the opposite side of the driving vehicle, and turning on the high beams will affect other vehicles or pedestrians. In order to avoid affecting other vehicles or pedestrians, steps S503-S506 are adopted in this embodiment to realize the recognition of When there is a dynamic target, the switching between high beam and low beam is automatically controlled, which improves driving safety.
本实施例中步骤S501-S502的执行顺序可以在步骤S101后的任意一个步骤前执行。步骤S503-S506的执行顺序可以在步骤S102后的任意一个步骤前执行。In this embodiment, the execution sequence of steps S501-S502 may be executed before any step after step S101. The execution sequence of steps S503-S506 may be executed before any step after step S102.
S503、判断所述目标信息是否包括动态目标;S503, determine whether the target information includes a dynamic target;
若判断所述目标信息包括动态目标,则执行步骤S504;If it is determined that the target information includes a dynamic target, step S504 is performed;
若判断所述目标信息不包括动态目标,则执行步骤S506;If it is determined that the target information does not include a dynamic target, step S506 is performed;
此处动态目标为车辆、行人等。The dynamic targets here are vehicles, pedestrians, etc.
S504、判断动态目标与行驶车辆之间的相对距离信息是否小于切换距离阈值;S504, judging whether the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold;
若判断动态目标与行驶车辆之间的相对距离信息小于切换距离阈值,则执行步骤S505;If it is determined that the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold, step S505 is executed;
若判断动态目标与行驶车辆之间的相对距离信息大于或等于切换距离阈值,则执行步骤S506;If it is determined that the relative distance information between the dynamic target and the driving vehicle is greater than or equal to the switching distance threshold, step S506 is executed;
S505、若当前开启的为远光灯,则将远光灯切换为近光灯,若当前开启的为近光灯,则保持近光灯,并返回执行步骤S503;S505, if the high beam is currently turned on, then the high beam is switched to the low beam; if the currently turned on is the low beam, the low beam is maintained, and the process returns to step S503;
在初始状态下,行驶车辆在夜晚环境中,开启远光灯。此种情况下,若动态目标与行驶车辆之间的相对距离信息小于切换距离阈值,则说明行驶车辆开启的远光灯对动态目标会产生影响,影响动态目标的视觉,执行将远光灯切换为近光灯的操作。In the initial state, the driving vehicle turns on the high beams in the night environment. In this case, if the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold, it means that the high beams turned on by the driving vehicle will affect the dynamic target and affect the vision of the dynamic target. For low beam operation.
在将远光灯切换为近光灯后,由于行驶车辆处于开启近光灯行驶的过程中,驾驶员的视野范围较小,因此存在将近光灯切换为远光灯的需求。After the high beam is switched to the low beam, since the driving vehicle is in the process of turning on the low beam, the driver's field of vision is small, so there is a need to switch the low beam to the high beam.
在本实施例中,切换为近光灯后,返回执行判断目标信息是否包括动态目标的步骤以及其后续步骤。In this embodiment, after switching to the low beam, the step of judging whether the target information includes a dynamic target and the subsequent steps are returned to.
通过执行判断目标信息是否包括动态目标的步骤,可以确定行驶车辆对面是否还存在动态目标。若判断目标信息包括动态目标,则执行判断该动态目标与行驶车辆之间的相对距离信息是否小于切换距离阈值的操作。By executing the step of judging whether the target information includes a dynamic target, it can be determined whether there is a dynamic target on the opposite side of the driving vehicle. If it is judged that the target information includes a dynamic target, an operation of judging whether the relative distance information between the dynamic target and the traveling vehicle is smaller than the switching distance threshold is performed.
若该动态目标与行驶车辆之间的相对距离信息小于切换距离阈值,由于当前车辆开启的为近光灯,则保持近光灯开启;If the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold, since the current vehicle is turning on the low beam headlights, keep the low beam headlights turned on;
若该动态目标与行驶车辆之间的相对距离信息大于或等于切换距离阈值,则说明动态目标距离行驶车辆有一定的距离,因此,可以开启远光灯,因此执行由近光灯切换远光灯的操作。If the relative distance information between the dynamic target and the driving vehicle is greater than or equal to the switching distance threshold, it means that the dynamic target is at a certain distance from the driving vehicle. Therefore, the high beams can be turned on, so switching from low beams to high beams is performed. operation.
S506、若当前开启的为远光灯,保持远光灯,若当前开启的为近光灯,将近光灯切换为远光灯。S506 , if the high beam is currently turned on, keep the high beam, and if the currently turned on is low beam, switch the low beam to the high beam.
从上述技术方案可知,本实施例中获取行驶车辆周围的图像信息,并对图像信息进行识别可以识别出在不同驾驶环境下存在的不同目标,如在行驶道路上可以识别出当前行驶车辆前方存在的其他车辆、行人等动态目标,则根据动态目标与当前行驶车辆之间的相对距离以及相对速度,在一定相对速度下动态目标与当前行驶车辆之间的相对距离小于刹车距离阈值时,开启刹车灯;在交叉路口这一环境下,可以识别出包括红绿灯、相关交通标识的静态目标,则在当前行驶车辆与静态目标之间的距离小于静态刹车距离阈值时,开启刹车灯;在交警指挥的道路上可以识别出交警,则对交警的姿态进行识别以确定出交警姿态的语义信息是停车、减速、左转还是右转,并根据不同的语义信息,对与所述语义信息匹配的车灯进行控制;同时,还可以根据图像信息识别出是否为夜晚,若为夜晚则在识别出目标信息的基础上,还需要根据目标信息对远光灯以及近光灯进行切换控制。可见,本实施例中实现了在不同驾驶环境下对车灯的不同控制,解决了现有对车灯的控制方法中不能适应多变的驾驶环境的问题。It can be seen from the above technical solutions that in this embodiment, the image information around the driving vehicle can be obtained, and the image information can be identified to identify different targets existing in different driving environments. other vehicles, pedestrians and other dynamic targets, according to the relative distance and relative speed between the dynamic target and the current driving vehicle, when the relative distance between the dynamic target and the current driving vehicle is less than the braking distance threshold at a certain relative speed, turn on the brake In the environment of an intersection, static targets including traffic lights and relevant traffic signs can be identified, then when the distance between the current driving vehicle and the static target is less than the static braking distance threshold, the brake light is turned on; The traffic police can be identified on the road, then the posture of the traffic police is recognized to determine whether the semantic information of the traffic police posture is to stop, slow down, turn left or turn right, and according to different semantic information, the lights that match the semantic information are determined. At the same time, it can also identify whether it is night according to the image information. If it is night, on the basis of identifying the target information, it is also necessary to switch control between the high beam and the low beam according to the target information. It can be seen that the present embodiment realizes different control of the vehicle lights under different driving environments, and solves the problem that the existing control methods for the vehicle lights cannot adapt to the changing driving environment.
在其他实施例中,在对采集到的图像信息进行识别之前,还可以包括预处理操作;In other embodiments, before identifying the collected image information, a preprocessing operation may also be included;
预处理操作包括对图像信息进行滤波处理,滤波处理为利用中值滤波对图形信息进行滤波,以对图像噪声进行抑制;然后对滤波处理后的图像信息进行直方图均衡化处理,得到预处理后的图像信息。后续对预处理后的图像信息进行识别。The preprocessing operation includes filtering the image information, and the filtering process is to use median filtering to filter the graphic information to suppress image noise; and then perform histogram equalization processing on the filtered image information to obtain a image information. Subsequently, the preprocessed image information is identified.
对应上述车灯的控制方法,本实施例还提供了一种车灯的控制系统,参见图6所示,该车灯的控制系统包括:Corresponding to the above-mentioned control method for a vehicle lamp, the present embodiment also provides a control system for a vehicle lamp. Referring to FIG. 6 , the control system for the vehicle lamp includes:
数据采集模块601和机器视觉算法模块602;
数据采集模块601,用于采集行驶车辆周围的图像信息;a
机器视觉算法模块602,用于识别所述图像信息,得到目标信息;所述目标信息包括以下至少一项:动态目标、静态目标、交警;并按照所述目标信息对应的控制方式,对车灯进行控制。The machine
从上述技术方案可知,本实施例中获取行驶车辆周围的图像信息,并对图像信息进行识别可以识别出在不同驾驶环境下存在的不同目标,如在交叉路口这一环境下,可以识别出包括红绿灯、相关交通标识的静态目标,在行驶道路上可以识别出当前行驶车辆前方存在的其他车辆、行人等动态目标,在交警指挥的道路上可以识别出交警,并按照确定出的目标信息对应的控制方式对车灯进行控制,实现了在不同驾驶环境下对车灯的不同控制,解决了现有对车灯的控制方法中不能适应多变的驾驶环境的问题。It can be seen from the above technical solutions that in this embodiment, the image information around the driving vehicle is acquired, and the image information can be identified to identify different targets existing in different driving environments. The static targets of traffic lights and related traffic signs can identify dynamic targets such as other vehicles and pedestrians in front of the current driving vehicle on the driving road, and the traffic police can be identified on the road under the command of the traffic police. The control method controls the car lights, realizes different control of the car lights in different driving environments, and solves the problem that the existing control methods for the car lights cannot adapt to the changing driving environment.
在其他实施例中,机器视觉算法模块602包括:In other embodiments, the machine
距离计算单元、速度计算单元、刹车判断单元和控制单元;Distance calculation unit, speed calculation unit, brake judgment unit and control unit;
所述距离计算单元,用于基于目标跟踪算法对所述动态目标进行跟踪,并计算当前时刻跟踪到的所述动态目标与该行驶车辆之间的相对距离信息;The distance calculation unit is configured to track the dynamic target based on a target tracking algorithm, and calculate the relative distance information between the dynamic target tracked at the current moment and the traveling vehicle;
所述速度计算单元,用于计算当前时刻与上一时刻之间的相对距离信息之差,以及当前时刻与上一时刻之间的时间差;根据两个时刻之间的时间差以及两个时刻之间的相对距离信息之差,计算得到该动态目标与该行驶车辆之间的相对速度信息;The speed calculation unit is used to calculate the difference between the relative distance information between the current moment and the previous moment, and the time difference between the current moment and the previous moment; according to the time difference between the two moments and the time difference between the two moments The difference between the relative distance information of , calculates the relative speed information between the dynamic target and the driving vehicle;
所述刹车判断单元,用于判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息是否小于与所述相对速度信息匹配的刹车距离阈值;The braking judgment unit is used for judging whether the relative distance information between the dynamic target and the traveling vehicle at the current moment is less than the braking distance threshold matched with the relative speed information;
所述控制单元,用于若判断当前时刻所述动态目标与该行驶车辆之间的相对距离信息小于与所述相对速度信息匹配的刹车距离阈值,则开启刹车灯。The control unit is configured to turn on the brake light if it is determined that the relative distance information between the dynamic target and the traveling vehicle at the current moment is less than the braking distance threshold matched with the relative speed information.
可选地,所述距离计算单元,还用于计算所述静态目标与该行驶车辆之间的相对距离信息;Optionally, the distance calculation unit is further configured to calculate relative distance information between the static target and the traveling vehicle;
所述刹车判断单元,还用于判断所述静态目标与该行驶车辆之间的相对距离信息是否小于静态刹车距离阈值;The braking determination unit is further configured to determine whether the relative distance information between the static target and the traveling vehicle is less than a static braking distance threshold;
所述控制单元,还用于若判断所述静态目标与该行驶车辆之间的相对距离信息小于静态刹车距离阈值,则开启刹车灯。The control unit is further configured to turn on the brake light if it is determined that the relative distance information between the static target and the traveling vehicle is less than the static braking distance threshold.
在其他实施例中,机器视觉算法模块602还包括:In other embodiments, the machine
环境判断单元、目标判断单元和切换判断单元;an environment judgment unit, a target judgment unit and a switch judgment unit;
所述环境判断单元,用于根据采集到的图像信息,判断行驶环境是否为夜晚环境;The environment judging unit is used for judging whether the driving environment is a night environment according to the collected image information;
所述目标判断单元,用于若判断为夜晚环境,则判断所述目标信息是否包括动态目标;the target judging unit, configured to judge whether the target information includes a dynamic target if it is judged to be a night environment;
所述切换判断单元,用于在判断所述目标信息包括动态目标时,判断动态目标与行驶车辆之间的相对距离信息是否小于切换距离阈值;The switching judgment unit is configured to judge whether the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold when judging that the target information includes a dynamic target;
所述控制单元,用于在所述环境判断单元判断为夜晚环境时,开启远光灯;并在判断动态目标与行驶车辆之间的相对距离信息小于切换距离阈值时,若当前开启的为远光灯,则将远光灯切换为近光灯,若当前开启的为近光灯,则保持近光灯。The control unit is configured to turn on the high beams when the environment judgment unit judges that it is a night environment; and when judging that the relative distance information between the dynamic target and the driving vehicle is less than the switching distance threshold, if the currently turned on is far If the high beam is switched to the low beam, if the low beam is currently turned on, keep the low beam.
在其他实施例中,机器视觉算法模块602包括:In other embodiments, the machine
姿态估计单元、提取单元和处理单元;Attitude estimation unit, extraction unit and processing unit;
所述姿态估计单元,用于对交警的姿态进行估计,得到估计结果;The attitude estimation unit is used for estimating the attitude of the traffic policeman to obtain an estimation result;
所述提取单元,用于从所述估计结果中提取交警的人体骨骼点;the extraction unit, used for extracting the human skeleton points of the traffic policeman from the estimation result;
所述处理单元,用于利用预先建立的时空图卷积网络对所述人体骨骼点进行处理后,得到交警姿态的语义信息;The processing unit is configured to obtain semantic information of the traffic police posture after processing the human skeleton points by using a pre-established spatiotemporal graph convolutional network;
所述控制单元,还用于根据语义信息,对与所述语义信息匹配的车灯进行控制。The control unit is further configured to control the vehicle lights matching the semantic information according to the semantic information.
在其他实施例中,控制系统在数据采集模块601和机器视觉算法模块602的基础上,还包括:In other embodiments, on the basis of the
预处理模块603;preprocessing
预处理模块603,用于对所述图像信息进行滤波处理,并对滤波处理后的图像信息进行直方图均衡化处理,得到均衡化处理后的图像信息。The
从上述技术方案可知,本实施例中获取行驶车辆周围的图像信息,并对图像信息进行识别可以识别出在不同驾驶环境下存在的不同目标,如在行驶道路上可以识别出当前行驶车辆前方存在的其他车辆、行人等动态目标,则根据动态目标与当前行驶车辆之间的相对距离以及相对速度,在一定相对速度下动态目标与当前行驶车辆之间的相对距离小于刹车距离阈值时,开启刹车灯;在交叉路口这一环境下,可以识别出包括红绿灯、相关交通标识的静态目标,则在当前行驶车辆与静态目标之间的距离小于静态刹车距离阈值时,开启刹车灯;在交警指挥的道路上可以识别出交警,则对交警的姿态进行识别以确定出交警姿态的语义信息是停车、减速、左转还是右转,并根据不同的语义信息,对与所述语义信息匹配的车灯进行控制;同时,还可以根据图像信息识别出是否为夜晚,若为夜晚则在识别出目标信息的基础上,还需要根据目标信息对远光灯以及近光灯进行切换控制。可见,本实施例中实现了在不同驾驶环境下对车灯的不同控制,解决了现有对车灯的控制方法中不能适应多变的驾驶环境的问题。It can be seen from the above technical solutions that in this embodiment, the image information around the driving vehicle can be obtained, and the image information can be identified to identify different targets existing in different driving environments. other vehicles, pedestrians and other dynamic targets, according to the relative distance and relative speed between the dynamic target and the current driving vehicle, when the relative distance between the dynamic target and the current driving vehicle is less than the braking distance threshold at a certain relative speed, turn on the brake In the environment of an intersection, static targets including traffic lights and relevant traffic signs can be identified, then when the distance between the current driving vehicle and the static target is less than the static braking distance threshold, the brake light is turned on; The traffic police can be identified on the road, then the posture of the traffic police is recognized to determine whether the semantic information of the traffic police posture is to stop, slow down, turn left or turn right, and according to different semantic information, the lights that match the semantic information are determined. At the same time, it can also identify whether it is night according to the image information. If it is night, on the basis of identifying the target information, it is also necessary to switch control between the high beam and the low beam according to the target information. It can be seen that the present embodiment realizes different control of the vehicle lights under different driving environments, and solves the problem that the existing control methods for the vehicle lights cannot adapt to the changing driving environment.
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例提供的装置而言,由于其与实施例提供的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. As for the apparatus provided in the embodiment, since it corresponds to the method provided in the embodiment, the description is relatively simple, and for related parts, please refer to the description in the method section.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
对所公开的实施例的上述说明,使本领域技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments enables any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
以上所述仅是本发明的优选实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本发明的保护范围。The above are only the preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, without departing from the principles of the present invention, several improvements and modifications can be made. It should be regarded as the protection scope of the present invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910329294.5A CN111824003A (en) | 2019-04-23 | 2019-04-23 | A kind of control method and control system of vehicle lamp |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910329294.5A CN111824003A (en) | 2019-04-23 | 2019-04-23 | A kind of control method and control system of vehicle lamp |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111824003A true CN111824003A (en) | 2020-10-27 |
Family
ID=72912613
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910329294.5A Pending CN111824003A (en) | 2019-04-23 | 2019-04-23 | A kind of control method and control system of vehicle lamp |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111824003A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113581059A (en) * | 2021-06-30 | 2021-11-02 | 上海商汤临港智能科技有限公司 | Light adjusting method and related device |
| CN114212023A (en) * | 2021-12-15 | 2022-03-22 | 深圳云天励飞技术股份有限公司 | Vehicle lamp control method and device |
| CN114670744A (en) * | 2022-04-22 | 2022-06-28 | 中国第一汽车股份有限公司 | Vehicle lamp control method, vehicle lamp control device and vehicle |
| CN115402188A (en) * | 2022-09-15 | 2022-11-29 | 长城汽车股份有限公司 | Vehicle control method, vehicle control device, vehicle and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201130020Y (en) * | 2007-12-18 | 2008-10-08 | 烟台麦特电子有限公司 | Automobile rear end collision preventing device based on vision analysis |
| JP2008299666A (en) * | 2007-05-31 | 2008-12-11 | Sumitomo Electric Ind Ltd | Vehicle driving support system, driving support device, vehicle, and vehicle driving support method |
| CN107826031A (en) * | 2017-10-10 | 2018-03-23 | 南京金龙新能源汽车研究院有限公司 | One kind meets at night, and far and near lamp pass is automatic to replace control method |
| CN109017786A (en) * | 2018-08-09 | 2018-12-18 | 北京智行者科技有限公司 | Vehicle obstacle-avoidance method |
| CN109389838A (en) * | 2018-11-26 | 2019-02-26 | 爱驰汽车有限公司 | Unmanned crossing paths planning method, system, equipment and storage medium |
-
2019
- 2019-04-23 CN CN201910329294.5A patent/CN111824003A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008299666A (en) * | 2007-05-31 | 2008-12-11 | Sumitomo Electric Ind Ltd | Vehicle driving support system, driving support device, vehicle, and vehicle driving support method |
| CN201130020Y (en) * | 2007-12-18 | 2008-10-08 | 烟台麦特电子有限公司 | Automobile rear end collision preventing device based on vision analysis |
| CN107826031A (en) * | 2017-10-10 | 2018-03-23 | 南京金龙新能源汽车研究院有限公司 | One kind meets at night, and far and near lamp pass is automatic to replace control method |
| CN109017786A (en) * | 2018-08-09 | 2018-12-18 | 北京智行者科技有限公司 | Vehicle obstacle-avoidance method |
| CN109389838A (en) * | 2018-11-26 | 2019-02-26 | 爱驰汽车有限公司 | Unmanned crossing paths planning method, system, equipment and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113581059A (en) * | 2021-06-30 | 2021-11-02 | 上海商汤临港智能科技有限公司 | Light adjusting method and related device |
| CN114212023A (en) * | 2021-12-15 | 2022-03-22 | 深圳云天励飞技术股份有限公司 | Vehicle lamp control method and device |
| CN114212023B (en) * | 2021-12-15 | 2023-11-17 | 深圳云天励飞技术股份有限公司 | Car lamp control method and device |
| CN114670744A (en) * | 2022-04-22 | 2022-06-28 | 中国第一汽车股份有限公司 | Vehicle lamp control method, vehicle lamp control device and vehicle |
| CN115402188A (en) * | 2022-09-15 | 2022-11-29 | 长城汽车股份有限公司 | Vehicle control method, vehicle control device, vehicle and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109033951B (en) | System and method for detecting occluding objects based on graphics processing | |
| KR102869076B1 (en) | Apparatus for controlling lane change of autonomous vehicle and method thereof | |
| US10818172B2 (en) | Method, device and system for processing startup of preceding vehicle | |
| US8995723B2 (en) | Detecting and recognizing traffic signs | |
| CN107972569B (en) | Vehicle lamp set control method, device and system and vehicle | |
| CN104700114A (en) | Method and device for recognizing pedestrian and vehicle supporting the same | |
| CN111824003A (en) | A kind of control method and control system of vehicle lamp | |
| CN110682907B (en) | Automobile rear-end collision prevention control system and method | |
| WO2005036371A2 (en) | Moving object detection using low illumination depth capable computer vision | |
| CN108460968A (en) | A kind of method and device obtaining traffic information based on car networking | |
| CN109703460A (en) | Multi-camera complex scene adaptive vehicle collision early warning device and early warning method | |
| CN113920782B (en) | Multi-sensor fusion method applied to parking space detection | |
| US20220410931A1 (en) | Situational awareness in a vehicle | |
| JP2014013454A (en) | In-vehicle environment recognition apparatus | |
| CN111879360A (en) | Automatic driving auxiliary safety early warning system in dark scene and early warning method thereof | |
| CN116034359A (en) | Method for environment detection with at least two mutually independent imaging environment detection sensors, device for performing the method, vehicle and correspondingly designed computer program | |
| WO2022244356A1 (en) | Light interference detection during vehicle navigation | |
| Yoneda et al. | Convolutional neural network based vehicle turn signal recognition | |
| CN109878445A (en) | A binocular vision assisted driving system | |
| Chougule et al. | IoT based smart car monitoring system | |
| CN110316046A (en) | Headlight for vehicles intelligently switches far and near photosystem and switching method | |
| CN114179793A (en) | Method and device for improving the rear traffic of a vehicle | |
| CN113870246A (en) | Obstacle detection and identification method based on deep learning | |
| CN105741558B (en) | Under overnight sight front vehicles are carried out with the detection method of dual tracking | |
| EP3287940A1 (en) | Intersection detection system for a vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201027 |
|
| RJ01 | Rejection of invention patent application after publication |