CN118082815A - Obstacle avoidance processing method and device for vehicle, vehicle and storage medium - Google Patents
Obstacle avoidance processing method and device for vehicle, vehicle and storage medium Download PDFInfo
- Publication number
- CN118082815A CN118082815A CN202410425195.8A CN202410425195A CN118082815A CN 118082815 A CN118082815 A CN 118082815A CN 202410425195 A CN202410425195 A CN 202410425195A CN 118082815 A CN118082815 A CN 118082815A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- lane
- obstacle
- driving
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/09—Taking automatic action to avoid collision, e.g. braking and steering
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/0098—Details of control systems ensuring comfort, safety or stability not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W60/00—Drive control systems specially adapted for autonomous road vehicles
- B60W60/001—Planning or execution of driving tasks
- B60W60/0015—Planning or execution of driving tasks specially adapted for safety
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
- B60W2552/50—Barriers
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
技术领域Technical Field
本申请涉及自动驾驶技术领域,尤其涉及一种车辆的避障处理方法、装置、车辆及存储介质。The present application relates to the field of autonomous driving technology, and in particular to a vehicle obstacle avoidance method, device, vehicle and storage medium.
背景技术Background technique
具备自动驾驶功能的车辆在行驶过程中,若前方出现障碍物,车辆需要能够识别到障碍物,并执行规避障碍物的驾驶决策。相关技术中,尤其是针对静态障碍物,例如车道上摆放有路障时,车辆的驾驶决策的生成,需要感知模块、融合模块以及规划模块的协同处理。其中,感知模块识别出障碍物和车道线,融合模块通过进行三维地图重建,确认障碍物在车道中的位置,规划模块根据障碍物的位置和危险程度来选择相应的避障策略。When a vehicle with an autonomous driving function is driving, if there is an obstacle in front of it, the vehicle needs to be able to identify the obstacle and make driving decisions to avoid it. In related technologies, especially for static obstacles, such as roadblocks placed on the lane, the generation of vehicle driving decisions requires the coordinated processing of the perception module, fusion module, and planning module. Among them, the perception module identifies obstacles and lane lines, the fusion module confirms the position of the obstacle in the lane by reconstructing the three-dimensional map, and the planning module selects the corresponding obstacle avoidance strategy according to the location and degree of danger of the obstacle.
然而,由于“感知-融合-规划”多模块协同运作的技术方案,需要处理不同来源的信息,使得整个技术方案的实现方式复杂,系统延时高;另外对远距离的障碍物作三维重建,存在构建不准确的问题,继而难以保障避障策略的可靠性和完备性。However, the technical solution of the "perception-fusion-planning" multi-module collaborative operation needs to process information from different sources, making the implementation of the entire technical solution complicated and the system latency high. In addition, the three-dimensional reconstruction of distant obstacles has the problem of inaccurate construction, which makes it difficult to ensure the reliability and completeness of the obstacle avoidance strategy.
发明内容Summary of the invention
为解决或部分解决相关技术中存在的问题,本申请提供一种车辆的避障处理方法、装置、车辆及存储介质,能够高效生成驾驶决策信息,降低系统响应时间,增强避障策略的可靠性和降低漏触发误触发几率。In order to solve or partially solve the problems existing in the related technology, the present application provides a vehicle obstacle avoidance processing method, device, vehicle and storage medium, which can efficiently generate driving decision information, reduce system response time, enhance the reliability of obstacle avoidance strategy and reduce the probability of missed triggering and false triggering.
本申请第一方面提供一种车辆的避障处理方法,包括:The first aspect of the present application provides a vehicle obstacle avoidance processing method, comprising:
接收车辆在行驶方向上的行驶场景图像,所述行驶场景图像至少包括自车车道;Receiving a driving scene image of the vehicle in a driving direction, wherein the driving scene image at least includes a lane of the vehicle;
根据预设分类模型对所述自车车道上的路况信息进行分类,获得对应的驾驶决策信息;其中,所述路况信息包括:自车车道存在非常规障碍物、自车车道存在预设障碍物或自车车道没有障碍物。The road condition information on the own vehicle lane is classified according to a preset classification model to obtain corresponding driving decision information; wherein the road condition information includes: the existence of unconventional obstacles in the own vehicle lane, the existence of preset obstacles in the own vehicle lane, or the absence of obstacles in the own vehicle lane.
一些实施方式中,所述驾驶决策信息包括变道、刹车或者保持行驶,其中:In some embodiments, the driving decision information includes changing lanes, braking, or maintaining driving, wherein:
若所述路况信息为自车车道存在非常规障碍物,则所述驾驶决策信息为刹车;If the road condition information indicates that there is an unconventional obstacle in the lane of the vehicle, the driving decision information is braking;
若所述路况信息为自车车道存在预设障碍物,则所述驾驶决策信息为变道;If the road condition information indicates that there is a preset obstacle in the lane of the vehicle, then the driving decision information is changing lanes;
若所述路况信息为自车车道没有障碍物,则所述驾驶决策信息为保持行驶。If the road condition information indicates that there is no obstacle in the vehicle lane, the driving decision information is to keep driving.
一些实施方式中,所述预设障碍物为静态障碍物;In some embodiments, the preset obstacle is a static obstacle;
所述若所述路况信息为自车车道存在预设障碍物,则所述驾驶决策信息为变道,包括:If the road condition information indicates that there is a preset obstacle in the lane of the vehicle, then the driving decision information is lane change, including:
若所述路况信息为自车车道存在预设障碍物,根据所述预设障碍物的摆放位置,所述驾驶决策信息为向左变道或向右变道。If the road condition information indicates that there is a preset obstacle in the vehicle's lane, the driving decision information is to change lanes to the left or to the right according to the placement of the preset obstacle.
一些实施方式中,所述预设分类模型的训练方法包括:In some implementations, the training method of the preset classification model includes:
根据采集的训练图像及对应的决策标签,构建训练数据;其中,根据每帧所述训练图像中的路况信息标注对应的决策标签;Constructing training data based on the collected training images and the corresponding decision labels; wherein the corresponding decision labels are annotated according to the road condition information in each frame of the training image;
利用所述训练数据,训练所述预设分类模型,获得训练后的预设分类模型。The training data is used to train the preset classification model to obtain a trained preset classification model.
一些实施方式中,所述训练图像包括:实景图像和/或仿真图像;In some implementations, the training images include: real scene images and/or simulated images;
其中,所述实景图像为包含预设障碍物或常规障碍物的场景图像;所述仿真图像为包含非常规障碍物的场景图像。The real scene image is a scene image containing preset obstacles or conventional obstacles; and the simulation image is a scene image containing unconventional obstacles.
一些实施方式中,所述行驶场景图像还包括相邻车道;In some implementations, the driving scene image also includes adjacent lanes;
若所述路况信息为相邻车道存在障碍物,所述驾驶决策信息包括车道左侧有侵入或车道右侧有侵入。If the road condition information indicates that there is an obstacle in an adjacent lane, the driving decision information includes an intrusion on the left side of the lane or an intrusion on the right side of the lane.
一些实施方式中,所述方法还包括:将所述驾驶决策信息发送至预设规划模块处理,以供输出路径规划信息。In some implementations, the method further includes: sending the driving decision information to a preset planning module for processing to output path planning information.
本申请第二方面提供一种车辆的避障处理装置,其包括:A second aspect of the present application provides a vehicle obstacle avoidance processing device, comprising:
图像接收模块,用于接收车辆在行驶方向上的行驶场景图像,所述行驶场景图像至少包括自车车道;An image receiving module, used for receiving a driving scene image of the vehicle in the driving direction, wherein the driving scene image at least includes a lane of the vehicle;
分类决策模块,用于根据预设分类模型对所述自车车道上的路况信息进行分类,获得对应的驾驶决策信息;其中,所述路况信息包括:自车车道存在非常规障碍物、自车车道存在预设障碍物或自车车道没有障碍物。The classification decision module is used to classify the road condition information on the vehicle lane according to a preset classification model to obtain corresponding driving decision information; wherein the road condition information includes: the presence of unconventional obstacles in the vehicle lane, the presence of preset obstacles in the vehicle lane, or the absence of obstacles in the vehicle lane.
本申请第三方面提供一种车辆,包括:A third aspect of the present application provides a vehicle, comprising:
处理器;以及Processor; and
存储器,其上存储有可执行代码,当所述可执行代码被所述处理器执行时,使所述处理器执行如上所述的方法。The memory stores executable codes thereon, and when the executable codes are executed by the processor, the processor is caused to execute the method as described above.
本申请第四方面提供一种计算机可读存储介质,其上存储有可执行代码,当所述可执行代码被车辆的处理器执行时,使所述处理器执行如上所述的方法。A fourth aspect of the present application provides a computer-readable storage medium having executable code stored thereon. When the executable code is executed by a processor of a vehicle, the processor is caused to execute the method as described above.
本申请提供的技术方案可以包括以下有益效果:The technical solution provided by this application may have the following beneficial effects:
本申请的车辆的避障处理方法,基于实时采集的行驶场景图像,对车辆自车车道所在的行驶方向上的路况信息进行分类,针对不同类型的路况信息,尤其是存在预设障碍物,快速且准确无漏地输出对应的驾驶决策信息,使自动驾驶的车辆可以基于更短的响应时间进行避障,提高处理效率,确保安全行驶。The vehicle obstacle avoidance processing method of the present application classifies the road condition information in the driving direction of the vehicle's own lane based on the real-time collected driving scene images, and outputs the corresponding driving decision information quickly and accurately without omissions for different types of road condition information, especially the presence of preset obstacles, so that the autonomous driving vehicle can avoid obstacles based on a shorter response time, improve processing efficiency, and ensure safe driving.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
通过结合附图对本申请示例性实施方式进行更详细地描述,本申请的上述以及其它目的、特征和优势将变得更加明显,其中,在本申请示例性实施方式中,相同的参考标号通常代表相同部件。The above and other objects, features and advantages of the present application will become more apparent by describing in more detail exemplary embodiments of the present application in conjunction with the accompanying drawings, wherein the same reference numerals generally represent the same components in the exemplary embodiments of the present application.
图1是本申请实施例示出的车辆的避障处理方法的流程示意图;FIG1 is a schematic flow chart of a vehicle obstacle avoidance processing method according to an embodiment of the present application;
图2是本申请实施例示出的自车车道摆放有朝左前方的预设障碍物的训练图像;FIG2 is a training image of a vehicle lane with a preset obstacle facing the left front shown in an embodiment of the present application;
图3是本申请实施例示出的自车车道摆放有朝右前方的预设障碍物的训练图像;FIG3 is a training image of a vehicle lane with a preset obstacle facing the right front, shown in an embodiment of the present application;
图4是本申请实施例示出的车辆的避障处理方法的另一流程示意图;FIG4 is another schematic flow chart of a vehicle obstacle avoidance method according to an embodiment of the present application;
图5是本申请实施例示出的自车车道存在非常规障碍物的训练图像;FIG5 is a training image showing an unconventional obstacle in the vehicle lane shown in an embodiment of the present application;
图6是本申请实施例示出的车辆的避障处理装置的结构示意图;FIG6 is a schematic diagram of the structure of an obstacle avoidance processing device for a vehicle according to an embodiment of the present application;
图7是本申请实施例示出的车辆的结构示意图。FIG. 7 is a schematic diagram of the structure of a vehicle according to an embodiment of the present application.
具体实施方式Detailed ways
下面将参照附图更详细地描述本申请的实施方式。虽然附图中显示了本申请的实施方式,然而应该理解,可以以各种形式实现本申请而不应被这里阐述的实施方式所限制。相反,提供这些实施方式是为了使本申请更加透彻和完整,并且能够将本申请的范围完整地传达给本领域的技术人员。The embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although the embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.
在本申请使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本申请。在本申请和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms of "a", "said" and "the" used in this application and the appended claims are also intended to include plural forms unless the context clearly indicates other meanings. It should also be understood that the term "and/or" used in this article refers to and includes any or all possible combinations of one or more associated listed items.
应当理解,尽管在本申请可能采用术语“第一”、“第二”、“第三”等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本申请范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。It should be understood that although the terms "first", "second", "third", etc. may be used in this application to describe various information, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
相关技术中,在车辆进行自动驾驶时,基于传统的rule-based,需要通过不同的功能模块逐级处理,才能触发得到避障策略。随着环节的增多,难以保证对所有需要避障的场景触发避障策略。若要得到非常准确地决策结果,需要多种传感器数据的融合,且对于远距离的障碍物还存在漏触发的情形。In related technologies, when a vehicle is performing autonomous driving, based on the traditional rule-based system, it needs to be processed step by step through different functional modules to trigger the obstacle avoidance strategy. With the increase of links, it is difficult to ensure that the obstacle avoidance strategy is triggered for all scenes that require obstacle avoidance. To obtain a very accurate decision result, the fusion of multiple sensor data is required, and there is still a situation of missed triggering for obstacles at a long distance.
针对上述问题,本申请实施例提供一种车辆的避障处理方法,能够快速、准确、无漏地触发车辆在自车车道的避障策略。In view of the above problems, an embodiment of the present application provides a vehicle obstacle avoidance processing method, which can quickly, accurately and seamlessly trigger the vehicle's obstacle avoidance strategy in its own lane.
以下结合附图详细描述本申请实施例的技术方案。The technical solution of the embodiments of the present application is described in detail below with reference to the accompanying drawings.
图1是本申请实施例示出的车辆的避障处理方法的流程示意图。FIG. 1 is a flow chart of a vehicle obstacle avoidance method according to an embodiment of the present application.
参见图1,本申请实施例示出的车辆的避障处理方法,包括:Referring to FIG. 1 , a vehicle obstacle avoidance processing method shown in an embodiment of the present application includes:
S110,接收车辆在行驶方向上的行驶场景图像,行驶场景图像至少包括自车车道。S110, receiving a driving scene image of the vehicle in a driving direction, where the driving scene image at least includes a lane of the vehicle.
在车辆正常行驶途中,安装于车辆上的摄像头可以实时拍摄行驶方向前方的图像,即可得到实时的行驶场景图像。可以理解,车辆行驶时所处的车道为自车车道,行驶场景图像可以包括行驶方向上的自车车道。During normal driving of the vehicle, the camera installed on the vehicle can capture the image in front of the driving direction in real time, and obtain a real-time driving scene image. It can be understood that the lane in which the vehicle is driving is the own vehicle lane, and the driving scene image can include the own vehicle lane in the driving direction.
例如,车辆沿自车车道朝着前方行驶,行驶场景图像即包括自车车道前方的实景图像,从而可以将自车车道前方的路况信息在图像中对应的位置进行显示。For example, the vehicle is traveling forward along the own lane, and the driving scene image includes a real scene image in front of the own lane, so that the road condition information in front of the own lane can be displayed at a corresponding position in the image.
本申请中,根据行驶场景图像可以实现模拟人眼所见即所得的效果,从而相较雷达这类受限于感测距离的传感器而言,基于行驶场景图像可以快速识别出距离车辆更远的障碍物,不受距离限制,使系统可以更快地进行避障规划。In the present application, the effect of what the human eye sees is what it gets can be simulated based on the driving scene image. Therefore, compared with sensors such as radar that are limited by sensing distance, obstacles farther away from the vehicle can be quickly identified based on the driving scene image without being restricted by distance, allowing the system to perform obstacle avoidance planning faster.
S120,根据预设分类模型对自车车道上的路况信息进行分类,获得对应的驾驶决策信息;其中,路况信息包括:自车车道存在非常规障碍物、自车车道存在预设障碍物或自车车道没有障碍物。S120, classifying the road condition information on the own vehicle lane according to a preset classification model to obtain corresponding driving decision information; wherein the road condition information includes: the existence of unconventional obstacles in the own vehicle lane, the existence of preset obstacles in the own vehicle lane, or the absence of obstacles in the own vehicle lane.
可以理解,在车辆的自车车道前方,可能存在有障碍物,也可能没有障碍物。进一步的,路况信息包括自车车道存在非常规障碍物、自车车道存在预设障碍物或自车车道没有障碍物。其中,非常规障碍物例如可以是侧翻的车辆、车轮、纸箱、垃圾等阻碍车辆行驶的异常、少见或随机出现的障碍物。预设障碍物是指静态障碍物,静态障碍物例如可以是路障,例如雪糕筒、围栏等,于此仅举例说明,不做限制。It is understood that there may be obstacles or no obstacles in front of the vehicle's own lane. Further, the road condition information includes the presence of unconventional obstacles in the own lane, the presence of preset obstacles in the own lane, or the absence of obstacles in the own lane. Among them, unconventional obstacles can be, for example, abnormal, rare or randomly appearing obstacles such as overturned vehicles, wheels, cartons, garbage, etc. that hinder the vehicle's travel. Preset obstacles refer to static obstacles, and static obstacles can be, for example, roadblocks, such as ice cream cones, fences, etc., which are only examples for illustration and not limitation.
一些具体的实施方式中,若路况信息为自车车道存在非常规障碍物,则驾驶决策信息为刹车;若路况信息为自车车道存在预设障碍物,则驾驶决策信息为变道;若路况信息为自车车道没有障碍物,则驾驶决策信息为保持行驶。可以理解,对于非常规障碍物,即异常、少见的障碍物,为了确保车辆行驶安全,则可以输出刹车的驾驶决策信息。对于预设障碍物,预设分类模型在训练过程中得到了足够的训练,可以准确进行识别,从而可以采用变道的驾驶决策信息进行避障。当自车车道没有障碍物,车辆则可以正常行驶,无需避障。In some specific implementations, if the road condition information indicates that there is an unconventional obstacle in the vehicle lane, the driving decision information is braking; if the road condition information indicates that there is a preset obstacle in the vehicle lane, the driving decision information is changing lanes; if the road condition information indicates that there is no obstacle in the vehicle lane, the driving decision information is to keep driving. It can be understood that for unconventional obstacles, that is, abnormal and rare obstacles, in order to ensure the safety of vehicle driving, the driving decision information of braking can be output. For preset obstacles, the preset classification model has been sufficiently trained during the training process and can be accurately identified, so that the driving decision information of changing lanes can be used for obstacle avoidance. When there is no obstacle in the vehicle lane, the vehicle can drive normally without obstacle avoidance.
本步骤中,基于自车车道前方是否存在障碍物以及障碍物的类型,直接生成对应的驾驶决策信息,无需引入其他不同功能模块的数据处理环节,提高数据处理效率和触发的出错率,使系统可以更快且准确地根据得到的驾驶决策信息及时进行车辆控制。In this step, based on whether there is an obstacle in front of the vehicle lane and the type of obstacle, the corresponding driving decision information is directly generated without introducing data processing links of other different functional modules, thereby improving data processing efficiency and triggering error rate, so that the system can control the vehicle in a more rapid and accurate manner based on the obtained driving decision information.
一些实施方式中,预设分类模型可以是基于CNN网络(卷积神经网络)的深度学习模型,通过训练数据预先训练获得的、能够对输入的行驶场景图像进行分类的模型。In some embodiments, the preset classification model may be a deep learning model based on a CNN network (convolutional neural network), which is a model obtained by pre-training with training data and capable of classifying input driving scene images.
从该示例可知,本申请的车辆的避障处理方法,基于实时采集的行驶场景图像,对车辆自车车道所在的行驶方向上的路况信息进行分类,针对不同类型的路况信息,快速且准确无漏地输出对应的驾驶决策信息,使自动驾驶的车辆可以基于更短的响应时间进行避障,提高处理效率,确保安全行驶。From this example, it can be seen that the vehicle obstacle avoidance processing method of the present application classifies the road condition information in the driving direction of the vehicle's own lane based on the real-time collected driving scene images, and outputs the corresponding driving decision information quickly and accurately for different types of road condition information, so that the autonomous driving vehicle can avoid obstacles based on a shorter response time, improve processing efficiency, and ensure safe driving.
本申请一实施例还提供一种预设分类模型的训练方法,包括:An embodiment of the present application further provides a method for training a preset classification model, including:
S210,根据采集的训练图像及对应的决策标签,构建训练数据;其中,根据每帧训练图像中的路况信息标注对应的决策标签。S210, constructing training data according to the collected training images and the corresponding decision labels; wherein the corresponding decision labels are annotated according to the road condition information in each frame of the training image.
一些实施方式中,训练图像包括:实景图像和/或仿真图像;其中,实景图像为包含预设障碍物或常规障碍物的场景图像;仿真图像为包含非常规障碍物的场景图像。也就是说,实景图像为真实拍摄采集到的图像,至少部分实景图像包含了在自车车道前方存在预设障碍物或常规障碍物的场景。小部分实景图像包含了自车车道前方不存在障碍物的场景。通过丰富实景图像的各类场景,可以更全面地训练模型能够识别不同场景并及时准确触发。其中,常规障碍物例如可以是位于当前车辆前方的其他正常行驶的车辆,其他车辆的车型不受限制,例如轿车、货车、自行车、摩托车等。In some embodiments, the training images include: real-life images and/or simulated images; wherein the real-life images are scene images containing preset obstacles or conventional obstacles; and the simulated images are scene images containing unconventional obstacles. That is to say, the real-life images are images captured through real shooting, and at least part of the real-life images contain scenes where preset obstacles or conventional obstacles exist in front of the vehicle's lane. A small part of the real-life images contain scenes where there are no obstacles in front of the vehicle's lane. By enriching the various scenes of the real-life images, the model can be more comprehensively trained to recognize different scenes and trigger them in a timely and accurate manner. Among them, conventional obstacles, for example, can be other normally traveling vehicles located in front of the current vehicle, and the models of other vehicles are not restricted, such as cars, trucks, bicycles, motorcycles, etc.
进一步的,对于具有非常规障碍物的实景图像的数据量较少,从而没有足够的训练数据用于训练模型。基于此,通过设计仿真图像进行补充,弥补罕见场景的不足。一些实施例中,仿真图像可以是完全虚拟设计的图像,也可以是部分实景与部分虚拟要素结合所得的图像,或者是不同的实景图像相结合所得的图像。例如,可以将包含有自车车道的实景图像作为背景,将虚拟设计的非常规障碍物放置在该实景图像的自车车道上,结合形成一帧仿真图像。Furthermore, the amount of data for real-life images with unconventional obstacles is small, so there is not enough training data for training the model. Based on this, simulation images are designed to supplement and make up for the lack of rare scenes. In some embodiments, the simulation image can be a completely virtual designed image, or an image obtained by combining part of the real scene with part of the virtual elements, or an image obtained by combining different real-life images. For example, a real-life image containing a vehicle lane can be used as the background, and a virtually designed unconventional obstacle can be placed on the vehicle lane of the real-life image to form a frame of simulation image.
本申请的训练方法,通过包含了常规障碍物的实景图像和非常规障碍物的仿真图像作为训练数据,可以提高训练后的预设分类模型的触发率,避免出现漏触发的情形,从而可以及时生成驾驶决策信息,提高自动驾驶的安全性。The training method of the present application, by including real-life images of conventional obstacles and simulated images of unconventional obstacles as training data, can improve the triggering rate of the trained preset classification model and avoid missed triggering, thereby timely generating driving decision information and improving the safety of autonomous driving.
一些实施方式中,根据训练图像中的路况信息,也即自车车道的障碍物位置和障碍物类型,预先设置对应的决策标签。决策标签可以包括变道、刹车或者保持行驶。也就是说,每一种决策标签对应一种驾驶决策信息。通过将决策标签与训练图像的路况信息进行关联,使模型在训练过程中可以学习到路况信息与驾驶决策信息的映射关系。In some implementations, corresponding decision labels are pre-set based on the road condition information in the training image, i.e., the obstacle position and obstacle type in the vehicle lane. The decision labels may include lane change, braking, or keeping driving. In other words, each decision label corresponds to a driving decision information. By associating the decision label with the road condition information of the training image, the model can learn the mapping relationship between the road condition information and the driving decision information during the training process.
一些具体的实施方式中,变道的决策标签还可以包括向左变道和向右变道。当训练图像中包含具有预设摆放位置的预设障碍物时,设置训练图像的标签为向左变道或向右变道。如图2所示,预设障碍物为自车车道上的多个静态障碍物,例如多个雪糕筒,多个静态障碍物规律地朝向左前方摆放,则表示车辆需要向左变道,则该训练图像的决策标签为向左变道。同理,如图3所示,当多个静态障碍物规律地朝向右前方摆放,则表示车辆需要向右变道,则该训练图像的决策标签对应为向右变道。通过引入具有预设障碍物的训练图像,能够高效地提升模型对静态障碍物的避障性能。In some specific implementations, the decision labels for lane changes may also include changing lanes to the left and changing lanes to the right. When the training image contains a preset obstacle with a preset placement position, the label of the training image is set to change lanes to the left or change lanes to the right. As shown in FIG2, the preset obstacles are multiple static obstacles on the vehicle lane, such as multiple ice cream cones. If the multiple static obstacles are regularly placed toward the left front, it means that the vehicle needs to change lanes to the left, and the decision label of the training image is changing lanes to the left. Similarly, as shown in FIG3, when multiple static obstacles are regularly placed toward the right front, it means that the vehicle needs to change lanes to the right, and the decision label of the training image corresponds to changing lanes to the right. By introducing training images with preset obstacles, the obstacle avoidance performance of the model for static obstacles can be efficiently improved.
一些实施方式中,训练图像还可以包括在相邻车道上存在障碍物的场景。如果相邻车道位于自车车道的左侧并存在有障碍物,则训练图像的决策标签增加左侧有侵入;如果相邻车道位于自车车道的右侧并存在有障碍物,则训练图像的决策标签增加右侧有侵入;如果自车车道的左侧和右侧均具有相邻车道并都存在有障碍物,则训练图像的决策标签同时增加左侧有侵入和右侧有侵入。也就是说,先确定相邻车辆位于自车车道的对应方位后,再进一步确定相邻车道上的路况信息。通过在根据自车车道的路况信息标记对应的决策标签的同时,还根据相邻车道的路况信息增加对应的决策标签,使得后续训练好的预设分类模型对行驶场景图像能够输出更丰富的驾驶决策信息以供参考。In some embodiments, the training image may also include a scene where an obstacle exists on an adjacent lane. If the adjacent lane is located on the left side of the own vehicle lane and there is an obstacle, the decision label of the training image is increased with intrusion on the left side; if the adjacent lane is located on the right side of the own vehicle lane and there is an obstacle, the decision label of the training image is increased with intrusion on the right side; if there are adjacent lanes on both the left and right sides of the own vehicle lane and there are obstacles on both sides, the decision label of the training image is increased with intrusion on the left side and intrusion on the right side at the same time. In other words, after first determining the corresponding position of the adjacent vehicle in the own vehicle lane, the road condition information on the adjacent lane is further determined. By marking the corresponding decision label according to the road condition information of the own vehicle lane, the corresponding decision label is also added according to the road condition information of the adjacent lane, so that the subsequently trained preset classification model can output richer driving decision information for reference to the driving scene image.
本步骤中,通过将多帧包含有不同路况信息的训练图像及对应的决策标签组合形成训练数据,以便后续的预设分类模型进行训练。In this step, training data is formed by combining multiple frames of training images containing different road condition information and corresponding decision labels, so as to facilitate subsequent training of the preset classification model.
S220,利用训练数据,训练预设分类模型,获得训练后的预设分类模型。S220, using the training data to train a preset classification model to obtain a trained preset classification model.
本步骤中,预设分类模型可以是基于卷积神经网络的深度学习模型。基于上述训练数据作为输入数据,通过模型迭代,可以训练获得一种可以根据不同的行驶场景图像输出对应的驾驶决策信息的预设分类模型。In this step, the preset classification model can be a deep learning model based on a convolutional neural network. Based on the above training data as input data, through model iteration, a preset classification model that can output corresponding driving decision information according to different driving scene images can be trained.
本申请的预设分类模型可以通过各类具有不同场景的实景图像和仿真图像训练,形成一种可以端到端地根据输入的行驶场景图像即能输出对应驾驶决策信息的分类模型,高效地提升模型性能和系统性能,避免出现漏触发及误触发的情形,提高车辆避障的准确率和及时性。The preset classification model of the present application can be trained through various real-life images and simulated images with different scenes to form a classification model that can output corresponding driving decision information based on the input driving scene images end-to-end, thereby efficiently improving the model performance and system performance, avoiding missed triggers and false triggers, and improving the accuracy and timeliness of vehicle obstacle avoidance.
参见图4,本申请一实施例还提供一种车辆的避障处理方法,包括:Referring to FIG. 4 , an embodiment of the present application further provides a vehicle obstacle avoidance processing method, including:
S310,接收车辆在行驶方向上的行驶场景图像,行驶场景图像包括自车车道和/或相邻车道。S310, receiving a driving scene image of the vehicle in a driving direction, where the driving scene image includes a vehicle lane and/or an adjacent lane.
在车辆行驶过程实时拍摄到的行驶场景图像中,可能不仅仅包括自车车道,还包括位于自车车道的左侧和/或右侧的相邻车道。也就是说,除了在自车车道的车辆前方存在障碍物,在相邻车道的前方也可能存在障碍物。The driving scene image captured in real time during the driving process of the vehicle may include not only the own lane, but also the adjacent lanes located on the left and/or right side of the own lane. In other words, in addition to obstacles in front of the vehicle in the own lane, there may also be obstacles in front of the adjacent lanes.
S320,根据预设分类模型对自车车道和相邻车道上的路况信息进行分类,获得对应的分类结果。S320, classifying the road condition information on the own vehicle lane and the adjacent lane according to a preset classification model to obtain corresponding classification results.
本步骤中,除了对自车车道的路况信息进行分类,还可以同时对相邻车道上的路况信息进行分类,得到不同车道对应的路况信息的分类结果。一些实施方式中,以自车车道对应的路况信息生成主要的驾驶决策信息,以相邻车道对应的路况信息生成辅助的驾驶决策信息。In this step, in addition to classifying the road condition information of the vehicle lane, the road condition information of the adjacent lanes can also be classified to obtain classification results of road condition information corresponding to different lanes. In some implementations, the road condition information corresponding to the vehicle lane is used to generate the main driving decision information, and the road condition information corresponding to the adjacent lane is used to generate the auxiliary driving decision information.
S330,若路况信息为自车车道存在非常规障碍物,则输出的驾驶决策信息为刹车。S330: If the road condition information indicates that there is an unconventional obstacle in the lane of the vehicle, the output driving decision information is braking.
参见图5,本步骤中,若预设分类模型识别到自车车道的路况信息为自车车道存在非常规障碍物,例如侧翻的车辆、车轮、纸箱、垃圾等阻碍车辆行驶的异常、少见或随机出现的障碍物,则输出对应的驾驶决策信息刹车。Referring to FIG. 5 , in this step, if the preset classification model recognizes that the road condition information of the own vehicle lane indicates that there are unconventional obstacles in the own vehicle lane, such as overturned vehicles, wheels, cartons, garbage and other abnormal, rare or randomly appearing obstacles that hinder the vehicle's travel, the corresponding driving decision information braking is output.
S340,若路况信息为自车车道存在预设障碍物,根据预设障碍物的摆放位置,则输出的驾驶决策信息为向左变道或向右变道。S340: If the road condition information indicates that there is a preset obstacle in the vehicle lane, the output driving decision information is to change lanes to the left or to the right according to the placement of the preset obstacle.
参见图2和图3,本步骤中,预设分类模型识别到自车车道的路况信息为自车车道存在预设障碍物,例如在自车车道的前方朝左前方依序摆放的多个路障,则输出的驾驶决策信息为向左变道;例如在自车车道的前方朝右前方依序摆放的多个路障,则输出的驾驶决策信息为向右变道。本申请的预设分类模型,可以高效的对静态障碍物的输出避障策略。、Referring to Figures 2 and 3, in this step, the preset classification model recognizes that the road condition information of the vehicle lane is that there are preset obstacles in the vehicle lane, such as multiple roadblocks placed in sequence in front of the vehicle lane toward the left front, and the output driving decision information is to change lanes to the left; for example, multiple roadblocks are placed in sequence in front of the vehicle lane toward the right front, and the output driving decision information is to change lanes to the right. The preset classification model of the present application can efficiently output obstacle avoidance strategies for static obstacles.
可以理解,本步骤中,若路况信息为自车车道存在常规障碍物,则输出的驾驶决策信息为变道。It can be understood that in this step, if the road condition information indicates that there is a conventional obstacle in the vehicle lane, the output driving decision information is changing lanes.
S350,若路况信息为自车车道没有障碍物,则输出的驾驶决策信息为保持行驶。S350: If the road condition information indicates that there is no obstacle in the vehicle lane, the output driving decision information is to keep driving.
显然,若预设分类模型识别到自车车道的路况信息为没有障碍物,则驾驶决策信息为保持行驶,即车辆无需避障,可以正常继续沿自车车道行驶。Obviously, if the preset classification model recognizes that the road condition information of the ego vehicle lane is that there are no obstacles, the driving decision information is to keep driving, that is, the vehicle does not need to avoid obstacles and can continue to drive along the ego vehicle lane normally.
上述步骤S330至S350根据行驶场景图像对应的真实路况信息择一执行。可以理解,若行驶场景图像中的自车车道上显示有障碍物,则可以忽略障碍物与当前车辆的间隔距离,无论实际间隔距离有多远,都可以执行对应的驾驶决策信息。The above steps S330 to S350 are selectively executed according to the real road condition information corresponding to the driving scene image. It can be understood that if an obstacle is displayed on the lane of the vehicle in the driving scene image, the distance between the obstacle and the current vehicle can be ignored, and the corresponding driving decision information can be executed regardless of the actual distance.
S360,若路况信息为相邻车道存在障碍物,则输出的驾驶决策信息包括车道左侧有侵入或车道右侧有侵入。S360, if the road condition information indicates that there is an obstacle in the adjacent lane, the output driving decision information includes an intrusion on the left side of the lane or an intrusion on the right side of the lane.
在识别自车车道的路况信息的同时,可选地,预设分类模型还可以同时识别相邻车道的路况信息。例如,若自车车道的左侧存在相邻车道且该左侧相邻车道存在障碍物,则预设分类模型不仅输出自车车道对应的驾驶决策信息,还可以同步输出相邻车道对应的驾驶决策信息如车道左侧有侵入;或者,预设分类模型仅输出自车车道对应的驾驶决策信息。While identifying the road condition information of the own vehicle lane, the preset classification model can optionally also simultaneously identify the road condition information of the adjacent lane. For example, if there is an adjacent lane on the left side of the own vehicle lane and there is an obstacle in the adjacent lane on the left side, the preset classification model not only outputs the driving decision information corresponding to the own vehicle lane, but also synchronously outputs the driving decision information corresponding to the adjacent lane, such as intrusion on the left side of the lane; or, the preset classification model only outputs the driving decision information corresponding to the own vehicle lane.
本步骤S360可以与上述步骤S330至S350之一同时执行或在后执行,或者选择性地执行S360。This step S360 can be performed simultaneously with or after one of the above steps S330 to S350, or S360 can be performed selectively.
一些实施方式中,在获得驾驶决策信息之后,将驾驶决策信息发送至预设规划模块处理,以供输出路径规划信息。In some implementations, after the driving decision information is obtained, the driving decision information is sent to a preset planning module for processing to output path planning information.
可以理解,根据预设分类模型能够更快输出驾驶决策信息,继而可以更早地发送至预设规划模块进行路径规划,以供车辆根据最新的路径规划信息进行自动驾驶。It can be understood that the driving decision information can be output faster according to the preset classification model, and then can be sent to the preset planning module for path planning earlier, so that the vehicle can perform automatic driving according to the latest path planning information.
相比于传统地使用多种功能模块逐级处理才能得到驾驶决策信息,本申请可以端到端地通过预设分类模型直接生成驾驶决策信息,缩短整个系统的处理流程,继而缩短系统的响应时间,且能应对更远的检测距离,更快获得避障策略,预留更充分的时间和距离以供车辆完成路径规划及变道距离,提升自动驾驶的安全性能。Compared with the traditional method of using multiple functional modules to process step by step to obtain driving decision information, the present application can directly generate driving decision information through a preset classification model end-to-end, shortening the processing flow of the entire system, and then shortening the response time of the system. It can also cope with longer detection distances, obtain obstacle avoidance strategies more quickly, and reserve more sufficient time and distance for the vehicle to complete path planning and lane change distance, thereby improving the safety performance of autonomous driving.
与前述应用功能实现方法实施例相对应,本申请还提供了一种车辆的避障处理装置、车辆及相应的实施例。Corresponding to the aforementioned application function implementation method embodiment, the present application also provides a vehicle obstacle avoidance processing device, a vehicle and corresponding embodiments.
图6是本申请实施例示出的车辆的避障处理装置的结构示意图。FIG. 6 is a schematic diagram of the structure of an obstacle avoidance device for a vehicle according to an embodiment of the present application.
参见图6,本申请一实施例示出的车辆的避障处理装置,包括图像接收模块610和分类决策模块620。其中:Referring to FIG. 6 , an obstacle avoidance device for a vehicle shown in an embodiment of the present application includes an image receiving module 610 and a classification decision module 620 . Among them:
图像接收模块610用于接收车辆在行驶方向上的行驶场景图像,行驶场景图像至少包括自车车道。The image receiving module 610 is used to receive a driving scene image of the vehicle in the driving direction, and the driving scene image at least includes the vehicle lane.
分类决策模块620用于根据预设分类模型对自车车道上的路况信息进行分类,获得对应的驾驶决策信息;其中,路况信息包括:自车车道存在非常规障碍物、自车车道存在预设障碍物或自车车道没有障碍物。The classification decision module 620 is used to classify the road condition information on the own vehicle lane according to the preset classification model to obtain corresponding driving decision information; wherein the road condition information includes: the existence of unconventional obstacles in the own vehicle lane, the existence of preset obstacles in the own vehicle lane, or the absence of obstacles in the own vehicle lane.
在一具体的实施方式中,分类决策模块620用于若路况信息为自车车道存在非常规障碍物,则驾驶决策信息为刹车;若路况信息为自车车道存在预设障碍物,则驾驶决策信息为变道;若路况信息为自车车道没有障碍物,则驾驶决策信息为保持行驶。In a specific embodiment, the classification decision module 620 is used to determine that if the road condition information indicates that there is an unconventional obstacle in the vehicle lane, the driving decision information is braking; if the road condition information indicates that there is a preset obstacle in the vehicle lane, the driving decision information is changing lanes; if the road condition information indicates that there is no obstacle in the vehicle lane, the driving decision information is keeping driving.
在一具体的实施方式中,分类决策模块620用于若路况信息为自车车道存在预设障碍物,根据预设障碍物的摆放位置,驾驶决策信息为向左变道或向右变道。In a specific implementation, the classification decision module 620 is used to determine the driving decision information to change lanes to the left or to the right according to the placement of the preset obstacle if the road condition information indicates that there is a preset obstacle in the vehicle lane.
在一具体的实施方式中,分类决策模块620用于若路况信息为相邻车道存在障碍物,驾驶决策信息包括车道左侧有侵入或车道右侧有侵入。In a specific implementation, the classification decision module 620 is used for, if the road condition information indicates that there is an obstacle in an adjacent lane, the driving decision information includes an intrusion on the left side of the lane or an intrusion on the right side of the lane.
从该示例可知,本申请的车辆的避障处理装置,可以基于预设分类模型直接输出驾驶决策信息,获得准确、及时的避障策略,缩短处理流程,降低系统的响应时长,且适用于更远的检测距离,提高车辆自动驾驶时的安全系数。From this example, it can be seen that the obstacle avoidance processing device of the vehicle of the present application can directly output driving decision information based on a preset classification model, obtain accurate and timely obstacle avoidance strategies, shorten the processing flow, reduce the response time of the system, and is suitable for longer detection distances, thereby improving the safety factor of the vehicle during automatic driving.
关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不再做详细阐述说明。Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated again here.
图7是本申请实施例示出的车辆的结构示意图。FIG. 7 is a schematic diagram of the structure of a vehicle according to an embodiment of the present application.
参见图7,车辆1000包括存储器1010和处理器1020。7 , the vehicle 1000 includes a memory 1010 and a processor 1020 .
处理器1020可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The processor 1020 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
存储器1010可以包括各种类型的存储单元,例如系统内存、只读存储器(ROM)和永久存储装置。其中,ROM可以存储处理器1020或者计算机的其他模块需要的静态数据或者指令。永久存储装置可以是可读写的存储装置。永久存储装置可以是即使计算机断电后也不会失去存储的指令和数据的非易失性存储设备。在一些实施方式中,永久性存储装置采用大容量存储装置(例如磁或光盘、闪存)作为永久存储装置。另外一些实施方式中,永久性存储装置可以是可移除的存储设备(例如软盘、光驱)。系统内存可以是可读写存储设备或者易失性可读写存储设备,例如动态随机访问内存。系统内存可以存储一些或者所有处理器在运行时需要的指令和数据。此外,存储器1010可以包括任意计算机可读存储媒介的组合,包括各种类型的半导体存储芯片(例如DRAM,SRAM,SDRAM,闪存,可编程只读存储器),磁盘和/或光盘也可以采用。在一些实施方式中,存储器1010可以包括可读和/或写的可移除的存储设备,例如激光唱片(CD)、只读数字多功能光盘(例如DVD-ROM,双层DVD-ROM)、只读蓝光光盘、超密度光盘、闪存卡(例如SD卡、min SD卡、Micro-SD卡等)、磁性软盘等。计算机可读存储媒介不包含载波和通过无线或有线传输的瞬间电子信号。The memory 1010 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, ROM can store static data or instructions required by the processor 1020 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory may store some or all instructions and data required by the processor at runtime. In addition, the memory 1010 may include any combination of computer-readable storage media, including various types of semiconductor storage chips (such as DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and/or optical disks may also be used. In some embodiments, the memory 1010 may include a readable and/or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (such as a DVD-ROM, a double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (such as an SD card, a mini SD card, a Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and transient electronic signals transmitted wirelessly or wired.
存储器1010上存储有可执行代码,当可执行代码被处理器1020处理时,可以使处理器1020执行上文述及的方法中的部分或全部。The memory 1010 stores executable codes, and when the executable codes are processed by the processor 1020 , the processor 1020 can execute part or all of the methods described above.
此外,根据本申请的方法还可以实现为一种计算机程序或计算机程序产品,该计算机程序或计算机程序产品包括用于执行本申请的上述方法中部分或全部步骤的计算机程序代码指令。In addition, the method according to the present application may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing some or all of the steps in the above method of the present application.
或者,本申请还可以实施为一种计算机可读存储介质(或非暂时性机器可读存储介质或机器可读存储介质),其上存储有可执行代码(或计算机程序或计算机指令代码),当可执行代码(或计算机程序或计算机指令代码)被车辆(或车辆服务器等)的处理器执行时,使处理器执行根据本申请的上述方法的各个步骤的部分或全部。Alternatively, the present application can also be implemented as a computer-readable storage medium (or non-temporary machine-readable storage medium or machine-readable storage medium) on which executable code (or computer program or computer instruction code) is stored. When the executable code (or computer program or computer instruction code) is executed by a processor of a vehicle (or a vehicle server, etc.), the processor executes part or all of the steps of the above-mentioned method according to the present application.
以上已经描述了本申请的各实施例,上述说明是示例性的,并非穷尽性的,并且也不限于所披露的各实施例。在不偏离所说明的各实施例的范围和精神的情况下,对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择,旨在最好地解释各实施例的原理、实际应用或对市场中的技术的改进,或者使本技术领域的其他普通技术人员能理解本文披露的各实施例。The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (10)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410425195.8A CN118082815B (en) | 2024-04-09 | 2024-04-09 | Vehicle obstacle avoidance processing method, device, vehicle and storage medium |
| PCT/CN2025/088111 WO2025214421A1 (en) | 2024-04-09 | 2025-04-09 | Obstacle avoidance processing method and apparatus for vehicle, vehicle, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410425195.8A CN118082815B (en) | 2024-04-09 | 2024-04-09 | Vehicle obstacle avoidance processing method, device, vehicle and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN118082815A true CN118082815A (en) | 2024-05-28 |
| CN118082815B CN118082815B (en) | 2025-01-07 |
Family
ID=91149733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410425195.8A Active CN118082815B (en) | 2024-04-09 | 2024-04-09 | Vehicle obstacle avoidance processing method, device, vehicle and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN118082815B (en) |
| WO (1) | WO2025214421A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118605542A (en) * | 2024-08-07 | 2024-09-06 | 成都赛力斯科技有限公司 | Vehicle obstacle avoidance method, electronic device and storage medium in urban driving scene |
| WO2025214421A1 (en) * | 2024-04-09 | 2025-10-16 | 广州小鹏自动驾驶科技有限公司 | Obstacle avoidance processing method and apparatus for vehicle, vehicle, and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160187880A1 (en) * | 2014-12-25 | 2016-06-30 | Automotive Research & Testing Center | Driving control system and dynamic decision control method thereof |
| DE102018214506A1 (en) * | 2018-08-28 | 2020-03-05 | Zf Friedrichshafen Ag | Method for further developing a driver assistance system and driver assistance system for a vehicle |
| US20200324795A1 (en) * | 2019-04-12 | 2020-10-15 | Nvidia Corporation | Neural network training using ground truth data augmented with map information for autonomous machine applications |
| CN114692289A (en) * | 2020-12-31 | 2022-07-01 | 华为技术有限公司 | Automatic driving algorithm testing method and related equipment |
| CN116476840A (en) * | 2023-06-21 | 2023-07-25 | 北京斯年智驾科技有限公司 | Lane changing driving method, device, equipment and storage medium |
| CN116894317A (en) * | 2022-04-06 | 2023-10-17 | 百度(美国)有限责任公司 | Data processing method, device, electronic equipment and medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109829367B (en) * | 2018-12-24 | 2023-04-28 | 杨昌兵 | Unmanned obstacle recognition management system and method |
| CN111612081B (en) * | 2020-05-25 | 2024-04-02 | 深圳前海微众银行股份有限公司 | Training method, device, equipment and storage medium for recognition model |
| CN116946118A (en) * | 2022-04-13 | 2023-10-27 | 北京罗克维尔斯科技有限公司 | Obstacle avoidance method and device for vehicle, electronic equipment and storage medium |
| CN117496302A (en) * | 2023-11-14 | 2024-02-02 | 杭州顺网科技股份有限公司 | Automatic image generation method, device, equipment and medium based on AIGC |
| CN118082815B (en) * | 2024-04-09 | 2025-01-07 | 广州小鹏自动驾驶科技有限公司 | Vehicle obstacle avoidance processing method, device, vehicle and storage medium |
-
2024
- 2024-04-09 CN CN202410425195.8A patent/CN118082815B/en active Active
-
2025
- 2025-04-09 WO PCT/CN2025/088111 patent/WO2025214421A1/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160187880A1 (en) * | 2014-12-25 | 2016-06-30 | Automotive Research & Testing Center | Driving control system and dynamic decision control method thereof |
| DE102018214506A1 (en) * | 2018-08-28 | 2020-03-05 | Zf Friedrichshafen Ag | Method for further developing a driver assistance system and driver assistance system for a vehicle |
| US20200324795A1 (en) * | 2019-04-12 | 2020-10-15 | Nvidia Corporation | Neural network training using ground truth data augmented with map information for autonomous machine applications |
| CN114692289A (en) * | 2020-12-31 | 2022-07-01 | 华为技术有限公司 | Automatic driving algorithm testing method and related equipment |
| CN116894317A (en) * | 2022-04-06 | 2023-10-17 | 百度(美国)有限责任公司 | Data processing method, device, electronic equipment and medium |
| CN116476840A (en) * | 2023-06-21 | 2023-07-25 | 北京斯年智驾科技有限公司 | Lane changing driving method, device, equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2025214421A1 (en) * | 2024-04-09 | 2025-10-16 | 广州小鹏自动驾驶科技有限公司 | Obstacle avoidance processing method and apparatus for vehicle, vehicle, and storage medium |
| CN118605542A (en) * | 2024-08-07 | 2024-09-06 | 成都赛力斯科技有限公司 | Vehicle obstacle avoidance method, electronic device and storage medium in urban driving scene |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2025214421A1 (en) | 2025-10-16 |
| CN118082815B (en) | 2025-01-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108334081A (en) | Depth of round convolutional neural networks for object detection | |
| CN118082815A (en) | Obstacle avoidance processing method and device for vehicle, vehicle and storage medium | |
| CN111971725B (en) | Method for determining lane change instructions of a vehicle, readable storage medium and vehicle | |
| US11507830B2 (en) | System and method for providing object-level driver attention reasoning with a graph convolution network | |
| CN108388834A (en) | The object detection mapped using Recognition with Recurrent Neural Network and cascade nature | |
| CN110843794A (en) | Driving scene understanding method and device and trajectory planning method and device | |
| KR102723106B1 (en) | Track segment cleaning of tracked objects | |
| JP2021136020A (en) | System and method for identifying dangerous objects using causal inference | |
| CN115393677A (en) | End-to-end system training using fused images | |
| CN111532225A (en) | Vehicle capsule network | |
| CN115792945A (en) | A floating obstacle detection method, device, electronic equipment, and storage medium | |
| CN115546752A (en) | Lane line marking method and device for high-precision map, electronic equipment and storage medium | |
| CN111352414A (en) | False object removal device and method for a vehicle and vehicle including the same | |
| CN114972911A (en) | Method and device for collecting and processing output data of autonomous driving perception algorithm model | |
| CN113807472B (en) | Hierarchical target detection method and device | |
| CN113771846B (en) | Automatic control method, device, system and medium for vehicle | |
| CN115620277A (en) | Monocular 3D environment perception method, device, electronic equipment, and storage medium | |
| CN115690028B (en) | Road pit detection method and device, electronic equipment and storage medium | |
| CN117372916A (en) | Annotating objects in image frames | |
| KR20240011081A (en) | Method for generating improved training data video and apparatus thereof | |
| CN115841757A (en) | Data processing method and device, electronic equipment and storage medium | |
| KR20240055395A (en) | Method for generating boundary line of object in video and apparatus thereof | |
| Khan et al. | Adaptive traffic signal control system using object detection based approach | |
| US12217511B1 (en) | Real time management of detected issues | |
| EP4576023A1 (en) | A method for generating an annotated training data set for training a perception algorithm of an automated driving system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |