[go: up one dir, main page]

CN114815894A - A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium - Google Patents

A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium Download PDF

Info

Publication number
CN114815894A
CN114815894A CN202210576685.9A CN202210576685A CN114815894A CN 114815894 A CN114815894 A CN 114815894A CN 202210576685 A CN202210576685 A CN 202210576685A CN 114815894 A CN114815894 A CN 114815894A
Authority
CN
China
Prior art keywords
data
obstacle
unmanned aerial
position data
aerial vehicle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210576685.9A
Other languages
Chinese (zh)
Inventor
李勇
潘屹峰
黄吴蒙
余冰
周成虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Imapcloud Intelligent Technology Co ltd
Original Assignee
Guangzhou Imapcloud Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Imapcloud Intelligent Technology Co ltd filed Critical Guangzhou Imapcloud Intelligent Technology Co ltd
Priority to CN202210576685.9A priority Critical patent/CN114815894A/en
Publication of CN114815894A publication Critical patent/CN114815894A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

本发明的实施例提供了一种路径优化方法、装置、电子设备、无人机及存储介质,涉及无人机技术领域,包括:获取所述激光雷达在预设时间段内扫描到的多个连续的障碍物位置数据;在各所述障碍物位置数据中存在动态障碍物位置数据的情况下,预测所述动态障碍物位置数据所对应的动态障碍物的运动状态,获得所述动态障碍物的预测运动数据;获取环境风参数以及所述无人机的姿态数据,所述环境风参数包括所述无人机所处环境的风力、风向;基于蝗虫算法,根据所述预测运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。本发明可以至少部分解决无人机在飞行过程中如何规避动态障碍物的问题。

Figure 202210576685

Embodiments of the present invention provide a path optimization method, device, electronic device, unmanned aerial vehicle, and storage medium, and relate to the technical field of unmanned aerial vehicles, including: acquiring a plurality of data scanned by the laser radar within a preset time period Continuous obstacle position data; in the case of dynamic obstacle position data in each of the obstacle position data, predict the motion state of the dynamic obstacle corresponding to the dynamic obstacle position data, and obtain the dynamic obstacle The predicted motion data; obtain the environmental wind parameters and the attitude data of the UAV, and the environmental wind parameters include the wind power and wind direction of the environment where the UAV is located; based on the locust algorithm, according to the predicted motion data, the According to the environmental wind parameters and the attitude data, the initial flight path of the UAV is optimized. The present invention can at least partially solve the problem of how to avoid dynamic obstacles during the flight of the UAV.

Figure 202210576685

Description

一种路径优化方法、装置、电子设备、无人机及存储介质A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium

技术领域technical field

本发明涉及无人机技术领域,具体而言,涉及一种路径优化方法、装置、电子设备、无人机及存储介质。The present invention relates to the technical field of unmanned aerial vehicles, and in particular, to a path optimization method, device, electronic equipment, unmanned aerial vehicle and storage medium.

背景技术Background technique

无人机技术发展日新月异,如今,各个领域都能够用到无人机进行一些任务。Unmanned aerial vehicle technology develops with each passing day, nowadays, various fields can use unmanned aerial vehicle to carry out some tasks.

无人机路径规划问题是无人机调度系统框架的重要组成部分,现有的无人机路径规划时,通常会考虑到一些静态的障碍物,在规划路径时将这些静态的障碍物避开。The UAV path planning problem is an important part of the UAV scheduling system framework. In the existing UAV path planning, some static obstacles are usually considered, and these static obstacles are avoided when planning the path. .

而当无人机飞行时,如何避开动态的障碍物,仍是一个待解决的问题。However, how to avoid dynamic obstacles when the UAV is flying is still a problem to be solved.

发明内容SUMMARY OF THE INVENTION

本发明提供了一种路径优化方法、装置、电子设备、无人机及存储介质,其能够至少以部分解决上述技术问题。The present invention provides a path optimization method, device, electronic device, unmanned aerial vehicle and storage medium, which can at least partially solve the above technical problems.

本发明的实施例可以这样实现:Embodiments of the present invention can be implemented as follows:

第一方面,本发明提供一种路径优化方法,应用于无人机,所述无人机包括激光雷达,所述方法包括:In a first aspect, the present invention provides a path optimization method, which is applied to an unmanned aerial vehicle, where the unmanned aerial vehicle includes a lidar, and the method includes:

获取所述激光雷达在预设时间段内扫描到的多个连续的障碍物位置数据;Acquire a plurality of continuous obstacle position data scanned by the lidar within a preset time period;

在各所述障碍物位置数据中存在动态障碍物位置数据的情况下,预测所述动态障碍物位置数据所对应的动态障碍物的运动状态,获得所述动态障碍物的预测运动数据;In the case that there is dynamic obstacle position data in each of the obstacle position data, predict the motion state of the dynamic obstacle corresponding to the dynamic obstacle position data, and obtain the predicted motion data of the dynamic obstacle;

获取环境风参数以及所述无人机的姿态数据,所述环境风参数包括所述无人机所处环境的风力、风向;Acquiring environmental wind parameters and attitude data of the drone, where the environmental wind parameters include wind force and wind direction of the environment where the drone is located;

基于蝗虫算法,根据所述预测运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。Based on the locust algorithm, the initial flight path of the UAV is optimized according to the predicted motion data, the environmental wind parameters and the attitude data.

可选地,所述无人机还包括可见光相机,所述方法还包括:Optionally, the UAV further includes a visible light camera, and the method further includes:

获取在所述预设时间段内,所述可见光相机拍摄的目标区域的多个连续的图像数据,所述目标区域为所述动态障碍物位置数据所对应的障碍物所在的区域;Acquire a plurality of continuous image data of the target area captured by the visible light camera within the preset time period, where the target area is the area where the obstacle corresponding to the dynamic obstacle position data is located;

根据多个连续的所述图像数据,预测所述动态障碍物的运动状态,获得所述动态障碍物的辅助运动数据;Predict the motion state of the dynamic obstacle according to a plurality of continuous image data, and obtain auxiliary motion data of the dynamic obstacle;

基于所述辅助运动数据,对所述预测运动数据进行优化,获得优化后的预测运动数据;Based on the auxiliary motion data, the predicted motion data is optimized to obtain optimized predicted motion data;

所述对所述无人机的初始飞行路径进行优化,包括:基于蝗虫算法,根据所述优化后的预测运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。The optimization of the initial flight path of the unmanned aerial vehicle includes: based on the locust algorithm, according to the optimized predicted motion data, the environmental wind parameters and the attitude data, to the initial flight path of the unmanned aerial vehicle. The flight path is optimized.

可选地,在所述动态障碍物位置数据所对应的动态障碍物为两个以上的情况下,所述方法还包括:Optionally, in the case that there are more than two dynamic obstacles corresponding to the dynamic obstacle position data, the method further includes:

分别获取每个所述动态障碍物所对应的优化后的预测运动数据;respectively obtaining the optimized predicted motion data corresponding to each of the dynamic obstacles;

合并多个所述优化后的预测运动数据,获得协同运动数据;Merging a plurality of the optimized predicted motion data to obtain coordinated motion data;

所述对所述无人机的初始飞行路径进行优化,包括:基于蝗虫算法,根据所述协同运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。The optimization of the initial flight path of the unmanned aerial vehicle includes: based on the locust algorithm, according to the cooperative motion data, the environmental wind parameters and the attitude data, performing the optimization on the initial flight path of the unmanned aerial vehicle. optimization.

可选地,在所述对所述无人机的初始飞行路径进行优化之前,所述方法还包括:Optionally, before optimizing the initial flight path of the UAV, the method further includes:

基于李雅普诺夫函数,消除所述协同运动数据的误差。Based on the Lyapunov function, the error of the cooperative motion data is eliminated.

可选地,所述方法还包括获得所述初始飞行路径的步骤,该步骤包括:Optionally, the method further includes the step of obtaining the initial flight path, the step including:

获取无人机地图,所述无人机地图包括目标点位、起始点位以及用户标注的静态障碍物点位;Obtain a UAV map, where the UAV map includes a target point, a starting point, and a static obstacle point marked by the user;

根据所述起始点位、所述目标点位以及所述静态障碍物点位,生成所述初始飞行路径。The initial flight path is generated according to the starting point, the target point and the static obstacle point.

可选地,所述方法还包括:Optionally, the method further includes:

判断所述障碍物位置数据中是否有所述静态障碍物点位所对应的位置数据;Determine whether there is position data corresponding to the static obstacle position in the obstacle position data;

若有,则筛选出除所述静态障碍物点位所对应的位置数据之外的障碍物位置数据作为所述动态障碍物位置数据。If there is, the obstacle position data other than the position data corresponding to the static obstacle points are screened out as the dynamic obstacle position data.

第二方面,本发明提供一种路径优化装置,应用于无人机,所述无人机包括激光雷达,所述装置包括:In a second aspect, the present invention provides a path optimization device, which is applied to an unmanned aerial vehicle. The unmanned aerial vehicle includes a laser radar, and the device includes:

障碍物位置数据获取单元,用于获取所述激光雷达在预设时间段内扫描到的多个连续的障碍物位置数据;an obstacle location data acquisition unit, configured to acquire a plurality of continuous obstacle location data scanned by the lidar within a preset time period;

预测单元,用于在各所述障碍物位置数据中存在动态障碍物位置数据的情况下,预测所述动态障碍物位置数据所对应的动态障碍物的运动状态,获得所述动态障碍物的预测运动数据;A prediction unit, configured to predict the motion state of the dynamic obstacle corresponding to the dynamic obstacle position data under the condition that there is dynamic obstacle position data in each of the obstacle position data, and obtain the prediction of the dynamic obstacle sports data;

环境参数获取单元,用于获取环境风参数以及所述无人机的姿态数据,所述环境风参数包括所述无人机所处环境的风力、风向;an environmental parameter acquisition unit, configured to acquire environmental wind parameters and attitude data of the drone, where the environmental wind parameters include wind force and wind direction of the environment where the drone is located;

路径优化单元,基于蝗虫算法,根据所述预测运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。The path optimization unit, based on the locust algorithm, optimizes the initial flight path of the UAV according to the predicted motion data, the environmental wind parameters and the attitude data.

第三方面,本发明提供一种无人机,包括雷达、风力传感器、陀螺仪以及控制器,所述控制器分别与所述雷达、所述风力传感器、所述陀螺仪通信连接;In a third aspect, the present invention provides an unmanned aerial vehicle, comprising a radar, a wind sensor, a gyroscope, and a controller, wherein the controller is respectively connected in communication with the radar, the wind sensor, and the gyroscope;

所述雷达用于获取并向所述控制器反馈障碍物的位置数据;the radar is used for acquiring and feeding back position data of obstacles to the controller;

所述风力传感器用于获取并向所述控制器发送环境风参数;The wind sensor is used for acquiring and sending ambient wind parameters to the controller;

所述陀螺仪用于获取并向所述控制器发送所述无人机的姿态数据;The gyroscope is used to acquire and send the attitude data of the UAV to the controller;

所述控制器用于执行上述任一项所述的路径优化方法。The controller is configured to execute the path optimization method described in any one of the above.

第四方面,本发明提供一种电子设备包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现上述任一项所述方法的步骤。In a fourth aspect, the present invention provides an electronic device comprising: a memory, a processor, and a computer program stored in the memory and running on the processor, the processor implements any one of the methods described above when the processor executes the program A step of.

第五方面,本发明提供一种存储介质,所述存储介质包括计算机程序,所述计算机程序运行时控制所述计算机可读存储介质所在电子设备实现上述任一项所述方法的步骤。In a fifth aspect, the present invention provides a storage medium, the storage medium includes a computer program, and when the computer program runs, it controls an electronic device where the computer-readable storage medium is located to implement the steps of any one of the methods described above.

本发明实施例的有益效果包括,例如:The beneficial effects of the embodiments of the present invention include, for example:

在无人机遇到动态障碍物时,通过对动态障碍物的运动状态进行预测,优化无人机的初始飞行路径,进而使无人机在飞行时能够有效地避免动态障碍物,防止无人机因为撞到动态障碍物而发生无人机损坏的情况出现。When the UAV encounters a dynamic obstacle, the initial flight path of the UAV is optimized by predicting the motion state of the dynamic obstacle, so that the UAV can effectively avoid the dynamic obstacle and prevent the UAV from flying. There are cases where the drone is damaged by hitting a dynamic obstacle.

附图说明Description of drawings

为了更清楚地说明本发明实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,应当理解,以下附图仅示出了本发明的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他相关的附图。In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the embodiments. It should be understood that the following drawings only show some embodiments of the present invention, and therefore do not It should be regarded as a limitation of the scope, and for those of ordinary skill in the art, other related drawings can also be obtained according to these drawings without any creative effort.

图1为本发明实施例提供的一种电子设备的结构示意图;1 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

图2为本发明实施例提供的一种路径优化方法的步骤流程图;FIG. 2 is a flowchart of steps of a path optimization method provided by an embodiment of the present invention;

图3为本发明实施例提供的一种初始飞行路径获取方法的步骤流程图;3 is a flowchart of steps of a method for obtaining an initial flight path according to an embodiment of the present invention;

图4为本发明实施例提供的一种无人机地图的示意图;4 is a schematic diagram of a UAV map according to an embodiment of the present invention;

图5为本发明实施例提供的一种路径优化装置的框架图。FIG. 5 is a frame diagram of a path optimization apparatus provided by an embodiment of the present invention.

图标:100-电子设备;110-存储器;120-处理器;130-通信模块;300-路径优化装置;301-障碍物位置数据获取单元;302-预测单元;303-环境参数获取单元;304-路径优化单元。Icon: 100-electronic equipment; 110-memory; 120-processor; 130-communication module; 300-path optimization device; 301-obstruction position data acquisition unit; 302-prediction unit; 303-environmental parameter acquisition unit; 304- Path optimization unit.

具体实施方式Detailed ways

为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。通常在此处附图中描述和示出的本发明实施例的组件可以以各种不同的配置来布置和设计。In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. The components of the embodiments of the invention generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations.

因此,以下对在附图中提供的本发明的实施例的详细描述并非旨在限制要求保护的本发明的范围,而是仅仅表示本发明的选定实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。Thus, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed, but is merely representative of selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

应注意到:相似的标号和字母在下面的附图中表示类似项,因此,一旦某一项在一个附图中被定义,则在随后的附图中不需要对其进行进一步定义和解释。It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.

此外,若出现术语“第一”、“第二”等仅用于区分描述,而不能理解为指示或暗示相对重要性。In addition, where the terms "first", "second" and the like appear, they are only used to differentiate the description, and should not be construed as indicating or implying relative importance.

需要说明的是,在不冲突的情况下,本发明的实施例中的特征可以相互结合。It should be noted that the features in the embodiments of the present invention may be combined with each other without conflict.

请参考图1,是本申请提供的一种电子设备100的方框示意图,包括存储器110、处理器120及通信模块130。所述存储器110、处理器120以及通信模块130。各元件相互之间直接或间接地电性连接,以实现数据的传输或交互。例如,这些元件相互之间可通过一条或多条通讯总线或信号线实现电性连接。Please refer to FIG. 1 , which is a schematic block diagram of an electronic device 100 provided by the present application, including a memory 110 , a processor 120 and a communication module 130 . The memory 110 , the processor 120 and the communication module 130 . Each element is directly or indirectly electrically connected to each other to realize data transmission or interaction. For example, these components can be electrically connected to each other through one or more communication buses or signal lines.

其中,存储器110用于存储程序或者数据。所述存储器110可以是,但不限于,随机存取存储器(Random Access Memory,RAM),只读存储器(Read Only Memory,ROM),可编程只读存储器(Programmable Read-Only Memory,PROM),可擦除只读存储器(ErasableProgrammable Read-Only Memory,EPROM),电可擦除只读存储器(Electric ErasableProgrammable Read-Only Memory,EEPROM)等。The memory 110 is used for storing programs or data. The memory 110 may be, but not limited to, random access memory (Random Access Memory, RAM), read only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only Memory, PROM), or Erasable Programmable Read-Only Memory (EPROM), Electrical Erasable Programmable Read-Only Memory (EEPROM), etc.

处理器120用于读/写存储器中存储的数据或程序,并执行相应地功能。The processor 120 is used to read/write data or programs stored in the memory, and perform corresponding functions.

通信模块130用于通过所述网络建立所述电子设备与其它通信终端之间的通信连接,并用于通过所述网络收发数据。The communication module 130 is configured to establish a communication connection between the electronic device and other communication terminals through the network, and to send and receive data through the network.

应当理解的是,图1所示的结构仅为电子设备100的结构示意图,所述电子设备100还可包括比图1中所示更多或者更少的组件,或者具有与图1所示不同的配置,例如,电子设备100还可以包括路径优化单元、预测单元等等。图1中所示的各组件可以采用硬件、软件或其组合实现。It should be understood that the structure shown in FIG. 1 is only a schematic structural diagram of the electronic device 100 , and the electronic device 100 may further include more or less components than those shown in FIG. 1 , or have different components from those shown in FIG. 1 . For example, the electronic device 100 may further include a path optimization unit, a prediction unit, and the like. Each component shown in FIG. 1 may be implemented in hardware, software, or a combination thereof.

现有的技术方案多是通过无人机挂载的雷达获取障碍物位置,然后根据获取的位置规划无人机接下来的路线,以此来避障,或者通过挂载相机拍摄到的图像进行处理来获取障碍物位置,或者是两者结合来提高障碍物位置精度。都是“被动式”的做出避障指令。Most of the existing technical solutions are to obtain the position of the obstacle through the radar mounted on the drone, and then plan the next route of the drone according to the obtained position, so as to avoid the obstacle, or to use the image captured by the mounted camera. processing to obtain the obstacle position, or a combination of the two to improve the obstacle position accuracy. They are all "passive" to make obstacle avoidance instructions.

但实际飞行任务中,很多障碍物不是静止的,对于在接近的障碍物是必须要避开的;对于在远离的障碍物,有时可以不用改变无人机原本的飞行路线;对于在接下来的时间内可能恰好与无人机在飞行路线上相交的,需要提前预测。因此,对无人机路径评估是否有碰撞风险,并提前对无人机路径进行优化,是非常有必要的。However, in actual flight missions, many obstacles are not stationary, and must be avoided for approaching obstacles; for distant obstacles, sometimes it is not necessary to change the original flight route of the UAV; The time may happen to intersect with the UAV on the flight path, which needs to be predicted in advance. Therefore, it is very necessary to assess whether there is a collision risk on the UAV path and optimize the UAV path in advance.

请参见图2,为本说明书实施例提供的一种路径优化方法,应用于无人机,所述无人机包括激光雷达,所述方法包括以下步骤:Referring to FIG. 2, a path optimization method provided in the embodiment of this specification is applied to an unmanned aerial vehicle. The unmanned aerial vehicle includes a laser radar, and the method includes the following steps:

步骤S120:获取所述激光雷达在预设时间段内扫描到的多个连续的障碍物位置数据。Step S120: Acquire a plurality of continuous obstacle position data scanned by the lidar within a preset time period.

步骤S130:在各所述障碍物位置数据中存在动态障碍物位置数据的情况下,预测所述动态障碍物位置数据所对应的动态障碍物的运动状态,获得所述动态障碍物的预测运动数据。Step S130: In the case where there is dynamic obstacle position data in each of the obstacle position data, predict the motion state of the dynamic obstacle corresponding to the dynamic obstacle position data, and obtain the predicted motion data of the dynamic obstacle .

步骤S140:获取环境风参数以及所述无人机的姿态数据,所述环境风参数包括所述无人机所处环境的风力、风向。Step S140: Obtain environmental wind parameters and attitude data of the drone, where the environmental wind parameters include wind force and wind direction of the environment where the drone is located.

步骤S150:基于蝗虫算法,根据所述预测运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。Step S150: Based on the locust algorithm, according to the predicted motion data, the environmental wind parameters and the attitude data, optimize the initial flight path of the UAV.

下面分别对以上步骤进行说明。The above steps are respectively described below.

步骤S120中,获取所述激光雷达在预设时间段内扫描到的多个连续的障碍物位置数据。In step S120, a plurality of continuous obstacle position data scanned by the lidar within a preset time period are acquired.

预设时间段可以是激光雷达扫描到障碍物位置数据开始后的一端时间,也可以是激光雷达启动时开始计时的一段时间。The preset time period can be an end time after the lidar scans the obstacle position data, or it can be a period of time that starts timing when the lidar starts.

无人机上设置的激光雷达,在无人机启动按照既定的初始路线飞行时,即开始实时扫描监测是否有障碍物。激光雷达是发射激光束探测目标的位置、速度等特征量的雷达系统。在有障碍物时,向障碍物发射探测信号(激光束),然后将接收到的从障碍物反射回来的信号(目标回波)与发射信号进行比较,做适当处理后,就可获得障碍物的有关信息,如目标距离、方位、高度、速度、姿态、甚至形状等参数,从而对障碍物进行识别,获取这些数据,即数据障碍物位置数据。The lidar set on the UAV starts to scan and monitor whether there are obstacles in real time when the UAV starts to fly according to the predetermined initial route. Lidar is a radar system that emits a laser beam to detect the position, velocity and other characteristic quantities of a target. When there is an obstacle, a detection signal (laser beam) is sent to the obstacle, and then the received signal (target echo) reflected from the obstacle is compared with the transmitted signal, and after proper processing, the obstacle can be obtained. related information, such as target distance, orientation, height, speed, attitude, and even shape and other parameters, so as to identify obstacles and obtain these data, that is, data obstacle position data.

以预设时间段为激光雷达扫描到障碍物位置数据开始后的一端时间为例,激光雷达扫描到障碍物位置数据后,在5秒的时间内,每间隔0.5秒扫描一次,获得多个连续的障碍物位置数据,然后将这些障碍物位置数据发送给处理器。Taking the preset time period as the end time after the lidar scans the obstacle position data as an example, after the lidar scans the obstacle position data, it scans once every 0.5 seconds within 5 seconds to obtain multiple consecutive the obstacle position data, and then send these obstacle position data to the processor.

可选地,如图3所示,所述方法还包括获得所述初始飞行路径的步骤,该步骤包括:Optionally, as shown in FIG. 3 , the method further includes the step of obtaining the initial flight path, and the step includes:

步骤S111:获取无人机地图,所述无人机地图包括目标点位、起始点位以及用户标注的静态障碍物点位;Step S111: obtaining a UAV map, where the UAV map includes a target point, a starting point, and a static obstacle point marked by the user;

步骤S112:根据所述起始点位、所述目标点位以及所述静态障碍物点位,生成所述初始飞行路径。Step S112: Generate the initial flight path according to the starting point, the target point and the static obstacle point.

如图4所示,无人机地图可以是用户从外部设备导入到无人机内部的地图,无人机地图上可以包含有无人机启动的起始点位、无人机需要到达的目标点位以及用户在无人机地图上标注好的静态障碍物点位。As shown in Figure 4, the drone map can be a map imported by the user from an external device into the drone. The drone map can include the starting point of the drone and the target point that the drone needs to reach. Positions and static obstacle positions marked by the user on the UAV map.

处理器在获取用户导入的无人机地图后,可以根据目标点位、起始点位以及用户标注的静态障碍物点位,自动生成一条能够避开静态障碍物点位的路径,即初始飞行路径。After the processor obtains the UAV map imported by the user, it can automatically generate a path that can avoid the static obstacle points according to the target point, the starting point and the static obstacle points marked by the user, that is, the initial flight path .

可选地,所述方法还包括:Optionally, the method further includes:

判断所述障碍物位置数据中是否有所述静态障碍物点位所对应的位置数据;Determine whether there is position data corresponding to the static obstacle position in the obstacle position data;

若有,则筛选出除所述静态障碍物点位所对应的位置数据之外的障碍物位置数据作为所述动态障碍物位置数据。If there is, the obstacle position data other than the position data corresponding to the static obstacle points are screened out as the dynamic obstacle position data.

激光雷达扫描到的障碍物可以包括动态障碍物和静态障碍物,为了筛选出激光雷达扫描到的障碍物中的动态障碍物,作为一种可选的实施例,可以通过将无人机地图与激光雷达扫描到的障碍物位置数据相结合的方式,从障碍物位置数据中判断出哪些障碍物位置数据为用户在无人机地图上标注为静态障碍物点位所对应的位置数据。Obstacles scanned by lidar can include dynamic obstacles and static obstacles. In order to filter out dynamic obstacles in obstacles scanned by lidar, as an optional By combining the obstacle location data scanned by the lidar, it is determined from the obstacle location data which obstacle location data is the location data corresponding to the static obstacle points marked by the user on the UAV map.

步骤S130中,在各所述障碍物位置数据中存在动态障碍物位置数据的情况下,预测所述动态障碍物位置数据所对应的动态障碍物的运动状态,获得所述动态障碍物的预测运动数据。In step S130, in the case where there is dynamic obstacle position data in each of the obstacle position data, the motion state of the dynamic obstacle corresponding to the dynamic obstacle position data is predicted, and the predicted motion of the dynamic obstacle is obtained. data.

激光雷达扫描到的障碍物可以包括动态障碍物和静态障碍物,当障碍物位置数据中有动态障碍物位置数据时,处理器可以将激光雷达获取的雷达数据进行数据处理,进而对动态障碍物接下来的运动状态进行预测。举例来说,激光雷达获取了动态障碍物A连续5秒时间内每隔0.5秒所在的位置的位置信息,那么,处理器可以根据动态障碍物A的位置信息计算出其运动的速度以及方向,进而对动态障碍物A接下来的运动速度以及运动方向进行预测,得到动态障碍物A的预测运动数据。The obstacles scanned by the lidar can include dynamic obstacles and static obstacles. When there is dynamic obstacle position data in the obstacle position data, the processor can process the radar data obtained by the lidar, and then analyze the dynamic obstacles. The next motion state is predicted. For example, the lidar obtains the position information of the position of the dynamic obstacle A every 0.5 seconds for 5 consecutive seconds, then the processor can calculate the speed and direction of its movement according to the position information of the dynamic obstacle A, Further, the next movement speed and movement direction of the dynamic obstacle A are predicted, and the predicted movement data of the dynamic obstacle A is obtained.

可选地,所述无人机还包括可见光相机,所述方法还包括:Optionally, the UAV further includes a visible light camera, and the method further includes:

获取在所述预设时间段内,所述可见光相机拍摄的目标区域的多个连续的图像数据,所述目标区域为所述动态障碍物位置数据所对应的障碍物所在的区域;Acquire a plurality of continuous image data of the target area captured by the visible light camera within the preset time period, where the target area is the area where the obstacle corresponding to the dynamic obstacle position data is located;

根据多个连续的所述图像数据,预测所述动态障碍物的运动状态,获得所述动态障碍物的辅助运动数据;Predict the motion state of the dynamic obstacle according to a plurality of continuous image data, and obtain auxiliary motion data of the dynamic obstacle;

基于所述辅助运动数据,对所述预测运动数据进行优化,获得优化后的预测运动数据。Based on the auxiliary motion data, the predicted motion data is optimized to obtain optimized predicted motion data.

为了使无人机对动态障碍物运动的预测更加准确,可以在无人机上搭载一个可见光相机。可见光相机可以是配合激光雷达使用的可以锁定拍摄目标并能够360度拍摄的相机。In order to make the UAV's prediction of dynamic obstacle motion more accurate, a visible light camera can be mounted on the UAV. A visible light camera can be a camera that can be used in conjunction with a lidar to lock the target and shoot 360 degrees.

目标区域可以是激光雷达扫描到的动态障碍物所在的区域,当处理器通过激光雷达获取的障碍物位置数据判断出动态障碍物时,可见光相机可以根据动态障碍物位置数据确定目标区域,可见光相机可以在预设时间段内拍摄目标区域中的连续的图像数据。通过对连续的图像进行处理,同样可以对动态障碍物的运动状态进行预测,进而得到动态障碍物的辅助运动数据。举例来说,可见光相机拍摄到的图像数据为目标区域的图像,通过对图像数据进行处理,可以在图像中建立空间坐标系,通过空间坐标系确定动态障碍物在图像中的位置。进一步地,由多张连续的图像数据中动态障碍物在图像中的位置,计算出动态障碍物在预设时间段内运动的速度以及方向,从而对动态障碍物的运动状态进行预测,得到动态障碍物的辅助运动数据。The target area can be the area where the dynamic obstacle scanned by the lidar is located. When the processor determines the dynamic obstacle through the obstacle position data obtained by the lidar, the visible light camera can determine the target area according to the dynamic obstacle position data, and the visible light camera can determine the target area. Continuous image data in the target area can be captured within a preset time period. By processing the continuous images, the motion state of the dynamic obstacle can also be predicted, and the auxiliary motion data of the dynamic obstacle can be obtained. For example, the image data captured by the visible light camera is the image of the target area. By processing the image data, a spatial coordinate system can be established in the image, and the position of the dynamic obstacle in the image can be determined by the spatial coordinate system. Further, from the position of the dynamic obstacle in the image in the multiple continuous image data, the speed and direction of the dynamic obstacle in the preset time period are calculated, so as to predict the motion state of the dynamic obstacle and obtain the dynamic obstacle. Assisted motion data for obstacles.

获得辅助运动数据后,可以通过辅助运动数据对预测运动数据进行优化,得到优化后的预测运动数据,提高预测运动数据的准确性。After the auxiliary motion data is obtained, the predicted motion data can be optimized through the auxiliary motion data to obtain optimized predicted motion data, thereby improving the accuracy of the predicted motion data.

卡尔曼滤波是一种利用递归实现目标方位估计的滤波,它能够从一系列含有噪声的测量中,估计预测目标系统的下一时刻的位置信息,对目标的轨迹进行预测,并且使用确信度较高的跟踪结果进行预测结果的修正,即只要获取上一时刻状态的估计值以及当前状态的观测值就可以计算出当前状态的估计值,因此不需要记录观测或者估计的历史信息。因此,作为一种可选地实施例,可以通过采用卡尔曼滤波对可见光相机拍摄的图像进行过滤,进而对动态障碍物的运动状态进行预测。Kalman filter is a kind of filter that uses recursion to realize target orientation estimation. It can estimate and predict the position information of the target system at the next moment from a series of noise-containing measurements, predict the trajectory of the target, and use certainty comparisons. The high tracking result is used to correct the prediction result, that is, the estimated value of the current state can be calculated only by obtaining the estimated value of the state at the previous moment and the observed value of the current state, so there is no need to record the historical information of the observation or the estimate. Therefore, as an optional embodiment, Kalman filtering can be used to filter the image captured by the visible light camera, so as to predict the motion state of the dynamic obstacle.

设一个非线性函数f,用于描绘当前状态向量

Figure BDA0003660571490000121
向前一个状态向量
Figure BDA0003660571490000122
的映射。基本结构状态的估计值。前一个状态向量
Figure BDA0003660571490000123
Figure BDA0003660571490000124
表示为:Let a nonlinear function f be used to describe the current state vector
Figure BDA0003660571490000121
previous state vector
Figure BDA0003660571490000122
mapping. An estimate of the basic structural state. previous state vector
Figure BDA0003660571490000123
use
Figure BDA0003660571490000124
Expressed as:

Figure BDA0003660571490000125
Figure BDA0003660571490000125

Figure BDA0003660571490000126
为k时刻的观测向量,那么k-1时刻的观测向量
Figure BDA0003660571490000127
表征为一个非线性函数:
Figure BDA0003660571490000126
is the observation vector at time k, then the observation vector at time k-1
Figure BDA0003660571490000127
Characterized as a nonlinear function:

Figure BDA0003660571490000128
Figure BDA0003660571490000128

用于表征卡尔曼滤波的伴随条件

Figure BDA0003660571490000131
是一个根据f向x求偏导的雅可比矩阵,
Figure BDA0003660571490000132
是根据h向w求偏导的雅可比矩阵,
Figure BDA0003660571490000133
是根据f向v求偏导的雅可比矩阵,
Figure BDA0003660571490000134
是根据f向w求偏导的雅各布矩阵。这里
Figure BDA0003660571490000135
是从具有协方差
Figure BDA0003660571490000136
的零均值多元正态分布中得出的,也同时是还具有协方差
Figure BDA0003660571490000137
的零均值高斯白噪声。Adjoint Conditions for Characterizing Kalman Filters
Figure BDA0003660571490000131
is a Jacobian matrix that takes the partial derivative of f to x,
Figure BDA0003660571490000132
is the Jacobian matrix of partial derivatives from h to w,
Figure BDA0003660571490000133
is the Jacobian matrix of partial derivatives from f to v,
Figure BDA0003660571490000134
is the Jacobian matrix that takes the partial derivative from f to w. here
Figure BDA0003660571490000135
is from having covariance
Figure BDA0003660571490000136
from a multivariate normal distribution with zero mean, which also has covariance
Figure BDA0003660571490000137
zero mean Gaussian white noise.

与卡尔曼滤波过程可以被概念化为两个阶段:“预测”和“修正”。以下是卡尔曼滤波计算步骤:The Kalman filtering process can be conceptualized as two stages: "prediction" and "correction". The following are the Kalman filter calculation steps:

计算状态评估传播Computational State Evaluation Propagation

Figure BDA0003660571490000138
Figure BDA0003660571490000138

其中

Figure BDA0003660571490000139
是非线性状态转移函数,xk-1代表无人机的位置和方向,uk-1代表无人机的简单移动,0代表噪声干扰。in
Figure BDA0003660571490000139
is the nonlinear state transfer function, x k-1 represents the position and orientation of the drone, u k-1 represents the simple movement of the drone, and 0 represents noise interference.

获取误差协方差传播Get Error Covariance Propagation

Figure BDA00036605714900001310
Figure BDA00036605714900001310

卡尔曼增益矩阵的计算Calculation of Kalman Gain Matrix

Figure BDA00036605714900001311
Figure BDA00036605714900001311

更新状态估计和误差协方差,以评估更新后的无人机环境位置。这里的卡尔曼滤波增益

Figure BDA0003660571490000141
是用来校正状态
Figure BDA0003660571490000142
及其协方差
Figure BDA0003660571490000143
更新的无人机状态向量
Figure BDA0003660571490000144
见以下方程:Update the state estimate and error covariance to evaluate the updated UAV environment position. The Kalman filter gain here
Figure BDA0003660571490000141
is used to correct the state
Figure BDA0003660571490000142
and its covariance
Figure BDA0003660571490000143
Updated drone state vector
Figure BDA0003660571490000144
See the following equations:

Figure BDA0003660571490000145
Figure BDA0003660571490000145

Figure BDA0003660571490000146
Figure BDA0003660571490000146

其中

Figure BDA0003660571490000147
Figure BDA0003660571490000148
表示具有零均值和协方差矩阵的新独立随机变量。这种滤波可得到无人机路径跟踪区域中障碍物的准确位置。in
Figure BDA0003660571490000147
and
Figure BDA0003660571490000148
represents a new independent random variable with zero mean and covariance matrix. This filtering can obtain the accurate location of obstacles in the area of the UAV's path tracking.

可选地,在所述动态障碍物位置数据所对应的动态障碍物为两个以上的情况下,所述方法还包括:Optionally, in the case that there are more than two dynamic obstacles corresponding to the dynamic obstacle position data, the method further includes:

分别获取每个所述动态障碍物所对应的优化后的预测运动数据;respectively obtaining the optimized predicted motion data corresponding to each of the dynamic obstacles;

合并多个所述优化后的预测运动数据,获得协同运动数据。Combine a plurality of the optimized predicted motion data to obtain coordinated motion data.

当动态障碍物多两个及以上时,可以对每个动态障碍物所对应的优化后的预测运动数据分别进行获取,然后将每个动态障碍物所对应的优化后的预测运动数据进行合并,获得所有动态障碍物的协同运动数据。When there are two or more dynamic obstacles, the optimized predicted motion data corresponding to each dynamic obstacle can be obtained separately, and then the optimized predicted motion data corresponding to each dynamic obstacle can be combined. Obtain coordinated motion data for all dynamic obstacles.

可选地,所述方法还包括:Optionally, the method further includes:

基于李雅普诺夫函数,消除所述协同运动数据的误差。Based on the Lyapunov function, the error of the cooperative motion data is eliminated.

李雅普诺夫函数在平衡时被用来决定框架的可靠性。误差动态模型的特征是:The Lyapunov function is used to determine the reliability of the framework when balancing. The characteristics of the error dynamic model are:

Figure BDA0003660571490000151
Figure BDA0003660571490000151

其中,θdi表示关于理想点的路径角,上方公式的微分可以用路径边界来描述。协同路径跟踪过程的目标是将每台无人机的误差动态模型特征ek=[pek,qek,θek]消除到[0 00]。最终目标是,无人机利用它们的情况将跟随误差最小化到预先定义的路径和彼此的位置以保持协作移动。where θdi represents the path angle with respect to the ideal point, and the differentiation of the above formula can be described by the path boundary. The goal of the cooperative path tracking process is to eliminate the error dynamic model feature ek = [ pek , qek , θek ] of each UAV to [0 00]. The ultimate goal is that the drones take advantage of their situation to minimize the following error to a pre-defined path and each other's position to maintain cooperative movement.

Figure BDA0003660571490000153
Figure BDA0003660571490000153

Figure BDA0003660571490000154
Figure BDA0003660571490000154

Figure BDA00036605714900001510
Figure BDA00036605714900001510

从上述公式可知,每台无人机的输入都包含地面速度Vgk、航向角率ωk和假设的其他无人机的速度。此时,当一群无人机按照航线行驶时,将其中我们跟踪的无人机看作一个目标点,该目标点在寻找一个理想的路线,Pd(sd)=(pd(sd),qd(sd)),其中sd表示曲线长度边界,

Figure BDA00036605714900001511
表示开发焦点的假设无人机的速度。From the above formula, it can be seen that the input of each UAV contains the ground speed V gk , the heading angle rate ω k and the assumed speed of other UAVs. At this time, when a group of UAVs are traveling along the route, the UAV we are tracking is regarded as a target point, and the target point is looking for an ideal route, P d(sd) =(p d(sd) , q d(sd) ), where s d represents the curve length boundary,
Figure BDA00036605714900001511
The speed of the hypothetical drone representing the development focus.

设pe0=pd-p0,qe0=qd-q0,误差

Figure BDA0003660571490000155
是预测目标点的跟踪误差。现在,
Figure BDA0003660571490000156
可由下式得到:Let p e0 =p d -p 0 , q e0 =q d -q 0 , the error
Figure BDA0003660571490000155
is the tracking error of the predicted target point. Now,
Figure BDA0003660571490000156
It can be obtained by the following formula:

Figure BDA0003660571490000157
Figure BDA0003660571490000157

其中,

Figure BDA0003660571490000158
表示基本速度
Figure BDA0003660571490000159
是连续的,Ke是控制参数。可知,当误差
Figure BDA0003660571490000161
较小时,无人机速度向最大方向协调,当误差
Figure BDA0003660571490000162
较大时,无人机速度向最小方向协调。in,
Figure BDA0003660571490000158
Indicates base speed
Figure BDA0003660571490000159
is continuous, and Ke is the control parameter. It can be seen that when the error
Figure BDA0003660571490000161
When it is smaller, the speed of the UAV is coordinated to the maximum direction, when the error
Figure BDA0003660571490000162
When it is larger, the speed of the drone is coordinated to the minimum direction.

步骤S150:基于蝗虫算法,根据所述预测运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。Step S150: Based on the locust algorithm, according to the predicted motion data, the environmental wind parameters and the attitude data, optimize the initial flight path of the UAV.

蝗虫算法源于蝗虫活动特征,寻找食物来源是蝗虫群的重要行为,主要仿生原理是将幼虫的小范围移动行为映射为短步长的局部开发,成虫的大范围移动行为映射为长步长的全局探索,以类似“步坦协同”的方式进行寻优。行为周期可分为两个阶段:探测和开发。该行为的数值模型如下所示:The locust algorithm is derived from the characteristics of locust activity. Finding food sources is an important behavior of locust swarms. The main bionic principle is to map the small-scale movement of larvae to local development with short steps, and the large-scale movement of adults to long-step. Global exploration is carried out in a way similar to "step-tank coordination". The behavior cycle can be divided into two phases: exploration and development. The numerical model of this behavior is as follows:

Figure BDA0003660571490000163
Figure BDA0003660571490000163

其中Xi表示蝗虫i的位置,Si表示社交影响,G表示重力影响,A是风平流影响。where Xi represents the position of locust i , Si represents social influence, G represents gravitational influence, and A is wind advection influence.

Figure BDA0003660571490000164
Figure BDA0003660571490000164

上式中,s(r)=fe-r/l-e-r表示社会影响力系数,其中f、l分别为吸引强度参数、吸引尺度参数。N表示种群规模。dij=|Xj-Xi|,表示个体i与个体j间距。In the above formula, s(r)=fe- r /le- r represents the social influence coefficient, where f and l are the attraction strength parameter and the attraction scale parameter, respectively. N represents the population size. d ij =|X j -X i |, represents the distance between individual i and individual j.

蝗虫所受的重力影响

Figure BDA0003660571490000165
其中g表示引力,
Figure BDA0003660571490000166
表示指向地心的单位向量。Gravity effect on locusts
Figure BDA0003660571490000165
where g is the gravitational force,
Figure BDA0003660571490000166
Represents a unit vector pointing to the center of the Earth.

风平流影响

Figure BDA0003660571490000171
u表示恒定漂移因子(意为即使没有风也会发生的飞行运动偏移),ew表示指向风向的单位向量。wind advection
Figure BDA0003660571490000171
u is the constant drift factor (meaning the flight motion excursion that occurs even in the absence of wind), and e w is the unit vector pointing in the wind direction.

在多次迭代后,发现收敛性较差,于是将数值模型优化为:After many iterations, the convergence was found to be poor, so the numerical model was optimized as:

Figure BDA0003660571490000172
Figure BDA0003660571490000172

式中ub、lb分别为当前维度的上、下限,

Figure BDA0003660571490000173
是当前最优个体在当前维度的位置,并引入了缩小舒适区的递减系数c,其公式为:where ub and lb are the upper and lower limits of the current dimension, respectively,
Figure BDA0003660571490000173
is the position of the current optimal individual in the current dimension, and introduces a decreasing coefficient c that reduces the comfort zone. Its formula is:

Figure BDA0003660571490000174
Figure BDA0003660571490000174

其中cmax表示最极值(趋近于1),cmin表示最小值,I表示当前迭代,MaxI表示最大循环数。通过引入这个递减系数c,蝗虫能够更好地控制自己与别人的“亲近圈”,从而避免过度聚集,降低算法陷入局部最优的概率。Where cmax represents the extreme value (close to 1), cmin represents the minimum value, I represents the current iteration, and MaxI represents the maximum number of cycles. By introducing this decreasing coefficient c, locusts can better control their "closeness circle" with others, thereby avoiding excessive aggregation and reducing the probability of the algorithm falling into a local optimum.

Lay5第5层:它包括一个单独的节点,该节点被设置为S′,以执行基本加法器,等效结果表示为:Lay5 layer 5: It includes a single node, which is set to S', to perform a basic adder, the equivalent result is expressed as:

Figure BDA0003660571490000175
Figure BDA0003660571490000175

算法输出的是无人机的防撞躲避运动,从而实现对无人机的飞行路径进行优化的效果。The output of the algorithm is the collision avoidance and avoidance motion of the UAV, so as to achieve the effect of optimizing the flight path of the UAV.

基于同一发明构思,如图5所示,本发明实施例提供一种路径优化装置300,应用于无人机,所述无人机包括激光雷达,路径优化装置300包括:Based on the same inventive concept, as shown in FIG. 5 , an embodiment of the present invention provides a path optimization device 300, which is applied to an unmanned aerial vehicle. The unmanned aerial vehicle includes a laser radar, and the path optimization device 300 includes:

障碍物位置数据获取单元301,用于获取所述激光雷达在预设时间段内扫描到的多个连续的障碍物位置数据;An obstacle location data acquisition unit 301, configured to acquire a plurality of continuous obstacle location data scanned by the lidar within a preset time period;

预测单元302,用于在各所述障碍物位置数据中存在动态障碍物位置数据的情况下,预测所述动态障碍物位置数据所对应的动态障碍物的运动状态,获得所述动态障碍物的预测运动数据;The prediction unit 302 is configured to predict the motion state of the dynamic obstacle corresponding to the dynamic obstacle position data when there is dynamic obstacle position data in each of the obstacle position data, and obtain the motion state of the dynamic obstacle. Predict motion data;

环境参数获取单元303,用于获取环境风参数以及所述无人机的姿态数据,所述环境风参数包括所述无人机所处环境的风力、风向;An environmental parameter acquisition unit 303, configured to acquire environmental wind parameters and attitude data of the UAV, where the environmental wind parameters include wind force and wind direction of the environment where the UAV is located;

路径优化单元304,基于蝗虫算法,根据所述预测运动数据、所述环境风参数以及所述姿态数据,对所述无人机的初始飞行路径进行优化。The path optimization unit 304, based on the locust algorithm, optimizes the initial flight path of the UAV according to the predicted motion data, the environmental wind parameters and the attitude data.

关于上述路径优化装置300,其中各个单元的具体功能已经在本说明书提供的路径优化方法的实施例中进行了详细描述,此处将不做详细阐述说明。Regarding the above path optimization apparatus 300, the specific functions of each unit have been described in detail in the embodiments of the path optimization method provided in this specification, and will not be described in detail here.

基于同一发明构思,本发明说明书实施例提供了一种无人机,包括雷达、风力传感器、陀螺仪以及控制器,控制器分别与雷达、风力传感器、陀螺仪通信连接;雷达用于获取并向所述控制器反馈障碍物的位置数据;风力传感器用于获取并向控制器发送环境风参数;陀螺仪用于获取并向所述控制器发送无人机的姿态数据;控制器用于执行前文路径优化方法的任一方法的步骤。Based on the same inventive concept, the embodiments of the present specification provide an unmanned aerial vehicle, including a radar, a wind sensor, a gyroscope, and a controller, and the controller is respectively connected to the radar, the wind sensor, and the gyroscope in communication; The controller feeds back the position data of the obstacle; the wind sensor is used to obtain and send the environmental wind parameters to the controller; the gyroscope is used to obtain and send the attitude data of the UAV to the controller; the controller is used to execute the preceding path The steps of any one of the optimization methods.

基于同一发明构思,本发明说明书实施例提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现前文路径优化方法的任一方法的步骤。Based on the same inventive concept, the embodiments of the present specification provide a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the steps of any of the foregoing path optimization methods.

采用本发明实施例中的上述方案,至少能够部分达到以下效果:By adopting the above-mentioned solution in the embodiment of the present invention, at least part of the following effects can be achieved:

1、在无人机遇到动态障碍物时,通过对动态障碍物的运动状态进行预测,优化无人机的初始飞行路径,进而使无人机在飞行时能够有效地避免动态障碍物,防止无人机因为撞到动态障碍物而发生无人机损坏的情况出现。1. When the UAV encounters a dynamic obstacle, the initial flight path of the UAV can be optimized by predicting the motion state of the dynamic obstacle, so that the UAV can effectively avoid the dynamic obstacle and prevent the unmanned aerial vehicle from flying. The man-machine crashed into a dynamic obstacle and the UAV was damaged.

2、设置可见光相机获得辅助运动数据,使得对动态障碍物运动状态的预测更加准确。2. Set the visible light camera to obtain auxiliary motion data, which makes the prediction of the motion state of dynamic obstacles more accurate.

3、获取协同运动数据,并基于李雅普诺夫函数,消除协同运动数据的误差,提高无人机对多个动态障碍物的避障能力。3. Obtain cooperative motion data, and based on the Lyapunov function, eliminate the error of cooperative motion data and improve the UAV's ability to avoid obstacles to multiple dynamic obstacles.

在本发明所提供的几个实施例中,应该理解到,所揭露的装置和方法,也可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的,例如,附图中的流程图和框图显示了根据本发明的多个实施例的装置、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分,所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现方式中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个连续的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或动作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus and method may also be implemented in other manners. The apparatus embodiments described above are merely illustrative, for example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality and possible implementations of apparatuses, methods and computer program products according to various embodiments of the present invention. operate. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more functions for implementing the specified logical function(s) executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.

另外,在本发明各个实施例中的各功能模块可以集成在一起形成一个独立的部分,也可以是各个模块单独存在,也可以两个或两个以上模块集成形成一个独立的部分。In addition, each functional module in each embodiment of the present invention may be integrated to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.

所述功能如果以软件功能模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .

以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到的变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art who is familiar with the technical scope disclosed by the present invention can easily think of changes or substitutions. All should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (10)

1. A path optimization method, applied to a drone including a lidar, the method comprising:
acquiring a plurality of continuous obstacle position data scanned by the laser radar in a preset time period;
predicting the motion state of a dynamic obstacle corresponding to the dynamic obstacle position data under the condition that the dynamic obstacle position data exists in each obstacle position data to obtain predicted motion data of the dynamic obstacle;
acquiring environmental wind parameters and attitude data of the unmanned aerial vehicle, wherein the environmental wind parameters comprise wind power and wind direction of the environment where the unmanned aerial vehicle is located;
and optimizing the initial flight path of the unmanned aerial vehicle according to the predicted motion data, the environmental wind parameters and the attitude data based on the locust algorithm.
2. The path optimization method of claim 1, wherein the drone further includes a visible light camera, the method further comprising:
acquiring a plurality of continuous image data of a target area shot by the visible light camera in the preset time period, wherein the target area is an area where an obstacle corresponding to the dynamic obstacle position data is located;
predicting the motion state of the dynamic obstacle according to a plurality of continuous image data to obtain auxiliary motion data of the dynamic obstacle;
optimizing the predicted movement data based on the auxiliary movement data to obtain optimized predicted movement data;
the optimizing the initial flight path of the unmanned aerial vehicle comprises: and optimizing the initial flight path of the unmanned aerial vehicle according to the optimized predicted motion data, the environment wind parameter and the attitude data based on the locust algorithm.
3. The method for optimizing a route according to claim 2, wherein when the number of the dynamic obstacles corresponding to the dynamic obstacle position data is two or more, the method further comprises:
respectively acquiring optimized predicted movement data corresponding to each dynamic obstacle;
merging a plurality of optimized predicted motion data to obtain cooperative motion data;
the optimizing the initial flight path of the unmanned aerial vehicle comprises: and optimizing the initial flight path of the unmanned aerial vehicle according to the cooperative motion data, the environmental wind parameter and the attitude data based on the locust algorithm.
4. The path optimization method of claim 3, wherein prior to said optimizing the initial flight path of the drone, the method further comprises:
and eliminating the error of the cooperative motion data based on the Lyapunov function.
5. The path optimization method of claim 1, further comprising the step of obtaining the initial flight path, the step comprising:
acquiring an unmanned aerial vehicle map, wherein the unmanned aerial vehicle map comprises a target point location, a starting point location and a static barrier point location marked by a user;
and generating the initial flight path according to the starting point position, the target point position and the static obstacle point position.
6. The path optimization method of claim 5, wherein the method further comprises:
judging whether the position data corresponding to the static obstacle point position exists in the obstacle position data or not;
and if so, screening the obstacle position data except the position data corresponding to the static obstacle point position as the dynamic obstacle position data.
7. A path optimisation device, characterized in that, is applied to a drone, the drone includes a lidar, the device includes:
the obstacle position data acquisition unit is used for acquiring a plurality of continuous obstacle position data scanned by the laser radar in a preset time period;
the prediction unit is used for predicting the motion state of the dynamic obstacle corresponding to the dynamic obstacle position data under the condition that the dynamic obstacle position data exists in each obstacle position data to obtain the predicted motion data of the dynamic obstacle;
the environment parameter acquiring unit is used for acquiring environment wind parameters and attitude data of the unmanned aerial vehicle, wherein the environment wind parameters comprise wind power and wind direction of the environment where the unmanned aerial vehicle is located;
and the path optimization unit is used for optimizing the initial flight path of the unmanned aerial vehicle according to the predicted motion data, the environmental wind parameters and the attitude data based on the locust algorithm.
8. An unmanned aerial vehicle is characterized by comprising a radar, a wind sensor, a gyroscope and a controller, wherein the controller is respectively in communication connection with the radar, the wind sensor and the gyroscope;
the radar is used for acquiring and feeding back position data of the obstacle to the controller;
the wind power sensor is used for acquiring and sending environmental wind parameters to the controller;
the gyroscope is used for acquiring and sending attitude data of the unmanned aerial vehicle to the controller;
the controller is used for executing the path optimization method of any claim 1-6.
9. An electronic device, comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the path optimization method according to any one of claims 1 to 6 when executing the program.
10. A storage medium comprising a computer program, wherein the computer program controls an electronic device in which the storage medium is located to execute the path optimization method according to any one of claims 1 to 6 when the computer program runs.
CN202210576685.9A 2022-05-25 2022-05-25 A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium Pending CN114815894A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210576685.9A CN114815894A (en) 2022-05-25 2022-05-25 A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210576685.9A CN114815894A (en) 2022-05-25 2022-05-25 A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium

Publications (1)

Publication Number Publication Date
CN114815894A true CN114815894A (en) 2022-07-29

Family

ID=82517681

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210576685.9A Pending CN114815894A (en) 2022-05-25 2022-05-25 A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium

Country Status (1)

Country Link
CN (1) CN114815894A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120071686A (en) * 2025-03-26 2025-05-30 砺剑(青岛)装备技术有限公司 Low-altitude flight safety guide assisting system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112506222A (en) * 2020-12-10 2021-03-16 中国南方电网有限责任公司超高压输电公司天生桥局 Unmanned aerial vehicle intelligent obstacle avoidance method and device
CN112949366A (en) * 2020-04-01 2021-06-11 北京京东乾石科技有限公司 Obstacle identification method and device
CN114325759A (en) * 2021-12-31 2022-04-12 深兰人工智能(深圳)有限公司 Dynamic obstacle removal method and related methods and devices in lidar positioning

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112949366A (en) * 2020-04-01 2021-06-11 北京京东乾石科技有限公司 Obstacle identification method and device
CN112506222A (en) * 2020-12-10 2021-03-16 中国南方电网有限责任公司超高压输电公司天生桥局 Unmanned aerial vehicle intelligent obstacle avoidance method and device
CN114325759A (en) * 2021-12-31 2022-04-12 深兰人工智能(深圳)有限公司 Dynamic obstacle removal method and related methods and devices in lidar positioning

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
RITIKA THUSOO: "An Evaluation of UAV Path Following and Collision Avoidance Using NFMGOA Control Algorithm", WIRELESS PERSONAL COMMUNICATIONS, 21 August 2021 (2021-08-21), pages 1247 - 1266 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120071686A (en) * 2025-03-26 2025-05-30 砺剑(青岛)装备技术有限公司 Low-altitude flight safety guide assisting system

Similar Documents

Publication Publication Date Title
CN110546459B (en) Robot tracking navigation with data fusion
Kim et al. Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network
Achtelik et al. Autonomous navigation and exploration of a quadrotor helicopter in GPS-denied indoor environments
EP3470787B1 (en) Multi-sensor fusion for robust autonomous flight in indoor and outdoor environments with a rotorcraft micro-aerial vehicle (mav)
Desaraju et al. Vision-based landing site evaluation and informed optimal trajectory generation toward autonomous rooftop landing
Shukla et al. Trajectory-prediction techniques for unmanned aerial vehicles (UAVs): A comprehensive survey
CN111897316A (en) A multi-vehicle autonomous decision-making method under rapidly changing scene conditions
Xiao et al. Vision-based learning for drones: A survey
WO2023097769A1 (en) Unmanned ground vehicle-unmanned aerial vehicle collaborative autonomous tracking and landing method
WO2016200629A1 (en) Vehicle collision prevention
CN119146969A (en) Unmanned aerial vehicle path planning method and system, unmanned aerial vehicle and storage medium
CN114815894A (en) A path optimization method, device, electronic device, unmanned aerial vehicle and storage medium
Samuel et al. Improved IMM filter for tracking a highly maneuvering target with mixed system noises
Figetakis et al. UAV path planning using on-board ultrasound transducer arrays and edge support
CN120831119A (en) A real-time tracking planning method for UAVs based on multi-trajectory optimization and evaluation
Zhou et al. Learning short-term spatial–temporal dependency for UAV 2-D trajectory forecasting
CN119987409A (en) A method, device, medium and equipment for real-time path planning and obstacle avoidance of unmanned aerial vehicle
Sun et al. UAV autonomous obstacle avoidance via causal reinforcement learning
Yoon et al. Real-time adversarial image perturbations for autonomous vehicles using reinforcement learning
CN117369507A (en) An adaptive particle swarm algorithm-based UAV dynamic path planning method
Usayiwevu et al. Continuous planning for inertial-aided systems
Ramtoula et al. Msl-raptor: A 6dof relative pose tracker for onboard robotic perception
JP7459238B2 (en) Autonomous driving optimization method and system based on reinforcement learning based on user preferences
CN117232493A (en) Methods for SLAM for determining objects in the surrounding environment
Zhao et al. Active Vision-Based UAV Swarm With Limited FOV Flocking in Communication-Denied Scenarios

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20220729