[go: up one dir, main page]

CN106647814A - System and method of unmanned aerial vehicle visual sense assistant position and flight control based on two-dimensional landmark identification - Google Patents

System and method of unmanned aerial vehicle visual sense assistant position and flight control based on two-dimensional landmark identification Download PDF

Info

Publication number
CN106647814A
CN106647814A CN201611092540.2A CN201611092540A CN106647814A CN 106647814 A CN106647814 A CN 106647814A CN 201611092540 A CN201611092540 A CN 201611092540A CN 106647814 A CN106647814 A CN 106647814A
Authority
CN
China
Prior art keywords
information
target
module
camera
vector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201611092540.2A
Other languages
Chinese (zh)
Other versions
CN106647814B (en
Inventor
刘磊
谯睿智
王永骥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huazhong University of Science and Technology
Original Assignee
Huazhong University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huazhong University of Science and Technology filed Critical Huazhong University of Science and Technology
Priority to CN201611092540.2A priority Critical patent/CN106647814B/en
Publication of CN106647814A publication Critical patent/CN106647814A/en
Application granted granted Critical
Publication of CN106647814B publication Critical patent/CN106647814B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/12Target-seeking control

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Navigation (AREA)

Abstract

本发明公开了一种基于二维码地标识别的无人机视觉辅助定位与飞控系统及方法,该系统包括无人机本体、传感器模块、跟踪轨迹生成模块、视觉处理模块、传感器更新模块、飞行控制模块、视觉辅助控制切换模块、指令输出模块以及摄像头,通过对航线特定位置上布置的二维码标志物进行视觉提取,融合惯性导航系统进行精确位置和姿态信息的计算,进而辅助和提高传统GPS组合导航系统的精度,同时通过二维码编码信息为无人机提供多元化信息指引,拓展飞行任务的多样性,另外,提出一种基于偏差的自适应补偿控制的级联飞行控制系统,实现标志物识别状态和未识别状态的平滑过渡,提高飞行控制的稳定性,进而提高识别的精准度和快速性。

The invention discloses a UAV visual aided positioning and flight control system and method based on two-dimensional code landmark recognition. The system includes a UAV body, a sensor module, a tracking trajectory generation module, a visual processing module, a sensor update module, The flight control module, the visual aid control switching module, the command output module and the camera, through the visual extraction of the two-dimensional code markers arranged on the specific position of the route, integrate the inertial navigation system to calculate the precise position and attitude information, and then assist and improve The accuracy of the traditional GPS integrated navigation system, while providing diversified information guidance for UAVs through two-dimensional code code information, expanding the diversity of flight missions, in addition, a cascade flight control system based on deviation-based adaptive compensation control is proposed , to achieve a smooth transition between the marker recognition state and the unrecognized state, improve the stability of flight control, and then improve the accuracy and speed of recognition.

Description

一种基于二维码地标识别的无人机视觉辅助定位与飞控系统 及方法A vision-assisted positioning and flight control system for UAV based on two-dimensional code landmark recognition and methods

技术领域technical field

本发明属于无人飞行器技术领域,更具体地,涉及一种基于二维码地标识别的无人机视觉辅助定位与飞控系统及方法。The invention belongs to the technical field of unmanned aerial vehicles, and more specifically relates to a visual aided positioning and flight control system and method for an unmanned aerial vehicle based on two-dimensional code identification.

背景技术Background technique

近年来随着智能科学与控制科学的发展,无人机成为了当前比较热门的一个研究话题。目前无人机广泛应用于航拍、大地测绘、地质救援、火灾救援、交通监控等领域。无人机不但具有实际的社会应用价值,在工程和学术也有重要的研究意义,例如农业植保、电力巡检、森林防火、检灾等领域,具有广阔的发展前景。In recent years, with the development of intelligence science and control science, UAV has become a hot research topic. At present, drones are widely used in aerial photography, land surveying and mapping, geological rescue, fire rescue, traffic monitoring and other fields. UAVs not only have practical social application value, but also have important research significance in engineering and academia, such as agricultural plant protection, power inspection, forest fire prevention, disaster detection and other fields, and have broad development prospects.

在无人机的自动飞行中,传统的组合导航技术受限于GPS精度问题,在位置精度上约为±2m左右,在对航线飞行、悬停精度要求比较高的场合,例如快递物流投送,救灾支援,上舰作战,自动返回充电等应用,往往需要采用其他设备来辅助以提高飞行时抵达目标点的精度,具有一定的局限性。In the automatic flight of UAVs, the traditional integrated navigation technology is limited by the GPS accuracy problem, and the position accuracy is about ±2m. In the occasions where the flight route and hovering accuracy are relatively high, such as express logistics delivery , Disaster relief support, combat on board, automatic return to charging and other applications often require the use of other equipment to assist in improving the accuracy of reaching the target point during flight, which has certain limitations.

发明内容Contents of the invention

针对现有技术的以上缺陷或改进需求,本发明提供了一种基于二维码地标精准识别的无人机视觉辅助定位与飞控系统,在航线的特定位置上布置若干个以二维码形式的标志物作为关键点,通过对二维码标志物进行视觉提取,融合惯性导航系统进行精确位置和姿态信息的计算,进而辅助和提高传统GPS组合导航系统的精度,同时通过二维码的编码信息为无人机提供多元化信息指引,拓展飞行任务的多样性。另外,提出一种基于偏差的自适应补偿控制的级联飞行控制系统,实现标志物识别状态和未识别状态的平滑过渡,提高飞行控制的稳定性,进而提高识别的精准度和快速性,由此解决现有技术中传统组合导航技术受限于GPS精度问题,位置精度较低,需要采用其他设备来辅助以提高飞行时抵达目标点的精度的技术问题。In view of the above defects or improvement needs of the prior art, the present invention provides a UAV visual aided positioning and flight control system based on the precise recognition of two-dimensional code landmarks. As the key point, through the visual extraction of the two-dimensional code markers, the calculation of the precise position and attitude information is fused with the inertial navigation system, thereby assisting and improving the accuracy of the traditional GPS integrated navigation system, and at the same time through the coding of the two-dimensional code Information provides diversified information guidance for drones and expands the diversity of flight missions. In addition, a cascaded flight control system based on deviation-based adaptive compensation control is proposed to realize the smooth transition between the marker recognition state and the unrecognized state, improve the stability of flight control, and then improve the accuracy and rapidity of recognition. This solves the technical problem that the traditional integrated navigation technology in the prior art is limited by the GPS accuracy, the position accuracy is low, and other equipment needs to be assisted to improve the accuracy of reaching the target point during flight.

为实现上述目的,按照本发明的一个方面,提供了一种基于二维码地标识别的无人机视觉辅助定位与飞控系统,其特征在于,包括:无人机本体、传感器模块、跟踪轨迹生成模块、视觉处理模块、传感器更新模块、飞行控制模块、指令输出模块、视觉辅助控制切换模块以及摄像头:In order to achieve the above object, according to one aspect of the present invention, a vision-assisted positioning and flight control system for unmanned aerial vehicles based on two-dimensional code landmark recognition is provided, which is characterized in that it includes: an unmanned aerial vehicle body, a sensor module, a tracking track Generation module, vision processing module, sensor update module, flight control module, command output module, visual aid control switching module and camera:

所述传感器模块用于获取所述无人机本体的位置信息以及所述无人机本体的第一运动速度矢量;The sensor module is used to obtain the position information of the UAV body and the first motion velocity vector of the UAV body;

所述跟踪轨迹生成模块用于根据预设的任务航点信息生成航线跟踪轨迹,并对所述航线跟踪轨迹进行离散处理得到N个期望航点,N为正整数;The tracking track generation module is used to generate route tracking tracks according to preset mission waypoint information, and perform discrete processing on the route tracking tracks to obtain N expected waypoints, where N is a positive integer;

所述视觉处理模块用于根据所述摄像头获取得到的二维码标志物的图像获取所述二维码标志物的位置信息、姿态信息以及编码信息,由所述位置信息、姿态信息以及编码信息得到所述摄像头相对于所述二维码标志物的偏离距离矢量以及所述摄像头相对于所述二维码标志物的第二运动速度矢量;The vision processing module is used to acquire the position information, attitude information and encoding information of the two-dimensional code marker according to the image of the two-dimensional code marker acquired by the camera, and the position information, attitude information and encoding information Obtaining a deviation distance vector of the camera relative to the two-dimensional code marker and a second motion velocity vector of the camera relative to the two-dimensional code marker;

所述传感器更新模块用于利用所述无人机本体的位置信息、所述第一运动速度矢量、所述偏离距离矢量以及所述第二运动速度矢量通过卡尔曼滤波算法进行多传感器信息融合,得到经卡尔曼滤波算法滤波后的无人机本体的目标位置信息、目标第一运动速度矢量、目标偏离距离矢量以及目标第二运动速度矢量;The sensor update module is used to use the position information of the UAV body, the first motion velocity vector, the deviation distance vector and the second motion velocity vector to perform multi-sensor information fusion through a Kalman filter algorithm, Obtain the target position information of the drone body filtered by the Kalman filter algorithm, the first target motion velocity vector, the target deviation distance vector and the target second motion velocity vector;

所述飞行控制模块用于利用目标期望航点的期望位置、目标期望航点的期望速度矢量、所述目标位置信息、所述目标第一运动速度矢量、所述目标偏离距离矢量以及所述目标第二运动速度矢量通过偏差自适应补偿生成制导指令,将所述制导指令发送给所述指令输出模块,其中,所述目标期望航点为无人机当前正在前往的航点,所述制导指令包括横滚角和俯仰角;The flight control module is used to utilize the expected position of the target expected waypoint, the expected velocity vector of the target expected waypoint, the target position information, the target first motion velocity vector, the target deviation distance vector and the target The second motion velocity vector generates a guidance instruction through deviation adaptive compensation, and sends the guidance instruction to the instruction output module, wherein the target desired waypoint is the waypoint that the drone is currently heading to, and the guidance instruction including roll and pitch angles;

所述视觉辅助控制切换模块,用于在所述二维码标志物处于识别状态时,控制所述飞行控制模块根据所述传感器模块和所述视觉处理模块得到的信息计算制导指令,在所述二维码标志物处于未识别状态时,控制所述飞行控制模块仅根据所述传感器模块得到的信息计算制导指令;The visual aid control switching module is used to control the flight control module to calculate guidance instructions according to the information obtained by the sensor module and the visual processing module when the two-dimensional code marker is in the recognition state. When the two-dimensional code marker is in an unrecognized state, control the flight control module to calculate guidance instructions only according to the information obtained by the sensor module;

所述指令输出模块用于输出所述制导指令。The command output module is used to output the guidance command.

优选地,所述摄像头位于所述无人机本体的底部,并且所述摄像头的视场方向垂直朝下。Preferably, the camera is located at the bottom of the drone body, and the field of view of the camera is vertically downward.

优选地,所述视觉处理模块包括图像灰度化模块、图像二值化模块、二值图处理模块、二维码信息提取模块以及位置姿态获取模块,Preferably, the visual processing module includes an image grayscale module, an image binarization module, a binary image processing module, a two-dimensional code information extraction module, and a position and attitude acquisition module,

所述图像灰度化模块用于将所述二维码标志物的图像转化为单通道灰度图;The image grayscale module is used to convert the image of the two-dimensional code marker into a single-channel grayscale image;

所述图像二值化模块用于根据单通道灰度图设定一个固定阀值,将灰度图转化为二值图;The image binarization module is used to set a fixed threshold according to the single-channel grayscale image, and convert the grayscale image into a binary image;

所述二值图处理模块用于对所述二值图进行轮廓检测,遍历所述二值图中所有边个数为4的多边形,并剔除面积小于预设阈值的多边形,然后将剩余的边个数为4的多边形进行正交投影,得到标准的正方形图像;The binary image processing module is used for performing contour detection on the binary image, traversing all polygons with four sides in the binary image, and removing polygons whose area is smaller than a preset threshold, and then converting the remaining edges Orthogonal projection of 4 polygons to obtain a standard square image;

所述二维码信息提取模块用于按照预设的编码信息规则提取所述正方形图像中的二进制编码信息和角点信息;The two-dimensional code information extraction module is used to extract binary coded information and corner information in the square image according to preset coded information rules;

所述位置姿态获取模块用于根据提取的二进制编码信息和角点信息得到所述摄像头相对于所述二维码标志物的偏离距离矢量以及所述摄像头相对于所述二维码标志物的第二运动速度矢量。The position and posture acquisition module is used to obtain the deviation distance vector of the camera relative to the two-dimensional code marker and the first position of the camera relative to the two-dimensional code marker according to the extracted binary code information and corner point information. Two motion velocity vectors.

按照本发明的另一方面,提供了一种基于二维码地标识别的无人机视觉辅助定位与飞控方法,其特征在于,包括:According to another aspect of the present invention, a visual aided positioning and flight control method for UAV based on two-dimensional code landmark recognition is provided, which is characterized in that it includes:

S1:获取无人机的位置信息以及无人机的第一运动速度矢量;S1: Obtain the position information of the UAV and the first motion velocity vector of the UAV;

S2:根据预设的任务航点信息生成航线跟踪轨迹,并对所述航线跟踪轨迹进行离散处理得到N个期望航点,N为正整数;S2: Generate route tracking trajectories according to preset mission waypoint information, and perform discrete processing on the route tracking trajectories to obtain N expected waypoints, where N is a positive integer;

S3:根据摄像头获取得到的二维码标志物的图像获取所述二维码标志物的位置信息、姿态信息以及编码信息,由所述位置信息、姿态信息以及编码信息得到所述摄像头相对于所述二维码标志物的偏离距离矢量以及所述摄像头相对于所述二维码标志物的第二运动速度矢量;S3: Acquire the position information, posture information and coding information of the two-dimensional code marker according to the image of the two-dimensional code marker obtained by the camera, and obtain the relative position of the camera relative to the coding information from the position information, posture information and coding information The deviation distance vector of the two-dimensional code marker and the second motion velocity vector of the camera relative to the two-dimensional code marker;

S4:利用所述无人机的位置信息、所述第一运动速度矢量、所述偏离距离矢量以及所述第二运动速度矢量通过卡尔曼滤波算法进行多传感器信息融合,得到经卡尔曼滤波算法滤波后的无人机的目标位置信息、目标第一运动速度矢量、目标偏离距离矢量以及目标第二运动速度矢量;S4: Using the position information of the UAV, the first motion speed vector, the deviation distance vector and the second motion speed vector to perform multi-sensor information fusion through the Kalman filter algorithm, and obtain the Kalman filter algorithm The target position information of the filtered UAV, the first target motion velocity vector, the target deviation distance vector and the target second motion velocity vector;

S5:利用目标期望航点的期望位置、目标期望航点的期望速度矢量、所述目标位置信息、所述目标第一运动速度矢量、所述目标偏离距离矢量以及所述目标第二运动速度矢量通过偏差自适应补偿生成制导指令,其中,所述目标期望航点为无人机当前正在前往的航点,所述制导指令包括横滚角和俯仰角;S5: Utilize the expected position of the target's expected waypoint, the expected speed vector of the target's expected waypoint, the target position information, the target's first motion speed vector, the target's deviation distance vector, and the target's second motion speed vector A guidance instruction is generated by adaptive offset compensation, wherein the target desired waypoint is the waypoint the UAV is currently heading to, and the guidance instruction includes a roll angle and a pitch angle;

S6:输出所述制导指令。S6: Outputting the guidance instruction.

优选地,所述摄像头位于所述无人机的底部,并且所述摄像头的视场方向垂直朝下。Preferably, the camera is located at the bottom of the drone, and the field of view of the camera is vertically downward.

优选地,步骤S3具体包括以下子步骤:Preferably, step S3 specifically includes the following sub-steps:

S301:将所述二维码标志物的图像转化为单通道灰度图;S301: Convert the image of the two-dimensional code marker into a single-channel grayscale image;

S302:根据单通道灰度图设定一个固定阀值,将灰度图转化为二值图;S302: Set a fixed threshold according to the single-channel grayscale image, and convert the grayscale image into a binary image;

S303:对所述二值图进行轮廓检测,遍历所述二值图中所有边个数为4的多边形,并剔除面积小于预设阈值的多边形,然后将剩余的边个数为4的多边形进行正交投影,得到标准的正方形图像;S303: Perform contour detection on the binary image, traverse all polygons with 4 sides in the binary image, and eliminate polygons whose area is smaller than a preset threshold, and then perform the remaining polygons with 4 sides Orthogonal projection to get a standard square image;

S304:按照预设的编码信息规则提取所述正方形图像中的二进制编码信息和角点信息;S304: Extract binary coded information and corner point information in the square image according to preset coded information rules;

S305:根据提取的二进制编码信息和角点信息得到所述摄像头相对于所述二维码标志物的偏离距离矢量以及所述摄像头相对于所述二维码标志物的第二运动速度矢量。S305: Obtain a deviation distance vector of the camera relative to the two-dimensional code marker and a second motion velocity vector of the camera relative to the two-dimensional code marker according to the extracted binary code information and corner point information.

总体而言,通过本发明所构思的以上技术方案与现有技术相比,主要有以下的技术优点:Generally speaking, compared with the prior art, the above technical solution conceived by the present invention mainly has the following technical advantages:

(1)通过对地面特定位置上布置的二维码标志物进行识别,利用二维码的编码技术获取地标信息,并融合多种传感器信息,来提高无人机的定位精度,从而辅助和提高传统GPS组合导航系统的精度,同时由于二维编码能够提供丰富的地标信息且具有加密能力,能够为无人机提供多元化信息指引,进而扩展飞行任务的多样性;(1) By identifying the two-dimensional code markers arranged on a specific position on the ground, using two-dimensional code coding technology to obtain landmark information, and fusing various sensor information to improve the positioning accuracy of the drone, thereby assisting and improving The accuracy of the traditional GPS integrated navigation system, and because the two-dimensional code can provide rich landmark information and has encryption capabilities, it can provide diversified information guidance for UAVs, thereby expanding the diversity of flight missions;

(2)在标志物识别状态和未识别状态采用同一个级联的飞行控制系统,并提出了一种基于偏差的自适应补偿控方法,在标志物目标识别状态下对获取到的额外位置信息进行补偿,能够实现标志物识别状态和未识别状态的平滑过渡,提高飞行控制的稳定性,保证旋翼无人机在各种干扰环境下都能实现快速精准识别。(2) The same cascaded flight control system is used in the marker recognition state and the unrecognized state, and a deviation-based adaptive compensation control method is proposed, and the additional position information obtained in the marker target recognition state Compensation can achieve a smooth transition between the marker recognition state and the unrecognized state, improve the stability of flight control, and ensure that the rotor UAV can achieve fast and accurate recognition in various interference environments.

附图说明Description of drawings

图1为本发明实施例公开的一种无人机高精度自主飞行的硬件结构图;Fig. 1 is a hardware structure diagram of a kind of unmanned aerial vehicle high-precision autonomous flight disclosed by the embodiment of the present invention;

图2为本发明实施例公开的一种基于二维码地标识别的无人机视觉辅助定位与飞控系统的结构示意图;Fig. 2 is a schematic structural diagram of a UAV visual aided positioning and flight control system based on two-dimensional code landmark recognition disclosed in an embodiment of the present invention;

图3为本发明实施例公开的一种基于二维码地标识别的无人机视觉辅助定位与飞控系统各模块的信息交互图;Fig. 3 is an information interaction diagram of the visual aided positioning of a UAV based on two-dimensional code landmark recognition and the modules of the flight control system disclosed in the embodiment of the present invention;

图4为本发明实施例公开的一种基于二维码地标识别的无人机视觉辅助定位与飞控方法的流程示意图;4 is a schematic flow diagram of a method for visually aided positioning and flight control of a drone based on two-dimensional code landmark recognition disclosed in an embodiment of the present invention;

图5为本发明实施例公开的一种无人机高精度自主飞行的流程示意图。Fig. 5 is a schematic flow chart of a high-precision autonomous flight of a drone disclosed in an embodiment of the present invention.

具体实施方式detailed description

为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。此外,下面所描述的本发明各个实施方式中所涉及到的技术特征只要彼此之间未构成冲突就可以相互组合。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

图1所示为本发明实施例公开的一种无人机高精度自主飞行的硬件结构图,在图1所示的硬件结构图中,图1左上部分为导航传感器集合,可以包括加速度计、陀螺仪、超声波传感器、气压计、磁力计以及GPS模块等,其中各传感器可以通过IIC和SPI接口与图1左下部分的飞行控制主板通讯,图1右下部分为无人机上的摄像头,可以通过USB2.0接口与图1右上部分的视觉处理主板通讯,视觉处理主板可以通过TTL串口与飞行控制主板通讯。Fig. 1 shows the hardware structure diagram of a kind of unmanned aerial vehicle high-precision autonomous flight disclosed by the embodiment of the present invention. In the hardware structure diagram shown in Fig. 1, the upper left part of Fig. 1 is a set of navigation sensors, which can include accelerometer, Gyroscopes, ultrasonic sensors, barometers, magnetometers, and GPS modules, etc., each of which can communicate with the flight control board in the lower left part of Figure 1 through IIC and SPI interfaces, and the lower right part of Figure 1 is the camera on the drone, which can The USB2.0 interface communicates with the vision processing board in the upper right part of Figure 1, and the vision processing board can communicate with the flight control board through the TTL serial port.

其中,飞行控制主板可以采用STM32F407嵌入式处理器,运行主频为168Mhz。导航传感器具体可以包括:MPU6050陀螺仪和加速度计,MS5611高精度气压计,M8NGPS接收机,US100超声波测距仪。视觉处理主板可以采用S5P4418高性能处理器,运行主频为1.4Ghz,具有1GB DDR3运行内存。摄像头可以为KS2A17,与视觉处理主板通信方式可以为USB2.0,在640×480分辨率下,最大帧率为120fps。视觉处理主板与飞行控制主板可以用TTL串口连接的方式进行数据通信。Among them, the flight control main board can adopt STM32F407 embedded processor, and the operating frequency is 168Mhz. Navigation sensors can specifically include: MPU6050 gyroscope and accelerometer, MS5611 high-precision barometer, M8NGPS receiver, US100 ultrasonic range finder. The visual processing main board can adopt S5P4418 high-performance processor, the operating frequency is 1.4Ghz, and it has 1GB DDR3 operating memory. The camera can be KS2A17, and the communication method with the visual processing main board can be USB2.0, and the maximum frame rate is 120fps under the resolution of 640×480. The vision processing main board and the flight control main board can use TTL serial port connection for data communication.

图2为本发明实施例公开的一种基于二维码地标识别的无人机视觉辅助定位与飞控系统的结构示意图,图3为本发明实施例公开的一种基于二维码地标识别的无人机视觉辅助定位与飞控系统各模块的信息交互图。如图2和图3所示,本发明所述系统包括无人机本体、传感器模块、跟踪轨迹生成模块、视觉处理模块、传感器更新模块、飞行控制模块、指令输出模块、视觉辅助控制切换模块以及摄像头。Figure 2 is a schematic structural diagram of a UAV visual aided positioning and flight control system based on two-dimensional code landmark recognition disclosed in an embodiment of the present invention, and Figure 3 is a structural diagram of a two-dimensional code-based landmark recognition disclosed in an embodiment of the present invention Information interaction diagram of each module of UAV visual aided positioning and flight control system. As shown in Figure 2 and Figure 3, the system of the present invention includes a UAV body, a sensor module, a tracking trajectory generation module, a visual processing module, a sensor update module, a flight control module, an instruction output module, a visual aid control switching module and Camera.

其中,上述传感器模块用于获取无人机本体的位置信息以及无人机本体的第一运动速度矢量;Wherein, the above-mentioned sensor module is used to obtain the position information of the UAV body and the first motion velocity vector of the UAV body;

上述跟踪轨迹生成模块用于根据预设的任务航点信息生成航线跟踪轨迹,并对上述航线跟踪轨迹进行离散处理得到N个期望航点,N为正整数;The tracking track generating module is used to generate route tracking tracks according to preset mission waypoint information, and perform discrete processing on the above route tracking tracks to obtain N expected waypoints, where N is a positive integer;

上述视觉处理模块用于根据摄像头获取得到的二维码标志物的图像获取该二维码标志物的位置信息、姿态信息以及编码信息,由上述位置信息、姿态信息以及编码信息得到摄像头相对于二维码标志物的偏离距离矢量以及摄像头相对于二维码标志物的第二运动速度矢量;The above-mentioned visual processing module is used to obtain the position information, attitude information and coding information of the two-dimensional code marker according to the image of the two-dimensional code marker acquired by the camera, and obtain the relative position of the camera relative to the two-dimensional code from the above position information, attitude information and coding information. The deviation distance vector of the two-dimensional code marker and the second motion velocity vector of the camera relative to the two-dimensional code marker;

其中,摄像头位于无人机本体的底部,并且摄像头的视场方向垂直朝下。Wherein, the camera is located at the bottom of the drone body, and the field of view of the camera is vertically downward.

其中,视觉处理模块包括图像灰度化模块、图像二值化模块、二值图处理模块、二维码信息提取模块以及位置姿态获取模块,Among them, the visual processing module includes an image grayscale module, an image binarization module, a binary image processing module, a two-dimensional code information extraction module, and a position and posture acquisition module,

上述图像灰度化模块用于将二维码标志物的图像转化为单通道灰度图;The above-mentioned image grayscale module is used to convert the image of the two-dimensional code marker into a single-channel grayscale image;

上述图像二值化模块用于根据单通道灰度图设定一个固定阀值,将灰度图转化为二值图;The above image binarization module is used to set a fixed threshold value according to the single-channel grayscale image, and convert the grayscale image into a binary image;

上述二值图处理模块用于对二值图进行轮廓检测,遍历二值图中所有边个数为4的多边形,并剔除面积小于预设阈值的多边形,然后将剩余的边个数为4的多边形进行正交投影,得到标准的正方形图像;The above-mentioned binary image processing module is used to perform contour detection on the binary image, traverse all polygons with 4 sides in the binary image, and eliminate polygons whose area is smaller than the preset threshold, and then convert the remaining polygons with 4 sides Orthogonal projection of the polygon to obtain a standard square image;

上述二维码信息提取模块用于按照预设的编码信息规则提取正方形图像中的二进制编码信息和角点信息;The two-dimensional code information extraction module is used to extract binary coded information and corner information in a square image according to preset coded information rules;

上述位置姿态获取模块用于根据提取的二进制编码信息和角点信息得到摄像头相对于二维码标志物的偏离距离矢量以及摄像头相对于二维码标志物的第二运动速度矢量。The above-mentioned position and posture acquisition module is used to obtain the deviation distance vector of the camera relative to the two-dimensional code marker and the second motion velocity vector of the camera relative to the two-dimensional code marker according to the extracted binary code information and corner point information.

其中,二维码标志物的尺寸为m厘米×m厘米,得到的二维码标志物的角点信息表示在摄像头的图像坐标下的位置信息,由于后续主要是对航点飞行误差进行补偿,因此统一规定二维码标志物的四个角点现实世界坐标分别为(m,m,0),(m,0,0),(0,m,0),(0,0,0),摄像机成像原理:s·m'=A·[R|T]·M,其中A为摄像头内参矩阵,可以通过实验标定得到,m'为摄像头在摄像头坐标系下的位置,M为摄像头在现实世界坐标系下的位置,[R|T]为旋转平移矩阵,也就是摄像头在现实世界坐标系下相对于某一个点的位置和姿态,即可求出摄像头相对于二维码标志物的偏离距离矢量以及摄像头相对于二维码标志物的第二运动速度矢量。Among them, the size of the two-dimensional code marker is m cm × m cm, and the obtained corner information of the two-dimensional code marker represents the position information under the image coordinates of the camera. Since the follow-up is mainly to compensate the flight error of the waypoint, Therefore, it is uniformly stipulated that the real world coordinates of the four corners of the two-dimensional code marker are (m, m, 0), (m, 0, 0), (0, m, 0), (0, 0, 0), Camera imaging principle: s·m'=A·[R|T]·M, where A is the internal reference matrix of the camera, which can be obtained through experimental calibration, m' is the position of the camera in the camera coordinate system, and M is the position of the camera in the real world The position in the coordinate system, [R|T] is the rotation and translation matrix, that is, the position and attitude of the camera relative to a certain point in the real world coordinate system, and the deviation distance of the camera relative to the two-dimensional code marker can be calculated vector and the second motion velocity vector of the camera relative to the two-dimensional code marker.

上述传感器更新模块用于利用无人机本体的位置信息、第一运动速度矢量、偏离距离矢量以及第二运动速度矢量通过卡尔曼滤波算法进行多传感器信息融合,得到经卡尔曼滤波算法滤波后的无人机本体的目标位置信息、目标第一运动速度矢量、目标偏离距离矢量以及目标第二运动速度矢量。The above sensor update module is used to use the position information of the UAV body, the first motion velocity vector, the deviation distance vector and the second motion velocity vector to perform multi-sensor information fusion through the Kalman filter algorithm, and obtain the Kalman filter algorithm filtered The target position information of the UAV body, the first target motion speed vector, the target deviation distance vector and the target second motion speed vector.

其中,可以通过设计卡尔曼滤波器对多传感器信息进行融合,来提高测量精度。卡尔曼滤波器的状态更新公式为:Among them, the measurement accuracy can be improved by designing a Kalman filter to fuse multi-sensor information. The state update formula of the Kalman filter is:

其中,θ、γ为旋转矩阵R中的俯仰角和横滚角,V是现实世界坐标下的无人机速度矢量,a是现实世界坐标下的无人机加速度矢量,ab是无人机坐标下的加速度矢量,可以由无人机中的加速度计测量得到,wb是无人机坐标下的角速度矢量,可以由无人机中的陀螺仪测量得到,Δt为滤波器更新间隔时间。Among them, θ and γ are the pitch and roll angles in the rotation matrix R, V is the velocity vector of the drone in the real world coordinates, a is the acceleration vector of the drone in the real world coordinates, a b is the drone The acceleration vector under the coordinates can be measured by the accelerometer in the drone, w b is the angular velocity vector under the coordinates of the drone, which can be measured by the gyroscope in the drone, and Δt is the filter update interval.

上述飞行控制模块用于利用目标期望航点的期望位置、目标期望航点的期望速度矢量、目标位置信息、目标第一运动速度矢量、目标偏离距离矢量以及目标第二运动速度矢量通过偏差自适应补偿生成制导指令,将该制导指令发送给指令输出模块,其中,目标期望航点为无人机当前正在前往的航点,制导指令包括横滚角和俯仰角;The above-mentioned flight control module is used to use the expected position of the target expected waypoint, the expected speed vector of the target expected waypoint, the target position information, the first target motion speed vector, the target deviation distance vector and the target second motion speed vector to pass the deviation self-adaptation Compensation generates a guidance command, and sends the guidance command to the command output module, wherein the desired waypoint of the target is the waypoint that the UAV is currently going to, and the guidance command includes a roll angle and a pitch angle;

其中,高精度飞行的控制目标就是使得无人机的位置收敛到目标期望航点集合的足够小的邻域内。在有视觉辅助的高精度飞行阶段时,由于视觉设备测量的精度优于传统导航设备,此时需要对控制器中的输入量进行补偿:Among them, the control goal of high-precision flight is to make the position of the UAV converge to a sufficiently small neighborhood of the desired waypoint set of the target. In the high-precision flight stage with visual aids, since the measurement accuracy of the visual equipment is better than that of the traditional navigation equipment, it is necessary to compensate the input quantity in the controller at this time:

Verr(t)=[Vd(t)-w3·V(t)]-w4·Vvision(t)V err (t)=[V d (t)-w 3 ·V(t)]-w 4 ·V vision (t)

其中,Pd(t),Vd(t)分别为无人机的期望位置和期望速度输入矢量,Perr(t),Verr(t)分别为位置外环控制器和速度内环控制器的误差输入向量,P(t),V(t)分别为传统GPS组合导航系统计算得到的无人机的位置向量和运动速度向量,T(t),Vvision(t)分别为视觉处理模块计算得到的无人机相对目标二维码标志物的偏离距离向量和运动速度向量,w1,w2,w3,w4为补偿权重系数,一般可取w1=w2,w3=w4,补偿权重系数可以取固定值,也可以采用自适应的方式确定:Among them, P d (t), V d (t) are the desired position and speed input vectors of the UAV, respectively, P err (t), Verr (t) are the position outer loop controller and the speed inner loop control The error input vector of the device, P(t), V(t) are the position vector and motion velocity vector of the UAV calculated by the traditional GPS integrated navigation system, respectively, T(t), V vision (t) are the vision processing The deviation distance vector and motion velocity vector of the UAV relative to the target two-dimensional code marker calculated by the module, w 1 , w 2 , w 3 , and w 4 are the compensation weight coefficients, generally w 1 = w 2 , w 3 = w 4 , the compensation weight coefficient can take a fixed value, or it can be determined in an adaptive way:

w2=1-w1 w 2 =1-w 1

在无人机飞行过程中,受到摄像头视场范围限制和实际飞行环境干扰影响,会对无人机的标志物提取信息精准度带来影响,传统无人机控制系统在地面标志物未识别过程和识别成功后的控制中分别采用不同的控制策略,因此,飞行控制模块会在地面标志物识别和未识别两种状态下频繁切换,造成控制不稳定。本发明在地面标志物识别状态和未识别状态采用同一个级联的飞行控制模块,即采用一个飞行控制模块,并提出了一种基于偏差的自适应补偿控制方法,在地面标志物识别状态下对获取到的额外位置和运动速度信息进行补偿。能够实现地面标志物识别状态和未识别状态平滑过渡,提高飞行控制的稳定性,保证无人机在各种环境下都能实现高精准度飞行。During the flight of the UAV, the limitation of the field of view of the camera and the interference of the actual flight environment will affect the accuracy of the UAV marker extraction information. The traditional UAV control system does not recognize the ground markers. Therefore, the flight control module will frequently switch between the two states of ground marker recognition and non-recognition, resulting in unstable control. The present invention adopts the same cascaded flight control module in the ground marker recognition state and the unrecognized state, that is, one flight control module is used, and a deviation-based self-adaptive compensation control method is proposed. Compensate for the acquired additional position and motion velocity information. It can realize the smooth transition between the ground marker recognition state and the unrecognized state, improve the stability of flight control, and ensure that the UAV can achieve high-precision flight in various environments.

上述指令输出模块用于输出上述制导指令。The above-mentioned instruction output module is used for outputting the above-mentioned guidance instruction.

图4为本发明实施例公开的一种基于二维码地标识别的无人机视觉辅助定位与飞控方法的流程示意图,其中,图4所示的方法包括以下步骤:Fig. 4 is a schematic flowchart of a method for visually aided positioning and flight control of a drone based on two-dimensional code landmark recognition disclosed in an embodiment of the present invention, wherein the method shown in Fig. 4 includes the following steps:

S1:获取无人机的位置信息以及无人机的第一运动速度矢量;S1: Obtain the position information of the UAV and the first motion velocity vector of the UAV;

S2:根据预设的任务航点信息生成航线跟踪轨迹,并对所述航线跟踪轨迹进行离散处理得到N个期望航点,N为正整数;S2: Generate route tracking trajectories according to preset mission waypoint information, and perform discrete processing on the route tracking trajectories to obtain N expected waypoints, where N is a positive integer;

S3:根据摄像头获取到的预先布置的二维码标志物的图像进行精准识别;S3: Accurately identify images of pre-arranged two-dimensional code markers acquired by the camera;

其中,步骤S3的实现方式为:根据摄像头获取到的预先布置的二维码标志物的图像获取该二维码标志物的位置信息、姿态信息以及编码信息,由上述位置信息、姿态信息以及编码信息得到摄像头相对于二维码标志物的偏离距离矢量以及摄像头相对于二维码标志物的第二运动速度矢量;Wherein, step S3 is implemented in the following manner: according to the image of the pre-arranged two-dimensional code marker obtained by the camera, the position information, attitude information and coding information of the two-dimensional code marker are obtained, and the above position information, attitude information and coding information The information obtains the deviation distance vector of the camera relative to the two-dimensional code marker and the second motion velocity vector of the camera relative to the two-dimensional code marker;

S4:利用识别的二维码标志物的信息、无人机的位置信息以及第一运动速度矢量通过卡尔曼滤波算法进行多传感器信息融合;S4: Using the information of the identified two-dimensional code marker, the position information of the UAV, and the first motion velocity vector to perform multi-sensor information fusion through the Kalman filter algorithm;

其中,步骤S4的具体实现方式为:利用无人机的位置信息、第一运动速度矢量、偏离距离矢量以及第二运动速度矢量通过卡尔曼滤波算法进行多传感器信息融合,得到经卡尔曼滤波算法滤波后的无人机的目标位置信息、目标第一运动速度矢量、目标偏离距离矢量以及目标第二运动速度矢量。Among them, the specific implementation of step S4 is as follows: using the position information of the UAV, the first motion velocity vector, the deviation distance vector and the second motion velocity vector to perform multi-sensor information fusion through the Kalman filter algorithm, and obtain the Kalman filter algorithm The filtered UAV's target position information, target first motion speed vector, target deviation distance vector and target second motion speed vector.

S5:利用卡尔曼滤波后得到的信息生成制导指令,其中制导指令中包括横滚角和俯仰角;S5: Use the information obtained after Kalman filtering to generate guidance instructions, where the guidance instructions include roll angle and pitch angle;

其中,步骤S5的具体实现方式为:利用目标期望航点的期望位置、目标期望航点的期望速度矢量、目标位置信息、目标第一运动速度矢量、目标偏离距离矢量以及目标第二运动速度矢量通过偏差自适应补偿生成制导指令,其中,目标期望航点为无人机当前正在前往的航点,制导指令包括横滚角和俯仰角。Wherein, the specific implementation of step S5 is: using the expected position of the target desired waypoint, the desired speed vector of the target desired waypoint, the target position information, the first target motion speed vector, the target deviation distance vector and the target second motion speed vector Guidance instructions are generated through bias adaptive compensation, where the target desired waypoint is the waypoint the UAV is currently heading to, and the guidance instructions include roll angle and pitch angle.

S6:输出上述制导指令。S6: output the above-mentioned guidance instruction.

图5为本发明实施例公开的一种无人机高精度自主飞行的流程示意图。在图5中有三个任务航点,其中任务航点(n)和(n+1)为关键航点,并在地面布设有标志物:二维码1和二维码2。无人机在飞经航点(n-1)时,仅采用传统的GPS组合导航系统。在飞经任务航点(n)和(n+1)时,会对地面标志物的位置、姿态和编码信息进行提取,以辅助传统的GPS组合导航系统。Fig. 5 is a schematic flow chart of a high-precision autonomous flight of a drone disclosed in an embodiment of the present invention. In Figure 5, there are three mission waypoints, among which mission waypoints (n) and (n+1) are key waypoints, and markers are arranged on the ground: QR code 1 and QR code 2 . When the UAV flies through the waypoint (n-1), it only uses the traditional GPS integrated navigation system. When flying through the mission waypoints (n) and (n+1), the position, attitude and coding information of the ground markers will be extracted to assist the traditional GPS integrated navigation system.

本领域的技术人员容易理解,以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。It is easy for those skilled in the art to understand that the above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention, All should be included within the protection scope of the present invention.

Claims (6)

1. it is a kind of based on Quick Response Code terrestrial reference recognize unmanned plane vision auxiliary positioning and flight control system, it is characterised in that include:Nothing Man-machine body, sensor assembly, pursuit path generation module, vision processing module, sensor update module, flight control mould Block, command output module, vision auxiliary control handover module and camera:
The sensor assembly is used to obtain the first fortune of the positional information of the unmanned plane body and the unmanned plane body Dynamic velocity;
The pursuit path generation module is used to generate course line pursuit path according to default task way point information, and to the boat Line pursuit path carries out discrete processes and obtains N number of expectation destination, and N is positive integer;
The vision processing module is used for the image of the Quick Response Code mark acquired according to the camera and obtains described two Positional information, attitude information and the coding information of code mark thing are tieed up, by the positional information, attitude information and coding information The deviation distance vector and the camera that the camera is obtained relative to the Quick Response Code mark is relative to described two Second movement velocity vector of dimension code mark thing;
The sensor update module be used for using the positional information of the unmanned plane body, the first movement velocity vector, The deviation distance vector and the second movement velocity vector carry out multi-sensor information and melt by Kalman filtering algorithm Close, obtain the target position information of the filtered unmanned plane body of Jing Kalman filtering algorithms, target the first movement velocity vector, Target deviation distance vector and target the second movement velocity vector;
The flight control modules are used to expect that the desired locations of destination, target expect the desired speed arrow of destination using target Amount, the target position information, the target the first movement velocity vector, the target deviation distance vector and the target Second movement velocity vector by deviation adaptive equalization generate guidance command, by it is described guidance command be sent to it is described instruction it is defeated Go out module, wherein, the target expects the destination that destination is currently being directed to for unmanned plane, described to guidance command including roll angle And the angle of pitch;
The vision auxiliary control handover module, for when the Quick Response Code mark is in identification state, controlling described flying Row control module is calculated according to the information that the sensor assembly and the vision processing module are obtained and guidanceed command, described two When dimension code mark thing is in unidentified state, the information that the flight control modules are obtained according only to the sensor assembly is controlled Calculating is guidanceed command;
The command output module is used to export described guidanceing command.
2. system according to claim 1, it is characterised in that the camera is located at the bottom of the unmanned plane body, And the visual field direction of the camera is vertically downward.
3. system according to claim 1, it is characterised in that the vision processing module include image gray processing module, Image binaryzation module, binary map processing module, 2 D code information extraction module and position and attitude acquisition module,
Described image gray processing module is used to for the image of the Quick Response Code mark to be converted into single channel gray-scale map;
Described image binarization block is used to set a fixed threshold values according to single channel gray-scale map, and gray-scale map is converted into into two-value Figure;
The binary map processing module is used to carry out the binary map contour detecting, travels through all side numbers in the binary map For 4 polygon, and polygon of the area less than predetermined threshold value is rejected, then carry out on the polygon that remaining side number is 4 Rectangular projection, obtains the square-shaped image of standard;
The 2 D code information extraction module is used for according to two in square-shaped image described in default coding information Rule Extraction Scale coding information and angle point information;
The position and attitude acquisition module is used to obtain the camera according to the binary-coded information and angle point information extracted Relative to the Quick Response Code mark deviation distance vector and the camera relative to the of the Quick Response Code mark Two movement velocity vectors.
4. it is a kind of based on Quick Response Code terrestrial reference recognize unmanned plane vision auxiliary positioning and winged prosecutor method, it is characterised in that include:
S1:Obtain the positional information of unmanned plane and the first movement velocity vector of unmanned plane;
S2:Course line pursuit path is generated according to default task way point information, and discrete place is carried out to the course line pursuit path Reason obtains N number of expectation destination, and N is positive integer;
S3:The positional information of the image acquisition Quick Response Code mark of the Quick Response Code mark acquired according to camera, Attitude information and coding information, by the positional information, attitude information and coding information obtain the camera relative to The deviation distance vector and the camera of the Quick Response Code mark is moved relative to the second of the Quick Response Code mark Velocity;
S4:Using the positional information of the unmanned plane, the first movement velocity vector, the deviation distance vector and described Second movement velocity vector carries out multi-sensor information fusion by Kalman filtering algorithm, obtains the filter of Jing Kalman filtering algorithms The target position information of the unmanned plane after ripple, target the first movement velocity vector, target deviation distance vector and target second Movement velocity vector;
S5:Expect that the desired locations of destination, target expect the desired speed vector of destination, target location letter using target Breath, the target the first movement velocity vector, the target deviation distance vector and the target the second movement velocity vector Generated by deviation adaptive equalization and guidanceed command, wherein, the target expects the boat that destination is currently being directed to for unmanned plane Point, it is described to guidance command including roll angle and the angle of pitch;
S6:Guidance command described in output.
5. method according to claim 4, it is characterised in that the camera is located at the bottom of the unmanned plane, and The visual field direction of the camera is vertically downward.
6. method according to claim 4, it is characterised in that step S3 specifically includes following sub-step:
S301:The image of the Quick Response Code mark is converted into into single channel gray-scale map;
S302:One fixed threshold values is set according to single channel gray-scale map, gray-scale map is converted into into binary map;
S303:Contour detecting is carried out to the binary map, it is 4 polygon to travel through all side numbers in the binary map, and is picked Except area is less than the polygon of predetermined threshold value, then the polygon that remaining side number is 4 is carried out into rectangular projection, obtain standard Square-shaped image;
S304:Believe according to the binary-coded information in square-shaped image described in default coding information Rule Extraction and angle point Breath;
S305:Binary-coded information and angle point information according to extracting obtains the camera relative to the two-dimentional code mark Second movement velocity vector of the deviation distance vector and the camera of thing relative to the Quick Response Code mark.
CN201611092540.2A 2016-12-01 2016-12-01 A visual aided positioning and flight control system and method for unmanned aerial vehicles based on two-dimensional code landmark recognition Expired - Fee Related CN106647814B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611092540.2A CN106647814B (en) 2016-12-01 2016-12-01 A visual aided positioning and flight control system and method for unmanned aerial vehicles based on two-dimensional code landmark recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611092540.2A CN106647814B (en) 2016-12-01 2016-12-01 A visual aided positioning and flight control system and method for unmanned aerial vehicles based on two-dimensional code landmark recognition

Publications (2)

Publication Number Publication Date
CN106647814A true CN106647814A (en) 2017-05-10
CN106647814B CN106647814B (en) 2019-08-13

Family

ID=58814148

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611092540.2A Expired - Fee Related CN106647814B (en) 2016-12-01 2016-12-01 A visual aided positioning and flight control system and method for unmanned aerial vehicles based on two-dimensional code landmark recognition

Country Status (1)

Country Link
CN (1) CN106647814B (en)

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107194399A (en) * 2017-07-14 2017-09-22 广东工业大学 A kind of vision determines calibration method, system and unmanned plane
CN107703973A (en) * 2017-09-11 2018-02-16 广州视源电子科技股份有限公司 Trajectory tracking method and device
CN108305291A (en) * 2018-01-08 2018-07-20 武汉大学 Utilize the monocular vision positioning and orientation method of the wall advertisement comprising positioning Quick Response Code
CN108803668A (en) * 2018-06-22 2018-11-13 航天图景(北京)科技有限公司 A kind of intelligent patrol detection unmanned plane Towed bird system of static object monitoring
WO2019006767A1 (en) * 2017-07-06 2019-01-10 杨顺伟 Scenic spot navigation method and device for unmanned aerial vehicle
CN109521781A (en) * 2018-10-30 2019-03-26 普宙飞行器科技(深圳)有限公司 Unmanned plane positioning system, unmanned plane and unmanned plane localization method
WO2019056982A1 (en) * 2017-09-21 2019-03-28 索尼公司 Apparatus and method in wireless communication system and computer readable storage medium
CN110325940A (en) * 2018-06-29 2019-10-11 深圳市大疆创新科技有限公司 A kind of flight control method, equipment, system and storage medium
CN110375747A (en) * 2019-08-26 2019-10-25 华东师范大学 A kind of inertial navigation system of interior unmanned plane
CN110446159A (en) * 2019-08-12 2019-11-12 上海工程技术大学 A kind of system and method for interior unmanned plane accurate positioning and independent navigation
CN110543989A (en) * 2019-08-29 2019-12-06 中国南方电网有限责任公司 Power transmission line machine patrol operation safety early warning method and device and computer equipment
CN110673619A (en) * 2019-10-21 2020-01-10 深圳市道通智能航空技术有限公司 Flight attitude control method and device, unmanned aerial vehicle and storage medium
CN111121744A (en) * 2018-10-30 2020-05-08 千寻位置网络有限公司 Positioning method and device based on sensing unit, positioning system and mobile terminal
CN111323789A (en) * 2020-03-19 2020-06-23 苏州思维慧信息科技有限公司 Ground topography scanning device and method based on unmanned aerial vehicle and solid-state radar
CN111580551A (en) * 2020-05-06 2020-08-25 杭州电子科技大学 Navigation system and method based on visual positioning
CN111930133A (en) * 2020-07-20 2020-11-13 贵州电网有限责任公司 Transformer substation secondary screen cabinet inspection method based on rotor unmanned aerial vehicle
CN112040175A (en) * 2020-07-31 2020-12-04 深圳供电局有限公司 Unmanned aerial vehicle inspection method and device, computer equipment and readable storage medium
CN112147995A (en) * 2019-06-28 2020-12-29 深圳市创客工场科技有限公司 Robot motion control method and device, robot and storage medium
CN112381464A (en) * 2020-12-07 2021-02-19 北京小米松果电子有限公司 Shared vehicle scheduling method and device and storage medium
CN112859923A (en) * 2021-01-25 2021-05-28 西北工业大学 Unmanned aerial vehicle vision formation flight control system
CN113238580A (en) * 2021-06-03 2021-08-10 一飞智控(天津)科技有限公司 Method and system for switching static placement deviation and dynamic flight deviation of unmanned aerial vehicle
CN113657256A (en) * 2021-08-16 2021-11-16 大连海事大学 Unmanned ship-borne unmanned aerial vehicle sea-air cooperative visual tracking and autonomous recovery method
TWI746973B (en) * 2018-05-09 2021-11-21 大陸商北京外號信息技術有限公司 Method for guiding a machine capable of autonomous movement through optical communication device
CN113776523A (en) * 2021-08-24 2021-12-10 武汉第二船舶设计研究所 A low-cost navigation and positioning method, system and application for a robot
CN114104310A (en) * 2021-12-31 2022-03-01 重庆高新区飞马创新研究院 Device and method for assisting unmanned aerial vehicle in landing based on GPS and AprilTag
CN114237262A (en) * 2021-12-24 2022-03-25 陕西欧卡电子智能科技有限公司 Automatic mooring method and system for unmanned ship on water
CN114326766A (en) * 2021-12-03 2022-04-12 深圳先进技术研究院 Vehicle-mounted machine cooperative autonomous tracking and landing method
CN114489102A (en) * 2022-01-19 2022-05-13 上海复亚智能科技有限公司 Self-inspection method and device for electric power tower, unmanned aerial vehicle and storage medium
CN114610068A (en) * 2022-03-16 2022-06-10 广州极飞科技股份有限公司 Unmanned aerial vehicle control method, device, equipment and storage medium
CN115586798A (en) * 2022-12-12 2023-01-10 广东电网有限责任公司湛江供电局 Unmanned aerial vehicle anti-crash method and system
CN118882655A (en) * 2024-08-13 2024-11-01 北京亿维智形科技有限公司 An optical tracking and positioning system based on deep learning and fusion positioning algorithm
CN119354190A (en) * 2023-07-24 2025-01-24 深圳市元鼎智能创新有限公司 An underwater navigation system and underwater navigation method for a swimming pool robot

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105184776A (en) * 2015-08-17 2015-12-23 中国测绘科学研究院 Target tracking method
CN105388905A (en) * 2015-10-30 2016-03-09 深圳一电航空技术有限公司 Unmanned aerial vehicle flight control method and device
US20160209850A1 (en) * 2014-12-09 2016-07-21 Embry-Riddle Aeronautical University, Inc. System and method for robust nonlinear regulation control of unmanned aerial vehicles syntetic jet actuators

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160209850A1 (en) * 2014-12-09 2016-07-21 Embry-Riddle Aeronautical University, Inc. System and method for robust nonlinear regulation control of unmanned aerial vehicles syntetic jet actuators
CN105184776A (en) * 2015-08-17 2015-12-23 中国测绘科学研究院 Target tracking method
CN105388905A (en) * 2015-10-30 2016-03-09 深圳一电航空技术有限公司 Unmanned aerial vehicle flight control method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
姚瑶,刘磊,王永骥: "基于耦合补偿和自抗扰的飞行器姿态控制", 《第34届中国控制会议》 *

Cited By (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019006767A1 (en) * 2017-07-06 2019-01-10 杨顺伟 Scenic spot navigation method and device for unmanned aerial vehicle
CN107194399B (en) * 2017-07-14 2023-05-09 广东工业大学 A method, system and unmanned aerial vehicle for visual calibration
CN107194399A (en) * 2017-07-14 2017-09-22 广东工业大学 A kind of vision determines calibration method, system and unmanned plane
CN107703973A (en) * 2017-09-11 2018-02-16 广州视源电子科技股份有限公司 Trajectory tracking method and device
US11653276B2 (en) 2017-09-21 2023-05-16 Sony Group Corporation Apparatus and method in wireless communication system and computer readable storage medium
WO2019056982A1 (en) * 2017-09-21 2019-03-28 索尼公司 Apparatus and method in wireless communication system and computer readable storage medium
US11076328B2 (en) 2017-09-21 2021-07-27 Sony Corporation Apparatus and method in wireless communication system and computer readable storage medium
CN108305291A (en) * 2018-01-08 2018-07-20 武汉大学 Utilize the monocular vision positioning and orientation method of the wall advertisement comprising positioning Quick Response Code
CN108305291B (en) * 2018-01-08 2022-02-01 武汉大学 Monocular vision positioning and attitude determination method utilizing wall advertisement containing positioning two-dimensional code
TWI746973B (en) * 2018-05-09 2021-11-21 大陸商北京外號信息技術有限公司 Method for guiding a machine capable of autonomous movement through optical communication device
US11338920B2 (en) 2018-05-09 2022-05-24 Beijing Whyhow Information Technology Co., Ltd. Method for guiding autonomously movable machine by means of optical communication device
CN108803668B (en) * 2018-06-22 2021-08-24 中国南方电网有限责任公司超高压输电公司广州局 Intelligent inspection unmanned aerial vehicle nacelle system for static target monitoring
CN108803668A (en) * 2018-06-22 2018-11-13 航天图景(北京)科技有限公司 A kind of intelligent patrol detection unmanned plane Towed bird system of static object monitoring
CN110325940A (en) * 2018-06-29 2019-10-11 深圳市大疆创新科技有限公司 A kind of flight control method, equipment, system and storage medium
CN109521781A (en) * 2018-10-30 2019-03-26 普宙飞行器科技(深圳)有限公司 Unmanned plane positioning system, unmanned plane and unmanned plane localization method
CN111121744A (en) * 2018-10-30 2020-05-08 千寻位置网络有限公司 Positioning method and device based on sensing unit, positioning system and mobile terminal
CN112147995B (en) * 2019-06-28 2024-02-27 深圳市创客工场科技有限公司 Robot motion control method and device, robot and storage medium
CN112147995A (en) * 2019-06-28 2020-12-29 深圳市创客工场科技有限公司 Robot motion control method and device, robot and storage medium
CN110446159A (en) * 2019-08-12 2019-11-12 上海工程技术大学 A kind of system and method for interior unmanned plane accurate positioning and independent navigation
CN110375747A (en) * 2019-08-26 2019-10-25 华东师范大学 A kind of inertial navigation system of interior unmanned plane
CN110543989A (en) * 2019-08-29 2019-12-06 中国南方电网有限责任公司 Power transmission line machine patrol operation safety early warning method and device and computer equipment
CN110673619A (en) * 2019-10-21 2020-01-10 深圳市道通智能航空技术有限公司 Flight attitude control method and device, unmanned aerial vehicle and storage medium
CN110673619B (en) * 2019-10-21 2022-06-17 深圳市道通智能航空技术股份有限公司 Flight attitude control method and device, unmanned aerial vehicle and storage medium
CN111323789B (en) * 2020-03-19 2023-11-03 陕西思地三维科技有限公司 Ground morphology scanning device and method based on unmanned aerial vehicle and solid-state radar
CN111323789A (en) * 2020-03-19 2020-06-23 苏州思维慧信息科技有限公司 Ground topography scanning device and method based on unmanned aerial vehicle and solid-state radar
CN111580551A (en) * 2020-05-06 2020-08-25 杭州电子科技大学 Navigation system and method based on visual positioning
CN111930133A (en) * 2020-07-20 2020-11-13 贵州电网有限责任公司 Transformer substation secondary screen cabinet inspection method based on rotor unmanned aerial vehicle
CN112040175A (en) * 2020-07-31 2020-12-04 深圳供电局有限公司 Unmanned aerial vehicle inspection method and device, computer equipment and readable storage medium
CN112381464A (en) * 2020-12-07 2021-02-19 北京小米松果电子有限公司 Shared vehicle scheduling method and device and storage medium
CN112859923A (en) * 2021-01-25 2021-05-28 西北工业大学 Unmanned aerial vehicle vision formation flight control system
CN113238580A (en) * 2021-06-03 2021-08-10 一飞智控(天津)科技有限公司 Method and system for switching static placement deviation and dynamic flight deviation of unmanned aerial vehicle
CN113657256A (en) * 2021-08-16 2021-11-16 大连海事大学 Unmanned ship-borne unmanned aerial vehicle sea-air cooperative visual tracking and autonomous recovery method
CN113657256B (en) * 2021-08-16 2023-09-26 大连海事大学 A method for sea-air collaborative visual tracking and autonomous recovery of unmanned boat-borne UAVs
CN113776523B (en) * 2021-08-24 2024-03-19 武汉第二船舶设计研究所 A low-cost navigation and positioning method, system and application for robots
CN113776523A (en) * 2021-08-24 2021-12-10 武汉第二船舶设计研究所 A low-cost navigation and positioning method, system and application for a robot
CN114326766A (en) * 2021-12-03 2022-04-12 深圳先进技术研究院 Vehicle-mounted machine cooperative autonomous tracking and landing method
CN114237262B (en) * 2021-12-24 2024-01-19 陕西欧卡电子智能科技有限公司 An automatic parking method and system for unmanned ships on the water surface
CN114237262A (en) * 2021-12-24 2022-03-25 陕西欧卡电子智能科技有限公司 Automatic mooring method and system for unmanned ship on water
CN114104310A (en) * 2021-12-31 2022-03-01 重庆高新区飞马创新研究院 Device and method for assisting unmanned aerial vehicle in landing based on GPS and AprilTag
CN114489102A (en) * 2022-01-19 2022-05-13 上海复亚智能科技有限公司 Self-inspection method and device for electric power tower, unmanned aerial vehicle and storage medium
CN114610068A (en) * 2022-03-16 2022-06-10 广州极飞科技股份有限公司 Unmanned aerial vehicle control method, device, equipment and storage medium
CN115586798B (en) * 2022-12-12 2023-03-24 广东电网有限责任公司湛江供电局 Unmanned aerial vehicle anti-crash method and system
CN115586798A (en) * 2022-12-12 2023-01-10 广东电网有限责任公司湛江供电局 Unmanned aerial vehicle anti-crash method and system
CN119354190A (en) * 2023-07-24 2025-01-24 深圳市元鼎智能创新有限公司 An underwater navigation system and underwater navigation method for a swimming pool robot
CN118882655A (en) * 2024-08-13 2024-11-01 北京亿维智形科技有限公司 An optical tracking and positioning system based on deep learning and fusion positioning algorithm

Also Published As

Publication number Publication date
CN106647814B (en) 2019-08-13

Similar Documents

Publication Publication Date Title
CN106647814B (en) A visual aided positioning and flight control system and method for unmanned aerial vehicles based on two-dimensional code landmark recognition
US12481289B2 (en) Backup navigation system for unmanned aerial vehicles
Bacik et al. Autonomous flying with quadrocopter using fuzzy control and ArUco markers
CN103175524B (en) A kind of position of aircraft without view-based access control model under marking environment and attitude determination method
CN105352495B (en) Acceleration and light stream Data Fusion of Sensor unmanned plane horizontal velocity control method
CN104062977B (en) Full-autonomous flight control method for quadrotor unmanned aerial vehicle based on vision SLAM
Li et al. UAV autonomous landing technology based on AprilTags vision positioning algorithm
CN105759829A (en) Laser radar-based mini-sized unmanned plane control method and system
CN114200948B (en) Unmanned aerial vehicle autonomous landing method based on visual assistance
CN103697889A (en) A UAV autonomous navigation and positioning method based on multi-model distributed filtering
CN111426320A (en) A Vehicle Autonomous Navigation Method Based on Image Matching/Inertial Navigation/Odometer
Bao et al. Vision-based horizon extraction for micro air vehicle flight control
Zhao et al. Homography-based vision-aided inertial navigation of UAVs in unknown environments
CN107144281A (en) Unmanned plane indoor locating system and localization method based on cooperative target and monocular vision
CN102788580A (en) Flight path synthetic method in unmanned aerial vehicle visual navigation
CN114326765A (en) A landmark tracking control system and method for UAV visual landing
CN116880523A (en) Unmanned aerial vehicle landing method based on robust visual servo prediction control and storage medium
Wang et al. Monocular vision and IMU based navigation for a small unmanned helicopter
CN109029451A (en) Small drone autonomic positioning method based on networked beacons correction
Gomez-Balderas et al. Vision-based autonomous hovering for a miniature quad-rotor
Ready et al. Inertially aided visual odometry for miniature air vehicles in GPS-denied environments
Agarwal et al. Monocular vision based navigation and localisation in indoor environments
CN119396200B (en) Visual carrier landing guiding method for carrier-based aircraft
CN207379510U (en) Unmanned plane indoor locating system based on cooperative target and monocular vision
Wang et al. Indoor visual navigation system based on paired-landmark for small UAVs

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190813