WO2018195883A1 - Method and device for controlling unmanned aerial vehicle, and unmanned aerial vehicle - Google Patents
Method and device for controlling unmanned aerial vehicle, and unmanned aerial vehicle Download PDFInfo
- Publication number
- WO2018195883A1 WO2018195883A1 PCT/CN2017/082331 CN2017082331W WO2018195883A1 WO 2018195883 A1 WO2018195883 A1 WO 2018195883A1 CN 2017082331 W CN2017082331 W CN 2017082331W WO 2018195883 A1 WO2018195883 A1 WO 2018195883A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- unmanned aerial
- aerial vehicle
- uav
- gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/22—Command input arrangements
- G05D1/228—Command input arrangements located on-board unmanned vehicles
- G05D1/2285—Command input arrangements located on-board unmanned vehicles using voice or gesture commands
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/24—Arrangements for determining position or orientation
- G05D1/243—Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/652—Take-off
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/654—Landing
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2101/00—Details of software or hardware architectures used for the control of position
- G05D2101/20—Details of software or hardware architectures used for the control of position using external object recognition
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2109/00—Types of controlled vehicles
- G05D2109/20—Aircraft, e.g. drones
- G05D2109/25—Rotorcrafts
- G05D2109/254—Flying platforms, e.g. multicopters
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2111/00—Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
- G05D2111/10—Optical signals
Definitions
- Embodiments of the present invention provide a method, a device, and an unmanned aerial vehicle for controlling an unmanned aerial vehicle to provide a manner for an ordinary user to quickly get started and easily control the unmanned aerial vehicle.
- Another aspect of an embodiment of the present invention is to provide an unmanned aerial vehicle control apparatus including: one or more processors operating separately or in cooperation, the processor for:
- a power system mounted to the fuselage for providing flight power
- FIG. 12 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention.
- the first operation may also be an operation of pressing the body, for example, a pressure sensor is disposed on the body of the UAV, and when the user presses the body, the pressure sensor will be the user to the body.
- the pressure is converted into an electrical signal and transmitted to the flight controller, and the flight controller detects the user's operation of pressing the fuselage based on the electrical signal.
- the user information may not be detected, that is, the flight controller does not detect the user information, and directly controls the unmanned aerial vehicle from the user according to the user's operation on the unmanned aerial vehicle.
- the user information may not be detected, that is, the flight controller does not detect the user information, and directly controls the unmanned aerial vehicle from the user according to the user's operation on the unmanned aerial vehicle.
- the palm of your hand takes off, and there are several possible ways to do it:
- the unmanned aerial vehicle is controlled to perform an action corresponding to the gesture according to the gesture, including at least one of the following:
- the distance detected by the distance sensor under the UAV and the image acquired by the image sensor determine that the palm of the user is below the UAV.
- the processor is further configured to: detect, by a distance sensor, a distance between the UAV and the user; if a distance between the UAV and the user exceeds a preset distance range, control The status light of the UAV flashes in a fifth flash mode. Controlling, when the processor recognizes the gesture of the user, a status light of the UAV to flash in a second flash mode; if the processor identifies that the gesture of the user fails, controlling the The status light of the human aircraft flashes in the third flash mode. If the processor recognizes the drag gesture of the user, controlling the UAV to fly in accordance with the moving direction of the drag gesture while maintaining the distance between the UAV and the user unchanged.
- the processor is further configured to: adjust a posture of the pan/tilt carried by the UAV during the process of controlling the unmanned aerial vehicle to fly to the first location point, so that the user is in the unmanned The shooting device of the aircraft's shooting device is in the picture.
- the processor is further configured to control the status light of the UAV to flash in accordance with the seventh flash mode.
- the processor is specifically configured to: determine a location of the user, and determine the user as a follow target according to the location of the user.
- the processor determines the user to follow the target
- the processor is specifically configured to: determine a location of the user, and determine the user as a follow target according to the location of the user. Determining, by the processor, the location of the user, when determining the user as the following target according to the location of the user, specifically determining: determining a location of the user in the photographing screen of the photographing device of the unmanned aerial vehicle, according to the user The position in the shooting screen determines the user to follow the target.
- the above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
- the above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present invention. Part of the steps.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
Landscapes
- Engineering & Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
本发明实施例涉及无人飞行器领域,尤其涉及一种无人飞行器的控制方法、设备及无人飞行器。Embodiments of the present invention relate to the field of unmanned aerial vehicles, and in particular, to a method, a device, and an unmanned aerial vehicle for controlling an unmanned aerial vehicle.
现有技术中用户采用遥控器摇杆来控制无人飞行器,但是需要用户具备较为丰富的操作经验,通常情况下,遥控器有两个杆,四个通道,控制无人飞行器上下飞行、前后飞行、左右飞行、向左转、向右转,用户在操作遥控器摇杆时,需要控制打杆的量,以使遥控器控制无人飞行器飞行的快慢、距离、姿态等,可见对于经验不够丰富的用户而言,控制好无人飞行器是一件较为困难的事情。In the prior art, the user uses the remote control rocker to control the unmanned aerial vehicle, but the user needs to have rich operation experience. Generally, the remote control has two poles and four channels, and the unmanned aerial vehicle is controlled to fly up and down, before and after flight. , left and right flight, turn left, turn right, when the user operates the remote control joystick, you need to control the amount of the bar, so that the remote control to control the speed, distance, posture, etc. of the UAV flight, it can be seen that the experience is not rich enough For users, controlling an unmanned aerial vehicle is a difficult task.
现有技术缺乏一种能让普通用户快速上手且容易控制无人飞行器的方式。The prior art lacks a way to get the average user to get started quickly and to easily control the unmanned aerial vehicle.
发明内容Summary of the invention
本发明实施例提供一种无人飞行器的控制方法、设备及无人飞行器,以提供一种能让普通用户快速上手且容易控制无人飞行器的方式。Embodiments of the present invention provide a method, a device, and an unmanned aerial vehicle for controlling an unmanned aerial vehicle to provide a manner for an ordinary user to quickly get started and easily control the unmanned aerial vehicle.
本发明实施例的一个方面是提供一种无人飞行器的控制方法,包括:An aspect of an embodiment of the present invention provides a method for controlling an unmanned aerial vehicle, including:
控制无人飞行器从用户的手掌起飞;Controlling the UAV from taking off from the user's palm;
识别用户的手势;Identify the user's gestures;
若识别出所述用户的手势,则根据所述手势控制所述无人飞行器执行与所述手势对应的动作;If the gesture of the user is recognized, controlling the unmanned aerial vehicle to perform an action corresponding to the gesture according to the gesture;
控制所述无人飞行器降落在所述用户的手掌上。The UAV is controlled to land on the palm of the user.
本发明实施例的另一个方面是提供一种无人飞行器控制设备,包括一个或多个处理器,单独或协同工作,所述处理器用于:Another aspect of an embodiment of the present invention is to provide an unmanned aerial vehicle control apparatus including one or more processors operating separately or in cooperation, the processor being configured to:
控制无人飞行器从用户的手掌起飞; Controlling the UAV from taking off from the user's palm;
识别用户的手势;Identify the user's gestures;
若识别出所述用户的手势,则根据所述手势控制所述无人飞行器执行与所述手势对应的动作;If the gesture of the user is recognized, controlling the unmanned aerial vehicle to perform an action corresponding to the gesture according to the gesture;
控制所述无人飞行器降落在所述用户的手掌上。The UAV is controlled to land on the palm of the user.
本发明实施例的另一个方面是提供一种无人飞行器,包括:Another aspect of an embodiment of the present invention provides an unmanned aerial vehicle comprising:
机身;body;
动力系统,安装在所述机身,用于提供飞行动力;a power system mounted to the fuselage for providing flight power;
以及上一方面中的无人飞行器控制设备。And the UAV control device in the above aspect.
本发明实施例的另一个方面是提供一种无人飞行器的控制方法,包括:Another aspect of the embodiments of the present invention provides a method for controlling an unmanned aerial vehicle, including:
识别用户的跟随手势;Identify the user's following gestures;
根据所述跟随手势控制无人飞行器飞行至第一位置点;Controlling the unmanned aerial vehicle to fly to the first position point according to the following gesture;
所述无人飞行器到达第一位置点后,将用户确定为跟随目标,控制所述无人飞行器对用户进行跟随。After the unmanned aerial vehicle reaches the first location point, the user is determined to follow the target, and the unmanned aerial vehicle is controlled to follow the user.
本发明实施例的另一个方面是提供一种无人飞行器控制设备,包括:一个或多个处理器,单独或协同工作,所述处理器用于:Another aspect of an embodiment of the present invention is to provide an unmanned aerial vehicle control apparatus including: one or more processors operating separately or in cooperation, the processor for:
识别用户的跟随手势;Identify the user's following gestures;
根据所述跟随手势控制无人飞行器飞行至第一位置点;Controlling the unmanned aerial vehicle to fly to the first position point according to the following gesture;
所述无人飞行器到达第一位置点后,将用户确定为跟随目标,控制所述无人飞行器对用户进行跟随。After the unmanned aerial vehicle reaches the first location point, the user is determined to follow the target, and the unmanned aerial vehicle is controlled to follow the user.
本发明实施例的另一个方面是提供一种无人飞行器,包括:Another aspect of an embodiment of the present invention provides an unmanned aerial vehicle comprising:
机身;body;
动力系统,安装在所述机身,用于提供飞行动力;a power system mounted to the fuselage for providing flight power;
以及上一方面中的无人飞行器控制设备。And the UAV control device in the above aspect.
本发明实施例中提供的无人飞行器的控制方法、设备及无人飞行器,通过控制无人飞行器从用户的手掌起飞,起飞后通过识别用户的手势,根据用户手势控制无人飞行器执行与该手势对应的动作,以及控制无人飞行器降落在用户的手掌上,使得用户通过手势即可控制无人飞行器,而不需要通过操控遥控器、用户终端等地面控制设备来控制无人飞行器,实现了一种能让普通用户快速上手且容易控制无人飞行器的方式,丰富了无人飞 行器的控制方式,提高了无人飞行器控制的便利性。The control method, device and unmanned aerial vehicle of the unmanned aerial vehicle provided in the embodiment of the present invention take off from the palm of the user by controlling the unmanned aerial vehicle, and control the unmanned aerial vehicle to perform and the gesture according to the user gesture by recognizing the gesture of the user after taking off. Corresponding actions, as well as controlling the UAV to land on the user's palm, enable the user to control the UAV by gestures, without having to control the UAV by manipulating remote control, user terminals and other ground control devices. A way to let ordinary users get started quickly and easily control unmanned aerial vehicles, enriching the unmanned flight The control mode of the walker improves the convenience of the control of the UAV.
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings.
图1为本发明实施例提供的无人飞行器的控制方法的流程图;1 is a flowchart of a method for controlling an unmanned aerial vehicle according to an embodiment of the present invention;
图2为本发明实施例提供的用户手势控制无人飞行器的示意图;2 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention;
图3为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 3 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图4为本发明实施例提供的用户手势控制无人飞行器的示意图;4 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention;
图5为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 5 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图6为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 6 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图7为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 7 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图8为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 8 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图9为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 9 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图10为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 10 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图11为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 11 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图12为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 12 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图13为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 13 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图14为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 14 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图15为本发明实施例提供的用户手势控制无人飞行器的示意图;FIG. 15 is a schematic diagram of a user gesture control unmanned aerial vehicle according to an embodiment of the present invention; FIG.
图16为本发明实施例提供的无人飞行器的控制方法的流程图;16 is a flowchart of a method for controlling an unmanned aerial vehicle according to an embodiment of the present invention;
图17为本发明实施例提供的无人飞行器的结构图。FIG. 17 is a structural diagram of an unmanned aerial vehicle according to an embodiment of the present invention.
附图标记:Reference mark:
20-手掌 21-机头 22-拍摄设备20-palm 21-head 22-shooting equipment
23-TOF相机 24-云台 25-距离传感器23-TOF Camera 24-PTZ 25-Distance Sensor
26-图像传感器 40-地面 100-无人飞行器26-Image Sensor 40-Surface 100-Unmanned Aerial Vehicle
1700-无人飞行器 1707-电机 1706-螺旋桨1700-unmanned aerial vehicle 1707-motor 1706-propeller
1717-电子调速器 1718-无人飞行器控制设备 1717-Electronic governor 1718-Unmanned aerial vehicle control equipment
1708-传感系统 1710-通信系统 1702-支撑设备1708-Sensing System 1710-Communication System 1702-Support Equipment
1704-拍摄设备 1712-地面站1704-Photographing Equipment 1712-Ground Station
1714-天线 1716-电磁波1714-antenna 1716-electromagnetic wave
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly described with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
需要说明的是,当组件被称为“固定于”另一个组件,它可以直接在另一个组件上或者也可以存在居中的组件。当一个组件被认为是“连接”另一个组件,它可以是直接连接到另一个组件或者可能同时存在居中组件。It should be noted that when a component is referred to as being "fixed" to another component, it can be directly on the other component or the component can be present. When a component is considered to "connect" another component, it can be directly connected to another component or possibly a central component.
除非另有定义,本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本文中在本发明的说明书中所使用的术语只是为了描述具体的实施例的目的,不是旨在于限制本发明。本文所使用的术语“及/或”包括一个或多个相关的所列项目的任意的和所有的组合。All technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. The terminology used in the description of the present invention is for the purpose of describing particular embodiments and is not intended to limit the invention. The term "and/or" used herein includes any and all combinations of one or more of the associated listed items.
下面结合附图,对本发明的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。Some embodiments of the present invention are described in detail below with reference to the accompanying drawings. The features of the embodiments and examples described below can be combined with each other without conflict.
本发明实施例提供一种无人飞行器的控制方法。图1为本发明实施例提供的无人飞行器的控制方法的流程图。如图1所示,本实施例中的方法,可以包括:Embodiments of the present invention provide a method for controlling an unmanned aerial vehicle. FIG. 1 is a flowchart of a method for controlling an unmanned aerial vehicle according to an embodiment of the present invention. As shown in FIG. 1, the method in this embodiment may include:
步骤S101、控制无人飞行器从用户的手掌起飞。Step S101: Controlling the UAV to take off from the palm of the user.
本发明实施例所述的无人飞行器的控制方法适用于通过用户手势来控制无人飞行器,无人飞行器在初始化自检完成后,如图2所示,用户可以将该无人飞行器100水平、轻握在手20中,并将该无人飞行器100的机头21朝向自己,可选的,无人飞行器在初始化自检的过程中,飞行控制器可控制该无人飞行器的状态灯闪光,以提示用户该无人飞行器正在初始化自检,其中,该无人飞行器的状态灯具体可以是状态指示灯,例
如发光二极管(Light Emitting Diode,LED)、荧光灯等,该状态灯可以是无人飞行器的前臂灯。The control method of the unmanned aerial vehicle according to the embodiment of the present invention is suitable for controlling the unmanned aerial vehicle by a user gesture. After the initialization of the unmanned aerial vehicle is completed, as shown in FIG. 2, the user can level the unmanned
可选的,在控制无人飞行器从用户的手掌起飞之前,还包括:检测用户信息;检测所述用户信息完成后,启动所述无人飞行器的电机。Optionally, before controlling the unmanned aerial vehicle to take off from the palm of the user, the method further includes: detecting user information; and after detecting the completion of the user information, starting the motor of the unmanned aerial vehicle.
其中,检测用户信息可以是在检测到所述用户的第一操作后,检测所述用户信息。所述第一操作包括如下至少一种:单击或双击电池开关的操作、晃动所述无人飞行器的操作、摇摆所述无人飞行器的操作。当用户单击或双击电池开关时,无人飞行器中具有数据处理功能的部件或器件例如飞行控制器可检测到该用户单击或双击电池开关的操作,在本实施例中,飞行控制器可以是专门用于控制无人飞行器飞行的处理器,也可以是通用的处理器,例如中央处理器(Central Processing Unit,CPU)或其它可以调用程序的处理器。另外,无人飞行器的惯性测量单元(Inertial Measurement Unit,IMU)用于检测无人飞行器的姿态信息,该姿态信息包括俯仰角(英文:pitch angle)、横滚角(英文:roll angle)、偏航角(英文:yaw angle)等,当用户晃动或摆动无人飞行器时,该无人飞行器的姿态信息不断变化,飞行控制器可通过IMU获取到无人飞行器实时的姿态信息,并根据姿态信息的变化,检测出用户晃动所述无人飞行器的操作或摇摆所述无人飞行器的操作。此外,在其他实施例中,所述第一操作还可以是按压机身的操作,例如无人飞行器的机身上设置有压力传感器,当用户按压机身时,压力传感器将用户对机身的压力转换为电信号,并将电信号传输给飞行控制器,飞行控制器根据该电信号检测用户按压机身的操作。The detecting the user information may be: detecting the user information after detecting the first operation of the user. The first operation includes at least one of clicking or double clicking on an operation of the battery switch, shaking the operation of the unmanned aerial vehicle, and swinging the operation of the unmanned aerial vehicle. When the user clicks or double-clicks the battery switch, the component or device having the data processing function in the unmanned aerial vehicle, such as the flight controller, can detect the operation of the user clicking or double clicking the battery switch. In this embodiment, the flight controller can It is a processor dedicated to controlling the flight of an unmanned aerial vehicle. It can also be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor that can call a program. In addition, an inertial measurement unit (IMU) of the UAV is used to detect the attitude information of the unmanned aerial vehicle, and the attitude information includes a pitch angle (English: pitch angle), a roll angle (English: roll angle), and a partial When the user shakes or swings the unmanned aerial vehicle, the attitude information of the unmanned aerial vehicle is constantly changing, and the flight controller can obtain the real-time attitude information of the unmanned aerial vehicle through the IMU, and according to the attitude information. The change detects the user's operation of shaking the UAV or swaying the UAV. In addition, in other embodiments, the first operation may also be an operation of pressing the body, for example, a pressure sensor is disposed on the body of the UAV, and when the user presses the body, the pressure sensor will be the user to the body. The pressure is converted into an electrical signal and transmitted to the flight controller, and the flight controller detects the user's operation of pressing the fuselage based on the electrical signal.
下面以用户单击或双击电池开关为例介绍飞行控制器检测到用户单击或双击电池开关的操作后,检测用户信息的过程:当飞行控制器检测出用户单击或双击电池开关的操作后,控制无人飞行器进入检测状态,开始检测所述用户信息,并在检测所述用户信息时,控制所述无人飞行器的状态灯按照第一闪灯模式闪灯,第一闪灯模式具体可以是黄灯慢闪,此处只是示意性说明,并不限定为黄灯慢闪,还可以是红灯快闪、绿灯慢闪等。另外,该第一闪灯模式只是为了和后续的第二闪灯模式、第三闪灯模式等闪灯模式加以区分,并不限定每一种闪灯模式下亮灯的 颜色、闪灯时间的长短和闪灯频率等。In the following, the user clicks or double-clicks the battery switch as an example to describe the process of detecting the user information after the flight controller detects the user clicking or double-clicking the battery switch: when the flight controller detects that the user clicks or double-clicks the battery switch Controlling the unmanned aerial vehicle to enter the detection state, starting to detect the user information, and when detecting the user information, controlling the status light of the unmanned aerial vehicle to flash according to the first flash mode, the first flash mode may specifically The yellow light flashes slowly. This is only a schematic description. It is not limited to a slow flash of yellow light. It can also be a flashing red light or a slow flashing green light. In addition, the first flash mode is only used to distinguish the flash mode from the subsequent second flash mode, the third flash mode, and the like, and is not limited to the lighting in each flash mode. Color, length of flash time, flashing frequency, etc.
所述用户信息包括如下至少一种:人脸信息、虹膜信息、指纹信息、声纹信息。飞行控制器在检测所述用户信息时,可控制无人飞行器100承载的拍摄设备22对该用户进行人脸识别或者虹膜识别,或者,无人飞行器还可以设置有指纹传感器,用户将手指放在指纹传感器上,飞行控制器通过指纹传感器来检测该用户的指纹信息,再或者,通过该无人飞行器的声音传感器检测用户的声纹信息。The user information includes at least one of the following: face information, iris information, fingerprint information, voiceprint information. When detecting the user information, the flight controller may control the photographing
若检测所述用户信息成功,则控制所述无人飞行器的状态灯按照第二闪灯模式闪灯;若检测所述用户信息失败,则控制所述无人飞行器的状态灯按照第三闪灯模式闪灯。具体的,当飞行控制器成功检测出用户信息例如人脸信息、虹膜信息、指纹信息、声纹信息中的一个或多个时,表示对用户身份进行确认,此时,飞行控制器可控制无人飞行器的状态灯例如前臂灯改为第二闪灯模式,该第二闪灯模式具体可以是绿灯常亮。当飞行控制器检测用户信息失败时,飞行控制器可控制无人飞行器的状态灯例如前臂灯改为第三闪灯模式,第三闪灯模式具体可以是红灯快闪,以提示用户再次配合无人飞行器进行用户信息的检测。If the user information is successfully detected, the status light of the unmanned aerial vehicle is controlled to flash in the second flash mode; if the user information is detected to be failed, the status light of the unmanned aerial vehicle is controlled according to the third flash Mode flashing. Specifically, when the flight controller successfully detects one or more of user information, such as face information, iris information, fingerprint information, and voiceprint information, it indicates that the user identity is confirmed. At this time, the flight controller can control none. The status light of the human aircraft, for example, the forearm light is changed to the second flash mode, and the second flash mode may specifically be that the green light is always on. When the flight controller fails to detect the user information, the flight controller may control the status light of the unmanned aerial vehicle such as the forearm light to change to the third flash mode, and the third flash mode may specifically be a red light flash to prompt the user to cooperate again. The UAV performs user information detection.
在其他实施例中,还可以通过例如用户晃动所述无人飞行器或摇摆所述无人飞行器的触发方式以触发飞行控制器检测用户信息,此处不再赘述。In other embodiments, the flight controller may be triggered to detect user information by, for example, a user shaking the unmanned aerial vehicle or swinging the unmanned aerial vehicle, and details are not described herein again.
通过上述方法,若飞行控制器成功检测出用户信息后,启动无人飞行器的电机,并控制无人飞行器从用户的手掌起飞,具体方法包括如下几种可实现的方式:Through the above method, if the flight controller successfully detects the user information, the motor of the unmanned aerial vehicle is started, and the unmanned aerial vehicle is controlled to take off from the palm of the user. The specific methods include the following achievable methods:
第一种可实现的方式是:飞行控制器成功检测出用户信息后,电调会发出蜂鸣警告,表示电机即将开始起转,提示用户需要小心,随后电机开始转动,电机转动带动螺旋桨转动,一段时间例如3秒左右之后,用户松开之前轻握无人飞行器的手,螺旋桨在转动时产生向上的拉力,随着电机的转速不断加大,螺旋桨的转速随之加大,当螺旋桨产生的拉力大于无人飞行器的重力时,无人飞行器起飞。The first achievable way is: after the flight controller successfully detects the user information, the ESC will send a buzzer warning, indicating that the motor is about to start to turn, prompting the user to be careful, then the motor starts to rotate, and the motor rotates to drive the propeller to rotate. After a period of time, for example, about 3 seconds, the user releases the hand of the unmanned aerial vehicle before the robot is released, and the propeller generates an upward pulling force when the propeller rotates. As the rotational speed of the motor increases, the rotational speed of the propeller increases, when the propeller generates When the pulling force is greater than the gravity of the unmanned aerial vehicle, the unmanned aerial vehicle takes off.
第二种可实现的方式是:飞行控制器成功检测出用户信息后,启动所述无人飞行器的电机,控制所述无人飞行器的电机怠速旋转;在检测到用 户的第二操作后,控制无人飞行器从用户的手掌起飞。所述第二操作包括如下至少一种:按压机身的操作、松开所述无人飞行器的操作、向上托举所述无人飞行器的操作。The second achievable manner is: after the flight controller successfully detects the user information, the motor of the unmanned aerial vehicle is started, and the motor of the unmanned aerial vehicle is controlled to rotate at an idle speed; After the second operation of the household, the unmanned aerial vehicle is controlled to take off from the palm of the user. The second operation includes at least one of: an operation of pressing the fuselage, an operation of releasing the unmanned aerial vehicle, and an operation of lifting the unmanned aerial vehicle upward.
具体的,飞行控制器成功检测出用户信息后,电调会发出蜂鸣警告,表示电机即将开始起转,提示用户需要小心,随后电机开始转动,并带动螺旋桨转动,电机开始转动后,可以先控制所述无人飞行器的电机怠速旋转,检测用户的第二操作,在检测到用户的第二操作后,控制无人飞行器从用户的手掌起飞。在本实施例中,第二操作可以是松开所述无人飞行器的操作和/或向上托举所述无人飞行器的操作,如图3所示,用户松开之前轻握无人飞行器的手,并轻轻向上托举无人飞行器100,以触发电机加速旋转直至从用户手掌上起飞,具体的,用户轻轻向上托举所述无人飞行器时,IMU可检测到无人飞行器向上的加速度或速度,飞行控制器根据无人飞行器向上的加速度或速度,控制电机加速旋转,电机带动螺旋桨加速旋转,当螺旋桨产生的拉力大于无人飞行器的重力时,无人飞行器起飞。在其他实施例中,第二操作还可以是按压机身的操作,例如无人飞行器的机身上设置有压力传感器,当用户按压机身时,压力传感器将用户对机身的压力转换为电信号,并将电信号传输给飞行控制器,飞行控制器根据该电信号触发电机加速旋转直至从用户手掌上起飞。Specifically, after the flight controller successfully detects the user information, the ESC will send a buzzer warning, indicating that the motor is about to start to turn, prompting the user to be careful, then the motor starts to rotate and drives the propeller to rotate. After the motor starts to rotate, the motor can start first. The motor of the unmanned aerial vehicle is controlled to rotate at an idle speed, and the second operation of the user is detected. After detecting the second operation of the user, the unmanned aerial vehicle is controlled to take off from the palm of the user. In this embodiment, the second operation may be an operation of releasing the unmanned aerial vehicle and/or an operation of lifting the unmanned aerial vehicle upward, as shown in FIG. 3, the user gently releases the unmanned aerial vehicle before releasing the unmanned aerial vehicle. Hand and gently lift the unmanned
另外,在其他实施例中,控制无人飞行器从用户的手掌起飞之前,可以不检测用户信息,即飞行控制器不检测用户信息,直接根据用户对无人飞行器的操作,控制无人飞行器从用户的手掌起飞,下面给出几种可行的方式:In addition, in other embodiments, before the unmanned aerial vehicle is controlled to take off from the user's palm, the user information may not be detected, that is, the flight controller does not detect the user information, and directly controls the unmanned aerial vehicle from the user according to the user's operation on the unmanned aerial vehicle. The palm of your hand takes off, and there are several possible ways to do it:
一种可行的方式是:用户手握无人飞行器向上加速运动,无人飞行器的惯性测量单元检测到向上的加速度或速度后,可将加速度或速度的值发送给飞行控制器,飞行控制器可根据加速度或速度值的大小,启动无人飞行器的电机,电机转动带动螺旋桨转动,螺旋桨转动时产生向上的拉力,用户松开无人飞行器,随着电机的转速不断加大,螺旋桨的转速随之加大,当螺旋桨产生的拉力大于无人飞行器的重力时,无人飞行器起飞。A feasible way is: the user holds the unmanned aerial vehicle to accelerate upward, and after the inertial measurement unit of the unmanned aerial vehicle detects the upward acceleration or speed, the acceleration or speed value can be sent to the flight controller, and the flight controller can According to the acceleration or speed value, the motor of the unmanned aerial vehicle is started. The rotation of the motor drives the propeller to rotate. When the propeller rotates, an upward pulling force is generated. When the user releases the unmanned aerial vehicle, the rotation speed of the propeller increases with the rotation speed of the motor. Increase, when the propeller produces a pulling force greater than the gravity of the unmanned aerial vehicle, the unmanned aerial vehicle takes off.
另一种可行的方式是:用户单击或双击无人飞行器尾部的电池开 关,飞行控制器检测到该用户单击或双击电池开关的操作后,启动无人飞行器的电机,电机转动带动螺旋桨转动,螺旋桨转动时产生向上的拉力,用户松开无人飞行器,随着电机的转速不断加大,螺旋桨的转速随之加大,当螺旋桨产生的拉力大于无人飞行器的重力时,无人飞行器起飞。Another possible way is: the user clicks or double clicks on the battery at the end of the UAV. Off, the flight controller detects that the user clicks or double-clicks the battery switch to start the motor of the unmanned aerial vehicle. The motor rotates to drive the propeller to rotate. When the propeller rotates, an upward pulling force is generated, and the user releases the unmanned aerial vehicle. The speed of the propeller continues to increase, and the speed of the propeller increases accordingly. When the pulling force generated by the propeller is greater than the gravity of the unmanned aerial vehicle, the unmanned aerial vehicle takes off.
再一种可行的方式是:用户双手握紧无人飞行器例如其支架,来回晃动或摆动,无人飞行器的惯性测量单元检测到无人飞行器的姿态信息,并将无人飞行器的姿态信息实时的发送给飞行控制器,该姿态信息包括俯仰角(英文:pitch angle)、横滚角(英文:roll angle)、偏航角(英文:yaw angle)等,由于用户来回晃动或摆动无人飞行器,该无人飞行器的姿态信息不断变化,飞行控制器可根据姿态信息的变化,启动无人飞行器的电机,电机转动带动螺旋桨转动,螺旋桨转动时产生向上的拉力,用户松开无人飞行器,随着电机的转速不断加大,螺旋桨的转速随之加大,当螺旋桨产生的拉力大于无人飞行器的重力时,无人飞行器起飞。Another feasible way is that the user grips the unmanned aerial vehicle such as its bracket with both hands, swings or swings back and forth, and the inertial measurement unit of the unmanned aerial vehicle detects the posture information of the unmanned aerial vehicle, and the posture information of the unmanned aerial vehicle is real-time. Sended to the flight controller, the attitude information includes a pitch angle (English: pitch angle), a roll angle (English: roll angle), a yaw angle (English: yaw angle), etc., because the user swings or swings the unmanned aerial vehicle, The attitude information of the unmanned aerial vehicle is constantly changing. The flight controller can start the motor of the unmanned aerial vehicle according to the change of the attitude information. The rotation of the motor drives the propeller to rotate, and the upward pulling force is generated when the propeller rotates, and the user releases the unmanned aerial vehicle. The rotation speed of the motor is continuously increased, and the rotation speed of the propeller is increased. When the pulling force generated by the propeller is greater than the gravity of the unmanned aerial vehicle, the unmanned aerial vehicle takes off.
又一种可行的方式是:用户按压机体顶部,无人飞行器的机体顶部设置有压力传感器,当用户按压机体顶部时,压力传感器将用户对机体顶部的压力转换为电信号,并将电信号传输给飞行控制器,飞行控制器根据该电信号启动无人飞行器的电机,电机转动带动螺旋桨转动,螺旋桨转动时产生向上的拉力,用户松开无人飞行器,随着电机的转速不断加大,螺旋桨的转速随之加大,当螺旋桨产生的拉力大于无人飞行器的重力时,无人飞行器起飞。Another feasible way is: the user presses the top of the body, and the top of the body of the unmanned aerial vehicle is provided with a pressure sensor. When the user presses the top of the body, the pressure sensor converts the pressure of the user to the top of the body into an electrical signal, and transmits the electrical signal. To the flight controller, the flight controller activates the motor of the unmanned aerial vehicle according to the electric signal, and the rotation of the motor drives the propeller to rotate. When the propeller rotates, an upward pulling force is generated, and the user releases the unmanned aerial vehicle. As the rotational speed of the motor increases, the propeller The rotational speed is increased accordingly, and when the pulling force generated by the propeller is greater than the gravity of the unmanned aerial vehicle, the unmanned aerial vehicle takes off.
本实施例不限定控制无人飞行器从用户手中起飞的方式,在其他实施例中还可以有其他的控制无人飞行器从用户手中起飞的方式。This embodiment does not limit the manner in which the unmanned aerial vehicle can be taken off from the user's hand. In other embodiments, there may be other ways to control the unmanned aerial vehicle to take off from the user's hand.
对于飞行控制器而言,确定所述无人飞行器从用户的手掌起飞的一种可实现方式是:通过所述无人飞行器下方的距离传感器检测的距离变化确定所述无人飞行器从用户的手掌起飞。具体的,用户松开轻握无人飞行器的手,并轻轻向上托举所述无人飞行器,以触发电机加速旋转,随着电机加速旋转,无人飞行器逐渐离开用户的手掌并不断上升,用户将手从无人飞行器的下方收回,此时无人飞行器下方的距离传感器检测
到的距离发生变化,如图4所示,用户的手位于无人飞行器的下方时,距离传感器检测到的距离是无人飞行器100距离用户的手掌20的高度为h2,h3是用户手掌20距离地面40的高度。如图5所示,用户将手从无人飞行器的下方收回后,距离传感器检测到的距离是无人飞行器100距离地面40的高度为h1,也就是说,在用户将手从无人飞行器的下方收回的这一时刻,距离传感器检测到的距离发生了变化,变化的大小为h3,当变化的大小大于预设的阈值时,飞行控制器确定出所述无人飞行器从用户的手掌起飞,可选的,该距离传感器包括如下至少一种:雷达、超声波探测设备、TOF测距探测设备、激光探测设备、视觉探测设备。For the flight controller, an achievable way to determine that the UAV is taking off from the user's palm is to determine the UAV from the user's palm by the distance change detected by the distance sensor below the UAV take off. Specifically, the user releases the hand of the unmanned aerial vehicle and gently lifts the unmanned aerial vehicle to trigger the motor to accelerate the rotation. As the motor accelerates and rotates, the unmanned aerial vehicle gradually leaves the user's palm and rises continuously. The user retracts the hand from the underside of the unmanned aerial vehicle, and at this time the distance sensor under the unmanned aerial vehicle detects
The distance to the change changes. As shown in FIG. 4, when the user's hand is located under the unmanned aerial vehicle, the distance detected by the distance sensor is that the height of the
根据上述方法,确定所述无人飞行器从用户的手掌起飞之后,控制所述无人飞行器悬停。可选的,所述无人飞行器悬停后,控制所述无人飞行器的状态灯按照第四闪灯模式闪灯,第四闪灯模式具体可以是红色常亮。According to the above method, after the unmanned aerial vehicle is taken off from the palm of the user, the unmanned aerial vehicle is controlled to hover. Optionally, after the UAV is hovered, the status light of the unmanned aerial vehicle is controlled to flash in a fourth flash mode, and the fourth flash mode may be red steady.
步骤S102、识别用户的手势。Step S102: Identify a gesture of the user.
控制所述无人飞行器悬停之后,控制所述无人飞行器进入手势识别模式。After controlling the UAV to hover, the UAV is controlled to enter a gesture recognition mode.
如图5所示,无人飞行器100悬停后,假设悬停在距离地面h1的位置,此时,用户可将手掌展开如图6所示,展开的手掌掌心正对于该无人飞行器的图像传感器,所述图像传感器包括如下至少一种:RGB相机、单目摄像头、双目摄像头、TOF相机。在本实施例中,该图像传感器可以是无人飞行器承载的拍摄设备22,拍摄设备22可以是无人飞行器100的主相机,拍摄设备22具体可以是一个RGB相机。或者,该图像传感器还可以是TOF相机,如图6所示的23,该TOF相机设置在无人飞行器的机头位置。飞行控制器可根据图像传感器例如TOF相机23检测到的图像信息确定无人飞行器的前方有障碍物,另外,也可以通过其他方式确定无人飞行器前方有障碍物,此时,飞行控制器控制无人飞行器进入手势识别模式,进一步的,飞行控制器确定无人飞行器距离该障碍物在预设距离范围内时,飞行控制器控制无人飞行器进入手势识别模式,所述无人飞行器进入手势识别模式后,控制所述无人飞行器的状态灯按照第一闪灯模式闪灯,第一闪灯模式具体为黄灯慢闪。具体的,飞行控制器可通过无
人飞行器机头前方的单目摄像头、双目摄像头、TOF相机等检测无人飞行器与该障碍物之间的距离,也可以通过无人飞行器的主相机拍摄的RGB图像或者无人飞行器前方的的TOF相机拍摄的深度图像检测无人飞行器与该障碍物之间的距离,此处,当用户位于无人飞行器前方时,无人飞行器与该障碍物之间的距离即为所述无人飞行器和所述用户之间的距离。若所述无人飞行器和所述用户之间的距离超出预设距离范围,则控制所述无人飞行器的状态灯按照第五闪灯模式闪灯,该预设距离范围具体可以是图像传感器的检测范围,例如该图像传感器是TOF相机,若所述无人飞行器和所述用户之间的距离超出TOF相机的检测范围时,TOF相机将无法准确识别出用户的手势,因此,为了提高对用户手势的识别准确度,需要确定所述无人飞行器和所述用户之间的距离是否超出图像传感器的检测范围,如果所述无人飞行器和所述用户之间的距离超出了图像传感器的检测范围,则通过控制状态灯的闪灯模式例如黄灯快闪以提醒用户调整其与无人飞行器之间的距离。As shown in FIG. 5, after the
步骤S103、若识别出所述用户的手势,则根据所述手势控制所述无人飞行器执行与所述手势对应的动作。Step S103: If the gesture of the user is recognized, controlling the unmanned aerial vehicle to perform an action corresponding to the gesture according to the gesture.
无人飞行器进入手势识别模式后,飞行控制器开始通过图像传感器识别用户的手势,具体的,获取所述无人飞行器的图像传感器捕捉的所述用户的手势的图像信息;根据所述用户的手势的图像信息,识别所述用户的手势。如果飞行控制器能够识别出该用户的手势,则表示该用户的手势是一个标准手势,即该手势是用于控制无人飞行器的手势。如果飞行控制器识别不出该用户的手势,则表示该用户的手势是一个非标准手势,即该手势不是用于控制无人飞行器的手势。After the UAV enters the gesture recognition mode, the flight controller begins to recognize the gesture of the user through the image sensor, and specifically, acquires image information of the gesture of the user captured by the image sensor of the UAV; according to the gesture of the user Image information identifying the user's gesture. If the flight controller is able to recognize the gesture of the user, it indicates that the gesture of the user is a standard gesture, that is, the gesture is a gesture for controlling the unmanned aerial vehicle. If the flight controller does not recognize the user's gesture, it indicates that the user's gesture is a non-standard gesture, ie, the gesture is not a gesture for controlling the unmanned aerial vehicle.
另外,若识别出所述用户的手势,则控制所述无人飞行器的状态灯按照第二闪灯模式闪灯,例如先单闪绿灯,再切为绿灯常亮;若识别所述用户的手势失败,则控制所述无人飞行器的状态灯按照第三闪灯模式闪灯,例如切为红灯快闪。In addition, if the gesture of the user is recognized, the status light of the UAV is controlled to flash in the second flash mode, for example, a single green light is flashed, and then the green light is always on; if the gesture of the user is recognized If it fails, the status light of the unmanned aerial vehicle is controlled to flash in a third flash mode, for example, a red light flashes.
此外,在本实施例中,当无人飞行器的状态灯按照第二闪灯模式闪灯即绿灯常亮时,表示无人飞行器进入受控状态,此时,飞行控制器将根据所述手势控制所述无人飞行器执行与所述手势对应的动作。 In addition, in this embodiment, when the status light of the UAV flashes in the second flash mode, that is, the green light is always on, indicating that the UAV enters a controlled state, at this time, the flight controller will control according to the gesture. The UAV performs an action corresponding to the gesture.
在本实施例中,若识别出所述用户的手势,则根据所述手势控制所述无人飞行器执行与所述手势对应的动作,包括如下至少一种:In this embodiment, if the gesture of the user is recognized, the unmanned aerial vehicle is controlled to perform an action corresponding to the gesture according to the gesture, including at least one of the following:
第一种:若识别出用户的拖动手势,则控制所述无人飞行器按照所述拖动手势的移动方向飞行,同时保持所述无人飞行器与用户的距离不变。The first type: if the user's drag gesture is recognized, the UAV is controlled to fly according to the moving direction of the drag gesture while keeping the distance between the UAV and the user unchanged.
用户可以将手掌张开至于胸前、掌心正对无人飞行器,当用户拖动手掌时,飞行控制器可通过图像识别,识别出用户的拖动手势,并控制所述无人飞行器按照所述拖动手势的移动方向飞行,例如,用户向其右侧拖动手掌,则飞行控制器控制无人飞行器向用户的右侧飞行,进一步的,还可以保持所述无人飞行器与用户的距离不变,例如,当用户手掌张开至于胸前、掌心正对无人飞行器、原地转动时,无人飞行器将以该用户为中心,按照与用户转动方向一致的方向转动,当用户转动速度较快,导致图像传感器无法及时捕获到用户的手掌时,飞行控制器还可以通过控制无人飞行器的状态灯的闪灯模式例如红灯常亮以提示用户。The user can open the palm to the chest and palm to face the unmanned aerial vehicle. When the user drags the palm, the flight controller can recognize the user's drag gesture by image recognition, and control the unmanned aerial vehicle according to the Flying in the direction of movement of the drag gesture, for example, if the user drags the palm to the right side thereof, the flight controller controls the unmanned aerial vehicle to fly to the right side of the user, and further, the distance between the unmanned aerial vehicle and the user may be maintained. For example, when the user's palm is opened to the chest and the palm is facing the unmanned aerial vehicle, the unmanned aerial vehicle will be centered on the user and rotate in the direction consistent with the user's direction of rotation. When the image sensor is unable to capture the palm of the user in time, the flight controller can also prompt the user by controlling the flash mode of the status light of the unmanned aerial vehicle, for example, the red light is always on.
第二种:若识别出用户的跟随手势,则根据所述跟随手势控制所述无人飞行器飞行至第一位置点;所述无人飞行器到达第一位置点后,将用户确定为跟随目标,控制所述无人飞行器对用户进行跟随。The second type: if the follow-up gesture of the user is recognized, the unmanned aerial vehicle is controlled to fly to the first location point according to the following gesture; after the unmanned aerial vehicle reaches the first location point, the user is determined to follow the target, The UAV is controlled to follow the user.
如图7所示,用户左右挥动手掌,例如左右挥动手掌两次,飞行控制器通过TOF相机23检测到用户张开的手掌左右挥动,并识别出该手势是跟随手势,则根据所述跟随手势控制所述无人飞行器飞行至第一位置点,可选的,在根据所述跟随手势控制所述无人飞行器飞行至第一位置点的过程中,控制所述无人飞行器的状态灯按照第六闪灯模式闪灯,第六闪灯模式具体可以是双闪绿灯。在本实施例中,用户左右挥动手掌的手势可作为用户的跟随手势,此处只是示意性说明,用户的跟随手势还可以是其他的手势。As shown in FIG. 7, the user swings the palm left and right, for example, swings the palm twice, and the flight controller detects that the open palm of the user swings left and right through the
根据上述方法识别出用户的跟随手势后,根据所述跟随手势控制所述无人飞行器飞行至第一位置点,具体的,根据所述跟随手势控制所述无人飞行器朝远离用户的方向后退飞行至第一位置点,例如,根据所述跟随手势控制所述无人飞行器朝远离用户的斜上方向后退飞行至第一位置点。所述第一位置点与用户之间的距离为预设的距离。如图8所示,飞 行控制器检测到用户手掌左右挥动时,控制无人飞行器朝远离用户的斜上方向后退飞行,在飞行过程中,距离传感器实时检测无人飞行器和用户之间的距离,当无人飞行器和用户之间的距离到达预设的距离时,无人飞行器再次悬停,再次悬停的位置即为第一位置点B点。其中,距离传感器可以包括IMU、视觉里程计等。After the following gesture is recognized according to the above method, the UAV is controlled to fly to the first location according to the following gesture, and specifically, the UAV is controlled to retreat away from the user according to the following gesture. To the first location point, for example, controlling the UAV to fly back to the first location point in an oblique direction away from the user according to the following gesture. The distance between the first location point and the user is a preset distance. As shown in Figure 8, fly When the row controller detects that the user's palm is waving left and right, the unmanned aerial vehicle is controlled to move backwards away from the user's oblique direction. During the flight, the distance sensor detects the distance between the unmanned aerial vehicle and the user in real time, when the unmanned aerial vehicle and the user When the distance between the two reaches the preset distance, the UAV hover again, and the position of hovering again is the first position point B. Wherein, the distance sensor may include an IMU, a visual odometer, and the like.
另外,在控制所述无人飞行器飞行至第一位置点的过程中,调整所述无人飞行器承载的云台的姿态,以使所述用户在所述无人飞行器的拍摄设备的拍摄画面中。如图9所示,无人飞行器从A点飞行到B点的过程中,飞行控制器不断调整无人飞行器承载的云台24的姿态,例如,无人飞行器从A点飞行到B点的过程中经过位置点C点,无人飞行器从A点飞行到C点、以及从C点飞行到B点的过程中,飞行控制器不断的调整云台24的姿态角,使得无人飞行器从A点飞行到B点的过程中用户始终在无人飞行器的拍摄设备22的拍摄画面中。In addition, in controlling the flight of the unmanned aerial vehicle to the first position point, adjusting a posture of the pan/tilt carried by the unmanned aerial vehicle, so that the user is in a shooting picture of the shooting device of the unmanned aerial vehicle . As shown in Fig. 9, during the flight of the UAV from point A to point B, the flight controller continuously adjusts the attitude of the
此外,所述无人飞行器飞行至第一位置点后,控制所述无人飞行器的状态灯按照第七闪灯模式闪灯。第七闪灯模式具体为黄灯常亮。具体的,无人飞行器从A点飞行到B点后悬停,同时控制无人飞行器的状态灯以黄灯常亮的模式闪灯,以提示用户当前无人飞行器已经进入智能跟随的目标检测状态。In addition, after the UAV flies to the first location point, the status light of the unmanned aerial vehicle is controlled to flash in accordance with the seventh flash mode. The seventh flash mode is specifically yellow light. Specifically, the unmanned aerial vehicle flies from point A to point B, and at the same time controls the state light of the unmanned aerial vehicle to flash in a pattern of steady yellow light to prompt the user that the current unmanned aerial vehicle has entered the target detection state of intelligent follow-up. .
进一步的,所述无人飞行器到达第一位置点后,将用户确定为跟随目标,控制所述无人飞行器对用户进行跟随。具体的,所述无人飞行器到达第一位置点后,确定用户的位置,根据所述用户的位置将用户确定为跟随目标。其中,确定用户的位置,根据所述用户的位置将用户确定为跟随目标的一种可实现的方式是:确定用户在无人飞行器的拍摄设备的拍摄画面中的位置,根据所述用户在所述拍摄画面中的位置将用户确定为跟随目标。Further, after the unmanned aerial vehicle reaches the first location point, the user is determined to follow the target, and the unmanned aerial vehicle is controlled to follow the user. Specifically, after the unmanned aerial vehicle reaches the first location point, the location of the user is determined, and the user is determined to follow the target according to the location of the user. Wherein, determining a location of the user, and determining, according to the location of the user, the user is determined to follow the target: determining a location of the user in the shooting screen of the shooting device of the unmanned aerial vehicle, according to the location of the user The position in the shooting picture determines the user to follow the target.
如图9所示,无人飞行器从A点飞行到B点后,飞行控制器确定用户的位置,该位置具体可以是用户在拍摄设备22的拍摄画面中的位置,并根据用户在拍摄画面中的位置将用户确定为跟随目标,将用户确定为跟随目标后,控制所述无人飞行器的状态灯按照第二闪灯模式闪灯,即绿灯常亮,指示用户无人飞行器当前已经进入智能跟随模式的受控状
态。当用户随意走动时,无人飞行器将自动跟随。As shown in FIG. 9, after the UAV flies from point A to point B, the flight controller determines the position of the user, which may specifically be the position of the user in the photographing screen of the photographing
确定用户在无人飞行器的拍摄设备的拍摄画面中的位置包括:根据所述无人飞行器上的云台的姿态、第一位置点与用户之间的距离、无人飞行器飞行至第一位置点的轨迹中的一个或多个确定用户在无人飞行器的拍摄设备的拍摄画面中的位置。如图9所示,无人飞行器从A点飞行到B点后,飞行控制器根据当前无人飞行器上的云台24的姿态、第一位置点B点与用户之间的距离、无人飞行器从A点飞行到B点的轨迹中的一个或多个确定用户在无人飞行器的拍摄设备22的拍摄画面中的位置。Determining the position of the user in the photographing screen of the photographing device of the unmanned aerial vehicle includes: according to the posture of the gimbal on the unmanned aerial vehicle, the distance between the first position point and the user, and the flying of the unmanned aerial vehicle to the first position point One or more of the trajectories determine the position of the user in the photographing screen of the photographing device of the unmanned aerial vehicle. As shown in FIG. 9, after the UAV flies from point A to point B, the flight controller according to the attitude of the pan/
此外,无人飞行器进入智能跟随模式后,识别用户的拍照手势,根据所述拍照手势控制所述无人飞行器上的拍摄设备对用户进行拍摄。具体的,在无人飞行器将用户确定为跟随目标后,用户还可以通过拍照手势控制无人飞行器上的拍摄设备对用户进行拍摄,用户对着无人飞行器的拍摄设备22做拍照手势,该拍照手势可以是如图10所示的手势,此处只是示意性说明,在其他实施例中还可以将其他的手势作为拍照手势。无人飞行器识别用户的拍照手势;根据所述拍照手势控制所述无人飞行器上的拍摄设备对用户进行拍摄。可选的,在识别出用户的拍照手势之后,控制所述无人飞行器的状态灯按照第三闪灯模式闪灯,该第三闪灯模式具体为红灯快闪,另外,拍摄设备对用户进行拍摄时,飞行控制器还可以通过无人飞行器的通信系统向用户携带的用户终端发送指示信息,该指示信息具体可以是一个语言提示,例如“3,2,1,咔嚓”,用户在收听到该语言提示时准备好拍照的姿态,拍摄设备完成拍照后,飞行控制器控制无人飞行器的状态灯恢复为绿灯常亮。In addition, after the UAV enters the smart follow mode, the user's photographing gesture is recognized, and the photographing device on the unmanned aerial vehicle is controlled to photograph the user according to the photographing gesture. Specifically, after the unmanned aerial vehicle determines the user to follow the target, the user can also control the shooting device on the unmanned aerial vehicle to photograph the user through the photographing gesture, and the user performs a photographing gesture on the photographing
第三种:若识别出所述用户的回航手势,则控制所述无人飞行器回航并悬停。Third: If the user's returning gesture is recognized, the UAV is controlled to return and hover.
当用户想要收回无人飞行器时,可以向无人飞行器挥手示意,例如单手挥动或双手挥动,如图11所示,用户向无人飞行器挥动单手,无人飞行器检测到用户的回航手势后,进入回航模式,飞行控制器控制所述无人飞行器回航并悬停,在本实施例中控制所述无人飞行器回航并悬停的一种可实现方式是:根据无人飞行器从A点飞行到B点的轨迹控制无人飞行器从B点原路返回到A点。当无人飞行器返回到A点后,飞行控 制器控制无人飞行器的状态灯恢复为红灯常亮模式,以提示用户自动飞行模式已经结束。When the user wants to take back the UAV, he can wave to the UAV, such as one-handed waving or two-handed waving. As shown in FIG. 11, the user waves one hand to the UAV, and the UAV detects the user's returning gesture. After entering the return flight mode, the flight controller controls the UAV to return and hover. In this embodiment, an achievable manner of controlling the UAV to return and hover is: according to the unmanned aerial vehicle from point A. The trajectory flying to point B controls the unmanned aerial vehicle to return from point B to point A. When the UAV returns to point A, flight control The controller controls the UAV's status light to return to the red light steady mode to prompt the user that the automatic flight mode has ended.
步骤S104、控制所述无人飞行器降落在所述用户的手掌上。Step S104: Control the UAV to land on the palm of the user.
如图12所示,用户召回无人飞行器后,无人飞行器悬停在A点,此时用户可以将手伸到无人飞行器的下方,飞行控制器确定所述用户的手掌在所述无人飞行器的下方后,控制所述无人飞行器降落在所述用户的手掌上。其中,确定所述用户的手掌在所述无人飞行器的下方,包括:通过所述无人飞行器下方的距离传感器检测到的距离变化和/或图像传感器获取的图像确定所述用户的手掌在所述无人飞行器的下方,下面分别进行介绍:As shown in Figure 12, after the user recalls the UAV, the UAV hoveres at point A, at which point the user can extend his hand under the UAV, and the flight controller determines that the user's palm is in the unmanned After the lower portion of the aircraft, the UAV is controlled to land on the palm of the user. Wherein determining that the user's palm is below the UAV includes: determining, by the distance sensor detected by the distance sensor below the UAV, and/or an image acquired by the image sensor to determine that the user's palm is in the Below the UAV, the following are introduced separately:
第一种:通过所述无人飞行器下方的距离传感器检测到的距离变化确定所述用户的手掌在所述无人飞行器的下方。First: determining the distance of the user's palm below the UAV by a change in distance detected by a distance sensor below the UAV.
如图12所示,用户召回无人飞行器后,无人飞行器悬停在A点,在用户没有伸出手时,无人飞行器下方的距离传感器25检测到的距离是无人飞行器距离地面的高度L1,用户将手伸到无人飞行器的下方后,距离传感器25检测到的距离是无人飞行器距离用户手掌的距离L2,则用户将手伸到无人飞行器的下方时,距离传感器25检测到的距离产生变化,该变化值大于预设值例如0.5米时,飞行控制器可根据该变化值确定所述用户的手掌在所述无人飞行器的下方。As shown in FIG. 12, after the user recalls the unmanned aerial vehicle, the unmanned aerial vehicle hovers at point A. When the user does not reach out, the distance detected by the
第二种:通过所述无人飞行器下方的图像传感器获取的图像确定所述用户的手掌在所述无人飞行器的下方。Second: determining, by the image acquired by the image sensor under the UAV, that the user's palm is below the UAV.
如图12所示,无人飞行器下方的图像传感器26可以是RGB相机、单目摄像头、双目摄像头、TOF相机等,此处的TOF相机和前述的TOF相机23的不同之处在于,TOF相机23设置在无人飞行器的机头位置,此处的TOF相机设置在无人飞行器的下方,对于无人飞行器而言,可以同时设置有配置在无人机下方的TOF相机和TOF相机23,也可以只设置两个中的一个。As shown in FIG. 12, the
图像传感器26将拍摄到的图像信息传输到分类器,该分类器可用于识别用户的手掌,该分类器具体可以是采用机器学习的方法进行训练得到的,例如提取包含手掌的样本数据集中每张图片的每个像素点的RGB或
灰度值和局部二值模式(Local Binary Pattern,LBP)值信息,使用支持向量机(Support Vector Machine,SVM)进行训练和分类得到该分类器。飞行控制器通过分类器识别出用户的手掌后,确定所述用户的手掌在所述无人飞行器的下方。The
第三种:通过所述无人飞行器下方的距离传感器检测到的距离变化和图像传感器获取的图像确定所述用户的手掌在所述无人飞行器的下方。Third: the distance detected by the distance sensor under the UAV and the image acquired by the image sensor determine that the palm of the user is below the UAV.
飞行控制器通过无人飞行器下方的距离传感器25检测到的距离变化,以及图像传感器26拍摄到的图像信息传输到分类器,分类器识别出用户的手掌,确定用户的手掌在所述无人飞行器的下方。其中,图像传感器26可以包括RGB相机、单目摄像头、双目摄像头、TOF相机等The flight controller transmits the distance change detected by the
由于TOF相机可以同时获取灰度图像和深度数据,则TOF相机可同时用于检测用户的手掌,以及无人飞行器与用户手掌之间的距离,因此,在某些情况下,距离传感器25和图像传感器26例如TOF相机可以是同一个传感器。Since the TOF camera can simultaneously acquire grayscale images and depth data, the TOF camera can simultaneously be used to detect the palm of the user and the distance between the unmanned aerial vehicle and the palm of the user, thus, in some cases, the
根据上述方法,确定所述用户的手掌在所述无人飞行器的下方后,控制所述无人飞行器降落在所述用户的手掌上的一种可实现的方式是:确定所述用户的手掌在所述无人飞行器的下方后,确定所述用户的手掌在水平方向上相对所述无人飞行器的位置;根据所述用户的手掌在水平方向上相对所述无人飞行器的位置控制所述无人飞行器降落在所述用户的手掌上。如图13所示,用户的手掌在水平方向上相对所述无人飞行器的位置具体可以是用户的手掌中心与无人飞行器的中心在水平方向上的距离L3,飞行控制器确定用户的手掌在无人飞行器的下方后,确定出用户的手掌中心与无人飞行器的中心在水平方向上的距离L3,并根据距离L3调整无人飞行器相对用户手掌的位置,使手掌中心与无人飞行器的中心在水平方向上的距离L3逐渐减小,当L3减小到预设范围后,降低电机的转速,如此可保证无人飞行器降落在用户的手掌中间,如图14所示,无人飞行器降落在了用户的手掌中间,从而防止落在手掌的侧边而滑落坠地。 According to the above method, after determining that the user's palm is below the UAV, an achievable way of controlling the UAV to land on the user's palm is to determine that the user's palm is After the underside of the unmanned aerial vehicle, determining the position of the palm of the user relative to the unmanned aerial vehicle in a horizontal direction; controlling the absence of the position of the unmanned aerial vehicle in a horizontal direction according to the palm of the user A human aircraft landed on the palm of the user. As shown in FIG. 13, the position of the palm of the user in the horizontal direction relative to the unmanned aerial vehicle may specifically be a distance L3 in the horizontal direction between the center of the palm of the user and the center of the unmanned aerial vehicle, and the flight controller determines that the palm of the user is After the UAV is below, determine the distance L3 between the center of the user's palm and the center of the UAV in the horizontal direction, and adjust the position of the UAV relative to the user's palm according to the distance L3, so that the center of the palm and the center of the UAV The distance L3 in the horizontal direction gradually decreases. When the L3 is reduced to the preset range, the rotation speed of the motor is lowered, so that the UAV can be lowered in the middle of the user's palm. As shown in FIG. 14, the UAV is landed at The middle of the user's palm, so as to prevent falling on the side of the palm and slipping to the ground.
本实施例通过控制无人飞行器从用户的手掌起飞,起飞后通过识别用户的手势,根据用户手势控制无人飞行器执行与该手势对应的动作,以及控制无人飞行器降落在用户的手掌上,使得用户通过手势即可控制无人飞行器,而不需要通过操控遥控器、用户终端等地面控制设备来控制无人飞行器,实现了一种能让普通用户快速上手且容易控制无人飞行器的方式。In this embodiment, the unmanned aerial vehicle is taken off from the palm of the user, and after the takeoff, the gesture of the user is recognized, the unmanned aerial vehicle is controlled according to the gesture of the user, and the action corresponding to the gesture is performed, and the unmanned aerial vehicle is controlled to land on the palm of the user. The user can control the unmanned aerial vehicle by gestures, and does not need to control the unmanned aerial vehicle by controlling the ground control device such as the remote controller and the user terminal, thereby realizing a way for the ordinary user to quickly get started and easily control the unmanned aerial vehicle.
本发明实施例提供一种无人飞行器的控制方法。在图1所示实施例的基础上,飞行控制器识别出所述用户的回航手势后,控制无人飞行器回航并悬停的方式还可以有另一种可实现方式,具体为:控制所述无人飞行器下降预设高度;控制所述无人飞行器向接近所述用户的方向飞行,以使所述无人飞行器在水平方向上与所述用户相距第二预设距离处悬停。Embodiments of the present invention provide a method for controlling an unmanned aerial vehicle. On the basis of the embodiment shown in FIG. 1 , after the flight controller recognizes the returning gesture of the user, the manner of controlling the unmanned aircraft to return to the air and hovering may also have another achievable manner, specifically: controlling the The UAV descends a preset height; controlling the UAV to fly in a direction approaching the user to hover the UAV in a horizontal direction from the user by a second predetermined distance.
作为图11所示的控制所述无人飞行器回航并悬停的一种可替代方式,如图15所示,用户向无人飞行器挥动单手,无人飞行器检测到用户的回航手势后,进入回航模式,此时,飞行控制器会控制无人飞行器先下降一定的高度到达D点,D点可以是用户胸口距离地面1.3m左右的位置;然后再根据用户的位置,控制无人飞行器向接近所述用户的方向飞行,即从D点向用户飞行,在无人飞行器从D点向用户飞行的过程中,当无人飞行器距离用户较远时,例如水平方向上无人飞行器距离用户5米之外的地方,可通过无人飞行器的拍摄设备22大致估计无人飞行器和用户之间的距离,当水平方向上无人飞行器距离用户5米以内时,可通过无人飞行器的TOF相机精确计算无人飞行器和用户之间的距离,保证无人飞行器在水平方向上与所述用户相距第二预设距离例如2m左右时停止,如图15所示,无人飞行器回航时悬停的点是E点,E点可以和上述实施例所述的A点相同,也可以不同。此时,将状态灯例如前臂灯恢复为红灯常亮模式,以提示用户自动飞行模式已经结束。As an alternative way of controlling the UAV to return and hover as shown in FIG. 11, as shown in FIG. 15, the user swings a single hand to the UAV, and after the UAV detects the user's returning gesture, the UAV enters In the return flight mode, at this time, the flight controller will control the unmanned aerial vehicle to descend to a certain height to reach the D point, and the D point may be a position where the user's chest is about 1.3 m from the ground; then, according to the position of the user, the unmanned aerial vehicle is controlled to approach. The direction of the user is flying, that is, flying from point D to the user. When the unmanned aerial vehicle is flying from the point D to the user, when the unmanned aerial vehicle is far away from the user, for example, the unmanned aerial vehicle is 5 meters away from the user in the horizontal direction. Outside the space, the distance between the UAV and the user can be roughly estimated by the UAV's
可选的,所述无人飞行器下降预设高度后,控制所述无人飞行器的状态灯按照第二闪灯模式闪灯;当所述无人飞行器在水平方向上与所述用户相距第二预设距离时,控制所述无人飞行器的状态灯按照第四闪灯模式闪灯。如图15所示,无人飞行器从B点降落到D点时,控制无人飞行器的状态灯按照绿灯常亮的模式闪灯,当无人飞行器在水平方向上与用户相距 第二预设距离例如2米时,控制所述无人飞行器的状态灯按照红灯常亮的模式闪灯,以提示用户自动飞行模式已经结束。Optionally, after the unmanned aerial vehicle descends by a preset height, the status light of the unmanned aerial vehicle is controlled to flash in a second flash mode; when the unmanned aerial vehicle is horizontally separated from the user by a second When the distance is preset, the status light of the unmanned aerial vehicle is controlled to flash in the fourth flash mode. As shown in Figure 15, when the UAV landed from point B to point D, the status lights controlling the unmanned aerial vehicle flashed in the green light mode, when the unmanned aircraft was horizontally separated from the user. When the second preset distance is, for example, 2 meters, the status light of the unmanned aerial vehicle is flashed in a red light steady mode to prompt the user that the automatic flight mode has ended.
本实施例通过控制无人飞行器的状态灯的闪灯模式,使得用户在脱离遥控器、用户终端等地面控制设备,通过手势控制无人飞行器时,根据无人飞行器的状态灯的闪灯模式,即可判断出无人飞行器所处的状态、执行的动作或执行动作后的结果,提高了用户通过手势控制无人飞行器的可靠性。In this embodiment, by controlling the flash mode of the status light of the unmanned aerial vehicle, the user can control the unmanned aerial vehicle by gestures when the user controls the unmanned aerial vehicle from the ground control device such as the remote controller or the user terminal, according to the flash mode of the status light of the unmanned aerial vehicle. The state of the UAV, the action performed, or the result of performing the action can be judged, and the reliability of the unmanned aerial vehicle controlled by the user is improved.
本发明实施例提供一种无人飞行器控制设备。该无人飞行器控制设备具体可以是上述实施例中所述的飞行控制器,该无人飞行器控制设备包括一个或多个处理器,单独或协同工作,所述处理器用于:控制无人飞行器从用户的手掌起飞;识别用户的手势;若识别出所述用户的手势,则根据所述手势控制所述无人飞行器执行与所述手势对应的动作;控制所述无人飞行器降落在所述用户的手掌上。Embodiments of the present invention provide an unmanned aerial vehicle control device. The UAV control device may specifically be the flight controller described in the above embodiments, the UAV control device comprising one or more processors operating separately or in cooperation, the processor being configured to: control the UAV from The user's palm takes off; recognizes the user's gesture; if the user's gesture is recognized, the unmanned aerial vehicle is controlled to perform an action corresponding to the gesture according to the gesture; and the unmanned aerial vehicle is controlled to land on the user On the palm of your hand.
可选的,所述处理器控制无人飞行器从用户的手掌起飞之前,还用于:检测用户信息;检测所述用户信息完成后,启动所述无人飞行器的电机。所述处理器检测用户信息时,具体用于:在检测到所述用户的第一操作后,检测所述用户信息。所述第一操作包括如下至少一种:单击或双击电池开关的操作、晃动所述无人飞行器的操作、摇摆所述无人飞行器的操作。所述用户信息包括如下至少一种:人脸信息、虹膜信息、指纹信息、声纹信息。Optionally, before the processor controls the unmanned aerial vehicle to take off from the palm of the user, the processor is further configured to: detect user information; and after detecting the completion of the user information, start the motor of the unmanned aerial vehicle. When the processor detects the user information, the processor is specifically configured to: after detecting the first operation of the user, detecting the user information. The first operation includes at least one of clicking or double clicking on an operation of the battery switch, shaking the operation of the unmanned aerial vehicle, and swinging the operation of the unmanned aerial vehicle. The user information includes at least one of the following: face information, iris information, fingerprint information, voiceprint information.
另外,所述处理器还用于:在检测所述用户信息时,控制所述无人飞行器的状态灯按照第一闪灯模式闪灯。若所述处理器检测所述用户信息成功,则控制所述无人飞行器的状态灯按照第二闪灯模式闪灯;若所述处理器检测所述用户信息失败,则控制所述无人飞行器的状态灯按照第三闪灯模式闪灯。In addition, the processor is further configured to: when detecting the user information, control a status light of the UAV to flash in a first flash mode. If the processor detects that the user information is successful, controlling the status light of the UAV to flash in a second flash mode; if the processor fails to detect the user information, controlling the UAV The status light flashes in the third flash mode.
具体的,所述处理器启动所述无人飞行器的电机之后,还用于:控制所述无人飞行器的电机怠速旋转;在检测到用户的第二操作后,控制无人飞行器从用户的手掌起飞。所述第二操作包括如下至少一种:按压机身的操作、松开所述无人飞行器的操作、向上托举所述无人飞行器的操作。 Specifically, after the processor starts the motor of the UAV, the method further includes: controlling an idle rotation of the motor of the UAV; and after detecting the second operation of the user, controlling the UAV from the palm of the user take off. The second operation includes at least one of: an operation of pressing the fuselage, an operation of releasing the unmanned aerial vehicle, and an operation of lifting the unmanned aerial vehicle upward.
所述处理器确定所述无人飞行器从用户的手掌起飞之后,还用于控制所述无人飞行器悬停。所述无人飞行器悬停后,所述处理器还用于控制所述无人飞行器的状态灯按照第四闪灯模式闪灯。具体的,所述处理器确定所述无人飞行器从用户的手掌起飞时,具体用于:通过所述无人飞行器下方的距离传感器检测的距离变化确定所述无人飞行器从用户的手掌起飞。所述距离传感器包括如下至少一种:雷达、超声波探测设备、TOF测距探测设备、激光探测设备、视觉探测设备。The processor determines that the UAV is used to control the UAV to hover after taking off from the user's palm. After the UAV is hovered, the processor is further configured to control the status light of the UAV to flash in a fourth flash mode. Specifically, when the processor determines that the UAV is taking off from the palm of the user, the processor is specifically configured to determine that the UAV takes off from the palm of the user by a distance change detected by a distance sensor below the UAV. The distance sensor includes at least one of the following: a radar, an ultrasonic detecting device, a TOF ranging detecting device, a laser detecting device, and a visual detecting device.
另外,所述处理器控制所述无人飞行器悬停之后,还用于:控制所述无人飞行器进入手势识别模式。所述无人飞行器进入手势识别模式后,所述处理器还用于控制所述无人飞行器的状态灯按照第一闪灯模式闪灯。所述处理器识别用户的手势时,具体用于:获取所述无人飞行器的图像传感器捕捉的所述用户的手势的图像信息;根据所述用户的手势的图像信息,识别所述用户的手势。所述图像传感器包括如下至少一种:RGB相机、单目摄像头、双目摄像头、TOF相机。In addition, after the processor controls the UAV to hover, the processor is further configured to: control the UAV to enter a gesture recognition mode. After the UAV enters the gesture recognition mode, the processor is further configured to control the status light of the UAV to flash in the first flash mode. When the processor recognizes the gesture of the user, the method is specifically configured to: acquire image information of the gesture of the user captured by an image sensor of the UAV; and identify a gesture of the user according to image information of the gesture of the user . The image sensor includes at least one of the following: an RGB camera, a monocular camera, a binocular camera, and a TOF camera.
此外,所述处理器还用于:通过距离传感器检测所述无人飞行器和所述用户之间的距离;若所述无人飞行器和所述用户之间的距离超出预设距离范围,则控制所述无人飞行器的状态灯按照第五闪灯模式闪灯。若所述处理器识别出所述用户的手势,则控制所述无人飞行器的状态灯按照第二闪灯模式闪灯;若所述处理器识别所述用户的手势失败,则控制所述无人飞行器的状态灯按照第三闪灯模式闪灯。若所述处理器识别出所述用户的拖动手势,则控制所述无人飞行器按照所述拖动手势的移动方向飞行,同时保持所述无人飞行器与用户的距离不变。若所述处理器识别出用户的跟随手势,则根据所述跟随手势控制所述无人飞行器飞行至第一位置点;所述无人飞行器到达第一位置点后,所述处理器将用户确定为跟随目标,控制所述无人飞行器对用户进行跟随。具体的,所述第一位置点与用户之间的距离为预设的距离。In addition, the processor is further configured to: detect, by a distance sensor, a distance between the UAV and the user; if a distance between the UAV and the user exceeds a preset distance range, control The status light of the UAV flashes in a fifth flash mode. Controlling, when the processor recognizes the gesture of the user, a status light of the UAV to flash in a second flash mode; if the processor identifies that the gesture of the user fails, controlling the The status light of the human aircraft flashes in the third flash mode. If the processor recognizes the drag gesture of the user, controlling the UAV to fly in accordance with the moving direction of the drag gesture while maintaining the distance between the UAV and the user unchanged. If the processor recognizes the following gesture of the user, controlling the unmanned aerial vehicle to fly to the first location point according to the following gesture; after the unmanned aerial vehicle reaches the first location point, the processor determines the user To follow the target, the UAV is controlled to follow the user. Specifically, the distance between the first location point and the user is a preset distance.
可选的,所述处理器还用于:在根据所述跟随手势控制所述无人飞行器飞行至第一位置点的过程中,控制所述无人飞行器的状态灯按照第六闪灯模式闪灯。所述处理器根据所述跟随手势控制所述无人飞行器飞行至第一位置点时,具体用于:根据所述跟随手势控制所述无人飞行器朝远离用 户的方向后退飞行至第一位置点。所述处理器根据所述跟随手势控制所述无人飞行器朝远离用户的方向后退飞行至第一位置点时,具体用于:根据所述跟随手势控制所述无人飞行器朝远离用户的斜上方向后退飞行至第一位置点。Optionally, the processor is further configured to: when the unmanned aerial vehicle is controlled to fly to the first location point according to the following gesture, control the status light of the unmanned aerial vehicle to flash according to the sixth flash mode light. When the processor controls the unmanned aerial vehicle to fly to the first location point according to the following gesture, the processor is specifically configured to: control the unmanned aerial vehicle to move away from the following according to the following gesture The direction of the user retreats to the first position. The processor is configured to control the unmanned aerial vehicle to fly back to the first position point in a direction away from the user according to the following gesture, and specifically, to: control the unmanned aerial vehicle to move away from the user according to the following gesture Fly back to the first position.
此外,所述处理器还用于:在控制所述无人飞行器飞行至第一位置点的过程中,调整所述无人飞行器承载的云台的姿态,以使所述用户在所述无人飞行器的拍摄设备的拍摄画面中。所述无人飞行器飞行至第一位置点后,所述处理器还用于控制所述无人飞行器的状态灯按照第七闪灯模式闪灯。所述无人飞行器到达第一位置点后,所述处理器将用户确定为跟随目标时,具体用于:确定用户的位置,根据所述用户的位置将用户确定为跟随目标。所述处理器确定用户的位置,根据所述用户的位置将用户确定为跟随目标时,具体用于:确定用户在无人飞行器的拍摄设备的拍摄画面中的位置,根据所述用户在所述拍摄画面中的位置将用户确定为跟随目标。In addition, the processor is further configured to: adjust a posture of the pan/tilt carried by the UAV during the process of controlling the unmanned aerial vehicle to fly to the first location point, so that the user is in the unmanned The shooting device of the aircraft's shooting device is in the picture. After the UAV flies to the first location, the processor is further configured to control the status light of the UAV to flash in accordance with the seventh flash mode. After the UAV reaches the first location point, when the processor determines the user to follow the target, the processor is specifically configured to: determine a location of the user, and determine the user as a follow target according to the location of the user. Determining, by the processor, the location of the user, when determining the user as the following target according to the location of the user, specifically determining: determining a location of the user in the photographing screen of the photographing device of the unmanned aerial vehicle, according to the user The position in the shooting screen determines the user to follow the target.
或者,所述处理器确定用户在无人飞行器的拍摄设备的拍摄画面中的位置时,具体用于:根据所述无人飞行器上的云台的姿态、第一位置点与用户之间的距离、无人飞行器飞行至第一位置点的轨迹中的一个或多个确定用户在无人飞行器的拍摄设备的拍摄画面中的位置。Alternatively, when the processor determines the position of the user in the photographing screen of the photographing device of the unmanned aerial vehicle, the method is specifically configured to: according to the posture of the gimbal on the unmanned aerial vehicle, the distance between the first position point and the user One or more of the trajectories of the unmanned aerial vehicle flying to the first position point determine the position of the user in the photographing screen of the photographing device of the unmanned aerial vehicle.
所述处理器将用户确定为跟随目标后,还用于控制所述无人飞行器的状态灯按照第二闪灯模式闪灯。After the processor determines the user to follow the target, the processor further controls the status light of the UAV to flash in the second flash mode.
可选的,所述处理器控制所述无人飞行器对用户进行跟随之后,还用于:识别用户的拍照手势;根据所述拍照手势控制所述无人飞行器上的拍摄设备对用户进行拍摄。所述处理器在识别出用户的拍照手势之后,还用于控制所述无人飞行器的状态灯按照第三闪灯模式闪灯。若所述处理器识别出所述用户的回航手势,则控制所述无人飞行器回航并悬停。Optionally, after the processor controls the UAV to follow the user, the processor is further configured to: identify a photographing gesture of the user; and control the photographing device on the unmanned aerial vehicle to photograph the user according to the photographing gesture. After identifying the photo gesture of the user, the processor is further configured to control the status light of the UAV to flash in a third flash mode. If the processor recognizes the user's returning gesture, the unmanned aircraft is controlled to return to the air and hover.
所述处理器控制所述无人飞行器降落在所述用户的手掌上时,具体用于:确定所述用户的手掌在所述无人飞行器的下方后,控制所述无人飞行器降落在所述用户的手掌上。所述处理器确定所述用户的手掌在所述无人飞行器的下方时具体用于:通过所述无人飞行器下方的距离传感器检测到的距离变化和/或图像传感器获取的图像确定所述用户的手掌在所述无人飞行器的下方。 When the processor controls the unmanned aerial vehicle to land on the palm of the user, specifically, after determining that the palm of the user is below the unmanned aerial vehicle, controlling the unmanned aerial vehicle to land in the On the palm of the user. Determining, by the processor, that the user's palm is below the unmanned aerial vehicle, the user is determined by the distance change detected by the distance sensor under the UAV and/or the image acquired by the image sensor. The palm of the hand is below the unmanned aerial vehicle.
所述处理器确定所述用户的手掌在所述无人飞行器的下方后,控制所述无人飞行器降落在所述用户的手掌上时,具体用于:确定所述用户的手掌在所述无人飞行器的下方后,确定所述用户的手掌在水平方向上相对所述无人飞行器的位置;根据所述用户的手掌在水平方向上相对所述无人飞行器的位置控制所述无人飞行器降落在所述用户的手掌上。After the processor determines that the palm of the user is under the unmanned aerial vehicle, when the unmanned aerial vehicle is controlled to land on the palm of the user, the processor is specifically configured to: determine that the palm of the user is in the After the lower side of the human aircraft, determining the position of the palm of the user relative to the unmanned aerial vehicle in a horizontal direction; controlling the unmanned aerial vehicle to land in a horizontal direction relative to the position of the unmanned aerial vehicle according to the palm of the user On the palm of the user.
本发明实施例提供的无人飞行器控制设备的具体原理和实现方式均与图1所示实施例类似,此处不再赘述。The specific principles and implementation manners of the unmanned aerial vehicle control device provided by the embodiments of the present invention are similar to the embodiment shown in FIG. 1 and will not be further described herein.
本实施例通过控制无人飞行器从用户的手掌起飞,起飞后通过识别用户的手势,根据用户手势控制无人飞行器执行与该手势对应的动作,以及控制无人飞行器降落在用户的手掌上,使得用户通过手势即可控制无人飞行器,而不需要通过操控遥控器、用户终端等地面控制设备来控制无人飞行器,实现了一种能让普通用户快速上手且容易控制无人飞行器的方式。In this embodiment, the unmanned aerial vehicle is taken off from the palm of the user, and after the takeoff, the gesture of the user is recognized, the unmanned aerial vehicle is controlled according to the gesture of the user, and the action corresponding to the gesture is performed, and the unmanned aerial vehicle is controlled to land on the palm of the user. The user can control the unmanned aerial vehicle by gestures, and does not need to control the unmanned aerial vehicle by controlling the ground control device such as the remote controller and the user terminal, thereby realizing a way for the ordinary user to quickly get started and easily control the unmanned aerial vehicle.
本发明实施例提供一种无人飞行器控制设备。在上述实施例提供的技术方案的基础上,所述处理器控制所述无人飞行器回航并悬停时,具体用于:控制所述无人飞行器下降预设高度;控制所述无人飞行器向接近所述用户的方向飞行,以使所述无人飞行器在水平方向上与所述用户相距第二预设距离。可选的,所述无人飞行器下降预设高度后,所述处理器还用于控制所述无人飞行器的状态灯按照第二闪灯模式闪灯;当所述无人飞行器在水平方向上与所述用户相距第二预设距离时,所述处理器还用于控制所述无人飞行器的状态灯按照第四闪灯模式闪灯。Embodiments of the present invention provide an unmanned aerial vehicle control device. Based on the technical solution provided by the foregoing embodiment, when the processor controls the UAV to return to the air and hover, the processor is specifically configured to: control the UAV to descend a preset height; and control the UAV to Flying in a direction close to the user such that the UAV is horizontally spaced from the user by a second predetermined distance. Optionally, after the UAV is lowered by a preset height, the processor is further configured to control the status light of the UAV to flash in a second flash mode; when the UAV is in a horizontal direction The processor is further configured to control the status light of the UAV to flash in accordance with the fourth flash mode when the second predetermined distance is away from the user.
本发明实施例提供的无人飞行器控制设备的具体原理和实现方式均与图15所示实施例类似,此处不再赘述。The specific principles and implementation manners of the unmanned aerial vehicle control device provided by the embodiments of the present invention are similar to the embodiment shown in FIG. 15 and will not be further described herein.
本实施例通过控制无人飞行器的状态灯的闪灯模式,使得用户在脱离遥控器、用户终端等地面控制设备,通过手势控制无人飞行器时,根据无人飞行器的状态灯的闪灯模式,即可判断出无人飞行器所处的状态、执行的动作或执行动作后的结果,提高了用户通过手势控制无人飞行器的可靠性。In this embodiment, by controlling the flash mode of the status light of the unmanned aerial vehicle, the user can control the unmanned aerial vehicle by gestures when the user controls the unmanned aerial vehicle from the ground control device such as the remote controller or the user terminal, according to the flash mode of the status light of the unmanned aerial vehicle. The state of the UAV, the action performed, or the result of performing the action can be judged, and the reliability of the unmanned aerial vehicle controlled by the user is improved.
本发明实施例提供一种无人飞行器的控制方法。图16为本发明实施 例提供的无人飞行器的控制方法的流程图。如图16所示,本实施例中的方法,可以包括:Embodiments of the present invention provide a method for controlling an unmanned aerial vehicle. Figure 16 is an implementation of the present invention A flow chart of a control method for an unmanned aerial vehicle provided by the example. As shown in FIG. 16, the method in this embodiment may include:
步骤S1601、识别用户的跟随手势。Step S1601, identifying a follow gesture of the user.
步骤S1602、根据所述跟随手势控制无人飞行器飞行至第一位置点。Step S1602, controlling the unmanned aerial vehicle to fly to the first position point according to the following gesture.
可选的,所述第一位置点与用户之间的距离为预设的距离。Optionally, the distance between the first location point and the user is a preset distance.
根据所述跟随手势控制无人飞行器飞行至第一位置点的一种可实现的方式是:根据所述跟随手势控制无人飞行器朝远离用户的方向后退飞行至第一位置点。具体的,根据所述跟随手势控制无人飞行器朝远离用户的斜上方向后退飞行至第一位置点。One achievable manner of controlling the unmanned aerial vehicle to fly to the first position point according to the following gesture is to control the unmanned aerial vehicle to fly back to the first position point in a direction away from the user according to the following gesture. Specifically, the UAV is controlled to fly back to the first position point in an oblique direction away from the user according to the following gesture.
另外,在控制无人飞行器飞行至第一位置点的过程中,调整所述无人飞行器承载的云台的姿态,以使所述用户在无人飞行器的拍摄设备的拍摄画面中。In addition, in controlling the flight of the unmanned aerial vehicle to the first position point, the posture of the pan/tilt carried by the unmanned aerial vehicle is adjusted to make the user in the photographing screen of the photographing device of the unmanned aerial vehicle.
步骤S1603、所述无人飞行器到达第一位置点后,将用户确定为跟随目标,控制所述无人飞行器对用户进行跟随。Step S1603: After the UAV arrives at the first location point, the user is determined to be a follow target, and the unmanned aerial vehicle is controlled to follow the user.
具体的,所述无人飞行器到达第一位置点后,确定用户的位置,根据所述用户的位置将用户确定为跟随目标。确定用户的位置,根据所述用户的位置将用户确定为跟随目标的一种可实现的方式是:确定用户在无人飞行器的拍摄设备的拍摄画面中的位置,根据所述用户在所述拍摄画面中的位置将用户确定为跟随目标。Specifically, after the unmanned aerial vehicle reaches the first location point, the location of the user is determined, and the user is determined to follow the target according to the location of the user. Determining the location of the user, and determining, according to the location of the user, an achievable manner of determining the user as a follow target is: determining a position of the user in the photographing screen of the photographing device of the unmanned aerial vehicle, according to which the user is photographing The position in the picture determines the user to follow the target.
其中,确定用户在无人飞行器的拍摄设备的拍摄画面中的位置包括:根据所述无人飞行器上的云台的姿态、第一位置点与用户之间的距离、无人飞行器飞行至第一位置点的轨迹中的一个或多个确定用户在无人飞行器的拍摄设备的拍摄画面中的位置。Wherein determining the position of the user in the photographing screen of the photographing device of the unmanned aerial vehicle comprises: according to the posture of the gimbal on the unmanned aerial vehicle, the distance between the first position point and the user, and the unmanned aerial vehicle flying to the first One or more of the trajectories of the location points determine the location of the user in the photographic scene of the photographic device of the UAV.
控制所述无人飞行器对用户进行跟随后,还可以识别用户的拍照手势;根据所述拍照手势,控制无人飞行器上的拍摄设备对用户进行拍摄。在识别出用户的拍照手势之后,控制无人飞行器上的状态灯按照第一闪灯模式闪灯。将用户确定为跟随目标后还可以控制无人飞行器上的状态灯以第二闪灯模式闪灯。After controlling the unmanned aerial vehicle to follow the user, the user may also recognize the photographing gesture of the user; according to the photographing gesture, the photographing device on the unmanned aerial vehicle is controlled to photograph the user. After the user's photographing gesture is recognized, the status light on the unmanned aerial vehicle is controlled to flash in the first flash mode. After the user is determined to follow the target, the status light on the UAV can also be controlled to flash in the second flash mode.
本发明实施例提供的无人飞行器的控制方法的具体原理和实现方式均与图1所示实施例类似,此处不再赘述。 The specific principles and implementation manners of the control method of the unmanned aerial vehicle provided by the embodiment of the present invention are similar to those of the embodiment shown in FIG. 1 and will not be further described herein.
本实施例通过识别用户的跟随手势,可控制无人飞行器飞行至第一位置点,并在第一位置点将用户确定为跟随目标,并控制无人飞行器对用户进行跟随,使得用户不需要在可视化的遥控器上框选无人飞行器跟随的目标,通过手势即可控制无人飞行器进行自动跟随,简化了控制无人飞行器进入跟随模式的方法,使得用户可以脱离遥控器、用户终端等地面控制设备,快速简单的控制无人飞行器自动跟随或航拍。In this embodiment, by recognizing the following gesture of the user, the UAV can be controlled to fly to the first location point, and the user is determined to follow the target at the first location, and the UAV is controlled to follow the user, so that the user does not need to The visualized remote control selects the target that the UAV follows, and controls the unmanned aerial vehicle to automatically follow through the gesture, which simplifies the method of controlling the UAV to enter the following mode, so that the user can leave the ground control such as the remote controller and the user terminal. The device quickly and easily controls the automatic follow-up or aerial photography of the UAV.
本发明实施例提供一种无人飞行器控制设备。该无人飞行器控制设备具体可以是上述实施例中所述的飞行控制器,该无人飞行器控制设备包括一个或多个处理器,单独或协同工作,所述处理器用于:识别用户的跟随手势;根据所述跟随手势控制无人飞行器飞行至第一位置点;所述无人飞行器到达第一位置点后,将用户确定为跟随目标,控制所述无人飞行器对用户进行跟随。所述第一位置点与用户之间的距离为预设的距离。Embodiments of the present invention provide an unmanned aerial vehicle control device. The UAV control device may specifically be the flight controller described in the above embodiment, the UAV control device includes one or more processors, which work separately or in cooperation, and the processor is configured to: identify a follow gesture of the user And controlling the unmanned aerial vehicle to fly to the first position point according to the following gesture; after the unmanned aerial vehicle reaches the first position point, the user is determined to follow the target, and the unmanned aerial vehicle is controlled to follow the user. The distance between the first location point and the user is a preset distance.
所述处理器根据所述跟随手势控制无人飞行器飞行至第一位置点时,具体用于:根据所述跟随手势控制无人飞行器朝远离用户的方向后退飞行至第一位置点。When the processor controls the unmanned aerial vehicle to fly to the first position point according to the following gesture, the processor is specifically configured to: according to the following gesture, control the unmanned aerial vehicle to fly backward to the first position point away from the user.
所述处理器根据所述跟随手势控制无人飞行器朝远离用户的方向后退飞行至第一位置点时,具体用于:根据所述跟随手势控制无人飞行器朝远离用户的斜上方向后退飞行至第一位置点。The processor is configured to control the unmanned aerial vehicle to fly back to the first position point in a direction away from the user according to the following gesture, and specifically, to: control the unmanned aerial vehicle to fly back away from the user in an oblique direction according to the following gesture to The first location point.
所述处理器还用于:在控制无人飞行器飞行至第一位置点的过程中,调整所述无人飞行器承载的云台的姿态,以使所述用户在无人飞行器的拍摄设备的拍摄画面中。The processor is further configured to: adjust a posture of the pan/tilt carried by the unmanned aerial vehicle in the process of controlling the unmanned aerial vehicle to fly to the first position point, so that the user photographs the shooting device of the unmanned aerial vehicle In the picture.
所述无人飞行器到达第一位置点后,所述处理器将用户确定为跟随目标时,具体用于:确定用户的位置,根据所述用户的位置将用户确定为跟随目标。所述处理器确定用户的位置,根据所述用户的位置将用户确定为跟随目标时,具体用于:确定用户在无人飞行器的拍摄设备的拍摄画面中的位置,根据所述用户在所述拍摄画面中的位置将用户确定为跟随目标。After the UAV reaches the first location point, when the processor determines the user to follow the target, the processor is specifically configured to: determine a location of the user, and determine the user as a follow target according to the location of the user. Determining, by the processor, the location of the user, when determining the user as the following target according to the location of the user, specifically determining: determining a location of the user in the photographing screen of the photographing device of the unmanned aerial vehicle, according to the user The position in the shooting screen determines the user to follow the target.
所述处理器确定用户在无人飞行器的拍摄设备的拍摄画面中的位置时,具体用于:根据所述无人飞行器上的云台的姿态、第一位置点与用户之间的距离、无人飞行器飞行至第一位置点的轨迹中的一个或多个确定用 户在无人飞行器的拍摄设备的拍摄画面中的位置。When the processor determines the position of the user in the photographing screen of the photographing device of the unmanned aerial vehicle, the method is specifically configured to: according to the posture of the pan/tilt on the unmanned aerial vehicle, the distance between the first position point and the user, One or more of the trajectories of the human aircraft flying to the first location point for determination The position of the user in the shooting screen of the shooting device of the unmanned aerial vehicle.
所述处理器控制所述无人飞行器对用户进行跟随后,还用于:识别用户的拍照手势;根据所述拍照手势,控制无人飞行器上的拍摄设备对用户进行拍摄。After the processor controls the UAV to follow the user, the processor is further configured to: identify a photographing gesture of the user; and control the photographing device on the unmanned aerial vehicle to photograph the user according to the photographing gesture.
所述处理器还用于:在识别出用户的拍照手势之后,控制无人飞行器上的状态灯按照第一闪灯模式闪灯。The processor is further configured to: after the user's photographing gesture is recognized, control the status light on the unmanned aerial vehicle to flash in the first flash mode.
所述处理器将用户确定为跟随目标后,还用于:控制无人飞行器上的状态灯以第二闪灯模式闪灯。After the processor determines the user to follow the target, the processor is further configured to: control the status light on the unmanned aerial vehicle to flash in the second flash mode.
本发明实施例提供的无人飞行器控制设备的具体原理和实现方式均与图16所示实施例类似,此处不再赘述。The specific principles and implementation manners of the unmanned aerial vehicle control device provided by the embodiments of the present invention are similar to the embodiment shown in FIG. 16 and will not be further described herein.
本实施例通过识别用户的跟随手势,可控制无人飞行器飞行至第一位置点,并在第一位置点将用户确定为跟随目标,并控制无人飞行器对用户进行跟随,使得用户不需要在可视化的遥控器上框选无人飞行器跟随的目标,通过手势即可控制无人飞行器进行自动跟随,简化了控制无人飞行器进入跟随模式的方法,使得用户可以脱离遥控器、用户终端等地面控制设备,快速简单的控制无人飞行器自动跟随或航拍。In this embodiment, by recognizing the following gesture of the user, the UAV can be controlled to fly to the first location point, and the user is determined to follow the target at the first location, and the UAV is controlled to follow the user, so that the user does not need to The visualized remote control selects the target that the UAV follows, and controls the unmanned aerial vehicle to automatically follow through the gesture, which simplifies the method of controlling the UAV to enter the following mode, so that the user can leave the ground control such as the remote controller and the user terminal. The device quickly and easily controls the automatic follow-up or aerial photography of the UAV.
本发明实施例提供一种无人飞行器。图17为本发明实施例提供的无人飞行器的结构图,如图17所示,无人飞行器1700包括:机身、动力系统和无人飞行器控制设备1718,无人飞行器控制设备1718具体可以是飞行控制器,所述动力系统包括如下至少一种:电机1707、螺旋桨1706和电子调速器1717,动力系统安装在所述机身,用于提供飞行动力;飞行控制器与所述动力系统通讯连接,用于控制所述无人飞行器飞行;其中,飞行控制器包括惯性测量单元及陀螺仪。所述惯性测量单元及所述陀螺仪用于检测所述无人飞行器的加速度、俯仰角、横滚角及偏航角等。Embodiments of the present invention provide an unmanned aerial vehicle. FIG. 17 is a structural diagram of an unmanned aerial vehicle according to an embodiment of the present invention. As shown in FIG. 17, the unmanned
另外,如图17所示,无人飞行器1700还包括:传感系统1708、通信系统1710、支撑设备1702、拍摄设备1704,其中,支撑设备1702具体可以是云台,通信系统1710具体可以包括接收机,接收机用于接收地面站1712的天线1714发送的无线信号,1716表示接收机和天线1714通信过程中产生的电磁波。
In addition, as shown in FIG. 17, the unmanned
本发明实施例中的无人飞行器控制设备1718的具体原理和实现方式均与上述实施例类似,此处不再赘述。The specific principles and implementation manners of the
本实施例通过控制无人飞行器从用户的手掌起飞,起飞后通过识别用户的手势,根据用户手势控制无人飞行器执行与该手势对应的动作,以及控制无人飞行器降落在用户的手掌上,使得用户通过手势即可控制无人飞行器,而不需要通过操控遥控器、用户终端等地面控制设备来控制无人飞行器,实现了一种能让普通用户快速上手且容易控制无人飞行器的方式。In this embodiment, the unmanned aerial vehicle is taken off from the palm of the user, and after the takeoff, the gesture of the user is recognized, the unmanned aerial vehicle is controlled according to the gesture of the user, and the action corresponding to the gesture is performed, and the unmanned aerial vehicle is controlled to land on the palm of the user. The user can control the unmanned aerial vehicle by gestures, and does not need to control the unmanned aerial vehicle by controlling the ground control device such as the remote controller and the user terminal, thereby realizing a way for the ordinary user to quickly get started and easily control the unmanned aerial vehicle.
在本发明所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
上述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium. The above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present invention. Part of the steps. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
本领域技术人员可以清楚地了解到,为描述的方便和简洁,仅以上 述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的装置的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and simplicity of the description, only the above The division of each functional module is illustrated. In practical applications, the above function assignment can be completed by different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. . For the specific working process of the device described above, refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。 Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present invention. range.
Claims (102)
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201780028633.5A CN109196439B (en) | 2017-04-28 | 2017-04-28 | Unmanned aerial vehicle control method, equipment and unmanned aerial vehicle |
| CN202210382952.9A CN114879720A (en) | 2017-04-28 | 2017-04-28 | Unmanned aerial vehicle control method and device and unmanned aerial vehicle |
| PCT/CN2017/082331 WO2018195883A1 (en) | 2017-04-28 | 2017-04-28 | Method and device for controlling unmanned aerial vehicle, and unmanned aerial vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/082331 WO2018195883A1 (en) | 2017-04-28 | 2017-04-28 | Method and device for controlling unmanned aerial vehicle, and unmanned aerial vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018195883A1 true WO2018195883A1 (en) | 2018-11-01 |
Family
ID=63917819
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2017/082331 Ceased WO2018195883A1 (en) | 2017-04-28 | 2017-04-28 | Method and device for controlling unmanned aerial vehicle, and unmanned aerial vehicle |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN114879720A (en) |
| WO (1) | WO2018195883A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111913493A (en) * | 2019-05-09 | 2020-11-10 | 经纬航太科技股份有限公司 | Unmanned aerial vehicle landing device and method |
| CN111913580A (en) * | 2020-08-12 | 2020-11-10 | 南京工业职业技术学院 | A gesture drone controller based on infrared photoelectricity |
| TWI809614B (en) * | 2021-11-02 | 2023-07-21 | 大陸商廣州昂寶電子有限公司 | UAV control method and system and remote controller for remote control of UAV |
| WO2023211694A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Stabilization and navigation of an autonomous drone |
| WO2023211690A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Landing an autonomous drone with gestures |
| WO2023211655A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Fully autonomous drone flight control |
| WO2023211695A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Unlocking an autonomous drone for takeoff |
| US12344409B2 (en) | 2022-04-27 | 2025-07-01 | Snap Inc. | Fully autonomous drone flights |
| US12360531B2 (en) | 2022-04-27 | 2025-07-15 | Snap Inc. | Stabilization and navigation of an autonomous drone |
| US12372975B2 (en) | 2022-04-27 | 2025-07-29 | Snap Inc. | Unlocking an autonomous drone for takeoff |
| US12517521B2 (en) | 2022-04-27 | 2026-01-06 | Snap Inc. | Landing an autonomous drone with gestures |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105204349A (en) * | 2015-08-19 | 2015-12-30 | 杨珊珊 | Unmanned aerial vehicle for intelligent household control and control method thereof |
| WO2015200209A1 (en) * | 2014-06-23 | 2015-12-30 | Nixie Labs, Inc. | Wearable unmanned aerial vehicles, launch- controlled unmanned aerial vehicles, and associated systems and methods |
| CN105867405A (en) * | 2016-05-23 | 2016-08-17 | 零度智控(北京)智能科技有限公司 | UAV (unmanned aerial vehicle) as well as UAV landing control method and device |
| CN106227234A (en) * | 2016-09-05 | 2016-12-14 | 重庆零度智控智能科技有限公司 | Unmanned plane, unmanned plane take off control method and device |
| CN106444843A (en) * | 2016-12-07 | 2017-02-22 | 北京奇虎科技有限公司 | Unmanned aerial vehicle relative azimuth control method and device |
| CN106502270A (en) * | 2017-01-04 | 2017-03-15 | 深圳极天创新科技有限公司 | Unmanned plane, unmanned plane take off control method and device |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150317924A1 (en) * | 2014-05-02 | 2015-11-05 | John Chowhan Park | Unmanned Aerial System for Creating Aerial Message |
| CN107209519B (en) * | 2014-12-31 | 2021-07-16 | 深圳市大疆创新科技有限公司 | Vehicle Height Limits and Controls |
| CN104808680A (en) * | 2015-03-02 | 2015-07-29 | 杨珊珊 | Multi-rotor flight shooting device |
| KR101741544B1 (en) * | 2015-04-14 | 2017-05-30 | 이병인 | System and Method for tracing location of golf ball in real time using pilotless aircraft |
| CN104843193A (en) * | 2015-05-13 | 2015-08-19 | 零度智控(北京)智能科技有限公司 | Unmanned aerial vehicle lamplight warning system |
| CN104867371B (en) * | 2015-05-29 | 2017-05-31 | 高域(北京)智能科技研究院有限公司 | The training guide and method of a kind of aircraft |
| CN105184776B (en) * | 2015-08-17 | 2018-09-28 | 中国测绘科学研究院 | Method for tracking target |
| CN105223957B (en) * | 2015-09-24 | 2018-10-02 | 北京零零无限科技有限公司 | A kind of method and apparatus of gesture manipulation unmanned plane |
| CN105549463B (en) * | 2015-12-10 | 2017-12-26 | 深圳市大疆创新科技有限公司 | Unmanned plane and its method for monitoring state, condition monitoring system, state monitoring device |
| CN105487555B (en) * | 2016-01-14 | 2018-09-28 | 浙江华飞智能科技有限公司 | A kind of station keeping method and device of unmanned plane |
| CN105607647A (en) * | 2016-02-25 | 2016-05-25 | 谭圆圆 | Shooting scope adjusting system of aerial equipment and corresponding adjusting method |
| CN105554480B (en) * | 2016-03-01 | 2018-03-16 | 深圳市大疆创新科技有限公司 | Control method, device, user equipment and the unmanned plane of unmanned plane shooting image |
| CN105786016B (en) * | 2016-03-31 | 2019-11-05 | 深圳奥比中光科技有限公司 | The processing method of unmanned plane and RGBD image |
| CN105843241A (en) * | 2016-04-11 | 2016-08-10 | 零度智控(北京)智能科技有限公司 | Unmanned aerial vehicle, unmanned aerial vehicle takeoff control method and apparatus |
| CN105730707B (en) * | 2016-04-28 | 2018-04-03 | 深圳飞马机器人科技有限公司 | A kind of hand of unmanned plane throws automatic takeoff method |
| CN106020227B (en) * | 2016-08-12 | 2019-02-26 | 北京奇虎科技有限公司 | Control method and device of unmanned aerial vehicle |
-
2017
- 2017-04-28 WO PCT/CN2017/082331 patent/WO2018195883A1/en not_active Ceased
- 2017-04-28 CN CN202210382952.9A patent/CN114879720A/en active Pending
- 2017-04-28 CN CN201780028633.5A patent/CN109196439B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015200209A1 (en) * | 2014-06-23 | 2015-12-30 | Nixie Labs, Inc. | Wearable unmanned aerial vehicles, launch- controlled unmanned aerial vehicles, and associated systems and methods |
| CN105204349A (en) * | 2015-08-19 | 2015-12-30 | 杨珊珊 | Unmanned aerial vehicle for intelligent household control and control method thereof |
| CN105867405A (en) * | 2016-05-23 | 2016-08-17 | 零度智控(北京)智能科技有限公司 | UAV (unmanned aerial vehicle) as well as UAV landing control method and device |
| CN106227234A (en) * | 2016-09-05 | 2016-12-14 | 重庆零度智控智能科技有限公司 | Unmanned plane, unmanned plane take off control method and device |
| CN106444843A (en) * | 2016-12-07 | 2017-02-22 | 北京奇虎科技有限公司 | Unmanned aerial vehicle relative azimuth control method and device |
| CN106502270A (en) * | 2017-01-04 | 2017-03-15 | 深圳极天创新科技有限公司 | Unmanned plane, unmanned plane take off control method and device |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111913493A (en) * | 2019-05-09 | 2020-11-10 | 经纬航太科技股份有限公司 | Unmanned aerial vehicle landing device and method |
| CN111913580A (en) * | 2020-08-12 | 2020-11-10 | 南京工业职业技术学院 | A gesture drone controller based on infrared photoelectricity |
| TWI809614B (en) * | 2021-11-02 | 2023-07-21 | 大陸商廣州昂寶電子有限公司 | UAV control method and system and remote controller for remote control of UAV |
| WO2023211694A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Stabilization and navigation of an autonomous drone |
| WO2023211690A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Landing an autonomous drone with gestures |
| WO2023211655A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Fully autonomous drone flight control |
| WO2023211695A1 (en) * | 2022-04-27 | 2023-11-02 | Snap Inc. | Unlocking an autonomous drone for takeoff |
| US12344409B2 (en) | 2022-04-27 | 2025-07-01 | Snap Inc. | Fully autonomous drone flights |
| US12360531B2 (en) | 2022-04-27 | 2025-07-15 | Snap Inc. | Stabilization and navigation of an autonomous drone |
| US12372975B2 (en) | 2022-04-27 | 2025-07-29 | Snap Inc. | Unlocking an autonomous drone for takeoff |
| US12517521B2 (en) | 2022-04-27 | 2026-01-06 | Snap Inc. | Landing an autonomous drone with gestures |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109196439B (en) | 2022-04-29 |
| CN109196439A (en) | 2019-01-11 |
| CN114879720A (en) | 2022-08-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109196439B (en) | Unmanned aerial vehicle control method, equipment and unmanned aerial vehicle | |
| US11914370B2 (en) | System and method for providing easy-to-use release and auto-positioning for drone applications | |
| US12125229B2 (en) | UAV control method, device and UAV | |
| US10824149B2 (en) | System and method for automated aerial system operation | |
| CN108521812A (en) | Control method, unmanned plane and the machine readable storage medium of unmanned plane | |
| US10409276B2 (en) | System and method for controller-free user drone interaction | |
| CN106444824B (en) | Unmanned aerial vehicle, unmanned aerial vehicle landing control device and method | |
| US20200027357A1 (en) | Method for controlling aircraft, device, and aircraft | |
| CN106444843A (en) | Unmanned aerial vehicle relative azimuth control method and device | |
| CN106292799B (en) | Unmanned plane, remote control and its control method | |
| US11449076B2 (en) | Method for controlling palm landing of unmanned aerial vehicle, control device, and unmanned aerial vehicle | |
| WO2019128275A1 (en) | Photographing control method and device, and aircraft | |
| US20200382696A1 (en) | Selfie aerial camera device | |
| JP2020187716A (en) | Equipment and methods for landing unmanned aerial vehicles | |
| CN110291482A (en) | Return control method, device and equipment | |
| US10308359B2 (en) | Moving device, method of controlling moving device and storage medium | |
| WO2022082440A1 (en) | Method, apparatus and system for determining target following strategy, and device and storage medium | |
| CN106647788B (en) | UAV flight control method and device | |
| CN112711274A (en) | Unmanned aerial vehicle control method and device, unmanned aerial vehicle and computer readable storage medium | |
| CN108351651B (en) | Image-based control method, device and aircraft |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17907206 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17907206 Country of ref document: EP Kind code of ref document: A1 |