CN106909163A - Immersive VR unmanned plane control loop - Google Patents
Immersive VR unmanned plane control loop Download PDFInfo
- Publication number
- CN106909163A CN106909163A CN201510968246.2A CN201510968246A CN106909163A CN 106909163 A CN106909163 A CN 106909163A CN 201510968246 A CN201510968246 A CN 201510968246A CN 106909163 A CN106909163 A CN 106909163A
- Authority
- CN
- China
- Prior art keywords
- unmanned plane
- control loop
- immersive
- flight
- drone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical group C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 claims abstract description 13
- 238000004891 communication Methods 0.000 claims description 16
- 238000003384 imaging method Methods 0.000 claims description 3
- 230000004886 head movement Effects 0.000 abstract description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/10—Simultaneous control of position or course in three dimensions
- G05D1/101—Simultaneous control of position or course in three dimensions specially adapted for aircraft
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Aviation & Aerospace Engineering (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Automation & Control Theory (AREA)
- Selective Calling Equipment (AREA)
Abstract
一种沉浸式虚拟现实无人机驾驶系统,该无人机驾驶系统包括:虚拟现实头盔,用于捕获无人机上的摄像机获取的飞行场景并提供给用户,并跟踪用户的头部动作产生飞行控制信号;以及数据手套,用于根据该虚拟现实头盔提供的飞行控制信号,控制无人机遥控器,进而控制无人机在该飞行场景的飞行动作。本发明能够大大提升用户体验。
An immersive virtual reality unmanned aerial vehicle driving system, the unmanned aerial vehicle driving system includes: a virtual reality helmet, which is used to capture the flight scene acquired by the camera on the unmanned aerial vehicle and provide it to the user, and track the user's head movement to generate the flight the control signal; and the data glove, which is used to control the remote controller of the drone according to the flight control signal provided by the virtual reality helmet, and then control the flight action of the drone in the flight scene. The present invention can greatly improve user experience.
Description
技术领域 technical field
本发明涉及驾驶系统,尤其涉及无人机的驾驶系统。 The present invention relates to a driving system, in particular to a driving system of an unmanned aerial vehicle.
背景技术 Background technique
在空中自由飞翔是许多人的的梦想,无人机的出现为实现这一梦想提供了可能。参见图1,现有的无人机10通常包括摄像机101和无线传输系统102。现有的无人机10的操作,通常是由用户50目测,手动操作无人机遥控器20上的遥控手柄来实现,并不能带给人们真实飞翔的感受。可见,实有必要对现有的无人机的驾驶系统进行改进。 Flying freely in the air is the dream of many people, and the emergence of drones provides the possibility to realize this dream. Referring to FIG. 1 , an existing drone 10 generally includes a camera 101 and a wireless transmission system 102 . The operation of the existing drone 10 is usually realized by the user 50 visually observing and manually operating the remote control handle on the remote controller 20 of the drone, which cannot give people the feeling of real flying. It can be seen that it is necessary to improve the driving system of the existing unmanned aerial vehicle.
发明内容 Contents of the invention
本发明要解决的技术问题在于克服上述现有技术存在的不足,而提出一种沉浸式虚拟现实无人机驾驶系统,能够大大提升用户体验。 The technical problem to be solved by the present invention is to overcome the above-mentioned deficiencies in the prior art, and propose an immersive virtual reality drone driving system, which can greatly improve user experience.
本发明针对上述技术问题而提出的技术方案包括,提出一种沉浸式虚拟现实无人机驾驶系统,该无人机驾驶系统包括:虚拟现实头盔,用于捕获无人机上的摄像机获取的飞行场景并提供给用户,并跟踪用户的头部动作产生飞行控制信号;以及数据手套,用于根据该虚拟现实头盔提供的飞行控制信号,控制无人机遥控器,进而控制无人机在该飞行场景的飞行动作。 The technical solution proposed by the present invention for the above technical problems includes proposing an immersive virtual reality drone driving system, which includes: a virtual reality helmet for capturing the flight scene captured by the camera on the drone And provide it to the user, and track the user's head movement to generate a flight control signal; and the data glove is used to control the drone remote control according to the flight control signal provided by the virtual reality helmet, and then control the drone in the flight scene flight maneuvers.
在一些实施例中,该无人机驾驶系统还包括与该虚拟现实头盔配合的通信接口,用于捕获对应无人机的飞行场景。 In some embodiments, the UAV piloting system further includes a communication interface cooperating with the virtual reality helmet for capturing the flight scene of the corresponding UAV.
在一些实施例中,该通信接口采用无线通信方式与该无人机通信连接。 In some embodiments, the communication interface communicates with the UAV in a wireless communication manner.
在一些实施例中,该无人机驾驶系统是能够经由该通信接口获取无人机的飞行数据的。 In some embodiments, the drone piloting system can acquire the flight data of the drone via the communication interface.
在一些实施例中,该飞行数据包括无人机的摄像机提供的图像信息,Wi-Fi 中继提供的通信信息,无人机的云台提供的飞控状态信息,无人机的定位系统提供的定位信息,以及地面站的测控信息。 In some embodiments, the flight data includes the image information provided by the camera of the drone, the communication information provided by the Wi-Fi relay, the flight control status information provided by the gimbal of the drone, and the information provided by the positioning system of the drone. The positioning information of the ground station and the measurement and control information of the ground station.
在一些实施例中,该无人机上的摄像机是立体成像的。 In some embodiments, the camera on the drone is stereo imaging.
与现有技术相比,本发明的沉浸式虚拟现实无人机驾驶系统,通过巧妙地设置虚拟现实头盔来捕获飞行场景并生成飞行控制信号,设置数据手套来直接将飞行控制信号转换为无人机遥控器能够接受的控制信号,进而控制无人机的飞行动作,能够大大提升用户体验。 Compared with the prior art, the immersive virtual reality UAV driving system of the present invention captures the flight scene and generates the flight control signal by skillfully setting the virtual reality helmet, and sets the data glove to directly convert the flight control signal into an unmanned The control signal that can be accepted by the remote control of the drone can be used to control the flight action of the drone, which can greatly improve the user experience.
附图说明 Description of drawings
图1是现有的无人机遥控器和无人机的系统结构示意。 FIG. 1 is a schematic diagram of the existing UAV remote controller and the system structure of the UAV.
图2是本发明沉浸式虚拟现实无人机驾驶系统、无人机遥控器以及无人机的系统结构示意。 Fig. 2 is a schematic diagram of the system structure of the immersive virtual reality drone driving system, the drone remote controller and the drone of the present invention.
其中,附图标记说明如下:10 无人机 20 无人机遥控器 30 无人机驾驶系统 50 用户 101 摄像机 102 无线传输系统 301 虚拟现实头盔 302 数据手套。 Wherein, the reference signs are explained as follows: 10 UAV 20 UAV remote controller 30 UAV driving system 50 User 101 Camera 102 Wireless transmission system 301 Virtual reality helmet 302 Data glove.
具体实施方式 detailed description
以下结合附图,对本发明予以进一步地详尽阐述。 The present invention will be further elaborated below in conjunction with the accompanying drawings.
参见图2,图2是本发明沉浸式虚拟现实无人机驾驶系统的结构示意。本发明提出一种沉浸式虚拟现实无人机驾驶系统,该无人机驾驶系统30大致包括:虚拟现实头盔301,用于捕获无人机10上的摄像机101获取的飞行场景并提供给用户50,并跟踪用户50的头部动作产生飞行控制信号;以及数据手套302,用于根据该虚拟现实头盔301提供的飞行控制信号,控制无人机遥控器20,进而控制无人机10在该飞行场景的飞行动作。该无人机遥控器20能够与无人机10的无线传输系统102通信连接。 Referring to FIG. 2, FIG. 2 is a schematic structural diagram of the immersive virtual reality drone driving system of the present invention. The present invention proposes an immersive virtual reality drone driving system, the drone driving system 30 generally includes: a virtual reality helmet 301, used to capture the flight scene captured by the camera 101 on the drone 10 and provide it to the user 50 , and track the head movement of the user 50 to generate a flight control signal; and the data glove 302 is used to control the UAV remote controller 20 according to the flight control signal provided by the virtual reality helmet 301, and then control the UAV 10 in this flight. The flight action of the scene. The UAV remote controller 20 can communicate with the wireless transmission system 102 of the UAV 10 .
该无人机驾驶系统30还包括与该虚拟现实头盔301配合的通信接口(图未示),用于捕获对应无人机10的飞行场景。较佳地,该通信接口采用无线通信方式与该无人机10通信连接。值得一提的是,该无人机驾驶系统30是能够经由该通信接口获取无人机10的飞行数据的。该飞行数据包括,但不限于:无人机10的摄像机101提供的图像信息,Wi-Fi 中继提供的通信信息,无人机10的云台提供的飞控状态信息,无人机10的定位系统(例如:GPS系统、北斗系统)提供的定位信息,以及地面站的测控信息。较佳地,该无人机10上的摄像机101是立体成像的。换言之,摄像机101为双目视觉摄像机,能够提供接近人眼实际目测的视觉效果。 The UAV driving system 30 also includes a communication interface (not shown) cooperating with the virtual reality helmet 301 for capturing the flight scene corresponding to the UAV 10 . Preferably, the communication interface communicates with the UAV 10 in a wireless communication manner. It is worth mentioning that the UAV piloting system 30 can acquire the flight data of the UAV 10 through the communication interface. The flight data includes, but is not limited to: the image information provided by the camera 101 of the UAV 10, the communication information provided by the Wi-Fi relay, the flight control status information provided by the gimbal of the UAV 10, the The positioning information provided by the positioning system (eg GPS system, Beidou system), and the measurement and control information of the ground station. Preferably, the camera 101 on the UAV 10 is stereo imaging. In other words, the camera 101 is a binocular vision camera, which can provide a visual effect close to the actual vision of human eyes.
与现有技术相比,本发明的沉浸式虚拟现实无人机驾驶系统,通过巧妙地设置虚拟现实头盔301来捕获飞行场景并生成飞行控制信号,设置数据手套302来直接将飞行控制信号转换为无人机遥控器20能够接受的控制信号,进而控制无人机10的飞行动作,能够大大提升用户体验。 Compared with the prior art, the immersive virtual reality drone driving system of the present invention captures the flight scene and generates flight control signals by skillfully setting the virtual reality helmet 301, and sets the data glove 302 to directly convert the flight control signals into The control signal that the UAV remote controller 20 can accept, and then control the flight action of the UAV 10, can greatly improve the user experience.
上述内容,仅为本发明的较佳实施例,并非用于限制本发明的实施方案,本领域普通技术人员根据本发明的主要构思和精神,可以十分方便地进行相应的变通或修改,故本发明的保护范围应以权利要求书所要求的保护范围为准。 The above content is only a preferred embodiment of the present invention, and is not intended to limit the implementation of the present invention. Those of ordinary skill in the art can easily make corresponding modifications or modifications according to the main concept and spirit of the present invention. Therefore, this The protection scope of the invention shall be determined by the protection scope required by the claims.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510968246.2A CN106909163A (en) | 2015-12-22 | 2015-12-22 | Immersive VR unmanned plane control loop |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510968246.2A CN106909163A (en) | 2015-12-22 | 2015-12-22 | Immersive VR unmanned plane control loop |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106909163A true CN106909163A (en) | 2017-06-30 |
Family
ID=59200568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510968246.2A Pending CN106909163A (en) | 2015-12-22 | 2015-12-22 | Immersive VR unmanned plane control loop |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106909163A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110187700A (en) * | 2019-06-10 | 2019-08-30 | 北京科技大学 | Remote control system and method for bionic flapping wing flying robot based on virtual reality |
| CN112669469A (en) * | 2021-01-08 | 2021-04-16 | 国网山东省电力公司枣庄供电公司 | Power plant virtual roaming system and method based on unmanned aerial vehicle and panoramic camera |
| CN113485392A (en) * | 2021-06-17 | 2021-10-08 | 广东工业大学 | Virtual reality interaction method based on digital twins |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103197757A (en) * | 2012-01-09 | 2013-07-10 | 癸水动力(北京)网络科技有限公司 | Immersion type virtual reality system and implementation method thereof |
| WO2013135410A1 (en) * | 2012-03-14 | 2013-09-19 | Prox Dynamics As | Mmi for uav control |
| CN203658947U (en) * | 2014-01-17 | 2014-06-18 | 湖南科技大学 | Intelligent remote control cart controller based on data gloves |
| CN104464438A (en) * | 2013-09-15 | 2015-03-25 | 南京大五教育科技有限公司 | Virtual reality technology-based automobile driving simulation training system |
| CN204406748U (en) * | 2014-12-24 | 2015-06-17 | 何军 | A kind of virtual driving system manipulated for unmanned machine |
| CN204426845U (en) * | 2015-03-02 | 2015-07-01 | 王志冲 | There is the remote control helmet seen and take aim at and guide function |
| CN104811615A (en) * | 2015-04-17 | 2015-07-29 | 刘耀 | Motion control camera shooting system and method |
| CN204669545U (en) * | 2015-06-17 | 2015-09-23 | 宋克凡 | A kind of unmanned plane drive simulating display unit |
| CN105083543A (en) * | 2015-06-06 | 2015-11-25 | 昆山玖趣智能科技有限公司 | Augmented reality (AR) 3D vision intelligent four-wing aircraft |
-
2015
- 2015-12-22 CN CN201510968246.2A patent/CN106909163A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103197757A (en) * | 2012-01-09 | 2013-07-10 | 癸水动力(北京)网络科技有限公司 | Immersion type virtual reality system and implementation method thereof |
| WO2013135410A1 (en) * | 2012-03-14 | 2013-09-19 | Prox Dynamics As | Mmi for uav control |
| CN104464438A (en) * | 2013-09-15 | 2015-03-25 | 南京大五教育科技有限公司 | Virtual reality technology-based automobile driving simulation training system |
| CN203658947U (en) * | 2014-01-17 | 2014-06-18 | 湖南科技大学 | Intelligent remote control cart controller based on data gloves |
| CN204406748U (en) * | 2014-12-24 | 2015-06-17 | 何军 | A kind of virtual driving system manipulated for unmanned machine |
| CN204426845U (en) * | 2015-03-02 | 2015-07-01 | 王志冲 | There is the remote control helmet seen and take aim at and guide function |
| CN104811615A (en) * | 2015-04-17 | 2015-07-29 | 刘耀 | Motion control camera shooting system and method |
| CN105083543A (en) * | 2015-06-06 | 2015-11-25 | 昆山玖趣智能科技有限公司 | Augmented reality (AR) 3D vision intelligent four-wing aircraft |
| CN204669545U (en) * | 2015-06-17 | 2015-09-23 | 宋克凡 | A kind of unmanned plane drive simulating display unit |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110187700A (en) * | 2019-06-10 | 2019-08-30 | 北京科技大学 | Remote control system and method for bionic flapping wing flying robot based on virtual reality |
| CN112669469A (en) * | 2021-01-08 | 2021-04-16 | 国网山东省电力公司枣庄供电公司 | Power plant virtual roaming system and method based on unmanned aerial vehicle and panoramic camera |
| CN112669469B (en) * | 2021-01-08 | 2023-10-13 | 国网山东省电力公司枣庄供电公司 | Power plant virtual roaming system and method based on drones and panoramic cameras |
| CN113485392A (en) * | 2021-06-17 | 2021-10-08 | 广东工业大学 | Virtual reality interaction method based on digital twins |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9747725B2 (en) | Video system for piloting a drone in immersive mode | |
| CN105759833A (en) | Immersive unmanned aerial vehicle driving flight system | |
| CN112367513B (en) | Navigation system and method for sensing an environment | |
| US9738382B2 (en) | Drone immersion-piloting system | |
| CN105704501A (en) | Unmanned plane panorama video-based virtual reality live broadcast system | |
| CN205384512U (en) | Multi -functional unmanned aerial vehicle and unmanned aerial vehicle control system | |
| JP2016203978A (en) | System for piloting a drone in immersed state | |
| WO2018112695A1 (en) | Image display method and mobile terminal | |
| JP2017208802A (en) | Method for encoding and decoding video of drone and related device | |
| CN105828062A (en) | Unmanned aerial vehicle 3D virtual reality shooting system | |
| WO2017166714A1 (en) | Method, device, and system for capturing panoramic image | |
| CN107005687A (en) | UAV flight experience method, device, system and UAV | |
| CN103955228A (en) | Aerial photography imaging and controlling device | |
| CN103149912B (en) | Integrated measurement and control device for unmanned aerial vehicle | |
| CN106909163A (en) | Immersive VR unmanned plane control loop | |
| US20240196045A1 (en) | Video display system, observation device, information processing method, and recording medium | |
| CN205692054U (en) | A kind of wireless line walking machine of head movement monitoring | |
| CN109445460A (en) | A kind of unmanned plane guidance system that view-based access control model is conveyed | |
| CN105786015A (en) | Unmanned plane formation control system based on Arkbird A flight control system, and control method | |
| JP6744033B2 (en) | Mobile control system, control signal transmission system, mobile control method, program, and recording medium | |
| JP6844898B2 (en) | Mobile maneuvering system, maneuvering signal transmission system, mobile maneuvering method, program, and recording medium | |
| WO2019061466A1 (en) | Flight control method, remote control device, and remote control system | |
| WO2020209167A1 (en) | Information processing device, information processing method, and program | |
| CN205017461U (en) | Remote first visual angle video monitoring control system | |
| CN108475064B (en) | Method, device, and computer-readable storage medium for device control |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170630 |