[go: up one dir, main page]

CN106909163A - Immersive VR unmanned plane control loop - Google Patents

Immersive VR unmanned plane control loop Download PDF

Info

Publication number
CN106909163A
CN106909163A CN201510968246.2A CN201510968246A CN106909163A CN 106909163 A CN106909163 A CN 106909163A CN 201510968246 A CN201510968246 A CN 201510968246A CN 106909163 A CN106909163 A CN 106909163A
Authority
CN
China
Prior art keywords
unmanned plane
control loop
immersive
flight
drone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510968246.2A
Other languages
Chinese (zh)
Inventor
黄焕波
郭森
黄永伟
吕姗
温昌明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Information Technology
Original Assignee
Shenzhen Institute of Information Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Information Technology filed Critical Shenzhen Institute of Information Technology
Priority to CN201510968246.2A priority Critical patent/CN106909163A/en
Publication of CN106909163A publication Critical patent/CN106909163A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Selective Calling Equipment (AREA)

Abstract

一种沉浸式虚拟现实无人机驾驶系统,该无人机驾驶系统包括:虚拟现实头盔,用于捕获无人机上的摄像机获取的飞行场景并提供给用户,并跟踪用户的头部动作产生飞行控制信号;以及数据手套,用于根据该虚拟现实头盔提供的飞行控制信号,控制无人机遥控器,进而控制无人机在该飞行场景的飞行动作。本发明能够大大提升用户体验。

An immersive virtual reality unmanned aerial vehicle driving system, the unmanned aerial vehicle driving system includes: a virtual reality helmet, which is used to capture the flight scene acquired by the camera on the unmanned aerial vehicle and provide it to the user, and track the user's head movement to generate the flight the control signal; and the data glove, which is used to control the remote controller of the drone according to the flight control signal provided by the virtual reality helmet, and then control the flight action of the drone in the flight scene. The present invention can greatly improve user experience.

Description

沉浸式虚拟现实无人机驾驶系统Immersive Virtual Reality Drone Piloting System

技术领域 technical field

本发明涉及驾驶系统,尤其涉及无人机的驾驶系统。 The present invention relates to a driving system, in particular to a driving system of an unmanned aerial vehicle.

背景技术 Background technique

在空中自由飞翔是许多人的的梦想,无人机的出现为实现这一梦想提供了可能。参见图1,现有的无人机10通常包括摄像机101和无线传输系统102。现有的无人机10的操作,通常是由用户50目测,手动操作无人机遥控器20上的遥控手柄来实现,并不能带给人们真实飞翔的感受。可见,实有必要对现有的无人机的驾驶系统进行改进。 Flying freely in the air is the dream of many people, and the emergence of drones provides the possibility to realize this dream. Referring to FIG. 1 , an existing drone 10 generally includes a camera 101 and a wireless transmission system 102 . The operation of the existing drone 10 is usually realized by the user 50 visually observing and manually operating the remote control handle on the remote controller 20 of the drone, which cannot give people the feeling of real flying. It can be seen that it is necessary to improve the driving system of the existing unmanned aerial vehicle.

发明内容 Contents of the invention

本发明要解决的技术问题在于克服上述现有技术存在的不足,而提出一种沉浸式虚拟现实无人机驾驶系统,能够大大提升用户体验。 The technical problem to be solved by the present invention is to overcome the above-mentioned deficiencies in the prior art, and propose an immersive virtual reality drone driving system, which can greatly improve user experience.

本发明针对上述技术问题而提出的技术方案包括,提出一种沉浸式虚拟现实无人机驾驶系统,该无人机驾驶系统包括:虚拟现实头盔,用于捕获无人机上的摄像机获取的飞行场景并提供给用户,并跟踪用户的头部动作产生飞行控制信号;以及数据手套,用于根据该虚拟现实头盔提供的飞行控制信号,控制无人机遥控器,进而控制无人机在该飞行场景的飞行动作。 The technical solution proposed by the present invention for the above technical problems includes proposing an immersive virtual reality drone driving system, which includes: a virtual reality helmet for capturing the flight scene captured by the camera on the drone And provide it to the user, and track the user's head movement to generate a flight control signal; and the data glove is used to control the drone remote control according to the flight control signal provided by the virtual reality helmet, and then control the drone in the flight scene flight maneuvers.

在一些实施例中,该无人机驾驶系统还包括与该虚拟现实头盔配合的通信接口,用于捕获对应无人机的飞行场景。 In some embodiments, the UAV piloting system further includes a communication interface cooperating with the virtual reality helmet for capturing the flight scene of the corresponding UAV.

在一些实施例中,该通信接口采用无线通信方式与该无人机通信连接。 In some embodiments, the communication interface communicates with the UAV in a wireless communication manner.

在一些实施例中,该无人机驾驶系统是能够经由该通信接口获取无人机的飞行数据的。 In some embodiments, the drone piloting system can acquire the flight data of the drone via the communication interface.

在一些实施例中,该飞行数据包括无人机的摄像机提供的图像信息,Wi-Fi 中继提供的通信信息,无人机的云台提供的飞控状态信息,无人机的定位系统提供的定位信息,以及地面站的测控信息。 In some embodiments, the flight data includes the image information provided by the camera of the drone, the communication information provided by the Wi-Fi relay, the flight control status information provided by the gimbal of the drone, and the information provided by the positioning system of the drone. The positioning information of the ground station and the measurement and control information of the ground station.

在一些实施例中,该无人机上的摄像机是立体成像的。 In some embodiments, the camera on the drone is stereo imaging.

与现有技术相比,本发明的沉浸式虚拟现实无人机驾驶系统,通过巧妙地设置虚拟现实头盔来捕获飞行场景并生成飞行控制信号,设置数据手套来直接将飞行控制信号转换为无人机遥控器能够接受的控制信号,进而控制无人机的飞行动作,能够大大提升用户体验。 Compared with the prior art, the immersive virtual reality UAV driving system of the present invention captures the flight scene and generates the flight control signal by skillfully setting the virtual reality helmet, and sets the data glove to directly convert the flight control signal into an unmanned The control signal that can be accepted by the remote control of the drone can be used to control the flight action of the drone, which can greatly improve the user experience.

附图说明 Description of drawings

图1是现有的无人机遥控器和无人机的系统结构示意。 FIG. 1 is a schematic diagram of the existing UAV remote controller and the system structure of the UAV.

图2是本发明沉浸式虚拟现实无人机驾驶系统、无人机遥控器以及无人机的系统结构示意。 Fig. 2 is a schematic diagram of the system structure of the immersive virtual reality drone driving system, the drone remote controller and the drone of the present invention.

其中,附图标记说明如下:10 无人机 20 无人机遥控器 30 无人机驾驶系统 50 用户 101 摄像机 102 无线传输系统 301 虚拟现实头盔 302 数据手套。 Wherein, the reference signs are explained as follows: 10 UAV 20 UAV remote controller 30 UAV driving system 50 User 101 Camera 102 Wireless transmission system 301 Virtual reality helmet 302 Data glove.

具体实施方式 detailed description

以下结合附图,对本发明予以进一步地详尽阐述。 The present invention will be further elaborated below in conjunction with the accompanying drawings.

参见图2,图2是本发明沉浸式虚拟现实无人机驾驶系统的结构示意。本发明提出一种沉浸式虚拟现实无人机驾驶系统,该无人机驾驶系统30大致包括:虚拟现实头盔301,用于捕获无人机10上的摄像机101获取的飞行场景并提供给用户50,并跟踪用户50的头部动作产生飞行控制信号;以及数据手套302,用于根据该虚拟现实头盔301提供的飞行控制信号,控制无人机遥控器20,进而控制无人机10在该飞行场景的飞行动作。该无人机遥控器20能够与无人机10的无线传输系统102通信连接。 Referring to FIG. 2, FIG. 2 is a schematic structural diagram of the immersive virtual reality drone driving system of the present invention. The present invention proposes an immersive virtual reality drone driving system, the drone driving system 30 generally includes: a virtual reality helmet 301, used to capture the flight scene captured by the camera 101 on the drone 10 and provide it to the user 50 , and track the head movement of the user 50 to generate a flight control signal; and the data glove 302 is used to control the UAV remote controller 20 according to the flight control signal provided by the virtual reality helmet 301, and then control the UAV 10 in this flight. The flight action of the scene. The UAV remote controller 20 can communicate with the wireless transmission system 102 of the UAV 10 .

该无人机驾驶系统30还包括与该虚拟现实头盔301配合的通信接口(图未示),用于捕获对应无人机10的飞行场景。较佳地,该通信接口采用无线通信方式与该无人机10通信连接。值得一提的是,该无人机驾驶系统30是能够经由该通信接口获取无人机10的飞行数据的。该飞行数据包括,但不限于:无人机10的摄像机101提供的图像信息,Wi-Fi 中继提供的通信信息,无人机10的云台提供的飞控状态信息,无人机10的定位系统(例如:GPS系统、北斗系统)提供的定位信息,以及地面站的测控信息。较佳地,该无人机10上的摄像机101是立体成像的。换言之,摄像机101为双目视觉摄像机,能够提供接近人眼实际目测的视觉效果。 The UAV driving system 30 also includes a communication interface (not shown) cooperating with the virtual reality helmet 301 for capturing the flight scene corresponding to the UAV 10 . Preferably, the communication interface communicates with the UAV 10 in a wireless communication manner. It is worth mentioning that the UAV piloting system 30 can acquire the flight data of the UAV 10 through the communication interface. The flight data includes, but is not limited to: the image information provided by the camera 101 of the UAV 10, the communication information provided by the Wi-Fi relay, the flight control status information provided by the gimbal of the UAV 10, the The positioning information provided by the positioning system (eg GPS system, Beidou system), and the measurement and control information of the ground station. Preferably, the camera 101 on the UAV 10 is stereo imaging. In other words, the camera 101 is a binocular vision camera, which can provide a visual effect close to the actual vision of human eyes.

与现有技术相比,本发明的沉浸式虚拟现实无人机驾驶系统,通过巧妙地设置虚拟现实头盔301来捕获飞行场景并生成飞行控制信号,设置数据手套302来直接将飞行控制信号转换为无人机遥控器20能够接受的控制信号,进而控制无人机10的飞行动作,能够大大提升用户体验。 Compared with the prior art, the immersive virtual reality drone driving system of the present invention captures the flight scene and generates flight control signals by skillfully setting the virtual reality helmet 301, and sets the data glove 302 to directly convert the flight control signals into The control signal that the UAV remote controller 20 can accept, and then control the flight action of the UAV 10, can greatly improve the user experience.

上述内容,仅为本发明的较佳实施例,并非用于限制本发明的实施方案,本领域普通技术人员根据本发明的主要构思和精神,可以十分方便地进行相应的变通或修改,故本发明的保护范围应以权利要求书所要求的保护范围为准。 The above content is only a preferred embodiment of the present invention, and is not intended to limit the implementation of the present invention. Those of ordinary skill in the art can easily make corresponding modifications or modifications according to the main concept and spirit of the present invention. Therefore, this The protection scope of the invention shall be determined by the protection scope required by the claims.

Claims (6)

1. a kind of immersive VR unmanned plane control loop, it is characterised in that the unmanned plane control loop includes:Virtual implementing helmet, flight control signal is produced for capturing the flying scene of the acquisition of the video camera on unmanned plane and being supplied to user, and track the headwork of user;And data glove, for the flight control signal provided according to the virtual implementing helmet, unmanned controller is controlled, and then control unmanned plane in the flare maneuver of the flying scene.
2. according to the immersive VR unmanned plane control loop described in claim 1, it is characterised in that the unmanned plane control loop also includes the communication interface coordinated with the virtual implementing helmet, the flying scene for capturing correspondence unmanned plane.
3. according to the immersive VR unmanned plane control loop described in claim 2, it is characterised in that the communication interface is connected using communication with the UAV Communication.
4. according to the immersive VR unmanned plane control loop described in claim 2, it is characterised in that the unmanned plane control loop is the flying quality that unmanned plane can be obtained via the communication interface.
5. according to the immersive VR unmanned plane control loop described in claim 4, it is characterized in that, the flying quality includes the image information that the video camera of unmanned plane is provided, the communication information that Wi-Fi relayings are provided, the winged control status information that the head of unmanned plane is provided, the location information that the alignment system of unmanned plane is provided, and earth station observing and controlling information.
6. according to the immersive VR unmanned plane control loop described in claim 1, it is characterised in that the video camera on the unmanned plane is three-dimensional imaging.
CN201510968246.2A 2015-12-22 2015-12-22 Immersive VR unmanned plane control loop Pending CN106909163A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510968246.2A CN106909163A (en) 2015-12-22 2015-12-22 Immersive VR unmanned plane control loop

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510968246.2A CN106909163A (en) 2015-12-22 2015-12-22 Immersive VR unmanned plane control loop

Publications (1)

Publication Number Publication Date
CN106909163A true CN106909163A (en) 2017-06-30

Family

ID=59200568

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510968246.2A Pending CN106909163A (en) 2015-12-22 2015-12-22 Immersive VR unmanned plane control loop

Country Status (1)

Country Link
CN (1) CN106909163A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110187700A (en) * 2019-06-10 2019-08-30 北京科技大学 Remote control system and method for bionic flapping wing flying robot based on virtual reality
CN112669469A (en) * 2021-01-08 2021-04-16 国网山东省电力公司枣庄供电公司 Power plant virtual roaming system and method based on unmanned aerial vehicle and panoramic camera
CN113485392A (en) * 2021-06-17 2021-10-08 广东工业大学 Virtual reality interaction method based on digital twins

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103197757A (en) * 2012-01-09 2013-07-10 癸水动力(北京)网络科技有限公司 Immersion type virtual reality system and implementation method thereof
WO2013135410A1 (en) * 2012-03-14 2013-09-19 Prox Dynamics As Mmi for uav control
CN203658947U (en) * 2014-01-17 2014-06-18 湖南科技大学 Intelligent remote control cart controller based on data gloves
CN104464438A (en) * 2013-09-15 2015-03-25 南京大五教育科技有限公司 Virtual reality technology-based automobile driving simulation training system
CN204406748U (en) * 2014-12-24 2015-06-17 何军 A kind of virtual driving system manipulated for unmanned machine
CN204426845U (en) * 2015-03-02 2015-07-01 王志冲 There is the remote control helmet seen and take aim at and guide function
CN104811615A (en) * 2015-04-17 2015-07-29 刘耀 Motion control camera shooting system and method
CN204669545U (en) * 2015-06-17 2015-09-23 宋克凡 A kind of unmanned plane drive simulating display unit
CN105083543A (en) * 2015-06-06 2015-11-25 昆山玖趣智能科技有限公司 Augmented reality (AR) 3D vision intelligent four-wing aircraft

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103197757A (en) * 2012-01-09 2013-07-10 癸水动力(北京)网络科技有限公司 Immersion type virtual reality system and implementation method thereof
WO2013135410A1 (en) * 2012-03-14 2013-09-19 Prox Dynamics As Mmi for uav control
CN104464438A (en) * 2013-09-15 2015-03-25 南京大五教育科技有限公司 Virtual reality technology-based automobile driving simulation training system
CN203658947U (en) * 2014-01-17 2014-06-18 湖南科技大学 Intelligent remote control cart controller based on data gloves
CN204406748U (en) * 2014-12-24 2015-06-17 何军 A kind of virtual driving system manipulated for unmanned machine
CN204426845U (en) * 2015-03-02 2015-07-01 王志冲 There is the remote control helmet seen and take aim at and guide function
CN104811615A (en) * 2015-04-17 2015-07-29 刘耀 Motion control camera shooting system and method
CN105083543A (en) * 2015-06-06 2015-11-25 昆山玖趣智能科技有限公司 Augmented reality (AR) 3D vision intelligent four-wing aircraft
CN204669545U (en) * 2015-06-17 2015-09-23 宋克凡 A kind of unmanned plane drive simulating display unit

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110187700A (en) * 2019-06-10 2019-08-30 北京科技大学 Remote control system and method for bionic flapping wing flying robot based on virtual reality
CN112669469A (en) * 2021-01-08 2021-04-16 国网山东省电力公司枣庄供电公司 Power plant virtual roaming system and method based on unmanned aerial vehicle and panoramic camera
CN112669469B (en) * 2021-01-08 2023-10-13 国网山东省电力公司枣庄供电公司 Power plant virtual roaming system and method based on drones and panoramic cameras
CN113485392A (en) * 2021-06-17 2021-10-08 广东工业大学 Virtual reality interaction method based on digital twins

Similar Documents

Publication Publication Date Title
US9747725B2 (en) Video system for piloting a drone in immersive mode
CN105759833A (en) Immersive unmanned aerial vehicle driving flight system
CN112367513B (en) Navigation system and method for sensing an environment
US9738382B2 (en) Drone immersion-piloting system
CN105704501A (en) Unmanned plane panorama video-based virtual reality live broadcast system
CN205384512U (en) Multi -functional unmanned aerial vehicle and unmanned aerial vehicle control system
JP2016203978A (en) System for piloting a drone in immersed state
WO2018112695A1 (en) Image display method and mobile terminal
JP2017208802A (en) Method for encoding and decoding video of drone and related device
CN105828062A (en) Unmanned aerial vehicle 3D virtual reality shooting system
WO2017166714A1 (en) Method, device, and system for capturing panoramic image
CN107005687A (en) UAV flight experience method, device, system and UAV
CN103955228A (en) Aerial photography imaging and controlling device
CN103149912B (en) Integrated measurement and control device for unmanned aerial vehicle
CN106909163A (en) Immersive VR unmanned plane control loop
US20240196045A1 (en) Video display system, observation device, information processing method, and recording medium
CN205692054U (en) A kind of wireless line walking machine of head movement monitoring
CN109445460A (en) A kind of unmanned plane guidance system that view-based access control model is conveyed
CN105786015A (en) Unmanned plane formation control system based on Arkbird A flight control system, and control method
JP6744033B2 (en) Mobile control system, control signal transmission system, mobile control method, program, and recording medium
JP6844898B2 (en) Mobile maneuvering system, maneuvering signal transmission system, mobile maneuvering method, program, and recording medium
WO2019061466A1 (en) Flight control method, remote control device, and remote control system
WO2020209167A1 (en) Information processing device, information processing method, and program
CN205017461U (en) Remote first visual angle video monitoring control system
CN108475064B (en) Method, device, and computer-readable storage medium for device control

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170630