[go: up one dir, main page]

CN107239077A - A kind of unmanned plane displacement computing system and method - Google Patents

A kind of unmanned plane displacement computing system and method Download PDF

Info

Publication number
CN107239077A
CN107239077A CN201710509907.4A CN201710509907A CN107239077A CN 107239077 A CN107239077 A CN 107239077A CN 201710509907 A CN201710509907 A CN 201710509907A CN 107239077 A CN107239077 A CN 107239077A
Authority
CN
China
Prior art keywords
unmanned aerial
aerial vehicle
short
focus lens
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710509907.4A
Other languages
Chinese (zh)
Other versions
CN107239077B (en
Inventor
黎凡炜
蔡朝链
林敬顺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to CN201710509907.4A priority Critical patent/CN107239077B/en
Publication of CN107239077A publication Critical patent/CN107239077A/en
Application granted granted Critical
Publication of CN107239077B publication Critical patent/CN107239077B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/08Control of attitude, i.e. control of roll, pitch, or yaw
    • G05D1/0808Control of attitude, i.e. control of roll, pitch, or yaw specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Measurement Of Optical Distance (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention provides a kind of unmanned plane displacement computing system and method, using telephoto lens and short-focus lens in different height, its image is in inductor(Sensor)On identification difference, calculate telephoto lens and the rational weight of short-focus lens, such UAS just can change telephoto lens and the calculating weight of short-focus lens according to different flying heights, so that aircraft is in different flying heights, at a relatively high identification can be kept for X, Y-direction translational movement, the problem of translational movement identification when solving different flying heights is inconsistent, so as to accurately calculate the distance of unmanned plane during flying, reaches the purpose of unmanned stability contorting.

Description

Unmanned aerial vehicle moving distance calculation system and method
Technical Field
The invention belongs to the technical field of unmanned aerial vehicles, and particularly relates to a system and a method for calculating the moving distance of an unmanned aerial vehicle.
Background
Most of existing optical flow visual modules for aircraft positioning adopt a design of combining an image module and a distance measuring module, wherein the image module is used for calculating X, Y (horizontal) direction movement amount, and the distance measuring module is used for calculating an absolute value in a Z (height) direction.
If the image module uses a single lens, the recognition (Pixel) of the image module for X, Y direction movement (Distance) will be reduced when the flight height (Altitude) is high. It can be seen from the following simple XY shift amount calculation formula that there is an error in the calculated shift amount.
If the image module adopts double lenses, namely a long-focus lens and a short-focus lens, the short-focus lens can obtain more scene information, but the identification degree is low when the object distance is far away, and the long-focus lens can obtain higher identification degree but lacks the scene information. In the prior art, a certain height is used as a criterion for switching different lenses, that is, an image with a short-focus lens below the certain height is completely used, and an image with a long-focus lens above the certain height is completely used, so that although the problem of reduced identification (Pixel) between different heights can be slightly improved, the problem is still limited, and the accuracy of the calculated moving distance still has errors.
Disclosure of Invention
The invention aims to provide a system and a method for calculating the moving distance of an unmanned aerial vehicle, which solve the problem of inconsistent translation amount identification degrees of the unmanned aerial vehicle at different flight heights, so that the flying distance of the unmanned aerial vehicle can be accurately calculated, and the aim of unmanned stable control is fulfilled.
In order to solve the technical problems, the invention adopts the following technical scheme:
compared with the prior art, the invention has the advantages and positive effects that: according to the invention, reasonable weights of the long-focus lens and the short-focus lens are calculated by utilizing the difference of identification degrees of images of the long-focus lens and the short-focus lens on the Sensor when the long-focus lens and the short-focus lens are at different heights, so that the unmanned aerial vehicle system can change the calculation weights of the long-focus lens and the short-focus lens according to different flight heights, so that the aircraft can keep quite high identification degrees on translation in the direction of X, Y when the aircraft is at different flight heights, the problem of inconsistent translation identification degrees when the flight heights are different is solved, the flight distance of the unmanned aerial vehicle can be accurately calculated, and the aim of unmanned stable control is fulfilled.
Other features and advantages of the present invention will become more apparent from the detailed description of the embodiments of the present invention when taken in conjunction with the accompanying drawings.
Drawings
FIG. 1 is a system block diagram of an embodiment of the present invention.
FIG. 2 is a diagram illustrating the working range of the prior art and an embodiment of the present invention.
Fig. 3 is a system block diagram of an embodiment of the present invention.
FIG. 4 is a flow chart of an embodiment of the present invention.
Detailed Description
As shown in fig. 1 and 3, the unmanned aerial vehicle movement distance calculating system of the present embodiment includes a telephoto lens module 1, a short-focus lens module 2, a ranging module 3, an optical flow control algorithm system module (MCU system module) 4, and a gyroscope 5. The following describes each module in detail:
the telephoto lens module 1 is configured to provide the image acquired by the telephoto lens to the optical flow control algorithm system module 4.
Resolution R of telephoto lens in case of telephoto lens determination1For determining the value, the angle of view FOV of the telephoto lens1To determine the value. Thus, for a telephoto lens, the distance D that the telephoto lens moves for a drone is calculated from some two frames of images1=P1/R1(H*2.0*tan(FOV1/2)),P1The moving pixel quantity of the object on the telephoto lens is compared with that of the rear frame image and the front frame image, and H is the height of the unmanned aerial vehicle obtained by the ranging module.
And the short-focus lens module 2 is used for providing the image acquired by the short-focus lens to the optical flow control algorithm system module 4.
Resolution R of short-focus lens in case of short-focus lens determination2For determining the value, the angle of view FOV of the short-focus lens2To determine the value. Thus, for a short focus lens, the distance D of the unmanned aerial vehicle movement calculated by the short focus lens from some two frames of images2=P2/R2(H*2.0*tan(FOV2/2)),P2The moving pixel quantity of the object on the short-focus lens is compared with that of the front frame image of the back frame image, and H is the height of the unmanned aerial vehicle obtained by the ranging module.
The front frame image and the rear frame image may be adjacent images or images separated by one frame or several frames, depending on the operation capability of the MCU system module.
The distance measurement module 3 is used for acquiring the height H of the unmanned aerial vehicle and providing the height H to the optical flow control algorithm system module 4;
and the gyroscope 5 is used for confirming the posture of the unmanned aerial vehicle so as to provide auxiliary reference for the optical flow control algorithm system module 4 in processing.
And the optical flow control algorithm system module 4 is used for detecting an object (characteristic point) according to the images provided by the long-focus lens module 1 and the short-focus lens module 2, calculating the movement amount of the object on an inductor (sensor) according to the information of the object, calculating the weight according to the height information of the unmanned aerial vehicle provided by the distance measuring module, and then calculating the movement distance of the unmanned aerial vehicle. The optical flow control algorithm system module 4(MCU system module) mainly includes three parts:
and the object detection module is used for detecting the object positions on the images of the long-focus lens and the short-focus lens and the pixel amount of the object movement. Wherein, the object is embodied by the object characteristic points.
A weight calculation module for calculating the height H of the unmanned aerial vehicle and the FOV of the telephoto lens1FOV of short-focus lens2Calculating tele lens weight W at different heights1And short focal length weight W2
Tele lens weight
Short focal length weight W2=1-W1
H=k(FOV2/FOV1) (ii) a k is a coefficient;
Hmaxthe maximum height measurable by the ranging module;
Hminthe minimum height measurable by the ranging module;
Hweight coefficients of the current altitude of the unmanned aerial vehicle.
And the moving distance calculation module is used for calculating the moving distance of the unmanned aerial vehicle according to the pixel quantity of the object movement calculated by the object detection module and the weight calculated by the weight calculation module.
Unmanned aerial vehicle moving distance calculating module for calculating moving distance of two frames of images
The moving distance calculation module calculates the moving distance of the unmanned aerial vehicle at a certain time
Wherein n is the number of image frames within a certain time. For example, when the calculation capability of the MCU system module is very high, the long focus lens module 1 and the short focus lens module 2 of the drone respectively collect n frames of images, and then calculate the drone moving distance D of two adjacent frames of images of the n frames of images, and then calculate DTotal. When the operational capability of the MCU system module is not high, the image frame numbers respectively acquired by the telephoto lens module 1 and the intersection lens module 2 of the unmanned aerial vehicle are m, m >n, extracting one frame of image from m frames of images at intervals of one frame or a plurality of frames to obtain n frames of images, respectively calculating the unmanned aerial vehicle movement distance D of two adjacent frames of images of the n frames of images, and then calculating DTotal
As shown in fig. 2, the unmanned aerial vehicle of the embodiment may extend the working range of the optical flow control algorithm module, and is no longer limited by the recognition limit of the image module. Wherein 6 is the workable range of the single lens image module in the prior art. Fig. 7 is a workable range of the long and short focal length dual lens module of this embodiment. By contrast, the working range of the long-focus and short-focus dual-lens module of the embodiment is greatly improved.
As shown in fig. 4, the present embodiment further provides a method for calculating a moving distance of an unmanned aerial vehicle:
and acquiring an image of the telephoto lens, and detecting the position of an object on the image of the telephoto lens and the pixel amount of the movement of the object. In this embodiment, the object is confirmed by detecting the object feature points on the image of the telephoto lens. The pixel amount of the object movement refers to the pixel amount of the object feature point movement in some two frames of images.
And acquiring an image of the short-focus lens, and detecting the position of an object on the image of the short-focus lens and the pixel amount of the movement of the object. In this embodiment, the object is confirmed by detecting the object feature points on the image of the short-focus lens. The pixel amount of the object movement refers to the pixel amount of the object feature point movement in some two frames of images.
And acquiring the height H of the unmanned aerial vehicle.
According to the height H of the unmanned aerial vehicle and the visual angle FOV of the telephoto lens1FOV of short-focus lens2Calculating tele lens weight W at different heights1And short focal length weight W2
Tele lens weight
Short focal length lens weightW2=1-W1
H=k(FOV2/FOV1) (ii) a k is a coefficient;
Hmaxthe maximum height measurable by the ranging module;
Hminthe minimum height measurable by the ranging module;
Hweight coefficients of the current altitude of the unmanned aerial vehicle.
And calculating the moving distance of the unmanned aerial vehicle according to the pixel quantity and the weight of the object moving.
The method for calculating the unmanned aerial vehicle moving distance D of two frames of images comprises the following steps:
wherein,
D1calculating the moving distance of the unmanned aerial vehicle by the telephoto lens; d1=P1/R1(H*2.0*tan(FOV1/2)),P1The pixel quantity of the object moving on the telephoto lens compared with the previous frame image in the later frame image; r1Resolution of the telephoto lens;
D2calculating the moving distance of the unmanned aerial vehicle by using the short-focus lens; d2=P2/R2(H*2.0*tan(FOV2/2)),P2The pixel quantity of the object moving on the short-focus lens compared with the previous frame image in the back frame image; r2The resolution of the short-focus lens.
Calculating the moving distance of the unmanned aerial vehicle at a certain time
Wherein n is the number of image frames within a certain time. For example, when the calculation capability of the MCU system module is very high, the long focus lens module 1 and the short focus lens module 2 of the drone respectively collect n frames of images, and then calculate the drone moving distance D of two adjacent frames of images of the n frames of images, and then calculate DTotal. When the operational capability of the MCU system module is not high, the number of the image frames respectively acquired by the telephoto lens module 1 and the interlace lens module 2 of the unmanned aerial vehicle is m, m is larger than n, one frame of image is extracted from the m frames of images at intervals of one frame or a plurality of frames to obtain n frames of images, the unmanned aerial vehicle moving distance D of two adjacent frames of images of the n frames of images is respectively calculated, and then D is calculatedTotal
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. An unmanned aerial vehicle movement distance calculation system, the system comprising:
the telephoto lens module is used for providing the image acquired by the telephoto lens to the optical flow control algorithm system module;
the short-focus lens module is used for providing the image acquired by the short-focus lens to the optical flow control algorithm system module;
the distance measurement module is used for acquiring the height H of the unmanned aerial vehicle and providing the height H to the optical flow control algorithm system module;
the optical flow control algorithm module comprises:
the object detection module is used for detecting the object positions on the images of the long-focus lens and the short-focus lens and the pixel amount of the movement of the object;
a weight calculation module for calculating the height H of the unmanned aerial vehicle and the FOV of the telephoto lens1FOV of short-focus lens2Calculating tele lens weight W at different heights1And short focal length weight W2
And the moving distance calculation module is used for calculating the moving distance of the unmanned aerial vehicle according to the pixel quantity of the object movement calculated by the object detection module and the weight calculated by the weight calculation module.
2. The system of claim 1, wherein the distance calculation module calculates the distance of the drone between two frames of imagesWherein,
D1calculating the moving distance of the unmanned aerial vehicle by the telephoto lens; d1=P1/R1(H*2.0*tan(FOV1/2)),P1The amount of pixels, R, by which an object moves on the telephoto lens in the subsequent frame image compared to the previous frame image1Resolution of the telephoto lens;
D2calculating the moving distance of the unmanned aerial vehicle by using the short-focus lens; d2=P2/R2(H*2.0*tan(FOV2/2)),P2The pixel quantity of the object moving on the short-focus lens compared with the previous frame image in the back frame image; r2The resolution of the short-focus lens.
3. The system of claim 2, wherein the distance calculation module calculates the distance the drone moves at a certain timeWherein n is the number of image frames within a certain time.
4. The unmanned aerial vehicle movement distance calculation system of claim 1, wherein the object is an object feature point.
5. The system of any of claims 1-4, wherein the telephoto lens weight is calculated
And short focal length weight W2=1-W1
H=k(FOV2/FOV1) (ii) a k is a coefficient;
Hmaxthe maximum height measurable by the ranging module;
Hminthe minimum height measurable by the ranging module;
Hweight coefficients of the current altitude of the unmanned aerial vehicle.
6. A method for calculating the moving distance of an unmanned aerial vehicle is characterized by comprising the following steps:
acquiring an image of a long-focus lens, an image of a short-focus lens and the height H of the unmanned aerial vehicle;
detecting the object positions on the images of the long-focus lens and the short-focus lens and the pixel amount of the object movement;
according to the height H of the unmanned aerial vehicle and the visual angle FOV of the telephoto lens1FOV of short-focus lens2Calculating tele lens weight W at different heights1And short focal length weight W2
And calculating the moving distance of the unmanned aerial vehicle according to the pixel quantity and the weight of the object moving.
7. The unmanned aerial vehicle movement distance calculation method according to claim 6, wherein the unmanned aerial vehicle movement distance D of two frames of images is calculated by:
wherein,
D1calculating the moving distance of the unmanned aerial vehicle by the telephoto lens; d1=P1/R1(H*2.0*tan(FOV1/2)),P1The pixel quantity of the object moving on the telephoto lens compared with the previous frame image in the later frame image; r1Resolution of the telephoto lens;
D2calculating the moving distance of the unmanned aerial vehicle by using the short-focus lens; d2=P2/R2(H*2.0*tan(FOV2/2)),P2The pixel quantity of the object moving on the short-focus lens compared with the previous frame image in the back frame image; r2The resolution of the short-focus lens.
8. The unmanned aerial vehicle movement distance calculation method of claim 7, wherein the movement distance of the unmanned aerial vehicle at a certain time is calculatedWherein n is the number of image frames within a certain time.
9. The unmanned aerial vehicle movement distance calculation method of claim 6, wherein the object is an object feature point.
10. The unmanned aerial vehicle movement distance calculation method of any one of claims 6-9, wherein telephoto lens weight W is calculated1And short focal length weight W2The method comprises the following steps:
<mrow> <msub> <mi>W</mi> <mn>1</mn> </msub> <mo>=</mo> <msub> <mi>&amp;delta;</mi> <mi>H</mi> </msub> <mo>*</mo> <mrow> <mo>(</mo> <mfrac> <mrow> <mi>H</mi> <mo>-</mo> <msub> <mi>H</mi> <mi>min</mi> </msub> </mrow> <mrow> <msub> <mi>H</mi> <mi>max</mi> </msub> <mo>-</mo> <msub> <mi>H</mi> <mi>min</mi> </msub> </mrow> </mfrac> <mo>)</mo> </mrow> <mo>;</mo> </mrow>
W2=1-W1
H=k(FOV2/FOV1) (ii) a k is a coefficient;
Hmaxthe maximum height measurable by the ranging module;
Hminthe minimum height measurable by the ranging module;
Hweight coefficients of the current altitude of the unmanned aerial vehicle.
CN201710509907.4A 2017-06-28 2017-06-28 Unmanned aerial vehicle moving distance calculation system and method Active CN107239077B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710509907.4A CN107239077B (en) 2017-06-28 2017-06-28 Unmanned aerial vehicle moving distance calculation system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710509907.4A CN107239077B (en) 2017-06-28 2017-06-28 Unmanned aerial vehicle moving distance calculation system and method

Publications (2)

Publication Number Publication Date
CN107239077A true CN107239077A (en) 2017-10-10
CN107239077B CN107239077B (en) 2020-05-08

Family

ID=59991209

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710509907.4A Active CN107239077B (en) 2017-06-28 2017-06-28 Unmanned aerial vehicle moving distance calculation system and method

Country Status (1)

Country Link
CN (1) CN107239077B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110865650A (en) * 2019-11-19 2020-03-06 武汉工程大学 Adaptive estimation method of UAV pose and attitude based on active vision

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5113962A (en) * 1986-01-21 1992-05-19 Calabrese Frank A Linear energy communicator
CN104215239A (en) * 2014-08-29 2014-12-17 西北工业大学 Vision-based autonomous unmanned plane landing guidance device and method
US20150130961A1 (en) * 2013-11-05 2015-05-14 Yoshifumi Sudoh Zoom lens and camera
CN105744234A (en) * 2016-04-06 2016-07-06 中国民用航空总局第二研究所 Linkage method for tracking moving object based on pixel differential ratio and system thereof
CN106558036A (en) * 2016-10-27 2017-04-05 中国科学院光电研究院 A kind of spaceborne super-resolution imaging design method
CN106707296A (en) * 2017-01-09 2017-05-24 华中科技大学 Dual-aperture photoelectric imaging system-based unmanned aerial vehicle detection and recognition method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5113962A (en) * 1986-01-21 1992-05-19 Calabrese Frank A Linear energy communicator
US20150130961A1 (en) * 2013-11-05 2015-05-14 Yoshifumi Sudoh Zoom lens and camera
CN104215239A (en) * 2014-08-29 2014-12-17 西北工业大学 Vision-based autonomous unmanned plane landing guidance device and method
CN105744234A (en) * 2016-04-06 2016-07-06 中国民用航空总局第二研究所 Linkage method for tracking moving object based on pixel differential ratio and system thereof
CN106558036A (en) * 2016-10-27 2017-04-05 中国科学院光电研究院 A kind of spaceborne super-resolution imaging design method
CN106707296A (en) * 2017-01-09 2017-05-24 华中科技大学 Dual-aperture photoelectric imaging system-based unmanned aerial vehicle detection and recognition method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
姜雨彤,等: "双目测距系统及标定方法研究", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110865650A (en) * 2019-11-19 2020-03-06 武汉工程大学 Adaptive estimation method of UAV pose and attitude based on active vision

Also Published As

Publication number Publication date
CN107239077B (en) 2020-05-08

Similar Documents

Publication Publication Date Title
CN110567469B (en) Visual positioning method and device, electronic equipment and system
CN115937810B (en) A sensor fusion method guided by a binocular camera
CN111735479B (en) Multi-sensor combined calibration device and method
CN103761737B (en) Robot motion&#39;s method of estimation based on dense optical flow
CN106529587B (en) Vision course recognition methods based on object detection
CN103886107B (en) Robot localization and map structuring system based on ceiling image information
CN106873619B (en) Processing method of flight path of unmanned aerial vehicle
CN107167826B (en) Vehicle longitudinal positioning system and method based on variable grid image feature detection in automatic driving
CN106960454B (en) Depth of field obstacle avoidance method and equipment and unmanned aerial vehicle
CN106681353A (en) Unmanned aerial vehicle (UAV) obstacle avoidance method and system based on binocular vision and optical flow fusion
JP2013115540A (en) On-vehicle camera system, and calibration method and program for same
CN105844692B (en) Three-dimensional reconstruction apparatus, method, system and unmanned plane based on binocular stereo vision
CN112650298A (en) Unmanned aerial vehicle tracking landing method and system
CN105182678B (en) A kind of system and method based on multichannel camera observation space target
WO2019073772A1 (en) Mobile entity position estimation device and position estimation method
CN101312524A (en) Moving object detection device and method using optical track analysis
CN106651957B (en) Monocular vision object space localization method based on template
CN108007426A (en) A kind of camera distance measuring method and system
CN114037759A (en) Dynamic characteristic point filtering and repositioning method in indoor environment
CN117649425A (en) A moving target trajectory coordinate conversion method, system, equipment and medium
CN114812558B (en) A monocular visual drone autonomous positioning method combined with laser ranging
CN107239077B (en) Unmanned aerial vehicle moving distance calculation system and method
CN114463398B (en) Real-time heterogeneous dynamic map registration method based on template matching and tracking algorithm
CN110415292A (en) A visual measurement method of motion attitude of a ring mark and its application
CN120121043A (en) An IMU-centered multi-sensor fusion autonomous driving positioning method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant