TW201932868A - Rain filtering techniques for autonomous vehicle - Google Patents
Rain filtering techniques for autonomous vehicle Download PDFInfo
- Publication number
- TW201932868A TW201932868A TW107144162A TW107144162A TW201932868A TW 201932868 A TW201932868 A TW 201932868A TW 107144162 A TW107144162 A TW 107144162A TW 107144162 A TW107144162 A TW 107144162A TW 201932868 A TW201932868 A TW 201932868A
- Authority
- TW
- Taiwan
- Prior art keywords
- optical radar
- laser light
- radar device
- optical
- planes
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000001914 filtration Methods 0.000 title description 14
- 239000002245 particle Substances 0.000 claims abstract description 39
- 230000003287 optical effect Effects 0.000 claims description 239
- 239000007787 solid Substances 0.000 claims description 54
- 238000002592 echocardiography Methods 0.000 claims description 30
- 239000010410 layer Substances 0.000 description 19
- 230000009977 dual effect Effects 0.000 description 16
- 238000005516 engineering process Methods 0.000 description 13
- 238000001514 detection method Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 10
- 239000002365 multiple layer Substances 0.000 description 9
- 239000013618 particulate matter Substances 0.000 description 9
- 230000000694 effects Effects 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 3
- 239000000428 dust Substances 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000001427 coherent effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- -1 rain Substances 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/87—Combinations of systems using electromagnetic waves other than radio waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
- G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Measurement Of Optical Distance (AREA)
Abstract
Description
本發明係有關於一種系統及方法,特別是當如雨或雪之顆粒物質存在於空氣中,使用光學雷達於無人駕駛車輛導航之系統及方法。 The present invention relates to a system and method, and particularly to a system and method for navigating an unmanned vehicle using optical radar when particulate matter such as rain or snow is present in the air.
無人駕駛車輛係可以在沒有人操作下能夠監視環境及導航,其優點包括更好的車輛安全性、更佳的效率、更低廉的成本、減少塞車、及提供給不符駕駛資格或沒有駕照者更優的機動性。 Unmanned vehicles can monitor the environment and navigate without human operation. Its advantages include better vehicle safety, better efficiency, lower costs, reduced traffic congestion, and provision for those who do not meet the driving qualification or have no driver's license. Excellent mobility.
無人駕駛車輛可以利用感測器監控它們所在的地點及環境,CMOS相機、雷達及雷射光能用以偵測物體及周遭環境存在的風險;然而,每一種類型的感測器都有其限制,舉例來說,CMOS相機倚賴適當的光線以偵測物體,更甚的是,當來車的頭燈將光線照射回來時,相機有可能會失去本身的效果,其他使用相機的缺點還包括不適當的光線、動態模糊、視野或偵測範圍限制等,雷達不倚賴可見光但缺乏辨別小物體的解決方式,而雷射光雖然可以用來克服以上之缺點,但在下雨或下雪的情況下則會失去其效果。 Driverless vehicles can use sensors to monitor their location and environment. CMOS cameras, radar, and laser light can be used to detect objects and the surrounding environment. However, each type of sensor has its limitations. For example, CMOS cameras rely on proper light to detect objects. What's more, the camera may lose its own effect when the light coming from the headlight of the car comes back. Other disadvantages of using the camera include inappropriate Light, motion blur, field of view, or limited detection range. Radar does not rely on visible light but lacks a solution to identify small objects. Although laser light can be used to overcome the above shortcomings, it will be used in the event of rain or snow. Lose its effect.
光學雷達(Lidar,Light Imaging Detection and Ranging)藉由利用雷射光脈衝照明及利用感測器偵測反射之脈衝以測量物體的距離, 典型用途來說,光學雷達系統從周遭車輛物體中反射複數個雷射光脈衝,藉由雷射光返回的時間及波長之差異可以用來製作數位3D物體。 Optical radar (Lidar, Light Imaging Detection and Ranging) measures the distance of an object by using laser light pulse illumination and using a sensor to detect reflected pulses. In a typical application, an optical radar system reflects a plurality of laser light pulses from surrounding vehicle objects. The difference in the time and wavelength of the laser light return can be used to make digital 3D objects.
惟,利用光學雷達穿透空氣中雪、雨、霧及塵是困難的,雨及其他空氣中的粒子如同固態形體一樣,可以將雷射光反射回系統,當雷射光脈衝反射回光學雷達系統時,無人駕駛車輛不一定會速度變慢或是停止前進,這是由於偵測到障礙物的誤報(false-positive假陽性誤報,以下簡稱誤報)。 However, it is difficult to penetrate snow, rain, fog, and dust in the air with optical radar. Rain and other particles in the air are like solid bodies. They can reflect the laser light back to the system. When the laser light pulse is reflected back to the optical radar system , Unmanned vehicles do not necessarily slow down or stop moving forward. This is due to the detection of false positives (false-positive false positives, hereinafter referred to as false positives).
習知已提出在雨天或下雪時改善光學雷達穩定性的方法,舉例來說,具有多重回波或最終回波之光學雷達的感測器技術可以過濾塵、雨或霧產生的反射,其原理係為脈衝能量的一部份會從固態形體反射回來的前提下運作,光束的其餘部分會繼續傳遞並由固態形體反射回來,當此狀況發生時,光學雷達單元可以忽略藉由雨水或空氣中的顆粒所產生更近、更弱的反射,雖然習知技術有所改進,但此技術對於大雨或暴雨的過濾並不穩定。 Known methods have been proposed to improve the stability of optical radars in rainy or snowy conditions. For example, optical radar sensor technology with multiple or final echoes can filter reflections from dust, rain, or fog. The principle is It is a premise that part of the pulse energy will be reflected from the solid form, and the rest of the beam will continue to be transmitted and reflected back by the solid form. When this happens, the optical radar unit can ignore the rain or air. Closer and weaker reflections are produced by the particles, and although the conventional technology has been improved, this technology is not stable for filtering heavy rain or heavy rain.
美國專利第9,097,800號描述一種結合雷達與光學雷達偵測物體的方法,光學雷達係用以產生車輛周遭環境的立體地圖,而後雷射係用以確認物體或存在的風險是固態物質而非雨水或空氣中的粒子,當系統被設計用來防止光學雷達的偵測誤報,它必須使用單獨的雷達系統,更進一步來說,雷達本身的低分辨率會錯過反射率較弱的物體。 U.S. Patent No. 9,097,800 describes a method for detecting objects by combining radar and optical radar. Optical radar is used to generate a three-dimensional map of the surrounding environment of the vehicle, and laser is used to confirm that the object or the risk is a solid substance rather than rain or water. For particles in the air, when the system is designed to prevent false detections by optical radar, it must use a separate radar system. Furthermore, the low resolution of the radar itself will miss objects with weak reflectivity.
美國專利第14/576,265號亦描述一種使用光學雷達來確認接近無人駕駛車輛之存在物體的方法,利用光學雷達偵測同一物體的複數點(即右、左、上、下)的方式來確認物體的存在,此方法類似於多重回波 形式需要複數個脈衝,如同美國專利第9,097,800號一樣,對於偵測小物體可能會失去其效果。 U.S. Patent No. 14 / 576,265 also describes a method of using optical radar to confirm the existence of an object approaching an unmanned vehicle, and using optical radar to detect plural points (i.e., right, left, up, and down) of the same object to confirm an object Existence, this method is similar to multiple echo The form requires multiple pulses, and like US Patent No. 9,097,800, it may lose its effect on detecting small objects.
因此,允許無人駕駛車輛在雨天或下雪時使用光學雷達來導航的系統是目前迫切需要的。 As a result, systems that allow unmanned vehicles to use optical radar to navigate when it is raining or snowing are urgently needed.
本發明依據了解到無人駕駛車輛對於導航及偵測物體及潛在風險的系統改善需求,必須使無人駕駛車輛在各種氣候下能夠利用且倚靠其系統以行駛,本發明也包括有其系統及過濾雨水之演算法以使無人駕駛車輛能行駛於下雨或下雪的天氣。 The present invention is based on the understanding of the need for improved systems for navigation and detection of objects and potential risks in unmanned vehicles. It must be possible to use unmanned vehicles in various climates and rely on their systems to drive. The invention also includes its systems and filtering rainwater. Algorithm to enable driverless vehicles to drive in rainy or snowy weather.
以下的概說提供本發明創新特徵之實施例以便於了解,但並非涵括所有完整之說明,藉由本發明說明書、申請專利範圍、圖式及摘要之整體所揭露的各個實施例,可以對本發明之技術特徵有相當的理解。 The following overview provides examples of the innovative features of the present invention for easy understanding, but does not include all complete descriptions. The embodiments disclosed in the present specification, patent application scope, drawings, and abstract can be used for the present invention. The technical characteristics are quite well understood.
本發明包括有利用雷射光(即光學雷達),以偵測物體或導航,同樣亦能辨別空氣中粒子中的固態形體的系統,此系統包括有第一光學雷達裝置,用以發射雷射光脈衝並偵測該雷射光之反射以掃描區域,以及第二光學雷達裝置,用以發射雷射光脈衝並偵測該雷射光之反射以掃描該區域或實質相同之該區域。電腦可以用演算法比較藉由該第一光學雷達裝置發射之雷射光並偵測到之反射雷射光與藉由該第二光學雷達裝置發射之雷射光並偵測到之反射雷射光,以確認固態形體的存在。固態形體的存在可以藉由當第一光學雷達裝置及第二光學雷達裝置偵測從固態形體反射之雷射光以確認。第一光學雷達裝置及第二光學雷達裝置可以架設在無人駕駛車輛上,使得彼此在水平面上間距有0.5至2.5米的距離。 The invention includes a system that uses laser light (that is, optical radar) to detect objects or navigation, and can also identify solid objects in particles in the air. The system includes a first optical radar device for emitting laser light pulses. And detecting the reflection of the laser light to scan the area, and a second optical radar device for transmitting a laser light pulse and detecting the reflection of the laser light to scan the area or substantially the same area. The computer can use an algorithm to compare the reflected laser light emitted by the first optical radar device and detected laser light with the reflected laser light detected by the second optical radar device to confirm that The existence of solid forms. The existence of the solid form can be confirmed by detecting the laser light reflected from the solid form by the first optical radar device and the second optical radar device. The first optical radar device and the second optical radar device may be mounted on an unmanned vehicle such that the distance between them on the horizontal plane is 0.5 to 2.5 meters.
除了雙光學雷達單元技術以外,第一光學雷達裝置與第二光學雷達裝置可以使用多重回波技術以從懸浮在空氣中的粒子辨識出固態形體。此外,光學雷達裝置可以執行複數平面掃描以辨識懸浮在空氣粒子中的固態形體。 In addition to the dual optical radar unit technology, the first optical radar device and the second optical radar device may use a multiple echo technology to identify solid objects from particles suspended in the air. In addition, optical radar devices can perform complex plane scans to identify solid bodies suspended in air particles.
本發明還包括給無人駕駛車輛行駛以偵測物體或障礙物的方法。第一光學雷達裝置藉由發射雷射光並偵測反射之雷射光(即回波)以掃描靠近無人駕駛車輛的區域,第二光學雷達裝置藉由發射雷射光並偵測回波以掃描靠近無人駕駛車輛的區域。再使用電腦及演算法比較第一光學雷達裝置發射的脈衝及偵測到的回波與第二光學雷達裝置發射的脈衝及偵測到的回波以確認物體或障礙物的存在。固態形體的存在可以藉由當第一光學雷達單元及第二光學雷達單元雙方均偵測到從固體反射之回波以確認。 The invention also includes a method for driving an unmanned vehicle to detect objects or obstacles. The first optical radar device scans the area near the unmanned vehicle by emitting laser light and detects the reflected laser light (ie, the echo), and the second optical radar device scans the area near the unmanned vehicle by emitting laser light and detecting the echo. The area where the vehicle is driven. A computer and an algorithm are used to compare the pulses and detected echoes emitted by the first optical radar device with the pulses and detected echoes emitted by the second optical radar device to confirm the existence of the object or obstacle. The existence of the solid body can be confirmed by both the first optical radar unit and the second optical radar unit detecting echoes reflected from the solid body.
由雨或雪所造成的回波可藉由比較第一光學雷達裝置接收之回波與第二光學雷達裝置接收之回波以辨別出來。第一光學雷達裝置及第二光學雷達裝置可以使用多重回波掃描。進一步而言,光學雷達裝置可以掃描複數個層或平面。固態形體的存在可以藉由當固態形體出現在一個或多個層或平面以確認。 Echoes caused by rain or snow can be discerned by comparing the echoes received by the first optical radar device with the echoes received by the second optical radar device. The first optical radar device and the second optical radar device may use multiple echo scanning. Furthermore, the optical radar device can scan a plurality of layers or planes. The existence of a solid form can be confirmed by the presence of the solid form on one or more layers or planes.
本發明亦包括一種偵測固態形體之方法,該方法包括下列步驟:(a)藉由第一光學雷達單元發射雷射光脈衝及偵測回波以掃描靠近無人駕駛車輛之區域,(b)藉由第二光學雷達單元發射雷射光脈衝及偵測回波以掃描實質相同之區域,(c)利用演算法比較第一光學雷達單元發射之脈衝及接收之回波與第二光學雷達單元發射之脈衝及接收之回波以確認物體或障 礙物的存在。當其中之一個光學雷達單元偵測到回波但另一光學雷達單元並未偵測到回波時即可分辨為誤報(即空氣中顆粒物質如雨或雪)。 The present invention also includes a method for detecting a solid body. The method includes the following steps: (a) transmitting a laser light pulse and detecting an echo by a first optical radar unit to scan an area near an unmanned vehicle, and (b) borrowing The second optical radar unit emits laser light pulses and detects echoes to scan substantially the same area. (C) Using an algorithm to compare the pulses and received echoes transmitted by the first optical radar unit with those of the second optical radar unit. Pulses and received echoes to identify objects or obstacles The existence of obstacles. When one optical radar unit detects an echo but the other optical radar unit does not detect an echo, it can be distinguished as a false alarm (ie, particulate matter in the air such as rain or snow).
更進一步,第一光學雷達單元與第二光學雷達單元可以使用多重回波掃描,亦能掃描一系列的平面。當形體出現於多於一個平面時即可確認固態形體的存在。而且,固態形體的存在可以藉由多重回波掃描中的最終回波以確認。 Furthermore, the first optical radar unit and the second optical radar unit can use multiple echo scanning, and can also scan a series of planes. The existence of a solid form can be confirmed when the form appears in more than one plane. Moreover, the existence of a solid form can be confirmed by the final echo in a multiple echo scan.
本發明亦包括有利用光學雷達偵測及/或確認固態形體的存在之方法,該方法包括下列步驟:(a)使用第一光學雷達裝置以掃描複數個平面,其中,該第一光學雷達裝置發射雷射光脈衝及偵測反射之雷射光,(b)蒐集從第一光學雷達裝置發射之雷射光及以該第一光學雷達裝置偵測反射之雷射光相關的數據,(c)藉由比對複數個平面中反射之雷射光的存在或不存在以確定從第一光學雷達反射之雷射光係由空氣中顆粒物所造成,(d)利用第二光學雷達裝置以掃描複數個平面,其中,該第二光學雷達裝置發射雷射光脈衝及偵測反射之雷射光,(e)蒐集從第二光學雷達裝置發射之雷射光及以該第二光學雷達裝置偵測反射之雷射光相關的數據,(f)藉由比對複數個平面中反射之雷射光的存在或不存在以確定從第二光學雷達裝置反射之雷射光係經由空氣中顆粒物所造成,(g)利用演算法比對從第一光學雷達裝置與第二光學雷達裝置蒐集的數據以確認反射之雷射光係經由固態形體而非空氣中顆粒物所造成。第一光學雷達裝置掃描之複數個平面的區域係與第二光學雷達裝置掃描之複數個平面的區域實質上相同。當反射之雷射光被第一光學雷達裝置或第二光學雷達裝置掃描的複數個平面中的四個及 /或多於四個以上平面所偵測,固態形體之存在能因而被確認。進一步而言,第一光學雷達裝置及第二光學雷達裝置可以使用多重回波掃描。 The present invention also includes a method for detecting and / or confirming the existence of a solid body using an optical radar. The method includes the following steps: (a) using a first optical radar device to scan a plurality of planes, wherein the first optical radar device Transmit laser light pulses and detect reflected laser light, (b) collect data related to laser light emitted from the first optical radar device and detect reflected laser light with the first optical radar device, (c) compare with Presence or absence of reflected laser light in the plurality of planes to determine that the laser light reflected from the first optical radar was caused by particulate matter in the air, (d) scanning the plurality of planes using a second optical radar device, wherein, the The second optical radar device emits laser light pulses and detects reflected laser light, (e) collects data related to the laser light emitted from the second optical radar device and the reflected laser light detected by the second optical radar device, ( f) By comparing the presence or absence of laser light reflected in a plurality of planes to determine that the laser light reflected from the second optical radar device is caused by particulate matter in the air, (g) An algorithm is used to compare the data collected from the first optical radar device with the second optical radar device to confirm that the reflected laser light is caused by the solid form rather than the particulate matter in the air. The area of the plurality of planes scanned by the first optical radar device is substantially the same as the area of the plurality of planes scanned by the second optical radar device. When the reflected laser light is scanned by the first optical radar device or the second optical radar device, four of the plurality of planes and The presence of solid objects can be confirmed by detecting more than four planes. Further, the first optical radar device and the second optical radar device may use multiple echo scanning.
本發明之第一局面為無人駕駛車輛使用光學雷達以偵測障礙物之方法及系統改善。 The first aspect of the present invention is the improvement of the method and system of using optical radar to detect obstacles in unmanned vehicles.
本發明之第二局面為無人駕駛車輛使用複數個光學雷達系統行駛之方法及系統改善。 The second aspect of the present invention is a method and system improvement for driving an unmanned vehicle using a plurality of optical radar systems.
本發明之第三局面為無人駕駛車輛使用複數個光學雷達系統行駛及使用演算法以避免空氣中水或顆粒錯誤辨識為固態形體之方法及系統改善。 A third aspect of the present invention is a method and system improvement for unmanned vehicles using multiple optical radar systems to travel and using algorithms to avoid water or particles in the air from being mistakenly identified as solid bodies.
本發明之第四局面為無人駕駛車輛使用多重回波技術以掃描複數層及採用演算法以減少空氣中雨水或顆粒的干擾之方法及系統改善。 The fourth aspect of the present invention is a method and system improvement for unmanned vehicles using multiple echo technology to scan multiple layers and adopt algorithms to reduce the interference of rain or particles in the air.
本發明之第五局面為無人駕駛車輛使用雙光學雷達系統、多重回波技術及具有演算法之複數層平面掃描以減少空氣中雨水或顆粒的干擾及改善穩定性之方法及系統改善。 The fifth aspect of the present invention is a method and system improvement for unmanned vehicles using a dual optical radar system, multiple echo technology, and multiple-layer plane scanning with algorithms to reduce interference from rain or particles in the air and improve stability.
110‧‧‧光學雷達單元 110‧‧‧Optical Radar Unit
115‧‧‧雨水 115‧‧‧ rain
120‧‧‧物體/固態形體 120‧‧‧Object / Solid Form
130‧‧‧第一回波/堆棧面 130‧‧‧First echo / stacked surface
140‧‧‧最終回波 140‧‧‧ final echo
210‧‧‧第一光學雷達單元/左光學雷達單元 210‧‧‧first optical radar unit / left optical radar unit
215‧‧‧第一物體 215‧‧‧First Object
220‧‧‧第二光學雷達單元/右光學雷達單元 220‧‧‧Second Optical Radar Unit / Right Optical Radar Unit
225‧‧‧第二物體 225‧‧‧Second Object
235‧‧‧中間區域 235‧‧‧Middle area
305‧‧‧最終回波過濾器 305‧‧‧final echo filter
310、320‧‧‧最終回波過濾 310, 320‧‧‧final echo filtering
315、330‧‧‧過濾雨水演算法 315, 330‧‧‧Filtering rain algorithm
325、340‧‧‧障礙物及特徵偵測 325, 340‧‧‧ obstacle and feature detection
400‧‧‧偵測區域 400‧‧‧ Detection area
410‧‧‧無人駕駛車輛 410‧‧‧unmanned vehicle
505‧‧‧雨滴 505‧‧‧Raindrops
本發明之圖式僅用於描述所選之實施例而非所有的可能實施態樣,並非限制於本發明所涵蓋之範圍。 The drawings of the present invention are only used to describe selected embodiments but not all possible implementation modes, and are not limited to the scope covered by the present invention.
據此,以下針對實施例之附圖說明以便於閱讀時理解,圖式中公開了本發明示例性的構造,但以下公開並不限於特定揭露之方法或手段,圖式亦不限定於揭露顯示之比例。 Accordingly, the following description of the drawings for the embodiments is easy to understand at the time of reading. The exemplary structure of the present invention is disclosed in the drawings, but the following disclosure is not limited to the specific disclosure methods or means, and the drawings are not limited to the disclosure display. Ratio.
第1A圖為習知多重回波之光學雷達系統示意圖,第1B圖為各掃描層疊加在網格圖之具有複數層掃描之光學雷達示意圖,第2圖為藉由具有複數層掃描之光學雷達獲得網格且固態形體存在於複數層之示意圖,第3A圖為光學雷達感應器使用最終回波過濾及過濾雨水演算法於障礙物特點偵測之實施例流程圖,第3B圖為本發明之雙光學雷達單元偵測障礙物之實施例示意圖,第3C圖為本發明之雙光學雷達單元使用最終回波過濾及過濾雨水演算法以辨識固態形體中的空氣中雨水或顆粒所返回訊號之流程圖,第4A圖為具有相距距離“d”之雙光學雷達感應器之無人駕駛車輛之示意圖,第4B圖為雙光學雷達感應器及個別區域偵測之示意圖,第5A圖為具有單平面之光學雷達實施狀態之畫面圖,第5B圖為具有單平面之光學雷達使用雙光學雷達系統實施狀態之畫面圖,第5C圖為具有複數個平面之光學雷達實施狀態之畫面圖,以及第5D圖為具有複數個平面之光學雷達使用雙光學雷達系統實施狀態之畫面圖。 Fig. 1A is a schematic diagram of a conventional multi-echo optical radar system, Fig. 1B is a schematic diagram of an optical radar with multiple layer scanning with each scanning layer superimposed on a grid chart, and Fig. 2 is an optical radar with multiple layer scanning A schematic diagram of the grid obtained and the solid form existing in multiple layers. Figure 3A is a flowchart of an embodiment of the optical radar sensor using the final echo filtering and filtering rain algorithm to detect obstacle characteristics. A schematic diagram of an embodiment of a dual optical radar unit for detecting obstacles. FIG. 3C is a flow chart of the dual optical radar unit of the present invention using a final echo filtering and filtering rain algorithm to identify signals returned by rain or particles in the air in a solid body Figure 4A is a schematic diagram of an unmanned vehicle with dual optical radar sensors with a distance "d", Figure 4B is a schematic diagram of dual optical radar sensors and individual area detection, and Figure 5A is a single-plane sensor. A picture of the implementation status of the optical radar. Figure 5B is a picture of the implementation status of the optical radar with a single plane using a dual optical radar system. The screen diagrams of the implementation status of the optical radar of the plurality of planes, and FIG. 5D are the screen diagrams of the implementation status of the optical radar with the plurality of planes using the dual optical radar system.
儘管本發明主要用於無人駕駛車輛之導航,應當理解本發明不局限於此,亦能協助其他人往使用光學雷達上努力,舉例來說,其他應用像是利用本發明於其他交通工具像是機器人、無人駕駛飛機或無人飛機系統,本發明還可使用於當空氣中存在有粒子如雨水或雪時,改善光學雷達之景觀成像及地圖應用的穩定性。 Although the present invention is mainly used for the navigation of unmanned vehicles, it should be understood that the present invention is not limited to this, and can also assist others in their efforts to use optical radar. For example, other applications such as using the invention on other vehicles such as Robots, drones, or unmanned aircraft systems. The present invention can also be used to improve the stability of optical radar's landscape imaging and map applications when particles such as rain or snow are present in the air.
本發明說明書中之“一個實施例/局面”用語意指有關實施例/局面而敘述之特定特徵、結構或特性包含於至少一個揭露之實施例/局面中。於本說明書各處使用之“在一實施例/局面”或“在另一實施例/局面”詞句並不全然指提及於完全相同之實施例/局面,也不是與其他實施例/局面相互排斥的個別或取代之實施例/局面。此外,顯示於某些實施例/局面之各種特徵,並未顯示於其他實施例/局面。同樣地,敘述於某些實施例/局面之要件特徵,於其他實施例/局面卻不是要件特徵。實施例及局面可以於某些特定的例子中相互使用。 The term “one embodiment / situation” in the specification of the present invention means that a specific feature, structure, or characteristic described in relation to the embodiment / situation is included in at least one disclosed embodiment / situation. The words "in one embodiment / position" or "in another embodiment / position" used throughout this specification do not refer to all references to the exact same embodiment / position, nor do they intersect with other embodiments / positions. Excluded individual or alternative embodiments / positions. In addition, various features shown in some embodiments / positions are not shown in other embodiments / positions. Similarly, the essential features described in some embodiments / positions are not essential features in other embodiments / positions. The embodiments and situations can be used interchangeably in some specific examples.
本說明書於文中及特定敘述文所揭露之術語具有本領域一般的意義。用於敘述揭露內容之一些術語將於下文或其他地方論述以提供給當事人對揭露內容的敘述更多的導引。為方便了解,對一些術語可能使用例如斜體或引號於例子中以突顯出來。突顯對於術語的範圍及意思並無影響,無論術語在相同內文中有無突顯皆表示相同範圍及意思,應當理解可以用不只一種方式說同樣的事情。 The terms disclosed in this specification and in specific narratives have general meanings in the art. Some terms used to describe the disclosure will be discussed below or elsewhere to provide parties with more guidance on the narrative of the disclosure. For ease of understanding, some terms may be highlighted, for example, in italics or quotes. Prominence has no effect on the scope and meaning of a term. Whether or not a term is prominent in the same context means the same scope and meaning, it should be understood that the same thing can be said in more than one way.
因此,替代的語言及同義詞可用於本文中任何一個或多個術語論述,無論一個術語是否被闡述或論述於文中也沒有特殊意義。在某些 特定術語會使用同義詞。一個或多個同義詞並不會排除其他同義詞的使用。本說明書使用之實施例包含之任何術語僅供表現,並不用於限制揭露之範圍及意思或任何例證的術語。相同地,所揭露之實施例並不僅限於本說明書所列舉之實施例。 Therefore, alternative languages and synonyms may be used in the discussion of any one or more terms herein, whether or not a term is elaborated or discussed in the text. In some Certain terms use synonyms. One or more synonyms do not exclude the use of other synonyms. The terminology used in the examples used in this specification is for expression only, and is not intended to limit the scope and meaning of the disclosure or any exemplified term. Similarly, the disclosed embodiments are not limited to the embodiments listed in this specification.
以下根據本說明書揭露內容之實施例說明相關之儀器、裝置、方法並不限定本發明揭露內容之範圍。所用的標的名稱或副標題係用以方便閱讀者閱讀,並非用以限定揭露內容之範圍。除非另有定義,否則文中所揭露所有技術或特殊術語皆有此領域任何普通技藝者一般所了解的意思。如有歧異之處,以本發明說明書包括其定義界定。 The following describes the related instruments, devices, and methods based on the embodiments disclosed in this specification, and does not limit the scope of the disclosure. The subject names or subtitles used are for the convenience of the reader and are not intended to limit the scope of the disclosure. Unless otherwise defined, all technical or special terms disclosed herein have the meaning commonly understood by any ordinary artisan in this field. If there is any discrepancy, it is defined by the specification of the present invention including its definition.
相對於彼此方向性或相關性的用語,例如,左、右、最低點、最高點、頂部、底部、垂直、水平、後面、前面、側部、等等但不僅是這些用語是相對於彼此,係依本申請元件或物體的特定方向而使用,以協助說明書中多樣實施例以及所附之請求項之敘述,而並非用以限制解釋。 Directional or related terms relative to each other, such as left, right, lowest point, highest point, top, bottom, vertical, horizontal, back, front, side, etc. but not only these terms are relative to each other, It is used according to the specific orientation of the elements or objects in this application to assist the description of various embodiments and the appended claims in the description, and is not intended to limit interpretation.
在本說明書及請求項適宜地使用之“大約”、“通常”之用語,除非有另外指出,表示上下有百分之二十的裕度。此外,同樣地在說明書及請求項所使用之“實質上”之用語,除非另有指出,表示上下有百分之十的裕度。應當理解並非所有上述用語在引用範圍中皆可量化以適用。 The terms "approximately" and "usually" used appropriately in this specification and the claims, unless otherwise indicated, indicate a margin of 20%. In addition, the term "substantially" also used in the specification and the claims, unless otherwise indicated, indicates a margin of 10%. It should be understood that not all of the above terms are quantifiable in the scope of citations to be applicable.
“多重回波性能(multi-echo capability)”之用語係關於一種光學雷達單元從每個發射雷射脈衝聚集並評估複數個(例如:三個)回波的能力。一個回波一旦到達光學雷達單元的接收器,其接收強度會轉換為電壓。來自固態形體的回波通常會形成高電壓持續一段長時間,然而,雨滴的回波會形成非常低電壓持續一段短時間。 The term "multi-echo capability" refers to the ability of an optical radar unit to gather and evaluate a plurality of (eg, three) echoes from each emitted laser pulse. Once an echo reaches the receiver of the optical radar unit, its reception intensity is converted into a voltage. Echoes from solid forms usually form a high voltage for a long period of time, however, echoes of raindrops form a very low voltage for a short period of time.
“複數層技術(multi-layer technology)”之用語係關於一種光學雷達單元允許借助具有不同垂直角度的掃描平面進行俯仰角補償(pitch angle compensation)。較佳之設計為光學雷達單元的光電二極體接收器包括複數個(例如:四個)獨立排於一線的接收器。每個接收器掃描單一平面,因此,將垂直孔洞分割成複數個平面。 The term “multi-layer technology” refers to an optical radar unit that allows pitch angle compensation by means of scan planes having different vertical angles. A preferred photodiode receiver designed as an optical radar unit includes a plurality of (eg, four) receivers arranged independently in a line. Each receiver scans a single plane, so the vertical hole is divided into multiple planes.
“SLAM”之用語係關於一種同時定位及映射製圖(Simultaneous Localization And Mapping)使當GPS定位不可使用時,如在室內空間,能夠準確地映射製圖。SLAM演算法使用光學雷達及IMU(慣性測量單元,Inertial Measurement Unit)數據以同時定位感測器及產生周遭環境的相干圖(coherent map)。 The term "SLAM" refers to a simultaneous localization and mapping (Simultaneous Localization And Mapping), which enables accurate mapping when GPS positioning is not available, such as indoor spaces. The SLAM algorithm uses optical radar and IMU (Inertial Measurement Unit) data to simultaneously locate the sensor and generate a coherent map of the surrounding environment.
“飛行時間原理(Time-of-Flight Principle)”之用語係關於一種依據訊號發射與從物體反射後返回感測器之間的時間差測量感測器與物體之間距離的方法。 The term "Time-of-Flight Principle" refers to a method for measuring the distance between a sensor and an object based on the time difference between the emission of a signal and its return to the sensor after reflection from the object.
本文使用之其他技術用語具有其在本領域中普通之涵義,如各種技術性辭典所解釋。在這些非限定例子中所論述之特定數值及構造可以變化且僅作為引述至少一實施例之用,並無作為限制其範圍之意圖。 Other technical terms used herein have their ordinary meaning in the art, as explained in various technical dictionaries. The specific numerical values and configurations discussed in these non-limiting examples may vary and are only used to quote at least one embodiment, and are not intended to limit its scope.
光學雷達(Lidar)基礎上是一種測量距離的技術。光學雷達系統將光能傳遞至地面或是傳往物體,其發射光可以稱為“光束”或“脈衝”。光學雷達單元係量測反射回感測器的光,這種反射回來的光可以稱為“回波(echo)”或是“返回(return)”。光學雷達系統與測量點之間的空間距離係依據比較脈衝及返回之間的延遲來計算。 Optical radar (Lidar) is a technology for measuring distance. Optical radar systems transmit light energy to the ground or to objects, and their emitted light can be referred to as "beams" or "pulses." The optical radar unit measures the light reflected back to the sensor. This reflected light can be called "echo" or "return". The spatial distance between the optical radar system and the measurement point is calculated based on the delay between the comparison pulse and the return.
光學雷達(Lidar)通常是一種使用於無人駕駛車輛上較佳的系統,因為光學雷達可以對於車輛周遭高解析度準確地三維映射(map)製圖。然而,空中的雨水或顆粒物質會使光學雷達失效就像是雷射光碰到物體反射回光學雷達單元。而當光被反射,空氣中的懸浮顆粒無法辨認固態形體,無人駕駛車輛就會減速或停止。 Optical radar (Lidar) is generally a better system for unmanned vehicles, because optical radar can accurately map three-dimensionally around the vehicle with high resolution. However, rain or particulate matter in the air can make the optical radar ineffective, as if the laser light hits the object and is reflected back to the optical radar unit. When light is reflected, suspended solids in the air cannot recognize solid bodies, and unmanned vehicles will slow down or stop.
第1A圖顯示光學雷達單元110使用最終回波以偵測物體120,這個技術亦稱為多重回波掃描,雨水115係被描繪在光學雷達單元110與物體120之間。一個脈衝可以產生雷射光的複數個回波(即第一回波、中段回波、最終回波)返回光學雷達單元,這會發生當空氣中物體如雨反射雷射光回光學雷達單元110的情況。圖中顯示訊號從空氣中粒子被反射的第一回波。中段回波亦會產生如同空氣中的粒子一樣的情況。圖中也顯示訊號(即回波)從物體120反射回來的最終回波140。 Figure 1A shows that the optical radar unit 110 uses the final echo to detect the object 120. This technique is also called multiple echo scanning. The rain 115 is depicted between the optical radar unit 110 and the object 120. One pulse can generate multiple echoes of the laser light (ie, the first echo, the middle echo, and the final echo) and return them to the optical radar unit. This occurs when an object in the air, such as rain, reflects the laser light back to the optical radar unit 110. The figure shows the first echo of a signal reflected from particles in the air. Mid-echo echoes can also behave like particles in the air. The figure also shows the final echo 140 reflected by the signal (ie, the echo) from the object 120.
這個系統可以分析回波以辨識出由於空氣中的雨水或粒子導致的回波。利用“最終回波過濾”,第一回波與中段回波會歸因於空氣中的雨水或粒子,而最終回波會歸因於固態形體。然而,這項技術有其限制而在大雨或空氣中具有大顆粒子時會失效。 This system can analyze echoes to identify echoes caused by rain or particles in the air. With "final echo filtering", the first and middle echoes are attributed to rain or particles in the air, and the final echoes are attributed to the solid form. However, this technology has its limitations and fails when exposed to heavy rain or large particles in the air.
第1B圖顯示多重回波掃描,係另一種技術用以辨識空氣中的雨水115或顆粒物質來的回波返回。光學雷達單元110掃描複數個角度。一個角度的掃描可測出層、面或堆棧面130。此系統可以比對從各個層的數據來確認物體的存在與否。出現在單層上的物體可能歸因於空氣中的顆粒物質。較佳的方法是,當在四個或四個以上的相鄰層偵測到回波時即確認固態形體的存在。 Figure 1B shows multiple echo scanning, another technique used to identify the return of rain 115 or particulate matter in the air. The optical radar unit 110 scans a plurality of angles. An angle scan can detect layers, faces, or stack faces 130. This system can compare the data from each layer to confirm the existence of the object. Objects that appear on a single layer may be attributed to particulate matter in the air. A better method is to confirm the existence of a solid body when echoes are detected in four or more adjacent layers.
每個角度/層的掃描可以在網格圖上重疊如第2圖所示。圖中顯示掃描四個層的結果。在四種掃描角度中,每個角度係被描繪於水平網格中。每塊陰影方格表示光學雷達單位偵測到回波。傳統的光學雷達系統會呈現兩個物體215、225的存在。複數層的數據分析可以從真實判讀中辨識出誤報的判讀。 The scan of each angle / layer can be superimposed on the grid as shown in Figure 2. The figure shows the results of scanning four layers. Of the four scanning angles, each angle is depicted in a horizontal grid. Each shaded square indicates an echo detected by the lidar unit. A conventional optical radar system would present the presence of two objects 215, 225. Plural layers of data analysis can identify false positive interpretations from true interpretations.
如果障礙物係被掃描層1所偵測到而非掃描層2或掃描層N在特定位置所偵測到,障礙物會被視為空氣中的粒子如雨水。雖然第一物體215存在於複數層中,但是不存在於中間層中(掃描層3),此外,物體存在於層中的位置不同,在這種情況下,此系統會決定回波是歸因於空氣中的雨水或粒子,相比之,第二物體225存在於複數連續層的相同位置,有了這個數據,此系統可以確認訊號係歸因於固態形體。更佳的方法是,四個單元的回波係被用以確認一個物體或障礙物的存在。假如物體存在於三個或更少的單元中,即可歸因於雨水或空氣中的懸浮顆粒。 If the obstacle is detected by scanning layer 1 instead of scanning layer 2 or scanning layer N at a specific position, the obstacle will be regarded as particles in the air such as rain. Although the first object 215 exists in the multiple layers, it does not exist in the intermediate layer (scanning layer 3). In addition, the object exists in the layer in different positions. In this case, the system determines that the echo is attributable. Compared to rain or particles in the air, the second object 225 exists in the same position in a plurality of continuous layers. With this data, the system can confirm that the signal is attributed to a solid body. A better method is that the echo system of four units is used to confirm the presence of an object or obstacle. If an object exists in three or fewer units, it can be attributed to suspended particles in rain or air.
第3A圖係顯示光學雷達單元採用最終回波及雨水過濾演算法之流程圖。光學雷達單元可以使用最終回波過濾器305及過濾雨水演算法315以分析從複數層掃描障礙物特徵及偵測325的數據。這可改善當空氣中存在懸浮粒子如雨水時光學雷達的可靠性及穩定性。 Figure 3A shows a flowchart of the optical radar unit using the final echo and rainwater filtering algorithm. The optical radar unit may use the final echo filter 305 and the filtered rain algorithm 315 to analyze the data from scanning the obstacle feature from the multiple layers and detecting 325. This can improve the reliability and stability of optical radar when there are suspended particles such as rain in the air.
第3B圖顯示本發明之兩個光學雷達單元同時起作用以改善無人駕駛車輛導航系統之穩定性及允許其在下雨或下雪的情況下運行之實施例。此系統可以包含第一(即左)光學雷達單元210及第二(即右)光學雷達單元220以掃描實質上相同之區域。從各光學雷達單元蒐集來的數據可以使用演算法比對以確認訊號是來自固態形體所造成。 FIG. 3B shows an embodiment in which two optical radar units of the present invention function at the same time to improve the stability of the navigation system of the unmanned vehicle and allow it to operate under rain or snow. This system may include a first (i.e. left) optical radar unit 210 and a second (i.e. right) optical radar unit 220 to scan substantially the same area. The data collected from each optical radar unit can be compared using algorithms to confirm that the signal is caused by a solid form.
假使第一光學雷達單元接收來自物體的反射光,系統會使用第二光學雷達單元以確認物體的存在。此系統可以使用演算法以分析來自各個光學雷達單元的數據包含發射光、反射光(即回波)以及物體的反射角度及移動。以這種方式,第二光學雷達單元確認第一光學雷達單元所接收之反射光是否為固態形體所造成。被兩個光學雷達單元中之一個所偵測之反射脈衝(即回波)在不經由另一光學雷達單元確認下,會被歸因於空氣中的粒子且歸類為誤報。以下列舉之原則可以應用於本方法:●固態形體/障礙物被兩個光學雷達單元(210,220)偵測;●一個回波被左光學雷達單元210偵測,但未被右光學雷達單元220偵測,可以歸因於空氣中的粒子如雨水;●一個回波被右光學雷達單元220偵測,但未被左光學雷達單元210偵測,可以歸因於空氣中的粒子如雨水。 If the first optical radar unit receives the reflected light from the object, the system uses the second optical radar unit to confirm the existence of the object. This system can use algorithms to analyze data from various optical radar units including emitted light, reflected light (ie, echoes), and reflection angles and movements of objects. In this way, the second optical radar unit confirms whether the reflected light received by the first optical radar unit is caused by a solid body. The reflected pulses (ie echoes) detected by one of the two optical radar units will be attributed to particles in the air and classified as false positives without confirmation by the other optical radar unit. The principles listed below can be applied to this method: ● a solid body / obstacle is detected by two optical radar units (210, 220); ● an echo is detected by the left optical radar unit 210 but not detected by the right optical radar unit 220 It can be attributed to particles in the air such as rain; ● An echo is detected by the right optical radar unit 220 but not detected by the left optical radar unit 210, which can be attributed to particles in the air such as rain.
這種雙光學雷達單元方法可以結合其他過濾技術如同最終回波和/或複數層掃描技術以改善具穩定性及可靠性。第3B圖顯示第一回波130伴隨著最終回波140。 This dual optical radar unit method can be combined with other filtering techniques such as final echo and / or multiple layer scanning techniques to improve stability and reliability. FIG. 3B shows that the first echo 130 is accompanied by the final echo 140.
第3C圖為根據本發明實施例顯示雙光學雷達單元之系統之流程圖。第一光學雷達單元210及第二光學雷達單元220可以使用最終回波過濾(310,320)。各個光學雷達單元之數據會被蒐集、處理、及使用過濾雨水演算法330來分析。舉例來說,此演算法可以將一個回波被其中一個而非配對之光學雷達單元偵測歸因於雨水,這將導致障礙物及特徵偵測340更穩定。無人駕駛車輛可以避免障礙物/危險且不會由於來自空氣中的雨水或粒子之誤報而減速或停止。 FIG. 3C is a flowchart showing a system of a dual optical radar unit according to an embodiment of the present invention. The first optical radar unit 210 and the second optical radar unit 220 may use final echo filtering (310, 320). Data from each optical radar unit is collected, processed, and analyzed using a filtered rain algorithm 330. For example, this algorithm can attribute an echo detected by one of the non-paired optical radar units to rainwater, which will cause obstacles and feature detection 340 to be more stable. Unmanned vehicles avoid obstacles / dangers and do not slow down or stop due to false alarms from rain or particles in the air.
第4A圖顯示此系統較佳的擺設,其中,第一光學雷達單元210及第二光學雷達單元220安裝在無人駕駛車輛410的車頂上並且彼此相距距離d。此距離d可以憑經驗而定,較佳的距離為0.5米至2.5米之間。然而,光學雷達單元之間分隔的距離可以根據車輛的大小、光學雷達單元解析度、障礙物/危險之預設距離及空氣中的顆粒物質之預設量等變數,舉例來說,理想的距離可以從小型機器人的一公分到大型無人飛機的數米不等。可以理解的,第一光學雷達單元210及第二光學雷達單元220可以安裝在車輛上的其他外部位置上(例如:引擎蓋上的保險桿)。更佳的擺設是,光學雷達單元彼此配置在一個水平面上,如此雷射光束將在同一個平面上發射。 FIG. 4A shows a preferred arrangement of the system. The first optical radar unit 210 and the second optical radar unit 220 are installed on the roof of the unmanned vehicle 410 and are separated from each other by a distance d. This distance d can be determined empirically, and the preferred distance is between 0.5 and 2.5 meters. However, the separation distance between optical radar units can be based on variables such as the size of the vehicle, the resolution of the optical radar unit, the preset distance of obstacles / dangers, and the preset amount of particulate matter in the air. For example, the ideal distance It can range from a centimeter of a small robot to a few meters of a large unmanned aircraft. It can be understood that the first optical radar unit 210 and the second optical radar unit 220 may be installed at other external positions on the vehicle (for example, a bumper on the hood). A better arrangement is that the optical radar units are arranged on a horizontal plane with each other, so that the laser beams will be emitted on the same plane.
第4B圖顯示第一(即左)光學雷達210及第二(即右)光學雷達單元220的偵測區域400。每個系統會掃描實質上的圓形區域以偵測物體120。掃描在中心區域235會重疊。每個感測器發射光束的數量及方向會根據光學雷達單元及設置而變。 FIG. 4B shows detection areas 400 of the first (ie, left) optical radar 210 and the second (ie, right) optical radar unit 220. Each system scans a substantially circular area to detect the object 120. The scans overlap in the central area 235. The number and direction of beams emitted by each sensor will vary depending on the optical radar unit and settings.
當光學雷達單元掃描實質上相同之區域,從重疊區域所蒐集到的數據可以被演算法所分析以確認訊號是否為固態形體所造成。空氣中的雨水或粒子可以將雷射光反射回光學雷達單元,固態形體120會被反射雷射光至兩個光學雷達單元所偵測。 When the optical radar unit scans substantially the same area, the data collected from the overlapping areas can be analyzed by the algorithm to confirm whether the signal is caused by a solid body. Rain or particles in the air can reflect the laser light back to the optical radar unit, and the solid body 120 will be detected by the reflected laser light to the two optical radar units.
兩個同時起作用的光學雷達單元及回波會被分析。多重回波技術可以與最終回波過濾技術及複數層掃描結合以改善無人駕駛車輛導航及允許空氣中存在顆粒如雨水或雪的情況下運行之穩定性。 Two simultaneous lidar units and echoes are analyzed. Multiple echo technology can be combined with final echo filtering technology and multiple layer scanning to improve the stability of unmanned vehicle navigation and allow operation in the presence of particles such as rain or snow in the air.
無人駕駛車輛系統在具有穩定雨水流量每小時十毫米的雨水隧道中作測試。光學雷達單元被安裝在車頂上,彼此間距大約一米之距離。使用兩種類型的光學雷達:單平面(LMS151光學雷達單元)及四平面(LDMRS光學雷達單元)。光學雷達單元使用多重回波技術。 The unmanned vehicle system was tested in a rainwater tunnel with a stable rainwater flow of ten millimeters per hour. The optical radar units are mounted on the roof of the vehicle at a distance of about one meter. Two types of optical radar are used: single-plane (LMS151 optical radar unit) and quad-plane (LDMRS optical radar unit). The optical radar unit uses multiple echo technology.
第5A-5D圖為中心為無人駕駛車輛之周遭環境俯視圖。橫軸代表以米為單位遠離車輛前面及後面之距離,縱軸代表以米為單位遠離車輛兩側之距離,每個間距為五米之距離。 Figures 5A-5D are top views of the surroundings of an unmanned vehicle. The horizontal axis represents the distance away from the front and back of the vehicle in meters, and the vertical axis represents the distance away from both sides of the vehicle in meters. Each distance is a distance of five meters.
第5A圖為單平面光學雷達使用多重回波掃描之網格圖。圓圈之區域為已知固態形體(雨水隧道的支柱)的位置,固態形體被來自雨滴505之誤報的其他區域所偵測,大部分的誤報係於車輛505前方區域偵測到。 Figure 5A is a grid map of single-plane optical radar using multiple echo scanning. The area in the circle is the location of the known solid body (the pillar of the rainwater tunnel). The solid body was detected by other areas from the false positives of the raindrops 505. Most of the false positives were detected in the area in front of the vehicle 505.
此測試使用(單平面)雙光學雷達系統重複測試,該系統以第一光學雷達系統及第二光學雷達系統掃描該區域。第5B圖為單平面光學雷達與來自雙光學雷達系統之數據之網格圖,如第5A圖所示,橫軸代表遠離車輛前方及後方之距離,縱軸代表遠離車輛兩側之距離。 This test was repeated using a (single plane) dual optical radar system that scanned the area with a first optical radar system and a second optical radar system. Figure 5B is a grid diagram of the single-plane optical radar and the data from the dual-optic radar system. As shown in Figure 5A, the horizontal axis represents the distance from the front and rear of the vehicle, and the vertical axis represents the distance from both sides of the vehicle.
歸因於雨水之返回訊號可以藉由比對第5A圖及第5B圖以辨識。在沒有雙光學雷達系統情況下,誤報會存在且歸因於來自空氣中雨滴505之回波。這些誤報在使用雙光學雷達系統時不存在,圓圈之區域為存在之結構物體(例如:支柱)且被偵測於兩種測試中。 The return signal due to rain can be identified by comparing Figures 5A and 5B. Without a dual optical radar system, false positives would exist and be attributed to echoes from raindrops 505 in the air. These false alarms do not exist when using the dual optical radar system. The circled area is the existing structural objects (such as pillars) and was detected in both tests.
第5C圖及第5D圖展示複數平面光學雷達過濾器的使用以偵測誤報之回波。第5C圖為複數平面光學雷達(未過濾)之網格圖。橫軸代 表遠離車輛前方及後方的距離,縱軸代表遠離車輛兩側之距離。每個間距為五米之距離。縱軸上的點為由於雨水而偵測到之誤報。 Figures 5C and 5D show the use of complex planar optical radar filters to detect false positive echoes. Figure 5C is a grid map of a complex planar optical radar (unfiltered). Horizontal axis generation The distance from the front and rear of the vehicle. The vertical axis represents the distance from the sides of the vehicle. Each pitch is a distance of five meters. The points on the vertical axis are false alarms detected due to rain.
此測試使用(複數平面)雙系統以重複測試,該系統以第一光學雷達系統及第二光學雷達系統掃描該區域。第5D圖為複數平面光學雷達使用雙光學雷達系統之網格圖。很多網格上的點在使用具有雙光學雷達過濾器時不存在,這些點係歸因於空氣中的雨滴,而這些點存在於第5C及5D圖可以被歸因於物體實物(即特徵)。 This test uses a (complex plane) dual system to repeat the test, which scans the area with a first optical radar system and a second optical radar system. Fig. 5D is a grid diagram of a dual optical radar system for a complex planar optical radar. Many points on the grid do not exist when using dual optical radar filters. These points are attributed to raindrops in the air, and these points exist in the 5C and 5D maps can be attributed to the physical object (ie, characteristics) .
額外的修改/元件可以改善系統在大雨(例如:雨量超過每小時二十毫米)下之穩定性。一種方法是使用能夠分析附加層(例如:五個或以上之層)的光學雷達單元以使雷達更好穿透雨水。具有更高更新率之光學雷達單元可以用以過濾除雨滴。可使用機械性之鼓風機以提供具有特定範圍(例如一米以下)之空氣幕(air curtain)以減少被光學雷達單元偵測之雨滴量。 Additional modifications / components can improve the stability of the system in heavy rain (for example: more than twenty millimeters per hour). One method is to use an optical radar unit capable of analyzing additional layers (eg, five or more layers) to make the radar better penetrate rainwater. Optical radar units with higher update rates can be used to filter raindrops. A mechanical blower can be used to provide an air curtain with a specific range (for example, less than one meter) to reduce the amount of raindrops detected by the optical radar unit.
應當理解,以上所揭露內容之各種改變及其他特徵和功能,或其替代方案可以結合其他系統或應用。此外,本領域技術人員隨後可進行未預見或未預料之替代方案、修改、改變或改善,皆為附隨之申請專利範圍所涵蓋。 It should be understood that various changes and other features and functions of the content disclosed above, or alternatives thereof may be combined with other systems or applications. In addition, those skilled in the art may subsequently carry out unforeseen or unexpected alternatives, modifications, changes or improvements, all of which are covered by the scope of the accompanying patent application.
儘管本實施例已相當詳細地描述可涵括可能的層面,本領域技術人員應了解本發明之其他態樣也是可行的。 Although this embodiment has described in considerable detail the possible aspects that can be covered, those skilled in the art will appreciate that other aspects of the invention are also possible.
Claims (17)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/SG2017/050607 WO2019112514A1 (en) | 2017-12-08 | 2017-12-08 | Rain filtering techniques for autonomous vehicle |
| ??PCT/SG2017/050607 | 2017-12-08 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW201932868A true TW201932868A (en) | 2019-08-16 |
Family
ID=66751135
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW107144162A TW201932868A (en) | 2017-12-08 | 2018-12-07 | Rain filtering techniques for autonomous vehicle |
Country Status (6)
| Country | Link |
|---|---|
| JP (1) | JP2021514457A (en) |
| AU (1) | AU2017442202A1 (en) |
| IL (1) | IL275162A (en) |
| SG (1) | SG11202005246TA (en) |
| TW (1) | TW201932868A (en) |
| WO (1) | WO2019112514A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112859010A (en) * | 2019-11-28 | 2021-05-28 | 怡利电子工业股份有限公司 | Alarming method for preventing raindrop misinformation of millimeter wave radar |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11643072B2 (en) * | 2019-09-27 | 2023-05-09 | Zoox, Inc. | Planning accommodations for particulate matter |
| US11640170B1 (en) | 2019-10-29 | 2023-05-02 | Zoox, Inc. | Identification of particulate matter in sensor data |
| TWI732365B (en) * | 2019-11-29 | 2021-07-01 | 怡利電子工業股份有限公司 | Warning method for preventing raindrop false alarm of millimeter wave radar |
| EP4130798A4 (en) * | 2020-04-15 | 2023-05-31 | Huawei Technologies Co., Ltd. | TARGET IDENTIFICATION METHOD AND DEVICE |
| JP2024052332A (en) * | 2022-09-30 | 2024-04-11 | 株式会社小松製作所 | Work site detection system and work site detection method |
| CN115825982B (en) * | 2023-02-02 | 2023-04-18 | 深圳煜炜光学科技有限公司 | Method and system for scanning point cloud data of unmanned aerial vehicle in rainy environment |
| CN119024302A (en) * | 2023-05-25 | 2024-11-26 | 深圳奥锐达科技有限公司 | A distance detection method, an anti-interference laser radar system and a measurement method |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5314037A (en) * | 1993-01-22 | 1994-05-24 | Shaw David C H | Automobile collision avoidance system |
| JP2009069020A (en) * | 2007-09-13 | 2009-04-02 | Toshiba Corp | Radar equipment |
| JP5092076B2 (en) * | 2007-10-26 | 2012-12-05 | オプテックス株式会社 | Laser area sensor |
| JP2013167479A (en) * | 2012-02-14 | 2013-08-29 | Toyota Motor Corp | Laser radar device and object detection method using the same |
| US9857472B2 (en) * | 2013-07-02 | 2018-01-02 | Electronics And Telecommunications Research Institute | Laser radar system for obtaining a 3D image |
| US9625582B2 (en) * | 2015-03-25 | 2017-04-18 | Google Inc. | Vehicle with multiple light detection and ranging devices (LIDARs) |
| JP2016191617A (en) * | 2015-03-31 | 2016-11-10 | シャープ株式会社 | Obstacle determination device |
| JP6598517B2 (en) * | 2015-06-04 | 2019-10-30 | 東日本高速道路株式会社 | Reverse running vehicle detection system using light waves |
| CN105607075A (en) * | 2015-09-08 | 2016-05-25 | 北京铁路局北京科学技术研究所 | Road safety monitoring method and apparatus thereof |
| CN204882872U (en) * | 2015-09-09 | 2015-12-16 | 厦门理工学院 | To keeping away barrier system before car |
-
2017
- 2017-12-08 AU AU2017442202A patent/AU2017442202A1/en not_active Abandoned
- 2017-12-08 JP JP2020528321A patent/JP2021514457A/en not_active Ceased
- 2017-12-08 SG SG11202005246TA patent/SG11202005246TA/en unknown
- 2017-12-08 WO PCT/SG2017/050607 patent/WO2019112514A1/en not_active Ceased
-
2018
- 2018-12-07 TW TW107144162A patent/TW201932868A/en unknown
-
2020
- 2020-06-07 IL IL275162A patent/IL275162A/en unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112859010A (en) * | 2019-11-28 | 2021-05-28 | 怡利电子工业股份有限公司 | Alarming method for preventing raindrop misinformation of millimeter wave radar |
Also Published As
| Publication number | Publication date |
|---|---|
| IL275162A (en) | 2020-07-30 |
| SG11202005246TA (en) | 2020-07-29 |
| WO2019112514A1 (en) | 2019-06-13 |
| JP2021514457A (en) | 2021-06-10 |
| AU2017442202A1 (en) | 2020-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TW201932868A (en) | Rain filtering techniques for autonomous vehicle | |
| US11609329B2 (en) | Camera-gated lidar system | |
| US11703879B2 (en) | All weather autonomously driven vehicles | |
| US12013464B2 (en) | Environment sensing system and movable platform | |
| CN110389586B (en) | System and method for ground and free space exploration | |
| EP2721593B1 (en) | System and method for traffic side detection and characterization | |
| US10816654B2 (en) | Systems and methods for radar-based localization | |
| RU2763800C1 (en) | Onboard sensor system | |
| WO2017181638A1 (en) | Systems and methods for unified mapping of an environment | |
| Taraba et al. | Utilization of modern sensors in autonomous vehicles | |
| EP4102251A1 (en) | Determination of atmospheric visibility in autonomous vehicle applications | |
| CN103576159A (en) | Runway pavement detection device and method based on laser scanning technology | |
| WO2018218629A1 (en) | Laser radar-based detection method and device and probing equipment | |
| US20180095473A1 (en) | Autonomous electric vehicle for transportation of goods and/or people | |
| CN117043632A (en) | Enhancement of LIDAR road detection | |
| CN114518566A (en) | Method and sensing system for a vehicle | |
| US20250052872A1 (en) | A system and method for lidar blockage detection | |
| Nowakowski | Operational Environment Impact on Sensor Capabilities in Special Purpose Unmanned Ground Vehicles | |
| Meydani | State-of-the-art analysis of the performance of the sensors utilized in autonomous vehicles in extreme conditions | |
| CN113050119B (en) | A method for judging interference of optical flash three-dimensional imaging radar | |
| RU148255U1 (en) | LASER OPTICAL AND LOCATION STATION | |
| US20240345237A1 (en) | Method and Localisation Device for Localising a Motor Vehicle, and Motor Vehicle | |
| EP4379424A1 (en) | Multipath object identification for navigation |