[go: up one dir, main page]

TWI862216B - Positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition - Google Patents

Positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition Download PDF

Info

Publication number
TWI862216B
TWI862216B TW112139181A TW112139181A TWI862216B TW I862216 B TWI862216 B TW I862216B TW 112139181 A TW112139181 A TW 112139181A TW 112139181 A TW112139181 A TW 112139181A TW I862216 B TWI862216 B TW I862216B
Authority
TW
Taiwan
Prior art keywords
positioning
image
unit
navigation
mark
Prior art date
Application number
TW112139181A
Other languages
Chinese (zh)
Other versions
TW202516152A (en
Inventor
莊仁輝
徐震濤
陳昱豪
Original Assignee
國立陽明交通大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 國立陽明交通大學 filed Critical 國立陽明交通大學
Priority to TW112139181A priority Critical patent/TWI862216B/en
Application granted granted Critical
Publication of TWI862216B publication Critical patent/TWI862216B/en
Publication of TW202516152A publication Critical patent/TW202516152A/en

Links

Landscapes

  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Navigation (AREA)

Abstract

A positioning system, an autonomous mobile device, a motion control system, and a positioning method based on image visual recognition are provided. The present invention can perform positioning and movement control from long distances to short distances in an environment without GPS signals. The present invention has the effect of stable and accurate positioning. In the case of insufficient ambient light, the detection and location of the present invention are stable. Moreover, the present invention can increase the computing speed, reduce computing resources, and quickly complete accurate positioning, and then guide the autonomous mobile device.

Description

基於影像視覺辨識的定位系統、自主移動設備、運動控制系統及定位方法Positioning system, autonomous mobile device, motion control system and positioning method based on image vision recognition

本發明提供一種定位系統及定位方法,尤指一種基於影像視覺辨識的定位系統、自主移動設備、運動控制系統及定位方法。 The present invention provides a positioning system and a positioning method, in particular, a positioning system, an autonomous mobile device, a motion control system and a positioning method based on image visual recognition.

通常在室外開放空間可以利用全球定位系統(GPS)對環境位置或無人載具進行精準定位,然而若是在大型室內場域(如:工廠)、隧道、山谷等無GPS的環境中,對於環境位置或無人載具的定位是件困難的課題。 Usually, the Global Positioning System (GPS) can be used to accurately locate the environment or unmanned vehicles in open outdoor spaces. However, in large indoor areas (such as factories), tunnels, valleys and other environments without GPS, the location of the environment or unmanned vehicles is a difficult problem.

以大型室內場域而言,習知的室內定位技術之一是佈建高密度或高精度的固定式無線通訊設備,主動發出無線定位訊號,然而若要精準定位,無線通訊設備的價格高,難以普及。另一種室內定位技術是使用RGB攝影機及SLAM(Simultaneous localization and mapping)定位演算法,此技術必須通過相機、其他類型的圖像感測器、雷達光掃描儀或聲納來量測位置、距離或速度,並據此來建立地圖模型,地圖模型需要耗費時間,一旦遇到環境變化大的情境(例如天災意外發生 時),耗時重新佈建地圖模型已不符合當下需求,並且一時之間難以觀察環境變化及測量周圍環境。 For large indoor venues, one of the known indoor positioning technologies is to deploy high-density or high-precision fixed wireless communication equipment to actively send out wireless positioning signals. However, if accurate positioning is required, the price of wireless communication equipment is high and it is difficult to popularize. Another indoor positioning technology is to use RGB cameras and SLAM (Simultaneous localization and mapping) positioning algorithms. This technology must use cameras, other types of image sensors, radar scanners or sonars to measure the position, distance or speed, and build a map model based on this. The map model takes time. Once the environment changes greatly (such as when a natural disaster occurs unexpectedly), it takes time to re-build the map model, which no longer meets the current needs, and it is difficult to observe environmental changes and measure the surrounding environment for a while.

以戶外場域而言,在隧道、山谷等自然環境中,多半無GPS訊號可以進行定位,在這些自然環境中也較缺乏照明設備,在無GPS訊號定位及弱光條件下,欲達到精準定位是相當困難的課題。 As for outdoor areas, in natural environments such as tunnels and valleys, there is usually no GPS signal for positioning. There is also a lack of lighting equipment in these natural environments. In the absence of GPS signal positioning and in low light conditions, it is quite difficult to achieve accurate positioning.

因此,本發明針對上述先前技術之問題,進一步提出一種基於影像視覺辨識的定位系統、自主移動設備、運動控制系統及定位方法,以解決習知所產生的問題。 Therefore, the present invention aims at the above-mentioned problems of the prior art and further proposes a positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition to solve the problems caused by learning.

有鑑於上述問題,本發明的主要目的是提供一種在缺乏GPS訊號的環境下,基於影像視覺辨識技術從遠距離到近距離導引自主移動設備可穩定且精確地抵達目標位置,同時在環境光源不足的情況下,也能夠穩定地偵測和定位,並且可提升運算速度、降低運算資源,而能快速完成精準定位與導引自主移動設備。 In view of the above problems, the main purpose of the present invention is to provide a method for guiding autonomous mobile devices from long distances to short distances to reach the target location stably and accurately based on image vision recognition technology in an environment lacking GPS signals. At the same time, it can stably detect and locate in the case of insufficient ambient light, and can improve computing speed and reduce computing resources, so as to quickly complete accurate positioning and guide autonomous mobile devices.

為達上述目的,本發明提供一種定位系統,定位系統包含導航標記單元與自主移動設備。導航標記單元位於環境中,導航標記單元包含定位標記(fiducial marker)與光點標記(light beacon),光點標記位於定位標記周圍,且發出一或多個光點。自主移動設備包含機體、驅動單元、影像擷取單元與運動控制系統。驅動單元用以驅動該機體移動。影像擷取單元產生環境中的影像。運動控制系統包含一處理單元,處理單元訊號連接驅動單元與影像擷取單元,以接收影像,處理單元用以分析影像。在處理單元辨識影像具有導航標記單元且無法以定位標記進行空間座標推算的狀態下,則處理單元選擇第一導航 演算法,處理單元依據第一導航演算法控制驅動單元,並導航機體到相距定位標記的第一距離內。在處理單元辨識影像具有導航標記單元且可以使用定位標記進行空間座標推算的狀態下,則處理單元選擇第二導航演算法,處理單元依據第二導航演算法控制驅動單元,並導航機體到相距定位標記的第二距離內。其中,第一距離大於第二距離。 To achieve the above-mentioned purpose, the present invention provides a positioning system, which includes a navigation marker unit and an autonomous mobile device. The navigation marker unit is located in the environment, and the navigation marker unit includes a positioning marker (fiducial marker) and a light beacon. The light beacon is located around the positioning marker and emits one or more light spots. The autonomous mobile device includes a body, a driving unit, an image capture unit and a motion control system. The driving unit is used to drive the body to move. The image capture unit generates an image in the environment. The motion control system includes a processing unit, and the processing unit signal connects the driving unit and the image capture unit to receive images, and the processing unit is used to analyze images. When the processing unit recognizes that the image has a navigation marker unit and the spatial coordinates cannot be calculated using the positioning marker, the processing unit selects the first navigation algorithm, controls the drive unit according to the first navigation algorithm, and navigates the body to a first distance from the positioning marker. When the processing unit recognizes that the image has a navigation marker unit and the spatial coordinates can be calculated using the positioning marker, the processing unit selects the second navigation algorithm, controls the drive unit according to the second navigation algorithm, and navigates the body to a second distance from the positioning marker. The first distance is greater than the second distance.

如前述的定位系統,在一實施例中,定位系統還包含多重強度照明器,多重強度照明器可設置於自主移動設備上或位於導航標記單元周圍,且朝向定位標記發出亮光,並且依據時間變化或預設頻率動態調整亮光的亮度,提供影像擷取單元獲得亮度隨時間變化的影像。 As in the aforementioned positioning system, in one embodiment, the positioning system further includes a multi-intensity illuminator, which can be set on the autonomous mobile device or located around the navigation marker unit, and emits light toward the positioning marker, and dynamically adjusts the brightness of the light according to time changes or preset frequencies, so as to provide the image capture unit with images whose brightness changes over time.

依據本發明的目的,再提出一種自主移動設備,自主移動設備包含機體、驅動單元、影像擷取單元與運動控制系統。驅動單元用以驅動該機體移動。影像擷取單元產生環境中的影像。運動控制系統包含一處理單元,處理單元訊號連接驅動單元與影像擷取單元,以接收影像,處理單元用以分析影像。在處理單元辨識影像具有導航標記單元且無法使用定位標記進行空間座標推算的狀態下,則處理單元選擇第一導航演算法,處理單元依據第一導航演算法控制驅動單元,並導航機體到相距定位標記的第一距離內。在處理單元辨識影像具有導航標記單元且可使用定位標記進行空間座標推算的狀態下,則處理單元選擇第二導航演算法,處理單元依據第二導航演算法控制驅動單元,並導航機體到相距定位標記的第二距離內。 According to the purpose of the present invention, an autonomous mobile device is proposed, which includes a body, a driving unit, an image capture unit and a motion control system. The driving unit is used to drive the body to move. The image capture unit generates images in the environment. The motion control system includes a processing unit, the processing unit signal connects the driving unit and the image capture unit to receive images, and the processing unit is used to analyze the images. When the processing unit recognizes that the image has a navigation mark unit and the positioning mark cannot be used for spatial coordinate calculation, the processing unit selects a first navigation algorithm, controls the driving unit according to the first navigation algorithm, and navigates the body to a first distance from the positioning mark. When the processing unit recognizes that the image has a navigation marker unit and can use the positioning marker to perform spatial coordinate calculation, the processing unit selects the second navigation algorithm, controls the drive unit according to the second navigation algorithm, and navigates the body to the second distance from the positioning marker.

依據本發明的目的,再提出一種運動控制系統,運動控制系統包含處理單元,處理單元接收並分析環境中的影像;在處理單元辨識影像具有導航標記單元且可使用定位標記進行空間座標推算的狀態下,則處理單元選擇第一導航演算法,處理單元依據第一導航演算法 控制驅動單元,並導航機體到相距定位標記的第一距離內。在處理單元辨識影像具有導航標記單元且可使用定位標記進行空間座標推算的狀態下,則處理單元選擇第二導航演算法,處理單元依據第二導航演算法控制驅動單元,並導航機體到相距定位標記的第二距離內。 According to the purpose of the present invention, a motion control system is proposed. The motion control system includes a processing unit, which receives and analyzes images in the environment; when the processing unit recognizes that the image has a navigation marker unit and can use the positioning marker to perform spatial coordinate calculation, the processing unit selects a first navigation algorithm, and the processing unit controls the drive unit according to the first navigation algorithm, and navigates the body to a first distance from the positioning marker. When the processing unit recognizes that the image has a navigation marker unit and can use the positioning marker to perform spatial coordinate calculation, the processing unit selects a second navigation algorithm, and the processing unit controls the drive unit according to the second navigation algorithm, and navigates the body to a second distance from the positioning marker.

依據本發明的目的,本發明再提供一種定位方法,定位方法包括以下步驟:透過處理單元接收影像擷取單元所產生的一影像;以及透過處理單元分析影像是否具有導航標記單元中的定位標記;若否,則分析影像是否有光點標記,若有則透過處理單元依據第一導航演算法訊號控制驅動單元,並導航機體到相距定位標記的一第一距離內;若是,則透過處理單元依據第二導航演算法訊號控制驅動單元,並導航機體到相距定位標記的一第二距離內;其中,第一距離大於第二距離。 According to the purpose of the present invention, the present invention further provides a positioning method, which includes the following steps: receiving an image generated by an image capture unit through a processing unit; and analyzing whether the image has a positioning mark in a navigation mark unit through the processing unit; if not, analyzing whether the image has a light spot mark, and if so, controlling the driving unit through the processing unit according to a first navigation algorithm signal, and navigating the body to a first distance from the positioning mark; if so, controlling the driving unit through the processing unit according to a second navigation algorithm signal, and navigating the body to a second distance from the positioning mark; wherein the first distance is greater than the second distance.

據上所述,本發明在缺乏GPS訊號情境下,無論距離目標位置係遠距離或近距離,皆可導引自主移動設備到達目標位置,同時具有可適應各種環境的功效。 As mentioned above, the present invention can guide the autonomous mobile device to reach the target location in the absence of GPS signals, regardless of whether the distance to the target location is long or short, and it can also adapt to various environments.

1,1’:定位系統 1,1’: Positioning system

10:導航標記單元 10: Navigation marker unit

12:定位標記 12: Positioning mark

14,14’:光點標記 14,14’: light spot mark

20,20’:自主移動設備 20,20’: Autonomous mobile devices

21:機體 21: Body

22:驅動單元 22: Drive unit

24:影像擷取單元 24: Image capture unit

30:運動控制系統 30: Motion control system

32:處理單元 32: Processing unit

40,40’:多重強度照明器 40,40’:Multiple intensity illuminators

L1:第一距離 L1: First distance

L2:第二距離 L2: Second distance

P:目標位置 P: Target position

P1:初始位置 P1: Initial position

P2:可辨識位置 P2: Identifiable location

X:目標距離 X: Target distance

S1~S5,S11~S14,S41~S43,S51~S56,S61~S64:步驟 S1~S5,S11~S14,S41~S43,S51~S56,S61~S64: Steps

圖1A為本發明之定位系統之第一實施例方塊圖;圖1B為本發明之定位系統之第一實施例示意圖;圖2A為本發明之定位系統之第二實施例方塊圖;圖2B為本發明之定位系統之第二實施例示意圖; 圖3為本發明之定位方法之第一實施例的流程圖;圖4為本發明之定位方法之第二實施例的流程圖;圖5為本發明之定位方法之第三實施例的流程圖;圖6為本發明之定位方法之第四實施例的流程圖;圖7為本發明之定位方法之第五實施例的流程圖。 FIG. 1A is a block diagram of the first embodiment of the positioning system of the present invention; FIG. 1B is a schematic diagram of the first embodiment of the positioning system of the present invention; FIG. 2A is a block diagram of the second embodiment of the positioning system of the present invention; FIG. 2B is a schematic diagram of the second embodiment of the positioning system of the present invention; FIG. 3 is a flow chart of the first embodiment of the positioning method of the present invention; FIG. 4 is a flow chart of the second embodiment of the positioning method of the present invention; FIG. 5 is a flow chart of the third embodiment of the positioning method of the present invention; FIG. 6 is a flow chart of the fourth embodiment of the positioning method of the present invention; FIG. 7 is a flow chart of the fifth embodiment of the positioning method of the present invention.

本發明之實施例將藉由下文配合相關圖式進一步加以解說。盡可能的,於圖式與說明書中,相同標號係代表相同或相似構件。於圖式中,基於簡化與方便標示,形狀與厚度可能經過誇大表示。可以理解的是,未特別顯示於圖式中或描述於說明書中之元件,為所屬技術領域中具有通常知識者所知之形態。本領域具有通常知識者可依據本發明之內容而進行多種之改變與修改。 The embodiments of the present invention will be further explained below with the help of the relevant drawings. As far as possible, the same reference numerals in the drawings and the specification represent the same or similar components. In the drawings, the shapes and thicknesses may be exaggerated for the sake of simplicity and convenience. It is understood that the components not specifically shown in the drawings or described in the specification are in the form known to those with ordinary knowledge in the relevant technical field. Those with ordinary knowledge in this field can make various changes and modifications based on the content of the present invention.

請參閱圖1A與圖1B,定位系統1包含導航標記單元10、自主移動設備20與多重強度照明器40。導航標記單元10位於環境中,且包含定位標記12與光點標記14,光點標記14位於定位標記12周圍,且發出一或多個光點。自主移動設備20包含機體21、驅動單元22、影像擷取單元24與運動控制系統30。驅動單元22驅動機體21移動。影像擷取單元24產生環境中的影像。 Please refer to FIG. 1A and FIG. 1B , the positioning system 1 includes a navigation marker unit 10, an autonomous mobile device 20 and a multi-intensity illuminator 40. The navigation marker unit 10 is located in the environment and includes a positioning marker 12 and a light spot marker 14. The light spot marker 14 is located around the positioning marker 12 and emits one or more light spots. The autonomous mobile device 20 includes a body 21, a drive unit 22, an image capture unit 24 and a motion control system 30. The drive unit 22 drives the body 21 to move. The image capture unit 24 generates an image in the environment.

運動控制系統30包括處理單元32,處理單元32訊號連接驅動單元22與影像擷取單元24,以接收影像。處理單元32用以分析影像,在處理單元32辨識影像具有導航標記單元10且無法使用定位標記12進行空間座標推算的狀態下(意即僅能辨識光點標記14的狀態下),處理單元32選擇第一導航演算法,處理單元32依據第一導航演算法訊號控 制驅動單元22,用以導航機體21到相距導航標記單元10的第一距離L1內。 The motion control system 30 includes a processing unit 32, which is connected to the drive unit 22 and the image capture unit 24 by signal to receive the image. The processing unit 32 is used to analyze the image. When the processing unit 32 recognizes that the image has a navigation marker unit 10 and cannot use the positioning marker 12 to perform spatial coordinate calculation (that is, only the light spot marker 14 can be recognized), the processing unit 32 selects the first navigation algorithm. The processing unit 32 controls the drive unit 22 according to the first navigation algorithm signal to navigate the body 21 to a first distance L1 from the navigation marker unit 10.

在處理單元32辨識影像具有導航標記單元10,並且能以定位標記12進行空間定位、空間座標推算的狀態下,則處理單元32選擇第二導航演算法。處理單元32依據第二導航演算法訊號控制驅動單元22,用以導航機體21到相距導航標記單元10的第二距離L2內。其中,第一距離L1大於第二距離L2。 When the processing unit 32 recognizes that the image has a navigation marker unit 10 and can use the positioning marker 12 to perform spatial positioning and spatial coordinate calculation, the processing unit 32 selects the second navigation algorithm. The processing unit 32 controls the driving unit 22 according to the second navigation algorithm signal to navigate the body 21 to the second distance L2 from the navigation marker unit 10. The first distance L1 is greater than the second distance L2.

多重強度照明器40位於導航標記單元10周圍,且朝向定位標記12發出亮光,而實際設置時可因應不同環境,放置於不同距離處。多重強度照明器40依據時間變化或預設頻率動態調整亮光的亮度,提供影像擷取單元24獲得亮度隨時間變化的影像。一般而言,為了適應不同地形與環境,在不同情境下多重強度照明器40與定位標記12之間的距離可能不同,而藉由多重強度照明器40使亮光隨時間變化、改變亮度的特性,進而使自主移動設備20在各種不同位置的情況下皆可提高定位標記12的辨識穩定度。 The multi-intensity illuminator 40 is located around the navigation mark unit 10 and emits light toward the positioning mark 12. In actual settings, it can be placed at different distances according to different environments. The multi-intensity illuminator 40 dynamically adjusts the brightness of the light according to time changes or preset frequencies, providing the image capture unit 24 with images whose brightness changes over time. Generally speaking, in order to adapt to different terrains and environments, the distance between the multi-intensity illuminator 40 and the positioning mark 12 may be different in different situations. The multi-intensity illuminator 40 allows the light to change over time and change the brightness, thereby enabling the autonomous mobile device 20 to improve the recognition stability of the positioning mark 12 in various different locations.

關於定位標記12與光點標記14的設置,舉例而言,如圖1B所示,導航標記單元10可包含多個定位標記12,每一個定位標記12代表一個ArUco代碼,並以矩陣排列組成,且導航標記單元10的可為矩形但不以此為限。光點標記14可發出一或多個光點,圖中為兩個平行的光點,設置於定位標記12的上方,兩個光點之間相距一段距離。光點標記14亦可變換位置,並非限制必須在定位標記12的旁邊。 Regarding the setting of the positioning mark 12 and the light spot mark 14, for example, as shown in FIG1B, the navigation mark unit 10 may include a plurality of positioning marks 12, each positioning mark 12 represents an ArUco code and is arranged in a matrix, and the navigation mark unit 10 may be rectangular but is not limited thereto. The light spot mark 14 may emit one or more light spots, two parallel light spots in the figure, which are set above the positioning mark 12, and the two light spots are separated by a certain distance. The light spot mark 14 may also change its position, and is not limited to being next to the positioning mark 12.

再者,在實際運用上,建立導航標記單元10上的定位標記12必須包含一或多個標記參數,標記參數包含:定位標記12每一行、每一列所設置的數量,定位標記12的邊長、每一個定位標記12之間的間隔 距離、標記字典(dictionary of tokens)以及第一個標記的ID。定位標記12由於具有獨特的編號且具方向性的特性,為了能獲得更穩定與準確的結果,本發明以多個相同種類但不同樣式的定位標記12,以矩陣排列所形成的特定標誌板,以提高定位標記12的識別率,對於部分遮擋圖像具有較大的容忍度,且可形成更多的參考點,因此能達成更穩定的偵測結果。 Furthermore, in actual application, the establishment of the positioning marker 12 on the navigation marker unit 10 must include one or more marker parameters, which include: the number of positioning markers 12 set in each row and column, the side length of the positioning marker 12, the spacing distance between each positioning marker 12, the token dictionary, and the ID of the first marker. Since the positioning marker 12 has a unique number and directional characteristics, in order to obtain more stable and accurate results, the present invention uses a plurality of positioning markers 12 of the same type but different styles, and forms a specific marker plate in a matrix arrangement to improve the recognition rate of the positioning marker 12, has a greater tolerance for partially blocked images, and can form more reference points, so that a more stable detection result can be achieved.

舉例而言,自主移動設備20為無人機、影像擷取單元24為相機,無人機透過前方相機所收集的影像,辨識環境中定位標記12的位置,以定位標記12所在位置定義無人機自身座標,並進行導引,若環境光源不足,則透過多重強度照明器40所發出不同亮度變化,進行適當的亮度補償;若無法獲得定位標記12的影像(意即無法以定位標記12進行空間定位推算的狀態下),則開啟辨識光點標記14機制,以光點標記14特定頻率或特定擺放位置進行辨識,進而導引無人機至定位標記12可辨識的距離範圍內,再進行導引。 For example, the autonomous mobile device 20 is a drone, and the image capture unit 24 is a camera. The drone identifies the position of the positioning mark 12 in the environment through the image collected by the front camera, defines the coordinates of the drone itself based on the position of the positioning mark 12, and performs guidance. If the ambient light is insufficient, the multi-intensity illuminator 40 emits different brightness changes to perform appropriate brightness compensation. If the image of the positioning mark 12 cannot be obtained (that is, the positioning mark 12 cannot be used for spatial positioning calculation), the light spot mark 14 recognition mechanism is turned on, and the light spot mark 14 is recognized based on the specific frequency or specific placement position, and then the drone is guided to the distance range where the positioning mark 12 can be recognized, and then guidance is performed.

關於第一導航演算法或第二導航演算法,可儲存於自主移動設備20或運動控制系統30內,處理單元32可從自主移動設備20或者運動控制系統30中選擇第一導航演算法或第二導航演算法。 The first navigation algorithm or the second navigation algorithm may be stored in the autonomous mobile device 20 or the motion control system 30, and the processing unit 32 may select the first navigation algorithm or the second navigation algorithm from the autonomous mobile device 20 or the motion control system 30.

請參閱圖2A與圖2B,本實施例與第一實施例差別在於定位系統1’的光點標記14’、自主移動設備20’、多重強度照明器40’與定位系統1的光點標記、自主移動設備、多重強度照明器並不相同。 Please refer to Figure 2A and Figure 2B. The difference between this embodiment and the first embodiment is that the light spot mark 14', the autonomous mobile device 20', and the multi-intensity illuminator 40' of the positioning system 1' are different from the light spot mark, the autonomous mobile device, and the multi-intensity illuminator of the positioning system 1.

在本實施例中,光點標記14’與定位標記12之間具有一段距離,兩者並非連接設置。多重強度照明器40’設置於自主移動設備20’上,多重強度照明器40’電性連接處理單元32,處理單元32控制多重強度照明 器40’發出亮光,且依據時間變化或預設頻率動態調整亮光的亮度,提供影像擷取單元24獲得亮度隨時間變化的影像。 In this embodiment, there is a distance between the light spot mark 14' and the positioning mark 12, and the two are not connected. The multi-intensity illuminator 40' is set on the autonomous mobile device 20', and the multi-intensity illuminator 40' is electrically connected to the processing unit 32. The processing unit 32 controls the multi-intensity illuminator 40' to emit light, and dynamically adjusts the brightness of the light according to time changes or preset frequencies, so as to provide the image capture unit 24 with images whose brightness changes with time.

舉例而言,當自主移動設備20’位在起飛的初始位置P1時,初始位置P1距離目標位置P約為40~80公尺,由於距離定位標記12過於遙遠,影像中較難辨識出定位標記12,也無法以定位標記12來進行空間定位推算,此時處理單元32分析影像若得以辨識出光點標記14’,則處理單元32便依據第一導航演算法訊號控制自主移動設備20’,且透過光點標記14’導引,導航自主移動設備20’移動至距離定位標記12的第一距離L1內,並持續移動至可辨識位置P2。可辨識位置P2距離目標位置P大約12~20公尺左右,當導航至可辨識位置P2後,處理單元32可分析影像並辨識出定位標記12,接著處理單元32再依據第二導航演算法訊號控制驅動單元22以導航機體21在相距定位標記12的第二距離L2內移動。 For example, when the autonomous mobile device 20' is located at the initial position P1 of takeoff, the initial position P1 is about 40 to 80 meters away from the target position P. Since the distance to the positioning mark 12 is too far, the positioning mark 12 is difficult to identify in the image, and the positioning mark 12 cannot be used to perform spatial positioning calculation. At this time, if the processing unit 32 analyzes the image and recognizes the light spot mark 14', the processing unit 32 controls the autonomous mobile device 20' according to the first navigation algorithm signal, and guides the autonomous mobile device 20' to move to the first distance L1 from the positioning mark 12 through the guidance of the light spot mark 14', and continues to move to the recognizable position P2. The identifiable position P2 is about 12 to 20 meters away from the target position P. After navigating to the identifiable position P2, the processing unit 32 can analyze the image and identify the positioning mark 12. Then the processing unit 32 controls the driving unit 22 according to the second navigation algorithm signal to navigate the body 21 to move within the second distance L2 from the positioning mark 12.

一般而言,當自主移動設備20’抵達該目標位置P後,考量實際過程中環境因素變化大,恐干擾自主移動設備20’在目標位置P上的定位能力。例如:當風力或外力導致移動設備大幅度轉向,可能造成定位標記12超出影像擷取單元24可感測的範圍;或,當自主移動設備20’很靠近定位標記12時,很容易受到氣流擾動,特別是當周圍環境有障礙物或遮擋物時,自主移動設備20’(如:無人機)的螺旋槳轉動所產生的氣流可能受到前述障礙物的影響,導致飛行條件不穩定,而此不穩定的現象亦可能導致自主移動設備上的影像擷取單元24已無法朝向定位標記12。運動控制系統30可設定一目標距離作為預設飄移範圍,也就是說自主移動設備20’抵達目標位置P時,可允許自主移動設備20’在一定的範圍內飄移。 Generally speaking, when the autonomous mobile device 20' arrives at the target position P, the environmental factors may change greatly during the actual process, which may interfere with the positioning capability of the autonomous mobile device 20' at the target position P. For example, when the wind or external force causes the mobile device to turn sharply, the positioning mark 12 may be beyond the sensing range of the image capture unit 24; or, when the autonomous mobile device 20' is very close to the positioning mark 12, it is easily disturbed by the airflow, especially when there are obstacles or obstructions in the surrounding environment. The airflow generated by the rotation of the propeller of the autonomous mobile device 20' (such as a drone) may be affected by the aforementioned obstacles, resulting in unstable flight conditions. This unstable phenomenon may also cause the image capture unit 24 on the autonomous mobile device to be unable to face the positioning mark 12. The motion control system 30 can set a target distance as a preset drifting range, that is, when the autonomous mobile device 20' reaches the target position P, the autonomous mobile device 20' can be allowed to drift within a certain range.

因此藉由本發明控制自主移動設備透過移動與飛行在無GPS的環境下進行定位,同時調整前進位置與方位,進而抵達目標位置。其中,自主移動設備可為一種無人機或無人載具。 Therefore, the present invention controls the autonomous mobile device to locate itself in a GPS-free environment by moving and flying, and adjusts the forward position and orientation at the same time, thereby reaching the target location. The autonomous mobile device can be a drone or unmanned vehicle.

儘管前述在說明本發明的定位系統的過程中,亦已同時說明定位方法的概念,但為求清楚起見,以下仍另繪示流程圖詳細說明。請配合前述圖1A至圖2B所示之定位系統之方塊圖與示意圖,以清楚說明以下圖3至圖7所示的流程圖。 Although the concept of the positioning method has been explained in the process of explaining the positioning system of the present invention, for the sake of clarity, a flowchart is still shown below for detailed explanation. Please use the block diagram and schematic diagram of the positioning system shown in Figures 1A to 2B above to clearly explain the flowcharts shown in Figures 3 to 7 below.

請參閱圖3,定位方法包含以下步驟: Please refer to Figure 3, the positioning method includes the following steps:

步驟S1,接收影像擷取單元所產生的影像。 Step S1, receiving the image generated by the image capture unit.

步驟S2,分析影像是否具有定位標記。若否,則執行步驟S3,若是,則執行步驟S5。 Step S2, analyze whether the image has a positioning mark. If not, execute step S3, if yes, execute step S5.

步驟S3,分析影像是否具有光點標記。 Step S3, analyzing whether the image has a light spot mark.

步驟S5,透過處理單元依據第二導航演算法訊號控制驅動單元,並導航機體在相距定位標記的第二距離內移動。 Step S5, the processing unit controls the driving unit according to the second navigation algorithm signal, and navigates the body to move within the second distance from the positioning mark.

在步驟S3中,若是則執行步驟S4,若否則回到步驟S1。 In step S3, if yes, go to step S4, if no, go back to step S1.

步驟S4,透過處理單元依據第一導航演算法訊號控制驅動單元,並導航機體到相距定位標記的第一距離內。 Step S4, the processing unit controls the driving unit according to the first navigation algorithm signal, and navigates the body to within the first distance from the positioning mark.

在步驟S1中,運動控制系統還包含通訊單元,通過通訊單元接收影像擷取單元所產生的影像。 In step S1, the motion control system also includes a communication unit, through which the image generated by the image capture unit is received.

在步驟S2中,通過通訊單元接收影像擷取單元所產生的影像後,再利用處理單元分析該影像。 In step S2, after receiving the image generated by the image capture unit through the communication unit, the image is analyzed by the processing unit.

請參閱圖4,本實施例與圖3所述的實施例差異在於本實施例的定位方法還包含以下步驟: Please refer to Figure 4. The difference between this embodiment and the embodiment described in Figure 3 is that the positioning method of this embodiment also includes the following steps:

步驟S11,控制驅動單元驅動機體移動至初始高度。 Step S11, control the driving unit to drive the body to move to the initial height.

步驟S12,接收影像擷取單元所產生的影像。 Step S12, receiving the image generated by the image capture unit.

步驟S13,分析影像是否具有導航標記單元。若是,則執行步驟S2;若否,則執行步驟S14。 Step S13, analyze whether the image has a navigation marker unit. If yes, execute step S2; if no, execute step S14.

步驟S14,控制驅動單元驅動機體繼續上升,並持續接收並分析上升時影像擷取單元所輸出的影像,直到預設最大高度則控制機體降落至地面、結束任務。 Step S14, control the driving unit to drive the body to continue to rise, and continue to receive and analyze the images output by the image capture unit during the rise, until the preset maximum height is reached, then control the body to land on the ground and end the mission.

在步驟S11中,初始高度高於地面或等於地面的高度,可依需求設定機體從地面或遠離地面的位置上起飛/降落,皆不以此為限。 In step S11, the initial height is higher than the ground or equal to the ground. The aircraft can be set to take off/land from the ground or a position far from the ground according to needs, but it is not limited to this.

在步驟S11、步驟S14中,關於控制驅動單元驅動的步驟,可由透過運動控制系統直接訊號控制驅動單元,亦可傳送一控制訊號來間接控制驅動單元。 In step S11 and step S14, regarding the step of controlling the driving unit, the driving unit can be controlled by a direct signal from the motion control system, or a control signal can be transmitted to indirectly control the driving unit.

舉例而言,在一些情況下,定位標記設置的位置可能受到障礙物遮蔽視線或高度太低、被遮蔽阻擋,又或者在啟動自主移動設備移動時,可能不會面對定位標記,因此藉由上述步驟進行搜尋感測。同時,亦可運用YOLOv5模型來辨識的定位標記周圍的邊界框的大小,並且為了確保移動設備能保持面向定位標記,定位標記周圍的邊界框寬度較佳設置在距離圖像的中心位置20像素以內,高度可大於300像素,以利於後續引導短距離定位導航。 For example, in some cases, the location where the positioning marker is set may be blocked by obstacles or the height is too low or blocked, or when the autonomous mobile device is started to move, it may not face the positioning marker, so the above steps are used for search sensing. At the same time, the YOLOv5 model can also be used to identify the size of the bounding box around the positioning marker, and in order to ensure that the mobile device can remain facing the positioning marker, the width of the bounding box around the positioning marker is preferably set within 20 pixels from the center of the image, and the height can be greater than 300 pixels, so as to facilitate the subsequent guidance of short-distance positioning navigation.

[遠距離定位導航] [Long-distance positioning navigation]

請一併參閱圖3與圖5,圖5亦表示出第一導航演算法的概念,預設情境為在一個無GPS的環境下,且當前無法得知移動設備距離目標位置的距離。在本實施例中,定位方法可先判別是否接近目標位置,再進一步進行導航引導定位。在步驟S4的步驟中還包含下列步驟: Please refer to Figure 3 and Figure 5 together. Figure 5 also shows the concept of the first navigation algorithm. The default scenario is in an environment without GPS, and the distance between the mobile device and the target location is currently unknown. In this embodiment, the positioning method can first determine whether it is close to the target location, and then further perform navigation guidance positioning. The following steps are also included in step S4:

步驟S41,透過處理單元利用深度學習模型來辨識導航標記單元。 Step S41, using a deep learning model to identify navigation marker units through a processing unit.

步驟S42,控制驅動單元驅動機體。 Step S42, control the drive unit to drive the body.

步驟S43,導航機體朝向光點標記且移動至第一距離內。 Step S43, the navigation body moves toward the light spot mark and within the first distance.

執行完步驟S43再回到圖3的步驟S1。 After executing step S43, return to step S1 in Figure 3.

[近距離定位導航] [Short-range positioning navigation]

請參閱圖6,在本實施例中,圖6與圖3的定位方法差異在於,步驟S5中還包含步驟S51至步驟S56。當自主移動設備在定位標記前的第二距離內時,將進行近距離定位導航機制。 Please refer to Figure 6. In this embodiment, the difference between the positioning method of Figure 6 and Figure 3 is that step S5 also includes steps S51 to S56. When the autonomous mobile device is within the second distance before the positioning mark, the short-distance positioning navigation mechanism will be performed.

步驟S51,透過運動控制系統依據預設圖標特徵分析影像。 Step S51, analyzing the image according to the preset icon features through the motion control system.

步驟S52,判斷影像中是否有符合預設圖標特徵的定位標記。若是,則執行步驟S53,若否則回到步驟S51。 Step S52, determine whether there is a positioning mark in the image that meets the preset icon characteristics. If yes, execute step S53, otherwise return to step S51.

步驟S53,建立定位標記的圖像座標。 Step S53, establish the image coordinates of the positioning mark.

步驟S54,通過圖像座標與相應的世界座標之間的幾何關係來計算自主移動設備的位置與方向。 Step S54, calculate the position and direction of the autonomous mobile device through the geometric relationship between the image coordinates and the corresponding world coordinates.

步驟S55,依據定位標記來引導控制機體移動,且控制定位標記位於影像的中心。 Step S55, guide and control the movement of the body according to the positioning mark, and control the positioning mark to be located at the center of the image.

步驟S56,到達定位標記前方的目標位置。 Step S56, reach the target position in front of the positioning mark.

在步驟S51中,預設圖標特徵包含定位標記的顏色、形狀、大小和其他特徵。 In step S51, the default icon features include the color, shape, size and other features of the positioning mark.

在步驟S54中,所謂的世界座標(World Coordinates)是固定的通用座標系統,由三個絕對座標(X,Y,Z)組成的一個有序的實數三元組。X、Y、Z分別表示沿相應軸方向上的距世界原點(0,0,0)的有向距離。 In step S54, the so-called world coordinates are a fixed universal coordinate system, an ordered real number triple consisting of three absolute coordinates (X, Y, Z). X, Y, and Z represent the directed distance from the world origin (0, 0, 0) along the corresponding axis direction.

舉例而言,物件尺寸較大時YOLOv5辨識邊界框位置可能較不穩定,因此應用此方法將可克服定位不穩定的課題,同時達到精準引導到特定的目標位置。當移動設備距離在導航標記單元前的12~20公尺內時,可應用本實施例的定位方法。其中目標位置可設置於定位標記前方的3~5公尺處,亦可設定一目標預設距離或目標預設範圍(例如:0至5公尺的範圍內)來當作目標位置。 For example, when the object size is larger, the position of the YOLOv5 recognition bounding box may be less stable. Therefore, applying this method will overcome the problem of unstable positioning and achieve accurate guidance to a specific target position. When the mobile device is within 12 to 20 meters in front of the navigation marker unit, the positioning method of this embodiment can be applied. The target position can be set 3 to 5 meters in front of the positioning marker, or a target preset distance or target preset range (for example, within the range of 0 to 5 meters) can be set as the target position.

進一步來說,在短距離精確定位應用上,本發明的定位方法可通過定位標記(即是ArUco板)和視覺定位演算法來計算自主移動設備的位置與姿態。 Furthermore, in the application of short-distance precise positioning, the positioning method of the present invention can calculate the position and posture of the autonomous mobile device through positioning markers (i.e. ArUco boards) and visual positioning algorithms.

[懸停階段] [Suspended phase]

請參閱圖7,在本實施例中,圖7與圖6的定位方法差異在於,在步驟S56抵達目標位置時,還包含步驟S61至步驟S64。 Please refer to Figure 7. In this embodiment, the positioning method of Figure 7 is different from that of Figure 6 in that when step S56 reaches the target position, it also includes steps S61 to S64.

步驟S61,控制機體抵達目標位置並懸停,並且控制定位標記位於影像的中心。 Step S61, control the machine to reach the target position and suspend, and control the positioning mark to be located at the center of the image.

步驟S62,計算移動過程中所儲存的複數個圖像座標的位置平均值。 Step S62, calculate the position average of multiple image coordinates stored during the movement process.

步驟S63,依據位置平均值調整自主移動設備的位置與方向。 Step S63, adjust the position and direction of the autonomous mobile device according to the average position value.

步驟S64,控制機體影像擷取單元朝向定位標記,同時保持水平移動。 Step S64, control the body image capture unit to face the positioning mark while maintaining horizontal movement.

在步驟S62中,透過移動設備先前移動時所記錄的十個圖像座標的位置平均值來調整移動設備的飛行,將有助於減輕氣流擾動和不穩定飛行條件的影響。 In step S62, adjusting the flight of the mobile device by averaging the position of the ten image coordinates recorded when the mobile device was previously moving will help reduce the impact of air turbulence and unstable flight conditions.

再者,在步驟S63中,可設定一預設飄移範圍,也就是說自主移動設備抵達該目標位置時可允許自主移動設備在一定的範圍內飄移, 例如:以目標位置為中心的圓,半徑為一預設距離以內,皆是可允許的飄移範圍內,藉由得以確保自主移動設備的精確定位和穩定性。 Furthermore, in step S63, a preset drifting range can be set, that is, when the autonomous mobile device reaches the target position, the autonomous mobile device can be allowed to drift within a certain range. For example, a circle with the target position as the center and a radius within a preset distance are all within the allowable drifting range, thereby ensuring the accurate positioning and stability of the autonomous mobile device.

在上述定位方法中,還可包含藉由多重強度照明器朝向定位標記發出亮光,以提供環境亮度補償。藉由多重強度照明器朝向定位標記發出亮光,並依據時間變化或預設頻率動態調整亮光的亮度。 In the above positioning method, it may also include emitting bright light toward the positioning mark by a multi-intensity illuminator to provide ambient brightness compensation. The multi-intensity illuminator emits bright light toward the positioning mark, and dynamically adjusts the brightness of the bright light according to time changes or preset frequency.

其中,此多重強度照明器的電路利用電子電路產生電壓變化的原理,產生不同強度的輔助照明。舉例而言,當多重強度照明器的週期設定為三秒時,在此期間多重強度照明器的亮度將從完全黑暗調整至完全明亮。 The circuit of this multi-intensity illuminator uses the principle of voltage change generated by electronic circuits to generate auxiliary lighting of different intensities. For example, when the cycle of the multi-intensity illuminator is set to three seconds, the brightness of the multi-intensity illuminator will be adjusted from complete darkness to complete brightness during this period.

儘管本揭露描述的方法的步驟以特定順序示出和描述,但是每個方法的操作順序可以改變,也可以相反的順序執行某些步驟,或者某些步驟也與其他步驟同時執行。在另一個實施例中,不同步驟可以間歇和/或交替的方式實施。 Although the steps of the methods described in the present disclosure are shown and described in a particular order, the order of operation of each method can be changed, and some steps can be performed in the reverse order, or some steps can be performed simultaneously with other steps. In another embodiment, different steps can be implemented in an intermittent and/or alternating manner.

綜上所述,本發明可有效的在無GPS的環境下將移動設備從遠距離導引到近距離再引導至定位標記前的目標位置上。在遠距離的範圍使用光點標記進行定位導航,在近距離的範圍內時使用定位標記進行定位導航可保證順利使移動設備飛向目標位置。因此,透過兩階段(遠距離導航與近距離導航)能夠使無人機從遠到近達到精準、平穩、高效率的導航。 In summary, the present invention can effectively guide the mobile device from a long distance to a short distance and then to the target position in front of the positioning marker in an environment without GPS. Using the light spot marker for positioning navigation in a long-distance range and using the positioning marker for positioning navigation in a short-distance range can ensure that the mobile device can fly smoothly to the target position. Therefore, through two stages (long-distance navigation and short-distance navigation), the drone can achieve accurate, stable and efficient navigation from far to near.

以上所述,僅為舉例說明本發明的較佳實施方式,並非以此限定實施的範圍,凡是依本發明申請專利範圍及專利說明書內容所作的簡單置換及等效變化,皆屬本發明的專利申請範疇。 The above is only an example to illustrate the preferred implementation of the present invention, and is not intended to limit the scope of implementation. All simple substitutions and equivalent changes made according to the scope of the patent application of the present invention and the content of the patent specification are within the scope of the patent application of the present invention.

1:定位系統 1: Positioning system

10:導航標記單元 10: Navigation marker unit

12:定位標記 12: Positioning mark

14:光點標記 14: Light spot mark

20:自主移動設備 20: Autonomous mobile devices

21:機體 21: Body

22:驅動單元 22: Drive unit

24:影像擷取單元 24: Image capture unit

30:運動控制系統 30: Motion control system

32:處理單元 32: Processing unit

40:多重強度照明器 40:Multiple intensity lighting device

Claims (19)

一種定位系統,包含:一導航標記單元,位於一環境中,該導航標記單元包含一定位標記與一光點標記,該光點標記位於該定位標記周圍,且發出一或多個光點;以及一自主移動設備,包含:一機體;一驅動單元,驅動該機體移動;一影像擷取單元,產生該環境中的一影像;及一運動控制系統,包含一處理單元,該處理單元訊號連接該驅動單元與該影像擷取單元,以接收該影像,該處理單元用以分析該影像;在該處理單元辨識該影像具有該導航標記單元且無法以該定位標記進行空間座標推算的狀態下,則該處理單元選擇一第一導航演算法,該處理單元依據該第一導航演算法控制該驅動單元,並導航該機體到相距該定位標記的一第一距離內;在該處理單元辨識該影像具有該導航標記單元且以該定位標記進行空間座標推算的狀態下,則該處理單元選擇一第二導航演算法,該處理單元依據該第二導航演算法控制該驅動單元,並導航該機體到相距該定位標記的一第二距離內;其中,該第一距離大於該第二距離。 A positioning system includes: a navigation mark unit located in an environment, the navigation mark unit includes a positioning mark and a light spot mark, the light spot mark is located around the positioning mark and emits one or more light spots; and an autonomous mobile device, including: a body; a driving unit, driving the body to move; an image capture unit, generating an image in the environment; and a motion control system, including a processing unit, the processing unit signal connecting the driving unit and the image capture unit to receive the image, the processing unit is used to analyze the image; the processing unit identifies that the image has the navigation mark unit and When the spatial coordinates cannot be calculated using the positioning mark, the processing unit selects a first navigation algorithm, controls the driving unit according to the first navigation algorithm, and navigates the body to a first distance from the positioning mark; when the processing unit recognizes that the image has the navigation mark unit and performs spatial coordinate calculation using the positioning mark, the processing unit selects a second navigation algorithm, controls the driving unit according to the second navigation algorithm, and navigates the body to a second distance from the positioning mark; wherein the first distance is greater than the second distance. 如請求項1所述的定位系統,還包含一多重強度照明器,該多重強度照明器位於該導航標記單元周圍或設置於該自主移動設備上,且朝向該定位標記發出亮光,並且依據時間變化或一預設頻率動態調整該亮光的一亮度,提供該影像擷取單元獲得該亮度隨時間變化的該影像。 The positioning system as described in claim 1 further comprises a multi-intensity illuminator, which is located around the navigation mark unit or is disposed on the autonomous mobile device and emits light toward the positioning mark, and dynamically adjusts the brightness of the light according to time changes or a preset frequency, so as to provide the image capture unit with the image whose brightness changes with time. 如請求項1所述的定位系統,其中,在該第一導航演算法中,該處理單元利用一深度學習模型來辨識該導航標記單元。 A positioning system as described in claim 1, wherein, in the first navigation algorithm, the processing unit uses a deep learning model to identify the navigation marker unit. 如請求項1所述的定位系統,其中,該定位標記具有一預設圖標特徵,在該第二導航演算法中,該處理單元分析該影像具有符合該預設圖標特徵的該定位標記時,則建立該定位標記的一圖像座標,該處理單元依據該圖像座標與相應的一世界座標之間的空間幾何關係來計算該機體相對於該定位標記的位置與方向。 A positioning system as described in claim 1, wherein the positioning marker has a preset icon feature, and in the second navigation algorithm, when the processing unit analyzes the image and finds that the positioning marker has the preset icon feature, an image coordinate of the positioning marker is established, and the processing unit calculates the position and direction of the body relative to the positioning marker based on the spatial geometric relationship between the image coordinate and a corresponding world coordinate. 如請求項4所述的定位系統,其中,該處理單元分析該影像並控制該機體在移動過程中該定位標記位於該影像的中心,在該定位標記偏離該影像的中心時,則該處理單元控制該驅動單元驅動該機體移動高度和轉向,同時繼續朝著該定位標記移動。 A positioning system as described in claim 4, wherein the processing unit analyzes the image and controls the positioning mark of the body to be located at the center of the image during the movement. When the positioning mark deviates from the center of the image, the processing unit controls the driving unit to drive the body to move in height and turn, while continuing to move toward the positioning mark. 如請求項4所述的定位系統,其中,該處理單元導航該機體在相距該定位標記的該第二距離內移動,且持續導航直到該機體位於該定位標記前方的一目標位置,控制該機體抵達該目標位置並懸停,並且控制該定位標記位於該影像的中心。 A positioning system as described in claim 4, wherein the processing unit navigates the body to move within the second distance from the positioning mark, and continues to navigate until the body is located at a target position in front of the positioning mark, controls the body to reach the target position and suspend, and controls the positioning mark to be located at the center of the image. 如請求項6所述的定位系統,其中,在該機體懸停的狀態下,該處理單元計算移動過程中所儲存的複數個該圖像座標的一位置平均值,來計算該機體欲移動的位置與方向,該處理單元控制該機體與該影像擷取單元朝向該導航標記單元,同時保持水平移動,以確保定位穩定性。 A positioning system as described in claim 6, wherein, when the body is suspended, the processing unit calculates a position average of a plurality of image coordinates stored during the movement process to calculate the position and direction of the body to be moved, and the processing unit controls the body and the image capture unit to face the navigation marking unit while maintaining horizontal movement to ensure positioning stability. 一種自主移動設備,包含:一機體;一驅動單元,驅動該機體移動;一影像擷取單元,產生一環境中的一影像; 一運動控制系統,包含一處理單元,該處理單元訊號連接該驅動單元與該影像擷取單元,用以接收並分析該影像;在該處理單元辨識該影像具有一導航標記單元且無法以該導航標記單元中的一定位標記進行空間座標推算的狀態下,則該處理單元選擇一第一導航演算法,該處理單元依據該第一導航演算法控制該驅動單元,並導航該機體到相距該定位標記的一第一距離內;在該處理單元辨識該影像具有該導航標記單元且以該定位標記進行空間座標推算狀態下,則該處理單元選擇一第二導航演算法,該處理單元依據該第二導航演算法控制該驅動單元,並導航該機體到相距該定位標記的一第二距離內,其中該第一距離大於該第二距離;以及一多重強度照明器,電性連接該運動控制系統,該多重強度照明器發出亮光,且依據時間變化或一預設頻率動態調整該亮光的一亮度,提供該影像擷取單元獲得該亮度隨時間變化的該影像。 An autonomous mobile device comprises: a machine body; a driving unit for driving the machine body to move; an image capturing unit for generating an image in an environment; a motion control system comprising a processing unit, the processing unit signal connecting the driving unit and the image capturing unit for receiving and analyzing the image; when the processing unit identifies that the image has a navigation marker unit and a positioning marker in the navigation marker unit cannot be used to perform spatial coordinate calculation, the processing unit selects a first navigation algorithm, controls the driving unit according to the first navigation algorithm, and navigates the machine body to a position away from the positioning marker. within a first distance; when the processing unit identifies that the image has the navigation mark unit and performs spatial coordinate calculation with the positioning mark, the processing unit selects a second navigation algorithm, and the processing unit controls the driving unit according to the second navigation algorithm, and navigates the body to a second distance from the positioning mark, wherein the first distance is greater than the second distance; and a multi-intensity illuminator, electrically connected to the motion control system, the multi-intensity illuminator emits light, and dynamically adjusts the brightness of the light according to time changes or a preset frequency, so as to provide the image capture unit with the image whose brightness changes with time. 一種運動控制系統,包含:一處理單元,接收並分析一環境中的一影像;在該處理單元辨識該影像具有一導航標記單元且無法以該導航標記單元中的一定位標記進行空間座標推算的狀態下,則該處理單元選擇一第一導航演算法,該處理單元依據該第一導航演算法控制一驅動單元,並導航一機體到相距該定位標記的一第一距離內;在該處理單元辨識該影像具有該導航標記單元且以該定位標記進行空間座標推算的狀態下,則該處理單元選擇一第二導航演算法,該處理單元依據 該第二導航演算法控制該驅動單元,並導航該機體到相距該定位標記的一第二距離內;其中,該第一距離大於該第二距離。 A motion control system includes: a processing unit, receiving and analyzing an image in an environment; when the processing unit recognizes that the image has a navigation marker unit and a positioning marker in the navigation marker unit cannot be used to perform spatial coordinate calculation, the processing unit selects a first navigation algorithm, controls a drive unit according to the first navigation algorithm, and navigates an object to a position at a distance within a first distance of the positioning mark; when the processing unit recognizes that the image has the navigation mark unit and performs spatial coordinate calculation with the positioning mark, the processing unit selects a second navigation algorithm, and the processing unit controls the drive unit according to the second navigation algorithm and navigates the body to a second distance from the positioning mark; wherein the first distance is greater than the second distance. 一種定位方法,包含:透過一處理單元接收一影像擷取單元所產生的一影像;以及透過該處理單元分析該影像是否具有一導航標記單元中的一定位標記;若否,則分析該影像是否有一光點標記,若有,則透過該處理單元依據一第一導航演算法訊號控制一驅動單元,並導航一機體到相距該定位標記的一第一距離內;若是,則透過該處理單元依據一第二導航演算法訊號控制該驅動單元,並導航該機體到相距該定位標記的一第二距離內;其中,該第一距離大於該第二距離。 A positioning method includes: receiving an image generated by an image capture unit through a processing unit; and analyzing whether the image has a positioning mark in a navigation mark unit through the processing unit; if not, analyzing whether the image has a light spot mark, and if so, controlling a driving unit through the processing unit according to a first navigation algorithm signal, and navigating a body to a first distance from the positioning mark; if so, controlling the driving unit through the processing unit according to a second navigation algorithm signal, and navigating the body to a second distance from the positioning mark; wherein the first distance is greater than the second distance. 如請求項10所述的定位方法,其中,該第一導航演算法為利用一深度學習模型來辨識該導航標記單元。 A positioning method as described in claim 10, wherein the first navigation algorithm utilizes a deep learning model to identify the navigation marker unit. 如請求項10所述的定位方法,在分析該影像是否具有該導航標記單元中的該定位標記的步驟前,還包括:控制該驅動單元驅動該機體移動至一初始高度,並回到接收該影像擷取單元所產生的該影像的步驟。 As described in claim 10, before analyzing whether the image has the positioning mark in the navigation mark unit, the positioning method further includes: controlling the driving unit to drive the body to move to an initial height, and returning to the step of receiving the image generated by the image capture unit. 如請求項10所述的定位方法,其中,在分析該影像的步驟中,若該影像未具有該導航標記單元,則藉由該處理單元控制該驅動單元驅動該機體繼續上升,並持續接收上升時該影像擷取單元所輸出的影像。 The positioning method as described in claim 10, wherein, in the step of analyzing the image, if the image does not have the navigation marker unit, the processing unit controls the driving unit to drive the body to continue to rise, and continuously receives the image output by the image capture unit during the rise. 如請求項13所述的定位方法,其中,控制該機體上升至一預設最大高度,並分析該影像是否具有該導航標記單元,若否,則降落至地面。 A positioning method as described in claim 13, wherein the aircraft is controlled to rise to a preset maximum height, and the image is analyzed to see whether it has the navigation marker unit, and if not, it descends to the ground. 如請求項10所述的定位方法,其中,該定位標記具有一預設圖標特徵,在該第二導航演算法中,當該影像具有符合該預設圖標特徵的該定位標記時,則建立該定位標記的一圖像座標,依據該圖像座標與相應的一世界座標之間的空間幾何關係來計算該機體相對於該定位標記的位置與方向。 The positioning method as described in claim 10, wherein the positioning marker has a preset icon feature, and in the second navigation algorithm, when the image has the positioning marker that meets the preset icon feature, an image coordinate of the positioning marker is established, and the position and direction of the body relative to the positioning marker are calculated based on the spatial geometric relationship between the image coordinate and a corresponding world coordinate. 如請求項15所述的定位方法,在計算該機體相對於該定位標記的位置與方向的步驟後,還包含控制該定位標記在該機體移動過程中位於該影像的中心;當該定位標記偏離該影像的中心時,則控制該驅動單元驅動該機體移動高度和轉向,同時繼續朝著該定位標記移動。 As described in claim 15, after calculating the position and direction of the body relative to the positioning mark, the positioning mark is controlled to be located at the center of the image during the movement of the body; when the positioning mark deviates from the center of the image, the driving unit is controlled to drive the body to move in height and turn, while continuing to move toward the positioning mark. 如請求項14所述的定位方法,在透過該處理單元依據該第二導航演算法訊號控制該驅動單元,導航該機體在相距該定位標記的該第二距離內移動的步驟中,還包含持續導航直到該機體位於該導航標記單元前方的一目標位置,控制該機體抵達該目標位置並懸停,並且控制該定位標記位於該影像的中心。 As described in claim 14, in the step of controlling the driving unit by the processing unit according to the second navigation algorithm signal to navigate the body to move within the second distance from the positioning mark, the method further includes continuing navigation until the body is located at a target position in front of the navigation mark unit, controlling the body to reach the target position and suspend, and controlling the positioning mark to be located at the center of the image. 如請求項17所述的定位方法,在控制該機體抵達該目標位置並懸停的步驟中,還可包含下列步驟:計算該定位標記的一圖像座標以及移動過程中所儲存的複數個該圖像座標的一位置平均值,來計算該機體欲移動的位置與方向;以及控制該機體與該影像擷取單元朝向該導航標記單元,同時保持水平移動,以確保定位穩定性。 The positioning method as described in claim 17 may further include the following steps in the step of controlling the body to reach the target position and suspend: calculating an image coordinate of the positioning mark and a position average of a plurality of image coordinates stored during the movement process to calculate the position and direction of the body to be moved; and controlling the body and the image capture unit to face the navigation mark unit while maintaining horizontal movement to ensure positioning stability. 如請求項10所述的定位方法,在透過該影像擷取單元感測並產生該影像的步驟前,還包括藉由一多重強度照明器朝向該導航標記單元發出亮光,且依據時間變化或一預設頻率動態調整該亮光的一亮度,以獲得該亮度隨時間變化的該影像。The positioning method as described in claim 10, before the step of sensing and generating the image through the image capture unit, also includes emitting light toward the navigation mark unit through a multi-intensity illuminator, and dynamically adjusting the brightness of the light according to time changes or a preset frequency to obtain the image whose brightness changes with time.
TW112139181A 2023-10-13 2023-10-13 Positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition TWI862216B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW112139181A TWI862216B (en) 2023-10-13 2023-10-13 Positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW112139181A TWI862216B (en) 2023-10-13 2023-10-13 Positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition

Publications (2)

Publication Number Publication Date
TWI862216B true TWI862216B (en) 2024-11-11
TW202516152A TW202516152A (en) 2025-04-16

Family

ID=94379891

Family Applications (1)

Application Number Title Priority Date Filing Date
TW112139181A TWI862216B (en) 2023-10-13 2023-10-13 Positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition

Country Status (1)

Country Link
TW (1) TWI862216B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200943998A (en) * 2007-12-18 2009-10-16 Qualcomm Inc Positioning using enhanced pilot signal
TW201829978A (en) * 2017-01-04 2018-08-16 美商高通公司 Systems and methods for using a global positioning system velocity in visual-inertial odometry
US20200158509A1 (en) * 2017-04-27 2020-05-21 Government Of The United States, As Represented By The Secretary Of The Air Force Positioning and navigation systems and methods
US20220171410A1 (en) * 2019-04-18 2022-06-02 Pearls Of Wisdom Advanced Technologies Ltd A uav carrier
CN116560383A (en) * 2023-06-08 2023-08-08 云南电网有限责任公司怒江供电局 An unmanned aerial vehicle mobile terminal control device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200943998A (en) * 2007-12-18 2009-10-16 Qualcomm Inc Positioning using enhanced pilot signal
TW201829978A (en) * 2017-01-04 2018-08-16 美商高通公司 Systems and methods for using a global positioning system velocity in visual-inertial odometry
US20200158509A1 (en) * 2017-04-27 2020-05-21 Government Of The United States, As Represented By The Secretary Of The Air Force Positioning and navigation systems and methods
US20220171410A1 (en) * 2019-04-18 2022-06-02 Pearls Of Wisdom Advanced Technologies Ltd A uav carrier
CN116560383A (en) * 2023-06-08 2023-08-08 云南电网有限责任公司怒江供电局 An unmanned aerial vehicle mobile terminal control device

Also Published As

Publication number Publication date
TW202516152A (en) 2025-04-16

Similar Documents

Publication Publication Date Title
Faessler et al. A monocular pose estimation system based on infrared leds
JP4584213B2 (en) Mobile robot positioning system and method using camera and sign
US9849589B2 (en) Method and system for localizing mobile robot using external surveillance cameras
Chen et al. Qualitative vision-based path following
KR101703177B1 (en) Apparatus and method for recognizing position of vehicle
WO2019128070A1 (en) Target tracking method and apparatus, mobile device and storage medium
CN109992006A (en) A kind of accurate recovery method and system of power patrol unmanned machine
US11577402B2 (en) Robot system and portable teaching device
EP3674830A1 (en) Server and method for controlling laser irradiation of movement path of robot, and robot that moves based thereon
EP3407152B1 (en) Method of controlling a cleaner
JP2012071645A (en) Automatic taking-off and landing system
CN106382930A (en) An indoor AGV wireless navigation method and a device therefor
US10638899B2 (en) Cleaner
CN112819943A (en) Active vision SLAM system based on panoramic camera
CN110879617A (en) Infrared-guided unmanned aerial vehicle landing method and device
KR20190129551A (en) System and method for guiding object for unmenned moving body
WO2018180454A1 (en) Moving body
JP2022012173A (en) Information processing device, information processing system, information processing method, and program
CN104965513A (en) Son hopping robot recovery system and recovery method
WO2021166845A1 (en) Information processing device, information processing method, and program
CN111780715A (en) Visual ranging method
KR100749923B1 (en) Localization system of mobile robot based on camera and landmarks and method there of
TWI862216B (en) Positioning system, autonomous mobile device, motion control system and positioning method based on image visual recognition
JP2002082720A (en) Method for teaching target position of moving object, movement control method, light guiding method, and light guiding system
CN111380535A (en) Navigation method and device based on visual label, mobile machine and readable medium