[go: up one dir, main page]

TWI693560B - Face recognition method - Google Patents

Face recognition method Download PDF

Info

Publication number
TWI693560B
TWI693560B TW107112624A TW107112624A TWI693560B TW I693560 B TWI693560 B TW I693560B TW 107112624 A TW107112624 A TW 107112624A TW 107112624 A TW107112624 A TW 107112624A TW I693560 B TWI693560 B TW I693560B
Authority
TW
Taiwan
Prior art keywords
face
face recognition
recognition method
depth
image
Prior art date
Application number
TW107112624A
Other languages
Chinese (zh)
Other versions
TW201944292A (en
Inventor
許玄岳
黃思翰
Original Assignee
合盈光電科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 合盈光電科技股份有限公司 filed Critical 合盈光電科技股份有限公司
Priority to TW107112624A priority Critical patent/TWI693560B/en
Publication of TW201944292A publication Critical patent/TW201944292A/en
Application granted granted Critical
Publication of TWI693560B publication Critical patent/TWI693560B/en

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Collating Specific Patterns (AREA)

Abstract

本發明有關一種臉部辨識方法,係於一臉部辨識系統偵測到一待測者之臉部後,進行一臉部辨識動作;藉此,本發明之臉部辨識方法主要係藉由深度影像擷取單元擷取使用者臉部之三維影像的硬體設計,搭配以影像處理單元於臉部影像中選取複數個特徵點與兩兩特徵點之間連線線段長度與深度的計算與比對方法,有效完成臉部影像特徵之安全辨識,並可進一步結合三條線段所圍成之三角形面積的計算與比對動作,確實達到更安全且更全面的臉部安全辨識之主要優勢。 The present invention relates to a face recognition method, in which a face recognition system detects a face of a person to be tested, and then performs a face recognition action; thereby, the face recognition method of the present invention mainly uses depth The image capture unit captures the hardware design of the three-dimensional image of the user's face, and uses the image processing unit to select a plurality of feature points in the face image and the calculation and comparison of the length and depth of the connecting line between the two feature points For the method, it can effectively complete the safe recognition of facial image features, and can further combine the calculation and comparison actions of the triangle area enclosed by the three lines, and indeed achieve the main advantage of safer and more comprehensive face safe recognition.

Description

臉部辨識方法 Face recognition method

本發明係有關於一種臉部辨識方法,尤其是指一種藉由深度攝影機進行臉部之影像擷取與複數個特徵點之連線長度與深度之比較以進行臉部辨識的安全監控方法。 The invention relates to a face recognition method, in particular to a safety monitoring method for performing face recognition by using a depth camera to perform facial image capture and compare the connection length and depth of a plurality of feature points.

按,在科技日新月異的今天,智慧城市的形成除了可以佈署綿密的網路與功能強大的控制中心外,亦可有效充分掌握人群的集散動線以提供快速、正確之狀況預防的社會安全監控,例如交通流量的監控方面,在路燈或交通號誌等設置監視系統,甚至是車輛間彼此的資訊交換,透過單一平台的即時監控與管理,可針對諸如交通堵塞、肇事車禍或聚眾犯罪等現場的掌控,有效協助疏散車潮或追蹤罪犯車輛動向等功能;臉部辨識系統是智慧城市中新興的一環,尤其是對於不喜歡攜帶鑰匙出門的人而言,臉部辨識更是一大福音,此乃由於越來越多人的住所係採用自動感應式門禁系統,用以取代原本既有的鑰匙孔門禁設備,確實達到便利性與安全性的提升,只是現行的自動感應式門禁系統多是採用射頻辨識(radio frequency identification,RFID)方式為之,主要係以配備有射頻辨識讀取器(RFID reader)的方式進行,其方法係提供使用者攜帶具有含有射頻辨識標籤(RDID tag)的物件,當使用者讓射頻辨識標籤靠近射頻辨識讀取器時,射頻辨識讀取器即可驗證射頻辨識標籤是否對頻,以決定是否讓使用者進入; 然而,射頻辨識技術最主要的缺點是認卡不認人,仍會存在有許多安全方面的疑慮。 According to the press, with the rapid development of technology, the formation of a smart city can not only deploy a dense network and a powerful control center, but also effectively fully grasp the distribution line of the crowd to provide rapid and correct social security monitoring of situation prevention. For example, in terms of traffic flow monitoring, a monitoring system is set up on street lights or traffic signs, and even the exchange of information between vehicles. Through a single platform of real-time monitoring and management, it can target scenes such as traffic jams, car accidents, or crowd crimes. Control, which effectively assists in the functions of evacuating car tide or tracking criminal vehicle movements; face recognition system is an emerging part of smart city, especially for people who don’t like to carry a key out, face recognition is a big boon, This is because more and more people's residences are using automatic induction access control systems to replace the original keyhole access control equipment, which does achieve convenience and safety. However, most of the current automatic induction access control systems are The radio frequency identification (RFID) method is adopted, which is mainly carried out by a method equipped with a radio frequency identification reader (RFID reader). The method is to provide the user to carry an object with a radio frequency identification tag (RDID tag) When the user brings the RFID tag close to the RFID reader, the RFID reader can verify whether the RFID tag is frequency-matched to determine whether to let the user enter; however, the main disadvantage of the RFID technology is to recognize the card If you don’t recognize people, there will still be many security concerns.

臉部辨識則是目前門禁系統最安全的方式,可有效解決上述射頻辨識技術的缺點;然而,現行之臉部辨識多為2D辨識方式,主要係將立體的人臉以2D的攝影機擷取成一平面資訊,臉部辨識系統僅在2D資訊中尋找可供對照的辨識資料,如此一來,有心人士只要擷取去有相關人臉資料的相片或平面圖等,就可以有效蒙騙2D的臉部辨識系統而同樣達到輕易進出門禁的目的;因此,如何藉由創新的硬體設計,有效結合臉部之平面與立體資訊,以達到更安全且更全面的臉部安全辨識之目的,仍是臉部辨識等相關產業開發業者與相關研究人員需持續努力克服與解決之課題。 Face recognition is currently the most secure method of the access control system, which can effectively solve the shortcomings of the above-mentioned radio frequency identification technology; however, the current face recognition is mostly 2D recognition method, which mainly captures the three-dimensional face with a 2D camera into one Planar information, the facial recognition system only looks for identification data in 2D information that can be compared, so that as long as the interested person retrieves photos or plans with relevant face data, they can effectively deceive 2D facial recognition The system also achieves the goal of easy access to the door; therefore, how to effectively combine the plane and three-dimensional information of the face through innovative hardware design to achieve a safer and more comprehensive face safety identification, is still the face Identification and other related industry developers and related researchers need to continuously strive to overcome and solve the problems.

今,發明人即是鑑於傳統之臉部辨識方法於實際實施時仍存在有諸多缺失,於是乃一本孜孜不倦之精神,並藉由其豐富之專業知識及多年之實務經驗所輔佐,而加以改善,並據此研創出本發明。 Today, the inventor is considering that the traditional face recognition method still has many deficiencies in the actual implementation, so it is a tireless spirit, and it is improved by its rich professional knowledge and many years of practical experience. , And researched and created the invention accordingly.

本發明主要目的為提供一種臉部辨識方法,尤其是指一種藉由深度攝影機進行臉部之影像擷取與複數個特徵點之連線長度與深度之比較以進行臉部辨識的安全監控方法,主要係藉由深度影像擷取單元擷取使用者臉部之三維影像之設計,搭配以影像處理單元於臉部影像中選取複數個特徵點與兩兩特徵點之間連線線段長度與深度的計算與比對方法,有效完成臉部影像特徵之安全辨識,並可進一步結合三條線段所圍成之三角形面積的計算與比對動作,確實達到更安全且更全面的臉部安全辨識之主要優勢者。 The main purpose of the present invention is to provide a face recognition method, in particular to a security monitoring method for face recognition by using a depth camera to perform facial image capture and compare the connection length and depth of a plurality of feature points, It is mainly designed by the depth image capturing unit to capture the three-dimensional image of the user's face, and the image processing unit is used to select a plurality of feature points in the facial image and the length and depth of the connecting line segment between the two feature points The calculation and comparison method can effectively complete the safe identification of facial image features, and can further combine the calculation and comparison actions of the triangle area enclosed by the three lines, and indeed achieve the main advantages of safer and more comprehensive face safe identification By.

為了達到上述之實施目的,本發明人乃研擬如下實施技術,其中本發明之臉部辨識方法係於一臉部辨識系統偵測到一待測者之臉部後,進行一臉部辨識動作;首先,使用一深度影像擷取單元進行一原始臉部之影像擷取;接著,使用一影像處理單元內建之選取模組於原始臉部之影像中選取複數個第一特徵點,並分別計算第一特徵點與深度影像擷取單元之間的第一距離值;接續,使用影像處理單元內建之長度計算模組連接兩兩第一特徵點以獲得複數條第一線段,並分別計算第一線段之長度以獲取複數個第一長度值,以及計算兩兩連線之第一特徵點的第一距離值之間的第一深度差值;接著,將具有第一特徵點、第一線段、第一長度值,以及第一深度差值之原始臉部的影像儲存於一儲存單元中;接續,重複上述步驟,使用深度影像擷取單元擷取一待測臉部之影像,並獲得待測臉部上複數個對應第一特徵點之位置的第二特徵點、複數個由第二特徵點所連接之第二線段與第二長度值,以及複數個第二距離值與第二深度差值,並儲存於儲存單元中;之後,使用一比對單元比對第一長度值與對應之第二長度值,以及第一深度差值與對應之第二深度差值;最後,當第一長度值與對應之第二長度值之間的差異,以及第一深度差值與對應之第二深度差值之間的差異介於一誤差範圍時,則待測臉部係與原始臉部相同。 In order to achieve the above-mentioned implementation objectives, the present inventors have devised the following implementation techniques, in which the face recognition method of the present invention performs a face recognition action after a face recognition system detects the face of a person to be tested ; First, use a depth image capture unit to capture an image of the original face; then, use a built-in selection module of the image processing unit to select a plurality of first feature points from the original face image, and separately Calculate the first distance between the first feature point and the depth image capture unit; then, use the built-in length calculation module of the image processing unit to connect two or two first feature points to obtain a plurality of first line segments, and respectively Calculate the length of the first line segment to obtain a plurality of first length values, and calculate the first depth difference between the first distance values of the first feature points of the two links; then, the first feature points, The original face image of the first line segment, the first length value, and the first depth difference value is stored in a storage unit; then, repeat the above steps to use the depth image capture unit to capture an image of the face to be measured And obtain a plurality of second feature points corresponding to the position of the first feature point on the face to be tested, a plurality of second line segments connected by the second feature point and a second length value, and a plurality of second distance values and The second depth difference value is stored in the storage unit; thereafter, the first length value and the corresponding second length value are compared using a comparison unit, and the first depth difference value and the corresponding second depth difference value; finally , When the difference between the first length value and the corresponding second length value, and the difference between the first depth difference and the corresponding second depth difference are within an error range, the face to be tested is The original face is the same.

如上所述的臉部辨識方法,其中深度影像擷取單元係為TOF攝影機或雙鏡頭攝影機等其中之一種裝置。 The face recognition method as described above, wherein the depth image capturing unit is one of a device such as a TOF camera or a dual-lens camera.

如上所述的臉部辨識方法,其中當深度影像擷取單元係為TOF攝影機時,深度影像擷取單元係至少包括有一發光模組、一接收模組,以及一影像擷取模組。 The face recognition method as described above, wherein when the depth image capturing unit is a TOF camera, the depth image capturing unit at least includes a light emitting module, a receiving module, and an image capturing module.

如上所述的臉部辨識方法,其中發光模組係發射複數個光斑於原始臉部或待測臉部上。 The face recognition method as described above, wherein the light emitting module emits a plurality of light spots on the original face or the face to be tested.

如上所述的臉部辨識方法,其中接收模組係接收複數個由原始臉部或待測臉部反射之反射光斑,並傳遞至影像處理單元。 The face recognition method as described above, wherein the receiving module receives a plurality of reflected light spots reflected by the original face or the face to be measured, and transmits them to the image processing unit.

如上所述的臉部辨識方法,其中影像擷取模組係包括有一第一光學鏡頭,以及一與第一光學鏡頭連接之第一感光元件,第一光學鏡頭係擷取原始臉部或待測臉部之影像於第一感光元件上成像。 The face recognition method as described above, wherein the image capturing module includes a first optical lens, and a first photosensitive element connected to the first optical lens, the first optical lens captures the original face or to-be-measured The image of the face is formed on the first photosensitive element.

如上所述的臉部辨識方法,其中第一光學鏡頭係為魚眼鏡頭、廣角鏡頭或標準鏡頭等其中之一種裝置。 In the face recognition method described above, the first optical lens is a device such as a fisheye lens, a wide-angle lens, or a standard lens.

如上所述的臉部辨識方法,其中第一感光元件係為光電耦合元件(Charge Coupled Device,CCD)或互補金屬氧化物半導體(Complementary Metal-Oxide-Semiconductor,CMOS)等其中之一種裝置。 In the face recognition method as described above, the first photosensitive element is one of a photocoupler (Charge Coupled Device, CCD) or a complementary metal oxide semiconductor (Complementary Metal-Oxide-Semiconductor, CMOS) and other devices.

如上所述的臉部辨識方法,其中當深度影像擷取單元係為雙鏡頭攝影機時,深度影像擷取單元係包括有二第二光學鏡頭,以及一分別與第二光學鏡頭連接之第二感光元件,第二光學鏡頭係同時擷取原始臉部或待測臉部之影像於第二感光元件上成像。 The face recognition method as described above, wherein when the depth image capturing unit is a dual-lens camera, the depth image capturing unit includes two second optical lenses and a second light sensor respectively connected to the second optical lenses Component, the second optical lens simultaneously captures the image of the original face or the face to be tested and forms an image on the second photosensitive element.

如上所述的臉部辨識方法,其中第二光學鏡頭係為魚眼鏡頭、廣角鏡頭或標準鏡頭等其中之一種裝置。 In the face recognition method as described above, the second optical lens is a device such as a fisheye lens, a wide-angle lens, or a standard lens.

如上所述的臉部辨識方法,其中第二感光元件係為光電耦合元件(CCD)或互補金屬氧化物半導體(CMOS)等其中之一種裝置。 In the face recognition method as described above, the second photosensitive element is one of photoelectric coupling element (CCD) or complementary metal oxide semiconductor (CMOS).

如上所述的臉部辨識方法,其中誤差範圍係介於98%~100%之間。 The face recognition method as described above, wherein the error range is between 98% and 100%.

如上所述的臉部辨識方法,其中於儲存原始臉部影像之前係可進一步使用一內建於影像處理單元之面積計算模組計算由三條第一線段所圍成之第一三角形的第一面積值,以及第一面積值加總之第一總面積值。 The face recognition method as described above, wherein an area calculation module built in the image processing unit can be further used to calculate the first triangle of the first triangle enclosed by the three first line segments before storing the original face image The area value, and the first area value plus the first total area value.

如上所述的臉部辨識方法,其中於比對第一長度值與對應之第二長度值之後係可進一步使用面積計算模組計算由三條第二線段所圍成之第二三角形的第二面積值,以及第二面積值加總之第二總面積值。 The face recognition method as described above, wherein after comparing the first length value with the corresponding second length value, the area calculation module can be further used to calculate the second area of the second triangle enclosed by the three second line segments Value, and the second total area value plus the second total area value.

如上所述的臉部辨識方法,其中面積計算模組係使用一海龍公式計算第一面積值或第二面積值。 The face recognition method as described above, wherein the area calculation module uses a Hailong formula to calculate the first area value or the second area value.

如上所述的臉部辨識方法,其中於最後一步驟完成之後係可進一步使用比對單元比對第一總面積值與第二總面積值,若第一總面積值與第二總面積值之間的差異介於誤差範圍時,則待測臉部係與原始臉部相同。 The face recognition method as described above, wherein after the last step is completed, the first total area value and the second total area value can be further compared using the comparison unit, if the first total area value and the second total area value are When the difference between is within the error range, the face to be tested is the same as the original face.

藉此,本發明之臉部辨識方法主要係藉由深度影像擷取單元擷取使用者臉部之三維影像之設計,搭配以影像處理單元於臉部影像中選取複數個特徵點與兩兩特徵點之間連線線段長度與深度的計算與比對方法,有效完成臉部影像特徵之安全辨識,並可進一步結合三條線段所圍成之三角形面積的計算與比對動作,確實達到更安全且更全面的臉部安全辨識之主要優勢;此外,本發明之臉部辨識方法主要係藉由TOF攝影機擷取人臉之五官等複數個特徵點與特徵點之間的深度差異,以作為臉部辨識的其中一個重要依據,可有效解決有心人士以具有相同人臉之相片或平面圖蒙騙二維臉部辨識系統之缺點,確實達到更安全而難以破解的臉部辨識之系統與方法等主要優勢;再者,本發明之臉部辨識方法主要係藉由比對臉部 上之特徵點的深度值、連接線長度,以及連接線所圍成之三角形面積等複數種比對標的,以增加臉部辨識之準確性,確實達到準確辨識以重視安全考量之主要目的;最後,本發明之臉部辨識方法主要係藉由深度影像擷取單元擷取人臉之三維特徵,讓使用者以不同的角度面對深度影像擷取單元之臉部影像擷取時,臉部辨識系統皆可準確給定臉部特徵點之深度差值,有效解決傳統臉部辨識系統因角度不正確而有判斷失誤之缺點,確實達到大幅減少臉部辨識時間之主要優勢。 In this way, the face recognition method of the present invention is mainly designed by the depth image capturing unit to capture the three-dimensional image of the user's face, combined with the image processing unit to select a plurality of feature points and two two features in the face image The calculation and comparison method of the length and depth of the connecting line between points effectively completes the safe identification of facial image features, and can further combine the calculation and comparison of the area of the triangle enclosed by the three lines, which is indeed more secure and The main advantage of a more comprehensive face safety recognition; in addition, the face recognition method of the present invention mainly uses the TOF camera to capture the depth difference between a plurality of feature points such as facial features of the face and the feature points as the face One of the important basis of recognition can effectively solve the shortcomings of the two-dimensional face recognition system that intentional people deceive the two-dimensional face recognition system with photos or floor plans of the same face, and indeed achieve the main advantages of a safer and more difficult face recognition system and method; Furthermore, the face recognition method of the present invention is mainly to compare the depth value of the feature points on the face, the length of the connecting line, and the triangle area enclosed by the connecting line to increase the face recognition The accuracy of the method really achieves the main purpose of accurate recognition to pay attention to safety considerations. Finally, the face recognition method of the present invention mainly uses the depth image capture unit to capture the three-dimensional features of the human face, allowing the user to face at different angles. When capturing the face image of the depth image capturing unit, the face recognition system can accurately give the depth difference value of the facial feature points, which effectively solves the shortcomings of the traditional face recognition system because of the incorrect angle. It does achieve the main advantage of significantly reducing the time of facial recognition.

(1)‧‧‧臉部辨識系統 (1)‧‧‧Face recognition system

(11)‧‧‧深度影像擷取單元 (11)‧‧‧Depth image capture unit

(111)‧‧‧發光模組 (111)‧‧‧Lighting module

(112)‧‧‧接收模組 (112)‧‧‧Receiving module

(113)‧‧‧影像擷取模組 (113)‧‧‧Image capture module

(1131)‧‧‧第一光學鏡頭 (1131)‧‧‧First optical lens

(12)‧‧‧影像處理單元 (12)‧‧‧Image processing unit

(121)‧‧‧選取模組 (121)‧‧‧Select module

(122)‧‧‧長度計算模組 (122)‧‧‧Length calculation module

(123)‧‧‧面積計算模組 (123)‧‧‧ Area calculation module

(13)‧‧‧儲存單元 (13)‧‧‧Storage unit

(14)‧‧‧比對單元 (14)‧‧‧Comparison unit

(2)‧‧‧ROI範圍 (2)‧‧‧ROI range

(3)‧‧‧待測者 (3)‧‧‧ subject

(A)‧‧‧原始臉部 (A)‧‧‧ original face

(A1)‧‧‧第一特徵點 (A1)‧‧‧First characteristic point

(A2)‧‧‧第一線段 (A2)‧‧‧The first line

(Ae1)‧‧‧第一面積值 (Ae1)‧‧‧First area value

(Ae2)‧‧‧第二面積值 (Ae2)‧‧‧Second area value

(B)‧‧‧待測臉部 (B) ‧‧‧ face to be tested

(B1)‧‧‧第二特徵點 (B1)‧‧‧Second characteristic point

(B2)‧‧‧第二線段 (B2)‧‧‧Second line

(L1)‧‧‧第一長度值 (L1)‧‧‧First length value

(L2)‧‧‧第二長度值 (L2)‧‧‧Second length value

(T1)‧‧‧第一三角形 (T1)‧‧‧The first triangle

(T2)‧‧‧第二三角形 (T2)‧‧‧Second Triangle

(S1)‧‧‧步驟一 (S1)‧‧‧Step 1

(S2)‧‧‧步驟二 (S2)‧‧‧Step 2

(S3)‧‧‧步驟三 (S3)‧‧‧Step 3

(S4)‧‧‧步驟四 (S4)‧‧‧Step 4

(S5)‧‧‧步驟五 (S5)‧‧‧Step 5

(S6)‧‧‧步驟六 (S6)‧‧‧Step 6

(S7)‧‧‧步驟七 (S7)‧‧‧Step 7

第1圖:本發明臉部辨識方法之步驟流程圖 Figure 1: Flow chart of the steps of the face recognition method of the present invention

第2圖:本發明臉部辨識方法所使用之臉部辨識系統硬體架構示意圖 Figure 2: Schematic diagram of the hardware architecture of the face recognition system used in the face recognition method of the present invention

第3圖:本發明臉部辨識方法其一較佳實施例之特徵點選取示意圖 Figure 3: Schematic diagram of feature point selection in a preferred embodiment of the face recognition method of the present invention

第4圖:本發明臉部辨識方法其一較佳實施例之線段連接示意圖 Figure 4: Schematic diagram of line connection of a preferred embodiment of the face recognition method of the present invention

第5圖:本發明臉部辨識方法其一較佳實施例之待測臉部辨識示意圖 Figure 5: Schematic diagram of facial recognition to be tested according to a preferred embodiment of the facial recognition method of the present invention

為利 貴審查委員瞭解本發明之技術特徵、內容、優點,以及其所能達成之功效,茲將本發明配合附圖,並以實施例之表達形式詳細說明如下,而其中所使用之圖式,其主旨僅為示意及輔助說明書之用,未必為本發明實施後之真實比例與精準配置,故不應就所附之圖式的比例與配置關係解讀、侷限本發明於實際實施上的權利範圍,合先敘明。 In order to facilitate your examination committee to understand the technical features, content, advantages and achievable effects of the present invention, the present invention is described in detail in conjunction with the drawings and in the form of expressions of the embodiments, and the drawings used therein, Its purpose is only for illustration and supplementary description, and may not be the true scale and precise configuration after the implementation of the present invention, so it should not be interpreted and limited to the relationship between the scale and the configuration of the attached drawings, and the scope of the present invention in the actual implementation is limited , He Xianming.

首先,請參閱第1圖與第2圖所示,為本發明臉部辨識方法之步驟流程圖,以及所使用之臉部辨識系統硬體架構示意圖,其中本發明之 臉部辨識方法應用之領域係可例如但不限定為出入口門禁之臉部辨識使用,其做法係先使用一臉部辨識系統(1)於一儲存單元(13)中建立一供臉部辨識使用的辨識模型;接著,當臉部辨識系統(1)於一ROI範圍(2)中偵測到一待測者(3)之臉部後,即啟動待測者(3)之臉部與預先儲存之辨識模型間的比對動作,若比對之成功率介於一誤差範圍內時,即開啟出入口供待測者(3)出入;本發明之臉部辨識方法主要包括有下列步驟:步驟一(S1):使用一深度影像擷取單元(11)進行一原始臉部(A)之影像擷取;此外,深度影像擷取單元(11)係為TOF攝影機或雙鏡頭攝影機等其中之一種裝置,而當深度影像擷取單元(11)係為TOF攝影機時,深度影像擷取單元(11)係至少包括有一發光模組(111)、一接收模組(112),以及一影像擷取模組(113),其中發光模組(111)係發射複數個光斑於原始臉部(A)上,而接收模組(112)係接收複數個由原始臉部(A)反射之反射光斑,並傳遞至影像處理單元(12),而影像擷取模組(113)係包括有一第一光學鏡頭(1131),以及一與第一光學鏡頭(1131)連接之第一感光元件(1132),而第一光學鏡頭(1131)係擷取原始臉部(A)之影像於第一感光元件(1132)上成像,其中第一光學鏡頭(1131)係為魚眼鏡頭、廣角鏡頭或標準鏡頭等其中之一種裝置,而第一感光元件(1132)係為光電耦合元件(CCD)或互補金屬氧化物半導體(CMOS)等其中之一種裝置;在本發明其一較佳實施例中,由於執行臉部辨識必須先建立供辨識之模型,故本案發明係使用以TOF攝影機態樣呈現的深度影像擷取單元(11)擷取待測者(3)的臉部影像,此臉部影像即稱之為原始臉部(A)影像,主要係藉由內建於TOF攝影機且以魚眼鏡頭態樣呈現之第一光學鏡頭(1131)擷取原始臉部(A)之影像於以光電耦合元件(CCD)態樣呈現 的第一感光元件(1132)上成像;步驟二(S2):使用一影像處理單元(12)內建之選取模組(121)於原始臉部(A)之影像中選取複數個第一特徵點(A1),並分別計算第一特徵點(A1)與深度影像擷取單元(11)之間的第一距離值;請一併參閱第2圖與第3圖所示之本發明臉部辨識方法其一較佳實施例之特徵點選取示意圖,其中影像處理單元(12)係電性連接深度影像擷取單元(11),而內建於影像處理單元(12)之選取模組(121)係於原始臉部(A)之五官等11個位置各設定第一特徵點(A1),並分別計算11個第一特徵點(A1)與深度影像擷取單元(11)之間的第一距離值,此第一距離值即為第一特徵點(A1)的深度值;步驟三(S3):使用影像處理單元(12)內建之長度計算模組(122)連接兩兩第一特徵點(A1)以獲得複數條第一線段(A2),並分別計算第一線段(A2)之長度以獲取複數個第一長度值(L1),以及計算兩兩連線之第一特徵點(A1)的第一長度值(L1)之間的第一深度差值(De1);請再一併參閱第2圖與第4圖所示之本發明臉部辨識方法其一較佳實施例之線段連接示意圖,其中使用影像處理單元(12)內建之長度計算模組(122)將兩兩第一特徵點(A1)以第一線段(A2)相互連接,11個第一特徵點(A1)之間相互連接可獲得20條第一線段(A2),而長度計算模組(122)則分別計算此20條第一線段(A2)的第一長度值(L1),再依相互連線之第一特徵點(A1)所各自具備之深度值計算兩者的深度值差異,此即為第一深度差值;然而必須注意的是,上述第一特徵點(A1)的個數與第一特徵點(A1)相互連接之第一線段(A2)的數量,是為了說明方便起見,而非以本發明所舉為限,且熟知此技藝者當知道不同的第一特徵點(A1)的個數與第一特徵點(A1)相互連接之第一線段(A2)的數 量,只要可以讓臉部辨識系統(1)進行第一線段(A2)之長度與第一深度差值(De1)之計算,皆可視為本發明之技術特徵的延伸,並不會影像本發明的實際實施;步驟四(S4):將具有第一特徵點(A1)、第一線段(A2)、第一長度值(L1),以及第一深度差值之原始臉部(A)的影像儲存於一儲存單元(13)中;在本發明其一較佳實施例中,儲存單元(13)係電性連接影像處理單元(12),由上述步驟所獲得的原始臉部(A)影像,以及包含於原始臉部(A)的第一特徵點(A1)、第一線段(A2)、第一長度值(L1),以及第一深度差值之資訊係全部儲存於儲存單元(13)中,即可作為出入口門禁之臉部辨識的辨識模型使用;步驟五(S5):重複步驟一(S1)至步驟三(S3),使用深度影像擷取單元(11)擷取一待測臉部(B)之影像,並獲得待測臉部(B)上複數個對應第一特徵點(A1)之位置的第二特徵點(B1)、複數個由第二特徵點(B1)所連接之第二線段(B2)與第二長度值(L2),以及複數個第二距離值與第二深度差值,並儲存於儲存單元(13)中;請一併參閱第2圖與第5圖所示之本發明臉部辨識方法其一較佳實施例之待測臉部辨識示意圖,其中於步驟一(S1)至步驟三(S3)之原始臉部(A)影像辨識模型建立完成後,當待測者(3)欲進出出入口而須進行臉部辨識時,深度影像擷取單元(11)即擷取其臉部影像,此臉部影像即稱之為待測臉部(B)影像;接著,選取模組(121)係於待測臉部(B)之五官以對應第一特徵點(A1)之11個位置各設定第二特徵點(B1),並分別計算11個第二特徵點(B1)與深度影像擷取單元(11)之間的第二距離值,此第二距離值即為第二特徵點(B1)的深度值;接續,長度計算模組(122)即將兩兩第二 特徵點(B1)以第二線段(B2)相互連接,以11個第二特徵點(B1)之間的相互連接係可獲得20條第二線段(B2),而長度計算模組(122)再分別計算此20條第二線段(B2)的第二長度值(L2);接著,依相互連線之第二特徵點(B1)所各自具備的深度值計算兩者的深度值差異,此即為第二深度差值;最後,將具有第二特徵點(B1)、第二線段(B2)、第二長度值(L2),以及第二深度差值之待測臉部(B)的影像儲存於儲存單元(13)中;步驟六(S6):使用一比對單元(14)比對第一長度值(L1)與對應之第二長度值(L2),以及該等第一深度差值與對應之第二深度差值;在本發明其一較佳實施例中,與影像處理單元(12)電性連接之比對單元(14)進行第一長度值(L1)與對應之第二長度值(L2)的比對動作,以及第一深度差值與對應之第二深度差值之比對動作,請再一次參閱第4圖與第5圖所示,第4圖中C點之第一特徵點(A1)與D點之第一特徵點(A1)之間所連接之第一線段(A2)的第一長度值(L1),即可與第5圖中同為C點之第二特徵點(B1)到D點之第二特徵點(B1)之間所連接之第二線段(B2)的第二長度值(L2)相互比較;以及步驟七(S7):當第一長度值(L1)與對應之第二長度值(L2)之間的差異,以及第一深度差值與對應之第二深度差值之間的差異介於一誤差範圍時,則待測臉部(B)係與原始臉部(A)相同;此外,誤差範圍係介於98%~100%之間;在本發明其一較佳實施例中,當比對單元(14)比對之第一長度值(L1)與對應之第二長度值(L2)的差異,以及第一深度差值與對應之第二深度差值的差異介於98%~100%之間時,即代表待測臉部(B)與原始臉部(A)係為同一個人臉,則臉部辨識成功並允許待測者(3)進出出入口。 First of all, please refer to Figures 1 and 2, which are flowcharts of the steps of the face recognition method of the present invention, and a schematic diagram of the hardware architecture of the face recognition system used, in which the field of the face recognition method of the present invention is applied It can be used, for example, but not limited to, face recognition for entrance and exit. The approach is to first use a face recognition system (1) to create a recognition model for face recognition in a storage unit (13); then, when After the face recognition system (1) detects the face of a person under test (3) in an ROI range (2), the ratio between the face of the person under test (3) and the pre-stored recognition model is activated For the action, if the success rate of the comparison is within an error range, the entrance is opened for the person to be tested (3) to enter; the face recognition method of the present invention mainly includes the following steps: Step 1 (S1): Use a The depth image capture unit (11) captures an image of the original face (A); in addition, the depth image capture unit (11) is a device such as a TOF camera or a dual-lens camera. When the fetching unit (11) is a TOF camera, the depth image capturing unit (11) at least includes a light emitting module (111), a receiving module (112), and an image capturing module (113), wherein The light emitting module (111) emits a plurality of light spots on the original face (A), and the receiving module (112) receives a plurality of reflected light spots reflected by the original face (A) and transmits them to the image processing unit ( 12), and the image capturing module (113) includes a first optical lens (1131), and a first photosensitive element (1132) connected to the first optical lens (1131), and the first optical lens (1131) ) Is to capture the image of the original face (A) and image it on the first photosensitive element (1132), where the first optical lens (1131) is one of fisheye lens, wide-angle lens or standard lens and other devices, and the first The photosensitive element (1132) is one of photoelectric coupling element (CCD) or complementary metal oxide semiconductor (CMOS) and other devices. In a preferred embodiment of the present invention, since face recognition must be established for recognition Therefore, the invention in this case uses the depth image capturing unit (11) presented in the form of a TOF camera to capture the face image of the person under test (3). This face image is called the original face (A) image. , Mainly by the first optical lens (1131) built in the TOF camera and presented in the form of a fisheye lens to capture the image of the original face (A) in the first presented in the form of a photoelectric coupling device (CCD) Imaging on the photosensitive element (1132); step two (S2): using a built-in selection module (121) of the image processing unit (12) to select a plurality of first feature points (A1) from the image of the original face (A) ), and calculate the first distance between the first feature point (A1) and the depth image capture unit (11); please refer to the face recognition method of the present invention shown in Figure 2 and Figure 3 Features of a preferred embodiment Selection schematic diagram, in which the image processing unit (12) is electrically connected to the depth image capturing unit (11), and the selection module (121) built in the image processing unit (12) is the facial features of the original face (A) Set the first feature point (A1) for each of 11 positions, and calculate the first distance between the 11 first feature points (A1) and the depth image capturing unit (11) respectively. This first distance value is The depth value of the first feature point (A1); Step three (S3): Use the built-in length calculation module (122) of the image processing unit (12) to connect two or two first feature points (A1) to obtain a plurality of first Line segment (A2), and calculate the length of the first line segment (A2) to obtain a plurality of first length values (L1), and calculate the first length value of the first feature point (A1) of the two lines ( L1) the first depth difference (De1); please also refer to the line segment connection diagram of a preferred embodiment of the face recognition method of the present invention shown in FIGS. 2 and 4 together, in which image processing is used The built-in length calculation module (122) of the unit (12) connects the two first feature points (A1) with the first line segment (A2), and 11 first feature points (A1) can be connected to each other 20 first line segments (A2), and the length calculation module (122) respectively calculates the first length value (L1) of the 20 first line segments (A2), and then connects the first feature points according to each other (A1) The depth value of each is used to calculate the difference between the two depth values, which is the first depth difference; however, it must be noted that the number of first feature points (A1) and the first feature point (A1) ) The number of the first line segments (A2) connected to each other is for convenience of description, and is not limited to the present invention, and those skilled in the art should know the number of different first feature points (A1) The number of first line segments (A2) connected to the first feature point (A1) as long as the facial recognition system (1) can perform the length difference between the first line segment (A2) and the first depth (De1) The calculations can be regarded as an extension of the technical features of the present invention, and will not reflect the actual implementation of the present invention; Step 4 (S4): will have a first feature point (A1), a first line segment (A2), the first The length value (L1) and the image of the original face (A) of the first depth difference are stored in a storage unit (13); in a preferred embodiment of the invention, the storage unit (13) is electrically Connect the image processing unit (12), the original face (A) image obtained by the above steps, and the first feature point (A1), the first line segment (A2), the first included in the original face (A) The length value (L1) and the first depth difference information are all stored in the storage unit (13), which can be used as a recognition model for face recognition at the entrance and exit; step five (S5): repeat step one (S1) ) To step 3 (S3), use the depth image capturing unit (11) to capture an image of the face (B) to be tested, and obtain a plurality of corresponding first feature points (A1) on the face (B) to be tested Of The second feature point (B1) of the position, the plurality of second line segments (B2) and the second length value (L2) connected by the second feature point (B1), and the plurality of second distance values and the second depth difference Value, and stored in the storage unit (13); please also refer to the face recognition schematic diagram of a preferred embodiment of the face recognition method of the present invention shown in FIG. 2 and FIG. 5 (S1) to step three (S3) after the creation of the original face (A) image recognition model is completed, when the person to be tested (3) wants to enter the entrance and exit and must perform face recognition, the depth image acquisition unit (11) is Capture its facial image, this facial image is called the face (B) image to be tested; then, select the module (121) to the facial features of the face (B) to be tested to correspond to the first feature point ( Set the second feature points (B1) for each of the 11 positions of A1), and calculate the second distance between the 11 second feature points (B1) and the depth image capturing unit (11) respectively. It is the depth value of the second feature point (B1); then, the length calculation module (122) connects the two second feature points (B1) with the second line segment (B2) to each other with 11 second feature points ( The interconnection between B1) can obtain 20 second line segments (B2), and the length calculation module (122) separately calculates the second length values (L2) of the 20 second line segments (B2); then, Calculate the difference between the two depth values according to the depth values of the second feature points (B1) connected to each other, this is the second depth difference; finally, there will be a second feature point (B1), a second line segment (B2), the second length value (L2), and the second depth difference value of the image of the face (B) to be measured are stored in the storage unit (13); Step 6 (S6): using a comparison unit (14 ) Compare the first length value (L1) with the corresponding second length value (L2), and the first depth difference and the corresponding second depth difference; in a preferred embodiment of the present invention, and The image processing unit (12) electrically connected comparison unit (14) performs a comparison operation of the first length value (L1) and the corresponding second length value (L2), and the first depth difference value and the corresponding second For the comparison operation of the depth difference, please refer to Figure 4 and Figure 5 again, between the first characteristic point (A1) at point C and the first characteristic point (A1) at point D in Figure 4 The first length value (L1) of the connected first line segment (A2) can be the same as the second feature point (B1) from point C to the second feature point (B1) of point D in Figure 5 The second length value (L2) of the connected second line segment (B2) is compared with each other; and Step 7 (S7): When the difference between the first length value (L1) and the corresponding second length value (L2), And when the difference between the first depth difference and the corresponding second depth difference is within an error range, the face to be measured (B) is the same as the original face (A); in addition, the error range is between 98%~100%; in a preferred embodiment of the present invention, when the comparison unit (14) compares the first The difference between a length value (L1) and the corresponding second length value (L2), and the difference between the first depth difference and the corresponding second depth difference is between 98% and 100% The face (B) and the original face (A) are the same person's face, then the face recognition is successful and the subject (3) is allowed to enter and exit.

此外,於步驟四(S4)儲存原始臉部(A)影像之前係可進一步使用一內建於影像處理單元(12)之面積計算模組(123)計算由三條第一線段(A2)所圍成之第一三角形(T1)的第一面積值(Ae1),以及第一面積值(Ae1)加總之第一總面積值;再者,於步驟六(S6)完成之後係可進一步使用面積計算模組(123)計算由三條第二線段(B2)所圍成之第二三角形(T2)的第二面積值(Ae2),以及第二面積值(Ae2)加總之第二總面積值;此外,面積計算模組(123)係使用一海龍公式計算第一面積值(Ae1)與第二面積值(Ae2);再者,於步驟七(S7)完成之後係可進一步使用比對單元(14)比對第一總面積值與第二總面積值,若第一總面積值與第二總面積值之間的差異介於誤差範圍時,則待測臉部(B)係與原始臉部(A)相同;請再一次參閱第4圖與第5圖所示,由三條第一線段(A2)所圍成之第一三角形(T1)係經由海龍公式而計算出第一面積值(Ae1),而20條第一線段(A2)所圍成之10個第一三角形(T1)的第一面積值(Ae1)總和則為第一總面積值;相同的,於待測臉部(B)影像中亦可計算出第二面積值(Ae2)與第二總面積值,接續在步驟七(S7)之後繼續比對第一總面積值與第二總面積值,若比對之誤差介於98%~100%之誤差範圍內,則代表待測臉部(B)與原始臉部(A)係為同一個人臉,以允許待測者(3)進出出入口。 In addition, before storing the original face (A) image in step 4 (S4), an area calculation module (123) built in the image processing unit (12) may be used to calculate the three first line segments (A2). The first area value (Ae1) of the enclosed first triangle (T1), and the first total area value added by the first area value (Ae1); in addition, the area can be further used after step 6 (S6) is completed The calculation module (123) calculates the second area value (Ae2) of the second triangle (T2) enclosed by the three second line segments (B2), and the second total area value added by the second area value (Ae2); In addition, the area calculation module (123) uses a sea dragon formula to calculate the first area value (Ae1) and the second area value (Ae2); furthermore, after the completion of step seven (S7), the comparison unit (123) can be further used ( 14) Compare the first total area value with the second total area value. If the difference between the first total area value and the second total area value is within the error range, the face to be measured (B) is the original face Part (A) is the same; please refer to Figures 4 and 5 again. The first triangle (T1) enclosed by three first line segments (A2) is calculated by the Hailong formula. (Ae1), and the sum of the first area values (Ae1) of the 10 first triangles (T1) enclosed by the 20 first line segments (A2) is the first total area value; the same is applied to the face to be measured Part (B) images can also calculate the second area value (Ae2) and the second total area value, and then continue to compare the first total area value and the second total area value after step 7 (S7). The error is within the range of 98%~100%, which means that the face to be tested (B) and the original face (A) are the same human face, allowing the person to be tested (3) to enter and exit.

再者,當深度影像擷取單元(11)係為雙鏡頭攝影機時,深度影像擷取單元(11)係包括有二第二光學鏡頭(圖式未標示),以及一分別與第二光學鏡頭連接之第二感光元件(圖式未標示),第二光學鏡頭係同時擷取原始臉部(A)或待測臉部(B)之影像於第二感光元件上成像;與其一較佳實施例相同,雙鏡頭攝影機亦可獲得第一特徵點(A1)與第二特徵點(B1)之深度值,同樣可以達到臉部辨識之功能。 Furthermore, when the depth image capturing unit (11) is a dual-lens camera, the depth image capturing unit (11) includes two second optical lenses (not shown in the figure), and one separate from the second optical lens The connected second photosensitive element (not shown in the figure), the second optical lens simultaneously captures the image of the original face (A) or the face to be tested (B) and forms an image on the second photosensitive element; and a preferred implementation thereof In the same example, the dual-lens camera can also obtain the depth values of the first feature point (A1) and the second feature point (B1), which can also achieve the function of face recognition.

由上述之實施說明可知,本發明之臉部辨識方法與現有技術相較之下,本發明係具有以下優點: It can be seen from the above implementation description that the face recognition method of the present invention has the following advantages compared with the prior art:

1.本發明之臉部辨識方法主要係藉由深度影像擷取單元擷取使用者臉部之三維影像之設計,搭配以影像處理單元於臉部影像中選取複數個特徵點與兩兩特徵點之間連線線段長度與深度的計算與比對方法,有效完成臉部影像特徵之安全辨識,並可進一步結合三條線段所圍成之三角形面積的計算與比對動作,確實達到更安全且更全面的臉部安全辨識之主要優勢。 1. The face recognition method of the present invention is mainly designed by the depth image capturing unit to capture the three-dimensional image of the user's face, and the image processing unit is used to select a plurality of feature points and two or two feature points in the face image The calculation and comparison method of the length and depth of the connecting line segment can effectively complete the safe identification of facial image features, and can further combine the calculation and comparison of the triangle area enclosed by the three line segments, which is indeed safer and more The main advantage of comprehensive face recognition.

2.本發明之臉部辨識方法主要係藉由TOF攝影機擷取人臉之五官等複數個特徵點與特徵點之間的深度差異,以作為臉部辨識的其中一個重要依據,可有效解決有心人士以具有相同人臉之相片或平面圖蒙騙二維臉部辨識系統之缺點,確實達到更安全而難以破解的臉部辨識之系統與方法等主要優勢。 2. The face recognition method of the present invention mainly uses the TOF camera to capture the depth difference between a plurality of feature points and feature points of the facial features of the face, as one of the important basis of face recognition, which can effectively solve the intentional person The use of photos or plans with the same human face to deceive the shortcomings of the two-dimensional face recognition system does indeed achieve the main advantages of a safer and more difficult-to-decipher face recognition system and method.

3.本發明之臉部辨識方法主要係藉由比對臉部上之特徵點的深度值、連接線長度,以及連接線所圍成之三角形面積等複數種比對標的,以增加臉部辨識之準確性,確實達到準確辨識以重視安全考量之主要目的。 3. The face recognition method of the present invention is mainly to compare the depth value of the feature points on the face, the length of the connecting line, and the triangle area enclosed by the connecting line, etc. to increase the face recognition. Accuracy does indeed achieve the main purpose of accurate identification to attach importance to safety considerations.

4.本發明之臉部辨識方法主要係藉由深度影像擷取單元擷取人臉之三維特徵,讓使用者以不同的角度面對深度影像擷取單元之臉部影像擷取時,臉部辨識系統皆可準確給定臉部特徵點之深度差值,有效解決傳統臉部辨識系統因角度不正確而有判斷失誤之缺點,確實達到大幅減少臉部辨識時間之主要優勢。 4. The face recognition method of the present invention mainly uses the depth image capturing unit to capture the three-dimensional features of the human face, allowing the user to face the face image of the depth image capturing unit at different angles. Recognition systems can accurately give the depth difference of facial feature points, effectively solving the shortcomings of traditional facial recognition systems due to incorrect angles and misjudgments, and indeed achieving the main advantage of greatly reducing facial recognition time.

綜上所述,本發明之臉部辨識方法,的確能藉由上述所揭露之實施例,達到所預期之使用功效,且本發明亦未曾公開於申請前,誠已完全符合專利法之規定與要求。爰依法提出發明專利之申請,懇請惠予審查,並賜准專利,則實感德便。 In summary, the face recognition method of the present invention can indeed achieve the expected use effect through the disclosed embodiments, and the present invention has not been disclosed before the application. It has fully complied with the provisions of the Patent Law and Claim. I filed an application for a patent for invention in accordance with the law, pleaded for the review, and granted the patent.

惟,上述所揭示之圖示及說明,僅為本發明之較佳實施例,非為限定本發明之保護範圍;大凡熟悉該項技藝之人士,其所依本發明之特徵範疇,所作之其它等效變化或修飾,皆應視為不脫離本發明之設計範疇。 However, the illustrations and descriptions disclosed above are only preferred embodiments of the present invention, and are not intended to limit the scope of protection of the present invention; those who are familiar with the art, according to the characteristic scope of the present invention, do other things Equivalent changes or modifications should be regarded as not departing from the design scope of the present invention.

(S1)‧‧‧步驟一 (S1)‧‧‧Step 1

(S2)‧‧‧步驟二 (S2)‧‧‧Step 2

(S3)‧‧‧步驟三 (S3)‧‧‧Step 3

(S4)‧‧‧步驟四 (S4)‧‧‧Step 4

(S5)‧‧‧步驟五 (S5)‧‧‧Step 5

(S6)‧‧‧步驟六 (S6)‧‧‧Step 6

(S7)‧‧‧步驟七 (S7)‧‧‧Step 7

Claims (13)

一種臉部辨識方法,係於一臉部辨識系統偵測到一待測者之臉部後,進行一臉部辨識動作,該臉部辨識方法係包括有下列步驟:步驟一:使用一深度影像擷取單元進行一原始臉部之影像擷取;步驟二:使用一影像處理單元內建之選取模組於該原始臉部之影像中選取複數個第一特徵點,並分別計算該第一特徵點與該深度影像擷取單元之間的第一距離值;步驟三:使用該影像處理單元內建之長度計算模組連接兩兩該等第一特徵點以獲得複數條第一線段,並分別計算該等第一線段之長度以獲取複數個第一長度值,以及計算兩兩連線之第一特徵點的第一距離值之間的第一深度差值,並使用一內建於該影像處理單元之面積計算模組計算由三條該第一線段所圍成之第一三角形的第一面積值,以及該等第一面積值加總之第一總面積值;步驟四:將具有該等第一特徵點、該等第一線段、該等第一長度值,以及該等第一深度差值之原始臉部的影像儲存於一儲存單元中;步驟五:重複該步驟一至該步驟三,使用該深度影像擷取單元擷取一待測臉部之影像,並獲得該待測臉部上複數個對應該等 第一特徵點之位置的第二特徵點、複數個由該等第二特徵點所連接之第二線段與第二長度值,以及複數個第二距離值與第二深度差值,並儲存於該儲存單元中;步驟六:使用一比對單元比對該等第一長度值與對應之第二長度值,以及該等第一深度差值與對應之第二深度差值,同時使用該面積計算模組計算由三條該第二線段所圍成之第二三角形的第二面積值,以及該等第二面積值加總之第二總面積值;以及步驟七:當該第一長度值與對應之第二長度值之間的差異,以及該第一深度差值與對應之第二深度差值之間的差異介於一誤差範圍,同時使用該比對單元比對該第一總面積值與該第二總面積值,若該第一總面積值與該第二總面積值之間的差異介於該誤差範圍時則該待測臉部係與該原始臉部相同。 A face recognition method is to perform a face recognition action after a face recognition system detects the face of a person to be tested. The face recognition method includes the following steps: Step 1: Use a depth image The capture unit captures an image of the original face; Step 2: Use a built-in selection module of the image processing unit to select a plurality of first feature points from the image of the original face and calculate the first feature separately The first distance between the point and the depth image acquisition unit; step 3: use the built-in length calculation module of the image processing unit to connect two or two of these first feature points to obtain a plurality of first line segments, and Calculate the lengths of the first line segments to obtain a plurality of first length values, and calculate the first depth difference between the first distance values of the first feature points of the two connecting lines, and use a built-in The area calculation module of the image processing unit calculates the first area value of the first triangle surrounded by the three first line segments, and the first total area value added up by the first area values; Step 4: will have The images of the original faces of the first feature points, the first line segments, the first length values, and the first depth difference values are stored in a storage unit; Step 5: Repeat step 1 to step Step three, use the depth image capturing unit to capture an image of a face to be tested, and obtain a plurality of corresponding faces on the face to be tested The second feature point at the position of the first feature point, a plurality of second line segments connected by the second feature points and a second length value, and a plurality of second distance values and a second depth difference value, and stored in In the storage unit; Step 6: Use a comparison unit to compare the first length value and the corresponding second length value, and the first depth difference value and the corresponding second depth difference value, while using the area The calculation module calculates the second area value of the second triangle enclosed by the three second line segments, and the second total area value added up by the second area values; and Step 7: When the first length value corresponds to The difference between the second length value and the difference between the first depth difference and the corresponding second depth difference are within an error range, and the first total area value and The second total area value, if the difference between the first total area value and the second total area value is within the error range, the face to be tested is the same as the original face. 如申請專利範圍第1項所述之臉部辨識方法,其中該深度影像擷取單元係為TOF攝影機或雙鏡頭攝影機其中之一。 The face recognition method as described in item 1 of the patent application, wherein the depth image capturing unit is one of a TOF camera or a dual-lens camera. 如申請專利範圍第2項所述之臉部辨識方法,其中當該深度影像擷取單元係為TOF攝影機時,該深度影像擷取單元係至少包括有一發光模組、一接收模組,以及一影像擷取模組。 The face recognition method as described in item 2 of the patent application scope, wherein when the depth image capturing unit is a TOF camera, the depth image capturing unit at least includes a light emitting module, a receiving module, and a Image capture module. 如申請專利範圍第3項所述之臉部辨識方法,其中該發光模組係發射複數個光斑於該原始臉部或該待測臉部上。 The face recognition method as described in item 3 of the patent application scope, wherein the light emitting module emits a plurality of light spots on the original face or the face to be tested. 如申請專利範圍第3項所述之臉部辨識方法,其中該接收模組係接收複數個由該原始臉部或該待測臉部反射之反射光斑,並傳遞至該影像處理單元。 The face recognition method as described in item 3 of the patent application scope, wherein the receiving module receives a plurality of reflected light spots reflected by the original face or the face to be measured, and transmits them to the image processing unit. 如申請專利範圍第3項所述之臉部辨識方法,其中該影像擷取模組係包括有一第一光學鏡頭,以及一與該第一光學鏡頭連接之第一感光元件,該第一光學鏡頭係擷取該原始臉部或該待測臉部之影像於該第一感光元件上成像。 A face recognition method as described in item 3 of the patent application, wherein the image capture module includes a first optical lens, and a first photosensitive element connected to the first optical lens, the first optical lens The image of the original face or the face to be measured is captured and imaged on the first photosensitive element. 如申請專利範圍第6項所述之臉部辨識方法,其中該第一光學鏡頭係為魚眼鏡頭、廣角鏡頭或標準鏡頭其中之一。 The face recognition method as described in item 6 of the patent application scope, wherein the first optical lens is one of a fisheye lens, a wide-angle lens, or a standard lens. 如申請專利範圍第6項所述之臉部辨識方法,其中該第一感光元件係為光電耦合元件(CCD)或互補金屬氧化物半導體(CMOS)其中之一。 The face recognition method as described in item 6 of the patent application range, wherein the first photosensitive element is one of a photoelectric coupling element (CCD) or a complementary metal oxide semiconductor (CMOS). 如申請專利範圍第2項所述之臉部辨識方法,其中當該深度影像擷取單元係為雙鏡頭攝影機時,該深度影像擷取單元係包括有二第二光學鏡頭,以及一分別與該等第二光學鏡頭連接之第二感光元件,該等第二光學鏡頭係同時擷取該原始臉部或該待測臉部之影像於該第二感光元件上成像。 The face recognition method as described in item 2 of the patent application scope, wherein when the depth image capturing unit is a dual-lens camera, the depth image capturing unit includes two second optical lenses, and a The second photosensitive element is connected to the second optical lens, and the second optical lens simultaneously captures images of the original face or the face to be tested and forms an image on the second photosensitive element. 如申請專利範圍第9項所述之臉部辨識方法,其中該第二光學鏡頭係為魚眼鏡頭、廣角鏡頭或標準鏡頭其中之一。 The face recognition method as described in item 9 of the patent application scope, wherein the second optical lens is one of a fisheye lens, a wide-angle lens, or a standard lens. 如申請專利範圍第9項所述之臉部辨識方法,其中該第二感光元件係為光電耦合元件(CCD)或互補金屬氧化物半導體(CMOS)其中之一。 The face recognition method as described in item 9 of the patent application scope, wherein the second photosensitive element is one of a photoelectric coupling element (CCD) or a complementary metal oxide semiconductor (CMOS). 如申請專利範圍第1項所述之臉部辨識方法,其中該誤差範圍係介於98%~100%之間。 The face recognition method as described in item 1 of the patent application scope, wherein the error range is between 98% and 100%. 如申請專利範圍第1項所述之臉部辨識方法,其中該面積計算模組係使用一海龍公式計算該第一面積值或該第二面積值。 The face recognition method as described in item 1 of the patent application scope, wherein the area calculation module calculates the first area value or the second area value using a Hailong formula.
TW107112624A 2018-04-12 2018-04-12 Face recognition method TWI693560B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107112624A TWI693560B (en) 2018-04-12 2018-04-12 Face recognition method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107112624A TWI693560B (en) 2018-04-12 2018-04-12 Face recognition method

Publications (2)

Publication Number Publication Date
TW201944292A TW201944292A (en) 2019-11-16
TWI693560B true TWI693560B (en) 2020-05-11

Family

ID=69184473

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107112624A TWI693560B (en) 2018-04-12 2018-04-12 Face recognition method

Country Status (1)

Country Link
TW (1) TWI693560B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI786565B (en) * 2021-03-11 2022-12-11 國立臺灣大學 Method and system of deep face recognition for fisheye images

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105046219A (en) * 2015-07-12 2015-11-11 上海微桥电子科技有限公司 Face identification system
CN106203308A (en) * 2016-06-30 2016-12-07 美的集团股份有限公司 Face identification method and face identification device
CN106326867A (en) * 2016-08-26 2017-01-11 维沃移动通信有限公司 Face recognition method and mobile terminal
CN106991377A (en) * 2017-03-09 2017-07-28 广东欧珀移动通信有限公司 Face recognition method combined with depth information, face recognition device and electronic device
TW201727537A (en) * 2016-01-22 2017-08-01 鴻海精密工業股份有限公司 Face recognition system and face recognition method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105046219A (en) * 2015-07-12 2015-11-11 上海微桥电子科技有限公司 Face identification system
TW201727537A (en) * 2016-01-22 2017-08-01 鴻海精密工業股份有限公司 Face recognition system and face recognition method
US20170228585A1 (en) * 2016-01-22 2017-08-10 Hon Hai Precision Industry Co., Ltd. Face recognition system and face recognition method
CN106203308A (en) * 2016-06-30 2016-12-07 美的集团股份有限公司 Face identification method and face identification device
CN106326867A (en) * 2016-08-26 2017-01-11 维沃移动通信有限公司 Face recognition method and mobile terminal
CN106991377A (en) * 2017-03-09 2017-07-28 广东欧珀移动通信有限公司 Face recognition method combined with depth information, face recognition device and electronic device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI786565B (en) * 2021-03-11 2022-12-11 國立臺灣大學 Method and system of deep face recognition for fisheye images
US11749022B2 (en) 2021-03-11 2023-09-05 National Taiwan University Method and system of deep face recognition for fisheye image

Also Published As

Publication number Publication date
TW201944292A (en) 2019-11-16

Similar Documents

Publication Publication Date Title
CN107093171B (en) Image processing method, device and system
CN102006402B (en) Image pick-up device and identity identification method thereof
CN104902258A (en) Multi-scene pedestrian volume counting method and system based on stereoscopic vision and binocular camera
CN109269405A (en) A fast 3D measurement and comparison method
KR20150080728A (en) Acquisition System and Method of Iris image for iris recognition by using facial component distance
CN102622588A (en) Dual-certification face anti-counterfeit method and device
KR101444538B1 (en) 3d face recognition system and method for face recognition of thterof
CN109389719A (en) A kind of cell unit door access control system and door opening method
TW201727537A (en) Face recognition system and face recognition method
CN205917619U (en) Channel management equipment
CN114743277B (en) Liveness detection method, device, electronic device, storage medium and program product
KR101917783B1 (en) Parking lot management system
CN107609515B (en) A dual verification face comparison system and method based on Feiteng platform
CN109815884A (en) Unsafe driving behavioral value method and device based on deep learning
CN110599657A (en) Access control monitoring system and method based on image recognition technology
CN108376237A (en) A kind of house visiting management system and management method based on 3D identifications
CN111191644B (en) Identification method, system and device
CN109492509A (en) Personal identification method, device, computer-readable medium and system
US20230342442A1 (en) Gate system, gate apparatus, and image processing method therefor
CN105989363A (en) Establishing method for multi-angle face image library
CN118506287A (en) Regional security monitoring method, system, readable storage medium and computer
TWI693560B (en) Face recognition method
CN106127866A (en) Ticket checking method and channel management equipment
CN101131727B (en) Image collecting method and its application
CN116863297A (en) Monitoring method, device, system, equipment and medium based on electronic fence

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees