GB2442504A

GB2442504A - Face recognition system, security system comprising same and method for operating same

Info

Publication number: GB2442504A
Application number: GB0623009A
Authority: GB
Inventors: Chin Ying Havik Lam
Original assignee: INTERNET WEB TECHNOLOGY Ltd
Current assignee: INTERNET WEB TECHNOLOGY Ltd
Priority date: 2006-11-17
Filing date: 2006-11-17
Publication date: 2008-04-09
Anticipated expiration: 2026-11-17
Also published as: GB0623009D0; DE202007016079U1; TW200823775A; CN101183429A; TWM337796U; GB2442504B; HK1116562A1; TWI338866B

Abstract

There is provided with a face recognition security system comprising a terminal with which a user interacts, said terminal comprises at least two cameras, means for determining which of the cameras is to be used for capturing the image of the face of the user and means for displaying the image of the face of the user, wherein one of said cameras is arranged above the other camera(s).

Description

I

FACE RECOGNITION SYSTEM, SECURITY SYSTEM COMPRISING

SAME AND METHOD FOR OPERATING SAME

FIELD OF THE INVENTION

S The present invention is concerned with face recognition systems, security systems and methods for operating these systems. In particular, the present invention is also concerned with entrance systems comprising one or more these systems or using such operating methods.

BACKGROUND OF THE INVENTION

Face recognition systems have been around for some time. Such systems basically seek to verify whether users are legitimate or authorized persons and these systems may be used in security systems for a variety of applications. One company that has been developing this technology is Cognitec System GmbH (www.cognitec-systems.de). However, the inventors of the present invention have found that for many reasons conventional systems of this type are not friendly to users and also are not friendly to administrators maintaining these systems and often lead to a high failure rate in their operation.

The present invention seeks to address these user or system administrator unfriendly problems or at least to provide an alternative to the genera] public.

SUMMARY OF THE INVENTION

According to a first aspect of the present invention, there is provided a face recognition security system comprising a terminal with which a user interacts, the terminal comprises at least two cameras, means for determining which of the cameras are to be used for capturing the image of the face of the user and means for displaying the image of the face of the user, wherein one of the cameras is arranged above the other camera(s).

Preferably, the system may comprise two cameras at the terminal and the display means may be arranged between the two cameras. The image displayed on the displayed means may be a mirror image.

In one embodiment, the system may comprise a database carrying information of facial images of users or authorized users.

Suitably, the system may be connected to the database via the internet. One advantage of this arrangement is that the database can be maintained and updated from a location remote or far away from the system.

Advantageously, the system may comprise means for identifying users. The system may comprise means for detecting the identification means. The identification means may generally be in the form of cards carrying identification information of and provided to respective authorized users of the system. Alternatively, the detecting means may be adapted to detect other characteristics unique to the respective users.

According to a second aspect of the present invention, there is provided an entrance system for allowing or disat lowing entrance by users, comprising a system as described above. The entrance system may comprise a gate or a door. After confirming the authenticity of the user, the gate or the door may be open on instructions by the face recognition system.

According to a third aspect of the present invention, there is provided a method of authenticating the identity of a user by using a system as described above.

According to a fourth aspect of the present invention, there is provided a method of authenticating the identity of a user by using a face recognition system, comprising the steps of (a) acquiring a first set of data from the user seeking to pass through the system, (b) determining which of the cameras to use in capturing the image of the face of the user based on the first set of data, (c) capturing the image of ihe user, (di generating a seconci set of data based on the captured image, (e) comparing the second set of data with information in a database cairying identification of authorized users of the system, (f) generating a third set of data based on the comparison in step and (g) allowing or denying the user to or from passing through the system based on the based on the third set of data. In one embodiment, the method may further comprise a step of displaying the image of the face of the user in a display means.

BRIEF DESCRIPTION OF DRAWINGS

Some embodiments of the present invention will now be described by way of example and with reference to the accompanying drawings, in which:-Fig. 1 is a perspective view illustrating a terminal of a face recognition system or an entrance system according to an embodiment of the invention; Fig. 2 is a front view of the terminal shown in Fig. 1; and Fig. 3 is a flow chart illustrating the logistics of the operation of the system according to an embodiment of the invention.

DETAILED DESCRIPTION OF PREFEERED EMBODIMENTS

As discussed above, face recognition systems have been around for some time, Computer software for use in comparing a captured facial Image of a user with images stored in a database and then determining whether the user is an authorized user is not new. Conventional face recognition systems are typicalLy designed with a terminal with which a user interacts with the system. In use, a user would stand in front of the terminal such that a camera resided ax the terminal can capture the facial image of the user. However, problems often arise during the image capturing process because the terminal is typically fixedly mounted on a wall or on a post and the camera is secured to a certain height from the ground at the terminal. Since users have different heights and the camera is fixedly mounted., capturing the facial image of users properly is often unsatisfactory. The present invention or embodiments in accordance with the present invention as described below seeks to solve the problems associated with such a problem.

A face recognition system in accordance with a first embodiment of the present invention comprises as shown in Fig. I a terminal 2 with which a user interacts therewith. The terminal is fixedly mounted on a wall at an appropriate height. A schematic diagram showing a front view and a perspective view of the terminal 2 are shown in Fig. I and Fig. 2, respectively. The terminal 2 is generally rectangular in shape and is disposed vertically on the wall. From the upper end to the lower end of the terminal 2, there is provided a first image capturing means such as a camera 4, means for displaying the facial image of a user such as a monitor 6, a second image capturing means such as a camera 8, a plurality of indicators 10 and means for detecting an identification of the user such as a detector 12. The monitor 6 has multiple functions, one of which is to provide a biofeedback to the user and which will be explained in further detail later in the description.

Although not shown in Fig. I and Fig. 2, the terminal also comprises means for determining which of the cameras 4, 8 is to be used for capturing the facial image of the user. In this embodiment, this determination means comprises a computer algorithm for conducting the determination function although in other embodiments the determination means may comprise a circuitry adapted to conduct the determination procedures. The system also comprises identification cards (e.g. proximity cards, "smart" cards, etc.) previously issued to the users authorized to use the system. The identification cards carry a profile of information of the respective authorized users such as their name, level of access privilege and height (or type of height). The detector from the terminal is adapted to detect the identification card and retrieve information from the card of the user. It is to be noted that a variety of identification cards may be used. These include contact-type identification cards, non-contact-type identification cards, long range RFID cards, short range RFII) cards, EM cards, Mifare cards and Wiegand based cards. Depending on which card type is used, the determination means will include a respective reader suitable for detecting a particular card type.

In this embodiment, the first camera 4 at the terminal 2 is arranged such that it is located about 5'9" from the ground and is proximal to the monitor 6, and the second camera 8 at the terminal 2 is arranged such that it is located about 5'3" from the ground and proximal to the monitor 6 and also below the first camera 4. The S monitor 6 is located at the terminal 2 between the first camera and the second camera.

The detector 12 is located at the lower end of the terminal 2 below the second camera 8.

Also in this embodiment, there are two types of height, namely type H designated to a taller person and type h designated to a shorter person. In this embodiment, a person who is 5 feet 6 inches or taller is classified as type 14 and a person wno is less than 5 teet and 6 inches is classified as type h. This height type is part of the information profile stored in his identification card. For the purpose of explaining the characteristics and operation of the system, it is assumed that in the following scenario the user is a type H person.

Referring to Fig. 3, the system is at its standby mode 14 ready to conduct a recognition or verification of the face of the (the type H user). When the user approaches the terminal 2 he will be prompted at the monitor 6 to register his identification card at the detector 12. In response, the user will place his identification card at the detector 12 (sec 16). The detector 12 will then firstly seek to verif' whether the card is a valid card (see 18). If it is not then it will output a signal to the monitor 6 for displaying an error message on the monitor 6 (see 20) and the system will then return to its standby mode (see 22). If it is then it will seek to retrieve further information from the profile stored in the card and ascertain the type of height of the person being verified (i.e. a type H or type h user) (see 24). Then when the person is identified to be of type H (as indicated above in this embodiment, the user is a type H person and the identification card assigned to him this type H information in the information profile.), the detector will output a signaL in order to activate the first S camera 4 which is located at a higher position (see 20). Once the camera 4 is activated, it will be adapted to capture in the camera range (from about 5'6" to 6') the fcial image of the user. Afler the image has been captured the captured image will be converted into information for comparison with infonnation in a database seeking to ascertain whether the person with the particular captured facial image is an authorized person to get passed the system or not (see 28). If it is found that the captured facial image does not correspond to any information on record then the system will abort the recognition process (see 30) and output a signal for prompting an ermr message to the monitor (see 32), and then return to its stand by model momentarily (see 34). The system will also register information in connection with this "unsuccessful" recognition at a log table for iture reference (see 36). If it is found that the captured facial image does correspond to information of an authorized user then the system will output a signal prompting a personalized greeting message to the monitor (see 38). In the scenario in which the system is connected to an entiance gate, the system can also be adapted to output a signal for unlocking the gate or opening the gate automatically. The system will likewise register information in connection with this "successful" recognition at a log table for future reference (see 40). The syslem will then return to its stand by mode for next recognition exercise (see 42).

S

Of course when the system serves to recognize the facial image of a type h authorized user, the lower camera 8 will be activated instead, although the rest of the algorithm will generally be similar.

S The above-described system is technically significant in a number of ways.

First, in conventional face recognition systems only one camera is provided. If a camera is mounted too high on a fixture in relation to a user then the camera will tend to capture a top perspective view of the face of the user or if the user is very short then the camera will tend to capture the image of the forehead of the user. It is to be understood the database connected to the system carries information of facial images of users (or authorized users) and if the captured image is not really a facial image but forehead image of the user then despite the user may well be an authorized user the recognition system would not be able to properly distinguish the user and allow the user to pass through the system. If a camera is mounted too low on a fixture in relation to a user then the camera will tend to capture from a lower perspective view of the face of the user or if the user is very tall then the camera will tend to capture the image of the chin of the user. Again, this would similarly lead to an unsuccessful recognition exercise. To the contrary, in accordance with the above-illustrated embodiment with the use of a dual camera arrangement, the system is able to select a suitable camera between the two cameras for more accurately capturing the facial image of the user.

Second, in conventional face recognition system no means for providing feedback to the user is available. It was often the case that a user would stand not exactly in front of the camera and not knowingly he is standing in an improper place for the recognition process the system will fail to peffonn the recognition exercise properly. To the contrary, in accordance with the above-illustrated embodiment, with the use of a monitor the user can see whether his image appears in the screen as he approaches the terminal. Due to a natural tendency of users to look for his image in the monitor he will move himself in front of the terminal until his front image is displayed fully in the monitor. The introduction of the monitor in essence produces a biofeedback whereby the user can be drawn to a proper position for action by the recognition system.

A second embodiment in accordance with the present invention is similar to the first embodiment, except the monitor is adapted to display a minor image of the user such that as the user moves to the right the image will follow and moves to right and vice versa. This design is advantageous because the user can follow the movement of the image and adjust his position accordingly.

A third embodiment in accordance with the present invention is similar to the first embodiment, except no means for displaying the image of the user is provided.

Although such an embodiment is less preferable it is still advantageous because at least the use of two cameras can handle a wider range of users of different height.

A fourth embodiment in accordance with the present invention is similar to the first embodiment, except only one camera is provided, Although such an embodiment is less preferable, it is still advantageous because with the presence of a monitor for biofeedback purpose at least the user is assisted with the monitor to position himself for recognition by the system.

A fifth embodiment in accordance with the present invention is similar to the first embodiment, except the detector is adapted to recognize fingerprints of authorized users. The recognition of fingerprints can be used for (1) identiing as to which height type a particular authorized user is and/or (ii) identifying whether the S user is an authorized user at all.

It is envisaged that in a further embodiment, the database of facial images or authorized facial images may be located at remote location and the terminal is connected to the database via the Internet. This is advantageous for a number of reasons. First, maintenance of the database can be conducted at a remote location.

Second, with the database at the remote location theft of personal information at the terminal can be avoided. Third, the database may include facial images of criminals and if these criminals are detected by the recognition system, the system can be adapted to inform the law enforcement authorities automatically.

It is also envisaged that a face recognition system may be comprised in an entrance system for allowing or denying access to a premises via an entrance of the system. The face recognition system may be comprised in other systems such as an automatic teller machine whereby the user is allowed to perform any transaction only after the user has passed face recognition system.

It is to be noted that the execution of the various algorithm above may be conducted via circuitries, software programming, firmware programming or other hardware programming, and the use of whichever mode for execution does not depart from the invention merits of the present invention.

Claims

Claims: I. A face recognition security system comprising a terminal

with which a user interacts, said terminal comprises at least two cameras, means for determining which of said cameras is to be used for capturing the image of the face of the user and means for displaying the image of the face of the user, wherein one of said cameras is arranged above the other camera(s).
2. A system as claimed in Claim 1, comprising two said cameras, wherein said display means is arranged between said two cameras.
3. A sys.em s claimed in Claim i or 2, wherein the image is a mirror image.
4. A system as claimed in Claim 1, 2 or 3, further comprising a database carrying information of facial images of users.
5. A system as claimed in Claim 4, wherein said database comprises information of facial images of authorized users.
6. A system as claimed in Claim 4 or 5, wherein said system is connected to said database via the Internet.
7. A system as claimed in any preceding claim, further comprising means for identifying users.
8. A system as claimed in Claim 7, further comprising means for detecting said identification means,
9. A system as claimed in Claim 8 wherein said Identification means is generally in the form of cards carrying identification information of and provided to respective authorized users of said system.
10. An entrance system for allowing or disallowing entrance by users, comprising a face recognition system as claimed in any one of Claims I to 9.
11. A method of authenti;athg the identity of a user by using a system as claimed in one of Claims ito 10.
12. A method of authenticating the identity of a user by using a face recognition system, comprising the steps of: (1) ac4uiring a first set of data from the user seeking to pass through the system; (ii) determining which of the cameras to use in capturing the image of the face of the user based on the first set of data; (iii) capturing the image of the face of the user; (iv) generating a second set of data based on the captured image; (v) comparing the second set of data with information in a database carrying identification of authorized users of the system; (vi) generating a third set of data based on the comparison in step (v); and (i) allowing or denying the user to or from passing through the system based on the based on the third set of data.
13. A method as claimed in Claim 12, comprising a step of displaying the image of the face of the user in a display means.
14. A face recognition system, an entrance system or a method substantially as hereinbefore described and/or illustrated in the accompanying figures.