JP2006221378A - Alarm system and method using face authentication - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To shorten an authentication time, and to increase operating efficiency by enabling authentication of an authentication object carrying packages in both hands. <P>SOLUTION: This alarm system comprises (1) a storage means for preliminarily storing a face image, (2) a camera for photographing a prescribed area, (3) a first sensor for detecting a person passing through the prescribed area, (4) a second sensor arranged in the prescribed area for detecting a person passing through an area closer to a camera than to the first sensor, (5) a face recognizing means for, when the passage is detected by the first sensor, and then the passage is detected by the second sensor, recognizing the face image from images photographed by the camera, (6) a face recognizing means for judging whether or not the similarity of the face image recognized by the face recognizing means and the preregistered face image is a threshold or more, and (7) an alarm means to be operated when it is not judged that the similarity of the face image recognized by the face recognizing means and the preregistered face image is a threshold or more. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a system and a method for monitoring entry into a predetermined place using a monitoring camera and issuing an alarm for entry into a suspicious person when a suspicious person is detected.

Conventionally, there has been a personal authentication device that authenticates whether or not an authentication target person is a registrant using biometric information such as a face, a fingerprint, and a palm print. The personal authentication device is applied to a system for monitoring a person who wants to enter a predetermined place (see, for example, Patent Document 1).
JP 2004-46697 A

  However, if a fingerprint or palm print is used for authentication judgment, the person to be authenticated must hold his / her finger or hand over the fingerprint or palm print reading device. For this reason, when the person to be authenticated has a baggage using both hands, the baggage has to be placed once.

  The first feature of the present invention is (1) a camera capable of photographing a predetermined area, (2) a first sensor capable of detecting a person passing through the predetermined area, and (3) within the predetermined area, A second sensor capable of detecting a person passing through an area closer to the camera than the first sensor; and (4) when the first sensor detects passage and then the second sensor detects passage. And (5) whether the similarity between the face image recognized by the face recognition means and the face image stored in advance is equal to or greater than a threshold value. (6) an alarm means that is activated when the similarity between the face image recognized by the face recognition means and the face image registered in advance is not determined by the face authentication means to be greater than or equal to a threshold value; It is in having. For example, an infrared sensor can be used as the sensor, and either a thermal sensor or an optical sensor may be used.

  The second feature of the present invention is that the time when the first sensor detects the passage and the second sensor detects the passage, the moving image captured by the camera at the time, and the face recognition means at the time. The image processing apparatus further includes storage means for storing the image recognized as a face and the result of the determination performed by the face authentication means at the time.

  According to the first feature of the present invention, when each sensor detects the passage of a person in the order of the first sensor and the second sensor, the face image is identified from the images captured by the camera, Further, the degree of similarity between the identified face image and the face image registered in advance is examined, and the alarm means is activated unless it is determined that the degree of similarity is greater than or equal to a threshold value. For this reason, authentication can be performed even if the person to be authenticated holds the baggage in both hands, and the authentication time can be shortened and work efficiency can be improved as compared with other authentication methods.

  According to the second feature of the present invention, when each sensor detects the passage of a person in the order of the first sensor and the second sensor, the date and time, the moving image taken at that time, and the moving image thereof The face image identified / extracted from the image and the result of the determination performed by the face authentication means for the face image are stored in association with each other. “Associated storage” refers to, for example, text data that displays the date and time, a moving image file, and a face image file linked by a hyperlink, and text or a face image displayed on the display screen (as appropriate, “face index” ")" Means that a linked moving image file is reproduced by clicking or the like using a pointing device.

  The best mode for carrying out the present invention will be described below with reference to the drawings. The following description is merely an example, and the technical scope of the present invention is not limited to the following description.

  FIG. 1 is an overall schematic diagram showing a configuration of an alarm system according to the present embodiment. As shown in FIG. 1, the alarm system 100 includes a first sensor 101, a second sensor 103, a control unit 105, a light 107, a speaker 109, a display unit 111, a face recognition unit 113, a face authentication unit 115, and a storage unit. 117 and a camera (photographing means) 119. It is preferable that the alarm system 100 further includes a personal computer (PC) 121 used when a face image is registered in advance. The first sensor 101, the second sensor 103, the light 107, the speaker 109, the display unit 111, the face recognition unit 113, the face authentication unit 115, the storage unit 117, the camera (photographing unit) 119, and the like are controlled by the control unit 105. The functions described below are exhibited.

  FIG. 2 is a diagram illustrating a relative positional relationship between the first sensor, the second sensor, and the camera in the alarm system according to the present embodiment. In the example shown in FIG. 2, the first sensor 101 and the second sensor 103 are installed so that the indoor side (the side where the camera 119 is installed) of both the carry-in port and the carry-out port is the detection target area. Has been. The first sensor 101 is installed on the side near the carry-in / out entrance, and the second sensor 103 is installed on the side near the camera 119. When someone passes between the first sensors 101a and 101b and the infrared rays between the first sensors 101a and 101b are blocked, the first sensor 101 detects the passage of the person. Similarly, when someone passes between the second sensors 103a and 103b and the infrared rays between the second sensors 103a and 103b are blocked, the second sensor 103 detects the passage of a person. The cameras 119a and 119b monitor the carry-in port, and the cameras 119c and 119d monitor the carry-out port. And authentication with respect to a room-entrant shall be completed in the position of about 1.5 m from a carrying-in entrance.

  The face recognizing means 113 searches for a face image from the images taken by the camera 119 and outputs it.

  Whether the person who has already entered the room is determined by determining whether the similarity between the face image recognized by the face recognition unit 113 and the already registered face image is greater than or equal to a threshold value. Judge whether or not.

  The light 107 is activated when the face authentication means 115 does not determine that the person entering the room is already registered. For example, when it is not determined that the person entering the room is a registrant, the red rotating lamp is activated. In this embodiment, it is assumed that the blue revolving light is activated when it is determined that the occupant is a registrant.

  The speaker 109 also operates when the face authentication means 115 does not determine that the person entering the room is already registered. For example, a buzzer sound is output when it is not determined that the room entrant is a registered person.

  The display means 111 is, for example, a first display area that displays a moving image taken by the camera 119 in real time, a second area that displays an index of the face image of the latest occupant, and someone has entered the room. A third display area for displaying the date and time and whether the room entrant is a registered person or an unregistered person (status).

  When the first sensor 101 detects the passage of a person and then the second sensor 103 detects the passage of a person, that is, when it detects that a person has entered, the storage means 117 The determination result (status) of the authentication means 115 as to whether the person who entered is a registered person or an unregistered person, a moving image obtained by photographing the entering person, and a face image extracted from the moving image are stored in association with each other. To do.

  FIG. 3 is a flowchart showing an example of processing in the alarm system according to the present embodiment. As shown in FIG. 3, the first sensor 101 first detects the passage of a person (or object) (step S111), and then the second sensor 103 similarly detects the passage of a person (or object) ( In step S113), the face recognition means 113 attempts to identify and extract a human face from the moving image captured by the camera 119 (step S115). When the face recognition unit 113 can recognize a face from the moving image (YES in step S117), the face recognition unit 113 extracts and outputs an image identified as a face. When the face recognition unit 113 outputs an image identified as a face, the face authentication unit 115 determines whether the similarity between the output face image and the face image stored in the storage unit 117 in advance is equal to or greater than a threshold value. (Step S119). When the face authentication unit 115 determines that the similarity between two face images is greater than or equal to the threshold, that is, when face authentication is performed (YES in step S121), no alarm is activated (step S123). For example, the light 107 operates as a blue rotating lamp, and the speaker 109 does not output sound. Note that a reproduction sound of an audio file for authentication stored in the storage unit 117 in advance, for example, a message such as “authenticated” may be output from the speaker 109.

  On the other hand, the face recognition means 113 could not recognize the face due to the reason that the occupant covered a part of the face with sunglasses or a mask, or entered the room with the back facing backward (step S117). If NO in step S121, or if the face recognition unit 115 fails to authenticate the image identified and output by the face recognition unit 113 (NO in step S121), an alarm is activated (step S125). For example, the light 107 operates as a red rotating lamp, and a buzzer sound is output from the speaker 109. Note that a reproduction sound of a non-authentication audio file stored in the storage unit 117 in advance, for example, a message such as “Not authenticated” may be output from the speaker 109.

  Further, the storage unit 117 includes a date and time when the face authentication unit 115 performs authentication or non-authentication, a result (status) of the authentication or non-authentication, and a face image (face index) subjected to authentication or non-authentication. Then, a moving image (moving image taken by the camera 119 at the date and time) from which the face image is extracted is stored in association with each other (step S127). It is preferable that any associated information such as date and time can be confirmed on the display unit 111.

  FIG. 4 shows a display example of the date and time, status, face image, and moving image in the alarm system according to the present embodiment. For example, the display screen 1110 of the display unit 111 displays a first display area (the LIVE screen display area) 1111 that displays a moving image captured by the camera 119 in real time and the face image of the latest occupant as an index. A second area (face index display area) 1112 and a third display area 1113 for displaying the date and time when somebody entered the room and whether the room entry is a registered person or an unregistered person (status).

In the example of FIG. 4, the third display area 1113 has
Date Time Status
2005.2.1.10:00:0-10:00:03 Unregistered
2005.2.1.10:00:05〜10:00:07 Registrant
2005.2.1.10:00:09〜10:00:11 It is displayed as an unregistered person. The date, status, and status of unregistered persons are preferably displayed in red for alerting.

  On the display screen 1110, a pointer that can be moved by a pointing device such as a mouse is displayed. When using this pointer, for example, “2005.2.1.10:00:00:00:00:03 Unregistered” is clicked, “2005.2. It is preferable that the camera 119 captures the image at “1.10: 00: 00: 00: 00: 03”, and the moving image file stored in the storage unit 117 is reproduced and displayed in the LIVE screen display area 1111.

  Similarly, when a face image displayed in the face index display area 1112 is clicked using the pointer, the moving image file stored in the storage unit 117 in association with the clicked face image is reproduced, and the LIVE screen display area is displayed. It is preferably displayed in 1111.

  As described above, according to the present embodiment, when the first sensor 101 detects the passage of a person and then the second sensor 103 detects the passage of a person, face recognition is performed from the image captured by the camera 119. The means 113 recognizes and extracts a human face image, and the face authentication means 115 determines whether the similarity between the face image and the face image registered in advance is equal to or greater than a threshold value. When the face authentication unit 115 determines that the similarity between the two face images is equal to or greater than the threshold value, that is, determines that the person entering the room is a pre-registered person, the light 107 operates with a blue rotating lamp, and the speaker 107 No sound is output from 109. On the other hand, if the face authentication unit 115 does not determine that the similarity between the two face images is greater than or equal to the threshold value, that is, if the person who has entered the room is not determined to be registered in advance, the light 107 rotates in red. The lamp is activated and a buzzer sound is output from the speaker 109.

  FIG. 5 shows another aspect regarding the mounting positions of the first sensor and the second sensor. In the example shown in FIG. 5, the first sensor 125 is installed on the ceiling near the entrance, and the second sensor 127 is installed on the ceiling closer to the camera 119 than the first sensor 125.

It is the whole schematic figure which shows the structure of the alarm system which concerns on this Embodiment. It is a figure which shows the relative positional relationship of the 1st sensor in the alarm system which concerns on this Embodiment, a 2nd sensor, and a camera. It is a flowchart which shows an example of the process in the alarm system which concerns on this Embodiment. It is a figure which shows the example of a display of the date in the alarm system which concerns on this Embodiment, a status, a moving image, and a still image (face index). It is a figure which shows another aspect regarding the attachment position of a 1st sensor and a 2nd sensor.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 ... 1st sensor 103 ... 2nd sensor 105 ... Control part 107 ... Light 109 ... Speaker 111 ... Display means 113 ... Face recognition means 115 ... Face authentication means 117 ... Storage means 119 ... Camera 121 ... PC 123 ... LAN

Claims (4)

Storage means for storing face images in advance;
A camera capable of shooting a predetermined area;
A first sensor capable of detecting a person passing through the predetermined area;
A second sensor capable of detecting a person within the predetermined area and passing through an area closer to the camera than the first sensor;
Face recognition means for recognizing a face image from images captured by the camera when the first sensor detects passage and then the second sensor detects passage;
Face authentication means for determining whether the similarity between the face image recognized by the face recognition means and the face image stored in advance is greater than or equal to a threshold;
Face recognition comprising: an alarm means that operates when the authentication means does not determine that the similarity between the face image recognized by the recognition means and a face image registered in advance is equal to or greater than a threshold value. Alarm system used.   The time when the first sensor detects passage, the next time the second sensor detects passage, the moving image taken by the camera at the time, and the face recognition means recognizes the face at the time. The alarm system using face authentication according to claim 1, further comprising storage means for storing a face image and a result of determination made by the face authentication means at the time in association with each other. Storing a face image in a storage means in advance;
The camera continuously captures a predetermined area, the first sensor detects a person passing through the area, the second sensor is in the area, and is closer to the camera than the first sensor A step of recognizing a face image from an image captured by the camera when a person passing through the camera is detected;
A step of face authentication means determining whether the similarity between the face image recognized by the face recognition means and the face image stored in advance is equal to or greater than a threshold;
And a step of operating an alarm means when the face authentication means does not determine that the degree of similarity between the face image recognized by the face recognition means and a pre-registered face image is greater than or equal to a threshold value. Alarm method using face authentication.   The time when the first sensor detects passage, the next time the second sensor detects passage, the moving image taken by the camera at the time, and the face recognition means recognizes the face at the time. 4. The alarm method using face authentication according to claim 3, further comprising a step of storing a face image and a result of determination performed by the face authentication unit at the time in association with each other.

Images