JP2012168768A - Information terminal device and fingerprint authentication method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem that the usability of a user is conventionally damaged because fingerprint authentication is requested each time device operation is subjected to lock release.SOLUTION: This information terminal device performs operation by bringing a finger into contact with a display part, and the display part has a touch sensor for detecting the position of the finger brought into contact with the display part a plurality of times, and an image sensor for reading fingerprint information of the finger brought into contact with the display part. The information terminal device has a determining part for determining whether the fingerprint information read by the image sensor coincides with fingerprint information registered in advance each time the touch sensor detects the position of the finger.

Description

  The present invention relates to an information terminal device and a fingerprint authentication method thereof.

  For example, fingerprint authentication using a fingerprint sensor is known as means for identifying a person when using a terminal device such as a mobile phone. For example, Patent Document 1 proposes a technique in which a fingerprint authentication sensor is arranged on a display and a user confirms the identity by touching the display. Patent Document 2 proposes a technique for detecting a finger pressing state by a pressure sensor and reading a fingerprint with higher accuracy.

  According to these conventional techniques, fingerprint authentication can be performed by touching the display with a finger on a terminal device equipped with a touch panel.

JP 2002-159052 A JP 2001-101404 A

  In such a terminal device that has an identity verification function based on fingerprint authentication, it can be specified after the terminal device has been activated, after the user has locked the terminal device, or when the terminal device has not been operated for a certain period of time. Enter the authentication lock state with the conditions of. Then, after that, when using the terminal device, the user must perform fingerprint authentication and release the authentication lock. In the conventional system of such an authentication lock for security, the operation is troublesome for the user, and there are cases in which the fingerprint authentication function itself is disabled and used. Furthermore, there is a problem that security cannot be maintained when another person operates or steals the terminal in the unlocked state.

  An object of the present invention is to provide a terminal device that maintains security without impairing the usability of the user by automatically performing fingerprint authentication while the user operates the terminal device.

  One aspect of the present invention is an information terminal device that performs an operation by bringing a finger into contact with a display unit, wherein the display unit detects a position of a finger that has touched the display unit a plurality of times, and An image sensor that reads fingerprint information of a finger that touches the display unit, and determines whether the fingerprint information read by the image sensor matches the fingerprint information registered in advance each time the touch sensor performs detection. An information terminal device having a determination unit.

  Another aspect of the present invention is a fingerprint authentication control method for an information terminal device that performs an operation by touching a finger with the display unit, wherein the information terminal device determines the position of the finger that has touched the display unit a plurality of times. A touch sensor to detect, and an image sensor that reads fingerprint information of a finger that touches the display unit, and the fingerprint information read by the image sensor each time the touch sensor performs detection is pre-registered fingerprint information It is a fingerprint authentication control method of the information terminal device that determines whether or not it matches.

  According to the present invention, since the fingerprint authentication is automatically performed while the user is using the terminal device and the identity is confirmed, high security can be maintained without imposing a burden on the user.

2 is a block configuration of a wireless information terminal device according to the first exemplary embodiment; 3 is a specific example of the wireless information terminal device according to the first exemplary embodiment; 3 is an operation flowchart of the wireless information terminal device according to the first exemplary embodiment; 3 is an example of a fingerprint information registration screen of the wireless information terminal device according to the first exemplary embodiment; 3 is an example of an unlock screen of the wireless information terminal device according to the first exemplary embodiment; 3 is a block configuration of an information terminal device according to a second exemplary embodiment. 5 is a specific example of an information terminal device according to a second exemplary embodiment.

  Embodiment 1 of the Invention

  Hereinafter, a specific first embodiment to which the present invention is applied will be described in detail with reference to the drawings. In the first embodiment, the present invention is applied to a wireless information terminal device such as a mobile phone having a fingerprint authentication function.

  FIG. 1 shows a block circuit configuration of a wireless information terminal device 100 having a fingerprint authentication function according to the first embodiment. As shown in FIG. 1, the wireless information terminal device 100 includes a CPU (Central Processing Unit) 110, a memory unit 120, a display unit 130, a display control unit 140, a sensor control unit 150, a bus 160, and communication. The processing unit 170, the wireless unit 171, the antenna ANT, the input control unit 180, and operation keys 181 are included.

  FIG. 2A shows a specific usage example of the wireless information terminal device 100. As shown in FIG. 2 (a), the wireless information terminal device 100 has a display unit 130 on the front side of the device, and a user uses the finger on the display unit 130 to perform operations such as making a call. Do.

  The CPU 110 is connected to the memory unit 120, the display control unit 140, the sensor control unit 150, the communication processing unit 170, the input control unit 180, and the like via the bus 160. The CPU 110 performs arithmetic processing according to the control program and data developed in the memory unit 120. In accordance with a program executed by the CPU 110, images, characters, and the like are displayed on the display unit 130, and the user operates the wireless information terminal device 100 with a finger according to the displayed images.

  The memory unit 120 is a RAM that stores temporary data required when a control program executed by the CPU 110 is expanded or when the CPU 110 executes various calculations and controls. For example, the data includes fingerprint information registered in advance by the apparatus user. Moreover, a non-volatile memory such as a flash may be used.

  The display unit 130 includes a liquid crystal panel, an organic EL panel, and the like that can perform a touch operation using a finger in the image display area. The display unit 130 includes a display circuit 131, a touch sensor 132, an image sensor 133, and a pressure sensor 134. As shown in FIG. 2B, the display unit 130 includes a touch sensor 132, a display circuit 131, a pressure sensor 134, and an image sensor 133 that are stacked from the upper layer to the lower layer. This realizes an application operation with the user's finger and a fingerprint reading function.

  The display circuit 131 includes a liquid crystal panel, an organic EL panel, or the like. Image data (application image) such as characters and graphics output from the display control unit 140 is displayed.

  The touch sensor 132 is disposed in an upper layer of the display unit 130 and is used to operate an application image displayed on the display circuit 131 with a finger. As the touch sensor 132, for example, a sensor using a resistance film method or a sensor using a capacitance method is used.

  The image sensor 133 captures the user's finger and reads the fingerprint. For the image sensor 133, for example, an optical imaging device or the like is used.

  The pressure sensor 134 detects a pressure when the user presses the finger against the display unit 130 (hereinafter referred to as a pressing force).

  The display control unit 140 outputs image data transmitted from the CPU 110 or the like via the bus 160 as pixel data corresponding to the display circuit 131. In addition, it has other functions such as controlling the polarity inversion of the liquid crystal panel pixels.

  The sensor control unit 150 controls the touch sensor 132, the image sensor 133, and the pressure sensor 134. For example, coordinate data detected by the touch sensor 132, image data read by the image sensor 133, and pressure data detected by the pressure sensor 134 are transmitted to the CPU 110 via the bus 160.

  The wireless unit 171 is a circuit for the wireless information terminal device 100 to perform wireless communication with a mobile phone base station, a wireless LAN access point, and the like. For example, an analog circuit such as a high frequency amplifier and a filter, a modulation / demodulation circuit, and the like are provided. The wireless signal generated by the wireless unit 171 is transmitted to the mobile phone base station, the wireless LAN access point, etc. via the antenna ANT, and conversely, the wireless signal from the mobile phone base station, the wireless LAN access point, etc. is converted to the antenna ANT. Receive via.

  The communication processing unit 170 controls the wireless unit 171. For example, the data received by the wireless unit 171 is transmitted to the CPU 110 via the bus 160. The communication processing unit 170 and the wireless unit 171 can connect to a network such as a mobile phone base station, access various WEB sites, and display information on the network on the display unit 130.

  The operation key 181 accepts key input from the user of the wireless information terminal device 100.

  The input control unit 180 controls the operation keys 181. For example, an operation signal when the user presses the operation key 181 is transmitted to the CPU 110 via the bus 160.

  Next, the operation of the wireless information terminal device 100 will be described using the flowchart shown in FIG. First, as shown in FIG. 3, the user of the wireless information terminal device 100 first registers his / her fingerprint information (S101). An example of a fingerprint information registration screen is shown in FIG. The fingerprint information registered here is stored in the memory unit 120.

  After registering the fingerprint, the user activates an arbitrary application program of the wireless information terminal device 100 and operates the wireless information terminal device 100 according to characters, graphics, etc. according to the application program (S102). Then, while the user of the wireless information terminal device 100 is operating by touching the touch sensor 132 with a finger, the pressure sensor 134 detects the pressing force (S103). In step S103, in order to accurately read the fingerprint information, it is desirable that the fingertip is pressed against the display unit 130 as a whole, and an optimum pressing force capable of accurately reading the fingerprint information is hereinafter referred to as an optimum pressure value. Called.

  It is determined whether the pressure sensor 134 has the optimum pressing force value (S104). If it is determined that the value is not the predetermined optimum pressing force value (NO in S104), since there is a high possibility of erroneous recognition, the process proceeds to step S102 without performing fingerprint authentication.

  On the other hand, if it is determined in step S104 that the pressure is equal to or greater than the predetermined optimum pressing force value (S104 YES), the coordinates of the position touched by the finger are detected by the touch sensor 132 (S105). Then, the corresponding part of the finger is photographed by the image sensor 133, and the fingerprint information of the user is read (S106).

  Next, it is verified whether the fingerprint information detected in step S106 matches the registered fingerprint information of the user stored in the memory unit 120 registered in step S101 (S107). If it matches the registered fingerprint information (YES at S108), the number of mismatches is cleared to zero (S110), and the process proceeds to step S102.

  On the other hand, when it is determined that there is a mismatch with the registered fingerprint information (NO in S108), the number of mismatches is counted up (S109). The count number of the mismatch is recorded in the memory unit 120.

  Next, when the number of mismatches exceeds a predetermined value (for example, 10 times) (S111), the screen transits to an identity confirmation screen as shown in FIG. 4, and identity verification is performed again by fingerprint authentication (S112). The reason why the number of mismatches is set to a specified value such as 10 times and the transition to the personal confirmation screen is not performed immediately after a single mismatch is because the recognition rate is reduced in fingerprint detection during operation.

  If the identity can be confirmed in step S112 (YES in S113), the number of mismatches is cleared to zero (S114), and the process proceeds to step S102. If the identity cannot be confirmed (NO in S113), the identity confirmation screen in step S112 is displayed until confirmation is possible.

  Further, as a means for identifying the person in the case where the number of mismatches of the fingerprint information in step S111 described above exceeds a specified value, an unlock number as shown in FIG. 5 is displayed, and whether or not the unlock number is a correct value. It is good also as identity verification by. As a result, when the user does not match the registered fingerprint information due to an injury to the finger or when the fingerprint information cannot be correctly detected due to a failure of the image sensor 133 or the like, the wireless information terminal device The situation where 100 becomes completely inoperable can be avoided.

  According to the wireless information terminal device 100 having the fingerprint authentication function according to the first embodiment as described above, while the user is using the terminal device, the operation described with reference to FIG. Verify your identity by authentication. For this reason, identity verification can be performed without imposing a burden on the user due to frequent authentication lock release operations that have been a problem in the past. Therefore, the wireless information terminal device 100 having the fingerprint authentication function according to the first embodiment can ensure high security while providing excellent usability.

  Further, when the wireless information terminal device 100 is used by a person other than the user himself / herself in a state where the lock is not released, high security can be ensured by making a transition to the user confirmation screen.

  Embodiment 2 of the Invention

  Hereinafter, a specific second embodiment to which the present invention is applied will be described in detail with reference to the drawings. In the second embodiment, the present invention is applied to an information terminal device such as an ATM having a fingerprint authentication function.

  FIG. 6 shows a block circuit configuration of an information terminal device 200 having a fingerprint authentication function according to the second embodiment. As shown in FIG. 1, the information terminal device 200 includes a CPU (central processing unit) 110, a memory unit 120, a display unit 230, a display control unit 140, a sensor control unit 150, a bus 160, and an external connection. Part 210.

  FIG. 6A shows a specific usage example of the information terminal device 200. As an example, there are a touch panel type ATM, a ticket machine, and the like. In addition, the structure which attached | subjected the code | symbol same as FIG. 1 among the codes | symbols shown in FIG. 6 has shown the structure similar to or similar to FIG. In the first embodiment, an example in which the present invention is applied to a mobile terminal device such as a mobile phone is shown. However, in the second embodiment, a stationary information terminal device is assumed. For this reason, unlike the first embodiment, the wireless unit 171 and the communication processing unit 170 are deleted. When the user's operation target is only the display unit 130, the operation key 181 and the input control unit 180 can also be deleted. In the second embodiment, portions different from the first embodiment will be mainly described, and descriptions of other similar portions will be omitted.

  The external connection unit 210 performs data input / output between the bus 160 and a network 211 such as a LAN or WAN to which the information terminal device 200 is connected. In this case, the information held by the server of the network 211 connected to the external connection unit 210 can be read to the information terminal device 200 when necessary.

  In this case, for example, even if the user's fingerprint information is not held in the information terminal device 200, it can be read from the network 211 when necessary by holding it in the network 211 connected to the external connection unit 210. Therefore, it is possible to skip registration of fingerprint information in step S101 described in the operation flowchart of the first embodiment.

  In the first embodiment, a liquid crystal panel and an organic EL panel are used as the display circuit 131 in consideration of portability. However, in the second embodiment, as shown in FIG. The display circuit 231 may be a cathode ray tube. Thus, it is possible to display a high-speed, high-brightness and fine image to the user.

  In the first embodiment, a resistive film type or capacitive type sensor is used as the touch sensor 132. However, in the second embodiment, as shown in FIG. An optical touch sensor 232 that detects the coordinates of the touched finger by a combination of infrared LEDs 241 and infrared light receiving elements 242 attached to the top, bottom, left and right of the screen frame may be used instead.

  Note that the stacked state of the display circuit 231, the touch sensor 232, the image sensor 133, and the pressure sensor 134 of the display unit 230 is as illustrated in FIG. 6B and is different from that of the first embodiment. .

  According to the information terminal device 200 having the fingerprint authentication function according to the second embodiment as described above, it is possible to automatically perform identity verification by fingerprint authentication while the user is using the terminal device. The same effects as those of the first embodiment can be obtained. In addition, by reading out the registered fingerprint information held in the network 211 connected to the external connection unit 210 when necessary, it is possible to register the information terminal device without only needing fingerprint information after that, only by registering fingerprint information once. It is possible to operate. As described above, it is possible to ensure high security while providing further excellent usability as compared with the first embodiment.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention. For example, the fingerprint information held in the network 211 described in the second embodiment may be for a plurality of users. In this case, the content displayed on the display unit 230 by the information terminal device 200 can be changed for each user associated with the fingerprint information held in the network 211. Thus, for example, it can be applied to an information terminal used by a plurality of people, such as a financial institution ATM. Furthermore, a plurality of information terminal devices 200 may be connected to the network 211, respectively. In this case, when a specific user uses the information terminal device 200 in a different place, it can be used without requesting fingerprint information registration for each use information terminal device 200.

100 Wireless information terminal device 110 CPU
120 Memory unit 130 Display unit 131 Display circuit 132 Touch sensor 133 Image sensor 134 Pressure sensor 140 Display control unit 150 Sensor control unit 160 Bus 170 Communication processing unit 171 Radio unit ANT Antenna 180 Input control unit 181 Operation key 200 Information terminal device 210 External Connection unit 211 Network 230 Display unit 231 Display circuit 232 Touch sensor

Claims (9)

An information terminal device that operates by touching a finger to the display unit,
The display unit is
A touch sensor that detects the position of the finger that has touched the display unit a plurality of times;
An image sensor that reads fingerprint information of a finger in contact with the display unit,
An information terminal device comprising: a determination unit configured to determine whether fingerprint information read by the image sensor matches with fingerprint information registered in advance each time the touch sensor performs detection. The display unit further includes a pressure sensor that detects a pressure with which a finger touching the display unit presses the display unit,
The information terminal device according to claim 1, wherein the determination unit determines whether the image sensor can read fingerprint information of a finger in contact with the display unit according to a pressure detected by the pressure sensor. The information terminal device according to claim 1 or 2, wherein the determination unit locks the operation of the device when fingerprint information read by the image sensor does not match the pre-registered fingerprint information. The said determination part locks operation of the said apparatus, when the frequency | count when the fingerprint information which the said image sensor read does not correspond with the said previously registered fingerprint information becomes a regulation value. Information terminal equipment. A fingerprint authentication control method for an information terminal device that performs an operation by touching a finger to a display unit,
The information terminal device includes a touch sensor that detects a position of a finger that has touched the display unit a plurality of times, and an image sensor that reads fingerprint information of the finger that has touched the display unit,
A fingerprint authentication control method for an information terminal device that determines whether the fingerprint information read by the image sensor matches the fingerprint information registered in advance each time the touch sensor performs detection. The display unit further includes a pressure sensor that detects a pressure with which a finger touching the display unit presses the display unit,
The fingerprint authentication control method for an information terminal device according to claim 5, wherein the image sensor determines whether the image sensor can read fingerprint information of a finger touching the display unit according to the pressure detected by the pressure sensor. The fingerprint authentication control method for an information terminal device according to claim 5 or 6, wherein when the fingerprint information read by the image sensor does not match the pre-registered fingerprint information, the operation of the information terminal device is locked. The information terminal according to claim 7, wherein the operation of the information terminal device is locked when the number of times when the fingerprint information read by the image sensor does not match the pre-registered fingerprint information becomes a specified value. Device fingerprint authentication control method. 9. The fingerprint authentication control method for an information terminal device according to claim 7, wherein when the operation of the information terminal device is locked, the locked state is released by an operation other than the fingerprint information.

Images