JP2013140440A - Information processing device and driving method for the same, control program and readable storage medium - Google Patents

Abstract

Security management using biometric authentication is performed automatically at the time of start-up or operation, without adding a new operation to the current operation, and at the same time achieving both ease of operation and confidentiality.
In an information processing apparatus 1 having a touch panel on a display screen 3, a fingerprint sensor 6 is provided at an end of the apparatus on an extension line of an activation slide operation with a finger on the touch panel, and an operator's fingerprint captured by the fingerprint sensor 6 is provided. If the fingerprint authentication unit 111 that matches the information and the registered fingerprint information of the administrator matches the verification result by the fingerprint authentication unit, an icon selection screen of a plurality of icons having a confidential function is displayed, and the verification result does not match In this case, the icon screen display means 112 that does not display the icon selection screen, the face image authentication camera 5 that captures the face image of the operator, and the face image and information of the operator that are captured by the face image authentication camera 5 It has face image authentication means 113 for collating with the registered face image of the manager of the processing apparatus 1.
[Selection] Figure 1

Description

  The present invention relates to an information processing apparatus having a touch panel typified by a mobile phone device, a driving method thereof, a control program in which processing procedures for causing a computer to execute each step of the information processing apparatus driving method, The present invention relates to a computer-readable readable storage medium storing a control program.

  This type of conventional information processing apparatus is used, for example, in a mobile phone device or the like, and a touch panel is used for its display screen. After turning on the power, touching the abdomen (fingerprint side) of the fingertip on the touch panel on the display screen will display multiple icons on the display screen. If you continue to touch the icon on the abdomen of the fingertip, While the application is selected, the fingerprint of the user who operates with the abdomen of the fingertip is read by the touch panel. The fingerprint information of the user read by the conventional information processing apparatus is collated to determine whether it is the fingerprint of the administrator of the registered apparatus. As a result of the fingerprint collation by the information processing apparatus, the application of the selected icon is executed only when the read fingerprint is a fingerprint of an administrator who has execution authority. This is proposed in Patent Document 1.

  Further, in Patent Document 1, an icon is displayed on the display screen even after execution of the application is started, and by touching the icon on the display screen with the abdomen (fingerprint side) of the fingertip, Whether or not the fingerprint of the touched fingertip is the administrator's fingerprint is collated, and if not, the application is forcibly terminated even after the application is executed once.

  FIG. 13 is a block diagram showing a system configuration of a conventional mobile phone device disclosed in Patent Document 1. In FIG.

  As shown in FIG. 13, the conventional cellular phone device 100 receives signals from various communication devices by the antenna AT, outputs the received signals to the system control unit 103, and transmits the signals generated by the system control unit 103. A wireless processing unit 101 that transmits signals to various communication devices via an antenna AT, a touch panel 102 for displaying a screen that includes a touch sensor 102a with a scanner function and a liquid crystal display panel 102b, and a CPU (medium arithmetic processing unit). The system control unit 103 configured to control each unit and the voice data from the system control unit 103 are converted into voice and output, and the input voice from the outside is converted into voice data and output to the system control unit 103 An OS program and a voice processing unit 104, which are composed of a ROM and a RAM and execute the CPU. Various control programs and data such as a plurality of application programs and a memory 105 stored.

  The touch panel 102 is controlled by the system control unit 103 to display various information such as icons and characters for starting the application program on the display screen. The touch panel 102 detects an operation command by the abdomen of the user's fingertip with respect to the display screen by the touch sensor 102a, outputs an operation command signal to the system control unit 103, and detects a fingerprint of the user's fingertip that has touched the display screen. The detected fingerprint data is output to the system control unit 103.

  FIG. 14 is a flowchart for explaining a confidential management operation for executing an application for which a security lock is set in the operation of the conventional mobile phone device.

  As shown in FIG. 14, first, in step S101, execution of an application for which a security lock has been set via the main menu process is started. At this time, an operation menu for operating the application whose execution has been started is displayed on the display screen in step S102.

  Next, when an administrator or a third party of the device touches a predetermined operation item in the operation menu with the abdomen (fingerprint side) of the fingertip (step S103), the fingerprint of the touched fingertip is read by the touch sensor 102a. Then, the read fingerprint data and the fingerprint data of the administrator registered in the memory 105 in advance are collated (step S104), and the read fingerprint data matches the registered fingerprint data (YES in step S105). Is determined to be an administrator and the process proceeds to step S106. If the read fingerprint data and the registered fingerprint data do not match (NO in step S105), it is determined that the person is a third person, and the process proceeds to step S108.

  If the fingerprint data read in step S105 matches the registered fingerprint data, the operation menu selected in step S106 is executed, and the operations in and after step S102 are repeated until the end of the application is confirmed. After confirming, return to the main menu processing.

  If the fingerprint data read in step S105 does not match the registered fingerprint data, various parameters are stored as setting information necessary for restarting the application in step S108, and the flag is set to “1” in step S109. Record that the performer is a third party.

  After that, in step S110, an operation history regarding what operation the third person of the executor tried to execute with which application is recorded in the memory 105, and the application is forcibly terminated in step S111.

JP 2011-49876 A

  In the conventional mobile phone device disclosed in Patent Document 1, fingerprint authentication is performed based on fingerprint data acquired when the touch panel 102 is touched with a fingertip, and security is authenticated. The touch position identification accuracy is about 3 mm to 5 mm at most because it depends on the electrode density configured on the touch panel 102, and even if the display accuracy of the touch panel 102 is high, the touch position recognition accuracy of the touch panel 102 can be used to perform fingerprint authentication. Had the problem of being inadequate. In short, the touch panel 102 is not accurate enough to authenticate a fingerprint.

  Therefore, even an administrator's fingerprint can be determined to be inconsistent with the registered fingerprint data as a result of fingerprint verification. Even if it is not a registrant's fingerprint, it may be determined as registered data as a result of fingerprint verification. As described above, the fingerprint information acquired by the touch panel 102 has low measurement accuracy and cannot maintain sufficient security, and misidentifies a regular administrator of the device as a non-administrator, There was a risk of misunderstanding as an administrator.

  In addition, in the above conventional mobile phone device, in order to ensure security after the execution of the application is started, the screen returns to the icon display screen during the execution of the application, and the fingerprint authentication operation is required again. When used by a person, there is a problem that the operation is troublesome.

  The present invention solves the above-described conventional problems, and at the time of start-up or operation, automatically adds a new operation to the current operation without any new operation, and achieves both ease of operation and confidentiality, and performs biometric authentication. Information processing apparatus that can be used for security management and its driving method, a control program that describes a processing procedure for causing a computer to execute each step of the information processing apparatus driving method, and the control program stored therein An object is to provide a computer-readable readable storage medium.

  An information processing apparatus according to the present invention is an information processing apparatus having a touch panel on a display screen, wherein a fingerprint sensor is provided at an end of the apparatus on an extension line of an activation slide operation by a finger on the touch panel, and an operator captured by the fingerprint sensor When the fingerprint authentication means for comparing the fingerprint information of the user and the registered fingerprint information of the administrator matches the matching result by the fingerprint authentication means, an icon selection screen for one or more icons having a confidential function is displayed. In the case where the collation results do not match, the apparatus has an icon screen display unit that does not display the icon selection screen, thereby achieving the above object.

  Preferably, the fingerprint sensor in the information processing apparatus of the present invention is provided at one end or both ends of the apparatus on an extension line of the activation slide operation by the finger with respect to the touch panel.

  Further preferably, the fingerprint sensor in the information processing apparatus of the present invention is configured to be able to read the fingerprint of one or a plurality of fingers, and the fingerprint authentication means includes the fingerprint information of the one or more fingers read The registered fingerprint information of the administrator corresponding to this is collated.

  Further, preferably, there are a plurality of security levels of applications for which security is required by a plurality of fingerprint collations in the information processing apparatus of the present invention.

  Further preferably, in the information processing apparatus according to the present invention, the second fingerprint matching is performed when the first fingerprint matching is performed, and the security is first required when the second fingerprint matching is performed. In the case where the second fingerprint verification does not match, it is assumed that the application requires security second.

  Further preferably, in the information processing apparatus of the present invention, when the first fingerprint collation is performed, the second fingerprint collation is performed, and when the second fingerprint collation is performed, the third fingerprint collation is performed. If the third fingerprint verification matches, the security is the first required application, and if the third fingerprint verification does not match, the second security is the required application, and the second fingerprint verification does not match In this case, it is assumed that the application requires security third.

  Further preferably, in the information processing apparatus of the present invention, a face image authentication camera capable of capturing an operator's face image, the operator's face image captured by the face image authentication camera, and the administrator's The image processing apparatus further includes a face image authentication unit that collates the registered face image, and an application control unit that terminates the application when the face image collation does not match and continues the application when the face image collation matches.

  Furthermore, preferably, the face image authentication cycle is set to be short in steps according to the importance of the security level in the information processing apparatus of the present invention.

  Further preferably, the information processing apparatus of the present invention further includes a power shut-off means for backing up the history data and shutting off the power when the collation result by the fingerprint authentication means or the face image authentication means does not match.

  Further preferably, the fingerprint sensor in the information processing apparatus of the present invention is configured by a line sensor or an area sensor.

  Further preferably, the fingerprint sensor in the information processing apparatus of the present invention has a size capable of simultaneously acquiring fingerprints of a plurality of fingers.

  Further preferably, the surface friction coefficient around the fingerprint sensor is set larger than the display screen area in the information processing apparatus of the present invention.

  Further, preferably, the face image authentication means in the information processing apparatus of the present invention is configured to detect a face image, whether or not blinking, whether a nose shadow is projected on the face, or a face image captured by illumination in a predetermined direction. The length of the shadow of the nose is detected, or 3D image verification is performed with a 3D camera including two 2D cameras.

  The information processing apparatus drive method of the present invention is a method for driving an information processing apparatus having a touch panel on a display screen, wherein a fingerprint sensor is provided at an end of the apparatus on an extension line of a start slide operation by a finger on the touch panel, and fingerprint authentication is performed. When the fingerprint authentication process in which the means matches the fingerprint information of the operator captured by the fingerprint sensor with the registered fingerprint information of the administrator and the matching result by the fingerprint authentication means match, the icon screen display means An icon selection screen for one or a plurality of icons having a function is displayed, and an icon screen display step for not displaying the icon selection screen when the collation result does not match is achieved. Is done.

  Preferably, the fingerprint sensor in the driving method of the information processing apparatus of the present invention is provided at one end or both ends of the apparatus on an extension line of the activation slide operation by the finger with respect to the touch panel.

  Further preferably, the fingerprint sensor in the driving method of the information processing apparatus according to the present invention is configured to be able to read a fingerprint of one or a plurality of fingers, and the fingerprint authentication means reads 1 or The fingerprint information of a plurality of fingers and the registered fingerprint information of the administrator corresponding to the fingerprint information are collated.

  Further, preferably, there are a plurality of security levels of applications for which security is required by a plurality of fingerprint collations in the method of driving the information processing apparatus of the present invention.

  Further preferably, in the driving method of the information processing apparatus of the present invention, the second fingerprint collation is performed when the first fingerprint collation is matched, and the security is first when the second fingerprint collation is matched. It is assumed that the application is required, and the security is second required when the second fingerprint verification does not match.

  Further preferably, in the method for driving the information processing apparatus of the present invention, the second fingerprint matching is performed when the first fingerprint matching is performed, and the third fingerprint matching is performed when the matching is performed by the second fingerprint matching. When the third fingerprint verification matches, the security is first required, and when the third fingerprint verification does not match, the security is second required, and the second fingerprint It is assumed that the security is the third requirement when the verification does not match.

  Further preferably, in the method for driving the information processing apparatus according to the present invention, the face image authentication camera captures the face image of the operator by the face image authentication camera, and the face image authentication means captures the face image authentication camera. When the face image authentication step for comparing the face image of the operator with the registered face image of the administrator and the application control means terminate the application when the face image matching does not match, and the face image matching matches And an application control process for continuing the application.

  Further, preferably, the face image authentication cycle is set to be shortened stepwise in accordance with the importance of the security level in the driving method of the information processing apparatus of the present invention.

  Further preferably, when the collation result by the fingerprint authentication means or the face image authentication means in the driving method of the information processing apparatus of the present invention is inconsistent, the power shut-off step of shutting off the power by backing up the history data It has further.

  Further preferably, in the face image authentication step in the driving method of the information processing apparatus of the present invention, the face image authentication means, in addition to the collation of the face image, whether the blinking, the nose of the face image captured by the predetermined illumination 3D image verification is performed using a 3D camera including two 2D cameras.

  The control program according to the present invention describes a processing procedure for causing a computer to execute each step of the method for driving the information processing apparatus according to the present invention, thereby achieving the above object.

  The readable storage medium of the present invention is a computer-readable storage medium storing the control program of the present invention, thereby achieving the above object.

  With the above configuration, the operation of the present invention will be described below.

  According to the present invention, in an information processing apparatus provided with a touch panel on a display screen, a fingerprint sensor is provided at an apparatus end on an extension line of a start slide operation with a finger on the touch panel, and the fingerprint information of the operator captured by the fingerprint sensor A fingerprint authentication unit that collates the registered fingerprint information of the administrator and a matching result by the fingerprint authentication unit, and displays an icon selection screen of a plurality of icons corresponding to an application having a confidential function, If the results do not match, an icon screen display unit that does not display the icon selection screen is provided. Further, the information processing apparatus is capable of capturing a face image authentication camera capable of capturing an operator's face image (for example, an iris), and registering the operator's face image captured by the face image authentication camera and the administrator. The image processing apparatus further includes a face image authenticating unit that compares the face image and an application control unit that terminates the application when the face image matching does not match and continues the application when the face image matching matches.

  As a result, it is possible to perform advanced security maintenance without performing troublesome operations for security maintenance. In addition, even when the security operation is forgotten when the application operation is interrupted, it is possible to prevent a problem from occurring due to confidentiality. Furthermore, the present invention is not limited to a portable terminal, and can be applied to medium-sized and large-sized touch panels.

  As described above, since the fingerprint sensor is provided at the end of the device on the extension line of the start slide operation with the finger on the touch panel, at the time of start-up or operation, the operation is automatically performed without adding a new operation to the current operation. Security management can be performed using biometric authentication.

  As described above, according to the present invention, since the fingerprint sensor is provided at the device end on the extension line of the activation slide operation with the finger on the touch panel, at the time of activation or operation, automatically without adding a new operation to the current operation, Security management can be performed using biometric authentication, with both ease of operation and confidentiality.

BRIEF DESCRIPTION OF THE DRAWINGS It is an external view which shows the principal part structural example of the information processing apparatus in Embodiment 1 of this invention, Comprising: (a) is the front view, (b) is the back view. FIG. 7 is a front view for explaining application activation and fingerprint acquisition operations in the information processing apparatus of FIG. 1. (A) is an external appearance front view which shows the modification of the information processing apparatus 1 of FIG. 1, (b) And (c) is an external appearance front view for demonstrating application starting operation | movement and fingerprint acquisition operation | movement. (A) is an external appearance front view which shows another modification of the information processing apparatus 1 of FIG. 1, (b) is an external appearance front view for demonstrating application starting operation | movement and fingerprint acquisition operation | movement. (A) is an external appearance front view which shows another modification of the electronic information device of FIG. 1, (b) is an external appearance front view for demonstrating the application starting operation | movement and fingerprint acquisition operation | movement in this case. . It is a block diagram which shows the basic system structural example of the information processing apparatus in Embodiment 1 of this invention. It is a block diagram which shows the specific system configuration example of the information processing apparatus in Embodiment 1 of this invention. It is a figure which shows the specific example of the various information memorize | stored in the memory | storage part of FIG. 6 and FIG. It is a flowchart which shows the 1st example of application starting of this Embodiment 1, fingerprint acquisition collation operation | movement, and face image acquisition collation operation | movement. 10 is a flowchart for explaining in detail the background face image authentication process of FIG. 9. It is a flowchart which shows the 2nd example of application starting of this Embodiment 1, fingerprint acquisition collation operation, and face image acquisition collation operation. (A)-(e) is a front view of the information processing apparatus for demonstrating the operation example different from the operation example of FIG. 7 and FIG. 1 is a block diagram showing a system configuration of a conventional mobile phone device disclosed in Patent Document 1. FIG. 10 is a flowchart for explaining a confidential management operation for executing an application in which a security lock is set in the operation of a conventional mobile phone device.

  Embodiment 1 of an information processing apparatus and a driving method thereof according to the present invention will be described below in detail with reference to the drawings. In addition, each thickness, length, etc. of the structural member in each figure are not limited to the structure to illustrate from a viewpoint on drawing preparation.

(Embodiment 1)
1A and 1B are external views showing a configuration example of a main part of an information processing apparatus according to Embodiment 1 of the present invention. FIG. 1A is a front view thereof, and FIG. 1B is a rear view thereof.

  As shown in FIG. 1A, the information processing apparatus 1 according to the first embodiment is configured by a touch panel unit including a display unit and a touch sensor on the display unit at the center of the surface of a surface protecting housing 2. A large display screen 3 is provided. An audio output unit 4 and a face image authentication camera 5 are provided side by side on the upper outer periphery of the display screen 3. In addition, a fingerprint sensor 6 for fingerprint authentication that is elongated in the vertical direction is provided on the right side of the outer periphery of the display screen 3 and on the lower side thereof. The size of the fingerprint sensor 6 in the vertical direction is about ¼ side from the lower end of the right side of the display screen 3. Further, on the lower side of the outer periphery of the display screen 3, a button switch 7 as a key input unit for turning on / off the power is provided on the left side, and a sound collecting unit 8 for collecting sound is provided on the right side. On the other hand, as shown in FIG. 1B, an imaging camera module 9 is provided at an upper right position on the back surface of the housing 2.

  The display screen 3 is composed of a display unit and a touch panel unit incorporating a touch sensor thereon. In addition to the liquid crystal display panel, the display unit may be an organic EL display panel or a display panel that displays images such as still images and moving images. The touch panel is a position selection screen that is configured integrally with an upper portion of the display unit, touches with a finger or a pen, reads the touch coordinates, and reflects the information on the display unit. Note that a touch panel capable of multi-touch operation is actually limited to a capacitance type. In the first embodiment, the touch operation with one finger may be a resistive film type or a capacitance type. The number of multi-touch touch panels is increasing.

  The audio output unit 4 converts audio data from a control unit, which will be described later, into audio and outputs it. The audio output unit 4 includes a speaker, an earphone, and the like, and outputs music, voice, and the like. If it is a stereo type, it is necessary to output an output signal of two channels or more.

  The face image authentication camera 5 is a camera for self-portrait, and uses image data captured by the camera for face image authentication. This face image authentication camera is a camera that captures the face of the person who is operating the touch panel unit, and is provided on the display screen side of the touch panel in order to capture a self-portrait to be operated. A CCD or area sensor with millions of pixels or more is desirable, and it is desirable to use a CCD or CMOS image sensor with 10 million pixels or more that has already been put to practical use in order to improve the security accuracy.

  The fingerprint sensor 6 is a fingerprint reading device constituted by an area sensor, and uses a CCD or a CMOS image sensor in order to increase the identification accuracy of an individual from the read fingerprint. In addition, an area sensor that reads a two-dimensional image or a line sensor that reads information one-dimensionally may be used, but in order to prevent the acquired image information from becoming unstable due to the moving speed of the finger, 2 A dimension sensor is desirable. A light source such as an LED and an optical sensor are integrated, and a fingerprint region to be authenticated is irradiated with the light source, and the reflected light is received by the photoelectric conversion sensor. Note that current photoelectric conversion sensors have an identification accuracy of 1/10 or more of the interval between the crests and troughs of fingerprints, and can be used for fingerprint authentication. It can be configured with a narrow width of several mm or less formed by a combination of an edge light type LED component and an area sensor. A product having a thickness of about 0.6 mm has been put to practical use as an edge light for mobile phones. The line sensor has the same thickness.

  When this button is turned on, the button switch 7 shifts from the power-off state to the initial screen display state. Information not related to security, such as a standby image and item display, is displayed, but in this state, the application selection screen has not been reached.

  The sound collection unit 8 is a microphone, converts input sound from the outside into sound data, and outputs the sound data to a control unit described later.

  The image capturing camera 9 incorporates a camera module for normal photographing. The image capturing camera 9 is a camera that captures surrounding images and videos, and is provided on the back side of the display screen 3. CCDs and area sensors with millions of pixels or more are provided.

  In the application selection screen from the standby screen of the display screen 3 after the power is turned on by the button switch 7, the casing of the fingertip with the fingerprint is placed on the extension line of the finger slide operation direction for starting the application. A fingerprint sensor 6 such as an area sensor is provided in the vertical direction along the outer peripheral frame 2.

  Here, application activation and fingerprint acquisition operation will be described in detail with reference to FIG.

  FIG. 2 is a front view for explaining application activation and fingerprint acquisition operations in the information processing apparatus of FIG.

  As shown in FIG. 2, in order to shift from the sleep mode to the active mode, sensor means 6 as a fingerprint authentication module is placed at the end of the housing 2 next to the display screen on the extension line of the fingertip slide operation (from left to right). Is incorporated.

  The icon on the display screen of the touch panel 3 is selected and activated by the abdomen (fingerprint side) of one fingertip, and the fingertip moves over the elongated fingerprint authentication sensor means 6 provided in the direction of operation flow of the activated fingertip. Fingerprint information is taken in through the abdomen (fingerprint side) and fingerprint authentication is performed with the registered fingerprint data. As described above, the operator of the information processing apparatus 1 includes the fingerprint acquisition operation in a series of finger slide operations to start the application without separately performing the fingerprint acquisition operation. The cumbersome operation is no longer necessary. Security can be ensured based on fingerprint data obtained during the application activation operation. Examples of applications that require security include mail, a telephone number book, and a wallet function.

  A face image authentication camera 5 as a self-portrait camera module is incorporated on the upper side of the display screen. Thus, even after the application execution is started, face image authentication is performed with the registered face image authentication data using the image data captured by the face image authentication camera 5, so that the face image authentication does not match and used by others. In this case, the application can be forcibly terminated.

  In the state where the information processing apparatus 1 is in a display state such as a standby screen or an application selection screen after the power is turned on, the fingertip slide operation for starting the application may be an index finger, but an operation performed with the thumb Since this method can be performed more stably and the fingerprint acquisition area of the thumb is the largest, the amount of information to be collated is large, and the security is high as fingerprint authentication.

  Next, a case where a fingerprint sensor is provided on the opposite side separately from the fingerprint sensor 6 to perform fingerprint authentication of the index finger and the middle finger will be described with reference to FIG.

  FIG. 3A is an external front view showing a modified example of the information processing apparatus 1 in FIG. 1, and FIGS. 3B and 3C are diagrams for explaining an application activation operation and a fingerprint acquisition operation. It is an external appearance front view.

  As shown in FIG. 3A, the information processing apparatus 1 </ b> A according to the first embodiment has a display screen 3 including a display unit and a touch panel unit with a built-in touch sensor at the center of the surface of the housing 2. Largely provided. An audio output unit 4 and a face image authentication camera 5 are provided side by side on the upper outer periphery of the display screen 3. In addition, a fingerprint sensor 6 for fingerprint authentication that is elongated in the vertical direction is provided on the right side of the outer periphery of the display screen 3 and on the lower side thereof. The vertical size of the fingerprint sensor 6 is about ¼ side from the lower end of the right side of the display screen 3. Further, on the lower side of the outer periphery of the display screen 3, a button switch 7 as a key input unit for turning on / off the power is provided on the left side, and a sound collecting unit 8 for collecting sound is provided on the right side. Further, on the left side of the outer periphery of the display screen 3 and slightly below the center, a fingerprint sensor 4A for fingerprint authentication that is elongated in the vertical direction is provided. The fingerprint sensor 6A is provided in a size of about ¼ side from the center position of the left side of the display screen 3 to the lower side.

  As shown in FIG. 3A, the slide operation direction is extended from the left to the right of the index finger for starting the selected application on the application selection screen from the standby screen of the display screen 3 after the power is turned on by the button switch 7. A fingerprint sensor 6 such as an area sensor is provided in the vertical direction along the outer peripheral frame on the right side of the housing 2 so that the abdomen of the fingertip with a fingerprint is placed on the line. Further, as shown in FIG. 3 (b), the housing 2 is placed so that the abdomen of the fingertip with the fingerprint is on the extension line of the sliding direction of the middle finger from the right to the left for starting the selected application. Sensor means 6A such as an area sensor is provided in the vertical direction along the left outer peripheral frame.

  In this way, confidentiality can be enhanced by using different fingers for the sliding operation when starting the first application and performing fingerprint authentication and the sliding operation when selecting the next application. Also, fingerprint sensors 6 and 6A are provided on the left and right, the slide operation direction of the next application selection operation is the opposite direction to the first slide operation, and the positions of the left and right fingerprint sensors 6 and 6A are provided at different heights. It is not necessary to change the operation position of the operation, and the operation is further simplified.

  Next, a case will be described in which fingerprints of the index finger and the middle finger are collated at the same time in a selection operation of selecting a high-security application with a plurality of fingers, for example, the index finger and the middle finger. In this case, the confidentiality of the index finger and the middle finger is higher than that of the operation of performing fingerprint collation with one thumb.

  4A is an external front view showing another modified example of the information processing apparatus 1 in FIG. 1, and FIG. 4B is an external front view for explaining an application activation operation and a fingerprint acquisition operation. is there.

  As shown in FIG. 4A, the information processing apparatus 1 </ b> B according to the first embodiment has a display screen 3 including a display unit and a touch panel unit with a built-in touch sensor at the center of the surface of the housing 2. Largely provided. An audio output unit 4 and a face image authentication camera 5 are provided side by side on the housing 2 on the outer periphery of the display screen 3. In addition, a fingerprint sensor 6B for fingerprint authentication that is elongated in the vertical direction is provided on the casing 2 on the right side of the outer periphery of the display screen 3 so as to be fully extended along the right side of the display screen 3. Further, a button switch 7 as a key input unit for turning on / off the power supply is provided on the left side of the casing 2 on the lower outer periphery of the display screen 3, and a sound collecting unit 8 for collecting sound is provided on the right side thereof. ing.

  In the application selection screen from the standby screen on the display screen 3 after the power is turned on by the button switch 7, a plurality of fingertips with fingerprints are placed on the extension line in the simultaneous sliding operation direction of the plurality of fingers for starting the selected application. A sensor means 6B such as an area sensor is provided long in the vertical direction along the outer peripheral frame of the housing 2.

  As shown in FIG. 4B, the fingerprints of the index finger and the middle finger are collated at the same time in a selection operation of selecting a high-security application with a plurality of fingers, for example, the index finger and the middle finger. Accordingly, the confidentiality of the index finger and the middle finger can be improved compared to the operation of performing fingerprint collation with a single thumb, for example.

  Next, when fingerprints of a plurality of fingers, for example, the index finger and the middle finger are collated at the same time, and fingerprints of a total of four fingers are collated by collating each finger of another finger, for example, the ring finger and the child finger at the same time Will be described. In this case, the confidentiality of the four can be improved compared to the operation of performing the two fingerprint collations.

  FIG. 5A is an external front view showing still another modified example of the electronic information device of FIG. 1, and FIG. 5B is an external view for explaining an application activation operation and a fingerprint acquisition operation in this case. It is a front view.

  As shown in FIG. 5A, the information processing apparatus 1C according to the first embodiment has a display screen 3 including a display unit and a touch panel unit with a built-in touch sensor at the center of the surface of the housing 2. Largely provided. An audio output unit 4 and a face image authentication camera 5 are provided side by side on the upper outer periphery of the display screen 3. In addition, a fingerprint sensor 6B for fingerprint authentication that is elongated in the vertical direction is provided on the casing 2 on the right side of the outer periphery of the display screen 3 so as to be fully extended along the right side of the display screen 3. Similarly, a fingerprint sensor 6C for fingerprint authentication that is elongated in the vertical direction is provided on the casing 2 on the left side of the outer periphery of the display screen 3 so as to be full along the left side of the display screen 3. Further, on the lower side of the outer periphery of the display screen 3, a button switch 7 as a key input unit for turning on / off the power is provided on the left side, and a sound collecting unit 8 for collecting sound is provided on the right side.

  On the application selection screen from the standby screen on the display screen 3 after the power is turned on by the button switch 7, on the extension line of a plurality of fingers for activating the selected application, for example, the index finger and the middle finger simultaneously sliding movement direction (left to right) Sensor means 6B such as an area sensor is provided long in the vertical direction along the outer peripheral frame of the housing 2 so that a plurality of (here, two) fingertips with fingerprints are applied.

  As shown in FIG. 5B, the fingerprints of the ring finger and the child finger are simultaneously collated in the selection operation of selecting a high-security application using another plurality of fingers (here, two fingers), for example, the ring finger and the child finger. To do. As a result, compared to the operation of two fingerprint fingerprints, for example, the index finger and the middle finger at the same time, in addition to the index finger and the middle finger, the ring finger and the child finger are added, resulting in a total of four fingerprint authentications. , The confidentiality can be further increased.

  The fingerprint sensors 6B and 6C are expanded to a vertical width size in which the fingerprints of a plurality of fingers can be easily acquired. For example, the vertical width size is the same as the vertical side size of the display screen 3 of the information processing apparatuses 1B and 1C. It is possible to simultaneously acquire fingerprints of a plurality of fingers. As a result, the display of the first application can be skipped by the slide operation for starting the first application, and the icon of the second application can be displayed suddenly. Therefore, it is possible to reduce the number of operations when performing an application that is required to reduce troublesomeness.

  In the first embodiment, the lateral width size of the fingerprint sensors 6B and 6C that simultaneously read the fingerprints of two fingers is set equal to the lateral width size equivalent to the fingerprint sensors 6 and 6A that detect the fingerprint of one finger. However, the present invention is not limited to this, and the fingerprint sensors 6B and 6C for detecting the fingerprint of two fingers are configured to have a wider width in the horizontal direction than the fingerprint sensors 6 and 6A for detecting the fingerprint of one finger. May be configured to facilitate reading.

  Next, a basic system configuration in the information processing apparatus 1 or 1B according to the first embodiment will be described in detail with reference to FIG.

  FIG. 6 is a block diagram illustrating a basic system configuration example of the information processing apparatus 1 or 1B according to the first embodiment of the present invention.

  In FIG. 6, the information processing apparatus 1 or 1 </ b> B according to the first embodiment is configured by a computer system, and includes a touch panel 31 as a screen input device that allows various input commands, and a fingerprint for inputting a worker's fingerprint. Various images such as the initial screen (standby screen), application selection screen, and processing result screen can be displayed on the display screen 3 according to various input commands and operation input units such as the sensor 6 or 6B and the button switch 7. A display unit 32, a control unit 11 composed of a CPU (Central Processing Unit) that performs overall control, a RAM as a temporary storage means that works as a work memory when the CPU is started, and a CPU to operate Computer-readable readable recording medium on which various control data and various data used therefor are recorded ( Storage unit 12 constituting a ROM as a storage unit), wireless transmission / reception unit 13 (or wired transmission / reception unit) for transmitting / receiving data, display control unit 14 for controlling display unit 32, and touch panel control for controlling touch panel unit 31 Unit 15 and fingerprint authentication unit 16 for performing fingerprint authentication.

  The control unit 11 includes the operator's fingerprint and the administrator's registered fingerprint based on a control program read from the ROM into the RAM and various data used for the input command and input information from the operation input unit. A fingerprint authentication unit 111 for collating information, an icon screen display unit 112 for displaying an application selection screen when fingerprint authentication matches, and a power cutoff unit 115 for backing up history data and shutting off the power. Yes.

  In this case, the control unit 11 terminates the application when the face image authentication does not match the face image authentication unit 113 that matches the face image of the operator and the registered face image of the administrator, and the face image authentication is performed. You may have the application control means 114 which continues an application when it corresponds. When the face image authentication unit 113 and the application control unit 114 are provided, the face image authentication camera 5, the face image authentication unit 18, and the timer 19 described in FIG.

  The storage unit 12 includes an application storage unit 121 that stores an application program, a control program storage unit 122 that stores a control program of the information processing apparatus 1, an authentication data storage unit 123 such as fingerprint information and face image information, and a cache-related It has a ROM having a cache information storage unit 124 for storing information, and a RAM for storing temporarily stored information and the like. The storage unit 12 has a readable recording medium constituting a ROM such as a disk or an IC memory. This control program and various data used therefor may be downloaded from a disk or IC memory to a ROM, may be downloaded from a hard disk of a computer to a ROM, or may be downloaded to a ROM via a wireless, wired, or the Internet. May be downloaded. A control program describing a processing procedure for causing a computer to execute the driving method of the information processing apparatus 1 or 1B is stored in a computer-readable storage medium and controlled by a computer (CPU).

  The wireless transmission / reception unit 13 receives signals from various communication devices via an antenna, outputs the received signals to the control unit 11, and transmits the transmission signal generated by the control unit 11 to the various communication devices via the antenna. . In short, the wireless transmission / reception unit 13 performs wireless transmission / reception of information with an external communication device via an antenna.

  The display control unit 14 controls display on the display unit 32.

  The touch panel control unit 15 reads input position information from the fingertip to the touch panel unit 31, processes the input position information, and reflects the input position information in the icon position information on the display unit 32. The display unit 32, the touch panel unit 31, and the touch panel control unit 15 function as a touch panel device.

  The fingerprint authentication unit 16 compares the registered fingerprint information of the administrator stored in advance in the storage unit 12 with the fingerprint information acquired by the fingerprint sensor 6 or 6B, and verifies whether or not they match. Only when they match, an application with confidentiality can be executed.

  In the basic system configuration example of FIG. 8, the face image authentication camera 5, the face image authentication unit 18, the sound processing unit 17, the sound output unit 4, the sound collection unit 8, the timer unit 19, and the image capturing camera 9 are described. Since it is not an essential matter of the present invention, it is not described here, but it may naturally be included. This case will be described as a specific system configuration example with reference to FIG.

  Next, a specific system configuration in the information processing apparatuses 1A and 1C according to the first embodiment will be described in detail with reference to FIG. FIG. 7 illustrates a case where the first fingerprint sensor 6 and the second fingerprint sensor 6A are provided on the left and right of the display screen 3, or the first fingerprint sensor 6B and the second fingerprint sensor 6C are provided on the left and right of the display screen 3.

  FIG. 7 is a block diagram illustrating a specific system configuration example of the information processing apparatus 1A or 1C according to the first embodiment of the present invention.

  In FIG. 7, the information processing apparatus 1A or 1C according to the first embodiment is configured by a computer system. The touch panel unit 31 is a screen input device that allows various input commands, and is used to input a worker's fingerprint. An operation input unit such as the first fingerprint sensor 6 and the second fingerprint sensor 6A, or the first fingerprint sensor 6B and the second fingerprint sensor 6C, and the button switch 7, and an initial screen on the display screen 3 according to various input commands (A standby screen), a display unit 32 that can display various images such as an application selection screen and a processing result screen, a control unit 11A composed of a CPU (central processing unit) that performs overall control, and a CPU RAM as a temporary storage means that works as a work memory at the start-up of the CPU, a control program for operating the CPU, and this A storage unit 12 that constitutes a ROM as a computer-readable readable recording medium (storage unit) on which various data to be used are recorded, a wireless transmission / reception unit 13 (or wired transmission / reception unit) that transmits and receives data, and a display unit 32 The display control unit 14 to control, the touch panel control unit 15 to control the touch panel unit 31, the first fingerprint authentication unit 16A and the second fingerprint authentication unit 16B that perform fingerprint authentication, and the audio processing that converts between audio and audio signals Unit 17, a face image authentication unit 18 that performs face image matching, and a timer unit 19 for setting a time for periodic face image authentication.

  The control unit 11A, based on an input command and input information from the operation input unit, a control program read from the ROM into the RAM, and various data used for the control program, and the registered fingerprint of the administrator Fingerprint authentication means 111A for collating information, icon screen display means 112A for displaying an application selection screen when fingerprint authentication matches, and face image authentication for collating an operator's face image with an administrator's registered face image When the face image authentication does not match the means 113A, the application is terminated, and when the face image authentication matches, the application control means 114A that continues the application, and the power shut-off means 115A that backs up the history data and shuts off the power And have.

  The fingerprint authentication unit 111A performs the first fingerprint verification and the second fingerprint verification, and there are a plurality of security levels of applications for which security is required by the first fingerprint verification and the second fingerprint verification. The second fingerprint verification is performed when the first fingerprint verification matches, the security is first required when the second fingerprint verification matches, and the security is second when the second fingerprint verification does not match. Suppose that the required application.

  The storage unit 12 includes an application storage unit 121 that stores an application program, a control program storage unit 122 that stores a control program of the information processing apparatus 1, an authentication data storage unit 123 such as fingerprint information and face image information, and a cache-related It has a ROM having a cache information storage unit 124 for storing information, and a RAM as a work memory for storing temporarily stored information and the like. The storage unit 12 has a readable recording medium constituting a ROM such as a disk or an IC memory. This control program and various data used therefor may be downloaded from a disk or IC memory to a ROM, may be downloaded from a hard disk of a computer to a ROM, or may be downloaded to a ROM via a wireless, wired, or the Internet. May be downloaded. A control program that describes a processing procedure for causing a computer to execute the driving method of the information processing apparatus 1A or 1C is stored in a computer-readable storage medium and controlled by a computer (CPU).

  The wireless transmission / reception unit 13 receives signals from various communication devices via an antenna, outputs the received signals to the control unit 11, and transmits the transmission signal generated by the control unit 11 to the various communication devices via the antenna. . In short, the wireless transmission / reception unit 13 performs wireless transmission / reception of information with an external communication device via an antenna.

  The display control unit 14 controls display on the display unit 32.

  The touch panel control unit 15 reads input position information from the fingertip to the touch panel unit 31, processes the input position information, and reflects the input position information in the icon position information on the display unit 32. The display unit 32, the touch panel unit 31, and the touch panel control unit 15 function as a touch panel device.

  The first fingerprint authentication unit 16A compares the registered fingerprint information of the administrator stored in advance in the storage unit 12 with the fingerprint information acquired by the fingerprint sensors 6 and 6A, and determines whether or not they match. Collate. Only when they match each other, an application with confidentiality can be executed.

  The second fingerprint authentication unit 16B compares the registered fingerprint information of the administrator stored in advance in the storage unit 12 with the fingerprint information acquired by the fingerprint sensors 6B and 6C, and determines whether or not they match. Collate. Only when they match each other, an application with confidentiality can be executed.

  The audio processing unit 17 performs data processing on the audio signal, converts the audio signal into audio that can be heard by a human from the audio output unit 4 (speaker), and outputs the audio signal to the audio signal received by the sound collection unit 8 such as a microphone. . The audio signal is transmitted / received from the wireless transmission / reception unit 13 via the antenna AT, and is stored as audio signal data in the storage device 12.

  The face image authentication unit 18 compares the administrator's registered face image information stored in advance in the authentication data storage unit 123 of the storage unit 12 with the operator's face image information acquired by the face image authentication camera 5. Then, it is verified whether or not they match. Only when they match, the selected application with confidentiality can be continuously executed.

  The timer unit 19 operates as a clock function or a counter function, and operates as a counter for the predetermined time when performing the face image authentication operation every predetermined time. A face image authentication cycle time setting register as the face image cycle setting unit 19 </ b> A is provided in the timer unit 19.

  Therefore, by providing the face image authentication camera 5 and the face image authentication unit 18, it is possible to automatically avoid operation of the application by another person after starting the application that requires confidentiality. In addition, since two sets of fingerprint sensors 6 and 6A (or 6B and 6C) are provided, even when one of them fails, the control unit 11A does not stop the operation of the information processing apparatus 1A or 1C, It can also be controlled so that the authentication operation is performed, and can be used normally without any restrictions.

  FIG. 8 is a diagram showing a specific example of various types of information stored in the storage unit 12 of FIGS. 6 and 7.

  As shown in FIG. 8, the application storage unit 121 stores various application programs such as a clock function, a game function, a communication function, a telephone number book function, a wallet function, and a mail function. The control program storage unit 122 stores various control programs such as a display control program, a fingerprint authentication control program, a face image authentication control program, a communication control program, and an image capturing control program. The authentication data storage unit 123 stores fingerprint information Store biometric information such as face image information and iris information. The cache information storage unit 124 stores cash related information such as balance and payment information, card management information, and bank account information. Fingerprint information and face image information for collation are stored in the storage unit 12 in advance. It is desirable that these pieces of collation information have a configuration that cannot be rewritten once stored.

  The operation of the above configuration will be described.

  FIG. 9 is a flowchart showing a first example of application activation, fingerprint acquisition collation operation, and face image acquisition collation operation in the information processing apparatus 1 of the first embodiment.

  As shown in FIG. 9, first, in step S1, the button switch 7 is pressed to turn on the power. As an initial state, the fingerprint sensor 6 or 6B, the face image authentication camera 5, and the face image authentication cycle time counter are inactive.

  Next, in step S2, an initial screen is displayed and the fingerprint sensor 6 or 6B is activated.

  Subsequently, in step S3, the display screen 3 of the information processing apparatus 1 or 1B is touched with the abdomen of the finger and moved in the horizontal direction, and the fingerprint sensor 6 or 6B near the display screen 3 is moved by the abdomen of the finger. The belly of the finger is slid so as to cross, and the fingerprint is read by the fingerprint sensor 6 or 6B.

  Thereafter, in step S4, the fingerprint authentication unit 111 compares and authenticates the operator's fingerprint read by the fingerprint sensor 6 or 6B and the registered administrator's fingerprint. If the fingerprint information of the operator does not match the registered fingerprint information in the fingerprint authentication in step S4 (NO), the power shut-off means 115 backs up the history data in step S11, and then the power shut-off is performed in the next step S12. Do. If the fingerprint information of the operator matches the registered fingerprint information in the fingerprint authentication in step S4 (YES), the process proceeds to the next step S5.

  Further, in step S5, the icon screen display means 112 displays an application selection screen on which the icons of m types of applications are displayed on the display screen 3.

  Further, the face image authentication camera 5 is activated in step S6, and the face image authentication cycle time is set in the register in step S7. In step S8, the face image authentication unit 113 executes background face image authentication processing. The background face image authentication process in step S8 will be described in detail with reference to FIG.

  Next, if the fingerprint authentication in step S4 is OK and the background face image authentication in step S8 is OK, the icon of the target application is selected by touching with a finger in step S9. Thus, the target application is executed while being displayed on the display screen 3.

  Subsequently, in step S10, the process waits until all applications to be selected are completed. When all applications to be selected are completed in step S10 (YES), the history data is backed up in step S11, and then in the next step S12. Turn off the power and finish selecting the application.

  FIG. 10 is a flowchart for explaining in detail the background face image authentication process of FIG.

  As shown in FIG. 10, in the background face image authentication process in step S8, first, in step S81, the face image authentication cycle time is loaded from the register in which the face image authentication cycle time is set in the face image authentication cycle counter. . In step S82, the face image authentication period counter is counted down. In step S83, the face image authentication cycle counter is counted down until the count value of the face image authentication cycle counter becomes “0”.

  Next, a face image is photographed by the face image authentication camera 5 in step S84. In step S85, face image authentication processing is performed. That is, face image authentication processing is performed until face image authentication does not match, and if face image authentication matches (YES), the process proceeds to step S9 in FIG. As the face image authentication process, the operator's face image captured by the face image authentication camera 5 is periodically compared with the registered administrator's face image to determine whether or not they match.

  Subsequently, if the face image authentication does not match in step S85 (NO), the application control unit 114 performs a forced logout process of the application being executed in step S86. Thereafter, after the power shut-off means 115 backs up the history data in step S87, the power is shut off in the next step S88, and the selection of the application is completed.

  As described above, when an application requiring security is executed after fingerprint authentication, the face information authentication operation is activated. The face image authentication operation is a background authentication operation at the time of application execution. When a predetermined time elapses, an interrupt operation is performed at the time of application execution, and a face information authentication operation is performed. After the history information is saved, the power is shut off. On the other hand, if it is determined that they match, the application control unit 114 continues to execute the application operation.

Next, when there are a plurality of security levels of applications requiring security, a case where the face information authentication period is set shorter as the security level is higher will be described with reference to FIG. Others are the same as the case of FIG. In short, the face image authentication cycle is set to be shortened stepwise according to the importance of the security level. FIG. 11 shows application activation and fingerprint acquisition verification operation, face image acquisition verification operation in the information processing apparatus 1A of the first embodiment. It is a flowchart which shows the 2nd example.

  As shown in FIG. 11, first, in step S21, the button switch 7 is pressed to turn on the power. As an initial state, the fingerprint sensors 6 and 6A or 6B and 6C, the face image authentication camera 5, and the face image authentication cycle time counter are inactive.

  Next, in step S22, an initial screen is displayed and the fingerprint sensors 6 and 6A or 6B and 6C are activated.

  Subsequently, in step S23, the display screen 3 of the information processing apparatus 1A or 1C is touched with the abdomen of the finger and moved in the horizontal direction, and the fingerprint sensor 6 or 6B near the display screen 3 is moved by the abdomen of the finger. The belly part of the finger is moved so as to cross each other, and the fingerprint is read by the fingerprint sensor 6 or 6B.

  Thereafter, in step S24, the fingerprint authentication unit 111A compares and authenticates the operator's fingerprint read by the fingerprint sensor 6 or 6B and the registered administrator's fingerprint. If the fingerprint information of the operator does not match the registered fingerprint information in the fingerprint authentication in step S24 (NO), the power shut-off means 115A backs up the history data in step S34 and then powers off in the next step S40. To exit the selected application. If the fingerprint information of the operator matches the registered fingerprint information in the fingerprint authentication in step S24 (YES), the process proceeds to the icon selection screen display process in the next step S25.

  Furthermore, in step S25, an application selection screen on which icons of m types of applications are displayed by the icon screen display means 112A is displayed on the display screen 3. An operator can select and activate a predetermined icon from each icon of m types of applications (m is a positive integer).

  Further, in step S27, the fingerprint authentication unit 111A compares and authenticates the fingerprint of the other finger of the operator read by the fingerprint sensor 6A or 6C in step S26 and the registered administrator's fingerprint. If the fingerprint information of the other finger of the operator does not match the registered fingerprint information corresponding to the fingerprint authentication in step S27 (NO), the process proceeds to step S35, and the fingerprint in step S27. If the fingerprint information of the operator's other finger matches the registered fingerprint information in the authentication (YES), the process proceeds to the icon selection screen display process in the next step S28.

  Further, in step S28, an application selection screen on which icons of n types of applications are displayed by the icon screen display means 112A is displayed on the display screen 3. Application Bi has a higher security level than application Ai. An operator can select and activate a predetermined icon from each icon of n types (n is a positive integer).

  In step S29, the face image authentication camera 5 is activated, and in step S30, the second face image authentication frequency time T2 (T2 <T1) is set in the register. In step S31, the face image authentication unit 113A executes background face image authentication processing. Details of the background face image authentication processing in step S31 are described with reference to FIG. If the face image authentication does not match in step S85 of FIG. 10 (NO), the application control unit 114A performs a forced logout process of the application being executed in step S86. Thereafter, after the power shut-off means 115A backs up the history data in step S87, the power is shut off in the next step S88, and the selection of the application is completed.

  Next, if the fingerprint authentication in step S27 is OK and the background face image authentication in step S31 is OK, a target application icon is selected by touching with a finger in step S32. Thus, the target application is executed while being displayed on the display screen 3.

  Subsequently, in step S33, the process waits until all the n types of applications to be selected are completed, and when all the applications to be selected are completed in step S33 (YES), the power shut-off means 115A displays the history data in step S34. After backup, the power is turned off in the next step S40, and the selection of the application is completed.

  On the other hand, if the fingerprint information of the operator's other finger does not match the corresponding registered fingerprint information in the fingerprint authentication of step S27 (NO), the process proceeds to step S35, and the face image is displayed in step S35. The authentication camera 5 is activated, and the first face image authentication frequency time T1 is set in the register in step S36. In step S37, the face image authentication unit 113A executes background face image authentication processing. The details of the background face image authentication process in step S37 are described with reference to FIG. If the face image authentication does not match in step S85 of FIG. 10 (NO), the application control unit 114A performs a forced logout process of the application being executed in step S86. Thereafter, after the power shut-off means 115A backs up the history data in step S87, the power is shut off in the next step S88, and the selection of the application is completed.

  Next, if the fingerprint authentication in step S24 is OK and the background face image authentication in step S37 is OK, the icon of the target application is selected by touching with a finger in step S38. Thus, the target application is executed while being displayed on the display screen 3.

  Subsequently, in step S38, the process waits until all the m types of applications to be selected are completed. When all the applications to be selected are completed in step S38 (YES), the power shut-off means 115A displays the history data in step S34. After backup, the power is turned off in the next step S40, and the selection of the application is completed.

  In the driving method of the information processing apparatus according to the first embodiment, the fingerprint sensor 6 is provided at the end of the device on the extension line of the activation slide operation with the finger on the touch panel, and the fingerprint of the operator captured by the fingerprint sensor 6 by the fingerprint authentication means is provided. If the fingerprint authentication process that matches the information with the registered fingerprint information of the administrator and the icon screen display means match the verification result by the fingerprint authentication means, the icon selection screen for one or more icons with a confidential function is displayed. And an icon screen display step that does not display the icon selection screen when the collation results do not match, a face image capturing step in which the face image authentication camera 5 captures the face image of the operator, and a face image authentication means, If the face image authentication process for comparing the face image of the operator photographed by the face image authentication camera 5 with the registered face image of the administrator and the application control means do not match the face image verification, If the application control process that continues the application when the face image collation matches and the collation result by the fingerprint authentication means or the face image authentication means does not match, the power shut-off means backs up the history data. A power-off process for cutting off the power.

  As described above, according to the first embodiment, for example, in the information processing apparatus 1 provided with the touch panel on the display screen 3, the fingerprint sensor 6 is provided at the device end on the extension line of the activation slide operation with the finger on the touch panel. When the fingerprint authentication unit 111 that matches the fingerprint information of the operator captured by the operator 6 with the registered fingerprint information of the administrator matches the verification result by the fingerprint authentication unit, a plurality of icons corresponding to an application having a confidential function are displayed. An icon selection screen is displayed, and if the matching result does not match, the icon screen display means 112 that does not display the icon selection screen, the face image authentication camera 5 that captures the face image of the operator, and the face image authentication Face image authentication means 113 for comparing the face image of the operator photographed by the camera 5 with the registered face image of the administrator, and the face image verification does not match Exit application case, and a application controller 114 to continue the application if the face image matching is matched.

  In the information processing apparatuses 1 and 1A to 1D provided with the touch sensor, by providing the fingerprint sensor at the end of the apparatus on the operation extension line of the startup slide operation, both improvement in operability and security can be achieved.

  In addition, since the fingerprint sensor is a line sensor or an area sensor, it is possible to realize the information processing apparatuses 1 and 1A to 1D including a vertically long narrow fingerprint sensor without increasing the width of the frame.

  Furthermore, since the fingerprint sensor has a size capable of simultaneously acquiring fingerprints of a plurality of fingers, a plurality of fingerprints can be acquired by a series of slide operations, and both operability and security can be improved at the same time.

  Furthermore, since the information processing apparatuses 1 and 1A to 1D include the face image authentication camera 5, even after the execution of an application requiring security is started, the face image authentication does not perform a new slide operation. Security can be automatically secured. In addition, when the authorized administrator operates, the application can be executed without interruption.

  Furthermore, since the face image authentication cycle is shortened stepwise according to the importance of the security level, security can be ensured according to that level when executing a high security level application.

  Furthermore, the slide operation can be realized in exactly the same way for tablet-type terminals other than the information processing apparatuses 1 and 1A to 1D, large information processing apparatuses, and the like.

  As described above, when a user operates an information processing apparatus having a touch panel typified by a mobile phone device, at the time of start-up or operation, it is automatically performed with a simple operation without adding a new operation to the current operation. Security management can be performed using biometric authentication, with both ease of operation and confidentiality.

  In the first embodiment, a plurality of fingerprint collation operation examples have been described with reference to FIGS. 7 and 11, and a modification of the operation example will be further described.

  The fingerprint authentication unit 111A performs the first fingerprint collation and the second fingerprint collation, and there are a plurality of security levels of applications for which security is required by the first fingerprint collation and the second fingerprint collation using different fingers. If the first fingerprint collation matches, the second fingerprint collation is performed. If the second fingerprint collation matches, the security management is particularly important. The security management is a normal level when the second fingerprint collation does not match. Application.

  FIGS. 12A to 12E are front views of the information processing apparatus 1D for explaining an operation example different from the operation examples of FIGS. 7 and 11. 7 and 11 correspond to the information processing apparatus 1A or 1C.

  As shown in FIG. 12A, in the information processing apparatus 1D of the present invention, the user performs an activation operation by sliding the thumb on the display screen 3 from left to right. The fingerprint of the thumb is read by the elongated fingerprint sensor 6D near the right of the display screen 3 on the extended line of the same slide operation, and the read fingerprint information of the operator and the registered fingerprint information of the administrator are collated. When the fingerprint information of the operator matches the registered fingerprint information of the administrator, an icon selection screen is displayed on the display screen.

  A slide operation is performed from left to right on the icon selection screen with another finger other than the thumb, for example, an index finger. Also in this case, the fingerprint of the index finger is read by the elongated fingerprint sensor 6D near the right side of the display screen 3 on the extended line of the same slide operation, and the fingerprint information of the read operator and the registered fingerprint information of the administrator corresponding thereto are read. And match. When the fingerprint information of the operator's index finger matches the registered fingerprint information of the administrator corresponding thereto, an icon selection screen for the highly confidential application is displayed on the display screen 3. If the fingerprint information of the operator's index finger does not match the registered fingerprint information of the administrator corresponding thereto, an icon selection screen for a normally confidential application is displayed on the display screen 3.

  A fingerprint sensor 6 or 6B or 6D is provided on at least one end side of the display screen 3, and an edge light type LED is provided adjacent to the fingerprint sensor 6 or 6B or 6D. These upper positions are provided with surface governors on which the abdomen on the opposite side of the fingernail contacts and slides.

  Although not particularly described in the first embodiment, as a first modification of the present invention, a camera module for face image authentication is provided and the application is normally executed after face image authentication. However, there is a possibility that the security is insufficient because there is a possibility of being camouflaged with a photograph or a mask. To ensure security, check whether the application has blinked during execution. If you don't blink, you may be disguised as a photograph or face, and in this case, turn off the power. If you are blinking, continue running the application. As a result, it is possible to ensure security against application execution in an impersonation situation.

  Although not particularly described in the first embodiment, as a second modification of the present invention, a camera module for face image authentication is provided, and the application is normally executed after face image authentication. However, there is a possibility that the security is insufficient because there is a possibility of being camouflaged with a photograph or a mask. In order to ensure security, 3D image verification is performed with a 2D camera. LED lamps are provided on the left and right, respectively, and the left and right LED lamps are used as flashes alone, and the length of the shadow of the nose of the captured image by the irradiation of the LED lamp in a predetermined direction is projected on the face. Determine if. As a result, it is possible to ensure security against application execution in an impersonation situation.

  Although not particularly described in the first embodiment, as a third modification of the present invention, a camera module for face image authentication is provided, and the application is executed normally after face image authentication. However, there is a possibility that the security is insufficient because there is a possibility of being camouflaged with a photograph or a mask. In order to ensure security, 3D image verification is performed with a 3D camera including two 2D cameras. As a result, it is possible to ensure security against application execution in an impersonation situation.

  Although not particularly described in the first embodiment, it is necessary to actually acquire a fingerprint as the fourth modification of the present invention. The coefficient of friction around the fingerprint sensor is set larger than the display area. For example, in the case of covering with the same acrylic resin, the display screen portion is mirror-finished and the surface of the fingerprint sensor is satin-finished. As a result, the moving speed of the finger is slower in the peripheral part of the fingerprint than in the mirror-finished part of the display screen part, so that fingerprint authentication can be performed reliably.

  In the first embodiment, the second fingerprint matching is performed when the first fingerprint matching is performed, and the security is first required when the second fingerprint matching is performed. The application has been described in which the second security is required when there is a mismatch in fingerprint collation. However, the present invention is not limited to this, and the second fingerprint collation is performed when there is a match in the first fingerprint collation. When matching is performed by matching, the third fingerprint matching is performed. When matching is performed by the third fingerprint matching, security is first required. When the third fingerprint matching does not match, security is required second. The application may be an application that requires third security when the second fingerprint verification does not match.

  As mentioned above, although this invention has been illustrated using preferable Embodiment 1 of this invention, this invention should not be limited and limited to this Embodiment 1. It is understood that the scope of the present invention should be construed only by the claims. It is understood that those skilled in the art can implement an equivalent range from the description of the specific preferred embodiment 1 of the present invention based on the description of the present invention and the common general technical knowledge. Patents, patent applications, and documents cited herein should be incorporated by reference in their entirety, as if the contents themselves were specifically described herein. Understood.

  The present invention relates to an information processing apparatus having a touch panel typified by a mobile phone device, a driving method thereof, a control program in which processing procedures for causing a computer to execute each step of the information processing apparatus driving method, In the field of computer-readable readable storage media storing control programs, mobile terminal devices such as mobile phone devices using this information processing device, and electronic information devices such as car navigation devices, activation slide operations with fingers on touch panels Since the fingerprint sensor is provided at the end of the device on the extension line, at the time of start-up or operation, automatic operation is performed without adding a new operation to the current operation. Security management.

DESCRIPTION OF SYMBOLS 1, 1A-1D Information processing apparatus 2 Case 3 Display screen 31 Touch panel part 32 Display part 4 Voice output part 5 Face image recognition camera 6, 6A-6D Fingerprint sensor 7 Button switch 8 Sound collection part 9 Image pick-up camera 11 , 11A Control unit 12 Storage unit 121 Application storage unit 122 Control program storage unit 123 Authentication data storage unit 124 Cache information storage unit 13 Wireless transmission / reception unit 14 Display control unit 15 Touch panel control unit 16 Fingerprint authentication unit 16A First fingerprint authentication unit 16B Second fingerprint authentication unit 17 Audio processing unit 18 Face image authentication unit 19 Timer unit 19A Face image cycle setting unit 111, 111A Fingerprint authentication unit 112, 112A Icon screen display unit 113, 113A Face image authentication unit 114, 114A Application control unit 115 115 Power shutoff means

Claims (25)

  In an information processing apparatus having a touch panel on a display screen, a fingerprint sensor is provided at an end portion of an extension line of an activation slide operation by a finger on the touch panel, and the fingerprint information of the operator captured by the fingerprint sensor and the information processing apparatus When the fingerprint authentication means for matching the registered fingerprint information of the administrator of the administrator and the matching result by the fingerprint authentication means match, an icon selection screen for a plurality of icons corresponding to an application having a confidential function is displayed, and the matching is performed. An information processing apparatus having icon screen display means for not displaying the icon selection screen when the results do not match.   The information processing apparatus according to claim 1, wherein the fingerprint sensor is provided at one or both ends of the apparatus on an extension line of an activation slide operation by a finger with respect to the touch panel.   The fingerprint sensor is configured to be able to read the fingerprint of one or more fingers, and the fingerprint authentication means includes the read fingerprint information of one or more fingers and the registered fingerprint information of the administrator corresponding to the fingerprint information. The information processing apparatus according to claim 1, wherein   The information processing apparatus according to claim 1, wherein there are a plurality of confidential levels of applications for which security is required by a plurality of fingerprint verifications.   When the first fingerprint verification matches, the second fingerprint verification is performed, and when the second fingerprint verification matches, the security is first required. When the second fingerprint verification does not match, The information processing apparatus according to claim 4, which is an application that requires security second.   When the first fingerprint verification matches, the second fingerprint verification is performed. When the second fingerprint verification matches, the third fingerprint verification is performed. When the third fingerprint verification matches, the security is improved. An application that is first required, an application that requires security second when the third fingerprint verification does not match, and an application that requires security third when there is a mismatch in the second fingerprint verification The information processing apparatus according to claim 4.   A face image authentication camera capable of capturing an operator's face image, and a face image authentication means for comparing the operator's face image captured by the face image authentication camera with the registered face image of the administrator; The information processing apparatus according to claim 1, further comprising: an application control unit that terminates the application when the face image matching does not match, and continues the application when the face image matching matches.   The information processing apparatus according to claim 7, wherein the face image authentication cycle is set to be shortened stepwise according to the importance of the security level.   The information processing apparatus according to claim 1, wherein the fingerprint sensor is an area sensor.   The information processing apparatus according to any one of claims 1 to 9, wherein the fingerprint sensor has a size capable of simultaneously acquiring fingerprints of a plurality of fingers.   The information processing apparatus according to any one of claims 1 to 10, wherein a surface friction coefficient around the fingerprint sensor is set larger than the display screen area.   The information processing apparatus according to claim 7, wherein the face image authentication unit performs image verification as to whether or not a blink has occurred, in addition to collation of face images.   The face image authentication means detects the length of the nose shadow of the captured face image by irradiation in a predetermined direction in which the shadow of the nose is projected onto the face in addition to the collation of the face image, or from two 2D cameras The information processing apparatus according to claim 7, wherein 3D image verification is performed by a 3D camera.   In a driving method of an information processing apparatus having a touch panel on a display screen, an operator having a fingerprint sensor provided at an apparatus end on an extension line of an activation slide operation by a finger with respect to the touch panel, and a fingerprint authentication means capturing an operator by the fingerprint sensor When the fingerprint authentication process for comparing the fingerprint information of the user and the registered fingerprint information of the administrator matches the verification result by the fingerprint authentication means, the icon screen display means displays a plurality of icons corresponding to the application having the confidential function. An information processing apparatus driving method comprising: displaying an icon selection screen, displaying an icon selection screen of a plurality of icons, and not displaying the icon selection screen when the matching result does not match.   The information processing apparatus drive method according to claim 14, wherein the fingerprint sensor is provided at one end or both ends of the apparatus on an extension line of a start slide operation by a finger with respect to the touch panel.   The fingerprint sensor is configured to be able to read a fingerprint of one or a plurality of fingers, and the fingerprint authentication means in the fingerprint authentication step reads the fingerprint information of the one or more fingers read and a manager corresponding thereto The information processing apparatus driving method according to claim 14, wherein the registered fingerprint information is collated.   The method for driving an information processing apparatus according to claim 14, wherein there are a plurality of security levels of applications for which security is required by a plurality of fingerprint verifications.   When the first fingerprint verification matches, the second fingerprint verification is performed, and when the second fingerprint verification matches, the security is first required. When the second fingerprint verification does not match, The method for driving an information processing apparatus according to claim 17, wherein the application requires security second.   When the first fingerprint verification matches, the second fingerprint verification is performed. When the second fingerprint verification matches, the third fingerprint verification is performed. When the third fingerprint verification matches, the security is improved. An application that is first required, an application that requires security second when the third fingerprint verification does not match, and an application that requires security third when there is a mismatch in the second fingerprint verification A method for driving the information processing apparatus according to claim 17.   A face image capturing step in which the face image authentication camera captures an operator's face image; and a face image authentication unit that captures the operator's face image captured by the face image authentication camera; 15. The face image authentication step of comparing the image and the application control means further includes an application control step of terminating the application when the face image matching does not match and continuing the application when the face image matching matches. A method for driving the information processing apparatus described in 1.   21. The method of driving an information processing apparatus according to claim 20, wherein the face image authentication cycle is set to be shortened stepwise according to the importance of the security level.   The information processing apparatus driving method according to claim 20, wherein the face image authentication step performs image verification as to whether the face image authentication means blinks in addition to the collation of the face image.   In the face image authentication step, the face image authentication means detects the length of the nose shadow of the captured face image by illumination in a predetermined direction in which the shadow of the nose is projected onto the face in addition to the collation of the face image. The information processing apparatus driving method according to claim 20, wherein 3D image verification is performed by a 3D camera including two 2D cameras. 24. A control program in which a processing procedure for causing a computer to execute each step of the information processing apparatus driving method according to claim 14 is described.   A computer readable storage medium storing the control program according to claim 24.

Images