JP2008152581A - Apparatus for creating interface of facial recognition system, user interface creating program, and recording medium with it recorded thereon - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a user to create a user interface for facial recognition without programming. <P>SOLUTION: A screen editor part 24 of an editor computer 21 is provided with a face registration screen creating unit 24a and a face authentication screen creating part 24b. The face registration screen creating part 24a enables a feature extraction part 91 of a face authentication engine 9 in a programmable indicator 1 to perform processing for registering feature data on a face of a person to be authenticated, and creates a face registration screen for providing information necessary for the processing. The face authentication screen creating part 24b enables a feature collating part 92 of the face authentication engine 9 to perform processing for authenticating or not authenticating the person to be authenticated, and creates a face authentication screen for providing information necessary for the processing. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a user interface creation device for providing a user interface in a face authentication system for personal authentication using a face image.

  Conventionally, fingerprint authentication, voiceprint authentication, iris authentication, and the like are known as biometric authentication techniques, but in recent years, face authentication has attracted attention. Face authentication technology extracts the features of each part, such as eyes, mouth, and nose, from the face image of the person to be authenticated that has been captured in advance, registers them in numerical form, and obtains them from the face image of the person to be authenticated that was captured during authentication. It is determined whether or not the person to be authenticated is the registered person by comparing and collating the characteristics of each component with the registered characteristics (for example, Patent Documents 1 and 2). As described above, in the face authentication technology, since the data for authentication is collected only by photographing the face of the person to be authenticated, it is simpler than other biometric authentication technologies such as fingerprint authentication and voiceprint authentication. Not only can data be collected, but the psychological burden on the person to be authenticated is small.

Also, with the recent increase in security awareness in information management, the introduction of a mechanism for authenticating an operable person using biometric authentication technology in an information processing apparatus such as a personal computer is progressing.
JP 63-177273 A (published July 21, 1998) Japanese Patent Laid-Open No. 2005-242432 (published on September 8, 2005)

  When the conventional face authentication technology is incorporated into the information processing apparatus, the user can perform registration of the face image of the person to be authenticated, authentication of the face for login, display of the authentication result, etc. on the screen of the information processing apparatus. A user interface is required for operations such as input. Generally, this type of user interface is provided in a predetermined format as a program created by a programmer. For this reason, if the user's preference or ease of use is to be reflected in the user interface, the programmer must be requested to change the user interface, and the user cannot freely change the user interface.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a user interface creation device that allows a user to create a user interface for face authentication without creating a program. .

  In order to solve the above problems, a user interface creation device for a face authentication system according to the present invention extracts first feature data representing features of each part of a person's face from a photographed person's image, and a feature database. A registration processing unit for registering the first feature data, and extracting second feature data representing features of each part of the face from the face of the photographed image of the person to be authenticated, and the first feature registered in the second feature data and the feature database An authentication processing unit comprising: an authentication processing unit that authenticates a person to be authenticated as a person having the characteristics of the first characteristic data when both match with each other in the data; and the registration processing unit and the authentication Display format of broadcast information for notifying the user of information necessary for the processing unit to execute each process, and input of input information required for the user to perform the process A user interface creation device of a face authentication system that creates a user interface that defines a formula, the personal information input component for inputting personal information about a registered person, and an image of the person A registered image display component defined to pass the image and the personal information to the registration processing unit in advance, and the personal information input component and the registered image display component are set in a desired manner by a user operation. A registration processing screen creation means for creating a registration processing screen by placing it at a position, and an authenticated image display defined to pass the image to the authentication processing unit in order to display the image of the subject A component and an authentication result display component for displaying an authentication result by the authentication processing unit in advance, Is characterized by comprising an authentication processing screen generating means for generating an authentication processing screen by arranging the image display part and the authentication result display part in a desired position.

  In the above configuration, a registration processing screen is created by placing the personal information input component and the registered image display component at a desired position by a user operation by the registration processing screen creation means.

  Further, the authentication processing screen creation means creates the authentication processing screen by placing the authenticated image display component and the authentication result display component at desired positions by a user operation.

  Therefore, the user can reflect the user's preference and ease of use on the registration processing screen by freely creating or changing the registration processing screen and the authentication processing screen.

  The user interface creation device stores a face processing image of the person to be authenticated authenticated by the authentication processing part and personal information of the person to be authenticated in a predetermined storage part, and saves the storage part in the storage part. A face image display component for displaying the face image by the display processing unit with respect to the face authentication system including a display processing unit that reads and displays a list of face images and personal information of the person to be authenticated The display processing unit has a personal information display component for displaying the personal information in advance, and the face image display component and the personal information display component are arranged at desired positions by a user operation. It is preferable that the authentication target person list display screen generating means for generating the target user list display screen is provided.

  In the above configuration, the authenticated person list display screen is created by arranging the face image display component and the personal information display component at desired positions by the user's operation.

  Thereby, it is possible to easily provide a user interface for displaying a list of authenticated persons who have been authenticated in the past.

  In this user interface creation device, the storage processing unit stores the face image of the person not authenticated by the authentication processing unit in the predetermined storage unit, and the display processing unit is stored in the storage unit. It is preferable that the face image display component also displays the non-authenticated face image with respect to the face authentication system that reads out the face images of unauthenticated persons as unauthenticated face images and displays them as a list. Thus, it is possible to easily provide a user interface for displaying a list of not-authenticated persons (non-authenticated persons) as well as authenticated persons.

  The user interface creation program of the present invention is a program for operating any one of the above-described user interface creation devices, and is a program that causes a computer to function as each of the means. The user interface creation program is recorded on a computer-readable recording medium. Thus, the user interface creation device can be realized by causing a computer to read and execute the program.

  As described above, the user interface creation apparatus according to the present invention includes a personal information input component for inputting personal information related to a registered person, and the image and the personal information for displaying an image of the person. A registered image display component defined to be passed to the registration processing unit of the face authentication system, and the personal information input component and the registered image display component are arranged at desired positions by a user operation. A registration processing screen creating means for creating a registration processing screen, and an authenticated image display component defined to pass the image to the authentication processing unit in order to display an image of the authenticated person; An authentication result display component for displaying an authentication result by the authentication processing unit in advance, and the image display component to be authenticated and the authentication result by a user operation And a authentication processing screen generating means for generating an authentication processing screen by a radical 113 products at a desired position. As a result, it is possible to create a user interface for face authentication that reflects the user's preferences and ease of use without creating a program.

  An embodiment of the present invention will be described with reference to FIGS. 1 to 11 as follows.

  As shown in FIG. 1, a programmable display 1 as an operation display device includes an arithmetic processing unit such as a CPU, and displays an input operation created by a user and screen data for display. It is a dedicated computer that realizes the operation function and display function.

  The programmable display 1 acquires the state of each device 11 displayed on the display screen via the PLC 13 through communication with the PLC 13 via the serial cable 12. It has a function to display the status. The programmable display 1 has a function of instructing the PLC 13 to control the state of the device 11 in accordance with an operation on the touch panel 3 described later. The programmable display 1 also has a function of recording, storing, and displaying the face image of the operator who is permitted to log in with the operation information using the face image.

  In order to realize the above functions, the programmable display 1 includes a display 2, a touch panel 3, interface units (I / F in the figure) 4, 5, a data memory 6, a work memory 7, and an HMI process. Unit 8, face authentication engine 9, face log engine 10, feature database 16, and log file storage unit 17. Hereinafter, each main part of the programmable display device 1 will be described in detail.

  As the display 2, a flat panel display such as a liquid crystal display, an EL display, or a plasma display is preferably used in order to configure the programmable display 1 to be thin. The touch panel 3 is an input device provided for performing touch input on the display image of the display 2.

  The interface unit 4 is a communication control unit for the programmable display 1 to perform serial communication with the PLC 13, and each is connected by a serial cable 12. The interface unit 4 performs communication using a communication protocol according to the manufacturer and model of the PLC 13 based on the connected device data. The connected device data and the communication protocol are stored in, for example, a data memory 6 described later.

  Note that the connection between the programmable display 1 and the PLC 13 is not limited to the serial cable 12, and may be made by a network such as Ethernet (registered trademark) or other communication means.

  Here, the PLC 13 will be described.

  The PLC 13 captures the state of the input device 11 via the input unit and outputs it at every predetermined scan time such as several tens of ms, for example, according to a sequence program (ladder program or the like) created by the user. A control instruction is given to the device 11 for changing the state.

  As the input device 11, devices such as sensors (temperature sensors, optical sensors, etc.) and switches (push button switches, limit switches, pressure switches, etc.) are used. As the output device 11, an actuator, a relay, a solenoid valve, a display, or the like is used. These devices 11 are arranged in required parts such as a production line.

  The device 11 may be a specific memory area in the programmable display device 1 (for example, a user area in a system area described later), or may be a specific memory area in a memory in the PLC 13. These memory areas are set as internal devices.

  The memory (device memory) in the PLC 13 stores data (word data or bit data) indicating the state of the device 11 (output value from the device 11 or set value to the device 11) in an area specified by the device address. is doing. In the memory, a word device and a bit device are set. The word device is set as an area for storing word data such as numeric values as input / output data, and is designated by a word address (device address). The bit device is set as an area for storing bit data such as an on / off state, and is set by a bit address (device address). With such a setting, the device 11 can be controlled by simply designating and accessing an arbitrary word device or bit device in the memory as a device address, or information regarding its state can be individually retrieved.

  A variable is associated with a device address called by a unique name for each manufacturer of the PLC 13. The variable is a name that can be arbitrarily set by the user, and a comment described later can be handled as a variable.

  In the following description, the device address is appropriately referred to as an address.

  The interface unit 5 is a communication control unit for the programmable display device 1 to communicate with the editor computer 21. The interface unit 5 is connected to a transfer cable 14 for transferring screen data and the like from the editor computer 21 to the programmable display 1. For example, a USB cable is used as the transfer cable 14.

  The data memory 6 is a memory for storing screen data, the above-described communication protocol, etc., and FEPROM (Flash Erasable and Programmable ROM) is used. Since FEPROM is a rewritable read-only flash memory, it plays the role of a hard disk drive in a general personal computer. A flash memory does not have a movable part and is resistant to impacts, and thus operates stably even in a poor ambient environment.

  The screen data is a data file of a user screen (unit screen configured by screen data for one frame) displayed on the programmable display 1. The screen data includes data of objects such as a base screen and parts to be displayed on the display 2, processing definition information assigned to each object, and the like. The process definition information defines various processes performed in relation to the user screen, and is created for each event to be executed on the base screen. This processing specification information basically includes the file number (screen number) of the base screen on which the display process is to be executed, the event name that specifies the operation content to be executed on this base screen, and each execution event. A set of reference information including one or more data to be referred to is provided.

  The work memory 7 is composed of, for example, a DRAM, and is used for work during arithmetic processing such as display control. The work memory 7 is used for temporary storage of the acquired data of the device 11. The working memory 7 has a state memory area for transferring the state of the device 11 (the contents of the device address) stored in the device memory of the PLC 13 to and from the device memory.

  The memory of the programmable display 1 is provided with a system area. The system area includes a system data area that stores data necessary for the operation of the programmable display 1, a user area that can be used as an internal device by a user, a special relay area that is used as a special relay, and the like. This system area is provided in the work memory 7, for example.

  The HMI processing unit 8 is provided as the center of control in order to realize the HMI function. The HMI processing unit 8 is a functional block realized by executing a program.

  The HMI processing unit 8 obtains the state of the device 11 as state data from the memory of the PLC 13 by communicating with the PLC 13 at every predetermined time interval or every predetermined event, and is prepared in the programmable display 1 The data is written in a temporary memory space, for example, a specific area (state memory area) of the working memory 7. Further, the HMI processing unit 8 rewrites the state data of the device 11 in the state memory area so as to update the state data in the internal memory of the PLC 3 and transmits it to the PLC 13. Based on the screen data created by combining the above-mentioned objects, the HMI processing unit 8 acquires the state data of the device 11 from the PLC 13 and draws and displays it on the programmable display 1 and performs operations on the screen. Accordingly, the operation when the change of the state of the device 11 is instructed is specified by the process definition information.

  The face authentication engine 9 includes a feature extraction unit 91 and a feature matching unit 92.

  The feature extraction unit 91 cuts out a face image from the input image passed from the face registration unit 81 described later, extracts data representing the features of each part of the face from the face image, and passes the personal image passed from the face registration unit 81 The information is registered in the feature database 16 together with the information.

  The feature matching unit 92 cuts out a face image from the input image passed from the face authentication unit 81, extracts data representing the features of each part of the face from the face image, and according to authentication sensitivity adjustment values and authentication parameters described later. The feature data of each part registered in the feature database 16 is compared and collated, and the result of match / mismatch (authentication / non-authentication) is notified to the face authentication unit 82 described later.

  The face log engine 10 includes the face image of the person to be authenticated who has obtained the result of face authentication, the result of face authentication (authentication / non-authentication), and the authenticated person to be authenticated. Are stored in the log file storage unit 17. Further, the face log engine 10, in response to an instruction from the face log display unit 83 to be described later, the face image and face authentication result of the person to be authenticated stored in the log file storage unit 17 and the authenticated person to be authenticated. The personal information is read out and transferred to the face log display unit 83.

  The HMI processing unit 8 described above has a face registration unit 81, a face authentication unit 82, and a face log display unit 83 for face authentication.

  First, when an event for registering an input image from the camera as a face image for face authentication occurs according to a user instruction or the like, the face registration unit 81 displays the input image from the camera as a face registration screen 101 (see FIG. 2). ) Is displayed in a window.

  Here, the face registration screen 101 in the programmable display device 1 will be described with reference to FIG.

  The face registration screen 101 is a screen provided by the face registration unit 81 as a user interface for face registration. The face registration screen 101 includes a registered image display component 102, a name input box 103, an authority setting box 104, and a registration start switch 105.

  The registered image display component 102 is a component for displaying an image of a person to be authenticated input from the camera 15 and is provided as an image display. The registered image display component 102 includes a picture imitating a person so that the registered image display component 102 is a component that displays a registered person. In the registered image display component 102, a storage device (storage medium) for setting the feature database 16, that is, a registered data storage location is set in advance. The registration data storage location is set in a registration setting dialog box 501 (see FIG. 7) to be described later, including other items. The setting by the registration setting dialog box 501 will be described in detail later.

  The name input box 103 is provided as a part for inputting the name of the person to be authenticated. The input of the name to the name input box 103 is performed using, for example, a keyboard that pops up when the name input box 103 is touched.

  The authority setting box 104 is provided for setting whether or not the person to be authenticated has the authority to operate the programmable display device 1. This authority setting box 104 is provided so as to set whether or not to have an operation authority in the form of a check box.

  The registration start switch 105 is a switch component that is provided for the instructed person to instruct the start of the registration process in order to register the face image of the inspected person. The registration start switch 105 is defined as processing definition information to pass each information to the authentication engine 9 as described below by a touch operation.

  When the registration start switch 105 is touched by the user, the face registration unit 81 is input to each item set in the registered image display component 102 and the name input box 103 together with the image displayed on the registered image display component 102. And the presence / absence of the operation authority after login set in the authority setting box 104 are passed to the face authentication engine 9. When the face authentication engine 9 receives the input image, the feature extraction unit 91 extracts, from the input image, feature data for registration (first feature data) representing features of each part of the photographed person's face. The extracted first feature data is registered in the feature database 16 together with personal information to be described later.

  The face registration screen 101 may include a registrant list display component (not shown) that displays a list of names of authenticated persons (registrants) who have already registered the first feature data. By providing this registrant list display component, it is possible to confirm whether or not an authenticated person to be registered is already registered.

  The face registration screen 101 may have a switch for setting the registration data storage location described above. By providing this switch, a registration data storage location to be passed to the authentication engine 9 can be set on the face registration screen 101. As described above, the registered data storage location is set in advance in the registered image display component 102. However, the registered data storage location can be changed in the programmable display 1 by touching the switch.

  The above switches are word switches that write word data into a designated memory area. When a touch operation is performed in advance by a face registration screen creation unit 24a of the screen editor unit 24 described later, a registration data storage location (such as a path name) is displayed. ) Is set in the area of the specified address in the user area (processing definition information). When the registration start switch 105 is touched by the user, the face registration unit 81 reads the registration data storage location from the user area according to the above address, and passes it to the face authentication engine 9.

  Next, when an event for authenticating an input image from the camera occurs according to a user instruction, the face authentication unit 82 displays the input image from the camera in a window on a face authentication screen 201 (see FIG. 3) described later.

  Here, the face authentication screen 201 in the programmable display device 1 will be described with reference to FIG.

  A face authentication screen 201 which is a screen for face authentication includes an authentication subject display component 202, a name display component 203, an authority display component 204, and an authentication result display component 205.

  The person-to-be-authenticated display component 202 is a part for displaying an image of the person to be authenticated input from the camera 15 and is provided as an image display. The person-to-be-authenticated person display component 202 includes a picture imitating a person in order to make it easy to understand that the person-to-be-authenticated part is a part for displaying the person to be authenticated. Each item set in an authentication setting dialog box 601 (see FIG. 9) to be described later is set in the certifier registration display component 202. Each item will be described in detail later.

  The name display component 203 is a character string display provided for receiving the name information from the feature matching unit 92 and displaying the name of the person to be authenticated authenticated by the feature matching unit 92 when the person to be authenticated is authenticated. It is a container part.

  When the authenticated person is authenticated, the authority display component 204 receives the authority information from the feature matching unit 92 and displays whether or not the authenticated person has the operating authority of the programmable display 1. It is a provided character string display part.

  The authentication result display component 205 is a character string display component provided for displaying the authentication result of the person to be authenticated.

  The face authentication unit 82 registers the input image in the log file storage unit 17 and passes the input image to the face authentication engine 9. When the face authentication engine 9 receives the input image, the feature extraction unit 91 extracts, from the input image, authentication feature data (second feature data) representing the features of each part of the photographed person's face. . Further, the face authentication engine 9 compares the second feature data with the first feature data registered in the feature database in the feature matching unit 92, and when the two match each other, The person having the feature of the feature data is authenticated. The feature matching unit 92 passes the face authentication result (authentication / non-authentication) together with the personal information acquired from the feature database 16 (only when authentication is successful) to the face authentication unit 82.

  When the face authentication unit 82 receives the authentication result from the feature matching unit 92 and is authenticated, the face authentication unit 82 displays the messages “authenticated” and “transition to the login screen” on the authentication result display component 205, A transition to the normal operation screen shown in FIG. 4 is made by a user operation or the passage of a certain time. Further, when the face authentication unit 82 has not been authenticated, the authentication result display component 205 displays messages “authentication failed” and “login failed”. Further, the face authentication unit 82 uses the face image of the person to be authenticated and the result of face authentication (authentication / non-authentication) passed from the feature matching unit 92 as the authenticated person to be authenticated. Together with the personal information of the above information is passed to the face log engine 10 described above.

  Here, the normal operation screen 211 will be described with reference to FIG.

  The operation screen 211 is a normal operation / display screen displayed on the programmable display 1 in a logged-in state as a result of authentication from the face authentication screen 201, that is, a screen for operation of the control system and display of the control status. is there. In addition, the operation screen 211 includes a login screen 212 as a common screen common to all operation screens including the operation screen 211. The login screen 212 includes an authenticated person display component 213 that displays the face image of the authenticated person, a name display component 214 that displays the name of the authenticated person, and an operation of the programmable display 1 by the authenticated person. It has an authority display component 215 for displaying whether or not it has authority, and a logout switch 216 provided for logging out when a touch operation is performed by the person to be authenticated.

  Note that the login screen 212 can be displayed only on a specific operation screen or not displayed as a common screen.

  Finally, the face log display unit 83 receives a face database face image and a result of face authentication (when an event for displaying a list of authentication target persons who have logged in to the programmable display 1 or attempted to log in occurs according to a user instruction) (Authentication / non-authentication) is acquired from the log file storage unit 17 by instructing the face log engine 10 to read, and a window is displayed on the face log display screen 301 (see FIG. 5) described later together with the personal information. indicate.

  Here, the face log display screen 301 in the programmable display device 1 will be described with reference to FIG.

  The face log display screen 301 is a screen for the face log display unit 83 to display an authentication result log by the face authentication engine 9. The face log display screen 301 includes a log content display component 302, a face image display component 303, an authentication result display component 304, a face log display switch 305, a date sort switch 306, a name sort switch 307, and the previous page. A changeover switch 308 and a next page changeover switch 309 are provided.

  The face image display component 303 is a component for displaying the face image of the authenticator or non-authenticated person stored in the log file storage unit 17 and is provided as an image display. The face image display component 303 includes a picture imitating a person in order to make it easy to understand that the component is a component that displays an authenticator or a non-authenticated person.

  The authentication result display component 304 displays the name of the certifier stored in the log file storage unit 17 or an unregistered person, and is a character string display component provided to display the date and time of login and logout It is.

  The log content display component 302 is a display component for arranging a plurality of face image display components 303 and an authentication result display component 304 together to display a list of logged faces.

  The face log display switch 305 is a switch component for the user to instruct the display of the face image display component 303.

  When the user performs a touch operation on the face log display switch 305, the face log display unit 83 receives from the log file storage unit 17 the face image of the certifier or non-authenticator, the name of the certifier, the date and time of login and logout, The date and time of access by the unauthenticated person is read out and displayed on the log content display component 302. For the non-authenticated person, the face log display unit 83 displays a message “unregistered person is unauthorized access” on the authentication result display component 304.

  The date sort switch 306 is a switch for sorting the log content display displayed on the log content display component 302 in the order of login date. When the date sort switch 306 is touched, the face log display unit 83 sorts and redisplays log contents in the order of login date.

  It should be noted that the face log display unit 83 displays a forward sort display when the date sort switch 306 is touched once in an unsorted state, a reverse sort display when the touch operation is performed twice, and then reverses the forward sort. You may make it display again by repeating a sort.

  The name sort switch 307 is a switch component for sorting the display of the log content displayed on the log content display component 302 in the order of the name in the order of 50 sounds. When the name sort switch 307 is touched, the face log display unit 83 sorts and redisplays the log contents in the order of 50 names. The face log display unit 83 may perform forward sort display and reverse sort display in the same manner as the date sort for the sort display by name.

  Further, the face log display unit 83 displays the log content divided into a plurality of pages when the log content cannot be displayed on the log content display component 302. The previous page changeover switch 308 is a switch component operated when switching the display from the currently displayed page to the previous page, and the next page changeover switch 309 displays from the currently displayed page to the next page. It is a switch part that is operated when switching.

  In this way, the user can freely use the face authentication system by using the face registration screen 101, the face authentication screen 201, and the face log display screen 301 reflecting the user's preference and usability in the programmable display. be able to.

  Next, the editor computer 21 will be described.

  As shown in FIG. 1, the editor computer 21 has a function as an editor computer that creates a screen displayed on the programmable display 1.

  The editor computer 21 is constituted by a personal computer having a CPU, a memory (RAM, ROM, etc.), an external storage device (hard disk drive, MO drive, etc.), a display device and an input device (keyboard, mouse, etc.). The editor computer 21 includes a control unit 22, an interface unit (I / F in the figure) 23, a screen editor unit 24, and a data storage unit 25.

  The interface unit 23 is a communication control unit for performing communication with the programmable display 1 and is connected to the transfer cable 14.

  The control unit 22 is a functional block realized by hardware (CPU, memory, etc.) and software (operating system, etc.), and controls the execution of application programs and the operation of peripheral devices. The control unit 22 has a work memory 22a to fulfill its function. The work memory 22a is constituted by a DRAM or the like, and is used for developing a screen file or a ladder file.

  The control unit 22 implements the screen editor unit 24 by executing editor software that is an application program. The screen editor unit 24 is recorded on a recording medium configured to be separable from the editor computer 21, and can be installed in the editor computer 21 from this storage medium.

  The above-mentioned recording medium (program medium) is a computer-readable recording medium, such as a tape system such as a magnetic tape or a cassette tape, a magnetic disk system such as a flexible disk or a hard disk, CD-ROM, MO, MD, DVD, etc. A card system such as an optical disk system, an IC card (including a memory card), or an optical card is suitable. In addition, the program medium may be a medium that carries a fixed program including a semiconductor memory such as a mask ROM, EPROM, EEPROM, flash ROM, or the like.

  Further, if the editor computer 21 is placed in an environment that can be connected to a communication network including the Internet, the editor computer 21 may be a medium that fluidly carries the program so as to download the program from the communication network. However, when the program is downloaded from the communication network in this way, the download program may be stored in the editor computer 21 in advance, or may be installed from another recording medium.

  The screen editor unit 24 supports components (such as a switch, a lamp, a numeric keypad, and various displays (for example, a numerical display, a meter display, and a graph display) so as to support the creation of a user screen that is a user-specific screen. Object), drawing function, text input function, etc. Objects are registered in a library format so that the user can easily select them.

  The screen data created by the editor computer 21 is stored in the data storage unit 25 configured by the above external storage device. The screen data is read from the data storage unit 25 and transferred to the programmable display device 1 via the transfer cable 14.

  The screen editor unit 24 includes a face registration screen creation unit 24a that is an editor unit for creating the face registration screen 101 and a face authentication screen creation unit 24b that is an editor unit for creating the face authentication screen 201. And a face log display screen creation unit 24c, which is an editor unit for creating the face log display screen 301 described above.

  Here, the face registration screen creation unit 24a will be described with reference to FIG.

  When the screen creation / editing mode is selected from a menu screen (not shown), the screen editor unit 24 displays a drawing window 401 as shown in FIG. The face registration screen creation unit 24 a includes various components for registration such as a registered image display component 102, a name input box 103, an authority setting box 104, and a registration start switch 105. When creating a user screen using such a face registration screen creation unit 24a, the user designates an arrangement position of each of the above components according to a predetermined operation procedure on the user screen displayed in the screen window 401. Thus, the parts are arranged on the user screen, and the face registration screen 101 is created.

  Further, as shown in FIG. 7, the face registration screen creation unit 24 a provides a face registration setting dialog box 501 for setting process definition information set in the registered image display component 102 as a user interface. The face registration screen creation unit 24a displays the face registration setting dialog box 501 when a mouse double-click operation on the registered image display component 102 arranged on the drawing window 401 or an operation for selecting from a menu screen (not shown) is performed. indicate.

  The face registration setting dialog box 501 includes a component display unit 502, a registered data storage location setting box 503, a window size setting box 504, a window position setting box 505, and a window display radio button 506. .

  The component display unit 502 is an area for displaying a reduced image of the registered image display component 102 in which each item is to be set in the face registration setting dialog box 501.

  The registered data storage location setting box 503 is provided for determining a storage device (storage medium) for setting the feature database 16. Examples of the location where the feature database 16 is set include a memory (for example, the data memory 6) in the programmable display 1 and an external recording medium (for example, a CF (registered trademark) card).

  A window size setting box 504 is a box for setting the window size (width and height) of the registered image display component 102. For example, this box can be provided in a list box format so that the user can select from several predetermined sizes, or the size can be determined by numerical input. A window position setting box 505 is a box for setting an arrangement position (coordinates of the upper left corner of the registered image display component 102) on the face registration screen 101 of the registered image display component 102.

  The window size is roughly determined by, for example, expanding or narrowing the outer periphery of the registered image display component 102 by dragging the mouse with the registered image display component 102 arranged on the face registration screen 101. At this time, since the current window size is displayed in the window size setting box 504, the size can be finely adjusted by changing the value. On the other hand, the window position can be moved, for example, by dragging the registered image display component 102 on the face registration screen 101, so that a rough position is determined by this operation and the current position displayed in the window position setting box 505 is displayed. It is determined by fine adjustment of the coordinate position.

  The window display radio button 506 is provided for setting whether to display the image of the person to be authenticated on the registered image display component 102. The face registration unit 81 described above displays the image on the registered image display component 102 when the registered image display component 102 is set to display the image of the person to be authenticated, and when the setting is made not to display the image. The image is not displayed on the registered image display component 102.

  In the present embodiment, the programmable display device 1 in which the face authentication system is incorporated is described. For example, when the face authentication system is applied to an entrance / exit monitoring system, an image of the person to be authenticated is displayed on the registered image display component 102. The display of is not required. Specifically, the entrance / exit monitoring system automatically registers the image of the visitor at the entrance by detecting the entrance, authenticates the visitor at the exit, and authenticates the registered visitor. Confirm exit. For this reason, when the face registration screen 101 created by the editor computer 21 is used in the entrance / exit monitoring system, it is not necessary to display the authentication subject image on the registered image display component 102.

  Next, the face authentication screen creation unit 24b will be described.

  The face authentication screen creation unit 24 b includes various components for authentication, such as a person-to-be-authenticated display component 202, a name display component 203, and an authority display component 204. When creating a user screen using such a face authentication screen creation unit 24b, as shown in FIG. 8, the user designates an arrangement position of each of the above components on a screen window 401 according to a predetermined operation procedure. By doing so, components are arranged on the user screen, and the face authentication screen 201 is created.

  Further, as shown in FIG. 9, the face authentication screen creation unit 24b provides a face authentication setting dialog box 601 for setting processing definition information set in the person-to-be-authenticated display component 202 as a user interface. The face authentication screen creation unit 24b performs a face authentication setting dialog box 601 when a mouse double-click operation on the authentication subject display component 202 arranged on the drawing window 401 or an operation for selecting from a menu screen (not shown) is performed. Is displayed.

  The face authentication setting dialog box 601 includes a component display unit 502, a registered data storage location setting box 603, a face log storage location setting box 604, a window size setting box 605, a window position setting box 606, and a readout address setting. A box 607, an authentication parameter setting unit 608, and a face authentication display radio button 609 are provided.

  The component display unit 603 is an area for displaying a reduced image of the authentication subject display component 202 in which each item is to be set in the face authentication setting dialog box 601.

  Similar to the registered data storage location setting box 503, the registered data storage location setting box 603 is provided to determine a storage device (storage medium) for setting the feature database 16.

  The face log storage location setting box 605 is provided to determine a storage device (storage medium) for setting the log file storage unit 17. As the location where the log file storage unit 17 is set, the memory (for example, the data memory 6) in the programmable display 1 or an external recording medium (for example, a CF (registered trademark) card), etc., can be cited as in the feature database 16.

  A window size setting box 605 is a box for setting the window size of the authentication subject display component 202. For example, this box can be provided in the form of a list box so that the user can select from several predetermined sizes as in the window size setting box 504 described above, or the size can be determined by numerical input. A window position setting box 604 is used to set the arrangement position (the coordinates of the upper left corner of the person-to-be-authenticated display part 202) on the face authentication screen 201 of the person-to-be-authenticated display part 202 in the same manner as the window position setting box 505 described above. Box.

  The read address setting box 607 is a box for setting an address for designating a read area in the user area in order to read the personal information of the person who has been successfully authenticated from the feature database 16 into the user area. When the HMI processing unit 8 displays the operation screen 211, the face authentication unit 82 reads the personal information of the person to be authenticated from the user area specified by the above address and passes it to the HMI processing unit 8. The HMI processing unit 8 receives the personal information and displays it on the name display component 214 and the authority display component 215 on the login screen 212.

  The authentication parameter setting unit 608 is provided for setting various parameters as conditions when the face authentication engine 9 authenticates the person to be authenticated. The authentication parameter setting unit 608 includes an authentication sensitivity adjustment value setting box 608a, a brightness setting box 608b, and a face size setting box 608c.

  The authentication sensitivity adjustment value setting box 608a is similar to the feature data to be verified with the feature data of each part of the registered face image that can be recognized as being authenticated when the feature matching unit 92 performs the face authentication process. It is a box provided for setting an authentication sensitivity adjustment value that is a threshold value of the degree. The aforementioned feature matching unit 92 authenticates the person to be authenticated when the degree of similarity is equal to or greater than the authentication sensitivity adjustment value.

  The brightness setting box 608b is a box provided for setting the brightness of the input image at the time of face authentication. Thereby, it can be prevented in advance that the registered face image is too dark or conversely too bright so that the face image cannot be visually confirmed.

  The face size setting box 608c is a box provided for setting the size of the face in the input image used for authentication. Thereby, it can be prevented in advance that the registered face image is too small and the characteristics of each part of the face cannot be accurately extracted.

  The face authentication display radio button 609 is provided for setting whether or not to display the face image of the authenticated person on the authenticated person display component 213 of the login screen 212. The face authentication unit 82 displays the face image of the person to be authenticated on the person to be authenticated display component 213 when the face image is set to be displayed and displays the face of the person to be authenticated when the setting is not displayed. Does not display the face image.

  Finally, the face log display screen creation unit 24c will be described.

  The face recognition log display screen creation unit 24c includes various parts for face log display such as a log content display part 302, a face image display part 303, an authentication result display part 304, and switches 305 to 309. . When creating a user screen using such a face log display screen creation unit 24c, as shown in FIG. 10, the user positions each component on the screen window 401 according to a predetermined operation procedure. By designating, the components are arranged on the user screen, and the face log display screen 301 is created.

  Further, as shown in FIG. 11, the face log display screen creation unit 24c provides a face log display setting dialog box 701 for setting processing definition information set in the log content display component 302 as a user interface. When the face log display screen creation unit 24c performs a double-click operation of the mouse on the log content display component 302 arranged on the drawing window 401 or an operation of selecting from a menu screen (not shown), the face log display setting dialog box 701 is displayed.

  The face log display setting dialog box 701 includes a face log storage location setting box 702, a window size setting box 703, a window position setting box 704, a read address setting box 705, and a face log display radio button 706. is doing.

  Similar to the face log storage location setting box 605 described above, the face log storage location setting box 702 is provided to determine a storage device (storage medium) for setting the log file storage unit 17.

  A window size setting box 703 is a box for setting the window size of the log content display component 302. For example, this box can be provided in the form of a list box so that the user can select from several predetermined sizes as in the window size setting box 504 described above, or the size can be determined by numerical input. A window position setting box 704 is used to set an arrangement position (coordinate of the upper left corner of the face log display component 302) of the log content display component 302 on the face log display screen 301 in the same manner as the window position setting box 505 described above. Is a box.

  The read address setting box 705 sets an address for designating a read area in the user area in order to read the name and login / logout date and time of the authenticated person successfully authenticated from the log file storage unit 17 into the user area. Is a box. When displaying the face log display screen 301, the face log display unit 83 reads the name of the person to be authenticated and the login / logout date and time from the user area specified by the above address and displays them on the authentication result display component 304. .

  The face log display radio button 706 sets whether to display the face image of the authenticated person or the face image of the unauthenticated person on the face image display component 303 of the face log display screen 301. Provided for. The face log display unit 83 described above displays the face image of the person to be authenticated on the face image display component 303 when the face image is set to be displayed and displays the face of the person to be authenticated when the setting is not displayed. Does not display the face image. Further, the face log display unit 83 may display or hide the face image of the person to be authenticated depending on whether or not the user has the operation authority.

  In the present embodiment, the example in which the face authentication system is incorporated in the programmable display 1 has been described. However, the face authentication system may be incorporated in an apparatus or system other than the programmable display 1. For example, the present invention can be applied even when a face authentication system is incorporated in the entrance / exit monitoring system as described above.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims. That is, embodiments obtained by combining technical means appropriately changed within the scope of the claims are also included in the technical scope of the present invention.

  The user interface creation apparatus according to the present invention prepares in advance parts necessary for creating a face registration screen, a face authentication screen, and a face log display screen in a face authentication system that performs personal authentication using a face image. A user interface for face authentication can be easily created, and can be suitably used when creating a user interface.

It is a block diagram which shows the structure of the programmable display and editor computer which concern on embodiment of this invention. It is a figure which shows the face registration screen displayed by the face registration part of the HMI process part in the said programmable display. It is a figure which shows the face authentication screen displayed by the face authentication part of the said HMI process part. It is a figure which shows the login screen which changes, when a to-be-authenticated person is authenticated by the face authentication engine of the said HMI process part. It is a figure which shows the face log display screen displayed by the face log display part of the said HMI process part. It is a figure which shows the drawing window of the state which has produced the said face registration screen by the face registration screen creation part of the screen editor part in the said editor computer. It is a figure which shows the registration setting dialog box displayed by the said face registration screen creation part in order to set an attribute to the registration image display component arrange | positioned on the said face registration screen. It is a figure which shows the drawing window of the state which has produced the said face authentication screen by the face registration screen creation part of the said screen editor part. It is a figure which shows the authentication setting dialog box displayed by the said face registration screen preparation part in order to set an attribute to a to-be-authenticated person display component arrange | positioned on the said face authentication screen. It is a figure which shows the drawing window of the state which has produced the said face log authentication screen by the face log display screen creation part of the said screen editor part. It is a figure which shows the authentication setting dialog box displayed by the said face log display screen creation part in order to set an attribute to the log content display component arrange | positioned on the said face log display screen.

Explanation of symbols

1 Programmable display (face recognition system)
9 Face authentication engine 10 Face log engine 16 Feature database 17 Log file storage (storage)
21 Editor computer (User interface creation device)
24 screen editor section 24a face registration screen creation section (registration processing screen creation means)
24b Authentication screen creation unit (authentication processing screen creation means)
24c Face log display screen creation unit (certifier list display screen creation means)
81 face registration unit 82 face authentication unit (storage processing unit)
83 Face log display section (display processing section)
91 Feature extraction unit (registration processing unit)
92 Feature verification unit (authentication processing unit)
101 Face registration screen (user interface)
102 Registered image display component 103 Name input box (personal information input component)
104 Authority setting box (personal information input component)
201 Face authentication screen (user interface)
202 Authentication-subject person image display component 205 Authentication result display component 301 Face log display screen (user interface)
303 face image display component 304 authentication result display component (personal information display component)

Claims (5)

A registration processing unit that extracts first feature data representing features of each part of the person's face from the photographed person's image and registers it in the feature database; and features of each part of the face from the face of the photographed person's photographed image. Second feature data to be expressed is extracted and compared with the second feature data and the first feature data registered in the feature database. When the two match, the person to be authenticated is featured in the first feature data. In a face authentication system comprising an authentication processing unit that authenticates that a person has an image, a display of notification information for notifying a user of information necessary for the registration processing unit and the authentication processing unit to execute the respective processes User interface creation device for face authentication system for creating a user interface that defines a format and an input format of input information input by a user necessary for executing the processing There is,
A personal information input component for inputting personal information related to a registered person, and a registered image defined to pass the image and the personal information to the registration processing unit in order to display an image of the person A registration processing screen creating means for creating a registration processing screen by arranging the personal information input component and the registered image display component at a desired position by a user operation,
In order to display the image of the person to be authenticated, an authenticated image display component defined to pass the image to the authentication processing unit, and an authentication result display component for displaying an authentication result by the authentication processing unit And an authentication processing screen creation means for creating an authentication processing screen by placing the authentication target image display component and the authentication result display component at a desired position by a user operation. A user interface creation device for a face authentication system. The face authentication system stores the face image of the person to be authenticated authenticated by the authentication processing part and the personal information of the person to be authenticated in a predetermined storage unit, and is stored in the storage unit. A display processing unit that reads out and displays a list of face images and personal information of the person to be authenticated,
The user interface creation device has in advance a face image display component for displaying the face image by the display processing unit, and a personal information display component for displaying the personal information by the display processing unit, It is characterized by comprising a to-be-authenticated person list display screen creating means for creating a to-be-authenticated person list display screen by arranging the face image display part and the personal information display part at a desired position by a user operation. The user interface creation device of the face authentication system according to claim 1. The storage processing unit stores the face image of the person to be authenticated that has not been authenticated by the authentication processing unit in the predetermined storage unit,
The display processing unit reads the face image of the unauthenticated person stored in the storage unit as a non-authenticated face image and displays the list as a list,
3. The user interface creation device for a face authentication system according to claim 2, wherein the face image display component also displays the non-authenticated face image.   A user interface creation program for operating the user interface device according to claim 1, 2, or 3, wherein the computer functions as each means of the user interface creation device of the face authentication system.   A computer-readable recording medium on which the user interface creation program according to claim 4 is recorded.