JP2018197980A - Image display apparatus, image forming apparatus, control program, and control method - Google Patents

Abstract

[Structure] The image forming apparatus (10) includes a display 22 provided with a touch panel 20 and a camera 52 that captures a captured image including an image of a user existing in the surroundings. The CPU (12) detects a face image from the captured image. When a plurality of face images are detected, an authentication image including the plurality of face images is generated, and the authentication screen 100 including the authentication images is displayed on the display 22. Then, the face image for authentication is specified from the plurality of face images in response to the touch input, and user authentication is performed for the user corresponding to the face image for authentication. [Effect] Even when a plurality of face images are detected, user authentication can be appropriately and easily performed. [Selection diagram] Fig. 7

Description

  The present invention relates to an image display apparatus, an image forming apparatus, a control program, and a control method, and more particularly to an image display apparatus, an image forming apparatus, a control program, and a control method that perform user authentication using a face image, for example.

  An example of this type of background art is disclosed in Patent Document 1. Background Art An image forming apparatus includes a first camera and a second camera. In the image forming apparatus of the background art, a person existing in the detection range on the front side of the image forming apparatus is detected by analyzing a captured image of the first camera. When a person existing in the detection range is detected, the face image of the person is taken by the second camera, and user authentication using the face image is performed.

Japanese Patent Laid-Open No. 2016-212624

  However, since the image forming apparatus of the background art includes the first camera as the detection unit that detects the presence of a person and the second camera as the face image acquisition unit that acquires the face image for authentication, the manufacturing cost increases. There is a problem.

  In order to solve this problem, it is conceivable to use a camera having both functions of a detection unit and a face image acquisition unit. When such a camera is used, it is necessary to image a wide range in order to detect the presence of a person, and there may be a plurality of persons in the detection range. Here, when there are a plurality of persons in the detection range, a plurality of face images are detected. Therefore, there is a problem that user authentication cannot be performed unless it is specified who is a user.

  Therefore, a main object of the present invention is to provide a novel image display apparatus, image forming apparatus, control program, and control method.

  Another object of the present invention is to provide an image display device, an image forming device, a control program, and a control method capable of performing user authentication appropriately and easily even when a plurality of face images are detected. .

  1st invention is an image display apparatus provided with an input part, a display, an imaging | photography means, a face detection means, a display means, and a 1st specific means. The imaging unit captures a captured image including an image of the user existing around the image display device. The face detection means detects a first image corresponding to the user's face image from the captured image. The display unit displays the plurality of first images on the display when the plurality of first images are detected by the face detection unit. The first specifying means specifies the first image for authentication according to the operation input in the input unit from among the plurality of first images displayed on the display.

  The second invention is an image display device subordinate to the first invention, wherein the storage means stores a registration face image corresponding to each of a plurality of registered users, and the user corresponds to the first image for authentication. When there are a plurality of registered user candidates corresponding to the candidate, the candidate presenting means for displaying a plurality of identification information corresponding to each of the plurality of registered user candidates on the display, and among the plurality of identification information displayed on the display And a second specifying means for specifying identification information for authentication in accordance with an operation input in the input unit.

  A third invention is an image display device subordinate to the second invention, wherein a priority is assigned to each of a plurality of registered user candidates based on the first image for authentication and the face image for registration. First setting means for setting is further provided, and the display means arranges a plurality of pieces of identification information according to the respective priorities of the plurality of registered user candidates.

  A fourth invention is an image display device including an input unit, a display, a storage unit, a photographing unit, a face detection unit, a determination unit, a display unit, and a first specifying unit. The storage means stores a registration face image corresponding to each of the plurality of registered users. The imaging unit captures a captured image including an image of the user existing around the image display device. The face detection means detects the user's face image from the captured image. The determination unit determines whether the user is a registered user based on the face image of the user detected by the face detection unit and the registration face image stored in the storage unit. The display unit displays a plurality of first images on the display when there are a plurality of first images corresponding to the face image of the user determined to be a registered user by the determination unit. The first specifying means specifies the first image for authentication according to the operation input in the input unit from among the plurality of first images displayed on the display.

  A fifth invention is an image display device subordinate to the fourth invention, further comprising specifying information presenting means for displaying a plurality of specifying information corresponding to each of the plurality of first images on a display. The first specifying means specifies, as a first image for authentication, a first image corresponding to the specifying information selected according to the operation input in the input unit from among the plurality of specifying information displayed on the display. To do.

  A sixth invention is an image display device according to the fifth invention, wherein each of the plurality of first images is in accordance with the position where each of the user's face images corresponding to the plurality of first images is detected. And a second priority setting means for setting the priority. The display means arranges a plurality of pieces of identification information according to the priority of the first image.

  A seventh invention is an image display device according to any one of the fourth to sixth inventions, and when there are a plurality of registered user candidates corresponding to the user corresponding to the first image for authentication, A plurality of identification information corresponding to each of a plurality of registered user candidates is displayed on the display and a plurality of identification information displayed on the display, and identification information for authentication according to an operation input in the input unit Second specifying means for specifying

  An eighth invention is an image display device subordinate to the seventh invention, wherein a priority is assigned to each of a plurality of registered user candidates based on the first image for authentication and the face image for registration. First priority setting means for setting is further provided. The display means arranges a plurality of pieces of identification information in accordance with the respective priorities of the plurality of registered user candidates.

  A ninth invention is an image forming apparatus including the image display device according to any one of the first to eighth inventions.

  A tenth aspect of the invention is a control program for an image display device including an input unit, a display, and a photographing unit that captures a photographed image including an image of a user existing around the processor. A face detection unit that detects a first image corresponding to the face image of the user, and a display unit that displays the plurality of first images on the display when the plurality of first images are detected by the face detection unit and the display. Among the plurality of first images, it is made to function as a first specifying unit that specifies a first image for authentication according to an operation input in the input unit.

  In an eleventh aspect of the invention, there is provided a processor of an image display device including an input unit, a display, and a photographing unit that captures a photographed image including an image of a user existing in the vicinity. Detecting a first image; (b) displaying a plurality of first images on a display when a plurality of first images are detected by step (a); and (c) displaying by a step (b). Is a control method for executing a step of identifying a first image for authentication in accordance with an operation input in an input unit from among a plurality of first images displayed on the screen.

  A twelfth aspect of the present invention is an image including an input unit, a display, a storage unit that stores a registration face image corresponding to each of a plurality of registered users, and an imaging unit that captures a captured image including an image of the user existing around A control program for a display device, wherein a processor of the image display device detects a first image corresponding to the user's face image from a captured image, a user's face image detected by the face detection means, Based on the registration face image stored in the storage means, a determination means for determining whether the user is a registered user, a first corresponding to the face image of the user determined to be a registered user by the determination means. In the case where there are a plurality of images, display means for displaying the plurality of first images on the display and a plurality of the first images displayed on the display, the input unit To function as a first specifying means for specifying the first image for authentication in accordance with the work input.

  A thirteenth aspect of the present invention is an image including an input unit, a display, a storage unit that stores a registration face image corresponding to each of a plurality of registered users, and an imaging unit that captures a captured image including an image of the user existing around. The processor of the display device (a) detects a first image corresponding to the user's face image from the captured image, (b) the user's face image detected in step (a), and is stored in the storage means. A step of determining whether or not the user is a registered user based on the registered face image, and (c) a first image corresponding to the face image of the user determined to be a registered user in step (b) A plurality of first images displayed on the display when there are multiple, and (d) among the plurality of first images displayed on the display by step (c) A control method for performing the step of identifying a first image for authentication in accordance with an input in the input section.

  According to the first to thirteenth inventions, user authentication can be performed appropriately and easily even when a plurality of face images are detected.

  According to the present invention, even when a plurality of face images are detected, user authentication can be performed appropriately and easily.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is a perspective view showing an appearance of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram showing an electrical configuration of the image forming apparatus shown in FIG. FIG. 3 is a plan view for explaining a range set around the image forming apparatus. FIG. 4 is a plan view showing a case where a person is present in the range. FIG. 5 is an illustrative view showing an example of a photographed image. FIG. 6 is an illustrative view showing an example of an authentication screen before face detection. FIG. 7 is an illustrative view showing an example of an authentication screen after face detection. FIG. 8 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 9 is a flowchart showing an example of the authentication process of the CPU shown in FIG. FIG. 10 is an illustrative view showing one example of an authentication screen of the second embodiment. FIG. 11 is a flowchart showing an example of the authentication process of the second embodiment. FIG. 12 is an illustrative view showing another example of the authentication screen of the second embodiment. FIG. 13 is an illustrative view showing one example of a user specifying screen of the third embodiment. FIG. 14 is a flowchart showing an example of the authentication process of the third embodiment.

[First embodiment]
FIG. 1 is a front view showing an external configuration of an image forming apparatus 10 according to an embodiment of the present invention. Referring to FIG. 1, in the first embodiment, image forming apparatus 10 is a multifunction peripheral (MFP) having a copying function, a printer function, a scanner function, a facsimile function, and the like. The present invention can be applied not only to a multifunction peripheral but also to other image forming apparatuses such as a copying machine (copying machine), a printing apparatus (printer), and a facsimile machine. In addition, since the present invention is not limited to an image forming apparatus, it is only necessary to have an image display function. Therefore, an information device or an electronic device having various image display functions such as a tablet terminal, a smartphone, a PC, and an electronic desk (digital table). It is also possible to apply to. Furthermore, the present invention is also applicable to image display devices such as information displays and electronic blackboards.

  In this specification, the front surface (front surface) is the surface facing the user's standing position, that is, the surface on which the operation panel 26 described later is provided, and the front-rear direction (depth direction) of the image forming apparatus 10 and its constituent members is defined. The horizontal direction (lateral direction) of the image forming apparatus 10 and its constituent members is defined based on the state when the image forming apparatus 10 is viewed from the user.

  The image forming apparatus 10 includes an apparatus main body 36 including an image reading unit 30, an image forming unit 32, a manual paper feed unit 34, a paper feed device 38, and a paper discharge tray 40.

  The image reading unit 30 includes a document placing table formed of a transparent material, and is built in the apparatus main body 36. A document pressing cover 30a is attached to the upper side of the document placing table via a hinge or the like so as to be freely opened and closed. The document pressing cover 30a is provided with a manual sheet feeding unit 34. The document presser cover 30a is provided with an ADF (automatic document feeder) that automatically feeds a document placed on the manual sheet feeder 34.

  The image reading unit 30 includes a light source, a plurality of mirrors, an imaging lens, a line sensor, and the like. The image reading unit 30 exposes the document surface with a light source, and guides reflected light reflected from the document surface to the imaging lens by a plurality of mirrors. Then, the reflected light is imaged on the light receiving element of the line sensor by the imaging lens. The line sensor detects the luminance or chromaticity of the reflected light imaged on the light receiving element, and generates read image data based on the image on the surface of the document. As the line sensor, a charge coupled device (CCD) or a contact image sensor (CIS) is used.

  The image forming unit 32 is built in the apparatus main body 36 and is provided below the image reading unit 30. The image forming unit 32 includes a photosensitive drum, a charging device, an exposure device, a developing device, a transfer device, and a fixing device. The image forming unit 32 forms an image on a recording medium (paper) conveyed from the manual paper feeding unit 34 or the paper feeding device 38 by an electrophotographic method, and discharges the image-formed paper to the paper discharge tray 40. . However, as image data for forming an image on a sheet, image data read by the image reading unit 30, image data transmitted from an external computer, or the like is used. Further, the recording medium is not limited to paper made of paper, and a sheet other than paper such as an OHP film is also used.

  The paper discharge tray 40 is provided between the image reading unit 30 and the image forming unit 32. The bottom surface of the paper discharge tray 40 is partitioned by the image forming unit 32. The top surface of the paper discharge tray 40 is partitioned by the image reading unit 30. Further, the left side surface of the paper discharge tray 40 (the left side surface as viewed from the front) is defined by the right side surface of the connection housing 42. That is, the front side, the back side, and the left side of the paper discharge tray 40 are opened. The bottom surface of the paper discharge tray 40 has an inclined surface that is inclined downward toward the connection housing 42 side.

  An operation panel (corresponding to an input unit) 26 is provided on the front side of the image reading unit 30. The operation panel 26 includes a display 22 with a touch panel 20 and a plurality of operation buttons 26a.

  The display 22 with the touch panel 20 displays software keys and messages for receiving various settings or printing instructions from the user. As an example, the display 22 displays a home screen, which is a screen for selecting a desired job from various jobs that can be executed by the image forming apparatus 10, an authentication screen 100 (see FIG. 6) described later, or the like. However, in the first embodiment, the job means copying (including document scanning), printing, fax transmission, and the like.

  The operation button 26a is a hardware key, and includes, for example, a home key, a power saving key, a main power key, and the like. The home key is a key for displaying the home screen on the display 22. The power saving key is a key for switching between a power saving state (power saving mode) in which power consumption is restricted and a normal state (normal mode) in which power consumption is not restricted.

  The software key refers to a key (icon) reproduced in software on the display surface of the display 22 with the touch panel 20, for example. On the other hand, a hardware key refers to a key (button) provided as a physical device. Further, the operation input on the operation panel 26 is an operation to each part of the operation panel 26 such as an operation input on a software key (for example, touch input on the touch panel 20) and an operation input on a hardware key (button operation on the operation button 26a). Means input.

  Further, in the center of the front surface of the operation panel 26, a human detection sensor 50 for detecting a person existing in front of or near the apparatus main body 36 and a face image of a person existing in front of or near the apparatus main body 36 are photographed. A camera 52 is provided as means.

  FIG. 2 is a block diagram showing an electrical configuration of the image forming apparatus 10 shown in FIG. Referring to FIG. 2, image forming apparatus 10 includes a CPU 12. The CPU 12 is connected to the RAM 14, the HDD 28, the touch panel control circuit 16, the display control circuit 18, the operation button detection circuit 24, the human detection sensor 50, the camera 52, the image reading unit 30, the image forming unit 32, and the communication circuit 54 via the bus 60. Is connected. A touch panel 20 is connected to the touch panel control circuit 16, a display 22 is connected to the display control circuit 18, and an operation button 26 a is connected to the operation button detection circuit 24.

  The CPU 12 governs overall control of the image forming apparatus 10. The RAM 14 is used as a work area and a buffer area for the CPU 12.

  The HDD 28 is a main storage device of the image forming apparatus 10, and appropriately stores a control program and data for the CPU 12 to control the operation of each part of the image forming apparatus 10. The HDD 28 also stores authentication information of registered users (registered users). The registered user authentication information includes identification information and a comparative image. The identification information is information for specifying a registered user such as a user ID and a name. The comparative image is a registered user's face image (registration face image).

  However, another nonvolatile memory such as an SSD, a flash memory, or an EEPROM may be used instead of or together with the HDD 28.

  The touch panel control circuit 16 applies necessary voltage and the like to the touch panel 20, detects a touch operation (touch input) within the touch effective range of the touch panel 20, and outputs touch coordinate data indicating the position of the touch input to the CPU 12. Output to.

  The touch panel 20 is a general-purpose touch panel, and an arbitrary system such as an electrostatic capacity system, an electromagnetic induction system, a resistance film system, and an infrared system can be used. In the first embodiment, a capacitive touch panel is used as the touch panel 20, and the touch panel 20 is provided on the display surface of the display 22. However, a touch panel display in which the touch panel 20 and the display 22 are integrally formed may be used.

  The display control circuit 18 includes a GPU, a VRAM, and the like. Under the instruction of the CPU 12, the GPU displays various screens on the display 22 using the image generation data 74b (see FIG. 8) stored in the RAM 14. Display image data is generated in the VRAM, and the generated display image data is output to the display 22. As the display 22, for example, an LCD or an EL (Electro-Luminescence) display can be used.

  The operation button detection circuit 24 outputs an operation signal or operation data corresponding to the operation of the operation button 26a described above to the CPU 12.

  The person detection sensor 50 is a sensor for detecting whether or not a person (user) exists in a range A (see FIG. 3) set around the image forming apparatus 10, and is a distance sensor, for example. For example, as the distance sensor, an infrared sensor, an ultrasonic sensor, a laser distance sensor, or the like is used. This distance sensor outputs distance data to the CPU 12. The CPU 12 has a person (user) in front of (in front of) the image forming apparatus 10 depending on whether the distance indicated by the distance data output from the person detection sensor 50 is within a predetermined distance that defines the range A. Determine whether or not. Accordingly, it can be said that the range A is a range set for determining whether a person is present in front of the image forming apparatus 10.

  As the human detection sensor 50, a pyroelectric sensor or a floor sensor (pressure sensor) can be used instead of the distance sensor. When the pyroelectric sensor is used, the pyroelectric sensor detects a temperature change in the range A, and the CPU 12 determines whether or not a person exists in the range A according to the output of the pyroelectric sensor. When a floor sensor is used, a floor sensor is provided in the floor surface range corresponding to the range A of the image forming apparatus 10, and the CPU 12 determines whether a person exists in the range A according to the output of the floor sensor. Judge whether.

  FIG. 3 is a plan view for explaining a range A set around the image forming apparatus 10. FIG. 4 is a plan view showing a case where a person exists in the range A. FIG.

  As shown in FIG. 3, the range A is a range in which there is a possibility that there is a person who may use (operate) the image forming apparatus 10. As an example, the range A is defined by a semicircle having a first distance L1. The However, the first distance L1 is a distance in the horizontal direction from the center of the front surface of the apparatus main body 36 of the image forming apparatus 10, and in this first embodiment, from the center of the front surface of the apparatus main body 36 to both ends in the left-right direction. It is set to be longer than. That is, in the first embodiment, the range A is the front side (front) of the image forming apparatus 10 (apparatus main body 36), and the position where the image forming apparatus 10 can be operated (for example, the operation panel 26 can be reached). Set to a range in which a person existing at (position) can be detected. The range A is set to a size (width) that allows a plurality of people to exist.

  However, as long as the size and shape of the range A are on the front side of the image forming apparatus 10 as described above and can detect a person present at a position where the image forming apparatus 10 can be operated, the range A is appropriately selected. It can be changed. Although the detailed description is omitted, the number of the human detection sensors 50 is not limited to one, and may be two or more as long as a person existing in the set range A can be detected.

  It should be noted that the detectable range of the human detection sensor 50 only needs to include the range A and does not need to coincide with the range A. Further, when a fixed obstacle exists in the range A, the obstacle may be excluded from the detection result in advance.

  As shown in FIG. 4, when there is a person in the range A, the person detection sensor 50 outputs distance data corresponding to a distance shorter than the first distance L <b> 1 to the CPU 12. When the CPU 12 receives (acquires) distance data of a distance shorter than the first distance L1, the CPU 12 determines that there is a person in the range A. When no person is present in the range A, the human detection sensor 50 outputs distance data corresponding to a distance longer than the first distance L1 to the CPU 12. When the CPU 12 receives the distance data of a distance longer than the first distance L1, the CPU 12 determines that no person exists in the range A.

  Although detailed description is omitted, in the first embodiment, the CPU 12 determines that there is a person in the range A when distance data having a distance equal to the first distance L1 is received. However, in this case, the CPU 12 may determine that no person exists in the range A.

  Although detailed explanation is omitted, when the CPU 12 receives distance data corresponding to a distance shorter than the first distance L1 after receiving distance data corresponding to a distance longer than the first distance L1, It is determined that the range A is entered from outside the range A. Further, when the CPU 12 receives distance data corresponding to a distance longer than the first distance L1 after receiving distance data corresponding to a distance shorter than the first distance L1, the person moves from within the range A to outside the range A. Judge that it came out.

  The camera 52 images the front of the image forming apparatus 10 (device main body 36). However, the shooting range of the camera 52 includes at least the range A. The camera 52 includes an image sensor (image sensor), a lens, and a drive circuit, and performs imaging by converting imaging light as visible light captured from the image sensor into an electrical signal. Examples of this image sensor include a solid-state image sensor such as a CCD image sensor or a complementary metal oxide semiconductor (CMOS) image sensor. The lens is an optical element for forming incident light on the light receiving portion of the image sensor. A fisheye lens is used as this lens. The fisheye lens is used to widen the viewing angle of the camera 52. The drive circuit drives the image sensor under the instruction of the CPU 12. The image sensor is driven when there is a person in the range A, and is not driven (stopped) when there is no person in the range A. That is, the image sensor is driven when it is determined that a person has entered the range A from outside the range A, and is stopped when it is determined that the person has moved out of the range A from outside the range A. However, even if there is a person in range A, the image sensor is stopped when user authentication described later is completed.

  The communication circuit 54 is a communication circuit for connecting to a network such as the Internet. The communication circuit 54 is a wired communication circuit or a wireless communication circuit, and communicates with an external computer such as a server via a network in accordance with an instruction from the CPU 12.

  Note that the electrical configuration of the image forming apparatus 10 shown in FIG. 2 is merely an example, and is not limited to this.

  In the image forming apparatus 10 having such a configuration, user authentication may be performed. For example, when a user desires to use a predetermined application provided in the image forming apparatus 10 or execute a predetermined job, whether or not the user is a registered user permitted to use the application or execute the job User authentication is performed to determine

  As a user authentication method, an authentication process using a user's face image (face authentication process) is known. In the face authentication process, a face image of a person existing in the range A is detected from a photographed image taken by the camera 52, and the face authentication process is performed using the face image. At this time, if there are a plurality of people in the range A, a plurality of face images may be detected. When a plurality of face images are detected, there is a problem that face authentication processing cannot be performed unless it is specified who is a user.

  Therefore, in the first embodiment, when a plurality of face images are detected, a face image for authentication is specified from among the plurality of face images in response to touch input, and who is the user is specified. I tried to do it.

  FIG. 5 is an illustrative view showing an example of a photographed image 90. FIG. 6 is an illustrative view showing an example of an authentication screen 100 before face detection. FIG. 7 is an illustrative view showing an example of an authentication screen 100 after face detection.

  Hereinafter, an operation example of the image forming apparatus 10 according to the first embodiment will be described, but a case where a registered user executes face authentication processing will be described. Here, a description of a case where a non-registered user executes face authentication processing will be omitted.

  When there is a person (registered user) in the range A, the image sensor of the camera 52 is driven and photographing is started. As shown in FIG. 5, when shooting is started, the camera 52 outputs a captured image 90 obtained by shooting a shooting range set around the image forming apparatus 10 to the CPU 12. In the example illustrated in FIG. 5, the number of persons existing in the shooting range of the camera 52 is three (users A to C). For this reason, the captured image 90 includes images of the users A to C. However, each of the users A to C is assumed to be a registered user.

  As described above, since the camera 52 has a fisheye lens, the captured image 90 corresponding to the captured image data 74c has distortion. Therefore, an authentication image in which the distortion of the captured image 90 corresponding to the captured image data 74c is corrected is generated. As shown in FIG. 6, when an authentication image is generated, an authentication screen 100 including the authentication image is displayed on the display 22. Further, a face image (corresponding to the first image) is detected (identified) from the authentication image.

  As a face image detection method, for example, there is a method of extracting (determining) a face area based on a face image discriminator using Haar-Like feature quantities by extracting image feature quantities in units of a predetermined size. is there. The face area is detected as a rectangle, and as detection results, the coordinates in the image at the upper left corner of the rectangle and the vertical and horizontal widths of the rectangle (or the coordinates in the image at the lower right corner of the rectangle) are output. An image included in this face area is a face image. In addition, various methods such as the Viola-Jones method have been proposed as other methods for detecting a face image, but the present invention can be used without being limited to a specific method. However, when there are a plurality of people in the shooting range of the camera 52 as in the first embodiment, a plurality of face images corresponding to each person are detected.

  In addition, when there is an object that erroneously detects a face image such as a poster including a human face in the shooting range of the camera 52, the poster or the like is excluded from the detection result of the face image in advance. Also good. For example, when a face image is detected at the same position in a plurality of captured images 90 taken at different times, the face image may be automatically excluded from the detection result. An area (range) to be excluded from the detection result of the face image may be manually set by the user.

  As shown in FIG. 7, when a plurality of face images are detected, a plurality of frame images 102 indicating the face areas of the plurality of face images are displayed on the display 22 (authentication screen 100). In the example illustrated in FIG. 7, a frame image 102 </ b> A corresponding to the face image of the user A, a frame image 102 </ b> B corresponding to the face image of the user B, and a frame image 102 </ b> C corresponding to the face image of the user C are displayed on the display 22.

  Each of these frame images 102A to 102C functions as a software key. However, the inner side of each frame of the frame images 102A to 102C is set as the touch effective range. That is, when a plurality of face images are detected on the authentication screen 100, a screen on which the user can select his / her face image (frame image 102) is displayed on the display 22.

  When any of the frame images 102A to 102C is touched (selected), the face image corresponding to the selected frame image 102 is specified as the face image for authentication. When the face image for authentication is specified, face authentication using the face image for authentication (face authentication for the user corresponding to the face image for authentication) is executed. For example, when the range of the frame image 102C is selected, the face image corresponding to the frame image 102C is specified as the face image for authentication, and the face authentication for the user C is executed.

  A specific method of face authentication processing using a face image is described in Japanese Patent Application Laid-Open No. 2004-265267 filed by the present applicant. Briefly, first, feature points (coordinates of specific parts in the face such as eyes, nose, mouth, etc.) are extracted from the face image for authentication, and feature quantities at each feature point are calculated. Next, the feature amount of the authentication face image is compared with the feature amounts of a plurality of comparison images stored in advance in the HDD 28, and the degree of coincidence of each of the plurality of comparison images with respect to the authentication face image is calculated. (Set).

  Then, whether or not the user is a registered user is determined depending on whether or not there is a comparison image having a matching degree with the authentication face image equal to or greater than a predetermined threshold among the plurality of comparison images. Here, when the degree of coincidence of a certain comparison image is greater than or equal to the threshold, it is determined that the user corresponding to the authentication face image and the registered user corresponding to the comparison image are the same person. That is, it is determined that the user corresponding to the face image for authentication is a registered user.

  If it is determined that the user is a registered user, the user authentication is successful, and the image forming apparatus 10 permits the login of the user corresponding to the face image for authentication. In this case, the user is notified that the user authentication is successful. For example, a message indicating that the user authentication is successful is displayed on the display 22. Thereafter, the home screen is displayed on the display 22.

  On the other hand, when it is determined that the user is not a registered user, the user authentication is unsuccessful, and the image forming apparatus 10 does not permit the user corresponding to the authentication face image to log in. In this case, the user is notified that the user authentication has failed. For example, a message indicating that the user authentication has failed is displayed on the display 22. Thereafter, the authentication screen 100 may be displayed on the display 22 or a home screen may be displayed. However, when the home screen is displayed after user authentication has failed, a predetermined application and a part of a predetermined job provided in the image forming apparatus 10 may not be used (executed).

  When the number of persons existing in the shooting range of the camera 52 is one (when there is one detected face image), the detected face image is automatically specified as a face image for authentication, and the face image Face authentication for the user corresponding to is performed. Even when the number of persons existing in the shooting range of the camera 52 is one, the above-described methods can be used as the face image detection method and the face authentication method.

  The above-described operation of the image forming apparatus 10 is realized by the CPU 12 executing a control program stored in the RAM 14. Specific processing will be described later with reference to a flowchart.

  FIG. 8 is an illustrative view showing one example of a memory map 70 of the RAM 14 shown in FIG. As shown in FIG. 8, the RAM 14 includes a program storage area 72 and a data storage area 74. As described above, the control program is stored in the program storage area 72 of the RAM 14. The control program includes a display program 72a, an operation detection program 72b, a presence determination program 72c, a shooting program 72d, a distortion correction program 72e, a face detection program 72f, a specific program 72g, a feature amount calculation program 72h, a matching degree setting program 72i, and an authentication program. 72j and a communication program 72k.

  The display program 72a is a program for displaying various screens such as a home screen or an authentication screen 100 on the display 22 using image generation data 74b described later.

  The operation detection program 72b is a program for detecting an operation on each unit of the image forming apparatus 10. For example, the operation detection program 72b is a program for acquiring touch coordinate data output from the touch panel 20 and detecting that software keys included in various screens displayed on the display 22 have been operated. The operation detection program 72b is also a program for detecting an operation input from the operation button 26a. Further, the operation detection program 72b is a program for acquiring the touch coordinate data output from the touch panel 20 and detecting the frame image 102 selected by the user from the plurality of frame images 102.

  The presence determination program 72c acquires the distance data output by the human detection sensor 50, and depending on whether the distance indicated by the distance data is within a predetermined distance (the first distance L1 in the first embodiment). This is a program for determining whether or not a person exists in the range A.

  The shooting program 72d is a program for driving (acquiring) the shot image 90 by driving the image sensor of the camera 52. However, according to the shooting program 72d, the CPU 12 drives the image sensor of the camera 52 when it is determined that a person exists in the range A, and turns the image sensor of the camera 52 when it is determined that no person exists in the range A. Stop.

  The distortion correction program 72e is a program for generating authentication image data 74d corresponding to an authentication image in which distortion of the captured image 90 corresponding to the captured image data 74c is corrected.

  The face detection program 72f is a program for detecting a face area from an authentication image corresponding to the authentication image data 74d and generating face image data 74e corresponding to the face image included in the face area.

  The identification program 72g is a program for identifying a face image for authentication according to the frame image 102 selected by the user detected according to the operation detection program 72b.

  The feature amount calculation program 72h is a program for calculating the feature amount of the authentication face image from the face image data 74e corresponding to the authentication face image. The feature amount calculation program 72h is a program for calculating feature amounts of a plurality of comparison images corresponding to the comparison image data from comparison image data included in each of authentication information data 74f described later. However, the feature amount of the comparison image is calculated when a registered user corresponding to the comparison image is registered, and is stored in the HDD 28 as a part of the authentication information data 74f.

  The degree-of-match setting program 72i compares the feature amount of the authentication face image with each of the feature amounts of the plurality of comparison images, and sets the degree of match for the authentication face image in each of the plurality of comparison images. It is a program to do.

  The authentication program 72j is a program for performing face authentication by the method described above according to the degree of coincidence with the authentication face image set in each of the plurality of comparison images.

  The communication program 72k is a program for communicating with an external computer or the like via a network.

  Although illustration is omitted, the program storage area 72 also stores an image reading program, an image forming program, and the like. The image reading program is a program for controlling the image reading unit 30 to read an image of a document and to output an image signal (image data) corresponding to the read image. The image forming program is a program for controlling the image forming unit 32 to print a multicolor or single color image on a sheet. The program storage area 72 also stores programs for selecting and executing various functions of the image forming apparatus 10.

  The data storage area 74 of the RAM 14 stores operation input data 74a, image generation data 74b, captured image data 74c, authentication image data 74d, face image data 74e, authentication information data 74f, and the like.

  The operation input data 74a is, for example, touch coordinate data or / and operation data detected (acquired) according to the operation detection program 72b. The detected touch coordinate data and / or operation data is stored in time series.

  The image generation data 74 b is data such as polygon data or texture data for generating display image data displayed on the display 22 and corresponding to various screens such as the home screen or the authentication screen 100. The image generation data 74b also includes software key image data such as the frame image 102, for example.

  The photographed image data 74c is image data regarding the photographed image 90 photographed by the camera 52 in accordance with the photographing program 72d.

  The authentication image data 74d is image data for an authentication image generated by performing distortion correction processing on the captured image 90 in accordance with the distortion correction program 72e.

  The face image data 74e is image data regarding a face image generated according to the face detection program 72f. The face image data 74e is data obtained by copying a part of the authentication image data 74d (part included in the face area in the authentication image).

  The authentication information data 74f is data about each authentication information of a plurality of registered users, and includes identification information data about identification information, comparison image data about a comparison image, and data about a feature amount of the comparison image. The authentication information data 74 f is read from the HDD 28 and stored in the RAM 14.

  Although not shown, the data storage area 74 stores other data necessary for execution of the control program, and is provided with a timer (counter) and a register necessary for execution of the control program.

  FIG. 9 is a flowchart showing an example of the authentication process of the CPU 12 shown in FIG. This authentication process is started when the main power supply of the image forming apparatus 10 is turned on or when the image forming apparatus 10 is returned from the standby state (power saving mode).

  As shown in FIG. 9, when starting the authentication process, the CPU 12 determines whether or not a person exists in the range A in step S1. If “NO” in the step S1, that is, if it is determined that there is no person in the range A, the process returns to the step S1. If “YES” in the step S1, that is, if it is determined that there is a person in the range A, the authentication information is read from the HDD 28 in a step S3, and the process proceeds to the step S5.

  Subsequently, in step S5, photographing by the camera 52 is started. In step S7, an authentication image is generated from the photographed image 90 photographed by the camera 52. In step S9, a face image is detected from the authentication image. Then, the process proceeds to step S11.

  In step S11, it is determined whether a plurality of face images have been detected. If “NO” in the step S11, that is, if a plurality of face images are not detected, the detected face images are specified as authentication face images, and the process proceeds to a step S17 described later. On the other hand, if “YES” in the step S11, that is, if a plurality of face images are detected, the authentication screen 100 including the plurality of face images is displayed on the display 22 in a step S13, and in a step S15, It is determined whether an authentication face image has been specified.

  If “NO” in the step S15, that is, if a face image for authentication is not specified, the process returns to the step S15. On the other hand, if “YES” in the step S15, that is, if a face image for authentication is specified, face authentication for the user corresponding to the face image for authentication is executed in a step S17.

  Subsequently, in step S19, it is determined whether or not the authentication is successful. If “YES” in the step S19, that is, if the authentication is successful, in step S21, the user corresponding to the authentication face image is permitted to log in, and the user is notified that the authentication is successful, The authentication process ends. On the other hand, if “NO” in the step S19, that is, if the authentication fails, in step S23, the login of the user corresponding to the face image for authentication is not permitted, and the user is notified that the authentication has failed. Then, the authentication process ends.

  According to the first embodiment, when a plurality of face images are detected, a screen on which the user can select his / her face image is displayed on the display 22, so even when a plurality of face images are detected. User authentication can be performed appropriately and easily.

  Further, according to the first embodiment, the authentication screen 100 including a plurality of face images is displayed on the display 22, and the face image for authentication is specified from the plurality of face images according to the touch input. And user authentication can be performed easily.

  In the first embodiment, a distance sensor is used as the human detection sensor 50, but it is not necessary to be limited to this. For example, a camera 52 may be used as the human detection sensor 50. In this case, the presence or absence of a person can be detected from the captured image captured by the camera 52. However, in this case, the image sensor of the camera 52 is always driven when the main power supply of the image forming apparatus 10 is turned on.

  In the first embodiment, the case where the lens of the camera 52 is a fisheye lens has been described as an example. However, the present invention is not limited to this. For example, as the lens of the camera 52, a wide-angle lens or a standard lens can be used. When the lens of the camera 52 is a standard lens, the process for correcting distortion can be omitted.

  Furthermore, in the first embodiment, the case where there is one camera 52 has been described as an example, but it is not necessary to be limited to this. For example, two or more cameras may be provided, or different shooting ranges may be shot using a movable camera. In these cases, a plurality of captured images are combined and corrected to generate an authentication image.

  Furthermore, in the first embodiment, the face image for authentication is specified by touch input to the touch panel 20, but it is not necessary to be limited to this. For example, an authentication face image may be specified by operating the operation button 26a.

In addition, each step of the flowchart shown in the first embodiment can be appropriately changed in order of processing as long as the same result is obtained. For example, in the first embodiment, the authentication information is read in step S3. However, the authentication information only needs to be read before the face authentication is executed in step S17. For this reason, in the process of reading the authentication information, it is possible to appropriately change the order of processing in the range up to step S17.
[Second Embodiment]
The image forming apparatus 10 according to the second embodiment is the same as the first embodiment except that there are a plurality of registered user candidates corresponding to the face image for authentication in the face authentication process. Different contents will be described, and redundant description will be omitted.

  In the face authentication process, there may be a plurality of comparison images having a matching degree with a face image for authentication equal to or greater than a predetermined threshold. That is, there may be a plurality of registered user candidates corresponding to the authentication face image. In this case, it is necessary to specify which user is allowed to log in. Hereinafter, registered user candidates may be referred to as candidate users. In addition, the degree of coincidence set in the comparison image corresponding to the candidate user may be simply referred to as the degree of coincidence of the candidate user.

  FIG. 10 is an illustrative view showing one example of an authentication screen 100 of the second embodiment. As shown in FIG. 10, in the second embodiment, when there are a plurality of candidate users, an image (identification information icon) 104 corresponding to a plurality of pieces of identification information corresponding to each of the plurality of candidate users is displayed on the authentication screen. 100 (displayed on the display 22).

  The identification information icon 104 is an image including candidate user identification information stored in the HDD 28. For example, the candidate user identification information includes the candidate user's name, user ID, employee number, registration face image, and the like. In the example illustrated in FIG. 10, the name of the candidate user is displayed on the identification information icon 104.

  The identification information icon 104 is an image surrounded by a substantially rectangular frame and functions as a software key. However, the inside of each frame of the plurality of identification information icons 104 is set as a touch effective range.

  In the example illustrated in FIG. 10, the face image of the user C is specified as the face image for authentication, and the three identification information icons 104 </ b> A to 104 </ b> A corresponding to each of the three candidate users corresponding to the face image of the user C are included. 104C is displayed on the display 22. The identification information icons 104A to 104C are arranged in the vertical direction.

  In addition, each of the identification information icons 104A to 104C is set with a priority according to the matching degree of the corresponding candidate user. However, the matching degree of the candidate user and the priority of the identification information icon 104 correspond to each other. If the matching degree of the candidate user is high, the priority of the identification information icon 104 is high, and if the matching degree of the candidate user is low, the identification information is displayed. The priority of the icon 104 is lowered.

  The identification information icons 104A to 104C are arranged according to the priority. For example, in the example illustrated in FIG. 10, the identification information icons 104 </ b> A to 104 </ b> C are arranged in descending order of priority from the top. Therefore, the priority of the identification information icon 104A arranged on the uppermost side is the highest. The priority of the identification information icon 104B arranged second from the top is the second highest.

  However, the arrangement of the plurality of identification information icons 104 described above is merely an example, and is not limited thereto, and can be changed as appropriate. For example, the plurality of identification information icons 104 may be arranged in descending order of priority from the lower side. Further, the identification information icon 104 having the highest priority may be arranged at the center in the vertical direction.

  A plurality of identification information icons 104 may be arranged in the left-right direction. In this case, the plurality of identification information icons 104 may be arranged in descending order of priority from the left side, or may be arranged in descending order of priority from the right side. In addition, the identification information icon 104 corresponding to the candidate user with the highest priority may be arranged in the center in the left-right direction.

  Further, a priority order may be set for each of the plurality of identification information icons 104 according to the priority, and a number (number) corresponding to the priority order may be displayed in the vicinity of the plurality of identification information icons 104. Furthermore, the identification information icon 104 with the highest priority may be displayed larger than the identification information icon 104 with the lower priority.

  Furthermore, in the example illustrated in FIG. 10, the case where there are three candidate users has been described. However, when there are four or more candidate users, the identification information icons 104 corresponding to all the candidate users are displayed. Alternatively, a part of identification information icons 104 having a high priority may be extracted and the extracted identification information icons 104 may be displayed.

  When any of the identification information icons 104A to 104C is touched (selected), the identification information corresponding to the selected identification information icon 104 is specified as authentication identification information. The image forming apparatus 10 performs face authentication for a candidate user corresponding to the identification information for authentication. However, as described above, each of the plurality of candidate users is a registered user. For this reason, even if any of a plurality of pieces of identification information is specified as identification information for authentication, user authentication is successful.

  Although illustration is omitted, the control program stored in the RAM 14 includes a priority setting program for setting a priority for the identification information icon 104 according to the degree of coincidence of candidate users.

  The identification program 72g is also a program for identifying identification information for authentication according to the identification information icon 104 selected by the user. The above-described operation of the image forming apparatus 10 is realized by the CPU 12 executing a control program.

  Hereinafter, the authentication process in the second embodiment will be described with reference to the flowchart. The same processes as the authentication process described in the first embodiment are denoted by the same reference numerals, and the description of the duplicated contents is omitted. Will be or briefly explained.

  FIG. 11 is a flowchart showing an example of the authentication process of the second embodiment. As shown in FIG. 11, when starting the authentication process, the CPU 12 executes face authentication for the user corresponding to the face image for authentication in step S17, and then in step S31, determines whether there are a plurality of candidate users. to decide.

  If “NO” in the step S31, that is, if there are not a plurality of candidate users, the process proceeds to a step S19 to determine whether or not the authentication is successful. On the other hand, if “YES” in the step S31, that is, if there are a plurality of candidate users, the identification information icons 104 for a plurality of identification information corresponding to the plurality of candidate users are displayed on the display 22 in a step S33. In step S35, it is determined whether or not identification information for authentication has been specified.

  If “NO” in the step S35, that is, if the identification information for authentication is not specified, the process returns to the step S35. On the other hand, if “YES” in the step S35, that is, if identification information for authentication is specified, in step S37, the user corresponding to the authentication face image is permitted to log in, and the authentication is successful. Is notified to the user, and the authentication process is terminated.

  In the second embodiment, when there are a plurality of registered user candidates corresponding to the face image for authentication, the identification information icon 104 for each of a plurality of pieces of identification information corresponding to each of the plurality of candidate users is presented to the user. The login of the candidate user corresponding to the identification information for authentication specified in response to the touch input is permitted. For this reason, even when there are a plurality of registered user candidates corresponding to the face image for authentication, user authentication can be performed appropriately and easily.

  Further, according to the second embodiment, the priority is set according to the matching degree of the candidate users corresponding to each of the plurality of identification information icons 104, and the plurality of identification information icons 104 are arranged according to the priority. Therefore, it becomes easy for the user to recognize and select the identification information icon 104.

  In the second embodiment, the identification information icon 104 is provided on the authentication screen 100. However, the present invention is not limited to this. FIG. 12 is an illustrative view showing one example of a candidate selection screen 120 of the second embodiment. As shown in FIG. 12, when there are a plurality of candidate users, a candidate selection screen 120 including identification information icons 104 for a plurality of pieces of identification information corresponding to the plurality of candidate users is displayed on the display 22. May be.

  In the example illustrated in FIG. 12, the candidate selection screen 120 is displayed so as to overlap the lower side of the authentication screen 100. The candidate selection screen 120 includes identification information icons 104A to 104G. For example, the identification information icons 104A to 104G include comparison images of corresponding candidate users. These identification information icons 104A to 104G are arranged so as to be arranged in the left-right direction. For example, among the identification information icons 104A to 104G, the identification information icon 104D having the highest priority is arranged at the center in the left-right direction.

  However, the arrangement mode of the plurality of identification information icons 104 on the candidate selection screen 120 is not particularly limited and can be changed as appropriate.

In this case, when a plurality of identification information icons 104 are displayed in step S33 of the authentication process of the second embodiment described above, a candidate selection screen 120 including a plurality of identification information icons 104 is displayed on the display 22.
[Third embodiment]
In the image forming apparatus 10 according to the third embodiment, when a plurality of registered user face images are detected from the authentication image, the specifying screen 130 for specifying the authentication face image is used instead of the authentication screen 100. Since it is the same as that of the first embodiment except that it is displayed on the display 22, the contents different from those of the first embodiment will be described, and redundant description will be omitted.

  FIG. 13 is an illustrative view showing one example of a specifying screen 130 of the third embodiment. In the third example, when a plurality of face images are detected, face authentication is performed for each of the plurality of face images.

  Here, when there are two or more face images determined to be registered users among a plurality of face images (when two or more registered users are included in the authentication image), it is shown in FIG. Such a specifying screen 130 is displayed on the display 22.

  A plurality of images (specific icons) 106 corresponding to face images determined to be registered users are provided on the specifying screen 130 (displayed on the display 22). In the example shown in FIG. 13, three specifying icons 106 </ b> A to 106 </ b> C corresponding to each of the three registered users are provided on the specifying screen 130.

  The identification icon 106 is an image including registered user identification information corresponding to the face image. For example, the identification information included in the specifying icon 106 is the name, user ID, employee number, and registered face image of the registered user. In the example illustrated in FIG. 13, the name of the registered user and a face image for registration are displayed on the specifying icon 106.

  The specifying icon 106 is an image surrounded by a substantially rectangular frame and functions as a software key. However, the inside of each frame of the plurality of identification icons 106 is set as a touch effective range.

  In the example shown in FIG. 13, the identifying icons 106A to 106C are arranged in the vertical direction. However, the identifying icons 106 </ b> A to 106 </ b> C are arranged according to the priority set according to the position where each corresponding face image is detected (the position of the face image with respect to the image forming apparatus 10). For example, the priority is set to each of the specifying icons 106 </ b> A to 106 </ b> C in the order in which the position of the corresponding face image is closer to the center in the left-right direction of the image forming apparatus 10. The identifying icons 106A to 106C are arranged in descending order of priority from the top.

  However, whether or not the position of the face image is close to the center in the left-right direction of the image forming apparatus 10 is determined from the position of the face image in the authentication image. Here, depending on the position where the camera 52 is provided, the center position in the left-right direction of the authentication image may not match the center position in the left-right direction of the image forming apparatus 10. In this case, the center position in the left-right direction of the image forming apparatus 10 in the authentication image is set according to the position of the camera 52 in the image forming apparatus 10.

  In addition, the arrangement | positioning aspect of the icon 106 for identification does not need to be specifically limited, It can change suitably. For example, the identification icons 106 may be arranged in the left-right direction.

  When any one of the specifying icons 106A to 106C is touched (selected), the registered user corresponding to the selected specifying icon 106 is specified as the user to be authenticated. That is, a face image for authentication is specified. When the user to be authenticated is specified, the image forming apparatus 10 permits the login of the user to be authenticated.

  Instead of displaying the specifying screen 130 on the display 22, the frame image 102 corresponding to the face image determined to be a registered user may be displayed on the authentication screen 100. In this case, the registered user corresponding to the selected frame image 102 is specified as the user to be authenticated.

  Further, when there is one face image determined to be a registered user among a plurality of face images (when the number of registered users included in the authentication image is one), the face image is automatically changed to that face image. Allow the corresponding user to log in. As in the first embodiment, the authentication screen 100 may be displayed, and when the face image is touched, the user corresponding to the face image may be permitted to log in.

  Hereinafter, the authentication process in the third embodiment will be described with reference to the flowchart. The same processes as the authentication process described in the first embodiment are denoted by the same reference numerals, and the description of the duplicated contents is omitted. Will be or briefly explained.

  FIG. 14 is a flowchart showing an example of the authentication process of the third embodiment. As shown in FIG. 14, when the CPU 12 starts the authentication process, if “YES” in the step S11, the CPU 12 executes face authentication for each of the plurality of face images in a step S51, and in step S53, the plurality of registrations are performed. Determine if the user exists. Here, it is determined whether or not there are two or more face images determined to be registered users.

  If “NO” in the step S53, that is, if there is one registered user, the process proceeds to a step S21 to permit the login of the user, notify the user that the authentication is successful, and perform the authentication process. finish. On the other hand, if “YES” in the step S53, that is, if there are a plurality of registered users, a plurality of specifying icons 106 corresponding to the plurality of registered users are displayed on the display 22 in a step S55. In step S57, it is determined whether the user to be authenticated has been specified.

  If “NO” in the step S57, that is, if the user to be authenticated is not specified, the process returns to the step S57. On the other hand, if “YES” in the step S57, that is, if a user to be authenticated is specified, the process proceeds to a step S21 to permit the user to log in, notify the user that the authentication is successful, and authenticate. The process ends.

  Note that the contents of the processing up to step S11 and the processing after step S17 are the same as those in the first embodiment, and thus the description thereof is omitted.

  According to the third embodiment, when a plurality of registered user face images are detected from the authentication image, the authentication face image is specified, and login of the specified registered user is permitted. For this reason, even when a plurality of registered user face images exist in the authentication image, user authentication can be performed appropriately and easily.

  Further, according to the third embodiment, a plurality of specifying icons 106 corresponding to each of a plurality of face images are presented to the user, and login for a registered user corresponding to the selected specifying icon 106 is permitted. For this reason, even when a plurality of registered user face images exist in the authentication image, user authentication can be performed appropriately and easily.

  Further, according to the third embodiment, since the plurality of identification icons 106 are arranged according to the priority set according to the position of the corresponding face image with respect to the image forming apparatus 10, the user can specify the identification icon. 106 is easier to recognize and select.

  Note that the specific configuration and the like given in the above-described embodiments are examples, and can be appropriately changed according to the actual product. Moreover, as long as the same result is obtained for each step of the flowchart shown in the above-described embodiment, the processing order can be changed as appropriate.

DESCRIPTION OF SYMBOLS 10 ... Image forming apparatus 12 ... CPU
14 ... RAM
DESCRIPTION OF SYMBOLS 28 ... Memory | storage part 30 ... Image reading part 32 ... Image formation part 50 ... Human detection sensor 52 ... Camera

Claims (13)

An image display device comprising an input unit and a display,
Photographing means for photographing a photographed image including an image of a user existing around the image display device;
Face detection means for detecting a first image corresponding to the face image of the user from the captured image;
When a plurality of the first images are detected by the face detection means, display means for displaying the plurality of first images on the display, and the plurality of first images displayed on the display, An image display device comprising: a first specifying unit that specifies a first image for authentication according to an operation input in the input unit. Storage means for storing a face image for registration corresponding to each of a plurality of registered users;
Candidate for displaying a plurality of identification information corresponding to each of the plurality of registered user candidates on the display when there are a plurality of registered user candidates corresponding to the user corresponding to the first image for authentication 2. The image according to claim 1, further comprising: a presentation unit; and a second identification unit that identifies identification information for authentication according to an operation input in the input unit from the plurality of identification information displayed on the display. Display device. A first priority setting unit configured to set a priority for each of the plurality of registered user candidates based on the first image for authentication and the face image for registration;
The image display apparatus according to claim 2, wherein the display unit arranges the plurality of pieces of identification information according to the priority of each of the plurality of registered user candidates. An image display device comprising an input unit and a display,
Storage means for storing a face image for registration corresponding to each of a plurality of registered users;
Photographing means for photographing a photographed image including an image of a user existing around the image display device;
Face detection means for detecting the user's face image from the captured image;
Determining means for determining whether or not the user is the registered user based on the face image of the user detected by the face detecting means and the face image for registration stored in the storage means;
Display means for displaying the plurality of first images on the display when there are a plurality of first images corresponding to the face image of the user determined to be the registered user by the determination means; and An image display device comprising: a first specifying unit that specifies a first image for authentication in accordance with an operation input in the input unit from among the plurality of displayed first images. A specifying information presenting means for displaying a plurality of specifying information corresponding to each of the plurality of first images on the display;
The first specifying unit is configured to authenticate the first image corresponding to the specifying information selected in accordance with an operation input in the input unit from the plurality of specifying information displayed on the display. The image display device according to claim 4, wherein the image display device is specified as a first image for use. A second priority setting unit configured to set a priority for each of the plurality of first images according to a position where each of the user's face images corresponding to the plurality of first images is detected;
The image display device according to claim 5, wherein the display unit arranges the plurality of pieces of identification information according to a priority of the first image. Candidate for displaying a plurality of identification information corresponding to each of the plurality of registered user candidates on the display when there are a plurality of registered user candidates corresponding to the user corresponding to the first image for authentication The presenting means, and further comprising: a second specifying means for specifying identification information for authentication according to an operation input in the input unit from the plurality of identification information displayed on the display. The image display device according to any one of the above. A first priority setting unit configured to set a priority for each of the plurality of registered user candidates based on the first image for authentication and the face image for registration;
The image display device according to claim 7, wherein the display unit arranges the plurality of pieces of identification information according to the priority of each of the plurality of registered user candidates.   An image forming apparatus comprising the image display device according to claim 1. A control program for an image display device including an input unit, a display, and a photographing unit that captures a photographed image including an image of a user existing in the surroundings,
A processor of the image display device;
Face detection means for detecting a first image corresponding to the face image of the user from the captured image;
When a plurality of the first images are detected by the face detection means, display means for displaying the plurality of first images on the display, and the plurality of first images displayed on the display, A control program for an image display device that functions as a first specifying unit that specifies a first image for authentication according to an operation input in the input unit. A processor of an image display device including an input unit, a display, and a photographing unit that captures a captured image including an image of a user existing in the surrounding area,
(A) detecting a first image corresponding to the face image of the user from the captured image;
(B) displaying a plurality of first images on the display when a plurality of the first images are detected in the step (a); and (c) displaying on the display by the step (b). The control method of performing the step which specifies the 1st image for authentication according to the operation input in the said input part from the said some said 1st image. A control program for an image display device comprising an input unit, a display, a storage means for storing a registration face image corresponding to each of a plurality of registered users, and a photographing means for photographing a photographed image including an image of a user existing around There,
A processor of the image display device;
Face detection means for detecting a first image corresponding to the face image of the user from the captured image;
Determining means for determining whether or not the user is the registered user based on the face image of the user detected by the face detecting means and the face image for registration stored in the storage means;
Display means for displaying the plurality of first images on the display when there are a plurality of first images corresponding to the face image of the user determined to be the registered user by the determination means; and A control program for an image display device that functions as a first specifying unit that specifies a first image for authentication in response to an operation input in the input unit from among the plurality of displayed first images. A processor of an image display device comprising: an input unit, a display, a storage unit that stores a registration face image corresponding to each of a plurality of registered users;
(A) detecting a first image corresponding to the face image of the user from the captured image;
(B) It is determined whether the user is the registered user based on the face image of the user detected in the step (a) and the registration face image stored in the storage unit. Step,
(C) when there are a plurality of first images corresponding to the face image of the user determined to be the registered user in the step (b), the step of displaying the plurality of first images on the display; And (d) executing a step of identifying a first image for authentication according to an operation input in the input unit from among the plurality of first images displayed on the display in the step (c). Method.

Images