JP2009156948A - Display control apparatus, display control method, and display control program - Google Patents

Abstract

A display control device and the like for capturing an image around a device and controlling a display screen based on a result of analyzing the captured image.
A display control apparatus (100) includes a display screen (270) and a camera (260) that images the front of the display screen (270), and performs display control of the display screen (270) by analyzing the captured image. A face recognition processing unit 210 for recognizing the face of a person having a predetermined area or more from the captured image, a feature extraction processing unit 220 for extracting the feature of the face from the face image, and the feature of the face as feature data in advance. A determination processing unit 230 that compares the feature data storage table 250 to be stored with the extracted feature data of the face and the feature data stored in advance in the feature data storage table 250 to determine whether or not they match, and a determination processing unit 230 And a display control processing unit 240 that controls the display data displayed on the display screen to be hidden when the facial features do not match as a result of the determination.
[Selection] Figure 2

Description

  The present invention relates to a display control device that controls a display screen, and more particularly to a display control device that performs display control based on a captured image.

  In an information processing apparatus such as a personal computer having a display screen, as a function for preventing burn-in of a display (CRT), a screen saver is generally activated when there is no input operation for a certain period of time. However, at present, the display has been changed to a liquid crystal display, and it has become difficult for image sticking to occur as before, so the function of the screen saver has been changed to protect confidential matters on the screen.

  As a technique for protecting the secret displayed on the screen of a computer using a screen saver, there is a technique disclosed in Patent Document 1 or 2. The technique shown in Patent Document 1 is a technique for detecting the presence or absence of an operator and identifying whether or not the operator can be used by the display device itself, and preventing the information processing devices to be connected and used from being limited. A display unit, a sensor unit, a reader unit, and a display control unit, and displays display data from the information processing apparatus on a screen. When the operator leaves the screen during use, a sensor unit using infrared rays detects it and outputs a leaving signal to the display control unit, and the display on the display unit is darkened by the luminance control signal to make it unreadable. When the operator returns, the sensor unit activates the reader unit with the detection signal, reads the bar code of the card with the input unit, verifies the identity with the identification information read from the card and stores it at the verification unit, and sends a permission signal Output and change the brightness control signal to brighten the display. The screen saver function including identification is not necessary for the information processing apparatus, and can be performed only by the display apparatus.

The technique shown in Patent Document 2 is a technique related to a display device that can display display contents only to people who have specific viewing authority and can prevent burn-in due to long-time display, and permits display. And a sensor for judging the surrounding physical conditions, and only when it is judged that there is a subject who is allowed to display and to be shown, the character of the predetermined input data on the display unit And / or control to display an image.
JP-A-10-97233 Japanese Patent Application Laid-Open No. 2004-93885

  However, since the techniques shown in Patent Documents 1 and 2 use an identification card, a barcode, or an authentication code as means for authenticating whether the operator is a valid person, the operator performs an authentication procedure. There is a problem that it is necessary and time-consuming.

  In addition, if the operator peeks from behind while performing the formal authentication procedure, the confidential information displayed on the screen will be seen without the operator's knowledge. Has a problem.

  Accordingly, the present invention has been made to solve the above-described problems, and includes a display control apparatus and a display control method for capturing an image around the apparatus and controlling a display screen based on a result of analyzing the captured image. An object is to provide a display control program.

(1. Operator authentication)
The display control device includes a feature storage unit that stores the feature of the operator's face as feature data, a display unit that includes a display screen that displays the display data, and an image that captures the front of the display screen at predetermined time intervals. Means, a face recognizing means for recognizing a person's face having a predetermined area or more from the image captured by the image capturing means, and a feature extracting means for extracting the feature of the face from the face image of the face recognized by the face recognizing means. Comparing the facial feature extracted by the feature extraction unit with the facial feature data of the operator stored in advance by the feature storage unit to determine whether they match, and the determination unit And display control means for controlling the display data displayed on the display screen to be hidden when the facial features do not match as a result of the determination.

  As described above, in the present invention, the operator is automatically authenticated, and in the case of a person who is not registered in advance, the display data is controlled to be hidden, so that it is displayed on the screen other than the registered person. There is an effect that the confidential information can be reliably protected without being seen.

Further, since the apparatus automatically performs authentication, there is an effect that the operator does not need to perform authentication processing and operations and can save labor.
When controlling the display screen to be hidden, a screen saver may be activated, the entire screen may be darkened so that the display cannot be seen, or a process of filling the entire screen is performed. You may go.

(2. Prevention of peeping by others)
The display control device stores the feature extraction when the feature storage unit stores the features of the faces of a plurality of operators as feature data, and the face recognition unit recognizes the faces of a plurality of persons having a predetermined area or more. The means extracts the facial features from the face images of each of the plurality of persons, and the determination means extracts the facial features extracted by the feature extraction means and the feature storage means for each of the face images of the plurality of persons. Compares the feature data of the plurality of operator's faces stored in advance to determine whether they match, and the result of the determination by the determination means is that one or more faces of the plurality of persons The display data displayed on the display screen is controlled to be non-displayed when the characteristics are not consistent.

  As described above, in the present invention, when the face recognizing unit recognizes the faces of a plurality of persons having a predetermined area or larger, the feature data of the plurality of operators stored in advance by the feature storing unit are compared. If one or more facial features do not match, the display data displayed on the display screen is controlled to be non-displayed. The information displayed on the screen is not seen without being noticed, and it is possible to reliably protect confidential matters.

(3. Judgment by continuity)
The display control apparatus is configured to display the image captured by the imaging unit while the face image of the human face recognized by the face recognition unit is larger than a predetermined area and / or within a predetermined region. Is characterized by determining that the person is the same person and controlling the display control means to maintain the display of the display data displayed on the display screen.

As described above, in the present invention, when the imaging unit captures images at a predetermined time interval, the face image of the face of one person recognized by the face recognition unit in the captured image is larger than a predetermined area. And / or while it is within the predetermined area, the one person is judged to be the same person, and the display control means controls the display screen, so that the same person can be judged accurately. In addition, there is an effect that processing for determination can be reduced and processing can be performed efficiently.
Further, since the control to hide is not performed while the same person is imaged, there is an effect that it is easy for the operator to use.

(4. Judgment by error setting)
In the display control apparatus, the feature storage unit stores discrete feature data including the upward, downward, right, and left faces of the operator, and the determination unit stores the discrete The feature data is continuous data, and the determination process is performed based on whether or not the facial data extracted from the image captured by the imaging unit is included in the range of the continuous data.

  As described above, in the present invention, the feature storage unit stores the facial feature data of the operator's upward, downward, rightward, and leftward directions, and the determination unit continues the discrete feature data. Since the determination process is performed based on whether or not the facial features extracted from the image captured by the imaging unit are included in the range of the continuous data, the operator can perform various operations such as up / down / left / right and diagonal directions other than the front. Even if the user is facing in any direction, authentication can be performed, and display control can be performed appropriately.

(5. Feature extraction)
In the present display control device, the feature data is a ratio of at least one of eyes, nose, mouth, and ear, and the determination means performs determination processing based on the ratio.
As described above, in the present invention, since authentication is performed by extracting a ratio of at least one size of the eyes, nose, mouth, and ears as feature data, accurate authentication can be performed by impersonation or the like. There is an effect that it is possible to prevent leakage of confidential matters.

  Although the present invention has been described as an apparatus, the present invention can be understood as a system, method, and program as will be apparent to those skilled in the art. These outlines of the invention do not enumerate the features essential to the present invention, and a sub-combination of these features can also be an invention.

  Embodiments of the present invention will be described below. The present invention can be implemented in many different forms. Therefore, the present invention should not be construed based only on the description of the present embodiment. Also, the same reference numerals are given to the same elements throughout the present embodiment.

  In this embodiment, the apparatus will be mainly described. However, as will be apparent to those skilled in the art, the present invention can be implemented as a system, a method, and a program for operating a computer. In addition, the present invention can be implemented in hardware, software, or hardware and software embodiments. The program can be recorded on any computer-readable medium such as a hard disk, CD-ROM, DVD-ROM, optical storage device, or magnetic storage device. Furthermore, the program can be recorded on another computer via a network.

(First embodiment of the present invention)
(1. Configuration and function)
(1-1 Hardware configuration)
FIG. 1 is a hardware configuration diagram of the display control apparatus according to the present embodiment. The display control apparatus 100 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, a flash memory (Flash memory) 104, an HD (Hard disk) 105 as an external storage device, A LAN (Local Area Network) card 106, a mouse 107, a keyboard 108, a video card 109, a display 109a that is a display device electrically connected to the video card 109, a sound card 110, and an electrical connection to the sound card 110. It comprises a speaker 110a, which is a sound output device, and a drive 111 for reading and writing storage media such as a flexible disk, CD-ROM, and DVD-ROM.
Note that the above hardware configuration is merely an example, and it is natural that the components can be changed.

(1-2 Module configuration and functions)
FIG. 2 is a module configuration diagram of the display control apparatus according to the present embodiment. The display control apparatus 100 includes a face recognition processing unit 210 as a face recognition unit, a feature extraction processing unit 220 as a feature extraction unit, a determination processing unit 230 as a determination unit, and a display control processing unit 240 as a display control unit. And a feature data storage table 250 as a feature storage means, a camera 260 as an imaging means, and a display screen 270.

  The face recognition processing unit 210 performs a process of recognizing a human face having an area larger than a predetermined value from an image captured by the camera 260 and extracting it as a face image. The area value here may be the ratio of the face area to the entire screen.

The feature extraction processing unit 220 performs a process of extracting facial features from the face image recognized by the face recognition processing unit 210. Here, the ratio of at least one size of eyes, nose, mouth, and ears is extracted as a feature.
The determination processing unit 230 compares the facial features extracted by the feature extraction processing unit 220 with the feature data stored in the feature data storage table 250 and determines whether or not they match.

  As a result of the determination by the determination processing unit 230, the display control processing unit 240 performs processing for hiding information displayed on the display screen 270 when the features do not match. If they match, no particular processing is performed. Here, non-display processing is performed by starting a screen saver.

  The feature data storage table 250 is a table for storing the features of a person's face registered as an operator in advance as feature data. Here, the ratio of at least one of the eyes, nose, mouth, and ears of the operator is stored as feature data.

The camera 260 performs a process of imaging at least the front of the display screen at a predetermined time interval. The time interval can be set arbitrarily by the user. For example, if the user wants to activate the screen saver immediately after leaving the seat, set the time to a short time (for example, about 0.5 to 2 seconds) and immediately If the screen saver need not be activated, the time is set to a long time (for example, about 3 to 5 seconds).
The display screen 270 performs processing for displaying display data.
In the above configuration, the camera 260 and the display screen 260 may be provided as separate devices and may be regarded as a display control system using a display control device.

(2. Operation)
FIG. 3 is a flowchart showing the processing operation of the display control apparatus according to the present embodiment. First, the camera 260 images the front of the display screen 270 (direction in which the operator operates) (step S301), and inputs the captured image (step S302). A face in the input image is recognized, and if there is a face in the image, it is determined whether the face is a predetermined size or larger (step S303). If there is no face larger than the predetermined size, the time data is cleared because the operator is not in front of the display screen 270 (step S309), and the screen saver is activated (step S310). By starting the screen saver, it is possible to hide the information displayed on the display screen 270 and protect confidential matters. If there is a face larger than a predetermined size, the facial features are extracted (step S304). It is determined whether or not the registered facial features match the extracted facial features (step S305). If they do not match, the time data is cleared because a person other than the operator is in front of the display screen 270. (Step S309), the screen saver is activated (Step S310). If they match, the operator is in front of the display screen 270.

When it is determined that the operator is in front of the display screen 270, time is measured (step S306), and it is determined whether a predetermined time has elapsed (step S307). The predetermined time here is an interval time for performing operator authentication, that is, an interval time for capturing an image by the camera 260, and can be set arbitrarily. If the predetermined time has not elapsed, the process returns to step S306 and the time is measured again. If the predetermined time has elapsed, the time data is cleared (step S308), the process returns to step S301, and the process of capturing an image with the camera is repeated.
Note that while the apparatus is activated in the above processing, imaging and authentication are always performed by the camera 260.

  As described above, in the display control apparatus according to the present embodiment, the operator is automatically authenticated, and in the case of a person who is not registered in advance, the display data is controlled to be hidden. In addition to this, information displayed on the screen is not seen, and confidential matters can be reliably protected. In addition, since the apparatus automatically performs authentication, the operator does not need to perform authentication processing and operations and can save labor.

  In order to hide the display data, in addition to starting the screen saver, the entire screen may be darkened so that the display cannot be seen, or a process of filling the entire screen may be performed.

(Second embodiment of the present invention)
(1. Configuration and function)
(1-1 Hardware configuration)
Since the hardware configuration of the display control apparatus according to this embodiment is the same as that of the first embodiment, description thereof is omitted.

(1-2 Module configuration and functions)
Since the module configuration of the display control apparatus according to this embodiment is the same as that of the first embodiment, description thereof is omitted. The face recognition processing unit 210, the feature extraction processing unit 220, the determination processing unit 230, and the display control processing unit 240 have an additional function in addition to the functions in the first embodiment. The additional functions are described below.

Similar to the first embodiment, the face recognition processing unit 210 recognizes a human face having an area of a predetermined value or more from an image captured by the camera 260 and extracts it as a face image. Recognition processing is also performed for other faces. That is, when a face other than the operator is captured in a predetermined size or more in the image captured when the operator is authenticated as a registered official person and the screen saver is not activated, the face is displayed. Perform recognition processing.
The feature extraction processing unit 220 performs processing for extracting features for faces other than the operator recognized by the face recognition processing unit 210.

  The determination processing unit 230 performs processing for determining whether or not the features of the faces other than the operator recognized by the face recognition processing unit 210 are matched with the feature data stored in the feature data storage table 250.

Even if the registered operator is in front of the display screen, the display control processing unit 240 displays if the facial features other than the operator do not match the feature data stored in the feature data storage table 250. Processing to hide the information displayed on the screen 270 is performed.
Since the functions of the feature data storage table 250, the camera 260, and the display screen 270 are the same as those in the first embodiment, description thereof is omitted.

(2. Operation)
FIG. 4 is a flowchart showing the processing operation of the display control apparatus according to the present embodiment. First, as in the first embodiment, the camera 260 images the front of the display screen 270 (the direction in which the operator operates) (step S301), and inputs the captured image (step S302). An arbitrary face in the input image is recognized, and if there is a face in the image, it is determined whether the face is a predetermined size or larger (step S303). If there is no face larger than the predetermined size, the time data is cleared because the operator is not in front of the display screen 270 (step S309), and the screen saver is activated (step S310). If there is one face larger than the predetermined size, the feature of one face is extracted (step S304). It is determined whether the registered facial feature matches the extracted facial feature (step S305). If they do not match, the time data is cleared because a person other than the operator is in front of the display screen 270. Then, the screen saver is activated (step S310). If they match, the operator is in front of the display screen 270.

  Next, it is determined whether or not there is another face larger than a predetermined size other than the one face (step S305a). Extract (step S305b). It is determined whether or not the registered facial features match the extracted other facial features (step S305c). If they do not match, time data is obtained because a person other than the operator is looking into the display screen 270. Clear (step S309) and activate the screen saver (step S310). If they match, it means that a person who is allowed to see the display screen 270 is in front of the display screen 270.

If the facial features registered in step S305c match the other facial features extracted, and if there are no other facial features of a predetermined size or larger in step S305a, the processing from step S306 is performed. Since the processing after step S306 is the same as that of the first embodiment, the description thereof is omitted.
Note that while the apparatus is activated in the above processing, imaging and authentication are always performed by the camera 260.

  As described above, in the display control apparatus according to the present embodiment, when the face recognition processing unit 210 recognizes faces of a plurality of persons having a predetermined area or more, one or more facial features are stored in the feature data storage table. Since the display of the display data displayed on the display screen is controlled to be non-displayed when there is a mismatch with the facial features stored in advance in 250, it is possible to prevent a person other than the registered person (operator) from looking into the display. The information displayed on the screen is not seen without being noticed, and the confidential matter can be reliably protected.

(Third embodiment of the present invention)
(1. Configuration and function)
(1-1 Hardware configuration)
Since the hardware configuration of the display control apparatus according to this embodiment is the same as that of the first and second embodiments, description thereof is omitted.

(1-2 Module configuration and functions)
Since the module configuration and function of the display control apparatus according to this embodiment are the same as those of the first embodiment, description thereof will be omitted.

(2. Operation)
FIG. 5 is a flowchart showing the processing operation of the display control apparatus according to the present embodiment. The difference from the first or second embodiment is that step S307a is added. Since the processing from step S301 to step S307 is the same as that of the second embodiment, description thereof is omitted. If the predetermined time has elapsed in step S307, it is determined whether the captured persons are the same person (step S307a). If it is determined that they are the same person, there is no need to perform face authentication again, so the process returns to step S305a to perform a peep determination process. If it is determined that they are not the same person, the time data is cleared and the process returns to step S301 to capture the person again. Here, the process for determining whether or not they are the same person will be described in detail.

(2-1 Judgment by error setting)
Hereinafter, a method for determining coincidence by setting an error will be described. Even for the same person, the facial features extracted by the feature extraction processing unit 220 do not always match the feature data registered in the feature data storage table 250 in advance. For example, if the angle or direction changes even a little, even the same person is processed as a different feature. Usually, the orientation and angle of the face are often different from those at the time of registration, and it is necessary to allow for some error in the determination process of whether or not they match. The accuracy of the judgment depends on how much error is expected. In the present embodiment, the error is set by the following method.

  FIG. 6 is a diagram illustrating a determination method by setting an error. First, as shown in FIG. 6A, at least one of eyes, nose, mouth, and ears in five patterns of a face facing front, an upward face, a downward face, a right face, and a left face in advance. Are registered in the feature data storage table 250 as feature data. Then, ratio data from front face ratio data to upward face ratio data, ratio data from front face ratio data to downward face ratio data, and downward face ratio data. The ratio data corresponding to the arrow bar portion in FIG. 6A, such as ratio data from right to right face ratio data, is derived by calculation as continuous feature data between registered feature data.

Next, ratio data (FIG. 6 (b) shaded portion) between the data corresponding to the bar portion of the arrow and the ratio data of the face facing the front is derived by calculation. When the determination processing unit 230 performs the determination processing, it is determined whether the face ratio data extracted by the feature extraction processing unit 220 is included in the shaded area in FIG. If it is included in the shaded area, it is determined that they match, and if it is not included in the shaded area, it is determined that they do not match.
Note that the front-facing face may or may not be registered. If not registered, the area corresponding to the shaded portion is calculated from the four ratio data of the top, bottom, left and right.

(2-2 Determination by continuity)
In the following, a method for determining coincidence based on continuity will be described. If the change of each feature data from authentication to authentication is less than a certain value, such as from the time when the authentication is first performed until the next authentication is performed, until the next authentication is performed, continuous Assume that they are the same person as data. However, when the area of the face is less than or equal to a certain area in the image or not within a certain region, it is determined that the operator has left the display screen.

  FIG. 7 is a diagram illustrating a determination method based on continuity. FIG. 7A shows a determination method when there are no faces larger than a certain area in the image. In FIG. 7A, a-1 is an image used in the first authentication. Here, since the ratio data in the image of a-1 is registered in the feature data storage table 250, the display data remains displayed. a-2 and a-3 are images used in the second and third authentications, respectively. Since the change in the faces of a-1, a-2, and a-3 is less than a certain value and the area of the face is more than a certain area, it is determined that the person is the same person as in the authentication of a-1, and is authenticated. The Therefore, the display data is still displayed here. a-4 is an image used in the fourth authentication. Although the change in the faces of a-3 and a-4 is less than a certain value, the face area is not greater than a certain area, so that the operator is judged to have left the display screen and authenticated. Therefore, here, the screen saver is activated and the display data is not displayed.

  FIG. 7B shows a determination method when the face disappears in a certain region. In FIG. 7A, b-1 is an image used in the first authentication. Here, since the ratio data in the image of b-1 is registered in the feature data storage table 250, the display data remains displayed. b-2 and b-3 are images used in the second and third authentications, respectively. Since the change in face of b-1, b-2, and b-3 is less than a certain value and there is a face in a certain area (shaded part), it is determined that the person is the same person as in the authentication of b-1. Authenticated. Therefore, the display data is still displayed here. b-4 is an image used in the fourth authentication. Although the change in the faces of b-3 and b-4 is less than a certain value, there is no face in a certain area (shaded part), so that the operator is judged to have left the display screen and authenticated. Therefore, here, the screen saver is activated and the display data is not displayed.

  As described above, in the display control apparatus according to the present embodiment, the feature data storage table 250 stores the facial feature data of the operator's upward, downward, rightward, and leftward directions, and determination processing is performed. The unit 230 sets the discrete feature data as continuous data, and performs a determination process based on whether the facial features extracted from the image captured by the imaging unit are included in the range of the continuous data. Authentication can be performed and display control can be appropriately performed even when facing in various directions such as up / down / left / right and diagonal directions other than the front. Further, when the camera 260 captures images at a predetermined time interval, the face image of the face of one person recognized by the face recognition processing unit 210 in the captured image is greater than or equal to a predetermined area and / or While it is determined that the one person is the same person within the predetermined area and the display control unit 240 controls the display screen, the same person can be determined accurately and the determination can be made. Therefore, it is possible to efficiently perform the processing by reducing the processing. Further, since the control for non-display is not performed while the same person is being imaged, there is an effect that the operator can easily use it.

(Other embodiments)
(1. Prevention of eye strain)
In the display control apparatus according to each of the embodiments described above, the screen saver is not activated while the operator registered in advance is looking at the display screen 270, and the screen saver is activated when the operator takes an eye off the display screen 270. It is the composition to do. That is, when the screen saver is not continuously activated, the operator continues to watch the display screen 270 continuously. Eye strain occurs when you continue to watch the display screen of a PC, etc., so if the screen saver does not start for a predetermined time continuously, the screen saver is forcibly activated to encourage rest and prevent eye strain To do.

  FIG. 8 is a flowchart showing the operation of the display control apparatus with an eye strain prevention function. Since the processing from step S301 to step S306 is the same as that of the second embodiment, a description thereof will be omitted. Note that the processing from step S301 to step S306 may be the same as in the first embodiment.

  When the time is measured in step S306, it is determined whether or not a first predetermined time has elapsed (step S307). The first predetermined time is an interval time for performing operator authentication, that is, an interval time for capturing an image by the camera 260, and can be arbitrarily set. If the first predetermined time has not elapsed, the process returns to step S306 and the time is measured again. If the first predetermined time has elapsed, the first time data is cleared (step S308), and it is determined whether the second predetermined time has elapsed (step S308a). The second predetermined time is an interval time for prompting rest to prevent eye strain when the screen saver is not continuously activated, and can be arbitrarily set. If the second predetermined time has not elapsed, the process returns to step S301, and the process of capturing an image with the camera is repeated. When the second predetermined time has elapsed, a time lapse message (for example, a message for prompting rest) is displayed (step S308b), and the first and second time data are cleared (step S309). Then, the screen saver is activated (step S310).

Note that while the apparatus is activated in the above processing, imaging and authentication are always performed by the camera 260.
As described above, in the display control apparatus according to the present embodiment, when the display control unit 240 does not perform the process of controlling the display data to be non-displayed for a predetermined time or more, that is, the operator continues to look at the display screen. In this case, the process of forcibly controlling the display data to be hidden is performed, so that it is possible to prevent eyestrain caused by continuously performing personal computer operations.

(2. Control of display screen according to line-of-sight direction)
In the present invention, it is determined whether or not the display screen is viewed from the characteristics and direction of the operator's face registered in advance, and it is further determined whether or not the display screen is viewed from the viewing direction. In other words, the screen saver is controlled to be activated when the face is facing the display screen but the line of sight is off the display screen.

  First, the face recognition processing unit 210 recognizes a face from an image captured by the camera 260. Next, the feature extraction processing unit 220 detects the line-of-sight direction from the recognized face image. Since various techniques are known for detecting the line-of-sight direction, a detailed description thereof is omitted here. The determination processing unit 230 determines whether the operator is viewing the display screen 270 from the recognized face position and line-of-sight direction. When it is determined that the display screen 270 is not viewed, the display control processing unit 240 activates the screen saver.

The relationship between the face position and the line-of-sight direction may be stored in advance in the feature data storage table 250.
As described above, in the display control device according to the present embodiment, the display screen is controlled according to the line-of-sight direction. For example, when the face is facing the display screen but the line of sight is off the display screen. Even in such a case, the display screen can be accurately controlled.

(3. Registration of feature data)
In the present invention, the feature of the operator's face is registered in advance in the feature data storage table 250 in order to authenticate the operator. In each of the embodiments described above, registration is performed for the front, upward, downward, leftward, and / or rightward faces, but only the front may be registered. That is, only the front is registered in advance, and images of various directions and expressions are acquired and registered while the same person is being imaged. Data to be registered increases with the usage time of the device, and the accuracy of authentication can be improved. In order to prevent the number of data from increasing too much, some data may be sampled and registered in the case of continuous data. For example, if 10 images are captured while facing right from the front, only 5 images are registered every 2 images, and the other 5 images are discarded.
As described above, in the display control apparatus according to the present embodiment, the data serving as the basis of authentication increases according to the usage time, and thus the authentication accuracy can be increased accordingly.

(4. Notification of peeping by sound)
In the second embodiment, the configuration is such that the peeping is prevented. However, when it is determined that the peeping is performed, the screen saver may not be activated immediately, but a sound may be output once. For example, if a peeping person is not registered in the feature data storage table 250 but has no problem even if he / she sees the display screen, he / she warns with a sound once. You can ignore it and continue working. If a person looks into the display screen with malicious intent, he / she can be prompted to leave the place by warning with a sound. The sound is output as a stage before the display control unit 240 controls the display screen 270.

  Although the present invention has been described with the above embodiments, the technical scope of the present invention is not limited to the scope described in the embodiments, and various modifications or improvements can be added to these embodiments. . And embodiment which added such a change or improvement is also contained in the technical scope of the present invention. This is apparent from the claims and the means for solving the problems.

The display control device according to each of the embodiments can be applied to any device that has a display screen. For example, it can be applied to personal computers, mobile phones, PDAs, bank ATMs, and the like.
In addition to facial features, appearance features such as employee uniforms and name tags may be used as feature data.

It is a hardware block diagram of the display control apparatus which concerns on 1st Embodiment. It is a module block diagram of the display control apparatus which concerns on 1st Embodiment. It is a flowchart which shows the processing operation of the display control apparatus which concerns on 1st Embodiment. It is a flowchart which shows the processing operation of the display control apparatus which concerns on 2nd Embodiment. It is a flowchart which shows the processing operation of the display control apparatus which concerns on 3rd Embodiment. It is a figure which shows the determination method by the setting of an error. It is a figure which shows the determination method by continuity. It is a flowchart which shows operation | movement of the display control apparatus with the eye strain prevention function.

Explanation of symbols

100 Display control device 101 CPU
102 RAM
103 ROM
104 Flash memory 105 HD
106 LAN card 107 Mouse 108 Keyboard 109 Video card 109a Display 110 Sound card 110a Speaker 111 Drive 210 Face recognition processing unit 220 Feature extraction processing unit 230 Judgment processing unit 240 Display control processing unit 250 Feature data storage table 260 Camera 270 Display device

Claims (7)

Feature storage means for storing the features of the operator's face as feature data;
Display means having a display screen for displaying display data;
Imaging means for imaging the front of the display screen at predetermined time intervals;
Face recognition means for recognizing a face of a person having a predetermined area or more from an image picked up by the image pickup means;
Feature extraction means for extracting features of the face from the face image recognized by the face recognition means;
A determination unit that compares the facial feature extracted by the feature extraction unit with the facial feature data of the operator stored in advance by the feature storage unit to determine whether or not they match;
A display control device comprising: display control means for controlling display data displayed on the display screen to be non-displayed when facial features do not match as a result of determination by the determination means. The display control device according to claim 1,
When the feature storage unit stores the facial features of a plurality of operators as feature data, and the face recognition unit recognizes the faces of a plurality of persons having a predetermined area or more, the feature extraction unit stores the plurality of persons. The facial features are extracted from each of the facial images, and the determination means extracts the facial features extracted by the feature extraction means and the plurality of features stored in advance by the feature storage means for each of the facial images of the plurality of persons. The feature data of the operator's face are compared to determine whether or not they match, and as a result of the determination by the determination unit, the feature of one or more of the plurality of persons does not match. A display control apparatus that controls display of display data displayed on the display screen to be non-displayed when the display screen is displayed. The display control apparatus according to claim 1 or 2,
In the image picked up by the image pickup means, the person is the same while the face image of the face of the person recognized by the face recognition means is larger than a predetermined area and / or within a predetermined area. A display control apparatus characterized in that it is determined that the user is a person and the display control means controls to maintain display of display data displayed on the display screen. The display control device according to any one of claims 1 to 3,
The feature storage means stores discrete feature data composed of the upward, downward, right, and left faces of the operator;
The determination unit uses the discrete feature data as continuous data, and performs determination processing based on whether or not a facial feature extracted from an image captured by the imaging unit is included in a range of the continuous data. A display control device. The display control device according to any one of claims 1 to 4,
The characteristic data is a ratio of at least one of the size of the eyes, nose, mouth, and ears;
The display control apparatus, wherein the determination unit performs a determination process based on the ratio. A feature storage procedure for storing the features of the operator's face as feature data;
A display procedure having a display screen for displaying display data;
An imaging procedure for imaging the front of the display screen at predetermined time intervals;
A face recognition procedure for recognizing a face of a person having a predetermined area or more from an image captured in the imaging procedure;
A feature extraction procedure for extracting features of the face from the face image of the face recognized in the face recognition procedure;
A determination procedure for comparing the facial feature extracted in the feature extraction procedure with the facial feature data of the operator stored in advance in the feature storage procedure to determine whether they match;
A display control method comprising: a display control procedure for controlling display data displayed on the display screen to be non-displayed when facial features do not match as a result of the determination in the determination procedure. On the computer,
A feature storage procedure for storing the features of the operator's face as feature data;
A display procedure having a display screen for displaying display data;
An imaging procedure for imaging the front of the display screen at predetermined time intervals;
A face recognition procedure for recognizing a face of a person having a predetermined area or more from an image captured in the imaging procedure;
A feature extraction procedure for extracting features of the face from the face image of the face recognized in the face recognition procedure;
A determination procedure for comparing the facial feature extracted in the feature extraction procedure with the facial feature data of the operator stored in advance in the feature storage procedure to determine whether they match;
A display control program for executing a display control procedure for controlling display data displayed on the display screen to be non-displayed when facial features do not match as a result of the determination in the determination procedure.

Images