JP2011198178A - Electronic device - Google Patents

Abstract

An electronic device for notifying a user of a result of appearance determination is provided.
An imaging unit that captures a person, a determination unit that determines the appearance of the person based on an image of the person captured by the imaging unit, and a notification that notifies a determination result based on the determination by the determination unit A part. The appearance of the person is determined by comparing the similarity between the ideal appearance image of the person photographed in advance by the photographing unit and the current image of the person photographed by the photographing unit with a threshold value.
[Selection] Figure 2

Description

  The present invention relates to an electronic device.

  2. Description of the Related Art Conventionally, a television receiver with a makeup function that enables a user to make up using a display screen of a television receiver is known (see, for example, Patent Document 1).

JP-A-11-112970

  However, even if the above-described television receiver can be used as a reference when the user performs makeup, the quality of the makeup performed by the user cannot be determined.

  The objective of this invention is providing the electronic device which notifies a user the determination result of appearance.

  An electronic apparatus according to the present invention includes a photographing unit that photographs a person, a determination unit that determines the appearance of the person based on an image of the person captured by the photographing unit, and a determination result based on the determination by the determination unit. And a notification unit for notifying.

  According to the electronic device of the present invention, it is possible to notify the user of the result of appearance determination.

It is a perspective view which shows the front surface of the digital photo frame which concerns on embodiment. 1 is a block diagram showing a system configuration of a digital photo frame according to an embodiment. FIG. It is a flowchart which shows the process of the digital photo frame which concerns on embodiment. It is a flowchart which shows the notification process in the digital photo frame which concerns on embodiment. It is a figure which shows the image displayed in the digital photo frame which concerns on embodiment.

  A digital photo frame (hereinafter referred to as DPF) according to an embodiment of the present invention will be described below with reference to the drawings. In general, there are DPFs that are installed on a desk or the like, and those that are installed on a wall. However, as an embodiment of the present invention, the DPF is installed on a desk or the like ( A description will be given using an example of an electronic photo frame.

  FIG. 1 is a perspective view showing an appearance of a DPF according to an embodiment of the present invention. The DPF 2 includes an apparatus main body 4 made of glass, plastic, or the like, and an LCD panel 6 serving as a display unit on which an image, a menu screen, etc. are electrically displayed on the front surface of the apparatus main body 4, for photographing a user An infrared detector 14 for detecting infrared rays output from the camera 10, a speaker 12 that outputs sound and the like, and a remote controller (not shown) for operating the DPF 2 is provided.

  Further, on the upper surface of the apparatus main body 4, a power switch 16 for switching on / off the power of the DPF 2, an operation key 18 used for setting functions of the DPF 2 and display settings of the LCD panel 6, and a shooting instruction for the camera 10. A shutter button 20 for performing the above is provided. Also, on one side of the apparatus body 4, a memory card slot 24 into which a memory card 22 storing data such as images and sounds is inserted, a USB port 26 to which a USB device is connected, and an Ethernet (registered trademark) standard. A network terminal 28 to which a network cable such as is connected is provided.

  FIG. 2 is a block diagram illustrating a system configuration of the DPF according to the embodiment. The above-described infrared detection unit 14, operation unit 19, memory card slot 24, USB port 26, and network terminal 28 are connected to the CPU 30 that comprehensively controls each unit of the DPF 2. Here, the operation unit 19 includes a power switch 16, an operation key 18, a shutter button 20, a menu button (not shown) for instructing display of a menu screen, and an OK button (instruction for setting an item selected on the menu screen). (Not shown).

  The CPU 30 also includes an internal memory 32 that stores data such as images and sounds, a display control unit 34 that performs display control of images and information displayed on the LCD panel 6, and sounds that are output from the speaker 12. A reproduction control unit 36 that performs reproduction control, an image change unit 38 that performs image processing such as color change on image data of an image captured by the camera 10, an A / D conversion (not shown), and a shooting signal output from the camera 10 An image memory 42 that temporarily stores image data generated by A / D conversion in the unit and a program memory 44 that stores a program for performing display setting, control, and the like of the LCD panel 6 are connected.

  Next, processing in the DPF according to the embodiment will be described with reference to the flowchart shown in FIG. First, when the power switch 16 is turned on and the menu button is pressed, the CPU 30 reads the menu screen image data stored in the program memory 44 and displays the menu screen image on the LCD panel 6. Next, when the operation key 18 is operated, a determination criterion acquisition mode for acquiring image data, which will be described later, is selected on the menu screen, and when the OK button is pressed, the CPU 30 stores the memory card. Image data serving as a determination criterion is read from 22 and stored in the internal memory 32 (step S1). Here, as the image data serving as a determination criterion, image data of a user's own image (hereinafter, referred to as an ideal appearance image) captured by the camera 10 with the appearance adjusted in advance is used. The ideal appearance refers to the appearance that the user wants to have when they go out, such as makeup, hairstyle, sledge of the eyelids, eyebrows, facial expressions, clothes, etc.

  Next, when the operation key 18 is operated on the menu screen and the camera 10 selects a shooting mode for shooting the user, and the OK button is pressed, the CPU 30 sets the DPF 2 to the shooting mode. Next, when the shutter button 20 is pressed in the state where the photographing mode is set, the user 10 is photographed by the camera 10 (step S2), and the current face of the photographed user is photographed. Image data of the image is stored in the image memory 42. Here, it is assumed that photographing of the user's current appearance is performed with the same composition as that of an ideal appearance image. For example, when the shooting mode is set, the CPU 30 reads out image data of an ideally dressed image from the internal memory 32 and displays the ideally dressed image on the left surface of the LCD panel 6 via the display control unit 34. At the same time, the CPU 30 starts shooting a moving image of the current state of the user by the camera 10 and displays a live view image of the shot subject on the right surface of the LCD panel 6 via the display control unit 34. The user adjusts the live view image displayed on the right side of the LCD panel 6 while confirming the ideal appearance image displayed on the left side of the LCD panel 6, and adjusts the size, orientation, The composition of the image, such as the position of the eyes and nose, is adjusted to the ideal appearance image, and the shutter button 20 is pressed to take a picture of the current figure.

  Next, the CPU 30 identifies a different portion (hereinafter, referred to as a different portion) between the user's current face image and an ideal appearance image (step S3). That is, first, the CPU 30 reads out the image data of the current face image of the user from the image memory 42, reads out the image data of the ideal face image from the internal memory 32, and reads out the current face image and the ideal appearance. And a color similarity (hereinafter referred to as similarity) at a predetermined spot on the face (for example, eyebrows, hair, cheeks, eyes, etc.) is measured. For example, it is performed by comparing pixels in a predetermined spot and detecting a color difference between the pixels. Note that the similarity is measured as 70% similarity in eyebrows, 10% similarity in hair, 50% similarity in cheeks, 40% similarity in eyes, and the like.

  Next, the CPU 30 compares the measured similarity with a predetermined threshold that is set in advance, and identifies a spot whose similarity is equal to or less than the predetermined threshold that is set as a different part. For example, in the case where 30% similarity is set as the threshold, the similarity in the eyebrows is 70%, the similarity in the hair is 10%, the similarity in the cheek is 50%, and the similarity in the eyes is 40% The CPU 30 identifies the hair part as a different part. Here, the user can arbitrarily set the similarity threshold.

  Next, the CPU 30 determines the appearance of the user based on the different parts (step S4). That is, it is determined that the appearance of the different parts is insufficient, and it is determined that the appearance is sufficient for other predetermined spots. After determining the appearance, the CPU 30 notifies the user of the determination result of the appearance (step S5).

  Next, with reference to the flowchart shown in FIG. 4, the notification process of the appearance determination result in the DPF 2 according to the embodiment will be described. Here, the determination result notification method is set in advance by the user. First, when the appearance determination is completed (step S4), the CPU 30 determines whether or not the image display mode for notifying the appearance determination result by image display is set (step S11). When the image display mode is not set (step S11: NO), the CPU 30 sets a sound mode for notifying the appearance determination result by sound and outputs a predetermined sound from the speaker 12 via the reproduction control unit 36. (Step S12). For example, sound data corresponding to the appearance determination result is stored in the internal memory 32 in advance, and when the sound mode is set, the CPU 30 reads out sound data corresponding to the appearance determination result from the internal memory 32, Audio based on the data is output from the speaker 12. Specifically, if it is determined in step S4 that the appearance of hair is insufficient and the appearance of eyebrows, cheeks, and eyes is sufficient, the CPU 30 “prepares the hairstyle”. Is read from the internal memory 32, and a sound based on the sound data is output from the speaker 12.

  On the other hand, when the image display mode is set (step S11: YES), the CPU 30 notifies the appearance determination result by changing the color of a different portion in the current face image of the user. It is determined whether or not the color change mode is set (step S13). When the color change mode is set (step S13: YES), the CPU 30 performs correction for changing the color of a different portion with respect to the image data of the current face image of the user in the image changing unit 38. Then, an image based on the corrected image data is displayed on the LCD panel 6 together with an ideal appearance image (step S14). For example, if the appearance of hair is insufficient and the appearance of eyebrows, cheeks, and eyes is sufficient, as shown in FIG. 5, the color of the hair portion in the image of the user's current face is changed. The changed image (shown on the right) is displayed next to the ideal appearance image (shown on the left). If there are a plurality of parts that differ in appearance, the colors of all the different parts are changed and displayed on the LCD panel 6.

  When the color change mode is not set (step S13: NO), the CPU 30 determines whether or not the reverse display mode for notifying the appearance determination result by displaying different portions in reverse is set. Is performed (step S15). When the reverse display mode is set (step S15: YES), the CPU 30 performs a correction to reversely display a different portion of the image data of the current face image of the user in the image changing unit 38. Then, an image based on the corrected image data is displayed on the LCD panel 6 together with an ideal appearance image (step S16). For example, if it is determined that the appearance of the hair is insufficient and the appearance of the eyebrows, cheeks, and eyes is sufficient, an image with the hair highlighted in the image of the user's current face is ideal. Display next to the dressed-up image.

  When the reverse display mode is not set (step S15: NO), the CPU 30 determines whether or not the flashing mode for notifying the appearance determination result is set by flashing different portions. (Step S17). When the blinking mode is set (step S17: YES), the CPU 30 sets the image changing unit 38 to blink the portion that is different from the image data of the current face image of the user, An image based on the image data is displayed on the LCD panel 6 together with an image of an ideal appearance (step S18). For example, if it is determined that the appearance of the hair is insufficient and the appearance of the eyebrows, cheeks, and eyes is sufficient, an image of blinking hair in the current face image of the user is ideal. Display next to the dressed-up image.

  When the blinking mode is not set (step S17: NO), the CPU 30 sets a zoom mode for notifying the appearance determination result by enlarging and displaying a different part, and the user is changed in the image changing unit 38. The image data of the current face image is corrected so as to be enlarged and displayed on a different part, and an image based on the corrected image data is displayed on the LCD panel 6 together with an ideal appearance image (step S19). For example, if it is determined that the appearance of the hair is insufficient and the appearance of the eyebrows, cheeks, and eyes is sufficient, an image that enlarges the hair in the user's current facial image is ideal. It is displayed next to the appearance image.

  According to the DPF 2 according to this embodiment, the user's current face image photographed by the camera 10 is compared with an ideal appearance image photographed in advance, and different portions of the image are represented by the user. By notifying the user, it is possible to notify the user of the appearance determination result. Further, by correcting different parts and displaying them on the LCD panel 6, it is possible to visually notify the judgment result of appearance. In addition, the user can receive notification of the determination result by a method suitable for himself / herself by setting a notification method of the determination result of appearance. In addition to visual notification, the appearance determination result can be notified by outputting sound from the speaker 12 under the control of the reproduction control unit 36 based on an instruction from the CPU 30.

  Further, in the above-described embodiment, the case where the user prepares the hairstyle is described as the appearance determination, but the appearance determination may be performed in other cases. For example, the user's current smile image may be compared with an ideal smile image, and the difference in the current smile image may be identified to determine the appearance. Thereby, it is possible to practice smiling using the DPF 2.

  In the above-described embodiment, the user's face is photographed by the camera 10 and the appearance of the face is determined. However, the user's whole body is photographed and the appearance of the whole body is determined. It may be. For example, a drive unit that changes the orientation of the camera 10 is provided, and the CPU 30 controls the drive unit to move the camera 10 up and down to sequentially photograph the user's face, chest, belly, waist, legs, and feet. A synthesized image of the whole body of the user may be generated by synthesizing the image data of the obtained images. In this case, the CPU 30 compares the current whole body composite image of the user with the ideal whole body image of the user photographed in advance, and specifies a different part in the current whole body image, thereby identifying the whole body. You may also check the appearance of As a result, it is possible to make a rough appearance determination for the whole body, such as checking whether the user has forgotten to wear a tie. Note that image data may be combined by any method. Further, by preparing a plurality of DPFs 2 and photographing the user with each camera 10 in a state where the DPFs 2 are arranged on the front, back, left, and right of the user, it is possible to determine the appearance of the user on a plurality of surfaces. Good.

  In the above-described embodiment, appearance determination is performed using a flat image, but appearance determination may be performed using a stereoscopic image. For example, when the user himself changes the body direction little by little, the camera 10 shoots a face in the order of front, right side, back, left side, and combines the image data of the captured images. You may make it produce | generate the image data of a stereo image. In this case, it is also possible to determine the appearance based on the stereoscopic image by generating image data of the stereoscopic image for each of the current and ideal appearance faces. Alternatively, stereoscopic image data may be generated for the user's whole body, and the appearance of the whole body may be determined using the stereoscopic image. In addition, every time a picture is taken by the camera 10, a message such as “Please change the direction of your body” may be displayed on the LCD panel 6.

  In the above-described embodiment, the similarity threshold may be changed according to the number of different parts. For example, when 30% similarity is set as a threshold value and there are less than three different parts, the threshold value is changed to 40% and the different parts are specified again. If there are 5 or more locations, the threshold value may be changed to 20% similarity to specify different portions again. As a result, a different number of different parts are displayed on the LCD panel 6, and it is possible to make it easy to understand spots that need to be dressed. The threshold may be set by the user sequentially by operating the operation key 18 or the like.

  Further, in the above-described embodiment, the image displayed on the LCD panel 6 may be displayed by being reversed left and right. As a result, the horizontally reversed image that appears on the mirror surface can be displayed on the LCD panel 6. Note that the user may be able to set whether or not to display the image with the image reversed horizontally.

  In the above-described embodiment, the case where image data of one ideal appearance image is stored in advance is described. However, image data of a plurality of ideal appearance images is stored in advance. May be. In this case, in the determination criterion acquisition mode, the CPU 30 reads thumbnail image data added to and stored in the image data of a plurality of ideal appearance images, displays a thumbnail image list on the LCD panel 6, and displays thumbnail images. You may make it use the image selected by the user from the list | wrist for determination of appearance. Thereby, one DPF 2 can be used by a plurality of people.

  In the above-described embodiment, correction or the like for directly changing the color is performed on the image of the user's current face and displayed on the LCD panel 6, but the image and color of the user's current face are displayed. You may display separately the image which performed correction | amendment etc. which change. For example, an image of an ideal appearance is displayed on the left side of the LCD panel 6, an image of the user's current face is displayed on the upper half of the right side of the LCD panel 6, and an image subjected to correction etc. for changing the color is displayed on the lower half. It may be displayed. Here, the display form on the right side of the LCD panel 6 may be selected by operating the operation key 18 or the like.

  In the above-described embodiment, in the zoom mode, a frame line may be displayed on the image of the current face of the user so that it can be seen which part has been enlarged. For example, an image of an ideal appearance is displayed on the left surface of the LCD panel 6, an image in which the eye portion is enlarged is displayed on the upper half of the right surface of the LCD panel 6, and an image of the current face of the user is displayed on the lower half. A square frame line may be displayed around the eye portion in the current face image. The enlargement size may be arbitrarily set by the user.

  In the above-described embodiment, the LCD panel 6 may have a touch panel function. For example, the touch sensor is arranged on the LCD panel 6, and the changed color or the like can be erased by touching a different part in the image data of the current face image of the user displayed on the LCD panel 6. You may be able to do it. As a result, for spots that do not need to be dressed, the LCD panel 6 can be touched to erase the changed color, leaving only spots that need to be dressed. Further, the touched portion may be enlarged and displayed. For example, when a familiar whole body image is displayed on the LCD panel 6, an image obtained by enlarging the face part by touching the face part is displayed on the LCD panel 6, and further, the eye part is touched by touching the eye part. An image obtained by enlarging the part may be displayed on the LCD panel 6. Thereby, it is possible to know the detailed contents of the different portions.

  In the above-described embodiment, the user may be able to select a range in which color change or the like is performed. For example, when it is determined that the appearance of all of the eyebrows, hair, cheeks, and eyes is insufficient, it is displayed on the LCD panel 6 when the user moves the cursor by operating the operation keys 18 or the like. When a hair portion is selected as a range from the current face image, correction may be performed to change the color of the hair portion.

  In the above-described embodiment, the similarity may be displayed on the LCD panel 6. For example, the similarity may be displayed on the LCD panel 6 such as “brow: 70%, hair: 10%, cheek: 50%, eyes: 40%”. Thereby, the user can grasp | ascertain the current state of appearance as a numerical value.

  Further, in the above-described embodiment, the image data of the image captured by the camera 10 is used for the appearance determination. However, the image data of the image captured by another camera may be used. For example, after the user's image is taken with another camera and the image data of the taken image is stored in the memory card 22, the memory card 22 is removed from the memory card slot of the other camera, and the memory card slot 24 of the DPF 2 is loaded. You may make it wear. Thereby, image data of an image photographed by another camera can be used as image data serving as a determination criterion. Further, image data may be acquired from another camera by performing communication between the other camera and the DPF 2 via the USB cable by the USB port 26. Further, wireless USB communication may be used, and image data may be acquired from another camera using communication means other than USB communication.

  In the above-described embodiment, the DPF 2 is operated by operating the menu button, the operation key 18 or the like. However, the operation may be performed by an operation remote controller. Thereby, the user can operate easily from a distant place.

  In the above-described embodiment, the DPF 2 has been described as a single device. However, a device including a control unit that performs notification processing of the appearance determination result, and a display medium for displaying the notification result and the above-described image The apparatus including the above may be a separate body. In addition, the notification process of the above-mentioned appearance determination result may be executed in cooperation by control units of a plurality of devices.

  Note that the program for executing the notification process of the appearance determination result in the above-described embodiment may be stored in the program memory 44 or may be stored in another recording medium.

  Moreover, you may make it implement | achieve a part of DPF2 which is the above-mentioned embodiment, for example, the function of CPU30 with a computer. In this case, an image processing program for realizing the control function in the notification process of the appearance determination result is recorded on a computer-readable recording medium, and the image processing program recorded on the recording medium is read by the computer system. , May be realized by executing. Here, the “computer system” includes an OS (Operating System) and hardware of peripheral devices. The “computer-readable recording medium” refers to a portable recording medium such as a flexible disk, a magneto-optical disk, an optical disk, and a memory card, and a storage device such as a hard disk built in the computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case may be included and a program that holds a program for a certain period of time may be included. Further, the above program may be for realizing a part of the functions described above, or may be realized by a combination with the program already recorded in the computer system. .

  2 ... DPF, 4 ... device main body, 6 ... LCD panel, 10 ... camera, 12 ... speaker, 14 ... infrared detector, 16 ... power switch, 18 ... operation keys, 20 ... shutter button, 24 ... memory card slot, 26 ... USB port, 28 ... Network terminal.

Claims (9)

A shooting section for shooting people,
A determination unit that determines the appearance of the person based on the image of the person photographed by the photographing unit;
An electronic device comprising: a notification unit that notifies a determination result based on determination by the determination unit. The determination unit includes a comparison unit that compares the image of the person photographed by the photographing unit with the image of the person photographed in advance.
The determination unit determines the appearance by specifying a different portion between the image of the person photographed by the photographing unit and the image of the person photographed in advance based on the comparison by the comparison unit. The electronic device according to claim 1. A display unit for displaying an image of the person photographed by the photographing unit;
The electronic device according to claim 1, wherein the notification unit displays the determination result on the display unit.   The said notification part identifies and displays the part which is different between the said person's image image | photographed with the said imaging | photography part currently displayed on the said display part, and the said person image | photographed previously. Item 4. The electronic device according to Item 3.   The notifying unit changes a color of a different portion between the image of the person photographed by the photographing unit displayed on the display unit and the image of the person photographed in advance. Performing at least one of highlighting a part, blinking the different part, enlarging and displaying the different part, and quantifying and displaying the degree of difference. The electronic device according to claim 4.   The electronic device according to claim 1, wherein the notification unit includes a voice output unit that notifies the determination result by voice.   The electronic apparatus according to claim 2, further comprising a determination criterion changing unit that changes a determination criterion used when the different portion is specified by the determination unit.   The change of the determination criterion by the determination criterion changing unit is performed according to a degree of difference between the image of the person photographed by the photographing unit and the image of the person photographed in advance. 7. The electronic device according to 7. A drive unit for changing a shooting direction by the shooting unit;
9. The image synthesizing unit according to claim 1, further comprising: an image synthesizing unit that synthesizes a plurality of images photographed by changing a photographing direction by the driving unit and generates a synthesized image to be determined by the determining unit. An electronic device according to any one of the above.

Images