JP2012078469A - Image display device and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to put on makeup while referring to an image without eye movement.SOLUTION: A state (a) where a foundation virtual makeup image FM and a state (b) where a face F is reflected on a half mirror 31 for a second prescribed time are alternately repeated. In this case, a liquid crystal display panel 32 for displaying the foundation virtual makeup image FM and the half mirror 31 reflecting the face F are laminated within the same display part 3. Consequently, the user does not move his or her eyes when viewing the foundation virtual makeup image FM and viewing the reflected face F, so that the user can put on makeup with a foundation while referring the image without eye movement.

Description

  The present invention relates to an image display device and an image display method used for makeup.

  Conventionally, an apparatus described in Patent Document 1 has been proposed as an apparatus used for makeup. This apparatus is composed of a first member and a second member connected via a hinge. A camera and a monitor are disposed on the first member, and a mirror is disposed on the second member. Then, the face before the makeup of the user is photographed by the camera, the photographed face image is subjected to a makeup simulation process, and a virtual face image with makeup is generated and displayed on the monitor. Therefore, the user can make up while referring to the virtual makeup image displayed on the monitor of the first member and looking at his / her own face reflected in the mirror of the second member.

JP 2009-39523 A

  However, when makeup is performed using the conventional technique, as described above, the user compares the virtual makeup image on the monitor of the first member with his / her own face reflected in the mirror of the second member. I will do make-up. Therefore, it is necessary to move the line of sight between the monitor and the mirror during makeup. In addition, since makeup is composed of a plurality of stages such as foundation, eye shadow, and teak, the line of sight movement is forced many times before the makeup is completed.

  For this reason, it takes time to complete the makeup, or the work ends with the makeup remaining incomplete due to the complicated movement of the line of sight. Dissatisfaction such as not being able to occur.

  SUMMARY An advantage of some aspects of the invention is that it provides an image display apparatus and an image display method capable of performing makeup while referring to an image without accompanying eye movement.

  In order to solve the above-described problem, in the image display device according to the first aspect of the present invention, a display panel that displays an image on a screen, a storage circuit that stores a makeup image on which makeup has been performed, and A display mode in which a makeup image stored in a storage circuit is displayed on the screen of the display panel; and the screen of the display panel is brought into a mirror state without displaying the makeup image on the screen of the display panel. And a display control circuit for switching between the mirror surface modes.

  In the image display device according to the second aspect of the present invention, the makeup image is an image obtained by performing an image makeup process on a user's face image.

  In the image display device according to the third aspect of the present invention, the makeup image is an image obtained by performing an image makeup process on a face image other than the user.

  In the image display device according to the fourth aspect of the present invention, the storage circuit stores a plurality of types of the makeup images applied for each type according to the stage and part of the makeup. The display control circuit displays a plurality of types of makeup images stored in the storage circuit in the display mode.

  In the image display device according to the fifth aspect of the present invention, the time interval between the display mode switched by the display control circuit and the specular mode is different.

  In the image display device according to the sixth aspect of the invention, the time in the specular mode is longer than the time in the display mode.

  In the image display method according to the seventh aspect of the present invention, a display step of displaying the makeup image stored in the storage circuit on the screen of the display panel, and at least one of before and after the display step A mirror surface step for bringing the screen of the display panel into a mirror state without displaying the makeup image.

  According to the present invention, makeup can be performed while referring to an image without moving the line of sight. For this reason, the makeup can be completed in a short time without requiring time to complete the makeup. Further, it is possible to prevent the work from being completed due to the complexity of the line-of-sight movement and to complete the work, and to obtain a makeup result that satisfies the user.

It is a figure which shows the external appearance of the digital photo frame which concerns on embodiment of this invention. It is a vertical sectional view showing a sectional structure of a display unit. It is a block diagram which shows the circuit structure of a digital photo frame. It is a block diagram which shows the circuit structure of an imaging part. It is a flowchart which shows the process sequence of the virtual makeup image creation mode in 1st Embodiment. It is a figure which shows the example of a screen in the state as which the live view image was displayed. It is a figure which shows the example of a screen at the time of foundation makeup zone writing. It is a figure which shows the example of a screen at the time of cheek make zone write-in writing. It is a figure which shows the example of a screen at the time of eye makeup make zone writing. It is a figure which shows a completion makeup virtual image. It is a flowchart which shows the process sequence of a make mode process. It is a display transition diagram at the time of foundation makeup. It is a display transition diagram at the time of cheek makeup. It is a display transition diagram at the time of eye shadow makeup. It is a flowchart which shows an interrupt routine. It is a display transition diagram at the time of interrupt. It is a flowchart which shows the process sequence of the virtual makeup image creation mode in 2nd Embodiment. It is a display transition diagram at the time of the virtual makeup image creation mode in the same embodiment. It is a flowchart which shows the process sequence of the virtual makeup image creation mode in 3rd Embodiment. It is a display transition diagram at the time of the virtual makeup image creation mode in the same embodiment.

Hereinafter, embodiments of the present invention will be described.
(First embodiment)
FIG. 1 is an external view showing a digital photo frame (hereinafter referred to as a DPF) 1 as an image display apparatus common to the embodiments of the present invention.

  In front of the DPF 1, a display unit 3 configured by a liquid crystal display panel or the like held by the main body 2 is provided. A transparent touch panel 5 is integrally formed on the display unit 3 so that a touch on an image displayed on the display unit 3 can be detected. An imaging unit 4 is provided at the front upper center of the main body 2, and a memory card slot 6 is provided on the lower surface. Further, a GPS antenna 7 is provided on the side of the main body, and a human sensor 8 is provided on the right side of the front surface.

  FIG. 2 is a diagram showing a cross-sectional structure of the display unit 3. In the display unit 3, the touch panel 5 is disposed on the outermost side, and a half mirror 31, a liquid crystal display panel 32, and a backlight 33 are sequentially disposed from the outer side to the inner side. Therefore, in the state of the display mode in which the backlight 33 is turned on, light from the backlight 33 is transmitted to the outside through the liquid crystal display panel 32, the half mirror 31, and the touch panel 5 as indicated by an arrow A, The image displayed on the liquid crystal display panel 32 can be visually recognized.

  However, in the mirror mode state in which the backlight 33 is turned off, as shown by the arrow B, after the light from the outside passes through the touch panel 5, it is reflected by the half mirror 31 and again passes through the touch panel 5 and diffuses outside. To do. Therefore, in the state of the mirror surface mode in which the backlight 33 is turned off, the half mirror 31 functions as a mirror surface and can capture the user's face and the like.

  FIG. 3 is a block diagram showing an electrical configuration of the DPF 1. The DPF 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12 connected to the CPU 11, a RAM (Random Access memory) 13, and an internal memory 14. The ROM 12 has a flowchart described later in the CPU 11. A program for performing operations and the like is stored. This program includes a face recognition program for recognizing a face image that is an image of a face portion in an image captured by the image capturing unit 4, and a virtual makeup that has been subjected to image processing on the recognized face image and applied with makeup. A makeup simulation program for generating up-images is included.

  In addition, as a face recognition program and a makeup simulation program, a well-known program can be used suitably, for example, you may make it use the program currently disclosed by the said patent document 1. FIG.

  The RAM 13 is a working memory in which the CPU 11 temporarily stores various data as necessary. The internal memory 14 is a large-capacity nonvolatile memory such as a hard disk or a flash memory, and can store a large number of images.

  The display control unit 16 causes the display unit 3 to display images and various menus by driving the liquid crystal display panel 32 based on display image data supplied from the CPU 11. The key input control unit 17 inputs an operation signal for the touch panel 5 based on the control of the CPU 11.

  The memory card interface 18 is an input / output interface that controls data input / output between the CPU 11 and various memory cards 60 that are detachably mounted in the memory card slot 6.

  The GPS control unit 20 acquires position information based on information received by the GPS antenna 7. Thereby, the present position of DPF1 can be known. The human sensor 8 is connected to the CPU 11 and detects whether a person is nearby. Therefore, when a person is not in the vicinity for a predetermined time or longer, the power is automatically turned off to save power (auto power off).

  The communication control unit 90 performs communication control including mail transmission / reception via the telephone line 91 or the wireless LAN 92. The address book 93 stores addresses used for mail transmission / reception, and is actually provided in the internal memory 14.

  The backup server 40 is connected via a network and backs up data recorded in the internal memory 14 automatically or by a manual instruction. The distribution content server 50 can distribute data to the DPF 1 via the network. The personal computer 70 can be connected to the DPF 1 via the communication control unit 90 via the wireless LAN 92 or the like, and can perform complicated settings that cannot be set by the DPF 1.

  The power control unit 80 takes in AC power through the power plug 81, converts it into direct current, and supplies power to each unit. The auto power-off control described above is also performed.

  FIG. 4 is a block diagram showing details of the imaging unit 4. The imaging unit 4 has the same function as a general digital camera such as AE (Auto Exposure), AWB (Auto White Balance), and AF (Auto Focus). That is, the lens block 41 includes an optical system such as a zoom lens 411 and a focus lens (not shown), and a drive mechanism for driving the optical system. The zoom lens 411 is driven in the optical axis direction by a zoom motor 42 provided in the drive mechanism.

  The entire imaging unit 4 is controlled by the CPU 11, and a motor driver 44 is connected to the CPU 11 via a timing generator (TG) 43. The motor driver 44 drives the zoom motor 42 based on a timing signal generated by the timing generator 43 in accordance with a command from the CPU 11 according to a user operation or a single command from the CPU 11. As a result, the zoom lens 411 is driven to change its lens position.

  At this time, the CPU 11 stores and manages instructions generated by itself. Therefore, the CPU 11 can acquire the lens position of the zoom lens 411 that changes according to the timing signal generated by the timing generator 43 by storing and managing the command generated by itself. Although not shown in the drawings, actually, a focus motor and a motor driver for driving the focus lens, a mechanical shutter, a mechanical aperture, and a drive mechanism having a motor for driving them are provided.

  In addition, the imaging unit 4 includes a charge coupled device (CCD) 45 as an imaging element. The CCD 45 is disposed on the optical axis of the lens block 41. The subject is imaged on the light receiving surface of the CCD 45 by the lens block 41. The vertical and horizontal drivers 46 drive the CCD 45 based on the timing signal generated by the timing generator 43 in accordance with instructions from the CPU 11. The CCD 45 is driven by a vertical and horizontal driver 46 and outputs an analog imaging signal corresponding to the optical image of the subject to the unit circuit 47. The unit circuit 47 is a CDS (Correllated Double Sampling) circuit that removes noise included in the output signal of the CCD 45 by correlated double sampling, and an A / D (Analog / Digital) that converts the image signal from which noise has been removed to a digital signal. ) It is composed of a converter and the like, and outputs a digital signal to a DSP (Digital Signal Processor) 48.

  The DSP 48 performs image processing such as pedestal clamp and auto white balance on the digital signal output from the unit circuit 47 to generate image data including a luminance (Y) signal and a color difference (UV) signal. The image data converted by the DSP 48 is sequentially stored in the RAM 13, and in the REC (Record) live view mode, it is converted into a video signal every time one frame of data (image data) is accumulated, and the liquid crystal display It is sent to the panel 32 and displayed on the screen as a live view image.

  When shooting a still image, the CPU 11 instructs the CCD 45, the vertical and horizontal drivers 46, the unit circuit 47, and the DSP 48 to switch from the live view image shooting mode to the still image shooting mode. The image data obtained by the shooting process in the image shooting mode and temporarily stored in the RAM 13 is compressed by the CPU 11 and finally recorded in the internal memory 14 or the like as a still image file of a predetermined format.

  In the movie recording mode, a plurality of image data sequentially stored in the RAM 13 are sequentially compressed by the CPU 11 and recorded as a moving image file in the internal memory 14 or the like. The still image file and the moving image file recorded in the internal memory 14 or the like are read out to the CPU 11 in accordance with the user's selection operation in the PLAY mode, expanded, developed as image data in the RAM 13, and then based on the image data. An image is displayed on the liquid crystal display panel 32.

  Of course, when a live view image, a reproduced image, or the like is displayed on the liquid crystal display panel 32, the backlight 33 is on and lit.

  Next, the operation of the first embodiment according to the above configuration will be described. In the state where the virtual makeup image creation mode is set, the CPU 11 executes processing as shown in the flowchart of FIG. 5 according to the program stored in the ROM 12. In other words, the live view image is displayed by transferring the image captured by the imaging unit 4 to the liquid crystal display panel 32 (step S101). Therefore, when the user is seated with the face facing the DPF 1, the user's face F is displayed on the liquid crystal display panel 32 of the display unit 3 as shown in FIG. 6.

  At this time, as shown in FIG. 6, the CPU 11 displays a shutter button 301 on a part of the liquid crystal display panel 32, and determines whether or not the displayed shutter button 301 is touched (step S102). If the shutter button 301 is touched, a shooting process is executed, and an image captured by the imaging unit 4 is stored in the RAM 13 (step S103).

In this embodiment, the photographing process is executed in response to the touch on the shutter button 301. However, the face is recognized by the face recognition program, and the position corresponding to the position of the zoom lens 411 in the live view image is determined. Automatic shooting may be performed on the condition that a face having a predetermined size exists.
Further, regarding the size of the face to be photographed, for example, the liquid crystal display panel 31 “zoom button” may be displayed, and the zoom lens 411 may be driven by the zoom motor 42 in response to a touch on the “zoom button”. In this way, a face image having a size desired by the user can be taken.

  Subsequently, the photographed face image is reproduced and displayed on the liquid crystal display panel 32 (step S104). Therefore, the face image FP of the user is reproduced and displayed by the processing in step S104 as shown in FIG. Next, the makeup zone writing instruction display of the foundation is executed (step S105). As a result of the processing in step S105, as shown in FIG. 7, for example, the character string “foundation color sample” and the sample colors “BE (abbreviation of beige) 1” “BE2” “OC (abbreviation of ocher) 1” “ OC2 "is displayed on the liquid crystal display panel 32.

  The user who visually recognizes this touches any sample color with a finger or a pen, and then touches or moves a finger or the like in the face image FP displayed on the face image FP. . Then, the touched position and area are detected from the touch panel 5, and the CPU 11 performs a makeup process on the face image according to the position and area detected by the touch panel 5 (step S106).

  The makeup process is a process of coloring and displaying the touched position and region with a foundation color that is a sample color selected by touch, for example. Therefore, if the user touches the nose of the face image FP and the lower part of both eyes, as shown in FIG. 7, the makeup zone MZ (foundation of the foundation) having a predetermined foundation color is formed on the nose of the face image FP and the lower part of both eyes. In this case, the entire face) is added.

  At this time, the CPU 11 displays a completion button 303 on a part of the liquid crystal display panel 32, and determines whether or not the writing of the foundation by the user is completed depending on whether or not the completion button 303 is touched (step). S107). If the completion button 303 is touched by the user and the writing of the foundation is completed, the image displayed on the liquid crystal display panel 32 at this time is stored in the RAM 13 as a foundation virtual makeup image (step S108). Therefore, if the user touches the completion button 303 in the display state of FIG. 6C, an image in which a makeup zone MZ having a predetermined foundation color is added to the nose of the face image FP and the lower part of both eyes is a virtual foundation. The makeup image FM is stored in the RAM 13.

  Subsequently, a cheek makeup zone writing instruction display is executed (step S109). As a result of the processing in step S109, as shown in FIG. 8, for example, a character string “teak color sample” and sample colors “PK (abbreviation of pink) 1” “PK2” “OR (abbreviation of orange) 1 “OR2”, “RD (abbreviation of red) 1”, and “RD2” are displayed on the liquid crystal display panel 32.

  The user who has visually recognized this touches a site to be cheeked in the displayed face image FP with a finger or a pen, or moves the finger or the like in the touched state. Then, the touched position and area are detected from the touch panel 5, and the CPU 11 performs a makeup process on the face image according to the position and area detected by the touch panel 5 (step S110).

  The makeup process is a process of coloring and displaying the touched position and region with a cheek color that is a sample color selected by touch, for example. Therefore, if the user touches both cheeks of the face image FP, as shown in FIG. 8, a makeup zone MZ having a predetermined cheek color is added to both cheeks of the face image FP. At this time, the CPU 11 displays a completion button 303 on a part of the liquid crystal display panel 32, and determines whether the writing of the cheek is completed by the user based on whether the completion button 303 is touched (step). S111). If the user touches the completion button 303 and the writing of the cheek is completed, the image displayed on the liquid crystal display panel 32 at this time is stored in the RAM 13 as the cheek virtual makeup image CM (step S112).

  Subsequently, eye shadow make zone writing instruction display is executed (step S113). Through the processing in step S113, as shown in FIG. 9, for example, a character string “eye shadow color sample” and sample colors “GR (green) 1” “GR2” “BL (blue)) “1”, “BL2”, “PU (abbreviation of purple) 1”, “PU2” are displayed on the liquid crystal display panel 32.

  The user who visually recognizes this touches the site to which the eye shadow is to be applied in the displayed face image FP with the finger or the pen, or moves the finger or the like in the touched state. Then, the touched position and area are detected from the touch panel 5, and the CPU 11 performs a makeup process on the face image according to the position and area detected by the touch panel 5 (step S114).

  This makeup process is a process of coloring and displaying the touched position and region with, for example, an eye shadow color that is a sample color selected by touch. Therefore, if the user touches the eyelid, a makeup zone composed of a predetermined eye shadow color is added to the eyelid. At this time, the CPU 11 displays a completion button 303 on a part of the liquid crystal display panel 32, and determines whether or not the writing of the eye shadow by the user is completed depending on whether or not the completion button 303 is touched ( Step S115). If the user touches the completion button 303 and the writing of the cheek is completed, the image displayed on the liquid crystal display panel 32 at this time is stored in the RAM 13 as the eye shadow virtual makeup image IM (step S116). .

  Further, the image subjected to the above eye shadow virtual makeup is stored in the RAM 13 as a completed makeup virtual image (step S117). Accordingly, the completed makeup virtual image PM shown in FIG. 10 is stored in the RAM 13 by the processing in step S117.

Therefore, when the virtual makeup image creation mode described above is completed, at least the following images (1) to (4) are stored in the RAM 13.
(1) Foundation virtual makeup image (2) Teak virtual makeup image (3) Eye shadow virtual makeup image (4) Completed makeup virtual image (= eye shadow virtual makeup image)

  When the virtual makeup image creation mode described above ends, the CPU 11 executes the make mode process according to the flowchart shown in FIG. That is, the backlight 33 is turned on (step S201), and the foundation virtual makeup image and an arrow indicating the direction in which the foundation should be applied are displayed on the liquid crystal display panel 32 (step S202). As described above with reference to FIG. 2, when the backlight 33 is turned on, light from the backlight 33 passes through the liquid crystal display panel 32, the half mirror 31, and the touch panel 5 and is emitted to the outside as indicated by an arrow A. Then, the image displayed on the liquid crystal display panel 32 can be visually recognized.

  Accordingly, as shown in FIG. 12A, the user can visually recognize the foundation virtual makeup image FM displayed on the liquid crystal display panel 32 from the outside of the display unit 3. In addition, a makeup zone MZ is added to the foundation virtual makeup image FM, and an arrow C indicating the direction in which foundation should be applied to the recognized face image is displayed according to a program stored in the ROM 12 in advance. The Therefore, the user refers to this and starts makeup by the foundation on his / her face.

At this time, the liquid crystal display panel 31 has 1.. Apply the foundation as shown by the arrow.
2. Insert teak as shown by the arrow.
3. An instruction item 304 for inserting an eye shadow as shown by an arrow is displayed.

  On the other hand, the CPU 11 determines whether or not a first predetermined time has elapsed (step S203), and when the first predetermined time has elapsed, the backlight 33 is turned off and extinguished (step S204). As described above with reference to FIG. 2, in the specular mode state in which the backlight 33 is turned off, as shown by the arrow B, the external light passes through the touch panel 5 and then is reflected by the half mirror 31 and again touches the touch panel 5. Permeates and diffuses to the outside. For this reason, in the mirror surface mode in which the backlight 33 is turned off, the half mirror 31 functions as a mirror surface and can capture the user's face and the like.

  Accordingly, as shown in FIG. 12B, the user's face F is reflected on the half mirror 31 that functions as a mirror surface. Therefore, the user can apply makeup with a foundation on his / her face while looking at the face F reflected on the half mirror 31. At this time, the position of the foundation virtual makeup image FM displayed up to that point and the position of the own face F are matched.

  On the other hand, the CPU 11 determines whether or not a second predetermined time has elapsed since the backlight 33 was turned off (step S205), and turns on the backlight 33 when the second predetermined time has elapsed (step S205). Step S206). Thereby, as shown in FIG. 12A, the user can visually recognize the foundation virtual makeup image FM displayed on the liquid crystal display panel 32 from the outside of the display unit 3 again.

  That is, as shown in FIG. 12, the state (a) in which the foundation virtual makeup image FM is displayed and the state (b) in which the face F is reflected on the half mirror 31 for the second predetermined time are alternately repeated. At this time, the liquid crystal display panel 32 that displays the foundation virtual make-up image FM and the half mirror 31 that displays the face F are stacked in the same display unit 3. Therefore, the line of sight does not move when the foundation virtual makeup image FM is viewed and when the captured face F is viewed.

  Therefore, it is possible to make up the foundation while referring to the image without moving the line of sight. For this reason, the makeup can be completed in a short time without requiring time to complete the makeup of the foundation. In addition, it is possible to prevent the makeup from being finished with incomplete makeup due to the complicated movement of the line of sight, and obtain a foundation makeup result that satisfies the user.

  Here, the relationship between the lengths of the first predetermined time and the second predetermined time is preferably longer than the first predetermined time. The reason is that the user only visually recognizes the displayed foundation virtual makeup image at the first predetermined time, but at the second predetermined time, the user looks at his / her face F reflected on the half mirror 31. While doing make-up work. Therefore, considering that the makeup work is performed, it is preferable that the second predetermined time is longer than the first predetermined time. Of course, the length of the first predetermined time and the second predetermined time may be the same.

  Further, as shown in FIG. 12A, the CPU 11 displays a completion button 303 on a part of the liquid crystal display panel 32, and the foundation makeup work by the user is completed depending on whether or not the completion button 303 is touched. It is determined whether or not it has been done (step S207). When the user completes the foundation makeup work and touches the completion button 303, the determination in step S207 is YES.

  Therefore, the CPU 11 advances the processing from step S207 to step S208, and displays a cheek virtual makeup image and an arrow indicating the direction to be cheeked on the liquid crystal display panel 32 (step S208). As described above with reference to FIG. 2, when the backlight 33 is turned on, light from the backlight 33 passes through the liquid crystal display panel 32, the half mirror 31, and the touch panel 5 and is emitted to the outside as indicated by an arrow A. Then, the image displayed on the liquid crystal display panel 32 can be visually recognized.

  Therefore, as shown in FIG. 13A, the user can visually recognize the cheek virtual makeup image CM displayed on the liquid crystal display panel 32 from the outside of the display unit 3. The cheek virtual make-up image CM is provided with a make zone MZ, and an arrow C indicating the direction in which cheek should be applied to the recognized face image is displayed according to a program stored in the ROM 12 in advance. The Therefore, the user refers to this and starts makeup by cheeking on his / her face.

  At this time, the instruction item 304 is displayed on the liquid crystal display panel 31 as described above.

  On the other hand, the CPU 11 determines whether or not the first predetermined time has elapsed (step S209), and when the first predetermined time has elapsed, the backlight 33 is turned off and turned off (step S210). Therefore, as shown in FIG. 13B, the user's face F is reflected on the half mirror 31 that functions as a mirror surface. Therefore, the user can apply cheek makeup on his / her face while looking at the face F reflected on the half mirror 31.

  On the other hand, the CPU 11 determines whether or not the second predetermined time has elapsed since the backlight 33 was turned off (step S211), and turns on the backlight 33 when the second predetermined time has elapsed (step S211). Step S212). Accordingly, as shown in FIG. 13A, the user can visually recognize the cheek virtual makeup image CM displayed on the liquid crystal display panel 32 from the outside of the display unit 3 again.

  That is, as shown in FIG. 13, the state (a) in which the cheek virtual makeup image CM is displayed and the state (b) in which the face F is reflected on the half mirror 31 for the second predetermined time are alternately repeated. At this time, the liquid crystal display panel 32 that displays the cheek virtual makeup image CM and the half mirror 31 that displays the face F are stacked in the same display unit 3. Therefore, the line of sight is not moved when the cheek virtual makeup image CM is viewed and when the captured face F is viewed.

  Therefore, it is possible to make up the cheek while referring to the image without moving the line of sight. For this reason, the makeup can be completed in a short time without requiring time to complete the makeup of the cheek. In addition, it is possible to prevent the work from being completed with makeup being incomplete due to the complicated movement of the line of sight, and to obtain a cheek makeup result that satisfies the user.

  Further, as shown in FIG. 13A, the CPU 11 displays a completion button 303 on a part of the liquid crystal display panel 32, and the cheek makeup work by the user is completed depending on whether or not the completion button 303 is touched. It is determined whether or not it has been done (step S213). When the user completes the cheek makeup work and touches the completion button 303, the determination in step S213 is YES.

  Therefore, the CPU 11 advances the process from step S213 to step S214, and displays an eye shadow virtual makeup image and an arrow indicating the direction in which the eye shadow should be applied on the liquid crystal display panel 32 (step S214). As described above with reference to FIG. 2, when the backlight 33 is turned on, light from the backlight 33 passes through the liquid crystal display panel 32, the half mirror 31, and the touch panel 5 and is emitted to the outside as indicated by an arrow A. Then, the image displayed on the liquid crystal display panel 32 can be visually recognized.

  Accordingly, as shown in FIG. 14A, the user can visually recognize the eye shadow virtual makeup image IM displayed on the liquid crystal display panel 32 from the outside of the display unit 3. Further, a makeup zone MZ is added to the eye shadow virtual makeup image IM, and an arrow C indicating the direction in which the eye shadow should be applied to the recognized face image according to a program stored in the ROM 12 in advance. Is displayed. Therefore, the user refers to this and starts makeup by eye shadow on his / her face.

  At this time, the instruction item 304 is displayed on the liquid crystal display panel 31 as described above.

  On the other hand, the CPU 11 determines whether or not a first predetermined time has elapsed (step S215), and when the first predetermined time has elapsed, the backlight 33 is turned off and extinguished (step S216). Therefore, as shown in FIG. 14B, the user's face F is reflected on the half mirror 31 that functions as a mirror surface. Therefore, the user can apply makeup by eye shadow on his / her face while looking at the face F reflected on the half mirror 31.

  On the other hand, the CPU 11 determines whether or not a second predetermined time has elapsed since the backlight 33 was turned off (step S217), and turns on the backlight 33 if the second predetermined time has elapsed (step S217). Step S218). Thereby, as shown in FIG. 14A, the user can visually recognize the eyeshadow virtual makeup image IM displayed on the liquid crystal display panel 32 from the outside of the display unit 3 again.

  That is, as shown in FIG. 14, the state (a) in which the eye shadow virtual makeup image IM is displayed and the state (b) in which the face F is reflected on the half mirror 31 for the second predetermined time are alternately repeated. At this time, the liquid crystal display panel 32 that displays the eye shadow virtual makeup image IM and the half mirror 31 that displays the face F are stacked in the same display unit 3. Therefore, the line of sight does not move when the eye shadow virtual makeup image IM is viewed and when the captured face F is viewed.

  Therefore, it is possible to make up the eye shadow while referring to the image without moving the line of sight. Therefore, it is possible to complete the makeup in a short time without requiring time to complete the makeup of the eye shadow. In addition, it is possible to prevent the makeup from being completed due to the complicated movement of the line of sight and to finish the work, and to obtain an eye shadow makeup result that satisfies the user.

  As shown in FIG. 14A, the CPU 11 displays a completion button 303 on a part of the liquid crystal display panel 32. Depending on whether or not the completion button 303 is touched, the user performs eye shadow makeup work. It is determined whether or not it is completed (step S219). When the user completes the eye shadow makeup work and touches the completion button 303, the determination in step S207 is YES, and the processing according to this flow is terminated.

  Therefore, according to the present embodiment, makeup can be performed while referring to an image with no eye movement for each makeup type of foundation, cheek, and eye shadow. Therefore, it is possible to complete the makeup in a short time without requiring time to complete the makeup of each makeup type. In addition, it is possible to prevent the end of the work with the makeup being incomplete due to the complicated movement of the line of sight, and obtain a makeup result of the entire face that satisfies the user.

  FIG. 15 is a flowchart showing a timer interrupt routine in the present embodiment. In a state where the make mode process is being executed according to the flowchart shown in FIG. 11, the CPU 11 jumps in at a predetermined cycle and executes the process according to this timer interrupt routine. That is, it is determined whether or not a touch on a predetermined part of the touch panel 5, for example, the center of the touch panel 5 is detected (step S <b> 301). If this touch is detected, the backlight 33 is turned on (step S302), and a completed makeup image is displayed on the liquid crystal display panel 32 (step S303).

  Therefore, as shown in FIG. 16A, the user can visually recognize the completed makeup virtual image PM displayed on the liquid crystal display panel 32 from the outside of the display unit 3. Further, the CPU 11 determines whether or not the first predetermined time has elapsed (step S304), and when the first predetermined time has elapsed, the backlight 33 is turned off and extinguished (step S305). Therefore, as shown in FIG. 16B, the user's face F is reflected on the half mirror 31 functioning as a mirror surface. Therefore, the user can see the face F shown on the half mirror 31.

  On the other hand, the CPU 11 determines whether or not the second predetermined time has elapsed since the backlight 33 was turned off (step S306). If the second predetermined time has elapsed, the CPU 11 touches the center of the touch panel 5 again. Is detected (step S307). Then, the process from step S302 is repeated until a touch on the touch panel 5 is detected again. If a touch on the touch panel 5 is detected again, the process returns to the main routine of the make mode process shown in FIG.

  Therefore, by this timer interrupt routine, the user can visually recognize the completed makeup virtual image PM at any point in time by touching the center of the touch panel 5. Therefore, the makeup can be completed while referring to the completed makeup virtual image PM at any time during or at the end of each makeup.

(Second Embodiment)
While the first embodiment described above generates a virtual makeup image by a user's touch, this second embodiment is a makeup simulation that generates a virtual makeup image stored in advance in a ROM. A virtual makeup image is generated using a program. In a state where the virtual makeup image creation mode is set, the CPU 11 executes processing as shown in the flowchart of FIG. 17 according to the program stored in the ROM 12. That is, the live view image is displayed by transferring the image captured by the imaging unit 4 to the liquid crystal display panel 32 (step S401). Therefore, when the user is seated with the face facing the DPF 1, the user's face F is displayed on the liquid crystal display panel 32 of the display unit 3 as shown in FIG. 6.

  At this time, as shown in FIG. 6, the CPU 11 displays a shutter button 301 on a part of the liquid crystal display panel 32, and determines whether or not the displayed shutter button 301 is touched (step S402). If the shutter button 301 is touched, shooting processing is executed, and the image captured by the imaging unit 4 is stored in the RAM 13 (step S403).

  Subsequently, the photographed face image is subjected to foundation makeup processing (step S404). That is, as described above, the ROM 12 has a known face recognition program for recognizing a face image that is an image of a face portion in an image captured by the image capturing unit 4, and performs image processing on the recognized face image to make makeup A known make-up simulation program for generating a virtual make-up image that has been subjected to up is stored. Patent Document 1 discloses a technique for generating a makeup simulation image for each foundation, cheek, and eye shadow. Therefore, in step S403, a process for applying makeup on the foundation to the photographed face image is executed using a known makeup simulation program. Then, the foundation virtual makeup image obtained by this process is stored in the RAM 13 (step S405).

  Similarly, the face image is subjected to a cheek makeup process (step S406), and the cheek virtual makeup image obtained thereby is stored in the RAM 13 (step S407). Further, similarly, the face image is subjected to eye shadow makeup processing (step S408), and the eye shadow virtual makeup image obtained thereby is stored in the RAM 13 (step S409). Further, the completed makeup virtual image subjected to the above-described foundation, cheek, and eyeshadow makeup processes is stored in the RAM 13 (step S410).

Therefore, when the virtual makeup image creation mode described above is completed, at least the following images (1) to (4) are stored in the RAM 13 as in the first embodiment.
(1) Foundation virtual makeup image (2) Teak virtual makeup image (3) Eye shadow virtual makeup image (4) Completed makeup virtual image (= eye shadow virtual makeup image)

  Therefore, according to the second embodiment, the virtual makeup images (1) to (4) can be generated and stored in the RAM 13 without the user performing a writing operation.

  When the virtual makeup image creation mode described above ends, the CPU 11 executes the make mode process according to the flowchart shown in FIG. 11 as in the first embodiment described above. Therefore, in the present embodiment as well, makeup can be performed while referring to the image without moving the line of sight for each makeup type of foundation, cheek, and eye shadow. Therefore, it is possible to complete the makeup in a short time without requiring time to complete the makeup of each makeup type. In addition, it is possible to prevent the end of the work with the makeup being incomplete due to the complicated movement of the line of sight, and obtain a makeup result of the entire face that satisfies the user.

  Further, the interrupt routine shown in FIG. 15 is executed in the same manner. Therefore, the user can visually recognize the completed makeup virtual image MPM generated by the makeup simulation program as shown in FIG. Further, as shown in FIG. 18B, the user's face F can be copied to the half mirror 31 that functions as a mirror surface. If the user touches the center of the touch panel 5 by the timer interrupt routine, the user can visually recognize the completed makeup virtual image PM as his / her face F at any time. Therefore, the makeup can be completed while referring to the completed makeup virtual image MPM at any time in the middle or at the end of each makeup.

(Third embodiment)
In the third embodiment of the present invention, makeup, such as foundation, cheek, and eyeshadow are displayed on the model face, and an image with makeup applied is downloaded and acquired. That is, the distribution content server 50 displays a makeup, cheek, and eyeshadow makeup zone on the model face, and a plurality of images each applied with makeup.

  Then, in a state where the virtual make-up image creation mode is set, the CPU 11 of the DPF 1 executes processing as shown in the flowchart of FIG. 19 according to the program stored in the ROM 12. That is, the communication control unit 90 is activated and connected to the distribution content server 50 via the telephone line 91 or the wireless LAN 92 and the network (step S501).

  Next, the foundation makeup image stored in the distribution content server 50 is downloaded and stored in the RAM 13 (step S502). At this time, the distribution content server 50 stores a plurality of foundation makeup images taken by applying different foundations to different models, and the user selects a desired foundation makeup image that matches his / her face from these. To do.

  Similarly, the cheek makeup image stored in the distribution content server 50 is downloaded and stored in the RAM 13 (step S503), and the eye shadow makeup image is downloaded and stored in the RAM 13 (step S504). . Further, the completed makeup virtual image subjected to the above-described foundation, cheek, and eyeshadow makeup processes is stored in the RAM 13 (step S505).

Therefore, when the virtual makeup image creation mode described above is completed, at least the following images (1) to (4) are stored in the RAM 13 as in the first embodiment.
(1) Foundation makeup image (2) Cheek makeup image (3) Eye shadow makeup image (4) Completed makeup image (= eye shadow makeup image)

  Therefore, according to the third embodiment, the virtual makeup images (1) to (4) can be generated and stored in the RAM 13 without the user performing a writing operation.

  Therefore, according to the third embodiment, ideal makeup images based on the models (1) to (4) can be acquired and stored in the RAM 13 without the user performing a writing operation. it can.

  When the virtual makeup image creation mode described above ends, the CPU 11 executes the make mode process according to the flowchart shown in FIG. 11 as in the first embodiment described above. Therefore, in the present embodiment as well, makeup can be performed while referring to the image without moving the line of sight for each makeup type of foundation, cheek, and eye shadow. Therefore, it is possible to complete the makeup in a short time without requiring time to complete the makeup of each makeup type. In addition, it is possible to prevent the makeup from being finished with incomplete makeup due to the complicated movement of the line of sight, and obtain a makeup result for the entire face that satisfies the user.

  Moreover, in the present embodiment, makeup can be performed while referring to an ideal makeup image in which makeup is applied to the model face.

  Further, the interrupt routine shown in FIG. 15 is executed in the same manner. Therefore, the user can visually recognize the completed makeup image PPM obtained by photographing the model face as shown in FIG. In addition, as shown in FIG. 20B, the user's face F can be copied to the half mirror 31 that functions as a mirror surface. If the user touches the center of the touch panel 5 by the timer interrupt routine, the user can visually recognize the completed makeup virtual image PM as his / her face F at any time. Therefore, the makeup can be completed while referring to the completed makeup image PPM of the model at any time in the middle or at the end of each makeup.

  In the embodiment, the foundation, cheek, and eye shadow images each having makeup applied for each type corresponding to the stage and part of makeup are used. However, a single image in which foundation, cheek, and eye shadow are all applied may be used without using an image for each type according to the makeup stage and site.

1 DPF
2 Main body 3 Display unit 4 Imaging unit 5 Touch panel 11 CPU
12 ROM
13 RAM
DESCRIPTION OF SYMBOLS 16 Display control part 30 Communication control part 31 Half mirror 32 Liquid crystal display panel 33 Backlight 40 Backup server 41 Lens block 42 Zoom motor 43 Timing generator 44 Motor driver 45 CCD
46 Horizontal driver 47 Unit circuit 48 DSP
50 distribution content server 301 shutter button 302 guide character string 303 completion button 411 zoom lens FM foundation virtual makeup image FP face image MZ makeup zone

Claims (7)

A display panel that displays images on the screen;
A storage circuit for storing a makeup image on which makeup has been applied;
A display mode in which the makeup image stored in the storage circuit is displayed on the screen of the display panel; and the screen of the display panel is mirrored without displaying the makeup image on the screen of the display panel. A display control circuit for switching between the mirror surface mode to be
An image display device comprising:   The image display apparatus according to claim 1, wherein the makeup image is an image obtained by performing an image makeup process on a face image of a user.   The image display apparatus according to claim 1, wherein the makeup image is an image obtained by performing image makeup processing on a face image other than the user. The storage circuit stores a plurality of types of the makeup images subjected to makeup for each type according to the stage and part of makeup,
4. The image display device according to claim 1, wherein the display control circuit displays a plurality of types of makeup images stored in the storage circuit in the display mode. 5.   5. The image display device according to claim 1, wherein a time interval between the display mode switched by the display control circuit and the specular mode is different.   6. The image display device according to claim 5, wherein a time in the mirror surface mode is longer than a time in the display mode. A display step for displaying the makeup image stored in the storage circuit on the screen of the display panel;
Mirror surface step for making the screen of the display panel into a mirror surface state without displaying the makeup image on at least one of the display step before and after,
An image display method comprising: