KR20190068146A - Smart mirror display device - Google Patents

Abstract

According to an embodiment of the present invention, disclosed is a smart mirror display device. The smart mirror display device comprises of: a camera unit for photographing a user; a display unit for displaying image and beauty content of the user photographed by the camera unit; and a control unit for recognizing the user′s beauty state on the image of the user photographed by the camera unit and switching sub-beauty content of the beauty content based at least in part on the recognized beauty state. The beauty content includes an image of a beauty creator that provides information on a makeup method to the user, and may include one or more sub-beauty content. The present invention can provide a device for allowing the user to easily try the beauty content of the beauty creator.

Description

[0001] SMART MIRROR DISPLAY DEVICE [0002]

The present invention relates to a smart mirror display device, and more particularly, to a smart mirror display device capable of interacting with a user's image.

Even before the invention of mirrors, people wanted to see their appearance on the waterfront. After the invention of mirrors, people want to see themselves through mirrors and to make their appearance more beautiful.

The desire of those who want to be beautiful has created a variety of makeup methods, ways to be beautiful. Recently, contents providing information on how to become beautiful in a video sharing platform and the like are becoming popular.

The user can provide the contents providing information on how to be beautiful and can try the information contained in the contents by himself / herself. For example, the user can try the same makeup method by following the video contents about the makeup method of the beauty creator. However, in this process, different results can be obtained due to the difference in skill between the beauty creator and the user.

Thus, there is a need for a device that can conveniently follow content that provides information about how a user is going to beautify beauty creators.

The present invention has been devised to cope with the background art described above and provides an apparatus for allowing a user to easily try beauty contents of a beauty creator.

A smart mirror display device according to an embodiment of the present invention for realizing the above-described problems is disclosed. The smart mirror display device includes a camera unit for photographing a user; A display unit for displaying image and beauty contents of a user photographed by the camera unit; And a control unit for recognizing the user's beauty state on the image of the user photographed by the camera unit and switching the sub-beauty content of the beauty content based at least in part on the recognized beauty state, , An image of a beauty creator that provides the user with information on the make-up method, and may include one or more sub-beauty contents.

Preferably, the control unit may further generate the one or more sub-beauty contents by separating the images according to a time unit, a face image change unit according to makeup, a makeup tool unit, or a makeup skill unit.

Preferably, the beauty state of the user includes information related to whether or not the user has performed the makeup step included in the sub-beauty content, and the control unit may determine, based on the image change value of the user's image, Determining whether or not the user has performed the makeup step included in the sub-beauty content based on the recognized beauty state, and if the user performs the makeup step included in the sub-beauty content In one case, it may decide to display the next sub-beauty content.

The control unit may further be configured to recognize the skin condition of the user in the image of the user photographed by the camera unit and to select the beauty content based at least in part on the recognized skin condition.

Preferably, the apparatus further includes a user input unit for receiving an input of the user's beauty goal from the user, and the control unit is further configured to determine, based on the input of the beauty goal input from the user, The corresponding beauty content can be selected.

Also, preferably, the beauty goal may be a beauty goal based on at least one of the skin condition of the user, the beauty orientation point of the user, the social event the user wants to attend, and the user's personal information.

Preferably, the control unit may further include a skin condition recognition unit for acquiring information for allowing the control unit to recognize the skin condition of the user.

Preferably, the control unit recognizes each part of the face of the user on the image of the user photographed by the camera unit, and judges whether or not the makeup step of the sub-beauty contents is applied to each recognized part can do.

The control unit may further store the image of the user photographed by the camera unit according to the makeup step of the user, and determine whether the image of the user is shared.

A smart mirror display method performed in a smart mirror display device in accordance with another embodiment of the present invention is disclosed. The smart mirror display method includes: capturing an image of a user; Displaying video and beauty contents of a photographed user; Recognizing the beauty state of the user on the photographed user's image; And converting the sub-beauty content of the beauty content based at least in part on the recognized beauty condition, wherein the beauty content includes an image of a beauty creater that provides the user with information about the makeup method , And one or more sub-beauty content.

A computer program stored in a computer-readable storage medium comprising encoded instructions in accordance with another embodiment of the present invention is disclosed. The computer program, when executed by one or more processors of a computing device, causes the one or more processors to perform the following steps for providing a smart mirror display, the steps comprising: ; Displaying video and beauty contents of a photographed user; Recognizing the beauty state of the user on the photographed user's image; And converting the sub-beauty content of the beauty content based at least in part on the recognized beauty condition, wherein the beauty content includes an image of a beauty creater that provides the user with information about the makeup method , And one or more sub-beauty content.

The present invention can provide an apparatus for allowing a user to easily try beauty contents of a beauty creator.

1 is a block diagram of a smart mirror display device according to an embodiment of the present invention.
2 is an illustration of an image displayed on a smart mirror display device according to an embodiment of the present invention.
3 is a flowchart of a smart mirror display method performed in a smart mirror display device according to an embodiment of the present invention.
4 is a block diagram illustrating a means for implementing a smart mirror display method in accordance with an embodiment of the present invention.
5 is a block diagram illustrating a module for implementing a smart mirror display method according to an embodiment of the present invention.
6 is a block diagram illustrating a circuit for implementing a smart mirror display method according to an embodiment of the present invention.
7 is a block diagram illustrating logic for implementing a smart mirror display method in accordance with an embodiment of the present invention.
8 is a block diagram of a computing device according to an embodiment of the present invention.

Various embodiments are now described with reference to the drawings. In this specification, various explanations are given in order to provide an understanding of the present invention. It will be apparent, however, that such embodiments may be practiced without these specific details. In other instances, well-known structures and devices are provided in block diagram form in order to facilitate describing the embodiments.

The terms "component," "module," system, "and the like, as used herein, refer to a computer-related entity, hardware, firmware, software, combination of software and hardware, or execution of software. For example, a component may be, but is not limited to, a process, a processor, an object, an execution thread, a program, and / or a computer running on a processor. For example, both an application running on a computing device and a computing device may be a component. One or more components may reside within a processor and / or thread of execution, one component may be localized within one computer, or it may be distributed between two or more computers. Further, such components may execute from various computer readable media having various data structures stored therein. The components may communicate, for example, via a network (e.g., a local system, data and / or signals from one component interacting with another component in a distributed system, and / or signals with one or more data packets) And / or < / RTI > transmitted data).

In addition, the term " comprises "and / or" comprising " means that the features and / or components are present, but excludes the presence or addition of one or more other features, components, and / It should be understood that it does not. Also, unless the context clearly dictates otherwise or to the contrary, the singular forms in this specification and claims should generally be construed to mean "one or more. &Quot;

The description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features presented herein.

1 is a block diagram of a smart mirror display device according to an embodiment of the present invention.

The smart mirror display device 100 includes a camera unit 110, a skin condition recognition unit 120, a display unit 130, a user input unit 140, a control unit 150, a communication unit 160, can do. The components shown in FIG. 1 are not all components of the smart mirror display device 100, and the smart mirror display device 100 may further include any components as needed.

The camera unit 110 may be composed of one or more camera modules, and can photograph a user's image. The camera unit 110 may include any camera module. The camera unit 110 can photograph a user's image so that the controller 150 can recognize the beauty state of the user. The camera unit 110 can also photograph the user so that the controller 150 can recognize the skin condition of the user. The user's beauty state includes information as to whether or not the makeup step included in the sub-beauty content has been performed. For example, the user ' s beauty status may include information as to what step the user performed the make-up method. That is, the controller 150 can recognize the beauty state of the user, such as whether the user performed the current eye contact or completed the ball touch, based on the photographed image photographed by the camera unit 110. [ The description of the above-mentioned make-up step is merely an example, and the present invention is not limited thereto.

The skin condition recognition unit 120 may acquire information for allowing the control unit 150 to recognize the skin condition of the user. For example, the skin condition recognition unit 120 can acquire a skin condition image of a user that is larger than a user's image that can be acquired by the camera unit 110. [ In addition, the skin condition recognition unit 120 may enlarge the surface of the user's skin so that the controller 150 can determine the roughness of the skin surface, the degree of moistness of the user's skin, the skin texture, and the skin age. In addition, the skin condition recognizing unit 120 may measure the skin moisture condition using an electric stimulus. That is, the skin condition recognition unit 120 may allow the control unit 150 to recognize the skin condition of the user through an image enlarged from the camera unit 110 that captures the user's overall image. In addition, the skin condition recognition unit 120 may acquire not only the image but also arbitrary information for determining the skin condition.

The display unit 130 may display the user's image 131 and the beauty content 133 taken by the camera unit. The beauty content 133 includes an image of a beauty creator that provides the user with information on the makeup method. The beauty content 133 may include sub-beauty content separated by time unit, face image change unit based on makeup, makeup tool unit, or makeup skill unit. 2 is an illustration of an image displayed on a smart mirror display device according to an embodiment of the present invention. Referring to FIG. 2, the display unit 130 may display a user image 131 and a beauty image 133. The display unit 130 may display the user's image 131 and the beauty image 133 together on one screen or may switch the user's image 131 or the beauty image 133 to each other It can also be displayed.

The user input 140 may receive input from a user for a user's beauty goal. A beauty goal may be a beauty goal based on at least one of a user's skin condition, a user's beauty orientation, a social event the user wants to attend, and a user's personal information. The user can input arbitrary information for selecting a makeup method he / she desires. For example, the user can enter through the user input section that his or her skin condition is dry and the skin tone is white. In this case, the control unit 150 can select the beauty content that matches the white tone of the dry skin. Also, for example, a user can enter a favorite friend's wedding attendance as a beauty goal. In this case, the control unit 150 can select the beauty content including the makeup method suitable for attending the wedding of a close friend. Also, the user can input his or her age, and in this case, the control unit 150 can select the beauty content including the make-up method suitable for the age of the user. The user input unit 140 may also receive an input for switching the sub-beauty content. For example, when the user confirms the beauty content, which is performed in the order of eye makeup, ball makeup, and lip makeup, on the display unit 130 and follows up makeup, It is possible to skip the sub-beauty contents related to the eye makeup scene. The user input 140 may receive a user input relating to a user's sub-beauty content skipping, and the controller 150 may determine to display the next sub-beauty content, lip makeup.

The user input 140 may include any input device such as a touch display, a keyboard, a mouse, etc., and may also process the gesture input. For example, if the user moves his / her hand twice rapidly from left to right on the screen during the makeup operation, the user input unit 140 can recognize the gesture of the user as a gesture related to the sub-beauty content skip. The specific configuration and gesture of the above-described user input section are merely examples, and the present invention is not limited thereto.

The control unit 150 may be a processor including one or more cores, and may be a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), a tensor processing unit And a TPU (tensor processing unit). The control unit 150 may read the computer program stored in the memory 170 to perform the smart mirror display method according to an embodiment of the present invention. The control unit 150 can control the overall operation of the smart mirror display device 100. [

The control unit 150 recognizes the user's beauty state in the image of the user photographed by the camera unit 110 and can switch the sub-beauty content of the beauty content based at least in part on the recognized beauty state. The beauty content may include an image of a beauty creator that provides information to the user about the makeup method, and may include one or more sub-beauty content. The user's beauty state may include information relating to whether the user has performed the makeup step included in the sub-beauty content. For example, the user ' s beauty status may include information as to what step the user performed the make-up method. That is, the controller 150 can recognize the beauty state of the user, such as whether the user performed the current eye contact or completed the ball touch, based on the photographed image photographed by the camera unit 110. [ The description of the above-mentioned make-up step is merely an example, and the present invention is not limited thereto.

The control unit 150 recognizes the user's beauty state based on the image change value of the user's image and determines whether or not the user has performed the makeup step included in the sub-beauty content based on the recognized beauty state, When the makeup step included in the sub-beauty content is performed, it may be determined to display the next sub-beauty content. For example, when the user confirms the beauty content on the display unit 130 in order of eye makeup, ball makeup, and lip makeup, and performs makeup, the controller 150 controls the display unit 130, And if it is determined that the user has completed the eyeshadow, it can be determined to display the sub-beauty contents related to the make-up.

The control unit 150 recognizes each part of the user's face in the image of the user photographed by the camera unit 110 and judges whether or not the cosmetic step of the sub-beauty contents is applied to each recognized part. The control unit 150 can recognize the face portion of the user first in the photographed image. The control unit 150 can recognize an edge of a user's face by using an image processing technique, an image processing algorithm such as CNN (Convolutional Neural Network). The control unit 150 can recognize features of the face such as eyes, nose, mouth, ear, etc. by using an image processing algorithm. The control unit 150 can recognize each part of the face based on the positional relationship of the feature parts of the face. For example, when the sub-beauty contents related to the ball makeup are displayed, the controller 150 recognizes the color change of the ball portion in the captured image of the user, detects whether the user has completed the make- It can decide to switch to the content.

The control unit 150 may generate at least one sub-beauty content by separating the beauty content. The control unit 150 may separate the beauty content according to time, a face image change unit based on makeup, a makeup tool unit, or a makeup skill unit. The control unit 150 may apply an image processing algorithm to the beauty content to read an image of the beauty content and recognize whether or not the corresponding frame performs a makeup step. For example, the control unit 150 may divide the beauty content into three minutes to generate the sub-beauty content. This sub-divided content can then be used to train the user in the time-critical field. For example, a make-up artist who performs make-up on an entertainer may have a limited time to fix an entertainer's make-up during the shoot. Such makeup artists can follow and train separate sub-beauty content by time of an embodiment of the present invention to improve make-up performance under time constraints. The control unit 150 can generate the sub-beauty contents by separating the beauty content by a face image change unit based on makeup, for example, a snow scene, a ball makeup, a lip makeup, and the like. In addition, the controller 150 recognizes the makeup tool in the beauty content and can separate the beauty content in units of the makeup tool. For example, the controller 150 recognizes the mascara and uses the mascara, recognizes the eyeliner, and separates the beauty content into a step of using the eyeliner. In addition, the control unit 150 recognizes the makeup skill in the beauty content and can separate the beauty content in the makeup skill unit. For example, the control unit 150 may recognize makeup actions for skin light from the beauty content, and may separate the beauty content in units of the makeup operations. The detailed description of the above-described beauty content division unit is merely an example, and the present invention is not limited thereto.

The control unit 150 can select the beauty content based at least in part on the skin condition of the user. The controller 150 controls the user's skin condition based at least in part on at least one of a user's image photographed at the camera unit, information obtained at the skin condition recognizing unit 120, and user input inputted at the user input unit 140 It can be judged. The control unit 150 can determine to display the beauty content including the moisture supply make-up method which can be recommended for dry skin, for example, when the user's skin is dry skin. In addition, the controller 150 may determine to display the beauty content including the whitening make-up method, for example, when the skin tone of the user is a dark tone. Also, the controller 150 can select the beauty content corresponding to the beauty goal set by the user. For example, if the user wishes to attend a friend's wedding, the control unit 150 can select the beauty content including a makeup method suitable for attending the wedding. Further, for example, when the user has eyes without an upper eyelid, the control unit 150 may recognize the beauty goal of the user as " eye emphasis ", and may select the beauty content including a cosmetic method for emphasizing the eyes. The present invention is not limited by the above-mentioned examples.

The control unit 150 may determine to store the image of the user photographed by the camera unit 110 according to the makeup step of the user. Also, the control unit 150 may determine whether or not the stored image of the user is shared. For example, when the user performs makeup while viewing the beauty content, the camera unit 110 can shoot the same. The control unit 150 may determine that the user stores the image in which the makeup is performed in the memory 170. [ In this case, the control unit 150 may divide the image for which the user performs makeup by applying a criterion similar to a criterion for creating sub-beauty content, or may set an edit point. The control unit 150 may determine that the stored image based on the user's input or the like is shared by the user, such as a video sharing platform.

The communication unit 160 can transmit and receive data and the like for performing the smart mirror display method to and from other computing devices, servers, and the like according to an embodiment of the present invention. The communication unit 160 can transmit and receive data required for embodiments of the present invention, such as beauty content of a beauty creator, a beauty image of a user, to and from other computing devices, servers, and the like. For example, the communication unit 160 may receive beauty content from a social network service, a video sharing platform (e.g., youtube), and the like. The communication unit 160 may transmit the beauty image of the photographed user to a social network service, a video sharing platform, or the like.

The memory 170 may store a computer program for performing the smart mirror display method according to an embodiment of the present invention, and the stored computer program may be read and driven by the processor of the controller 150. [

The smart mirror display device 100 displays beauty contents so that the user can follow them, and the beauty content can be divided into sub-beauty contents so that the user can follow them step by step. In addition, the smart mirror display device 100 according to an embodiment of the present invention recognizes the beauty state of the user and switches the sub-beauty content, thereby enabling the user to conveniently follow the beauty content. In addition, the smart mirror display device 100 according to an exemplary embodiment of the present invention may recommend the beauty content that can be referred to according to the beauty goal of the user so that the user can learn the makeup method according to the beauty point of the user.

2 is an illustration of an image displayed on a smart mirror display device according to an embodiment of the present invention.

2 (a) and 2 (b), when the user is located in front of the smart mirror display device 100, the smart mirror display device 100 photographs the user and generates a user's image 131 And display the user's image 131 together with the beauty content 133. [

As shown, the displayed beauty content 133 may be the sub-beauty content of the step of performing highlight making on the nose. At this time, the controller 150 recognizes the nose portion 201 of the user's image 131 and compares the nose portion 201 with the nose portion 203 of the beauty content 133 to determine whether or not the user has performed the makeup step of the sub- Can be recognized.

 The control unit 150 can recognize the nose portion 201 in the user's face by applying an image processing algorithm to the user's image 131. [ The controller 150 can detect whether or not the user has performed the makeup step included in the sub-beauty content by detecting a change in the color value of the recognized nose 201 of the user. The controller 150 may switch the sub-beauty content so that the next sub-beauty content is displayed on the display unit 130 when the user senses that the user has performed the makeup step included in the sub-beauty content.

The smart mirror display device 100 shown in FIG. 2 and the images displayed thereon are merely examples, and the present invention is not limited thereto.

3 is a flowchart of a smart mirror display method performed in a smart mirror display device according to an embodiment of the present invention.

The smart mirror display device 100 can photograph the user's image (step S310). The smart mirror display device 100 may capture a user to generate a user image so as to recognize the beauty state of the user.

The smart mirror display device 100 may display the photographed image of the user and the beauty image (step S320). The beauty content 133 includes an image of a beauty creator that provides the user with information on the makeup method. The beauty content 133 may include sub-beauty content separated by time unit, face image change unit based on makeup, makeup tool unit, or makeup skill unit.

The smart mirror display device 100 can recognize the user's beauty state in the image of the photographed user (operation S330). The user's beauty state may include information relating to whether the user has performed the makeup step included in the sub-beauty content. For example, the user ' s beauty status may include information as to what step the user performed the make-up method. That is, the smart mirror display device 100 can recognize the beauty state of the user, such as whether the user performed the current eye contact, completed the ball touch, or the like based on the photographed image photographed by the smart mirror display device 100. [ The description of the above-mentioned make-up step is merely an example, and the present invention is not limited thereto.

The smart mirror display device 100 may switch the sub image of the beauty image based at least in part on the recognized beauty state (step S340). The smart mirror display device 100 may recognize the user's beauty state, for example, to determine whether or not the user has performed eye makeup, and the sub-beauty image may be displayed at least partially based on the determination result, A sub-beauty image including a makeup method can be displayed and displayed.

The smart mirror display device 100 displays beauty contents so that the user can follow them, and the beauty content can be divided into sub-beauty contents so that the user can follow them step by step. In addition, the smart mirror display device 100 recognizes the beauty state of the user and can switch the sub-beauty content to enable the user to conveniently follow the beauty content. In addition, the smart mirror display device 100 may recommend the beauty content that can be referred to according to the user's beauty goal, so that the user can learn the makeup method according to the beauty point of interest.

4 is a block diagram illustrating a means for implementing a smart mirror display method in accordance with an embodiment of the present invention.

The smart mirror display method according to an embodiment of the present invention can be implemented by the following means.

According to an embodiment of the present invention, a smart mirror display method includes: means (410) for photographing a user's image; Means (420) for displaying a photographed user's image and a beauty image; Means (430) for recognizing the user ' s beauty state in the photographed user ' s image; And means (440) for switching the sub-beauty image of the beauty image based at least in part on the recognized beauty state.

5 is a block diagram illustrating a module for implementing a smart mirror display method according to an embodiment of the present invention.

The smart mirror display method according to an embodiment of the present invention can be implemented by the following module.

According to an embodiment of the present invention, a smart mirror display method includes a module 510 for capturing an image of a user; A module 520 for displaying a photographed user's image and a beauty image; A module 530 for recognizing the user's beauty state in the image of the photographed user; And a module 540 for switching the sub-beauty image of the beauty image based at least in part on the recognized beauty state.

6 is a block diagram illustrating a circuit for implementing a smart mirror display method according to an embodiment of the present invention.

The smart mirror display method according to an embodiment of the present invention can be implemented by the following circuit.

According to an embodiment of the present invention, a smart mirror display method includes a circuit 610 for capturing an image of a user; A circuit (620) for displaying the photographed user's visual and beauty images; A circuit 630 for recognizing the beauty state of the user in the image of the photographed user; And circuitry 640 for switching the sub-beauty image of the beauty image based at least in part on the recognized beauty state.

7 is a block diagram illustrating logic for implementing a smart mirror display method in accordance with an embodiment of the present invention.

The smart mirror display method according to an embodiment of the present invention can be implemented by the following logic.

According to an embodiment of the present invention, a smart mirror display method includes logic 710 for capturing an image of a user; Logic 720 for displaying the captured image of the user and the beauty image; Logic 730 for recognizing the user ' s beauty state in the image of the photographed user; And logic 740 for switching the sub-beauty image of the beauty image based at least in part on the recognized beauty state.

Those skilled in the art will further appreciate that the various illustrative logical blocks, configurations, modules, circuits, means, logic, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, And the like. To clearly illustrate the interchangeability of hardware and software, various illustrative components, blocks, structures, means, logic, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

8 is a block diagram of a computing device according to an embodiment of the present invention.

Figure 8 illustrates a simplified schematic diagram of an exemplary computing environment in which embodiments of the present invention may be implemented.

Although the present invention has been described above generally in terms of computer-executable instructions that can be executed on one or more computers, those skilled in the art will appreciate that the present invention may be implemented in combination with other program modules and / You will know.

Generally, program modules include routines, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. It will also be appreciated by those skilled in the art that the methods of the present invention may be practiced with other computer systems, such as single-processor or multiprocessor computer systems, minicomputers, mainframe computers, as well as personal computers, handheld computing devices, microprocessor-based or programmable consumer electronics, And may operate in conjunction with one or more associated devices).

The described embodiments of the invention may also be practiced in distributed computing environments where certain tasks are performed by remote processing devices connected through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Computers typically include a variety of computer readable media. Any medium accessible by a computer may be a computer-readable medium, which may include volatile and non-volatile media, transitory and non-transitory media, removable and non-removable media, Removable media. By way of example, and not limitation, computer readable media can comprise computer readable storage media and computer readable transmission media. Computer-readable storage media includes both volatile and nonvolatile media, both temporary and non-volatile media, both removable and non-removable, implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data Media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, Or any other medium which can be accessed by a computer and used to store the desired information.

Computer readable transmission media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, It includes all information delivery media. The term modulated data signal refers to a signal that has one or more of its characteristics set or changed to encode information in the signal. By way of example, and not limitation, computer readable transmission media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, or other wireless media. Combinations of any of the above described media are also intended to be included within the scope of computer readable transmission media.

There is shown an exemplary environment 1100 that implements various aspects of the present invention including a computer 1102 and includes a processing unit 1104, a system memory 1106 and a system bus 1108 do. The system bus 1108 couples system components, including but not limited to, system memory 1106 to the processing unit 1104. The processing unit 1104 may be any of a variety of commercially available processors. Dual processors and other multiprocessor architectures may also be used as the processing unit 1104.

The system bus 1108 may be any of several types of bus structures that may additionally be interconnected to a local bus using any of the memory bus, peripheral bus, and various commercial bus architectures. The system memory 1106 includes read only memory (ROM) 1110 and random access memory (RAM) The basic input / output system (BIOS) is stored in a non-volatile memory 1110, such as a ROM, EPROM, EEPROM or the like, which is a basic (non-volatile) memory device that aids in transferring information between components within the computer 1102 Routine. The RAM 1112 may also include a high speed RAM such as static RAM for caching data.

The computer 1102 may also be an internal hard disk drive (HDD) 1114 (e.g., EIDE, SATA) - this internal hard disk drive 1114 may also be configured for external use within a suitable chassis , A magnetic floppy disk drive (FDD) 1116 (e.g., for reading from or writing to a removable diskette 1118), and an optical disk drive 1120 (e.g., a CD-ROM For reading disc 1122 or reading from or writing to other high capacity optical media such as DVD). The hard disk drive 1114, magnetic disk drive 1116 and optical disk drive 1120 are connected to the system bus 1108 by a hard disk drive interface 1124, a magnetic disk drive interface 1126 and an optical drive interface 1128, respectively. . The interface 1124 for external drive implementation includes at least one or both of Universal Serial Bus (USB) and IEEE 1394 interface technologies.

These drives and their associated computer-readable media provide non-volatile storage of data, data structures, computer-executable instructions, and the like. In the case of computer 1102, the drives and media correspond to storing any data in a suitable digital format. While the above description of computer readable media refers to HDDs, removable magnetic disks, and removable optical media such as CDs or DVDs, those skilled in the art will appreciate that other types of storage devices, such as a zip drive, magnetic cassette, flash memory card, Or the like may also be used in the exemplary operating environment and any such medium may include computer-executable instructions for carrying out the methods of the present invention.

A number of program modules may be stored in the drive and RAM 1112, including an operating system 1130, one or more application programs 1132, other program modules 1134, and program data 1136. All or a portion of the operating system, applications, modules, and / or data may also be cached in the RAM 1112. It will be appreciated that the present invention may be implemented in a variety of commercially available operating systems or combinations of operating systems.

A user may enter commands and information into the computer 1102 via one or more wired / wireless input devices, such as a keyboard 1138 and a pointing device such as a mouse 1140. [ Other input devices (not shown) may include a microphone, IR remote control, joystick, game pad, stylus pen, touch screen, etc. These and other input devices are often connected to the processing unit 1104 via an input device interface 1142 that is coupled to the system bus 1108, but may be a parallel port, an IEEE 1394 serial port, a game port, a USB port, an IR interface, ≪ / RTI > and so forth.

A monitor 1144 or other type of display device is also connected to the system bus 1108 via an interface, such as a video adapter 1146, In addition to the monitor 1144, the computer typically includes other peripheral output devices (not shown) such as speakers, printers,

Computer 1102 may operate in a networked environment using logical connections to one or more remote computers, such as remote computer (s) 1148, via wired and / or wireless communication. The remote computer (s) 1148 may be a workstation, a computing device computer, a router, a personal computer, a portable computer, a microprocessor-based entertainment device, a peer device or other conventional network node, But for the sake of simplicity, only memory storage device 1150 is shown. The logical connections depicted include a wired / wireless connection to a local area network (LAN) 1152 and / or a larger network, e.g., a wide area network (WAN) These LAN and WAN networking environments are commonplace in offices and corporations and facilitate enterprise-wide computer networks such as intranets, all of which can be connected to computer networks worldwide, for example the Internet.

When used in a LAN networking environment, the computer 1102 is connected to the local network 1152 via a wired and / or wireless communication network interface or adapter 1156. [ The adapter 1156 may facilitate wired or wireless communication to the LAN 1152 and the LAN 1152 also includes a wireless access point installed therein to communicate with the wireless adapter 1156. [ When used in a WAN networking environment, the computer 1102 may include a modem 1158, or may be connected to a communications computing device on the WAN 1154, or to establish communications over the WAN 1154 And other means. A modem 1158, which may be an internal or external and a wired or wireless device, is coupled to the system bus 1108 via a serial port interface 1142. In a networked environment, program modules described for the computer 1102, or portions thereof, may be stored in the remote memory / storage device 1150. It will be appreciated that the network connections shown are exemplary and other means of establishing a communication link between the computers may be used.

The computer 1102 may be any wireless device or entity that is deployed and operable in wireless communication, such as a printer, a scanner, a desktop and / or portable computer, a portable data assistant (PDA) Any equipment or place, and communication with the telephone. This includes at least Wi-Fi and Bluetooth wireless technology. Thus, the communication may be a predefined structure, such as in a conventional network, or simply an ad hoc communication between at least two devices.

Wi-Fi (Wireless Fidelity) allows you to connect to the Internet without wires. Wi-Fi is a wireless technology such as a cell phone that allows such devices, e.g., computers, to transmit and receive data indoors and outdoors, i. E. Anywhere within the coverage area of a base station. Wi-Fi networks use a wireless technology called IEEE 802.11 (a, b, g, etc.) to provide a secure, reliable, and high-speed wireless connection. Wi-Fi can be used to connect computers to each other, the Internet, and a wired network (using IEEE 802.3 or Ethernet). The Wi-Fi network may operate in unlicensed 2.4 and 5 GHz wireless bands, for example, at 11 Mbps (802.11a) or 54 Mbps (802.11b) data rates, or in products containing both bands have.

Those of ordinary skill in the art will understand that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced in the above description may include voltages, currents, electromagnetic waves, magnetic fields or particles, Particles or particles, or any combination thereof.

Those skilled in the art will appreciate that the various illustrative logical blocks, modules, processors, means, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be embodied directly in electronic hardware, (Which may be referred to herein as "software") or a combination of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the design constraints imposed on the particular application and the overall system. Those skilled in the art may implement the described functionality in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and / or engineering techniques. The term "article of manufacture" includes a computer program, carrier, or media accessible from any computer-readable device. For example, the computer-readable medium can be a magnetic storage device (e.g., a hard disk, a floppy disk, a magnetic strip, etc.), an optical disk (e.g., CD, DVD, etc.), a smart card, But are not limited to, devices (e. G., EEPROM, cards, sticks, key drives, etc.). The various storage media presented herein also include one or more devices and / or other machine-readable media for storing information.

It will be appreciated that the particular order or hierarchy of steps in the presented processes is an example of exemplary approaches. It will be appreciated that, based on design priorities, certain orders or hierarchies of steps in processes may be rearranged within the scope of the present invention. The appended method claims provide elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

The description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features presented herein.

Claims (11)

A smart mirror display device,
A camera unit for photographing a user;
A display unit for displaying image and beauty contents of a user photographed by the camera unit; And
And a control unit for recognizing the user's beauty state in the image of the user photographed by the camera unit and switching the sub-beauty content of the beauty content based at least in part on the recognized beauty state,
Wherein the beauty content comprises an image of a beauty creator providing information on a makeup method to a user and includes one or more sub-
Smart mirror display device. The method according to claim 1,
The control unit may further include a step of generating the at least one sub-beauty content by separating the images according to time units, face image change units based on makeup, makeup tools, or makeup skill units,
Smart mirror display device. The method according to claim 1,
Wherein the user's beauty state includes information related to whether the user has performed the makeup step included in the sub-beauty content,
The control unit recognizes the user's beauty state based on the image change value of the user's image and determines whether or not the user has performed the makeup step included in the sub-beauty content based on the recognized beauty state And when the user performs the makeup step included in the sub-beauty content, determines to display the next sub-
Smart mirror display device. The method according to claim 1,
Wherein the control unit is further configured to recognize the skin condition of the user in the image of the user photographed by the camera unit and to select the beauty content based at least in part on the recognized skin condition,
Smart mirror display device. The method according to claim 1,
Further comprising a user input for receiving an input from the user about the beauty goal of the user,
Wherein the control unit is further configured to select the beauty content corresponding to the beauty goal based on an input to the beauty goal input from the user,
Smart mirror display device. 6. The method of claim 5,
Wherein the beauty goal is a beauty goal based on at least one of a skin condition of the user, a beauty orientation point of the user, a social event the user wants to attend, and personal information of the user,
Smart mirror display device. The method according to claim 1,
Further comprising a skin condition recognition unit for acquiring information for allowing the control unit to recognize the skin condition of the user,
Smart mirror display device. The method according to claim 1,
Wherein the control unit recognizes each part of the face of the user in the image of the user photographed by the camera unit and determines whether or not the makeup step of the sub-
Smart mirror display device. The method according to claim 1,
The control unit may further store the image of the user photographed by the camera unit according to the makeup step of the user and determine whether the user's image is shared,
Smart mirror display device. A smart mirror display method performed in a smart mirror display device,
Capturing an image of a user;
Displaying video and beauty contents of a photographed user;
Recognizing the beauty state of the user on the photographed user's image; And
And switching the sub-beauty content of the beauty content based at least in part on the recognized beauty state,
Wherein the beauty content comprises an image of a beauty creater that provides the user with information about the makeup method,
A smart mirror display method performed in a smart mirror display device. 21. A computer program stored in a computer-readable storage medium including encoded instructions, the computer program being executable by one or more processors of a computing device to cause the one or more processors to: Said steps comprising:
Capturing an image of a user;
Displaying video and beauty contents of a photographed user;
Recognizing the beauty state of the user on the photographed user's image; And
And switching the sub-beauty content of the beauty content based at least in part on the recognized beauty state,
Wherein the beauty content comprises an image of a beauty creater that provides the user with information about the makeup method,
A computer program stored on a computer readable storage medium.

Images