KR102334622B1 - A method of controlling multimedia device and a multimedia device - Google Patents

Abstract

A multimedia device according to embodiments of the present invention includes a camera unit for generating first image data by photographing a user, a control unit for detecting data related to the user's face from the first image data, and a control unit for detecting data related to the user's face from the first image data and a display unit configured to display the first image data and a first component indicating a method for the user to apply makeup according to the makeup method data based on the data and the makeup method data.

Description

A method of controlling a multimedia device and a multimedia device {A method of controlling multimedia device and a multimedia device}

The present invention relates to a multimedia device control method and a multimedia device for providing a makeup method using a camera. Specifically, it relates to a system for photographing a user using a camera unit and providing a customized makeup method and feedback based thereon.

Recently, as interest and demand for multimedia devices based on smart phones and IoT are increasing, multimedia devices using a camera module (or a camera unit) are increasing. A user may be photographed using the camera module, and new data may be generated based on the photographed data.

A multimedia device using such a camera module may include a preset makeup on the user's face and output it to a display after photographing the user's face. However, in the case of such a configuration, the preset makeup is applied only to the user's face on the screen, and a method of actually implementing the overlaid makeup (or makeup) is not provided to the users. Therefore, there is a problem in that users who are unfamiliar with makeup or makeup cannot actually implement it on their faces even if they like the overlaid makeup. In addition, the multimedia device using such a camera module does not provide content that interacts with the user by using the front camera and the zoom function of the front camera.

Accordingly, in order to solve this problem, the present invention proposes a multimedia device control method providing a makeup method using a camera module and a multimedia device providing a makeup method.

In order to solve the above problems, the multimedia device according to the embodiments of the present invention provides a customized makeup method based on the photographed data by photographing the user's face using a camera module, thereby providing a user unfamiliar with makeup. The purpose is to provide people with the correct makeup method and to enhance the convenience of makeup.

In addition, in order to solve the above problems, the multimedia device according to embodiments of the present invention provides a customized makeup method with high accuracy to the user using a front camera including a zoom function, and performs makeup The purpose is to provide the correct makeup method to users and to enhance the convenience of makeup by providing components for interaction with the user.

In order to solve the above technical problem, a multimedia device according to embodiments of the present invention includes a camera unit generating first image data by photographing a user, and detecting data related to the user's face from the first image data. a control unit and a display unit configured to display the first image data and a first component indicating a method for the user to apply makeup according to the makeup method data based on a control unit and data related to the user's face and makeup method data can

Furthermore, the data related to the user's face may include information about the user's face shape and information about the user's skin tone, and the information about the user's skin tone is a pixel included in the first image data. It may be based on the brightness value of the pixels and the color value of the pixels.

In addition, the control unit further performs the step of retrieving one or more makeup method data and loading the determined makeup method data to determine the makeup method data, and the one or more makeup method data is stored It may be makeup method data stored by the department or makeup method data received from a server. In this case, the makeup method data is determined based on weather information, date information, and data related to the user's face, and the display unit processes the first image data based on the determined makeup method data It is possible to display the first processed image data.

Furthermore, the makeup method data is determined based on information on cosmetics received from the user, and the information on cosmetics is information based on image data on the cosmetics or information received from a server by a communication unit, and the The display unit may display second processed image data in which the first image data is processed based on the makeup method data and information on the cosmetics.

In addition, the camera unit may be a front camera, the multimedia device may further include an input unit for receiving an input signal from the user, in response to the input signal received from the user, the display unit to the user The makeup area of the first image data for the user may be enlarged and displayed, and the makeup area may be an area for a position where the user will apply makeup according to the makeup method.

In addition, the makeup method data may include first information indicating a concentration of makeup and second information indicating a location of makeup, wherein the first component is based on the first information and the second information. to include a guideline component for the user to apply makeup, and the multimedia device generates feedback data based on the makeup method data and second image data captured after the first image data is captured It may further include a feedback generating unit, the display unit may further display a second component related to the feedback data.

In this case, the feedback data may include first data indicating whether cosmetics used by the user are suitable based on chrominance and brightness of the user's face in the second image data; Comparing the first information with the values of pixels for the user's face in the image data, second data indicating whether the makeup concentration is appropriate, and the values of pixels for the user's face in the second image data; Comparing the second information may include third data indicating whether the position of the makeup is suitable, and when at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is not suitable, the display unit A third component for notifying the user that at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is not suitable may be further displayed.

In addition, the multimedia device may further include a communication unit for transmitting the first image data and the first component.

The multimedia device according to embodiments of the present invention may provide a correct makeup method to users and enhance makeup convenience by providing a front camera including a zoom function and components for interacting with the user. .

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

In addition, it is possible to provide convenience to people who broadcast makeup as content by using a camera for shooting a personal broadcast and a mirror for makeup as a single device. That is, by allowing people who broadcast makeup as content to use a display unit and a camera that provide a mirror-like function at the same time, it is possible to solve the inconvenience of editing image data.

The accompanying drawings represent embodiments of the invention and together with the description explain the principles of the invention.
1 is a block diagram illustrating a multimedia device according to embodiments of the present invention.
2 is a block diagram illustrating another embodiment of a multimedia device 200 according to embodiments of the present invention.
3 is a diagram illustrating processing of image data by the multimedia device 100 according to embodiments of the present invention.
4 is a flowchart of a method of controlling the multimedia device 100 according to embodiments of the present invention.
5 illustrates an embodiment of a method of extracting, by the multimedia device 100, information about a user's face from image data generated by photographing the user according to embodiments of the present invention.
6 illustrates an embodiment in which the multimedia device 100 according to embodiments of the present invention provides a guideline indicating a makeup (or makeup) method to the user to the user.
7 is a flowchart of a method for controlling the multimedia device 100 according to embodiments of the present invention.

Preferred embodiments of the present invention will be described in detail, examples of which are shown in the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The detailed description below with reference to the accompanying drawings is intended to describe preferred embodiments of the present invention rather than representing only embodiments that can be implemented according to the embodiments of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, details are included in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced without these details. Most terms used in the present invention are selected from general ones widely used in the art, but some terms are arbitrarily selected by the applicant and their meanings are described in detail in the following description as necessary. Accordingly, the present invention should be understood based on the intended meaning of the term rather than the simple name or meaning of the term. In addition, the following drawings and detailed description should not be construed as being limited only to the specifically described embodiments, but should be construed as including equivalents or substitutes to the embodiments described in the drawings and detailed description of the present invention.

1 is a block diagram illustrating a multimedia device 100 according to embodiments of the present invention.

Specifically, FIG. 1 is a multimedia view according to embodiments of the present invention for providing a user with a guide on a makeup method based on image data for the user and providing a makeup mode that provides feedback on the makeup performed by the user. An embodiment of the device is shown.

The multimedia device 100 according to embodiments of the present invention includes a camera unit 101 for generating image data for a user by photographing a user, and a user's face related to the user's face from the image data for the user generated from the above-described camera unit. A control unit 102 for detecting data, a display unit for displaying a first component indicating a method for a user to apply makeup according to the makeup method data based on data related to the user's face and makeup method data, and first image data (103) may be included.

The camera unit 101 may generate image data for the user by photographing the user. The camera unit 101 may output image data or a plurality of image data by photographing the user. The image data for the user may be moving picture data or image data. The camera unit 101 may transmit the output image data or a plurality of image data to the controller 102 according to embodiments of the present invention.

The camera unit 101 according to embodiments of the present invention may photograph the user's face, or may photograph a part of the body other than the face that is the subject of makeup. That is, the camera unit 101 may output image data or a plurality of image data by photographing the user's face or body part to be made-up.

The camera unit 101 according to embodiments of the present invention may be a front camera located in front of the multimedia device. In addition, the camera unit according to embodiments of the present invention may be a camera located on the side or rear side, not the front camera.

The controller 102 may receive image data or a plurality of image data from the camera unit 101 according to embodiments of the present invention. The controller 102 according to embodiments of the present invention may generate makeup method data based on the received image data or a plurality of image data. The makeup method data may mean information related to a method for a user to apply makeup (or makeup). In one embodiment, the makeup method data may refer to information on cosmetics for the user to apply makeup, and may include information on a facial area to be applied with makeup, a concentration of makeup, and the like when performing makeup. .

The controller 102 may determine makeup method data according to embodiments of the present invention in response to the user's input signal. That is, in response to the user's input signal, the controller 102 may determine a cosmetic for the user to apply makeup, and may determine an area and concentration for applying makeup to the user based on the determined cosmetic.

The controller 102 may receive the image data of the user from the camera unit 101 to determine the makeup method data, and detect the user's face shape and the user's skin tone. That is, the control unit 102 controls the user's facial shape from the image data, the user's skin tone information, the user's skin-related information, the location of the user's facial features, and Data about size can be extracted. The controller 102 may generate data or guideline data related to a makeup method for a user to apply makeup based on information extracted from image data of the user.

The display unit 103 may display the user's image data captured by the camera unit. The display unit according to embodiments of the present invention transforms the image data of the user photographed from the camera unit symmetrically to the left and right, and does not show the reflection in the mirror, not the point of view of the actual person, but shows the same image as the gaze of the photographer himself. The display may be performed or a part of the image data may be enlarged and displayed. In one embodiment, the display unit of the multimedia device according to embodiments of the present invention extracts a specific body part (eg, eyebrows or lips) included in the user's image data in real time to zoom the corresponding body part. ) can also be displayed.

The display unit 103 may display a guideline component for indicating how the user performs makeup according to the makeup method data generated by the controller. The display unit may display an image of the user generated by the camera unit. In addition, the display unit may perform display by zooming a partial area of the image of the user. Also, the display unit may display a feedback component indicating feedback data generated by the control unit (or a feedback generating unit to be described later).

The multimedia device according to the embodiments of the present invention is not limited to a device having a rectangular (or rectangular parallelepiped) shape as shown in FIG. 1 . For example, the multimedia device according to embodiments of the present invention may refer to a smart phone or a portable electronic device, and may be configured in the form of a home round mirror or picture frame that can be hung on a wall.

A multimedia device according to embodiments of the present invention includes: a camera unit generating first image data by photographing a user; a controller for detecting data related to the user's face from the first image data; and a display unit configured to display a first component indicating a method for the user to apply makeup according to the makeup method data and first image data based on the user's face-related data and makeup method data; includes

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

A multimedia device according to embodiments of the present invention may provide a customized makeup method service optimized to a user by using image data about the user. In addition, the multimedia device according to embodiments of the present invention may provide an accurate makeup method suitable for a user based on data related to the user's face.

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

2 is a block diagram illustrating another embodiment of a multimedia device 200 according to embodiments of the present invention.

The multimedia device 200 according to embodiments of the present invention includes a camera unit 201 , a control unit 202 , a display unit 203 , a communication unit 204 , a storage unit 205 , a feedback generation unit 206 , and an input unit. (207) may be included.

The camera unit 201 may generate image data for the user by photographing the user. The camera unit described in this drawing may refer to the camera unit 101 described above with reference to FIG. 1 . The camera unit 201 may transmit image data for the user generated by photographing the user to the storage unit 205 or the communication unit 204 .

The controller 202 may generate makeup method data based on the received image data or a plurality of image data. The control unit 202 described in this figure may refer to the control unit 102 described above in FIG. 1 . The control unit 202 may generate makeup method data or generate feedback data and transmit it to the communication unit 204 , the storage unit 205 , the feedback generation unit 206 , or the display unit 203 . A method of generating the feedback data will be described later.

The controller according to embodiments of the present invention may further perform the step of searching for one or more makeup method data and loading the determined makeup method data in order to determine the makeup method data, and the one or more makeup method data The method data may mean makeup method data stored by the storage unit or makeup method data received from a server.

The display unit 203 may display a guideline component related to makeup method data generated by the control unit. The display unit 203 described in this figure may refer to the display unit 103 described in FIG. 1 . The display unit 203 may receive data related to makeup method data from the control unit and display a guideline component for indicating how the user performs makeup. The display unit 203 may receive the feedback related data received from the feedback generator 206 and further display a feedback component related to the feedback data.

The communication unit 204 may refer to a module for transmitting or receiving a signal from a server. The communication unit of the multimedia device according to embodiments of the present invention may receive makeup method data or information on cosmetics from a server, or transmit makeup method data or information on cosmetics to the server. After the communication unit transmits the information on the query data received from the input 207 to the server, the communication unit may receive information on cosmetics corresponding to the information on the above-described query data from the server. In addition, the multimedia device may recognize a pattern in which the user determines cosmetics based on the query data received from the user, and may receive information on cosmetics from the server based on the user's pattern. In summary, the multimedia device according to the embodiments of the present invention may be a multimedia device that further includes a communication unit for transmitting the first image data and the first component.

In addition, the communication unit may transmit an image of the user to the server in order to provide a streaming service for the image of the user. That is, the communication unit may transmit the image data of the user photographed in real time to the server in real time.

The storage unit 205 may refer to a module for storing image data and the like for a user. The storage unit may store image data for a user generated by the camera unit. The storage unit may store data related to a makeup method and data indicating information about cosmetics. Also, the storage unit may store data related to a makeup method or guideline data according to information on cosmetics. The storage unit 205 may store data related to the feedback generated by the feedback generation unit 206 .

The feedback generator 206 may generate feedback data based on the makeup method data and the image data of the user. Specifically, the feedback generator may generate feedback data for when the user is applying makeup or has finished makeup. The feedback generator may transmit the generated feedback data to the display unit, the control unit, or the storage unit. Also, the feedback generator may be included in the controller 102 described with reference to FIG. 1 .

That is, the multimedia device according to the embodiments of the present invention may further include a feedback generator that generates feedback data based on the makeup method data and the second image data captured after the first image data is captured, and a display The unit may further display a second component related to the feedback data. In addition, when at least one of the cosmetics, the concentration of makeup, and the position of the makeup is not suitable for the display unit, the display unit further displays a third component for notifying the user that at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is not suitable. can do.

The input unit 207 may refer to a module for receiving a signal input from a user. The input unit may mean a sensor that detects a signal input from the user. The input unit may mean a voice sensor for recognizing a user's voice, a temperature sensor for detecting a body temperature of the user, a touch sensor for detecting a touch event (or gesture) from the user, and the like. The input unit may be a separate interface module (eg, a keypad) included in the multimedia device, or may be a touch screen integrated with the display unit.

In the multimedia device according to the embodiments of the present invention, the camera unit may be a front camera, the multimedia device may further include an input unit for receiving an input signal from the user, and in response to the input signal received from the user, the display unit The makeup area of the first image data for the user is enlarged and displayed, and in this case, the makeup area may mean an area for a position where the user will apply makeup according to a makeup method.

A multimedia device according to embodiments of the present invention may provide a customized makeup method service optimized to a user by using image data about the user. In addition, the multimedia device according to embodiments of the present invention may provide an accurate makeup method suitable for a user based on data related to the user's face.

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

3 is a diagram illustrating the transformation of image data by the multimedia device 100 according to embodiments of the present invention.

The multimedia device according to embodiments of the present invention may display the transformed image data for the user by transforming the image data for the user. The controller of the multimedia device may transform image data for the user. In this case, the transformed image data may be referred to as processed image data.

3A illustrates that the multimedia device 100 according to embodiments of the present invention transforms image data for a user according to a beauty mode. The controller of the multimedia device according to embodiments of the present invention may transform the image data based on information about the user's face, information about the user's skin tone, and the like from the image data of the user. In this case, the multimedia device may transform the image data for the user based on the makeup method data determined by the controller. The display unit according to embodiments of the present invention may display image data (or processed image data) of a user who is transformed according to makeup beauty.

3B illustrates that the multimedia device 100 according to embodiments of the present invention processes image data for a user according to an emoji mode. The controller of the multimedia device according to the embodiments of the present invention may provide a fun function for adding an emoji to image data based on information on the face of the user, information on the skin tone of the user, etc. from the image data on the user. can In this case, the emoji may be determined based on a signal input from the user, or may be determined based on information about the user's face, information about the user's skin tone, and the like. As an embodiment, the emoji may mean animal ears or sunglasses on the user's face in image data for the user.

3C illustrates that the multimedia device 100 according to embodiments of the present invention processes image data for a user according to an avatar mode. The controller of the multimedia device according to embodiments of the present invention may generate avatar image data by processing the image data based on information about the user's face, information about the user's skin tone, etc. from the image data of the user. In this case, the avatar image data may be determined based on a signal input from the user, or may be determined based on information about the user's face, information about the user's skin tone, and the like.

In addition to FIGS. 3(a) to 3(b), the multimedia device according to embodiments of the present invention may transform and display an image of a user. In one embodiment, the multimedia device can display the image data for the user (or the photographer himself) photographed from the front camera by supporting the left-right symmetry function, and can be displayed by symmetrically deforming the image data for the user by providing a zoom function. It is also possible to display by zooming a part of the . The multimedia device according to embodiments of the present invention supports the left-right symmetry function, so that it is possible to provide an image identical to the gaze of the photographer himself, rather than showing the reflection in the mirror rather than the actual point of view.

In addition to the beauty mode, emoji mode, and avatar mode described above, the multimedia device according to embodiments of the present invention may support a mode that can be helpful in real life. The multimedia device according to embodiments of the present invention may provide a makeup mode that provides a user with a guide on a makeup method based on image data for the user and provides feedback on the makeup performed by the user. That is, the multimedia device according to the embodiments of the present invention may display the first image data by further including the decorative image data or the decorative image data by the display unit. An embodiment of a specific operation process for the makeup mode will be described in detail with reference to FIG. 4 .

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

In addition, it is possible to provide convenience to people who broadcast makeup as content by using a camera for shooting a personal broadcast and a mirror for makeup as a single device. That is, by allowing people who broadcast makeup as content to use a display unit and a camera that provide a mirror-like function at the same time, it is possible to solve the inconvenience of editing image data.

4 is a flowchart of a method of controlling the multimedia device 100 according to embodiments of the present invention.

Specifically, FIG. 4 is an embodiment of the present invention for providing a method of performing makeup (or makeup) to a user based on image data for the user and providing feedback on the makeup (or makeup) performed by the user. It relates to a control method of the multimedia device 100 according to the above.

First, the multimedia device 100 according to embodiments of the present invention may generate image data for the user by photographing the user by the camera unit. As described above, the image data may include image data or video data.

The multimedia device 100 according to embodiments of the present invention may detect the shape of the user's face from the generated image data of the user (S400a). The multimedia device 100 may generate data related to the shape of the user's face from the image data of the user. The data related to the shape of the user's face includes data about the outline of the user's face, data related to the eyebrows on the user's face (eg, the size of the eyebrows, the shape of the eyebrows, the position of the eyebrows or the color of the eyebrows, etc.); Data related to the nose on the user's face (eg nose size, height of the nose, thickness of the nose, etc.), data related to the cheekbones on the user's face (eg size or position of the cheeks, etc.) ), data related to the mouth on the user's face (eg, thickness of lips, color of lips or shape of the corners of the mouth, etc.), and data related to other special aspects of the user's face (eg, presence of dimples, child presence or absence of flesh or presence of dots) may be included.

In addition, the multimedia device according to embodiments of the present invention may generate data related to the shape of the user's face from a plurality of image data (or image data). In one embodiment, based on image data corresponding to when the user does not smile and the image data corresponding to when he smiles, the difference between when the user does not smile and when the user smiles is calculated to generate data related to the cheekbones on the user's face. can As an embodiment, the multimedia device according to embodiments of the present invention may generate data about the user's face based on image data (or image data) corresponding to various emotions of the user. As another embodiment, data on the user's face may be generated based on image data corresponding to the side view or back view of the user's face.

The multimedia device 100 according to embodiments of the present invention may detect the skin tone of the user's face from the generated image data for the user (S400b). The multimedia device 100 may generate data related to the skin tone of the user's face from the image data of the user. The multimedia device 100 may detect a skin tone based on pixel values included in image data for the user (or images included in the image data).

As an embodiment, the user's skin tone may be detected using the above-described brightness value (Y) of the pixel. In this case, the user's skin tone may be classified into pale skin or dark skin according to the brightness value of the pixel. In another embodiment, the skin tone may be detected using the color (UV) value of the aforementioned pixel. Specifically, it is possible to detect whether there are many red tones or many yellow tones with respect to the user's face.

The multimedia device 100 may generate data about the user's skin tone for each area of the user's face, based on the image data of the user. As an embodiment, data on a skin tone may be generated for each of the forehead region, the cheek region, and the lip region included in the user's face.

That is, the data related to the user's face may include information about the user's face shape and information about the user's skin tone, and the information about the user's skin tone includes the brightness values of pixels and the pixels included in the first image data. It can be based on color values.

The multimedia device 100 according to embodiments of the present invention may determine cosmetics for providing a makeup (or makeup) method to a user.

The multimedia device 100 according to embodiments of the present invention may inquire whether or not to add cosmetics and the cosmetics to be added from the user ( S401 ). The multimedia device may receive information about cosmetics from a user or a server. The multimedia device may store the received cosmetic information in the storage unit (S402).

The multimedia device may receive information about cosmetics from the user through the input unit 207 . In this case, the input unit may be a separate interface module included in the multimedia device, or may be a touch screen integrated with the display unit.

The cosmetic information received from the user may mean text data related to the cosmetic product. Text data related to cosmetics may include the name of the cosmetic product, the manufacturer of the cosmetic product, and the ingredients and ingredients included in the cosmetic product. Also, information on cosmetics received from the user may mean image data related to cosmetics. The image data related to cosmetics may mean image data including images representing cosmetics or image data including names of cosmetics. Information about cosmetics may be extracted from image data about cosmetics. Also, information about cosmetics received from the user may include voice data related to cosmetics. In one embodiment, when the user's cosmetics are photographed by the camera unit included in the multimedia device, information on the cosmetics owned by the user may be extracted based on image data of the photographed cosmetics.

The multimedia device may receive information about cosmetics from the server by the communication unit. In an embodiment, the information on cosmetics may include information on recently popular cosmetics. In addition, the multimedia device may receive query data for retrieving information about cosmetics from the user, and after transmitting the information on the query data received from the user to the server, You may also receive information about cosmetics. In addition, the multimedia device may recognize a pattern in which the user determines cosmetics based on the query data received from the user, and may receive information on cosmetics from the server based on the user's pattern.

In the multimedia device, when a user uses the multimedia device for the first time (or when the multimedia device is initialized), the user may register information on cosmetics owned by the user and store the information in the storage unit (or server). Thereafter, the user may additionally register the cosmetics purchased by the user and store it in the storage unit (or server).

The multimedia device 100 according to embodiments of the present invention may determine a makeup method (or data related to a makeup method).

The multimedia device 100 according to embodiments of the present invention may receive an input signal related to a makeup method received from a user and retrieve makeup method data (S403). The multimedia device according to embodiments of the present invention provides makeup method data, information about the user's face shape, information about the user's skin tone, information about points to be noted in relation to the user's skin, and the user's face can be searched based on data about the location and size of the features of As an embodiment, when a user searches for a makeup method, the multimedia device 100 may provide a makeup method suitable for the user by providing a filter function. The filter function refers to conditions related to the above-described information about the user's facial shape, information about the user's skin tone, information about points to be aware of in relation to the user's skin, data about the location and size of the user's facial features, etc. It may mean a function for searching for a makeup method that satisfies In this case, the multimedia device according to embodiments of the present invention may recommend to the user cosmetics for performing a makeup method suitable for a corresponding characteristic or condition, or may inquire about a purchase intention. The multimedia device according to embodiments of the present invention may further display a component for querying a purchase intention.

For example, if information about a round face, red skin tone, prominent cheekbones, and thin lips are extracted as information about the user's face, it is based on data related to a makeup method suitable for the characteristic or condition. to perform a search.

In addition, the multimedia device may generate processed image data by processing the image data of the user based on the found data related to the makeup method. The processed image data may refer to image data for an expected result when makeup is performed with data related to a makeup method searched by a user. In this case, the image data includes information about the user's facial shape, information about the user's skin tone, information about points to be paid attention to in relation to the user's skin, and data related to the location and size of the user's facial features. It may be processed by modifying the color or darkening of the cosmetic based on the like.

The multimedia device 100 may load data related to the makeup method when the user selects or searches for a makeup method stored in the storage unit based on an input signal related to the makeup method received from the user ( S404a).

In this case, the storage unit may include tag information about the makeup method related to the makeup method. The tag information may mean information related to a corresponding makeup method. In an embodiment, the data related to the first makeup method may include data on a weather (or season) suitable for the first makeup method, an anniversary (eg, makeup suitable for a graduation ceremony, makeup method suitable for a birthday) suitable for the first makeup method. , data on a makeup method suitable for Halloween or a makeup method suitable for Christmas). As another embodiment of the tag information, the tag information may include favorite information indicating the number of times the user has used the corresponding makeup method and whether the user has separately classified the makeup method for frequent use.

When the user searches for a makeup method other than the makeup method stored in the storage unit, data related to a new makeup method may be received from the user. The multimedia device 100 may load data related to a new makeup method received from the user (S404b). In another embodiment, when the user searches for a makeup method other than the makeup method stored in the storage unit, the multimedia device 100 receives and loads data related to another makeup method searched by the user in a way to answer a query to the server can do.

Specifically, when receiving another makeup method not stored in the storage from the user, the multimedia device 100 may generate query data to receive data related to the other makeup method from the server. The multimedia device may transmit the generated query data to the server by using the communication unit. Thereafter, the multimedia device may receive data related to the other makeup method described above, corresponding to the transmitted query data. When data related to another makeup method is received, data related to the corresponding makeup method may be loaded.

Also, the multimedia device may recommend a makeup method to the user based on a recommendation algorithm included in the multimedia device or recommendation data received from a server.

That is, the control unit of the multimedia device according to the embodiments of the present invention may further perform the step of searching for one or more makeup method data and loading the determined makeup method data in order to determine the makeup method data, The one or more makeup method data may mean makeup method data stored by the storage unit or makeup method data received from a server.

The multimedia device 100 according to embodiments of the present invention may provide an enlargement function for enlarging the user's makeup area in order to provide the user with a makeup (or makeup) method ( S405 ). Specifically, the multimedia device 100 may enlarge and display a part of image data (or image data) for the user. In this case, the camera unit for capturing image data for the user may be a front camera. That is, the user may become a photographer and view the image data of the user while looking at the front of the multimedia device, and may view a part of the image data of the user by zooming.

In this case, a part of the image data to be enlarged and displayed may mean an area where the user should apply makeup. The area where the user should apply makeup may be determined based on data related to the above-described makeup method. The multimedia device 100 extracts and displays in real time the area to be put on makeup from the above-described image data for the user, so that only the area to be put on makeup is displayed to the user.

The enlargement function may be performed based on a signal (eg, a gesture of the touch screen) input from the user by the input unit.

In one embodiment, when the user applies makeup to the user's skin, the user's makeup area may be the user's face. That is, the multimedia device according to embodiments of the present invention may extract an area corresponding to the user's face from among the image data for the user, enlarge and display the extracted area.

As another embodiment, when the user puts on a body part (eg, eyes, nose, or mouth) on the user's face, the user's makeup area may mean an area indicating the corresponding body part.

The multimedia device 100 according to embodiments of the present invention may provide a guideline indicating a makeup (or makeup) method to the user (S406).

Specifically, the multimedia device may generate guideline data indicating a makeup (or makeup) method to the user, and may display a guideline component indicating the guideline data. In this case, guideline data indicating a makeup (or makeup) method to the user may be based on data related to the above-described makeup method or information on the above-described cosmetic.

The guideline data may include information on the cosmetics to be used by the user, the color of the cosmetics, the thickness (or concentration) of the cosmetics, the location to apply the cosmetics, points to be aware of when performing makeup, and how to use the cosmetics correctly. . Information on the color of the cosmetic or the information on the darkness of the cosmetic may be determined based on the above-described information on the cosmetic.

The guideline component may mean a component displayed by the display unit based on guideline data. The guideline component may include a component indicating a location where the user will apply cosmetics, and may be a translucent image of the area to which the cosmetics are to be applied, and a line (or dashed-dotted line) indicating the outside of the area where the cosmetics will be applied. Alternatively, it may mean an arrow component indicating an area on which cosmetics are to be applied.

The multimedia device 100 according to embodiments of the present invention may provide feedback on the makeup performed by the user ( S407 ). When the user finishes makeup by the feedback generator, the multimedia device may generate feedback data for this and display a feedback component indicating the feedback data. When the user is applying makeup by the feedback generator, the multimedia device may generate feedback data in real time and display a feedback component indicating the feedback data.

In order to generate feedback data, the multimedia device according to embodiments of the present invention may capture image data of a user who has completed or is applying makeup. In this case, image data of a user who has completed or is applying makeup may be referred to as 'after image data' or 'second image data' for the user. After image data (or second image data) for the user may be captured by the camera unit according to embodiments of the present invention.

The generated feedback data may include first data indicating whether cosmetics used by the user are suitable. In this case, the first data may be generated based on chrominance and brightness of the user's face included in the after image data of the user. The color difference with respect to the user's face may be determined according to a value (ie, UV value) corresponding to the UV coordinates of pixels included in the after image data for the user. Also, the brightness of the user's face may be determined according to a value (ie, a Y value) corresponding to the Y coordinate of a pixel included in the after image data for the user.

The generated feedback data may include second data indicating whether the concentration of the makeup performed by the user is appropriate. The second data may be data generated by comparing the values of pixels on the user's face included in the after image data for the user with the above-described first information.

The generated feedback data may include third data indicating whether the location of the makeup performed by the user is appropriate. The third data may be data generated by comparing the values of pixels on the user's face included in the after image data for the user with the second information.

When at least one of the cosmetics, the makeup concentration, and the makeup position is not suitable, the display unit may further display a feedback component to inform the user that at least one of the cosmetics, the makeup concentration, and the makeup position is not suitable. Whether at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is suitable may be determined based on the above-described first data, the above-described second data, or the above-mentioned third data.

As an embodiment, when the area where the user has applied makeup is not included in the area to apply the cosmetics provided in the guideline component, the multimedia device has an incorrect position to apply the cosmetics to the user based on the above-described third data (that is, , a feedback component may be further displayed in order to inform (when the cosmetic application location is different) when it deviates from the guideline. Also, the feedback component may further provide a correction direction to the user so that the user can correct the makeup performed by the user. That is, the multimedia device according to embodiments of the present invention may further display a feedback component so that the user can be corrected by notifying the user when the color, density, location, etc. of cosmetics are different.

The multimedia device according to embodiments of the present invention may provide a correct makeup method to users and enhance makeup convenience by providing a front camera including a zoom function and components for interacting with the user. .

In the multimedia device according to the embodiments of the present invention, the data related to the user's face includes information about the user's face shape and information about the user's skin tone, and the information about the user's skin tone is the first image data (that is, , image data for a user) may be based on a brightness value of pixels and a color value of the pixels.

At this time, the control unit of the multimedia device according to the embodiments of the present invention may further perform the step of searching for one or more makeup method data and loading the determined makeup method data in order to determine the makeup method data, , In this case, the one or more makeup method data may mean makeup method data stored by the storage unit or makeup method data received from a server. In addition, the makeup method data may be determined based on weather information, date information, and data related to the user's face, and in this case, the display unit is processed (or modified) based on the makeup method data in which the first image data is determined. ) can display the first processed image data.

In the multimedia device according to the embodiments of the present invention, the makeup method data may be determined based on information on cosmetics received from the user, and the information on the cosmetics is information based on image data on the cosmetics or from the server by the communication unit. It may be received information, and the display unit may display second processed image data in which the first image data is processed based on makeup method data and information on cosmetics.

In addition, the camera unit according to embodiments of the present invention may be a front camera, and the multimedia device according to embodiments of the present invention may further include an input unit for receiving an input signal from a user, and the input signal received from the user Correspondingly, the display unit may enlarge and display the makeup area of the first image data for the user, and in this case, the makeup area may mean an area for a position where the user will apply makeup according to a makeup method.

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

In addition, it is possible to provide convenience to people who broadcast makeup as content by using a camera for shooting a personal broadcast and a mirror for makeup as a single device. That is, by allowing people who broadcast makeup as content to use a display unit and a camera that provide a mirror-like function at the same time, it is possible to solve the inconvenience of editing image data.

5 illustrates an embodiment of a method of extracting, by the multimedia device 100, information about a user's face from image data generated by photographing the user according to embodiments of the present invention.

Specifically, FIG. 5 illustrates a method of extracting, by a multimedia device, information related to a user's face based on image data of the user according to embodiments of the present invention.

The multimedia device according to embodiments of the present invention may detect the shape of the user's face ( 500 ). The shape of the face may refer to the outside of the user's face. The multimedia device according to the embodiments of the present invention may extract information indicating the outline of the face based on the image data of the user. As an embodiment, the outer edge of the user's face may be configured in a polygonal shape, and coordinates corresponding to each vertex may be stored. As another embodiment, the user's face may be stored as a three-dimensional shape in the form of a polyhedron.

The multimedia device according to embodiments of the present invention may detect a body part on the user's face included in the image data for the user and store it in the form of a plurality of points 500 - 1 . In other words, the coordinates of a plurality of vertices (or a plurality of points, 500-1) constituting the polyhedron may be extracted and stored in order to store the outlines of the body parts or components on the user's face in the form of a polyhedron. The multimedia device according to embodiments of the present invention may store information indicating an identifier for each point, and may store it in correspondence with a body part of the user's face. For example, the multimedia device according to embodiments of the present invention may store information that in this figure, points corresponding to points 74 to 92 are included with respect to a body part corresponding to the outside of the user's nose. . In addition, the multimedia device according to embodiments of the present invention may store information that a portion corresponding to the right eyebrow is composed of points corresponding to points 50 to 66.

In this case, the data related to the shape of the user's face includes data about the outer edge of the user's face, data related to the eyebrows on the user's face (eg, the size of the eyebrows, the shape of the eyebrows, the position of the eyebrows, or the color of the eyebrows) etc.), data related to the nose on the user's face (eg, nose size, height of the nose, thickness of the nose, etc.), data related to the cheekbones on the user's face (eg size or cheekbones) location of the user's face), data relating to the mouth on the user's face (e.g., the thickness of the lips, the color of the lips or the shape of the corners of the mouth, etc.), and data relating to other special aspects of the user's face (e.g. presence or absence, the presence or absence of feces, or the presence or absence of dots) may be included.

The multimedia device according to embodiments of the present invention may detect a static body part on the user's face ( 501 ). A static body part may mean a part on the user's face included in the image data about the user, which does not move or has a minute movement. For example, there may be a user's eyebrows, a user's ears, and a user's nose bridge. A multimedia device according to embodiments of the present invention detects a static body part of a user based on image data (or one image data) of the user, and obtains information on the location, shape, color, etc. of the static body part. can be extracted.

The multimedia device according to embodiments of the present invention may detect a dynamic body part on the user's face ( 502 ). The dynamic body part may mean a part on the user's face included in the image data about the user that has a large movement or a large degree of change according to the user's facial expression. For example, there may be a user's lips, a user's cheeks, and a user's eyes. The multimedia device according to embodiments of the present invention may detect a static body part of a user based on image data about the user and extract information such as a position, shape, color, etc. of the static body part. In this case, the multimedia device according to embodiments of the present invention may extract the above-described information based on one or more image data (or image data).

In one embodiment, based on the image data corresponding to when the user does not smile and the image data corresponding to when he smiles, the difference between when the user does not smile and when the user smiles is calculated to obtain data related to lips or eyes on the user's face. can create As an embodiment, the multimedia device according to embodiments of the present invention may generate data about the user's face based on image data (or image data) corresponding to various emotions of the user. As another embodiment, data on the user's face may be generated based on image data corresponding to the side view or back view of the user's face.

The multimedia device according to embodiments of the present invention may detect a skin tone of the user's face ( S503 ). The multimedia device may generate data related to the skin tone of the user's face from the image data of the user. The multimedia device may detect a skin tone based on pixel values included in image data for the user (or images included in the image data).

As an embodiment, the user's skin tone may be detected using the above-described brightness value (Y) of the pixel. In this case, the user's skin tone may be classified into pale skin or dark skin according to the brightness value of the pixel. In another embodiment, the skin tone may be detected using the color (UV) value of the aforementioned pixel. Specifically, it is possible to detect whether there are many red tones or many yellow tones with respect to the user's face.

The multimedia device may generate data about the user's skin tone for each area of the user's face, based on the image data of the user. As an embodiment, data on a skin tone may be generated for each of the forehead region, the cheek region, and the lip region included in the user's face.

The multimedia device may detect a skin tone based on pixel values included in image data for the user (or images included in the image data). The multimedia device may detect the user's skin tone by using the above-described value related to the brightness of the pixel (eg, the Y value of the pixel). In this case, the user's skin tone may be classified into pale skin or dark skin according to a value related to the brightness of the pixel. In another embodiment, the skin tone may be detected using a value (eg, UV value) related to the above-described color of the pixel. Specifically, it is possible to detect whether there are many red tones or many yellow tones with respect to the user's face.

The multimedia device may generate data about the user's skin tone for each area of the user's face, based on the image data of the user. As an embodiment, data on a skin tone may be generated for each of the forehead region, the cheek region, and the lip region included in the user's face.

That is, the data related to the user's face may include information about the user's face shape and information about the user's skin tone, and the information about the user's skin tone includes the brightness values of pixels and the pixels included in the first image data. It can be based on color values.

A multimedia device according to embodiments of the present invention may provide a customized makeup method service optimized to a user by using image data about the user. In addition, the multimedia device according to embodiments of the present invention may provide an accurate makeup method suitable for a user based on data related to the user's face.

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

6 illustrates an embodiment in which the multimedia device 100 according to embodiments of the present invention provides a guideline indicating a makeup (or makeup) method to the user to the user.

Specifically, FIG. 6 illustrates a feedback component that displays a guideline component indicating guideline data indicating a makeup (or makeup) method to a user, and a feedback component therefor, in the multimedia device.

The guideline data may include information on the cosmetics to be used by the user, the color of the cosmetics, the thickness (or concentration) of the cosmetics, the location to apply the cosmetics, points to be aware of when performing makeup, and how to use the cosmetics correctly. . Information on the color of the cosmetic or the information on the darkness of the cosmetic may be determined based on the above-described information on the cosmetic.

The guideline component may mean a component displayed by the display unit based on guideline data.

6( a ) shows an embodiment of a guideline for a user to apply makeup on a region near the user's eyes. Specifically, FIG. 6( a ) shows that the multimedia device according to embodiments of the present invention displays a guideline component related to an eye makeup method to a user to apply makeup on the user's eyes.

The multimedia device according to embodiments of the present invention may detect the region 600a or the eye 600a-1 corresponding to the user's eye. Thereafter, the multimedia device according to embodiments of the present invention may display the guideline component 600a - 2 for eye makeup based on the makeup method-related data or information on cosmetics. The guideline component may include a component 600a - 2 indicating a position where the user applies cosmetics near the eye area, and in an embodiment, the guideline component may be a translucent image of the area where the cosmetics are to be applied.

6( b ) shows an embodiment of a guideline for a user to apply makeup on a region near the user's eyebrows.

The multimedia device according to embodiments of the present invention may detect a region 600b or an eye 600b-1 corresponding to the user's eyebrows. Thereafter, the multimedia device according to embodiments of the present invention may display the guideline component 600b - 2 for eyebrow makeup based on the makeup method-related data or information on cosmetics. The guideline component may include a component 600a - 2 indicating a position where the user applies cosmetics near the eyebrow region, and in an embodiment, the guideline component includes a dotted line (or dashed-dotted line) indicating the outside of the area to which the cosmetic is to be applied. It may be an image of the form.

6( c ) is a flowchart in which a user provides guidelines for applying makeup on all or part of a user's face.

The multimedia device according to embodiments of the present invention may detect a region 600c corresponding to a user's face or a part 600b-1 thereof for skin makeup. Thereafter, the multimedia device according to embodiments of the present invention may display the guideline component 600c - 2 for skin makeup based on the makeup method-related data or information on cosmetics. At this time, when the user does not put on makeup according to the guideline corresponding to the guideline component (600c-3), the feedback component is provided so that the user can correctly perform makeup according to the guideline corresponding to the guideline component. Can be displayed (600c-4).

The guideline component may display information on cosmetics required for the user to perform corresponding makeup (600c-5). In addition, the guideline component is a guideline for correctly using the corresponding cosmetic product, and information on a method of holding the corresponding cosmetic product, a holding position, and the like may be displayed to the user (600c-6).

In other words, the multimedia device according to embodiments of the present invention may generate image data for the user by photographing the user. The multimedia device according to embodiments of the present invention may detect or generate data related to the user's face from the image data for the user. Facial data for the user may be detected according to FIG. 5 . The multimedia device according to embodiments of the present invention may display a makeup method search component to the user to search for a makeup method. The multimedia device according to the embodiments of the present invention may receive an input signal for cosmetics or a makeup method from a user by means of an input unit, and respond to an input signal related to cosmetics or a makeup method received from the user to receive a cosmetic product or a makeup method. data can be searched for. In response to an input signal received from a user, the multimedia device according to embodiments of the present invention may further display a guideline component along with image data for the user based on information on cosmetics and information on a makeup method. .

The multimedia device according to embodiments of the present invention may further capture image data of the user while the user is applying makeup (or after finishing makeup). Image data captured by the camera unit during or after makeup is performed may be referred to as 'after image data' or 'second image data'. The multimedia device according to embodiments of the present invention may further display a feedback component based on the after-image data (second image data) captured by the camera unit, information on cosmetics, and data on a makeup method.

The multimedia device according to embodiments of the present invention may display a guideline component and a feedback component based on a user's input signal. When the user applies makeup, the multimedia device according to the embodiments of the present invention may display an enlarged area corresponding to a body part on which the user applies makeup in image data for the user based on the user's input signal. have. Alternatively, the multimedia device according to embodiments of the present invention may enlarge and display a portion of image data for the user based on the user's gesture.

The feedback component may further provide a correction direction to the user to correct the makeup performed by the user. That is, the multimedia device according to embodiments of the present invention may further display a feedback component so that the user can be corrected by notifying the user when the color, density, location, etc. of cosmetics are different.

The multimedia device according to embodiments of the present invention may further display a component indicating information about cosmetics and a component corresponding to data on a makeup method in response to a user's input signal. The multimedia device according to embodiments of the present invention may display a component indicating information on cosmetics together with a component for inquiring whether to purchase cosmetics.

In the multimedia device according to the embodiments of the present invention, the makeup method data may be determined based on weather information, date information, and data related to a user's face, and the display unit may include a makeup method in which the first image data is determined. The first processed image data processed based on the data may be displayed.

In the multimedia device according to the embodiments of the present invention, the makeup method data may include first information for indicating a concentration of makeup and second information for indicating a position of makeup, and the first component includes the first information and a guideline component for a user to apply makeup based on the second information, wherein the multimedia device according to embodiments of the present invention captures the makeup method data and the first image data after photographing It may further include a feedback generator for generating feedback data based on the second image data. Also, the display unit may further display a second component related to the feedback data.

At this time, the feedback data includes first data indicating whether cosmetics used by the user are suitable based on chrominance and brightness of the user's face in the second image data, and the user's in the second image data. The position of the makeup is determined by comparing the values of pixels for the face with the first information to compare the second data and the second information indicating whether the makeup concentration is appropriate and the values of pixels for the user's face in the second image data. Third data indicating whether it is suitable may be included. In addition, when at least one of the cosmetics, the makeup concentration, and the makeup position is not suitable, the display unit may further display a third component for notifying the user that at least one of the cosmetics, the makeup concentration, and the makeup position is not suitable. can

A multimedia device according to embodiments of the present invention may provide a customized makeup method service optimized to a user by using image data about the user. In addition, the multimedia device according to embodiments of the present invention may provide an accurate makeup method suitable for a user based on data related to the user's face.

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

7 is a flowchart of a method for controlling the multimedia device 100 according to embodiments of the present invention.

The method of controlling the multimedia device 100 according to embodiments of the present invention may generate first image data by photographing a user by a camera unit (S700). The first image data is image data of a user, and may mean image data of a corresponding user before the user applies makeup according to the makeup method provided by the multimedia device according to embodiments of the present invention. In addition, the camera unit according to embodiments of the present invention may be a front camera.

The method for controlling the multimedia device 100 according to embodiments of the present invention may detect data related to the user's face from the first image data (S701). The data related to the user's face includes information about the user's face shape, information about the user's skin tone, information about points to be aware of in relation to the user's skin, data about the location and size of the user's facial features, etc. may include A method of detecting data related to a user's face is the same as described above with reference to FIGS. 1 to 6 .

In the method of controlling the multimedia device 100 according to embodiments of the present invention, a first component indicating a method for a user to apply makeup according to the makeup method data and first image data may be displayed by the display unit (S702). ). The first component may refer to the above-described guideline component. A process in which the multimedia device generates guideline data and displays guideline components according to embodiments of the present invention is as described above with reference to FIGS. 1 to 6 . In addition, the multimedia device according to embodiments of the present invention may display all of the above-described first image data, or may display a partial area of the first image data by zooming.

A multimedia device according to embodiments of the present invention may provide a customized makeup method service optimized to a user by using image data about the user. In addition, the multimedia device according to embodiments of the present invention may provide an accurate makeup method suitable for a user based on data related to the user's face.

The multimedia device according to embodiments of the present invention can provide a correct makeup method to users unfamiliar with makeup and enhance makeup convenience.

In this specification, “/” and “,” may be interpreted as “and/or”. For example, the expression “A/B” may mean “A and/or B”. Furthermore, “A, B” may mean “A and/or B”. Furthermore, “A/B/C” may mean “at least one of A, B and/or C”.

Furthermore, in this specification, “or” may be construed as “and/or”. For example, “A or B” may mean 1) only A, 2) only B, and/or 3) A and B. In other words, in this specification, “or” may mean “additionally or alternatively”.

A multimedia device, a method for controlling a multimedia device, and/or modules/blocks existing therein according to embodiments of the present invention may perform functions corresponding to the above description.

The components of the multimedia device according to the embodiments of the present invention described with reference to FIGS. 1 to 7 may each be composed of separate hardware (eg, a chip, a hardware circuit, a communicable device, etc.) or may be composed of a single piece of hardware. may be Also, at least one of the multimedia devices according to the embodiments of the present invention may be configured with one or more processors capable of executing a program.

In addition, although the specification has been described with reference to each accompanying drawing, it is also possible to design a new embodiment by merging the embodiments shown in the accompanying drawings with each other. In addition, when a computer-readable recording medium in which a program for executing the above-described embodiments is recorded is designed according to the needs of those skilled in the art, it falls within the scope of the claims and equivalents thereof.

That is, although the present specification has been described with reference to the accompanying drawings, this is only an embodiment and is not limited to a specific embodiment, and various contents that can be modified by those of ordinary skill in the art to which the present invention belongs are also claimed. It belongs to the scope of rights according to In addition, such modifications should not be separately understood from the spirit of the present invention.

Executable instructions for performing a multimedia device or a method of controlling a multimedia device according to embodiments of the present invention are non-transitory CRM or other computer program products configured to be executed by one or more processors. may be stored, or may be stored in a temporary CRM or other computer program product configured for execution by one or more processors. In addition, the memory according to the embodiments of the present invention may be used as a concept including not only a volatile memory (eg, RAM, etc.) but also a non-volatile memory, a flash memory, a PROM, and the like.

100, 201: camera unit
101, 202: control unit
102, 203: display unit
204: communication department
205: storage
206: feedback generator
207: input unit

Claims (20)

The user acquires reference image data by photographing the shape of the face in a state in which the user is not smiling, and obtains smile image data by photographing the shape of the face in the state in which the user is smiling. Camera unit for inverting left-right symmetry;
a control unit configured to detect data related to the user's face from the reference image data and the smile image data in which the left and right symmetry is inverted; and
Based on the data related to the user's face and the makeup method data, a first component indicating how the user performs makeup according to the makeup method data, and the reference image data and smile image data in which the left-right symmetry is inverted are displayed a display unit;
an input unit for receiving an external signal for enlarging or reducing at least one of the reference image data and the smile image data displayed on the display unit; and
a memory for storing makeup-related data including the makeup method data;
including,
The control unit is
comparing the reference image data and the smiley image data to calculate a deviation between the reference image data and the smiley image data;
generate data related to the user's eyebrows, data related to the nose, data related to the cheeks, data related to the mouth, and other data as data related to the user's face based on the deviation, wherein the other data is the data related to the user Including information about the dimple of the user, information about the user's paws, and information about the user's point-
Detecting a first part of the user's face in which the deviation is larger than a value stored in the memory and a second part in which the deviation is smaller than a value stored in advance,
create a first component providing for the first portion a concentration of makeup as a first concentration and for the second portion a concentration of makeup as a second concentration;
The display unit,
When the input unit receives an external signal, the display by enlarging or reducing a portion of at least one of the left-right symmetry inverted reference image data and the left-right symmetry inverted smile image data,
multimedia device. According to claim 1,
The data related to the user's face includes information about the user's face shape and information about the user's skin tone,
The information on the skin tone of the user is based on brightness values of pixels and color values of pixels included in the reference image data,
multimedia device. According to claim 1,
The control unit searches one or more makeup method data to determine the makeup method data and loads the determined makeup method data;
The one or more makeup method data is makeup method data stored by a storage unit or makeup method data received from a server,
multimedia device. 4. The method of claim 3,
The makeup method data is determined based on weather information, date information, and data related to the user's face,
The display unit, the reference image data displaying the first processed image data processed based on the determined makeup method data,
multimedia device. According to claim 1,
The makeup method data is determined based on information about cosmetics received from the user,
The information on the cosmetics is information based on image data on the cosmetics or information received from the server by the communication unit,
The display unit displays second processed image data in which the reference image data is processed based on the makeup method data and information on the cosmetics,
multimedia device. According to claim 1,
In response to the input signal received from the user, the display unit displays the enlarged makeup area of the reference image data for the user,
The makeup area is an area for a location where the user will apply makeup according to the makeup method,
multimedia device. According to claim 1,
The makeup method data includes first information indicating the concentration of the makeup and second information indicating the location of the makeup,
The first component includes a guideline component for the user to perform makeup based on the first information and the second information,
The multimedia device further includes a feedback generator configured to generate feedback data based on second image data captured after the makeup method data and the reference image data are captured,
The display unit further displays a second component representing the feedback data,
multimedia device. 8. The method of claim 7,
The feedback data is
First data indicating whether cosmetics used by the user are suitable based on chrominance and brightness of the user's face in the second image data;
second data indicating whether the concentration of the makeup is appropriate by comparing the values of pixels for the user's face in the second image data with the first information; and
and third data indicating whether the position of the makeup is appropriate by comparing the values of pixels for the user's face in the second image data with the second information;
When at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is not suitable, the display unit is configured to notify the user that at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is not suitable. 3 to display more components,
multimedia device. According to claim 1, wherein the multimedia device,
Further comprising a communication unit for transmitting the reference image data and the first component,
multimedia device. According to claim 1,
The display unit further includes decorative image data or decorative image data in the reference image data to display,
multimedia device. The camera unit acquires reference image data by photographing the shape of the face in a state in which the user is not smiling, the camera unit acquires the smile image data by photographing the shape of the face in the state in which the user is smiling, and the obtained reference image inverting the left-right symmetry of the data and the smile image data;
calculating, by a controller, a difference between the reference image data and the smiley image data by comparing the reference image data with the smiley image data;
detecting, by the control unit, data related to the eyebrows, data related to the nose, data related to the cheeks, data related to the mouth, and other data related to the user's eyebrows as data related to the user's face based on the deviation; The data includes information about the user's dimples, information about the user's paws, and information about the user's mole-
detecting, by the controller, a first portion of the user's face in which the deviation is greater than a value previously stored in a memory and a second portion in which the deviation is smaller than a value previously stored in the memory;
generating, by the control unit, a first component providing the makeup concentration as a first concentration for the first portion and providing the makeup concentration as a second concentration for the second portion;
Based on the data related to the user's face and the makeup method data, the first component indicating how the user performs makeup according to the makeup method data, the reference image data, and the smile image data are displayed by a display unit displaying; and
receiving, by an input unit, an external signal for enlarging or reducing a portion of at least one of the reference image data and the smile image data whose left-right symmetry is inverted;
including,
The display unit enlarges or reduces a portion of at least one of the reference image data and the smile image data whose left-right symmetry is inverted in response to the external signal and displays,
A method of controlling a multimedia device. 12. The method of claim 11,
The data related to the user's face includes information about the user's face shape and information about the user's skin tone,
The information on the skin tone of the user is based on brightness values of pixels and color values of pixels included in the reference image data,
A method of controlling a multimedia device. 12. The method of claim 11,
The step of detecting data related to the user's face,
retrieving one or more makeup method data to determine the makeup method data and loading the determined makeup method data;
The one or more makeup method data is makeup method data stored by a storage unit or makeup method data received from a server,
A method of controlling a multimedia device. 14. The method of claim 13,
The makeup method data is determined based on weather information, date information, and data related to the user's face,
The displaying of the reference image data may include displaying first processed image data in which the reference image data is processed based on the determined makeup method data.
A method of controlling a multimedia device. 12. The method of claim 11,
The makeup method data is determined based on information about cosmetics received from the user,
The information on the cosmetics is information based on image data on the cosmetics or information received from the server by the communication unit,
The displaying of the reference image data may include displaying second processed image data in which the reference image data is processed based on the makeup method data and information on the cosmetics.
A method of controlling a multimedia device. delete 12. The method of claim 11,
The makeup method data includes first information indicating the concentration of the makeup and second information indicating the location of the makeup,
The first component includes a guideline component for the user to perform makeup based on the first information and the second information,
The multimedia device control method includes: generating feedback data based on second image data captured after the makeup method data and the reference image data are captured;
Further comprising the step of further displaying a second component representing the feedback data by the display unit,
A method of controlling a multimedia device. 18. The method of claim 17,
The feedback data is
First data indicating whether cosmetics used by the user are suitable based on chrominance and brightness of the user's face in the second image data;
second data indicating whether the concentration of the makeup is appropriate by comparing the values of pixels for the user's face in the second image data with the first information; and
and third data indicating whether the position of the makeup is appropriate by comparing the values of pixels for the user's face in the second image data with the second information;
When at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is not suitable, the display unit is configured to notify the user that at least one of the cosmetics, the concentration of the makeup, and the position of the makeup is not suitable. 3 further comprising the step of displaying the component,
A method of controlling a multimedia device. 12. The method of claim 11,
The multimedia device control method comprises:
In the step of detecting data related to the user's face,
Further comprising the step of a communication unit communicating with a server for the reference image data and the first component,
A method of controlling a multimedia device. 12. The method of claim 11,
The multimedia device control method comprises:
Before acquiring the reference image data,
Further comprising the step of displaying by the display unit, further including decorative image data or decorative image data in the reference image data,
A method of controlling a multimedia device.

Images