JP2020048945A - Server, terminal and skin color diagnosis method - Google Patents

Abstract

To provide information relating to user's skin color.SOLUTION: A server includes: a receiving unit for receiving a photographed image of user's skin; a control unit for determining a combination of multiple candidate colors on the basis of attribute information of the user; and a transmission unit for transmitting information relating to the user's skin color chosen from the multiple possible candidate colors on the basis of the photographed image.SELECTED DRAWING: Figure 2

Description

  The present disclosure relates to a server, a terminal, and a skin color diagnosis method that provide information on a user's skin color.

  Generally, cosmetics (eg, foundation, lipstick, cheek, mascara, nail enamel, etc.) are applied to at least a portion of the user's body (eg, face, lips, cheeks, eyelashes, nails, etc.). For this reason, in order to provide products suitable for the skin colors (skin colors) of various users (also referred to as consumers), one or more products of the same brand and the same type (for example, the foundation of a certain brand of a certain company) are provided. (Color variations) are provided.

  Further, an apparatus for assisting a user in selecting a color suitable for a user from color variations of a specific product of a specific company has been studied (for example, Patent Document 1).

JP 2011-59960 A

  2. Description of the Related Art In recent years, in the cosmetics market, products that are relatively low in price and relatively easily available to users (petit plastic cosmetics, plastic plastic) from products with relatively high prices (also referred to as department store cosmetics and depacos) sold in department stores and the like. And so on).

  Therefore, the user compares and examines not only the color variation of a specific product provided by a specific company but also various color variations provided by many companies from department store cosmetics to petit plastic cosmetics, and selects a product suitable for the user's skin color. It is desirable to be able to select.

  However, in many cases, the user does not properly grasp his or her skin color. Further, even if the user's own skin color is recognized in the color variation of a specific product of a specific company, it may be assumed that the recognized skin color cannot be used when selecting a product of another company. This is because the definition of the color variation does not always match for each company or each product.

  As described above, the user may not be able to appropriately recognize his or her skin color, and as a result, may not be able to appropriately select a product suitable for the skin color. Such a problem may occur when a user wears and selects a product having various color variations, such as clothing (for example, a suit, a Y-shirt, a tie, and stockings), as well as cosmetics.

  Therefore, an object of the present disclosure is to provide a server, a terminal, and a skin color diagnosis method capable of providing information on a user's skin color.

  A server according to an aspect of the present disclosure includes a receiving unit that receives a captured image of a user's skin, a control unit that determines a combination of a plurality of candidate colors based on the attribute information of the user, and the plurality of candidate colors. And a transmission unit for transmitting information on the user's skin color selected from the above based on the photographed image.

  According to an aspect of the present disclosure, information on a user's skin color can be provided.

It is a figure showing an example of the whole composition of the skin color diagnosis system concerning this embodiment. 2A and 2B are diagrams illustrating an example of the color chart according to the present embodiment. 3A and 3B are diagrams illustrating an example of a user registration operation according to the present embodiment. FIG. 4 is a diagram illustrating an example of a user management table according to the present embodiment. It is a figure showing an example of the 1st skin color diagnostic operation concerning this embodiment. FIG. 4 is a diagram illustrating an example of a partial region and a reference region according to the present embodiment. FIG. 5 is a diagram illustrating an example of correction of a partial region color according to the present embodiment. It is a figure showing an example of the skin color information table concerning this embodiment. It is a figure showing an example of the 2nd skin color diagnostic operation concerning this embodiment. It is a figure showing an example of the skin color selection screen concerning this embodiment. FIG. 3 is a diagram illustrating an example of a configuration of a terminal according to the present embodiment. FIG. 2 is a diagram illustrating an example of a configuration of a server according to the present embodiment. It is a figure showing an example of hardware constitutions of each device in a skin color diagnostic system concerning this embodiment.

(Overview of skin color diagnosis system)
FIG. 1 is a diagram showing an example of the overall configuration of the skin color diagnosis system according to the present embodiment. As shown in FIG. 1, the skin color diagnosis system 1 according to the present embodiment may include a terminal 10 and a server 30 to which the terminal 10 is connected via a network 20.

  The terminal 10 is, for example, a communication terminal (device, communication device) such as a smartphone, a tablet, and a personal computer, but may be any terminal having a communication function.

  The network 20 may include at least one of a wireless LAN, Wi-Fi (registered trademark), an optical network, a mobile communication network, an IP network, and a private network.

  The server 30 is a device that provides information on the user's skin color (skin color information). The server 30 may be configured by a single server or may include a plurality of servers (for example, a Web server, a database, and the like).

  In the skin color diagnosis system 1, the attribute information of the user of the terminal 10 (for example, gender, age, generation, race, job title, family structure, annual income, residence area, hobby (for example, The color chart used for determining the user's skin color is determined based on the indoors). Here, the color chart indicates a combination (set) of a plurality of colors (for example, colors (candidate colors) that are candidates for the user's skin color).

  Further, in the skin color diagnosis system 1, the user's skin color is selected from the plurality of candidate colors indicated by the determined color chart based on the user's skin image (captured image). Further, information on the selected skin color is provided to the terminal 10.

  2A and 2B are diagrams illustrating an example of the color chart according to the present embodiment. 2A and 2B show color charts for each attribute information of the user (for example, gender in FIGS. 2A and 2B). In the color chart for each attribute information of the user, a plurality of candidate colors different in at least one of a color, a light and dark stage, and a skin tone may be shown.

  Here, the color indicates a flesh color system such as a pink ocher (PO) system, a normal ocher (NO) system, a beige ocher (BO) system, and a yellow ocher (YO) system. The light and dark stages are the light and dark stages of skin color such as fair (light), fair (soft), standard (neutral), tan (healthy), dark (dark), and tanned skin (darkest). It is shown. The skin tone indicates a skin tone such as a yellow base and a blue base. Note that the definitions of the color, the light-dark level, and the skin tone are not limited to those described above, and any term indicating at least one of the color, the light-dark level, and the skin tone may be used. For example, a NO system may simply be referred to as an ocher (O) system.

  For example, in the color charts for each gender shown in FIGS. 2A and 2B, a plurality of candidate colors are shown in two dimensions of a color and a light and dark stage, but the present invention is not limited to this. For example, the plurality of candidate colors in each color chart may be defined one-dimensionally using any of the tint, light and dark stages, and skin tones. In addition, the plurality of candidate colors in each color chart may be defined in two or more dimensions using at least two of a color, a light / dark stage, and a skin tone.

  For example, in the women's color chart of FIG. 2A, the PO, NO, BO, and YO candidate colors are identified by PO-Fx, NO-Fx, BO-Fx, and YO-Fx, respectively. In the male color chart of FIG. 2B, the PO, NO, BO, and YO candidate colors are identified by PO-Mx, NO-Mx, BO-Mx, and YO-Mx, respectively.

  Here, x is a parameter indicating a light-dark stage. For example, in a women's color chart, the six light-dark stages of fair (light), fair (soft), normal (neutral), tan (healthy), dark (dark), and tanned skin (darkest) are x. = 1 to 6 may be used. In the color chart for men, there are six light-dark stages of super-white (bright), fair-white (light), fair-white (soft), standard (neutral), wheat skin (healthy), and tanned dark (dark). = 1 to 6 may be used.

  The identifier of each candidate color (for example, PO-Fx, PO-Mx, etc.) shown in FIGS. 2A and 2B may be called a color code or the like. In the color charts shown in FIGS. 2A and 2B, a candidate color indicated by each color code may be displayed in a box provided with each color code. Note that the color code may be any identifier of the candidate color, and is not limited to those illustrated in FIGS. 2A and 2B.

  Further, in the color chart for each attribute information of the user, according to the attribute information (for example, gender, age, generation, race, position, family structure, annual income, living area, hobbies (for example, outdoor, indoor), etc.) A combination of a plurality of candidate colors may be indicated. For example, in the male color chart of FIG. 2B, candidate colors darker (black or darker) than the candidate colors in the female color chart of FIG. 2A may be displayed for each color. Further, the color chart for the white race may include many candidate colors with lower (darker) gradations than the color chart for the yellow race.

  In the color chart for each attribute information of the user, at least one of the number and definition of colors, the number and definition of light and dark stages, and the number and definition of skin tones may be different for each attribute information. For example, in the female color chart of FIG. 2A, the number of light-dark stages of the PO system is smaller than the number of light-dark stages of the PO system in the male color chart of FIG. 2B.

  2A and 2B exemplify a color chart for each gender, but the color chart for each attribute information of the user is not limited to this. In the skin color diagnosis system 1, the attributes are different for each attribute information of the user (for example, at least one of gender, age, generation, race, position, family structure, annual income, living area, and hobby (for example, outdoor, indoor)). A plurality of color charts each defining a plurality of candidate colors of the combination may be used.

  The combination of a plurality of candidate colors defined in each color chart may be determined in advance (or may be stored). Alternatively, the combination of the plurality of candidate colors may be controlled (customized) by predetermined parameters (for example, user attribute information, season, user's past history, and the like). Further, the candidate colors included in each color chart are not limited to a specific company or a specific product, and may be defined for general purposes.

  As described above, in the skin color diagnosis system 1, by selecting the user's skin color from a general-purpose color chart, the user's skin color can be diagnosed without imposing a mounting load. In addition, since the color chart is determined based on the attribute information of the user, the skin color of the user can be more appropriately diagnosed. As a result, information on the skin color (skin color information) (for example, at least one of diagnosis information, makeup information, and product information described later) can be appropriately provided to the user.

(Operation of skin color diagnosis system)
Next, the operation of the skin color diagnosis system 1 will be described in detail. Specifically, (1) user registration operation, (2) first skin color diagnosis operation, and (3) second skin color diagnosis operation in the skin color diagnosis system 1 will be described. In the skin color diagnosis system 1, at least one of the first skin color diagnosis operation and the second skin color diagnosis operation may be implemented.

(1) User Registration Operation FIGS. 3A and 3B are diagrams illustrating an example of a user registration operation according to the present embodiment. In step S101 of FIG. 3A, the terminal 10 causes the display unit (output unit) 150 to display an input screen for information about the user (user information).

  Here, the user information includes personal information of the user (for example, name, nickname, e-mail address, telephone number, address, etc.) and attribute information of the user (for example, gender, age, generation, race, position, family composition) , Annual income, residential area, hobbies (for example, at least one of outdoor and indoor), and the like.

  For example, on the input screen shown in FIG. 3B, a box for inputting the user's nickname, gender (male or female), age, and e-mail address (optional) or a button for selection is displayed. Note that the input screen shown in FIG. 3B is merely an example, and is not limited to this.

  In step S102 of FIG. 3A, the terminal 10 transmits the user information input or selected on the input screen displayed in step S101 to the server 30. In step 103, the server 30 stores a table (user management table) in which the user information received from the terminal 10 is associated with the user identifier (user ID) in the storage unit 320.

  FIG. 4 is a diagram showing an example of the user management table according to the present embodiment. As shown in FIG. 4, in the user management table, the user ID, personal information (for example, nickname, e-mail address, etc.), and attribute information (for example, gender, age, generation, race, position, family composition, annual income, A residence area and a hobby (for example, at least one of an outdoor group, an indoor group, etc.) may be associated. FIG. 4 is merely an example, and the configuration of the user management table is not limited to the illustrated one.

(2) First Skin Color Diagnosis Operation FIG. 5 is a diagram showing an example of a first skin color diagnosis operation according to the present embodiment. In the first skin color diagnosis operation, the server 30 determines the user's skin color.

  In step 201 in FIG. 5, the terminal 10 acquires an image of the user's skin (captured image) captured by the imaging unit 160. Note that the captured image may be a captured image captured by activating the imaging unit 160 in step S201, or may be a captured image stored in the storage unit 120. The photographed image may be, for example, an image obtained by photographing at least a face (hair does not have to be included).

  In step S202, the terminal 10 displays the captured image acquired in step S201 on the display unit 150, and cuts out a first area (partial area) and a second area (reference area) of the captured image. (Trim).

  FIG. 6 is a diagram illustrating an example of the partial region and the reference region according to the present embodiment. As shown in FIG. 6, the partial region may be a partial region of the face (for example, at least a part of the cheek) that does not include a non-skin-colored portion such as eyes and mouth. The reference area is an area used for determining a color difference from a reference color (for example, white), and may be an area that does not include a background (for example, at least a part of a neck). An object of the reference color (for example, white paper) may be imaged in a predetermined area including the reference area in the captured image. For example, at the time of imaging, the user may apply white paper to a predetermined area including a specified reference area (for example, his own neck) on the screen and take an image of his / her own face. This makes it possible to estimate the degree of influence of ambient light, and to use the estimation result in determining the color of the partial area.

  In FIG. 6, the partial region and the reference region are indicated by circles, but the shapes of the partial region and the reference region are not limited to this, and may be other than a circle such as a square. In addition, the positions of the partial region and the reference region illustrated in FIG. 6 are merely examples, and are not limited to the illustrated positions.

  The terminal 10 transmits the cropped partial region image (partial region image) and the reference region image (reference region image) to the server 30. By transmitting the trimmed partial area image and the reference area image to the server 30 instead of the captured image in which substantially the entire face of the user is captured, the user is less likely to be identified on the server 30 side. Effective for protection.

  In step S203 of FIG. 5, the server 30 corrects (calibrates) the color of the partial region (partial region color) based on the partial region image and the reference region image received from the terminal 10. Here, the partial area color may be an average value of the colors of the pixels in the partial area.

  FIG. 7 is a diagram illustrating an example of correction of a partial region color according to the present embodiment. As shown in FIG. 7, the server 30 calculates (determines) a difference (color difference) between the color of the reference area (reference area color) and the reference color. Here, the reference region color may be an average value of the colors of the pixels in the reference region. Further, the reference color may be, for example, a reference color (for example, white, a color indicated by a specific color code, or the like) in the skin color diagnosis system 1. Thereby, for example, a reference area color (for example, white paper put on the neck of the user) affected by the ambient light and a reference color (predetermined or determined) in the server 30 or the terminal 10 are determined. For example, the degree of influence of ambient light (color difference) can be estimated (calculated) based on the difference from (white).

  Further, the server 30 determines a corrected color (correction color) based on the determined color difference and the partial region color. For example, as shown in FIG. 7, the server 30 may determine the correction color by subtracting (or adding) the color difference from the partial region color.

  In step S204 of FIG. 5, the server 30 determines at least the attribute information of the user (for example, gender, age, generation, race, occupation, family structure, annual income, residential area, and hobby (for example, outdoor, indoor)). The color chart used for determining the user's skin color is determined based on one or the like. For example, when the server 30 stores the color chart for each gender shown in FIGS. 2A and 2B, if the user is a woman, it is determined to use the woman's color chart of FIG. 2A.

  The attribute information of the user may be obtained from a user management table (for example, FIG. 4) based on the user ID transmitted from the terminal 10 in step S202. Alternatively, the attribute information of the user may be transmitted from the terminal 10 together with the partial area image and the reference area image in step S202, for example.

  In step S205 of FIG. 5, the server 30 selects the user's skin color from the plurality of candidate colors in the color chart determined in step S204. For example, the server 30 may select a candidate color closest to the correction color determined in step S203 as a user's skin color from a plurality of candidate colors in the color chart.

  In step S206 of FIG. 5, the server 30 may generate information (skin color information) related to the skin color selected in step S205 and transmit the information to the terminal 10. The skin color information may include, for example, at least one of diagnostic information on the selected skin color, information on makeup suitable for the skin color (makeup information), and information on products suitable for the skin color (product information).

  Specifically, the server 30 may determine the user's skin color information (for example, at least one of diagnostic information, makeup information, and product information) based on the color code of the skin color selected in step S205. For example, the storage unit 320 of the server 30 may store a table (skin color information table) that associates a color code with at least one of diagnostic information, makeup information, and product information. Further, the server 30 is based on attribute information of the user (for example, at least one of gender, age, generation, race, position, family structure, annual income, residential area, hobby (for example, outdoor, indoor)). May be used to determine the skin color information.

  FIG. 8 is a diagram showing an example of the skin color information table according to the present embodiment. As shown in FIG. 8, in the skin color information table, at least one of diagnosis information, makeup information, and product information may be associated with the color code.

  As shown in FIG. 8, the diagnostic information may be, for example, information indicating the nature of the skin color indicated by the color code. In addition, the makeup information may indicate, for example, a texture suitable for the skin color indicated by the color code, a base color, a concealer, an eye shadow, a teak color, or the like. The product information is information on products suitable for the skin color indicated by the color code, such as cosmetics, clothes, accessories, favorite items, and stockings. The product information may be indicated for each category (for example, depacos, miniature plastic, etc.).

  The server 30 determines at least one of the diagnostic information, makeup information, and product information associated with the color code indicating the skin color determined in step S205 with reference to the skin color information table illustrated in FIG. May be sent.

  In step S207 of FIG. 5, the terminal 10 displays the skin color information (for example, at least one of diagnosis information, makeup information, and product information) received from the server 30 on the display unit 150.

  According to the above-mentioned first skin color diagnosis operation, the server 30 automatically selects the user's skin color from the color chart determined based on the user's attribute information. Thus, there is no need for the user himself to select the skin color, and the burden on the user can be reduced.

  In addition, the server 30 corrects the color of the partial region in the captured image based on the color difference between the reference color and the reference color in the captured image of the user, and adjusts the color in the plurality of candidate colors in the color chart. , The candidate color closest to the correction color is selected as the user's skin color. For this reason, it is possible to reduce the error in the skin color diagnosis result caused by the user's shooting environment (for example, a dark room, a bright room, day, night, etc.).

(3) Second skin color diagnosis operation The second skin color diagnosis operation is different from the first skin color diagnosis operation in that the user selects a skin color from a color chart displayed on the display unit 150 of the terminal 10. different. The following description focuses on differences from the first skin color diagnosis operation.

  FIG. 9 is a diagram showing an example of the second skin color diagnosis operation according to the present embodiment. Step S301 in FIG. 9 is the same as step S201 in FIG.

  In step S302, the terminal 10 displays the captured image acquired in step S301 on the display unit 150, and trims a first region (partial region) of a part of the captured image (for example, see FIG. 6). Step S302 differs from step S202 in FIG. 5 in that the second region (reference region) does not need to be cut out. The terminal 10 transmits the trimmed partial area image to the server 30.

  In step S303, the server 30 determines a partial area color based on the partial area image received from the terminal 10. As described above, the partial region color may be an average value of the colors of the pixels in the partial region.

  In step S304, the server 30 determines at least one of the attribute information of the user (for example, gender, age, generation, race, job title, family structure, annual income, residential area, hobby (for example, outdoor party, indoor party)). ), A color chart is determined. The acquisition of the attribute information of the user and the determination of the color chart (for example, see FIGS. 2A and 2B) are the same as in step S204 in FIG.

  In step S304, information on the determined color chart (color chart information) and information indicating the partial area color determined in step S303 (partial area color information) are transmitted to the terminal 10. different.

  Here, the color chart information may be information indicating a plurality of candidate colors in the color chart. The color chart information may be, for example, an identifier of the color chart or a color code of each of a plurality of candidate colors in the color chart.

  In step S305, the terminal 10 displays a skin color selection screen on the display unit 150 based on the color chart information and the partial area color information from the server 30. FIG. 10 is a diagram showing an example of the skin color selection screen according to the present embodiment.

  As shown in FIG. 10, the skin color selection screen includes, for example, a color chart indicated by the color chart information received from the server 30, a partial area color indicated by the partial area color information received from the server 30, and step S302 in FIG. A trimmed partial area may be provided. In the skin color selection screen, display of at least one of the partial region and the partial region color may be omitted.

  For example, in FIG. 10, the female color chart (for example, see FIG. 2A) is determined based on the attribute information of the user (for example, female) in step S304 of FIG. 9, so that the female color chart is displayed on the color selection screen. Is shown. The color chart displayed on the color selection screen may be any color chart as long as it is determined based on the attribute information of the user.

  As shown in FIG. 10, by displaying the partial area, the partial area color, and the color chart trimmed from the captured image (see FIG. 6) on the color selection screen, the user can input the partial area, the partial area color, and the color. The user can select his / her own skin color while comparing with a plurality of candidate colors in the chart.

  In step S305 in FIG. 9, terminal 10 accepts from input unit 140 a request to select one (i.e., skin color) from a plurality of candidate colors in the color chart displayed on the color selection screen. The terminal 10 transmits a color code indicating the selected flesh color to the server 30.

  Steps S306 and S307 in FIG. 9 are the same as steps S206 and S207 in FIG.

  According to the above-mentioned second skin color diagnosis operation, the user himself / herself selects a skin color from a plurality of candidate colors in the color chart determined based on the attribute information of the user in the server 30, so that the first skin color The implementation of the skin color diagnosis system 1 can be simplified as compared with the diagnosis operation.

(Configuration of skin color diagnosis system 1)
Next, the configurations of the terminal 10 and the server 30 configuring the skin color diagnosis system 1 will be described. FIGS. 11 and 12 are diagrams each showing an example of the configuration of the terminal and the server according to the present embodiment.

  11 and 12 mainly show functional blocks of characteristic portions of the terminal 10 and the server 30. Of course, the terminal 10 and the server 30 may also have other functional blocks required for other processes. Further, the configuration may be such that some of the functional blocks shown in FIGS. 11 and 12 are not included.

  As illustrated in FIG. 11, the terminal 10 may include a control unit 110, a storage unit 120, a transmission / reception unit 130, an input unit 140, an output unit 150, and an imaging unit 160.

  The control unit 110 controls the terminal 10. The terminal 10 can be configured by a controller, a control circuit, or a control device described based on common recognition in the technical field according to the present disclosure.

  Specifically, the control unit 110 performs transmission and / or reception by the transmission / reception unit 130, reception of various requests by the input unit 140, processing based on the various requests, display of various screens on the output unit 150, and imaging by the imaging unit 160. The acquisition of an image may be controlled.

  For example, the control unit 110 displays an input screen for user information to the output unit 150 (for example, FIG. 3B), a screen for trimming a captured image (for example, FIG. 6), a skin color selection screen (for example, FIG. 10), and display of skin color information The display of the screen may be controlled. Further, control unit 110 may control reception of a request from the user using input unit 140 on these display screens.

  Further, the control unit 110 may control trimming of at least one of the partial region and the reference region in the captured image of the user's skin. The control unit 110 may control generation, transmission, and the like of at least one of the partial area image and the reference area image. Further, control unit 110 may control transmission of a color code indicating a skin color selected by the user.

  The storage unit 120 stores (holds) information used in the terminal 10. The storage unit 320 can be configured by, for example, a memory, a storage, a storage device, and the like described based on common recognition in the technical field according to the present disclosure. For example, the storage unit 120 may store at least one of a captured image of the user's skin, a partial area image, and a reference area image.

  The transmission / reception unit 130 performs communication with another communication device (for example, the server 30) via the network 20. The transmitting / receiving unit 130 may output the received various information to the control unit 110. The transmission / reception unit 130 can be configured by a transmitter / receiver, a transmission / reception circuit, or a transmission / reception device described based on common recognition in the technical field according to the present disclosure. Note that the transmission / reception unit 130 may include a transmission unit and a reception unit.

  Specifically, the transmitting / receiving unit 130 transmits at least one of user information (for example, personal information and attribute information), a user ID, a partial area image, a reference area image, and a color code indicating a skin color selected by the user to the server 30. May be sent.

  Further, the transmitting / receiving unit 130 may receive from the server 30 at least one of the user's skin color information (for example, at least one of diagnosis information, makeup information, and product information), color chart information, and partial area color information.

  The input unit 140 receives an input by an operation from a user. The input unit 140 may be connected to a predetermined device, a storage medium, or the like, and may receive data input. The input unit 140 may output an input result to, for example, the control unit 110.

  The input unit 140 can be configured by input devices such as a keyboard, a mouse, and a button, input / output terminals, input / output circuits, and the like, which are described based on common recognition in the technical field according to the present disclosure. Further, the input unit 140 may be configured to be integrated with the display unit (for example, a touch panel).

  The output unit 150 outputs data, content, and the like in a format that can be perceived by the user. For example, the output unit 150 may be configured to include a display unit (display screen) that displays an image, an audio output unit that outputs audio, and the like.

  The display unit can be configured by, for example, a display device such as a display or a monitor described based on common recognition in the technical field according to the present disclosure. Further, the audio output unit can be configured by an output device such as a speaker described based on common recognition in the technical field according to the present disclosure.

  The output unit 150 includes, for example, an arithmetic unit, an arithmetic circuit, an arithmetic device, a player, an image / video / audio processing circuit, an image / video / audio processing device described based on common recognition in the technical field according to the present disclosure, It can be configured to include an amplifier and the like.

  The imaging unit 160 can be configured to include, for example, a unit that captures an image of a subject such as a camera. The imaging unit 160 may include at least one of a camera (out camera) provided on the back side of the terminal 10 and a camera (in camera) provided on the display unit side of the terminal 10.

  As illustrated in FIG. 12, the server 30 may include a control unit 310, a storage unit 320, a transmission / reception unit 330, an input unit 340, and an output unit 350. Note that the basic configuration of the control unit 310, the storage unit 320, the transmission / reception unit 330, the input unit 340, and the output unit 350 of the server 30 includes a control unit 110, a storage unit 120, This is the same as the transmitting / receiving unit 130, the input unit 140, and the output unit 150. Hereinafter, a description will be given mainly of a functional configuration characteristic of the server 30.

  The control unit 310 determines a color chart (a combination of a plurality of candidate colors) based on the attribute information of the user.

  Further, the control unit 310 may select a skin color of the user from a plurality of candidate colors in the color chart based on a captured image of the skin of the user. Here, the captured image may include an image of a partial region obtained by cutting out a part of the user's face and an image of a reference region used for determining a color difference from a reference color. The control unit 310 may select, from the plurality of candidate colors in the color chart, the candidate color closest to the correction color determined based on the color of the partial area and the color difference as the skin color.

  Further, control unit 310 may control generation and transmission of skin color information regarding the skin color selected by control unit 310 or the user. Specifically, control unit 310 refers to the skin color information table (for example, FIG. 8), and acquires at least one of diagnostic information, makeup information, and product information associated with a color code indicating the skin color. Good.

  Further, control unit 310 may control user registration based on the user information received from terminal 10.

  The storage unit 320 may store a user management table (for example, FIG. 4) and a skin color information table (for example, FIG. 8). The storage unit 320 may store at least one of the partial area image and the reference area image received from the terminal 10 in association with the user ID.

  Further, the storage unit 320 may store a plurality of color charts. The plurality of color charts each include user attribute information (for example, at least one of gender, age, generation, race, job title, family structure, annual income, residential area, and hobby (for example, outdoor or indoor)). May be associated with

  The transmission / reception unit 330 receives from the terminal 10 at least one of user information (for example, personal information and attribute information), a user ID, a partial area image, a reference area image, and a color code indicating a skin color selected by the user. Good.

  In addition, the transmitting / receiving unit 330 may transmit to the terminal 10 at least one of the user's skin color information (for example, at least one of diagnosis information, makeup information, and product information), color chart information, and partial area color information.

(Hardware configuration)
Note that the block diagram used in the description of the above-described embodiment shows blocks in functional units. These functional blocks (components) are realized by an arbitrary combination of hardware and / or software. The means for implementing each functional block is not particularly limited. That is, each functional block may be realized by one physically connected device, or two or more physically separated devices may be connected by wire or wireless, and may be realized by a plurality of these devices. Good.

  For example, a device, a server, and the like in the present embodiment may function as a computer that performs the operation of the present disclosure. FIG. 13 is a diagram illustrating an example of a hardware configuration of a device, a server, and the like according to the present embodiment. The above-described terminal 10, server 30, and the like may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

  In the following description, the term “apparatus” can be read as a circuit, a device, a unit, or the like. The hardware configuration of the terminal 10, the server 30, and the like may be configured to include one or more devices illustrated in the drawing, or may be configured without including some devices.

  For example, although only one processor 1001 is shown, there may be multiple processors. Further, the processing may be executed by one processor, or the processing may be executed by one or more processors simultaneously, sequentially, or by using another method.

  The functions of the terminal 10, the server 30, and the like are executed by reading predetermined software (program) on hardware such as the processor 1001 and the memory 1002, and the processor 1001 performs an operation. This is realized by controlling the reading and / or writing of data in the storage 1003.

  The processor 1001 controls the entire computer by operating an operating system, for example. The processor 1001 may be configured by a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic device, a register, and the like. Each unit such as the control unit 110 described above may be realized by the processor 1001. Processor 1001 may be implemented by one or more chips.

  In addition, the processor 1001 reads a program (program code), a software module, data, and the like from the storage 1003 and / or the communication device 1004 to the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operation described in the above embodiment is used. For example, the control unit 310 (110) may be realized by a control program stored in the memory 1002 and operated by the processor 1001, and the other function blocks may be similarly realized.

  The memory 1002 is a computer-readable recording medium, for example, at least one of a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically EPROM), a RAM (Random Access Memory), and other appropriate storage media. It may be constituted by one. The memory 1002 may be called a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, and the like that can be executed to perform the method according to this embodiment.

  The storage 1003 is a computer-readable recording medium, such as a flexible disk, a floppy (registered trademark) disk, a magneto-optical disk (for example, a compact disk (CD-ROM (Compact Disc ROM), etc.)), a digital versatile disk, At least one of a Blu-ray (registered trademark) disk, a removable disk, a hard disk drive, a smart card, a flash memory device (eg, a card, a stick, a key drive), a magnetic stripe, a database, a server, and other suitable storage media. May be configured. The storage 1003 may be called an auxiliary storage device. Note that the above-described storage unit 320 (120) may be realized by the memory 1002 and / or the storage 1003.

  The communication device 1004 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like. Communication device 1004 may include a SIM card. Note that the above-described transmitting / receiving section 330 (130) may be realized by the communication device 1004.

  The input device 1005 is an input device (for example, a keyboard, a mouse, a camera, and the like) that receives an external input. The output device 1006 is an output device that performs output to the outside (for example, a display, a speaker, and the like). Note that the input device 1005 and the output device 1006 may have an integrated configuration (for example, a touch panel). Note that the above-described input unit 340 (140) and output unit 350 (150) may be realized by the input device 1005 and the output device 1006, respectively.

  Each device such as the processor 1001 and the memory 1002 is connected by a bus 1007 for communicating information. The bus 1007 may be configured by a single bus, or may be configured by a different bus between the devices.

  The terminal 10 and the server 30 are hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). And some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented by at least one of these hardware.

(Modification)
Note that terms described in the present disclosure and / or terms necessary for understanding the present disclosure may be replaced with terms having the same or similar meaning.

  The information, parameters, and the like described in the present disclosure may be represented by absolute values, may be represented by relative values from predetermined values, or may be represented by other corresponding information. Further, the names used for parameters and the like in the present disclosure are not limited in any way.

  The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc., that can be referred to throughout the above description are not limited to voltages, currents, electromagnetic waves, magnetic or magnetic particles, optical or photons, or any of these. May be represented by a combination of

  Information, signals, etc. may be input / output via a plurality of network nodes. Information and signals input and output may be stored in a specific location (for example, a memory) or may be managed using a table. Information and signals that are input and output can be overwritten, updated, or added. The output information, signal, and the like may be deleted. The input information, signal, and the like may be transmitted to another device.

  Software, regardless of whether it is called software, firmware, middleware, microcode, a hardware description language, or any other name, instructions, instruction sets, codes, code segments, program codes, programs, subprograms, software modules , Applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, and the like.

  In addition, software, instructions, information, and the like may be transmitted and received via a transmission medium. For example, if the software uses a wired technology (such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL)) and / or wireless technology (such as infrared, microwave, etc.), the website, server, or other When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

  The terms "system" and "network" as used in this disclosure are used interchangeably.

  The embodiments described in the present disclosure may be used alone, may be used in combination, or may be switched according to execution. In addition, the order of the processing procedure, sequence, flowchart, and the like of each aspect / embodiment described in the present disclosure may be changed as long as there is no inconsistency. For example, the methods described in this disclosure present elements of various steps in a sample order, and are not limited to the specific order presented. Specifically, in the flowcharts shown in FIGS. 5, 6, 8, 9, and 10, some steps may be omitted, steps not shown may be added, and at least some steps may be added. May be interchanged.

  Reference to “based on” as used in the present disclosure does not mean “based solely on” unless otherwise indicated. In other words, the phrase "based on" means both "based only on" and "based at least on."

  Any reference to elements using designations such as "first," "second," etc., as used in the present disclosure, does not generally limit the quantity or order of those elements. These designations may be used in the present disclosure as a convenient way to distinguish between two or more elements. Thus, reference to the first and second elements does not mean that only two elements can be employed, or that the first element must precede the second element in some way.

  Although the invention according to the present disclosure has been described in detail above, it is obvious to those skilled in the art that the invention according to the present disclosure is not limited to the embodiment described in the present disclosure. The invention according to the present disclosure can be implemented as modifications and changes without departing from the spirit and scope of the invention determined based on the description of the claims. Therefore, the description of the present disclosure is intended for illustrative purposes and does not bring any restrictive meaning to the invention according to the present disclosure.

Claims (6)

A receiving unit that receives a photographed image of the user's skin,
A control unit that determines a combination of a plurality of candidate colors based on the attribute information of the user;
A transmission unit that transmits information on the user's skin color selected based on the captured image from among the plurality of candidate colors,
A server comprising: The captured image includes an image of a partial region obtained by cutting out a part of the user's face, and an image of a reference region used for determining a color difference from a reference color,
The said control part selects the candidate color closest to the correction | amendment color determined based on the color of the said partial area | region and the said color difference from the said several candidate color as said skin color, The Claims characterized by the above-mentioned. 2. The server according to 1. The captured image includes an image of a partial region obtained by cutting out a part of the user's face,
The transmitting unit transmits information indicating the plurality of candidate colors and information indicating an average color of the partial region,
The server according to claim 1, wherein the receiving unit receives information indicating the skin color selected from the plurality of candidate colors.   4. The information on the skin color includes at least one of diagnostic information on the selected skin color, information on makeup suitable for the skin color, and product information suitable for the skin color. 5. Server as described in. A transmitting unit that transmits a photographed image of the user's skin;
A receiving unit that receives information on the user's skin color, which is selected from a combination of a plurality of candidate colors determined based on the user's attribute information,
A terminal comprising: Receiving a photographed image of the user's skin;
Determining a combination of a plurality of candidate colors based on the attribute information of the user;
Transmitting information on the user's skin color selected based on the captured image from the plurality of candidate colors,
A skin color diagnosis method, comprising:

Images