HK1108345B - Skin condition diagnostic system and beauty counseling system - Google Patents

Description

Skin condition diagnosis system and beauty counseling system

Technical Field

The present invention relates to a system for diagnosing the skin condition of a customer or a subject in a store such as a cosmetics shop.

Background

It has become common practice in stores selling cosmetics to magnify and observe the skin of customers and diagnose their skin condition by using a microscope.

It has also become common practice to apply a microscope connected to an image processing apparatus such as a personal computer to a specific part of the face, display its enlarged image on a display unit, and the image processing apparatus analyzes an image captured from the microscope to quantitatively evaluate a skin condition such as a texture condition or the like.

In a store having such equipment, a salesperson uses the results of the diagnosis of the skin condition to select a product suitable for the customer and provides guidance on the use of the product.

Disclosure of Invention

Problems to be solved by the invention

However, since the area that the microscope can capture on the face at the same time is small, only local information is processed based on the diagnosis result of the captured image. For example, even when the mottling condition of the cheek is measured, data is captured on only a small portion of the entire area of the cheek. For this reason, unless the position is in a condition representative of the entire cheek, it cannot be said that the cheek condition is diagnosed. For example, in the case where a stain is present only where a microscope is applied, a diagnostic result indicating the condition of the entire cheek cannot be obtained.

Thus, in order to obtain highly reliable results, as many portions of the image as possible should be captured and analyzed. However, to capture the entire cheek or the entire forehead, for example, time and effort are required to repeatedly apply the microscope to the customer's face and capture an image.

Even if the range is limited to a specific range, such as cheek, forehead, etc., it is not realistic to capture a large number of places with a microscope and diagnose the condition of the whole face.

Furthermore, in order to capture a large amount of information and analyze them all, a lengthy processing time is required. The customer can only be allowed to wait for a few minutes in the store without any trouble until the image and other customer information is all entered and the analysis results are output. To obtain results during this period, large-scale computers with high processing speeds are indispensable. However, it is almost impossible to install such a large-sized computer in each shop.

However, there is also a problem in that a person with considerable experience is required to specify an image capturing point representing the condition of a portion having a specific width and apply a microscope to the portion to capture an image.

Further, in a diagnosis unit using a microscope, a magnified image of a captured portion can be displayed, but it is impossible to specify where the magnified image corresponds to the customer's face, i.e., to identify its exact position on the face. Therefore, there is a problem that the customer cannot recognize which part of the face the enlarged image corresponds to, and cannot recognize even if the diagnosis result is given.

In addition, there is a problem in that an operation of applying a microscope to a face and capturing an analyzable image requires a trick for using the microscope, which is too difficult for beginners unfamiliar with the operation.

An object of the present invention is to provide a system for diagnosing the condition of the skin of a customer or a subject in a shop, the operation of which at the time of diagnosis is simplified so that even a beginner can perform the diagnosis and the accuracy of the diagnosis result thereof is improved.

Means for solving the problems

A first invention is a skin condition diagnosis system including a data collection system and a data analysis system that performs analysis processing based on data collected by the data collection system, both of which are connected to each other by a communication device, characterized in that the data collection system includes: a collector communication means for transmitting/receiving data to/from the data analysis system; an image capture device for capturing an ultra-high resolution digital image sufficient to analyze skin texture conditions; a collection-side image data compression means for compressing image data by a high compression method that suppresses block noise; and a collector data display device. The data analysis system includes: an analysis-side communication means for transmitting/receiving data to/from the data collection means; data analysis means for analyzing the image data; an analysis-side image data compression means for compressing the image data by a high compression method that suppresses block noise; and analysis-side data storage means for storing an analysis result of the data analysis means, the image capture means capturing a whole face image of a subject as an ultrahigh-resolution digital image, the collection-side image data compression means having a function of compressing the whole face image to create compressed image data and transmitting the data to the data analysis system through the collection-side communication means, the data analysis means having a function of receiving the compressed image data through the analysis-side communication means, analyzing a skin condition of the subject from the received compressed image data, creating visual information reflecting the analysis result on the whole face image, and outputting the visual information as a diagnosis result, the analysis-side image data compression means compressing the diagnosis result output from the data analysis means to create compressed image data, and transmitting the compressed image data to the data collection system through the analysis side communication means, and the collection side data display means has a function of displaying the diagnosis result transmitted from the analysis side communication means.

In a system that receives compressed image data sent between the data collection system and the data analysis system, the compressed image data is decompressed while the data is being processed.

A second invention is based on the premise of the first invention, and characterized in that the data analysis system further includes a storage device for storing a plurality of diagnosis items regarding skin conditions, and the data analysis device has a function of analyzing skin conditions from face whole image data for each diagnosis item, calculating a score (grade) from the diagnosis result, and reflecting an evaluation result corresponding to the score to the face whole image.

A third invention is based on the premise of the second invention, and is characterized in that the storage means classifies the plurality of diagnostic items into at least two or more intermediate items and stores them, and stores the intermediate items and the diagnostic items simultaneously in such a manner that they are associated with coefficient values, and the data analysis means sums up scores (score) of all diagnostic items obtained by multiplying the calculated score of each diagnostic item by the coefficient value corresponding to the diagnostic item, calculates an intermediate item score for each intermediate item, multiplies the intermediate item score by the coefficient value corresponding to the intermediate item, and sums up the multiplied scores to calculate a score of the skin condition.

A fourth invention is based on the premise of the third invention, and is characterized in that the coefficient value is a value calculated by analyzing a relationship between a visual score of a visually determined skin condition and a score of each diagnostic item calculated by the data analysis means.

A fifth invention is based on the premise of the third and fourth inventions, characterized in that the data analysis means has a function of creating display data for displaying the calculated score and the coefficient value corresponding to the item on the same screen.

A sixth invention is based on the premise of the first and fifth inventions, characterized in that the data analysis device performs: a process of specifying constituent elements of a face in a whole-face image received from the data collection system; specifying a course of diagnostic items; a process of specifying a diagnostic portion on the whole face image that fits the specified diagnostic item based on the constituent elements of the face; and a process of analyzing the image characteristics conforming to the skin condition corresponding to the diagnosis item presented in the diagnosis section.

A seventh invention is a skin condition diagnosis system including a data collection system and a data analysis system that performs analysis processing based on data collected by the data collection system, both of which are connected to each other by a communication device, characterized in that the data collection system includes: a collector communication means for transmitting/receiving data to/from the data analysis system; an image capturing means for capturing an ultra-high resolution digital image allowing analysis of skin texture conditions; a collection-side image data compression means for compressing image data by a high compression method that suppresses block noise; and a collector data display device, the data analysis system comprising: an analysis-side communication means for transmitting/receiving data to/from the data collection means; data analysis means for analyzing the image data; an analysis-side image data compression means for compressing the image data by a high compression method that suppresses block noise; the analysis end data storage device is used for storing the analysis result of the data analysis device; and a change trend storage means for storing a trend over time that is compatible with a preset skin condition and face shape pattern, the image capturing means capturing an entire image of a face of a subject as an ultrahigh resolution digital image, the collection-side image data compression means having a function of compressing the entire image of the face to create compressed image data and transmitting the data to the data analysis system through the collection-side communication means, the data analysis means having: a function of receiving the compressed image data by the analysis-side communication device, analyzing a skin condition of the subject based on the received compressed image data, creating visual information reflecting the analysis result on the entire image of the face, and outputting the visual information as a diagnosis result; a function of specifying the pattern in accordance with the skin condition and the face shape of the subject and simultaneously specifying a variation tendency corresponding to the pattern from the data stored in the variation tendency storage means; and a function of predicting a future skin condition and a face shape of the subject based on the specified trend of change and reflecting the prediction result to the face whole image to output it as a predicted future face image, the analysis side image data compression means compresses the predicted future face image output from the data analysis means to create compressed image data, and transmits the compressed image data to the data collection system via the analysis side communication means, and the collection side data display means has a function of displaying the predicted future face image transmitted from the analysis side communication means.

As an eighth invention, a beauty counseling system comprising a data collecting system and a data analyzing system which performs an analyzing process based on data collected by the data collecting system, both of which are connected to each other by a communication means, characterized in that the data collecting system comprises: a collector communication means for transmitting/receiving data to/from the data analysis system; an image capture device for capturing an ultra-high resolution digital image sufficient to analyze skin texture conditions; a collection-side image data compression means for compressing image data by a high compression method that suppresses block noise; and a collector data display device, the data analysis system comprising: an analysis-side communication means for transmitting/receiving data to/from the data collection means; data analysis means for analyzing the image data; an analysis-side image data compression means for compressing the image data by a high compression method that suppresses block noise; the analysis end data storage device is used for storing the analysis result of the data analysis device; and a beauty information storage device for storing beauty information such as makeup information, the image capturing device capturing a whole face image of a subject as an ultra-high resolution digital image, the collection-side image data compressing device having a function of compressing the whole face image to create compressed image data and transmitting the data to the data analyzing system through the collection-side communication device, the data analyzing device having: a function of receiving the compressed image data by the analysis-side communication device, analyzing a skin condition of the subject from the received compressed image data, creating visual information reflecting the analysis result on the entire face image, and outputting the visual information as a diagnosis result; and a function of extracting and outputting cosmetic information suitable for the subject from the cosmetic information storage device based on the diagnosis result, the analysis side image data compressing device compresses the diagnosis result output from the data analyzing device to create compressed image data, and transmits the compressed image data to the data collecting system through the analysis side communication device together with the extracted cosmetic information, and the collection side data display device has a function of displaying the diagnosis result and cosmetic information transmitted from the analysis side communication device.

Effects of the invention

According to the first to eighth inventions, since the whole image of the face with ultrahigh resolution is transmitted in a short time, the data analysis system capable of making a high-accuracy diagnosis can be installed separately from the data collection system.

By separating a large processing apparatus that performs high-accuracy analysis from a data collection system, a small-sized data collection system can be installed in many shops and the like.

Since the whole image of the face can be captured by a simple operation using the camera on the data collection system side of the shop or the like, even a beginner can capture the whole image of the face of the customer compared to using a conventional microscope.

As a result, a diagnosis result with higher accuracy can be easily obtained.

Further, since the diagnosis result is visually represented on the whole face image, the subject such as a customer or the like of the cosmetic shop can easily accept the diagnosis result.

Further, since data on the skin condition of the whole face can be captured simultaneously by the whole face image, the skin condition of the whole face can be comprehensively evaluated. If data of the entire face cannot be captured at the same time, the time at which the data is captured varies depending on the place. On the other hand, since the skin condition varies with time, if there is any time difference in capturing data depending on the place, it is impossible to evaluate the whole face under the same time condition. Thus, when the skin condition of the entire face is comprehensively evaluated, a correct evaluation result cannot be obtained. However, capturing the whole image of the face at once as it is with the present invention can eliminate such a concern.

According to the second to fourth inventions, the skin condition can be comprehensively evaluated and displayed.

In particular, according to the fourth invention, the evaluation result of the skin condition for viewing, that is, the visible skin condition, can be calculated.

According to the fifth invention, the degree of contribution of each item to the result of the comprehensive evaluation of the skin condition can be identified. Thus, it is possible to know which diagnostic items should be improved to improve the overall evaluation result of the skin condition only by looking at it.

According to the sixth invention, a portion on the image that should be analyzed can be specified according to a diagnostic item.

According to the seventh invention, a predicted future face image that predicts the future can be output according to the skin condition of the subject. In an effort to utilize the predicted future facial image, appropriate advice regarding cosmetology may be provided.

According to the eighth invention, even inexperienced persons can provide counseling about beauty in stores and the like.

Drawings

FIG. 1 is a general block diagram of a system in a first embodiment of the invention;

fig. 2 is a schematic diagram showing the whole face image data subjected to analysis by the data analysis system;

FIG. 3 is a diagram of an analysis section;

fig. 4 is a diagram showing an entire image of a face on which a diagnosis result is reflected;

fig. 5 is a diagram showing a display example of a diagnosis result in which a skin condition level is presented together with a face whole image;

fig. 6 is a graph showing skin condition levels;

fig. 7 is a diagram showing a display example of the diagnosis result of the first embodiment, in which an enlarged image is presented together with a face whole image;

FIG. 8 is a table showing the relationship among diagnostic items, intermediate items, and respective coefficient values according to the second embodiment;

FIG. 9 is an arithmetic expression for calculating the score for the middle item and the score for the skin condition;

fig. 10 is a diagram showing a data structure of the second embodiment;

fig. 11 is a screen showing the diagnosis result of the second embodiment, and is a diagram showing the score of the middle item;

fig. 12 is a screen showing the diagnosis result of the second embodiment, and is a diagram showing the scores of the diagnosis items;

fig. 13 is a table showing a setting example of an intermediate item;

FIG. 14 is a diagram showing an example of facial shape aging simulation logic;

FIG. 15 is a diagram showing an example of skin condition aging simulation logic; and

fig. 16 is a diagram showing an example of reference data of a predicted future face.

Description of the reference numerals

1 data collection system

2 shooting unit

3 display unit

6 processing unit

7 transmitting and receiving unit

11 data analysis system

12 transmitting and receiving unit

13 central processing unit

Detailed Description

A first embodiment of the present invention will be described with reference to fig. 1 and 2.

In the system of the first embodiment, the data collection systems 1 installed in a plurality of stores, respectively, are connected to the data analysis system 11 installed in the control center through a communication network N such as the internet. The location of the data collection system 1 is not limited to a store, but in the following embodiment, the data collection system 1 is installed in a store such as a cosmetic store.

In the skin condition diagnosis system, data necessary for diagnosis is transmitted from the data collection system 1 to the data analysis system 11, the result analyzed by the data analysis system 11 is transmitted to the data collection system 1, and the analysis result is displayed on the display unit 3.

As shown in fig. 1, the data collection system 1 includes a photographing unit 2 for capturing an ultra-high definition digital image as an image capturing device of the present invention, a display unit 3 for displaying data, an input unit 4 such as a keyboard or a card reader for inputting customer information or the like, a storage unit 5 for storing data therein, a processing unit 6, an output unit 8 for outputting data, and a transmitting and receiving unit 7 for performing communication with a data analysis system 11 through a communication network N as a collection-side communication device of the present invention.

All the data collection systems 1 installed in the stores have the same configuration.

The photographing unit 2 is a digital camera that photographs the entire face of a customer, a subject, as a digital image with ultra-high definition that enables analysis of the skin texture condition. The ultra-high definition that enables analysis of the skin texture condition means providing a level of resolution sufficient to recognize fine lines having a width of 30 micrometers, for example, a level equivalent to or higher than that of a microscope 50 times as wide as a current 14-inch display. The greater the number of pixels of the captured image, the easier the analysis of the texture situation. In particular, 20,000,000 pixels or more are required, and 40,000,000 pixels or more are preferable.

The display unit 3 is a display unit capable of displaying an ultra-high definition digital image, and the output unit 8 is a printer or the like for outputting analysis results and other data returned from the data analysis system 11.

The processing unit 6 has a function of processing the customer data input from the input unit 4 and the image data input from the photographing unit 2, storing the data in the storage unit 5, and transmitting the data to the data analysis system 11 through the transmitting and receiving unit 7.

Examples of the data processing function of the processing unit 6 include a function of compressing the ultra-high definition image input from the photographing unit 2. The compression method is a high compression method that suppresses block noise.

The compression method of suppressing block noise is a method that does not impair the continuity of lines existing in an original image even when compressed image data is decompressed, and is the most suitable method for analyzing the skin texture condition. Examples of software implementing such compression methods include "MrSID" and the like, available from Celartem technologies, inc.

The compression rate of the high compression is a compression rate that can achieve a communication speed at which the analysis result is returned from the data analysis system within a few minutes after the necessary data is input at the store side, and is about one-tenth.

Various software already commercially available can be utilized as the compression method. These software blocks are provided to the collector-side processing unit 6 to compress the image data.

That is, the collection-side processing unit 6 configures the collection-side image data compression apparatus of the present invention.

On the other hand, the data analysis system 11 is equipped with a transmission and reception unit 12 as analysis-side communication means for performing communication with the data collection system 1, a central processing unit 13 corresponding to the data analysis means and the analysis-side image data compression means, a storage unit 14, and various databases 15 to 19.

The storage unit 14 is a storage unit that stores data transmitted from the data collection system 1 and stores analysis results analyzed by the central processing unit 13. The databases 15 to 19 are databases in which data necessary for analysis processing at the time of data analysis of the central processing unit 13 discussed in detail later is stored.

Examples of the data include: a customer database 15 in which customer information transmitted from a plurality of data collection systems 1 connected to the control center is stored; a face image database 16 in which a customer face image is stored; a skin identification criterion database 17 in which criterion data at the time of identifying a skin condition is stored; a skin care database 18 in which skin care methods corresponding to skin characteristics are stored; and a product information database 19 in which information on products distributed by each store is stored.

The criterion data stored in the skin-evaluation criterion database 17 is a criterion for replacing the result of image analysis performed for each diagnostic item with a level value for each skin condition. For example, in order to evaluate brightness (whiteness) of the whole face, luminance (brilliance) is measured from a face image, and a skin brightness level is determined using the measurement value. So that the skin brightness level equivalent to the image luminance is the criterion data.

The central processing unit 13 has the same function of image data compression as the collection-side processing unit 6, and can compress the image data by the high compression method of suppressing block noise.

Now, a process of diagnosing the skin condition of a customer who comes to a store in which the data collection system 1 is installed will be described.

In this section, an example of a comprehensive diagnosis of the skin condition of the customer's face, for example, whether the skin has any problems such as dry skin or the like, will be discussed.

First, in the store, the person in charge captures the entire face data of the customer using the photographing unit 2. In particular, the face of the customer is photographed using an ultra-high definition digital camera. At the time of shooting, the whole of the face clearly focused on the camera must be captured. Since taking pictures with a digital camera is a matter of everyone, and capturing analyzable images is not a particularly difficult matter if customer location, lighting conditions, and others are manually configured. This operation is simple and is a work that even a beginner can do, compared with a case where an image is captured with a microscope.

When the whole face image is captured from the photographing unit 2 as described above, the processing unit 6 compresses the image and transmits it to the data analysis system 11 through the transmitting and receiving unit 7 as compressed image data.

In the data analysis system 11, the central processing unit 13 receives the compressed image data through the transmitting and receiving unit 12 and analyzes the data after decompression.

Referring to fig. 2, the analysis process will be explained below.

The central processing unit 13 decompresses the received compressed image data and creates a whole face image. Fig. 2 shows the created face whole image 21. Based on the face whole image 21, skin diagnosis is performed.

First, the central processing unit 13 recognizes the skin color of the whole face image 21, determines a face contour line therefrom, applies feature point data of each face portion such as eyes, nose, mouth, and the like, which are constituent elements of the face, stored in advance, and determines the position of the face portion in the whole face image 21.

Next, as shown in fig. 3, the analysis section 22 is determined based on the information of the face section. The analysis section 22 may be provided as the whole face or as a specific region, for example, as a region such as a cheek or a tail of an eye suitable for a diagnostic item. The diagnostic item means an item of skin condition that is analyzed and identified by an image in the system. In particular, they are items including wrinkles, dry skin, and the like.

For example, in order to diagnose dry skin, cheeks that are prone to lose moisture are set as an analysis portion in advance, or in order to diagnose wrinkles, the canthus and both corners of the mouth are set as an analysis portion in advance.

In the first embodiment, in order to diagnose the skin condition of the entire face, a plurality of diagnostic items are set in advance and diagnosis is performed on all of them. For the determined analysis section, data analysis is performed for each diagnostic item to obtain an analysis result.

There are items to be analyzed such as texture condition, pore shape and size, etc., and an analysis process for each diagnostic item such as wrinkles, dry skin, moles, etc. These analysis items and procedures are set in advance in the analysis program of the central processing unit 13. The analysis is an image analysis process such as brightness (lightness), hue, and color distribution of a desired portion of the entire image of the face captured by the data collection system 1 side in accordance with the diagnostic item. For example, in the case where skin brightness (whiteness) is evaluated, brightness is measured by the entire image data, and in the case where color is evaluated, hue is evaluated by the entire image data, and all are compared with the criterion data to determine a score or level value of skin brightness.

Nevi and black eye circles are analyzed from the analyzed data such as the portion having the concentration exceeding the reference value, and the density and area thereof. Also for the texture and wrinkle, the texture and wrinkle are determined by determining a portion in which a dark portion continues in the form of a line. The evaluation result is output by comparing the measured values such as the blackness, size, distribution, etc. thereof with the reference data.

Further, among the diagnostic items, there are diagnostic items related to other diagnostic items. For example, dry skin is strongly associated with a texture condition. Therefore, in the case of diagnosis, the texture condition of the analysis portion corresponding to the diagnosis of dry skin is analyzed to obtain a texture condition converted into a number. This value is compared with the dry skin criterion data of the skin authentication criterion database 17 and the dry skin condition of the customer is determined.

The central processing unit 13 performs image analysis of brightness, color, density, line arrangement, and the like of a desired portion for all the diagnostic items, based on the analysis items of each diagnostic item. The analysis result of each analysis item is compared with the criterion data of the skin evaluation criterion database 17, and the skin condition of the customer is evaluated for each diagnosis item.

When the skin condition is identified by the analysis results of all the items to be diagnosed, the central processing unit 13 creates image information reflecting the diagnosis result on the whole face image 21 as shown in fig. 4.

That is, the central processing unit 13 creates diagnostic result image data for displaying a portion 23 in which wrinkles at the outer corners of the eyes are generated and a portion 24 in which dry skin of the cheeks is generated on the whole face image 21 by using different colors to distinguish them as shown in fig. 4.

The central processing unit 13 highly compresses the diagnosis result image data indicating the diagnosis result by a compression method of suppressing block noise and transmits them to the data collection system 1 through the transmitting and receiving unit 12.

In the data collection system 1, the received data is displayed on the display unit 3. On the display unit 3, as shown in fig. 4, a screen showing skin conditions distinguished by using different colors is presented on the face overall image 21 of the customer.

As shown in fig. 5, the skin condition level obtained in the central processing unit 13 may also be displayed on the display unit 3 together with the face whole image 21 using the graphic 30. The graph 30 shows the degree of the skin condition level of each diagnostic item including wrinkles as shown in fig. 6.

However, the skin condition level may be displayed not by the graphic 30 but by a color on the face whole image 21. For example, a dry skin level may also be indicated by a color intensity used to indicate a dry skin area.

By visually representing the diagnosis result on the whole-face image 21 in this way, the customer can sufficiently understand his/her skin condition, and also on the shop side, the salesperson can more easily make the customer clear his/her skin condition.

Further, as shown in fig. 7, in the data collection system 1, a specific position in the displayed face whole image 21 is selected with a mouse pointer 31 or the like, and its enlarged image can be displayed on the enlarged image display area 32.

The image displayed on the enlarged image display area 32 is an image based on an ultra-high definition image captured from the photographing unit 2 and has a level sufficient to accurately recognize the texture condition.

The reason why the skin condition can be diagnosed from the whole image of the face with ultra-high definition at a realistic speed can be attributed to: the processing time is shortened by allowing the data analysis system 11 of the control center having high processing capability to perform actual analysis processing; and communication time is shortened by transmitting and transmitting image data after high compression.

It makes no sense if the image data is degraded and the accuracy of analysis of the skin condition is degraded due to compression of the image data. However, the system of the present invention employs a compression method that suppresses block noise to allow compressed image data to maintain line continuity, which is critical to skin analysis. Thus, there is no fear of degradation of analysis accuracy due to compression.

In the first embodiment, the skin condition of the whole face of the customer is checked, but it may be allowed to analyze only diagnostic items of interest to the customer, for example, a problem area of the skin or the like.

In this case, the problematic areas of the customer's skin are input through the input unit 4 of the data collection system 1 and sent to the data analysis system 11. In the data analysis system 11, the central processing unit 13 specifies the diagnosis items corresponding to the received problematic areas, performs data analysis through the same procedure as the first embodiment, and outputs the diagnosis result.

Also in this case, on the display unit 3 of the data collection system 1, a specific color, which corresponds to the portion of the problematic area to assign to the portion, may be displayed on the entire image of the face of the customer. In addition, the degree of skin damage can be represented by a graph and a score.

The second embodiment shown in fig. 8 to 10 is an example which not only displays the skin condition with respect to individual diagnostic items as in the case of the first embodiment, but also calculates a comprehensive score of the skin condition by aggregating the analysis results.

However, this second embodiment has the same general system configuration as the first embodiment shown in fig. 1. Thus, a second embodiment is discussed with reference to fig. 1.

The overall skin condition evaluated in the second embodiment is a skin condition that affects the appearance and is the beauty of the skin.

Since the process of generating a diagnosis result from the image analysis of the individual diagnosis items and the function of displaying the diagnosis structure on the whole image of the face of the customer in the system of the second embodiment are the same as those of the first embodiment, the description thereof will be omitted. The focus will be described on the function of calculating a comprehensive score of the skin condition.

In this system, as shown in fig. 8, the diagnostic items B1 through B28 are classified into three intermediate items: skin color C1, irregularity C2, and vitality C3, and stores a table in which the coefficient values are in one-to-one correspondence with the associated items in the skin identification criterion database 17 shown in fig. 1. That is, the associated coefficient values B1 through B28 are in one-to-one correspondence with the diagnostic items B1 through B28, and the associated coefficient values C1 through C3 are respectively established in correspondence with the intermediate items C1 through C3.

The intermediate items C1 to C3 are elements relating to the skin condition a, and the condition in which these intermediate items are combined (integrated) is defined as the comprehensive skin condition a. Each of the intermediate items C1 through C3 summarizes the diagnosis results of the diagnosis items B1 through B28 classified as the intermediate items. Thus, the diagnostic items related to skin color such as complexion establish a correspondence with the skin color C1 of the intermediate item, and the diagnostic items related to irregularities of the skin surface have a one-to-one correspondence with the irregularities C2. Further, vitality C3 is also a project related to the skin surface condition, and diagnostic projects that change mainly with aging are associated therewith.

The coefficient values B1 to B28 of the diagnostic items B1 to B28 are numerical values indicating the degree of contribution of the diagnostic items to the classified intermediate items. The coefficient values C1 to C3 of the intermediate items C1 to C3 are numerical values indicating the degree of contribution of these intermediate items C1 to C3 to the skin condition a. The degree of contribution of brightness (whiteness) B1 to the middle item skin color C1 is the coefficient value B1, and the degree of contribution of color B2 is the coefficient value B2. This means that, for example, when the coefficient value B1 is greater than the coefficient value B2, the luminance (whiteness) B1 makes a larger contribution to the visible skin condition a than the color B2.

As described in the first embodiment, the central processing unit 13 may perform diagnosis by analyzing the whole-face image data of the customer, the subject, for each of the diagnosis items B1 to B28, and may express the evaluation result as a score. In the first embodiment, the skin condition is specified at a level in contrast to the criterion data of each diagnostic item, but in the present embodiment, a numerical value representing the level is specified as the score.

Assume that { B1} to { B28} represent scores regarding the diagnostic items B1 to B28, and scores of the intermediate items C1 to C3 and a score of the skin condition a are indicated with parenthesis attached, respectively. The scores { C1}, { C2}, and { C3} of the middle items and the score { a } of the skin condition are represented by equations (1) to (4) of fig. 9.

Thus, the central processing unit 13 obtains scores { B1} to { B28} of the diagnostic items B1 to B28, and the central processing unit can calculate a score { a } of the comprehensive skin condition using equations (1) to (4) shown in fig. 9.

Each coefficient value contained in equations (1) to (4) shown in fig. 9 varies according to age group. This is because the elements affecting the visual skin condition vary according to age group. For example, generally, younger age groups have skin radiance and skin elasticity, but in such age groups rough skin and periocular wrinkles may sometimes be more pronounced than in older age groups. That is, for the twenties, the fine skin texture B9 and the periocular folds B24 contribute more to the intermediate item, which is an element of beautiful skin color, than to other diagnostic items. For people over the age of forty, wrinkles on the cheeks make them suddenly older and confusing, but people over the age of 50 feel more concerned about items other than cheek wrinkles. In evaluating skin beauty, regions and items that should be emphasized differ in this way according to age group. Thus, in this system, each coefficient value is determined by age and stored.

For example, the coefficient values may be determined in the following manner.

First, assume a data structure as shown in fig. 10, which is supported by expressions (1) to (4). Scores { B1} through { B28} of the diagnosis items are obtained from the measurement data of actual customers of various ages and, at the same time, the appearance skin condition (i.e., visible skin condition) of the customer is evaluated to determine a score { A }. Next, a covariance structural analysis and the like are performed using the scores { A } and the scores { B1} to { B28} determined by visual inspection of the diagnostic items. Coefficient values B1 to B28 as contribution degrees of the diagnostic items B1 to B28 to each of the intermediate items C1 to C3, and coefficient values C1 to C3 as contribution degrees of the intermediate items C1 to C3 to the score { a } of the skin condition are calculated.

Thus, the calculated coefficient values are allowed to have one-to-one correspondence to the diagnostic items B1 through B28 and the intermediate items C1 through C3, and are stored in the skin identification criterion database 17.

In calculating the coefficient values, it is more preferable to have as many combinations of the visual scores { A } and the scores { B1} to { B28} based on the measurement data as possible, because coefficient values that meet practical values can be obtained. Further, the evaluation of the visible skin condition may be conducted by statistically processing the results of evaluations performed by experts experienced in diagnosing the skin condition, or the results of evaluations performed by a large number of inexperienced persons.

The score { A } of the visual assessment used in determining the coefficient values as described above is the visual score of the present invention. Only if the coefficient values are input into the central processing unit 13 of the system can the score { a } be calculated for a skin condition that is close to that which the central processing unit 13 has visually evaluated.

As described above, the central processing unit 13 analyzes the face whole image data transmitted from the data collection system 1 for each diagnosis item, converts the diagnosis result into a score, and calculates scores { C1} to { C3} of the intermediate items and further calculates a score { a } of the skin condition based on the score.

In calculating the score { a } of the skin condition of the customer, the central processing unit 13 transmits the result to the data collection system 1 through the transmitting and receiving unit 12 and allows the display unit 3 to display the result. However, as display data to be displayed by the display unit 3, the central processing unit 13 creates display data for displaying the calculated score and the coefficient value corresponding to each item on the same screen. Examples of planes displayed by the display data include the graphs shown in fig. 11 and 12.

Fig. 11 shows simultaneously the values of the coefficients of the global skin condition a, labelled "four-star", and the intermediate items C1 to C3 corresponding to the skin condition a. The score of skin condition { a } is indicated with a star label and it is determined that the greater the number of stars, the better the condition and the brighter the skin tone appears. This score { A } is a numerical value calculated by equation (4) of FIG. 9, and in this case, the number of star markers "four" is determined in accordance with this score.

In fig. 11, each of the middle items C1, C2, and C3 is taken as the abscissa, and the score of each item is taken as the ordinate. The sizes of scores C1, C2, and C3 are represented by the lengths of the dashed lines, and the coefficient values C1, C2, and C3 are represented by the diameters of the circles. However, the center position of each circle is the value of the score of each of the middle items C1 to C3.

Thus, the score { a } of the skin condition is a value obtained by multiplying and summing up C1, C2, and C3 corresponding to the circle diameter and scores { C1}, { C2}, and { C3} corresponding to the length of each broken line.

Thus, from fig. 11, the location of the factor rated as a skin condition score a of two star markers can be found. In the case of fig. 11, it is evident that the skin color C1 scores the lowest and the irregular C2 scores higher. Further, the coefficient value of skin color C1 is greater than that of irregular C2.

In such cases, it is contemplated that the overall score { A } may be effectively increased by improving skin color C1 and increasing the score, rather than by improving the irregular C2, which is currently at a satisfactory level.

Further, fig. 12 is a graph in which the scores of the diagnostic items constituting the middle item skin color C1 are represented on the abscissa and the coefficient values of the diagnostic items B1 to B8 are represented by circles. From this figure, not only are the advantages and disadvantages of the customer clarified, but it can be appreciated which item should be improved to effectively increase the score of skin tone C1. For example, fig. 12 indicates that in the diagnosis result of the customer, the score B3 of the overall facial matte is low and the coefficient value is large. Thus, it is understood that it would be effective to improve the overall skin condition by improving the overall dullness of the face.

When the middle item skin color C1 is selected by clicking the item name in a situation where the score of the middle item shown in fig. 11 is displayed on the screen of the display unit 3 on the data collection system 1 side, the graph shown in fig. 12 is displayed on the screen. However, this case represents an example in which the skin color C1 is selected from three intermediate items, and when other intermediate items are selected, a graph showing the scores of the diagnostic items corresponding to the intermediate items is displayed.

In the system of the second embodiment, the comprehensive skin condition can be quantitatively evaluated as a beautiful skin color. Further, the point to be improved is specified by the scores of the intermediate item and the diagnostic item respectively indicating the score for deriving the comprehensive skin condition.

Further, the coefficient value of each item is displayed so that the customer and the salesperson of the cosmetics shop can understand the item that can effectively improve the score of the skin condition.

The reason why the diagnostic items are classified into the intermediate items in the second embodiment and the scores and the coefficient values of the intermediate items are displayed as shown in fig. 11 is that the skin condition can be more effectively improved.

If no intermediate items are provided and only the scores of all diagnostic items are displayed, it can be assumed that the diagnostic item with the lowest score must be improved.

For example, among all the diagnostic items B1 to B28, the diagnostic item having the lowest score is pimple and pimple mark B15 (see fig. 8), assuming that pimples and pimple marks must be improved for the first time unless the score of the middle item is not known.

In practice, however, intermediate items are established and the scores are as shown in FIG. 11. The middle item containing pimples and pimple marks B15 was irregular C2, but as shown in fig. 11, the score was higher for irregular C2 and lower for skin color C1. This indicates that the score of each diagnostic item contained in the middle item skin color C1 is not the lowest score and is generally lower.

Further, the coefficient value C1 of skin color C1 is larger than the coefficient value C2 of irregular C2. In such cases, it is more effective to increase the score of skin color C1 to increase the score of the overall skin condition than to improve the score of acne and pimple marks B15 and increase the score of irregular C2. In particular, in order to increase the score of skin color C1, it is necessary to realize a skin care method for improving the face overall matte B3, lip matte B4, lightness B1, and the like. However, unless an intermediate item is established, it is difficult to understand that improving the items contained in skin color C1 to improve the score of the overall skin condition is effective. In the system of the second embodiment, such a thing does not occur, and it is easy to clarify an effective improvement item.

Further, setting the intermediate items in such a manner that diagnostic items improved by similar skin-caring methods are classified into the same intermediate item, a method of clearly improving skin conditions can be more effectively utilized using the scores of the intermediate items.

Fig. 13 shows an example of an intermediate item based on such a skin care method.

The intermediate items shown in fig. 13 are whitening C1, blood circulation C2, moisturizing C3, tightening C4, sebum and keratotic plugs C5, sagging C6, dry wrinkles C7, and senescent wrinkles C8. For whitening C1, as diagnostic items corresponding to skin conditions varying according to whitening makeup methods, brightness B1, color B2, face-overall-matt B3, conspicuous moles and mottles B5, and the like are classified.

Similarly, with respect to the blood circulation C2, diagnostic items of skin conditions that vary depending on the correctness or mistakes of the blood circulation are classified. With regard to moisturizing C3, diagnostic items of skin conditions that vary according to moisturizing are classified. With respect to tightening C4, diagnostic items of skin conditions that vary according to the tightening cosmetic method are classified. For sebum and keratotic plugs C5, diagnostic items related to the skin condition of sebum and keratotic plugs were classified. In addition, diagnostic items on skin sagging, dry wrinkles, and aged wrinkles are classified for sagging C6, dry wrinkles C7, and aged wrinkles C8, respectively.

In fig. 13, the names of the diagnostic items classified into each intermediate item are omitted and only symbols are shown, but the symbols used here are the same symbols B1 through B28 as used in fig. 8. The coefficient values allowed as the degree of contribution to the intermediate items respectively correspond to each of the diagnostic items.

However, in the classification method shown in fig. 13, the same diagnostic item corresponds to a plurality of intermediate items in some cases. For example, the diagnostic item black eye B8 is classified into the intermediate item whitening C1 and the blood circulation C2 at the same time. This is because dark circles may be caused by a melanin tendency or insufficient blood circulation.

As described above, since the coefficient value of a diagnostic item classified into a plurality of intermediate items represents the degree of contribution of the diagnostic item to the intermediate item into which it is classified, the coefficient value may vary according to the intermediate item.

Further, the coefficient values correspond to the intermediate items C1 to C8, respectively. When these are summed up to calculate the score of the skin condition a, the coefficient values corresponding to the relevant scores are multiplied and summed up as in the case of the equation shown in fig. 9.

In addition, the system according to the invention allows to connect a plurality of data collection systems 1 to the data analysis system 11 by communication. This makes it possible to register the customer information and the face images collected at a plurality of stores to the customer database 15 and the face image database 16. Furthermore, the analysis results at the central processing unit 13 may also be accumulated.

As described above, accumulation of customer data and facial images collected from customers throughout the country at a control center makes it possible for people to analyze these data and grasp regional differences in the skin condition of customers.

Since data of a large number of customers that cannot be collected by one store can be accumulated, it is possible to create a pattern of the face shape and the skin characteristics from the data and classify the data by the pattern.

Still further, if a large amount of data is accumulated and the criteria and trends of skin conditions by age can be grasped, such data can be utilized to predict future face shapes and skin conditions.

For example, changes in facial shape and changes in skin condition may be predicted according to the logic shown in fig. 14 and 15.

That is, as in the case of fig. 14, the entire image of the face of the customer is enlarged, the skin softness is estimated from the shape and smoothness of the mouth texture, and the customer skin is classified as "stable" or "unstable". In the case of the "stable" type, the face shape is classified into the "enlarged" type and the "slim" type, and the trend of the change can be determined.

Further, as in the case of fig. 15, the entire face image of the customer is enlarged. The moisture level of the skin is estimated by the degree of fine texture and smoothness of the cheeks, and the sebum level is estimated by the pore size, keratotic plug condition, and age. Next, the skin types were classified into a "soft" type and a "non-soft" type, and the "non-soft" type was further classified into a "more sebum" type and a "less sebum" type, so that the tendency of all types to change could be determined.

If a predicted future face image of the customer's future predicted from the change tendency determined as above is created and output, the predicted future face image can be displayed on the data collection system 1 side as well.

In particular, as shown in fig. 16, four types of skin conditions were created by age by the presence or absence of "stability", and by the "soft" type and the "non-soft" type, and each type was allowed to correspond to average face data having an average value of the skin conditions.

The average face data is a value calculated for each type that classifies customer data collected in the past by age, type of face, and presence or absence of stability. Allowing the mean value of the diagnostic items to correspond to each type. Such average face data is stored in advance in the skin identification criterion database 17 or the like on the data analysis system 11 side, for example. In implementation, although four types of data are allowed to correspond to all age groups, part of the data of the "not soft" type is omitted in fig. 16.

It is possible to recognize whether the skin type is the "stable" type or the "unstable" type by determining that the score of the diagnostic item soft skin B16 described in the second embodiment or the middle item vitality C3 is not less than the reference value set for each age group, or less than the reference value. In this case, as shown in fig. 16, the presence or absence of "stability" was classified using the vitality rating based on the score of vitality C3. The viability grade indicates loss of viability on a scale of 1 to 8.

In fact, when a future face image of a customer who comes to the store is on the data collection system 1 side, the entire image of the face of the customer is taken as in the case of the first and second embodiments. In the data analysis system 11, the skin condition is analyzed while the contour line of the face of the customer is analyzed from the whole face image, and it is recognized that the face shape of the customer is of an "enlarged" type or a "thin" type.

Then, the presence or absence of stability is determined from the skin diagnosis result based on the score of vitality C3, and it is determined to which of the above four types the customer belongs.

For example, in the case of a 40-year-old customer, in the "expanded" and "unstable" type, the customer belongs to the T1 type of fig. 16. This T1 type will become T2 type after 10 years.

Thus, when the face appearance of the customer 10 years later is predicted, the predicted future face image is created by applying the average value of the skin condition regarding the type of T2 to the face image of the customer. For example, a wrinkle condition that meets the score of the new line in the average face appearance is represented on the facial image of the customer.

However, this will vary when the customer has a skin condition that is far from the average face tolerance that fits the type of her/his age group.

For example, the average vitality rating of the T1 type is 4 but the vitality rating of the customer may be 3. On average, in the case where the above-mentioned customer ages from 40 to 50 years, the vitality rating changes from 4 to 5, but the customer has a vitality rating of 3 at 40 years. For this reason, when s/he becomes 50 years old, s/he will achieve a vitality rating of 4 by increasing 1 and should exhibit a skin condition satisfying this vitality rating.

In this way, the central processing unit 13 transmits the created predicted future face image to the data collection system 1 and allows it to be displayed on the display unit 3.

As described above, by accumulating a large amount of data in the data analysis system 1, immeasurable advantages can be achieved in which various analyses can be performed with even higher accuracy.

Further, by separating a large-sized processing unit for performing high-precision analysis from the data collection system, the number of shops in which small-sized data collection systems can be installed increases, and an even larger amount of data can be collected to the control center.

Further, the central processing unit 13 of the data analysis system 11 may select a skin care method from the skin care database 18 or a product from the product information database 19 according to the skin diagnosis result, and transmit the data to the data collection system 1.

For example, in skin care database 18, tables of various skin care methods are stored in one-to-one correspondence with reference points corresponding to the diagnostic items. When any item smaller than the reference point exists in the skin condition diagnosis result, the central processing unit 13 selects a skin care method corresponding to the item.

The product information is stored in the product information database 19, and the skin care method for the product is stored in each product in such a manner as to have correspondence. For example, lotions and creams used to provide moisturization to the skin are classified as "moisturization" and products used for whitening are classified as "whitening". Further, each skin care method is associated with a diagnostic item and an intermediate item, and a product is selected based on a score of the item.

For example, when the intermediate items described in the second embodiment are created from the skin care perspective as shown in fig. 13, a one-to-one correspondence is allowed for the product to each intermediate item and the correspondence table is stored in the product information database 19. In this way, the products necessary for improving the skin condition can be automatically selected depending on the scores of the intermediate items. However, product brands are often prepared in age groups. In such a case, it is necessary to prepare the correspondence table in the age group.

This enables the central processing unit 13 to select a skin treatment method suitable for the skin condition of the customer, product information, and other cosmetic information of the present invention, and display them on the display unit 3 of the data collection system 1. Even if the clerk is an inexperienced novice, she/he can explain the skin care method most suitable for the customer like an experienced clerk.

Claims (6)

1. A skin condition diagnosis system comprising a data collection system and a data analysis system for performing analysis processing based on data collected by the data collection system, both of which are connected to each other by a communication means,

the data collection system includes:

a collector communication means for transmitting/receiving data to/from the data analysis system;

an image capture device for capturing an ultra-high resolution digital image sufficient to analyze skin texture conditions;

a collection-side image data compression means for compressing image data by a high compression method that suppresses block noise; and

a data display device at the collecting end is provided,

the data analysis system includes:

an analysis-side communication means for transmitting/receiving data to/from the data collection means;

data analysis means for analyzing the image data;

an analysis-side image data compression means for compressing the image data by a high compression method that suppresses block noise; and

an analysis-side data storage device for storing the analysis result of the data analysis device,

the image capturing apparatus captures an entire image of a face of a subject as an ultra-high resolution digital image,

the collecting-side image data compressing means has a function of compressing the whole face image to create compressed image data and transmitting the image data compressed at the collecting side to the data analyzing system through the collecting-side communication means,

the data analysis means has a function of receiving the compressed image data through the analysis-side communication means, analyzing the skin condition of the subject from the received compressed image data, creating visual information reflecting the analysis result on the entire image of the face, and outputting the visual information as a diagnosis result,

the analysis side image data compression means compresses the diagnosis result output from the data analysis means to create compressed image data, and transmits the image data compressed at the analysis side to the data collection system via the analysis side communication means, and

the collector-side data display device has a function of displaying the diagnosis result transmitted from the analyzer-side communication device;

wherein the data analysis system further comprises a storage means for storing a plurality of diagnostic items relating to the skin condition, and

the data analysis means has a function of analyzing a skin condition from the whole face image data for each diagnosis item, calculating a score from the diagnosis result, and reflecting an evaluation result corresponding to the score to the whole face image;

and wherein the storage means classifies the plurality of diagnostic items into three intermediate items and stores them, and stores the intermediate items and the diagnostic items simultaneously in such a manner that they are associated with coefficient values, and

the data analysis device calculates a score of skin condition by summing up scores of all diagnostic items obtained by multiplying the calculated score of each diagnostic item by the coefficient value corresponding to the diagnostic item, calculating an intermediate item score for each intermediate item, multiplying the intermediate item score by the coefficient value corresponding to the intermediate item, and summing up the multiplied scores,

and wherein the intermediate item comprises: skin tone, irregularities, and vitality.

2. The skin condition diagnosis system according to claim 1, wherein the coefficient value is a value calculated by analyzing a relationship between a visual score of the visually determined skin condition and a score of each diagnosis item calculated by the data analysis means.

3. The skin condition diagnosis system according to claim 1, wherein the data analysis means has a function of creating display data for displaying the calculated score and the coefficient value corresponding to the item on the same screen.

4. The skin condition diagnosis system according to any one of claims 1 to 3, wherein the data analysis device performs:

a process of specifying constituent elements of a face in a whole-face image received from the data collection system;

specifying a course of diagnostic items;

a process of specifying a diagnostic portion on the whole face image that fits the specified diagnostic item based on the constituent elements of the face; and

a process of analyzing the image characteristics conforming to the skin condition corresponding to the diagnosis item presented in the diagnosis section.

5. A beauty counseling system comprising a data collecting system and a data analyzing system for performing an analyzing process based on data collected by the data collecting system, both of which are connected to each other by a communication means,

the data collection system includes:

a collector communication means for transmitting/receiving data to/from the data analysis system;

an image capture device for capturing an ultra-high resolution digital image sufficient to analyze skin texture conditions;

a collection-side image data compression means for compressing image data by a high compression method that suppresses block noise; and

a data display device at the collecting end is provided,

the data analysis system includes:

an analysis-side communication means for transmitting/receiving data to/from the data collection means;

data analysis means for analyzing the image data;

an analysis-side image data compression means for compressing the image data by a high compression method that suppresses block noise;

the analysis end data storage device is used for storing the analysis result of the data analysis device; and

a beauty information storage device for storing beauty information,

the image capturing apparatus captures an entire image of a face of a subject as an ultra-high resolution digital image,

the collecting-side image data compressing means has a function of compressing the whole face image to create compressed image data and transmitting the image data compressed at the collecting side to the data analyzing system through the collecting-side communication means,

the data analysis device includes:

a function of receiving the compressed image data by the analysis-side communication device, analyzing a skin condition of the subject from the received compressed image data, creating visual information reflecting the analysis result on the entire face image, and outputting the visual information as a diagnosis result; and

a function of extracting and outputting cosmetic information suitable for the subject from the cosmetic information storage device based on the diagnosis result,

the analysis side image data compressing means compresses the diagnosis result output from the data analyzing means to create compressed image data, and transmits the image data compressed at the analysis side to the data collecting system through the analysis side communication means together with the extracted beauty information, and

the collector data display device has a function of displaying the diagnosis result and the beauty information transmitted from the analyzer communication device;

wherein the data analysis system further comprises a storage means for storing a plurality of diagnostic items relating to the skin condition, and

the data analysis means has a function of analyzing a skin condition from the whole face image data for each diagnosis item, calculating a score from the diagnosis result, and reflecting an evaluation result corresponding to the score to the whole face image;

and wherein the storage means classifies the plurality of diagnostic items into three intermediate items and stores them, and stores the intermediate items and the diagnostic items simultaneously in such a manner that they are associated with coefficient values, and

the data analysis device calculates a score of skin condition by summing up scores of all diagnostic items obtained by multiplying the calculated score of each diagnostic item by the coefficient value corresponding to the diagnostic item, calculating an intermediate item score for each intermediate item, multiplying the intermediate item score by the coefficient value corresponding to the intermediate item, and summing up the multiplied scores,

and wherein the intermediate item comprises: skin tone, irregularities, and vitality.

6. The cosmetic counseling system of claim 5, wherein the cosmetic information comprises: cosmetic information.