JP2018173704A - Information provision system, information provision method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide information on a combination of clothes, which is valuable to a user, based on a simpler operation for the user. An information providing system according to an embodiment combines a second image, which is an image of clothing, with the first image and a combination of clothing performed by a user in the past. The combination determination unit, which is determined from the images of a plurality of clothes associated with the user's identification information, and the first image and the determined second image are determined based on the determination information indicating the determination. It includes a compositing unit that generates a composited composite image and a providing unit that provides the composite image. [Selection diagram] FIG. 14

Description

  The present disclosure relates to a technique for providing information related to a combination of clothes.

  Services that provide information on clothing combinations are widespread.

  Patent Document 1 discloses a fashion coordination service system that displays clothes that meet a user's request using information such as temperature, humidity, wind speed, and weather of whereabouts.

  Patent Document 2 discloses an information providing system that creates try-on image data by combining product images and customer body shape data.

  Patent Document 3 discloses a try-on image display device that generates a try-on image by combining input images based on part information and displays the try-on image.

JP 2014-013460 A JP 2006-251839 A JP 2006-135876 A

  Depending on the technologies disclosed in Patent Documents 1 to 3, the user does not always easily obtain information valuable to the user.

  For example, the combination of clothes proposed by the system disclosed in Patent Literature 1 is a combination selected by the user in the past. Therefore, a fresh combination is not proposed for the user. In addition, there is a possibility that clothes including clothes that the user wants to use are not proposed.

  In the techniques disclosed in Patent Documents 2 and 3, it is necessary for the user to consider the combination of clothes.

  An object of the present invention is to provide information on a combination of clothes that is valuable to the user based on a simpler operation for the user.

  The information providing system according to one aspect of the present invention combines a first image, which is an image of clothing, with a second image as a combination of the first image and clothing made by the user in the past. The combination determining means for determining from the plurality of clothing images associated with the user identification information, and the first image and the determined second image are combined based on the determination information indicating Composing means for generating a composite image, and providing means for providing the composite image.

  In the information providing method according to one aspect of the present invention, the second image is combined with the first image, which is an image of clothing, and the second image is determined for the combination of the first image and the clothing performed by the user in the past. Based on the determination information indicating the user's identification information, and determining a plurality of clothing images associated with the user's identification information, and generating a composite image by combining the first image and the determined second image , Providing the composite image.

  The program which concerns on 1 aspect of this invention is combined with the combination of the said 1st image and the clothing which the user performed in the past, combining the 2nd image with the computer with respect to the 1st image which is an image of clothing. Based on the determination information indicating the determination, a combination determination process that is determined from a plurality of clothing images associated with the identification information of the user, and the first image and the determined second image are combined. A combining process for generating the combined image and a providing process for providing the combined image are executed.

  ADVANTAGE OF THE INVENTION According to this invention, based on simpler operation for a user, the information regarding the combination of clothing which is valuable for a user is provided.

It is a block diagram which shows the structure of the information provision system which concerns on the 1st Embodiment of this invention. It is a figure which shows the example of the 1st screen displayed on a display part. It is a figure which shows the example of the 1st screen displayed on a display part. It is a figure which shows the example of the data memorize | stored in a database. It is a figure which shows the example of the data memorize | stored in a database. It is a flowchart which shows the flow of operation | movement of the terminal which concerns on clothing registration, and a proposal system. It is a flowchart which shows the flow of operation | movement of the terminal which concerns on provision of information, and a proposal system. It is a figure which shows the example of the screen on which a synthesized image is displayed on a display part. It is a block diagram which shows the structure of the information provision system which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the flow of operation | movement of the shop terminal and proposal system which concern on 2nd Embodiment. It is a flowchart which shows the flow of operation | movement of the purchase reception apparatus and proposal system which concern on the modification of 2nd Embodiment. It is a block diagram which shows the structure of the information provision system which concerns on the modification of 2nd Embodiment. It is a block diagram which shows the structure of the information provision system which concerns on the modification of 2nd Embodiment. It is a block diagram which shows the structure of the information provision system which concerns on one Embodiment of this invention. It is a flowchart which shows the flow of the information provision method which concerns on one Embodiment of this invention. It is a block diagram which shows the example of the hardware which comprises each part of each embodiment of this invention.

  In the present disclosure, “clothing, garment” is a general term for things to be worn. “Clothing” may include hats, glasses, ornaments, shoes, etc., as well as wearing apparel.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<< First Embodiment >>
First, a first embodiment of the present invention will be described. In the first embodiment, the proposed system 21 provides a composite image indicating a combination of clothes to the terminal 11 used by the user.

<Configuration>
FIG. 1 is a block diagram illustrating a configuration of an information providing system 1 according to the first embodiment. The information providing system 1 includes a terminal 11 and a proposal system 21. The terminal 11 and the proposal system 21 are connected via a communication network 99 so that they can communicate with each other.

=== Terminal 11 ===
The terminal 11 is an information processing apparatus used by a user who uses a service provided by the proposal system 21. The terminal 11 is, for example, a mobile phone, a smartphone, a tablet, and a PC (Personal Computer).

  The terminal 11 includes a communication unit 110, an imaging unit 111, an input reception unit 112, a display unit 113, and a control unit 115. Each unit included in the terminal 11 is connected to be communicable with each other so that information can be shared.

  The communication unit 110 transmits / receives information to / from the proposal system 21 via the communication network 99.

  The imaging unit 111 performs imaging. The imaging unit 111 is, for example, a camera mounted on a terminal. The imaging unit 111 images clothing. For example, the user may adjust the angle of view of the imaging unit 111 and instruct the imaging unit 111 to take an image when the angle of view is that the clothing is captured.

  As an example of modification, the imaging unit 111 may be a separate device from the terminal 11. For example, the imaging unit 111 is a camera installed on a wall or a figure, and may be configured to transmit a captured image to the terminal 11 by wired or wireless communication.

  The input receiving unit 112 receives input of information by the user. For example, when the terminal 11 is a smartphone or a tablet, the input reception unit 112 is a touch panel. When the terminal is a PC, the input receiving unit 112 is, for example, a keyboard and a mouse.

  The display unit 113 displays information. When the terminal 11 is a smartphone or a tablet, the display unit 113 is, for example, a touch panel. When the terminal is a PC, the input reception unit 112 is, for example, a monitor.

  The display unit 113 displays information, for example, by displaying an image on the screen.

  As an example of change, the display unit 113 may be replaced with an output unit that outputs information to a device connected to the terminal 11. For example, when the terminal 11 is connected to a printer as an output device, the output unit may output information to the printer, and the printer may print the information. Alternatively, for example, the output unit may store information in a storage medium such as a flash memory.

  The control unit 115 controls processing of each unit included in the terminal 11. Each process of each unit included in the terminal 11 may be performed according to an instruction from the control unit 115. The function of the control unit 115 is realized, for example, by executing a program installed in the terminal 11 by a processor included in the terminal 11.

  For example, when the user wants to receive a service provided by the proposal system 21, the user may activate an application for executing the program. Thereby, the control unit 115 may start processing.

  Hereinafter, a specific example of processing performed by the control unit 115 will be described.

  The process performed by the control unit 115 includes a registration request process and an information acquisition process. For example, after the application is activated, the user may instruct the terminal 11 via the input reception unit 112 which process the control unit 115 performs.

[Registration request processing]
The registration request process is a process for requesting that the combination of the clothes owned by the user and the clothes adopted by the user be registered in the database 214 of the proposal system 21. In this process, the control unit 115 performs a process of causing the user to photograph clothing and transmitting a captured image acquired thereby to the suggestion system 21.

  For example, first, the control unit 115 causes the display unit 113 to input a selection of whether to image clothing that the user is wearing or clothing that the user is not wearing. Display the screen for And the control part 115 receives the selection by a user by the input reception part 112. FIG.

  When the user selects to image the clothing worn by the user, the control unit 115 activates the imaging unit 111 and displays the first screen for imaging the clothing worn by the user. It is displayed on the display unit 113. 2 and 3 are diagrams showing examples of the first screen.

  The first screen includes, for example, an image showing an angle of view image captured by the imaging unit 111 and an instruction regarding the user's position with respect to the user. FIG. 2 is an example of a first screen when nothing is captured by the imaging unit 111. For example, as illustrated in FIG. 2, on the first screen, the position where the user should be located in the angle of view captured by the imaging unit 111 is displayed with a broken line. Specifically, for example, positions to be positioned such as the position of the head, the position of the upper body, the position of the lower body, and the like are shown. As shown in FIG. 2, a broken line indicating the position of the waist may also be displayed.

  For example, the user stands in front of a mirror such as a figure and looks at the first screen so that each part of his / her body is positioned at the position indicated on the first screen. Adjust the angle of view and your posture. FIG. 3 is a diagram illustrating an example of a first screen in a state where a user is shown.

  The control unit 115 receives an imaging instruction for the imaging unit 111 from the user. For example, when the terminal 11 is a smartphone, the control unit 115 causes the display unit 113 to display an area where “shooting” is written, as illustrated in FIG. 3. When the input receiving unit 112 receives that the user has touched this area, the control unit 115 instructs the imaging unit 111 to perform imaging. In this way, the imaging unit 111 acquires a captured image including a user wearing clothes.

  When the user operates the input receiving unit 112 and selects to image clothing that the user does not wear, the control unit 115 activates the imaging unit 111 and captures clothing that the user does not wear. A second screen for displaying is displayed on the display unit 113. For example, the second screen may include an image captured by the imaging unit 111. In this case, the user adjusts the angle of view of the imaging unit 111 so that the clothing appears on the second screen while looking at the second screen by spreading the clothing to be registered on the floor or hanging on a hanger. .

  On the second screen, for example, the control unit 115 causes the display unit 113 to display an area where “shooting” is written, as in the first screen. When the input receiving unit 112 receives that the user has touched this area, the control unit 115 instructs the imaging unit 111 to perform imaging. In this way, the imaging unit 111 acquires a captured image including clothing that the user does not wear.

  The control unit 115 may acquire various information regarding the captured clothing from the user after the captured image including the clothing is acquired. For example, the control unit 115 acquires, from the user, information on whether or not the captured clothing is the clothing that the user adopts (that is, intends to wear on) that day (the captured date). May be. For example, the control unit 115 may display a sentence indicating a question “Is it today's coordination” on the display unit 113 and receive an answer by the input receiving unit 112.

  Further, for example, when a captured image including a plurality of clothing combinations is acquired, the control unit 115 may accept an evaluation by the user with respect to the captured clothing combinations. For example, the control unit 115 causes the display unit 113 to display a sentence indicating a question “Please rate the satisfaction of this coordination with a maximum score of 5” and a numerical value of 1 to 5, and the input receiving unit 112 displays 1 The selection of any numerical value of 5 is accepted. When the selection of the numerical value is received, the control unit 115 acquires the selected numerical value as information indicating evaluation for the captured clothing combination.

  In addition, for example, the control unit 115 may accept an input of captured clothing characteristics. The characteristics of clothing are, for example, type, color, pattern, shape, size, material, laundry information, and the like. However, for features that can be distinguished from the captured image, such as the color, pattern, and shape of clothing, the control unit 115 may not accept input of the features.

  The types of clothing include, for example, a large classification and a small classification. The major classification is a classification based on a part on which clothing such as “tops” or “bottoms” is worn. The small classification is a classification based on the shape or material of clothing, such as “blouse”, “shirt”, or “cardigan”.

  Clothes washing information is information about washing the clothes, for example, washing method, how to dry, whether or not washing is possible at home, ease of washing (for example, represented by a numerical value of 5 levels), and It is easy to dry (for example, it is expressed by a numerical value of 5 levels).

  Further, the control unit 115 may receive, from the user, the comfort and the degree to which the user likes the clothing as characteristics of the clothing.

  The control unit 115 may acquire information about clothing that the user is about to capture from the user before the captured image including the clothing is acquired.

The control unit 115 obtains the acquired captured image and the information about the clothing included in the captured image acquired by inputting the answer from the user, together with a request for registering the clothing (registration request), via the communication unit 110. To the proposal system 21.
[Information acquisition processing]
The information acquisition process is a process for requesting the proposal system 21 to propose a combination of clothes and acquiring a composite image showing the proposed combination of clothes.

  The control unit 115 receives, from the input receiving unit 112, an input from the user (that is, an instruction to acquire a proposal) indicating that the user desires to acquire a proposal for a combination of clothes by the proposal system 21.

  When the control unit 115 receives the input, the control unit 115 sets a condition regarding the combination of clothes proposed by the proposal system 21 (hereinafter, “proposed condition”). For example, the control unit 115 sets a proposal condition based on information acquired by the input reception unit 112.

  The proposal condition set by the control unit 115 includes designation of at least one garment. That is, the control unit 115 sets a condition that a combination of clothes including the specified clothes is proposed as one of the proposal conditions. Hereinafter, clothing designated as clothing to be included in the proposed combination under the proposed conditions is referred to as “designated clothing”.

  For example, the designated clothing is determined as follows.

  First, the control unit 115 displays a plurality of clothing images together with a message “Please select clothing you want to use” on the display unit 113, and accepts an operation of selecting the clothing that the user wants to use. At this time, the plurality of clothing images displayed by the control unit 115 are, for example, clothing images (described later) of clothing owned by the user stored in the database 214 described later. The user taps (clicks) on the image of the clothing that the user wants to use, thereby selecting the clothing that the user wants to use, ie, the designated clothing. When an image is selected, control unit 115 determines clothes included in the selected image as designated clothes.

  The control unit 115 may accept selection of two or more clothes and determine the two or more clothes as designated clothes.

  As another method for determining the designated clothing, the control unit 115 may acquire a captured image of the clothing. For example, the control unit 115 causes the display unit 113 to display a message for instructing the user to operate the imaging unit 111 to image clothing that the user wants to use. Then, when the user images clothing, the control unit 115 determines the captured clothing as designated clothing.

  In the other method, the clothing to be imaged is not limited to clothing stored as clothing owned by the user in the database 214. However, it may be specified whether the imaged clothing is the clothing stored in the database 214 as the clothing owned by the user. That is, the control unit 115 transmits the captured image to the suggestion system 21, and the clothing image generation unit 212 identifies the captured clothing, detects the feature of the clothing, and stores the feature in the database 214 based on the detected feature. It may be specified whether the clothing image is stored.

  As described above, the control unit 115 sets the designated clothing.

  The control unit 115 may accept setting of other conditions included in the proposed condition, in addition to setting the designated clothing.

  For example, the control unit 115 may prompt the user to set a proposal condition related to the characteristics (color, material, comfort, washing information, etc.) of the clothing used. The control unit 115 may display a screen for setting the proposed condition on the display unit 113, and accept the setting input by the input receiving unit 112.

  The control unit 115 transmits a request for proposing a combination of clothes and the set proposal condition to the proposal system 21 via the communication unit 110. When the designated clothing is acquired by imaging, the control unit 115 transmits the acquired captured image of the designated clothing to the suggestion system 21.

  Hereinafter, a request for proposing a combination of clothes is also referred to as a proposal request.

  In addition, when the communication unit 110 receives the composite image transmitted from the proposal system 21, the control unit 115 causes the display unit 113 to display the received composite image.

[Other controls]
The control unit 115 may acquire user information and transmit the user information to the suggestion system 21.

  The user information includes, for example, the user's sex, age, height, physique, size of each part, skin color, facial image, and the like. The control unit 115 may acquire user information by receiving input of user information from the user via the input receiving unit 112. The control unit 115 may acquire a captured image captured by the user as user information. Then, the control unit 115 may transmit user information to the proposal system 21.

=== Proposed system 21 ===
The proposal system 21 is a system that proposes a combination of clothes.

  The proposal system 21 includes a communication unit 210, a specification unit 211, a clothing image generation unit 212, a registration unit 213, a database 214, a combination determination unit 215, a synthesis unit 216, a learning unit 217, and a knowledge database 218. Each unit included in the terminal 11 is connected to be communicable with each other so that information can be shared.

  The communication unit 210 transmits / receives information to / from the communication unit 110 of the terminal 11 via the communication network 99.

  The identifying unit 211 identifies the user of the terminal 11 that has transmitted the data received by the communication unit 210. When the proposed system 21 can communicate with a plurality of terminals 11, the terminal 11 includes information that can identify the user in data transmitted to the proposed system 21. The identifying unit 211 identifies the user based on information that can identify the user. The information that can identify the user may be, for example, identification information of the terminal 11 or user identification information.

  In the following description, it is assumed that a user is specified.

  The clothing image generation unit 212 generates a clothing image from the captured image transmitted from the terminal 11 by the registration request process. Specifically, clothing image generation unit 212 generates each image of clothing included in the captured image as a clothing image.

  An example of processing by the clothing image generation unit 212 for a captured image including clothing worn by the user is as follows.

  First, the clothing image generation unit 212 detects each region where clothing is present, which is included in the captured image. For example, the clothing image generation unit 212 detects the region by detecting the boundary of each clothing included in the captured image based on the pixel value.

  Then, the clothing image generation unit 212 identifies the type of clothing (large classification, small classification, etc.). The large classification of clothing (for example, whether it is tops or bottoms) can be specified based on the position in the captured image. For example, the clothing image generation unit 212 may identify the large classification of each clothing based on the relationship between the instruction displayed on the first screen and the position of the clothing in the captured image. The clothing image generation unit 212 may detect the user's posture and identify the clothing based on the detected posture. The clothing image generation unit 212 detects and identifies, for example, clothing covering the upper body (tops), clothing covering the legs (bottoms), and clothing covering the feet (socks or shoes). The clothing image generation unit 212 may further identify clothing worn on the head (hair accessory), neck ornaments, ornaments attached to the wrist, and the like.

  The clothing image generation unit 212 may further specify a small classification of clothing (whether it is a blouse or a shirt). For example, the clothing image generation unit 212 may specify a small classification of clothing based on the shape of clothing using sample data of clothing. Alternatively, when the information on the clothing that has been captured has already been acquired by the input from the user, the clothing image generation unit 212 determines each clothing based on the information. What is necessary is just to determine the small classification of.

  The clothing image generation unit 212 generates a clothing image of the identified clothing. Specifically, the clothing image generation unit 212 cuts out a region where the identified clothing is present from the captured image, and generates an image of the cut out region as a clothing image. The clothing image is, for example, an image including only one (or one set) clothing. Alternatively, the clothing image may be an image including a combination of clothing having the same large classification.

  The clothing image generation unit 212 may generate a clothing image of the clothing in a shape when the user wears the clothing by estimation. In the estimation, for example, the clothing image generation unit 212 may estimate the shape of the clothing and the position on the user's body when the user wears it. In the above estimation, the clothing image generation unit 212 may use information on the user's body shape and information such as the size of clothing. Information relating to the user's body shape may be stored in the database 214 as one piece of user information. Information such as clothing size may be acquired by input from the user. The clothing image generation unit 212 may deform the clothing image based on the estimated shape and position and generate a clothing image of the deformed clothing.

  In addition, when a part of the imaged clothing is hidden or disturbed, the clothing image generation unit 212 may correct the clothing image of the clothing. Specifically, for example, the clothing image generation unit 212 may correct a hidden or disturbed portion based on the symmetry of clothing. For example, when a portion corresponding to the right arm of a clothing that is a symmetric type is hidden or disturbed, the clothing image generation unit 212 hides an image obtained by inverting the portion corresponding to the left arm of the clothing. Alternatively, the portion corresponding to the right arm may be corrected by superimposing it on the portion that is disturbed.

  Further, for example, when the upper part of the clothing image of clothing corresponding to the bottoms is missing because it is hidden by the clothing corresponding to the tops, the clothing image generation unit 212 corresponds to the bottoms based on the position of the waist. Correction that complements the clothing image of the clothing may be performed.

  In addition to the corrections listed above, the clothing image generation unit 212 estimates the shape and color of a hidden or disturbed part based on the sample data of clothing, and corrects the image based on the estimated result. May be.

  The clothing image generation unit 212 may correct the size of the clothing image so that the size of the captured clothing is unified. That is, the clothing image generation unit 212 may correct the size of the clothing image so that the ratio of the size in units of pixels between the clothing images is equal to the ratio of the actual clothing dimensions.

  The clothing image generation unit 212 may process the clothing image so that the postures of the same type of clothing are unified.

  The registration unit 213 registers information about clothes included in the captured image transmitted from the terminal 11 by the registration request process in the database 214.

  For example, the registration unit 213 stores the clothing image generated by the clothing image generation unit 212 in the database 214 so that the clothing image and information about clothing included in the clothing image are associated with each other.

  The registration unit 213 registers information related to the combination of clothes adopted by the user.

  The registration unit 213 registers user information in the database 214 when user information is transmitted from the terminal 11.

  The database 214 stores various data for services by the proposal system 21.

  For example, the database 214 stores the clothing image generated by the clothing image generation unit 212.

  FIG. 4 is a diagram illustrating an example of data stored in the database 214.

  The database 214 stores clothing included in the captured image transmitted from the terminal 11 by the registration request process as clothing owned by the user of the terminal 11 (hereinafter also referred to as “user's property”). FIG. 4 shows an example of data relating to clothes owned by a user whose identification number is “user01”. The database 214 stores, for example, each clothing identification number, owner identification number, clothing image, and clothing characteristics in a tabular form as shown in FIG. However, the data format is not limited to the tabular format. The information shown in FIG. 4 is an example, and the database 214 may store more information.

  The clothing identification number may be given by the registration unit 213.

  The database 214 may further derive clothing features from the stored data and store the features. For example, the database 214 may derive “easy to dry” as one of the characteristics of clothing and store the information. The ease of drying is derived from, for example, the thickness of the fabric constituting the clothes, the material, and how to dry.

  The database 214 further stores information on the combination of clothes adopted by the user, transmitted from the terminal 11 by the registration request process. FIG. 5 is a diagram illustrating an example of information related to the combination of clothes adopted by the user, which is stored in the database 214. For example, as shown in FIG. 5, the database 214 stores the date and time (shooting date and time) when the captured image of the adopted clothing combination was acquired, the adopted clothing combination, and weather information (average) on the date when the combination was adopted. Temperature and precipitation probabilities, etc.), and user ratings for the clothing combinations employed are stored. The combination of clothing is represented using, for example, a clothing identification number.

  The database 214 stores user information.

  The learning unit 217 learns the relationship between the information stored in the database 214 based on the information stored in the database 214. The learning unit 217 derives information indicating the relationship between the combination of clothes that the user prefers and information about the combination of clothes by performing learning.

The learning unit 217 receives, for example, the following information, and learns the relationship between the following information.
1st information: Combination of clothing adopted by the user 2nd information: Clothing available for the user 3rd information: Characteristics of clothing used for the adopted combination 4th information: Adopted combination Time information related to the date and time adopted Fifth information: weather information on the date when the adopted combination is adopted The time information includes the season, date, day of the week, and time when the captured image was acquired.

  The weather information is the weather, temperature, humidity, probability of precipitation, wind strength, and the like of the user's residence or the user's whereabouts on the day when the captured image was acquired.

  The clothing usable by the user is, for example, clothing owned by the user. However, clothes that have not been washed may be excluded from usable clothes. The clothes that have not been washed are, for example, clothes that have been used in the last n days (n is a predetermined integer). The suggestion system 21 may be configured to receive information from a user that can identify clothes that have not been washed.

  The combination of the above first to fifth information can be said to be information on the determination made by the user in the past.

  Assuming that the combination of clothing adopted in the past is based on the environment and preferences surrounding the user, the first to fifth combinations of information described above are the environment and preferences surrounding the user, etc. It is the information which shows the judgment of the user based on. Therefore, by learning by the learning unit 217, for example, a combination of colors that the user can easily adopt, types of clothes that the user can easily select on Monday, combinations of clothing materials that the user can easily select on rainy days, and the like The tendency of the user's judgment according to the surrounding environment and preferences can be clarified.

  The learning method performed by the learning unit 217 may be a generally known method of learning the relationship between a plurality of data. For example, the learning unit 217 may perform multivariate analysis to derive the relationship between the input data and the output data when the first information is input data and the second to fifth information is output data. . That is, the learning unit 217 may derive a model for deriving a combination of clothes based on the second to fifth information.

  The learning unit 217 may derive a model for deriving a combination of clothes based on the second to fifth information by heterogeneous mixed learning.

  The second to fifth information is an example, and information used as input data for learning using a combination of clothes as output data is not limited to the second to fifth information.

  The learning unit 217 may perform learning using sixth information that is information indicating evaluation by the user for the adopted combination. The sixth information is also information on determinations made by the user in the past. The combination of the first to sixth information is information indicating the tendency of the user to evaluate the combination of clothes, that is, the preference of the combination of clothes. Therefore, the learning of the learning unit 217 may reveal the tendency of the combination of clothes that the user likes (highly evaluates). For example, the learning unit 217 may derive a model for deriving the sixth information based on the first to fifth information.

  In the present embodiment, information obtained as a result of learning by the learning unit 217 is referred to as “knowledge”. In other words, the knowledge obtained is knowledge about user preferences and judgment tendencies that are generated based on information about judgments on clothes that the user has made in the past.

  The learning unit 217 stores the obtained knowledge in the knowledge database 218.

  The learning unit 217 may use information related to the determination made by a person unrelated to the user as information for learning. For example, the learning unit 217 may use, as information for learning, an image including a combination of clothes that is uploaded to a specific web page as needed. Further, for example, the learning unit 217 may learn information on determinations made by a plurality of users in the past. At this time, the learning unit 217 may perform learning including user information. As a result, it is possible to obtain knowledge about user preferences and judgment tendencies according to user characteristics and the like.

  The combination determination unit 215 determines a combination of clothes in response to a request (proposal request) for proposing a combination of clothes from the control unit 115 of the terminal 11. The combination determination unit 215 determines clothing combinations that satisfy the set conditions based on the conditions set by the control unit 115.

  As an example, it is assumed that the set condition is “a combination of clothes owned by the user using the clothes G1”. The combination determination unit 215 determines a combination of the clothing G1 and other clothing owned by the user. A combination determined by the combination determination unit 215 is a combination of clothes proposed by the proposal system 21.

  The combination determination unit 215 determines a combination of clothes based on not only the set conditions but also the knowledge stored in the knowledge database 218.

  That is, the combination determination unit 215 applies knowledge using the set conditions as input data, and outputs a combination of clothes. However, in addition to the set conditions, the combination determination unit 215 may use weather information, time information, and usable clothing information on that day (the day on which the proposal request is transmitted).

  For example, the combination determination unit 215 determines a combination of clothing that is most likely to be adopted by the user on that day (the date on which the proposal request is transmitted). That is, the combination determination unit 215 applies the model derived by the learning unit 217 using, for example, the conditions related to the day (information corresponding to the second to fifth information) as input data, and uses the combination of clothes as output data. To derive. Then, the combination determination unit 215 may determine the derived combination as a proposed combination of clothes.

  Alternatively, the combination determination unit 215 may determine a combination that is expected to have the highest user evaluation among combinations of clothing that satisfy the set conditions. That is, for example, the combination determination unit 215 may derive a combination of clothes that has the highest value derived from the knowledge obtained as a result of learning the relationship between the first to sixth information. Good. Then, the combination determination unit 215 may determine the derived combination as a proposed combination of clothes.

  However, conditions for determining combinations may be adjusted, such as excluding combinations that have been adopted within a predetermined number of days in the past.

  The composition unit 216 synthesizes the clothing images included in the clothing combination determined by the combination determination unit 215. Hereinafter, an image generated as a result of the synthesis by the synthesis unit 216 is referred to as a synthesized image.

  An example of a specific procedure of synthesis by the synthesis unit 216 is as follows.

  First, the composition unit 216 prepares a background image for composition. The background image may be stored in the synthesis unit 216 or read from the database 214. The background image may be a white color image or an image in which an arbitrary landscape is drawn. In the background image, an illustration or a photograph showing the user's face and body may be drawn.

  Then, the synthesis unit 216 reads out the clothing image of the clothing included in the clothing combination determined by the combination determination unit 215 from the database 214. However, if the designated clothing is clothing that is not stored in the database 214 and a captured image of the designated clothing is transmitted from the terminal 11, the combining unit 216 uses the captured image. Then, the synthesis unit 216 determines the position where the read clothing image is arranged in the background image based on the type of clothing included in the clothing image. For example, if it is determined that the read clothing image is a clothing image of clothing classified as “tops”, the composition unit 216 determines from the position where the clothing image of clothing classified as “bottoms” is arranged. The upper position is determined as the position where the clothing image is arranged. Thus, the position where the clothing image is arranged may be determined according to the large classification of clothing.

  Then, the composition unit 216 superimposes the clothing image on the determined position of the background image. The order in which clothing images are superimposed may be determined in advance as an order based on the type of clothing. In this way, the composition unit 216 generates a composite image on which clothing images are superimposed.

  The composition unit 216 sends the generated composite image to the communication unit 210.

<Operation>
Hereinafter, the flow of operations of the terminal 11 and the proposal system 21 in the information providing system 1 will be described.

[Register clothing]
First, operations of the terminal 11 and the proposal system 21 relating to the process of registering clothes owned by the user will be described. The process of registering clothes is a process of storing information about clothes in the database 214 as illustrated in FIG.

  FIG. 6 is a flowchart for explaining the flow of operations of the terminal 11 and the proposal system 21 relating to the process of registering clothes owned by the user.

  First, the imaging unit 111 images clothing that the user owns (step S111). For example, the control unit 115 prompts the user to image clothing using the imaging unit 111. Then, when the user captures clothes that the user wants to register with the imaging unit 111, the imaging unit 111 generates a captured image including the clothes.

  When the captured image is generated, the communication unit 110 transmits a registration request and the captured image to the suggestion system 21 based on an instruction from the control unit 115 (step S112).

  The communication unit 210 of the proposal system 21 receives the registration request and the captured image (step S113). Then, the clothing image generation unit 212 identifies clothing included in the captured image (step S114). Then, the clothing image generation unit 212 generates a clothing image of the identified clothing (Step S115).

  The registration unit 213 registers the clothing image generated by the clothing image generation unit 212 in the database 214 as an image of clothing owned by the user.

  However, if the clothing indicated by the generated clothing image is already registered in the database 214 as clothing owned by the user, the registration unit 213 does not need to register the clothing image.

  The registration unit 213 compares the feature of the generated clothing image with the feature of the clothing image registered in the database 214 to determine whether the clothing indicated by the generated clothing image has already been registered in the database 214. do it.

  If the registration unit 213 determines that the generated clothing image is not yet registered in the database 214, the registration unit 213 assigns an identification number to the clothing image and registers it in the database 214.

  When the registration unit 213 determines that the generated clothing image is already registered in the database 214, the registration unit 213 may specify the identification number of the registered clothing image.

[Registering information about captured images]
When the captured image sent from the terminal 11 by the registration request process is a captured image including the combination of clothes adopted by the user, the registration unit 213 further registers information regarding the combination of clothes adopted by the user. The information regarding the combination of clothing adopted by the user is the information illustrated in FIG.

[Processing related to provision of information]
The operations of the terminal 11 and the proposal system 21 relating to the process of providing the user with information regarding the combination of clothes will be described with reference to the flowchart of FIG.

  First, the control unit 115 receives an instruction to acquire a clothing combination proposal from the user via the input receiving unit 112 (step S121).

  Then, the control part 115 sets proposal conditions (step S122). And the control part 115 transmits a proposal request | requirement and proposal conditions to the proposal system 21 via the communication part 110 (step S123).

  In the proposal system 21, when the communication unit 210 receives a proposal request and a proposal condition (step S124), the combination determination unit 215 determines a combination of clothing that satisfies the proposal condition based on the proposal condition and knowledge ( Step S125).

  Then, the synthesis unit 216 synthesizes clothing images included in the determined clothing combination (step S126). Then, the communication unit 210 transmits the combined image generated by the combining unit 216 to the terminal 11.

  In the terminal 11, the communication unit 110 receives the composite image (step S128), and the display unit 113 displays the composite image (step S129).

  Through the operation as described above, the user can view a composite image that is one of information related to the combination of clothes.

  FIG. 8 is a diagram illustrating an example of a screen that displays a composite image. The control unit 115 may cause the display unit 113 to display an image for receiving a user's evaluation input for the combination of clothes indicated by the composite image, in addition to the composite image.

  When the evaluation is accepted, the control unit 115 may transmit the accepted evaluation to the proposal system 21. Then, the registration unit 213 may register the evaluation regarding the combination in the database 214. Evaluation by a user for a combination of clothes is one piece of information indicating a determination made by the user in the past. If the learning unit 217 performs learning using the registered evaluation information, more accurate knowledge about user preferences can be generated. That is, a combination of clothing that more suits the user's preference can be proposed.

  The control unit 115 may further accept, on the display unit 113, a selection as to whether or not to adopt as clothes that the user wears on that day (the day on which the composite image is displayed). For example, the control unit 115 causes the display unit 113 to display an area written “adopted” and an area written “not adopted”. When the user selects “recruitment”, the control unit 115 may transmit a request to the suggestion system 21 to register the displayed combination in the database 214 as a combination of clothing adopted by the user. In this case, the user does not need to photograph the worn clothes after wearing the combined clothes that day.

<Effect>
According to the information providing system 1 according to the first embodiment, information relating to a combination of clothes that is valuable to the user is provided.

  The reason is that the proposal system 21 transmits a composite image indicating the combination determined based on the condition set by the user by the combination determination unit 215 and the user's preference to the terminal 11.

  In particular, since the composite image can easily imagine the appearance when the user wears the clothes, the user can easily evaluate the proposed combination of clothes or determine whether or not to adopt.

  The user can select a designated garment and view a composite image showing a combination of garments including the designated garment. In order to examine combinations, the user does not need to examine the clothing candidates used for the combinations one by one.

  Therefore, according to the present invention, information about a combination of clothes that is valuable to the user is provided based on a simpler operation for the user.

<< Second Embodiment >>
<Configuration>
A second embodiment of the present invention will be described. In the second embodiment, the store terminal 32 installed in the store 8 makes a proposal request. In the present embodiment, the suggestion system 22 provides the user with information related to the combination of clothing sold as a product and clothing owned by the user via the store terminal 32.

  FIG. 9 is a block diagram illustrating a configuration of the information providing system 2 according to the second embodiment. The information providing system 2 includes a store terminal 32 and a proposal system 22. The store terminal 32 and the proposal system 22 are connected to each other via a communication network 99 so that they can communicate with each other.

  The store terminal 32 is a terminal installed in the store 8 that sells clothing. The store terminal 32 is an information processing device equipped with a touch panel, for example. A customer who visits the store 8 can use the store terminal 32. In the present embodiment, a store clerk who is serving customers may use the store terminal 32.

  The store 8 includes a product database 52 and a purchase acceptance device 63 in addition to the store terminal 32.

  The product database 52 is a database that stores information on products handled by the store 8 (that is, products sold in the store 8). The store 8 is assumed to handle clothing as a product. In the present embodiment, the product database 52 is described as being in the store 8, but the product database 52 may be outside the store 8. For example, the proposal system 22 may include a product database 52.

  The merchandise database 52 stores, for example, information such as identification information, images, prices, inventory quantities, positions located in the store 8, and clothing characteristics of the clothing sold in the store 8.

  The purchase acceptance device 63 is a so-called cash register. The purchase receiving device 63 is a device that receives a procedure for purchasing a product. For example, the purchase acceptance device 63 reads product identification information (such as a barcode) and displays the amount of money set for the product. The purchase accepting apparatus 63 accepts the payment of the amount, or accepts information indicating that the amount has been paid from a store clerk or the like, thereby completing the procedure for purchasing the product.

  Store terminal 32 includes a communication unit 320, an input reception unit 322, a display unit 323, and a control unit 325.

  The communication unit 320 communicates with a device outside the store terminal 32. Specifically, the communication unit 320 communicates with the product database 52, the purchase acceptance device 63, and the proposal system 22.

  The input receiving unit 322 receives input of information by the user (or salesclerk). The input receiving unit 322 is, for example, a touch panel.

  The display unit 323 displays an image. The display unit 323 and the input receiving unit 322 may be integrated. For example, the display unit 323 may be a touch panel.

  The control unit 325 controls processing of each unit included in the store terminal 32.

  The proposal system 22 may be the same system as the proposal system 21 of the first embodiment. In FIG. 9, only the blocks showing the components particularly related to the present embodiment are described. Assume that the database 214 of the suggestion system 22 has already stored data relating to clothing owned by the user. It is assumed that knowledge about user preferences is already stored in the knowledge database 218 of the proposal system 22.

<Operation>
The flow of operations of the store terminal 32 and the proposal system 22 according to the second embodiment will be described with reference to the flowchart of FIG.

  A user who visits the store 8 makes a request for service provision by the store terminal 32 by touching the input receiving unit 322, for example. When the service provision request is received, the control unit 325 performs the following processing.

  The control unit 325 first acquires user information. For example, the control unit 325 displays a screen for the user to input user information on the display unit 323. The user inputs user information to the input receiving unit 322 according to the display on the screen, and the input receiving unit 322 receives the input.

  The control unit 325 transmits the input user information to the proposal system 22 via the communication unit 320 (step S211). When the communication unit 210 of the proposal system 22 performs user information (step S212), the specifying unit 211 specifies a user who is using the store terminal 32 (step S213). Thereby, the proposal system 22 becomes possible [specifying the knowledge regarding the user who is using the shop terminal 32, and the information of the clothing which the said user possesses].

  The control unit 325 also sets a proposal condition (step S214). The control unit 325 sets a proposal condition in which the product in the store 8 is designated clothing.

  For example, the control unit 325 receives designation of one or more products from the user. For example, the control unit 325 displays an image of the product stored in the product database 52 on the display unit 113 together with a message “Please select clothing you are considering to purchase”. An operation to select an existing product is accepted. In that case, for example, the user selects a product by tapping an image of the product being considered for purchase. When a product is selected, control unit 115 determines the clothing that is the selected product as the designated clothing.

  The control unit 325 may further prompt the user to set a proposal condition. For example, the control unit 325 may display on the display unit 323 a screen for accepting an input of an answer by the user, including a message asking about the characteristics of clothing that the user plans to purchase. And the control part 325 sets a proposal condition based on a user's input.

  The control unit 325 transmits the set proposal condition to the proposal system 22 via the communication unit 320 (step S215).

  In the proposal system 22, the communication unit 210 receives the proposal condition (step S216). Then, the combination determining unit 215 determines a combination of clothing that satisfies the proposal condition (step S217). Then, the composition unit 216 generates a composite image by combining the images of clothes included in the determined combination of clothes (step S218).

  The image of the designated clothing may be stored in advance in the database 214 (but not as a user-owned item) or may be provided from the control unit 325. As an example, the control unit 325 may read an image of the designated clothing from the product database 52 and transmit the read image via the communication unit 320. The composition unit 216 may generate a composite image using the received image of the designated clothing as a clothing image. Note that the clothing image generation unit 212 processes the image of the designated clothing before the composition by the composition unit 216, and the clothing image of the designated clothing has a shape when a product is worn according to the body shape of the user. May be generated.

  The communication unit 210 transmits the composite image (step S219). The communication unit 320 of the store terminal 32 receives the composite image (step S220).

  Then, the display unit 323 displays the composite image (Step S221).

<Effect>
According to the second embodiment, the user can see a composite image that shows a combination of the product of the store 8 and the user's property. This makes it easier for the user to consider purchasing the product in the store 8. When the user looks at the composite image and decides to purchase the product included in the composite image, the user can pick up the product existing in the store 8 and perform the procedure for purchasing the product at the purchase acceptance device 63. .

  The user does not need to select a candidate for possession to be combined with the product, and the user is not required to perform many operations. Therefore, even when the user is not actively considering the purchase of the product, valuable information regarding the combination of clothes including the product can be obtained, and the user's willingness to purchase the product can be improved.

<Modification>
The information providing system 2 may be configured such that information on clothes purchased at the store 8 is registered in the database 214. Hereinafter, an operation example of the information providing system 2 configured as described above will be described.

  FIG. 11 is a flowchart showing the operations of the purchase acceptance device 63 and the proposal system 22 in this modification.

  When the purchase acceptance device 63 accepts purchase of a product (clothing) (step S231), the purchase acceptance device 63 acquires information that can identify the user who purchased the product (step S232).

  For example, the purchase acceptance device 63 may acquire a card including user information used when paying for the price as information that can identify the user who purchased the product. If the user information associated with the card is associated with the user identification information stored in the database 214, the user who purchased the product can be identified.

  Alternatively, the store terminal 32 may issue a paper on which a barcode including product identification information and information that can identify the user is printed, and the purchase acceptance device 63 may read the barcode.

  And the purchase reception apparatus 63 transmits the information of the purchased goods and the information which can specify a user (step S233). In the proposal system 22, the communication unit 210 receives information on the purchased product and information that can identify the user (step S <b> 234).

  The identifying unit 211 identifies the user who purchased the product based on information that can identify the user (step S235). That is, the specifying unit 211 specifies identification information stored in the image storage unit 219 of the user who purchased the product. Then, the registration unit 213 registers the purchased product as the specified user's property (step S236).

  According to the operation as described above, information on clothing purchased by the user is added to the database 214 as the user's new property.

  According to this modification, it is possible to save the user from registering clothes. In other words, the information providing system 2 can provide information on a combination of clothes that is valuable to the user based on a simpler operation for the user.

<Modification>
The information providing system 2 may include a designated clothing determining unit 329 that determines the designated clothing. FIG. 12 is a block diagram showing a configuration of the information providing system 3 including a designated clothing determining unit 329 in addition to the same components as those of the information providing system 2. In FIG. 12, the designated clothing determination unit 329 is described so as to be included in the store terminal 32, but the specified clothing determination unit 329 may be included in another information processing apparatus in the store 8 or the proposal system 22. Good.

  The designated clothing determining unit 329 determines the designated clothing.

  For example, the designated clothing determination unit 329 may determine the clothing set as the “recommended product” in the store 8 as the designated clothing. The “recommended product” is set by, for example, a clerk of the store 8, and information that can identify the “recommended product” may be stored in the product database 52.

  Alternatively, the designated clothing determination unit 329 may determine, for example, a product that the user is expected to most like as the designated clothing. The product expected to be most preferred by the user is, for example, a product similar to clothing that is most frequently used by the user. However, the frequency is the number of times used in a specific period. This specific period may be freely designed, for example, the most recent month or three months from the day before one year. Note that similar products are products having similar clothing characteristics. For example, the designated clothing determination unit 329 may express the feature of the clothing with a feature vector and calculate the similarity between the clothing using the feature vector of each clothing. The similarity between the two clothes may be, for example, an inner product of normalized feature vectors. The degree of similarity between two clothing items may be, for example, the number of components having the same value among the components of the two feature quantity vectors.

  The designated clothing determination unit 329 may specify a product that the user is expected to most like based on knowledge stored in the knowledge database 218.

  Or the designated clothing determination part 329 may determine the goods which are the most similar to the characteristic of the clothing which a user owns as designated clothing, for example. Thereby, a fresh coordinate for the user can be provided to the user.

  Alternatively, the designated clothing determination unit 329 may determine, for example, a product that matches the clothing that is least frequently used by the user as the designated clothing. Matching two garments means that the user is expected to prefer a combination of the two garments. What the user is expected to like is that the evaluation derived based on the knowledge derived by the learning unit 217 is high.

  According to this modification, even if the user does not determine the designated clothing, the user can obtain valuable information regarding the combination of clothing including the product. In addition, the designated clothing determination unit 329 determines the designated clothing based on the determination information made by the user in the past, so that a product that is highly likely to meet the user's preference and a combination including the product or the user Information indicating fresh coordinates can be provided.

<Modification>
It may be assumed that the user considers purchasing a product without actually visiting the store.

  Hereinafter, as a modified example of the second embodiment, a mode in which a user considers purchasing an online store product will be described.

  FIG. 13 is a block diagram showing a configuration of the information providing system 4 according to this modification. In FIG. 13, a sales system 73 is illustrated as a system for constructing an online store. The information providing system 4 includes a sales system 73, a terminal 13, and a proposal system 23. The sales system 73, the terminal 13, and the proposal system 23 are connected via a communication network 99 so that they can communicate with each other.

  The communication unit 730 transmits and receives information to and from the communication unit 210 of the proposed system 22 via the communication network 99.

  The control unit 735 performs control to provide information to the terminal 13. For example, the control unit 735 generates information constituting a display screen displayed on the terminal 13.

  The purchase accepting unit 733 accepts a procedure for purchasing a product in response to a request for performing a procedure for purchasing a product included in the data received by the communication unit 730.

  The product database 53 stores information on products handled in the sales system 73 (that is, products that can be purchased through the sales system 73).

  The terminal 13 is an information processing apparatus used by the user. The terminal 13 may be a terminal different from the terminal 11 in the first embodiment, or may be the same terminal.

  The terminal 13 includes a communication unit 130, an input reception unit 132, a display unit 133, and a control unit 135. The functions of the communication unit 130, the input reception unit 132, and the display unit 133 may be the same as the functions of the communication unit 110, the input reception unit 112, and the display unit 113 in the first embodiment.

  The control unit 135 transmits information to the sales system 73 via the communication unit 130 in accordance with the operation received by the input receiving unit 132 of the terminal 13. Further, the display of the display unit 133 is controlled according to the information received by the communication unit 130.

  The proposal system 23 is a system including a designated clothing determination unit 239 in addition to the same components as the proposal system 22. The function of the designated clothing determination unit 239 is the same as that of the designated clothing determination unit 329.

  First, the terminal 13 accesses an online store constructed by the sales system 73. Then, the terminal 13 transmits user information to the sales system 73. The sales system 73 that has received the user information transmits the user information to the proposal system 23. And in the proposal system 23, the specific | specification part 211 specifies the user who accessed the online store which the sales system 73 builds.

  For example, the terminal 13 transmits a proposal request to 73. The sales system 73 that has received the proposal request transmits the proposal request to 23. The terminal 13 may transmit the proposal request directly to the proposal system 23.

  The terminal 13 may set a proposal condition. When the proposal condition is set, the terminal 13 transmits the proposal condition to the sales system 73. The sales system 73 transmits the proposal condition to the proposal system 23 when transmitting the proposal request.

  The proposed condition set by the terminal 13 may include designated clothing or may not include designated clothing. When the terminal 13 sets designated clothing, the terminal 13 determines the designated clothing from the products included in the product database 53 of the sales system 73.

  Note that the terminal 13 may not transmit the proposal request. For example, the proposal request may be transmitted to the proposal system 23 when the sales system 73 receives user information from the terminal 13.

  When the proposal request is received and the designated clothing is not set by the terminal 13, the designated clothing determining unit 239 determines the designated clothing from the products included in the product database 53 in the sales system 73. The method for determining the designated clothing by the designated clothing determining unit 239 may be the same as the method for determining the designated clothing by the designated clothing determining unit 329 described in the modification of the second embodiment.

  The combination determination unit 215 determines a combination of clothes including the designated clothes. In addition, when the proposal conditions other than designated clothing are also set, the combination determination part 215 should just determine the combination which satisfy | fills a proposal condition. Then, the synthesis unit 216 generates a composite image by combining the images of clothes included in the determined combination of clothes.

  The communication unit 210 transmits the composite image to the sales system 73. In the sales system 73, the control unit 735 generates information including the composite image in response to the reception of the composite image, and transmits the information to the terminal 13 via the communication unit 730.

  In the terminal 13, when the communication unit 130 receives information including the composite image, the control unit 135 causes the display unit 133 to display information including the composite image.

  Through the flow described above, even when considering the purchase of a product in an online store, the user can be provided with information on a combination of clothes that is valuable to the user based on a simpler operation for the user. .

  When the user decides to purchase the product, the user inputs an input to the input reception unit 132 so that the terminal 13 transmits information for specifying the product to be purchased and a request for performing the purchase procedure to the sales system 73. Good. After the purchase procedure is performed by the purchase acceptance unit 733, the administrator of the sales system 73 may deliver the purchased product to the user by a predetermined method.

  In addition, the purchase reception unit 733 may transmit information on purchased products to the proposal system 23. The registration unit 213 may register the purchased product in the database 214 as a new property owned by the user.

<< Main composition >>
The configuration and operation of the information providing system 5 according to an embodiment of the present invention will be described.

  FIG. 14 is a block diagram illustrating a configuration of the information providing system 5. The information providing system 5 includes a combination determining unit 105, a combining unit 106, and a providing unit 107.

  The combination determination unit 105 combines the first image, which is an image of clothing, with the second image based on the first image and determination information indicating determination on the combination of clothing performed by the user in the past. Then, it is determined from a plurality of clothing images associated with the user identification information.

  The designated clothing in each of the above embodiments is an example of the first image.

  The combination determination unit 215 in each of the above embodiments is an example of the combination determination unit 105.

  In each of the above-described embodiments, the image of clothing owned by the user stored in the database 214 is an example of a plurality of clothing images associated with the identification information of the user.

  The synthesizing unit 106 generates a synthesized image obtained by synthesizing the first image and the second image determined by the combination determining unit 105.

  The synthesizing unit 216 in each of the above embodiments is an example of the synthesizing unit 106.

  The providing unit 107 provides the composite image generated by the combining unit 106. The units (communication units 210 and 730, control units 115, 325, and 735, display units 113 and 323, and the like) that output a composite image in each of the above embodiments are examples of the synthesis unit 106. It can be said that the communication units 210 and 730 provide a composite image to another system or apparatus. It can be said that the control units 115, 325, and 735 provide the composite image to other components. It can be said that the display units 113 and 323 provide a composite image to the user.

  FIG. 15 is a flowchart showing the operation of the information providing system 5. First, the combination determination unit 105 combines the first image with the second image, based on the first image and determination information indicating the determination on the combination of clothing performed by the user in the past. It is determined from a plurality of clothing images associated with the identification information (step S101). Next, the synthesizing unit 106 generates a synthesized image obtained by synthesizing the first image and the second image determined by the combination determining unit 105 (step S102). Then, the providing unit 107 provides the composite image generated by the combining unit 106 (Step S103).

  According to the information providing system 5, based on a simpler operation for the user, information related to the combination of clothes that is valuable to the user is provided. The reason is that the combination determining unit 105 determines the second image to be combined with the first image based on the first image and the determination information indicating the determination on the combination of clothing performed by the user in the past. It is because it decides.

<Hardware Configuration for Implementing Each Unit of Embodiment>
As described above, in each of the embodiments of the present invention described above, each component included in the apparatus and the system is described in units of functions.

  The processing of each component that processes information may be realized by, for example, a computer system reading and executing a program stored in a computer-readable storage medium that causes the computer system to execute the processing. Good. “Computer-readable storage media” include, for example, portable media such as optical disks, magnetic disks, magneto-optical disks, and nonvolatile semiconductor memories, and ROMs (Read Only Memory) and hard disks built in computer systems. It is a storage device. "Computer-readable storage medium" is a medium that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, In this case, a program or a program that temporarily holds a program such as a volatile memory in a computer system corresponding to a server or a client is also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already stored in a computer system.

The “computer system” is a system including a computer 900 as shown in FIG. 16 as an example. The computer 900 includes the following configuration.
CPU (Central Processing Unit) 901
・ ROM902
-RAM (Random Access Memory) 903
A program 904A and storage information 904B loaded into the RAM 903
A storage device 905 that stores the program 904A and storage information 904B
A drive device 907 that reads / writes data from / to the storage medium 906
A communication interface 908 connected to the communication network 909
An input / output interface 910 for inputting / outputting data
-Bus 911 connecting each component

  For example, each component of the apparatus and system in each embodiment is realized by the CPU 901 loading the program 904A that realizes the function of the component into the RAM 903 and executing it. A program 904A for realizing the functions of the components of the apparatus and the system is stored in advance in the storage device 905 or the ROM 902, for example. Then, the CPU 901 reads the program 904A as necessary. The storage device 905 is, for example, a hard disk. The program 904A may be supplied to the CPU 901 via the communication network 909, or may be stored in advance in the storage medium 906, read out to the drive device 907, and supplied to the CPU 901. The storage medium 906 is a portable medium such as an optical disk, a magnetic disk, a magneto-optical disk, and a nonvolatile semiconductor memory.

  There are various modifications of the device and system implementation methods. For example, the apparatus and the system may be realized by a possible combination of a computer 900 and a program that are separately provided for each component. In addition, a plurality of components included in the apparatus and the system may be realized by a possible combination of one computer 900 and a program.

  In addition, some or all of the components of the apparatus and system may be realized by other general-purpose or dedicated circuits, computers, and the like, or combinations thereof. These may be configured by a single chip or may be configured by a plurality of chips connected via a bus.

  When some or all of the components of the apparatus and system are realized by a plurality of computers, circuits, and the like, the plurality of computers, circuits, and the like may be centrally arranged or distributed. For example, the computer, the circuit, and the like may be realized as a form in which each is connected via a communication network, such as a client and server system and a cloud computing system.

  The present invention is not limited to the embodiment described above. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  A part or all of the above embodiment may be described as in the following supplementary notes, but is not limited thereto.

<< Appendix >>
[Appendix 1]
The second image to be combined with the first image, which is an image of clothing, is based on the first image and determination information indicating determination on the combination of clothing performed by the user in the past. A combination determining means for determining from a plurality of clothing images associated with the identification information;
Combining means for generating a combined image by combining the first image and the determined second image;
Providing means for providing the composite image;
An information providing system comprising:
[Appendix 2]
The information providing system according to attachment 1, wherein the first image is an image of clothing sold as a product, and is different from a plurality of clothing images associated with the identification information of the user.
[Appendix 3]
Purchase acceptance means for accepting purchase of the first clothing associated with the first image;
Registration means for associating the image of the first clothing and the information associated with the image of the first clothing with the identification information of the user when the purchase of the first clothing is accepted;
The information providing system according to Appendix 2, further comprising:
[Appendix 4]
The information providing system according to any one of supplementary notes 1 to 3, further comprising designated clothing determining means for determining the first image based on the determination information.
[Appendix 5]
The information providing system according to any one of appendices 1 to 4, wherein the determination information includes information indicating an evaluation performed by the user on a combination of clothes in the past.
[Appendix 6]
A control unit that receives an input of evaluation for the composite image from the user, and performs control to include the received evaluation in the determination information;
The information providing system according to appendix 5.
[Appendix 7]
The second image to be combined with the first image, which is an image of clothing, is based on the first image and determination information indicating determination on the combination of clothing performed by the user in the past. Determined from multiple clothing images associated with identification information,
Generating a composite image by combining the first image and the determined second image;
Providing the composite image;
An information providing method comprising:
[Appendix 8]
The information providing method according to appendix 7, wherein the first image is an image of clothing sold as a product, and is different from a plurality of clothing images associated with the identification information of the user.
[Appendix 9]
Accepting a purchase of a first garment associated with the first image;
When the purchase of the first clothing is accepted, the image of the first clothing and the information associated with the image of the first clothing are associated with the identification information of the user.
The information providing method according to appendix 8.
[Appendix 10]
The information providing method according to any one of appendices 7 to 9, wherein the first image is determined based on the determination information.
[Appendix 11]
11. The information providing method according to any one of appendices 7 to 10, wherein the determination information includes information indicating an evaluation performed by the user on a clothing combination in the past.
[Appendix 12]
An input of evaluation for the composite image is received from the user, and the received evaluation is included in the determination information.
The information providing method according to attachment 11.
[Appendix 13]
On the computer,
The second image to be combined with the first image, which is an image of clothing, is based on the first image and determination information indicating determination on the combination of clothing performed by the user in the past. A combination determination process for determining from a plurality of clothing images associated with the identification information;
A combining process for generating a combined image by combining the first image and the determined second image;
A providing process for providing the composite image;
A program that executes
[Appendix 14]
The program according to attachment 13, wherein the first image is an image of clothing sold as a product, and is different from a plurality of clothing images associated with the identification information of the user.
[Appendix 15]
When the purchase of the first clothing is accepted by the purchase acceptance means for accepting the purchase of the first clothing associated with the first image, the image of the first clothing and the image of the first clothing are displayed. A registration process for associating associated information with the identification information of the user,
The program according to appendix 14, which is executed by the computer.
[Appendix 16]
The program according to any one of supplementary notes 13 to 15, which causes the computer to execute designated clothing determination processing for determining the first image based on the determination information.
[Appendix 17]
The program according to any one of appendices 13 to 16, wherein the determination information includes information indicating an evaluation performed by the user on a combination of clothes in the past.
[Appendix 18]
Receiving information indicating the evaluation from a control unit that receives an input of evaluation for the composite image from the user, and causing the computer to execute a process of including information indicating the evaluation in the determination information;
The program according to appendix 17.

1-5 Information providing system 105 Combination determining unit 106 Combining unit 107 Providing unit 11, 13 Terminal 110, 130 Communication unit 111 Imaging unit 112, 132 Input receiving unit 113, 133 Display unit 115, 135 Control unit 21, 22, 23 Proposal System 210 communication unit 211 identification unit 212 clothing image generation unit 213 registration unit 214 database 215 combination determination unit 216 synthesis unit 217 learning unit 218 knowledge database 32 store terminal 320 communication unit 322 input reception unit 323 display unit 325 control unit 329, 239 designation Clothing determination unit 52, 53 Product database 63 Purchase reception device 73 Sales system 730 Communication unit 735 Control unit 733 Purchase reception unit 8 Store 99 Communication network 900 Computer 901 CPU
902 ROM
903 RAM
904A program 904B storage information 905 storage device 906 storage medium 907 drive device 908 communication interface 909 communication network 910 input / output interface 911 bus

Claims (10)

The second image to be combined with the first image, which is an image of clothing, is based on the first image and determination information indicating determination on the combination of clothing performed by the user in the past. A combination determining means for determining from a plurality of clothing images associated with the identification information;
Combining means for generating a combined image by combining the first image and the determined second image;
Providing means for providing the composite image;
An information providing system comprising:   The information providing system according to claim 1, wherein the first image is an image of clothing sold as a product, and is different from a plurality of clothing images associated with the identification information of the user. Purchase acceptance means for accepting purchase of the first clothing associated with the first image;
Registration means for associating the image of the first clothing and the information associated with the image of the first clothing with the identification information of the user when the purchase of the first clothing is accepted;
The information providing system according to claim 2, further comprising:   The information providing system according to any one of claims 1 to 3, further comprising designated clothing determining means for determining the first image based on the determination information.   The information providing system according to any one of claims 1 to 3, wherein the determination information includes information indicating an evaluation performed by the user on a combination of clothes in the past. A control unit that receives an input of evaluation for the composite image from the user, and performs control to include the received evaluation in the determination information;
The information providing system according to claim 5. The second image to be combined with the first image, which is an image of clothing, is based on the first image and determination information indicating determination on the combination of clothing performed by the user in the past. Determined from multiple clothing images associated with identification information,
Generating a composite image by combining the first image and the determined second image;
Providing the composite image;
Information provision method.   The information providing method according to claim 7, wherein the first image is an image of clothing sold as a product, and is different from a plurality of clothing images associated with the identification information of the user. On the computer,
The second image to be combined with the first image, which is an image of clothing, is based on the first image and determination information indicating determination on the combination of clothing performed by the user in the past. A combination determination process for determining from a plurality of clothing images associated with the identification information;
A combining process for generating a combined image by combining the first image and the determined second image;
A providing process for providing the composite image;
A program that executes   The program according to claim 9, wherein the first image is an image of clothing sold as a product and is different from a plurality of clothing images associated with the identification information of the user.

Images