JP2018132821A - Information processing device, information processing system, terminal device, program, and information processing method - Google Patents

Abstract

An information processing apparatus and the like capable of suitably presenting to a user second information similar to the first information. A server (20) includes a control unit (202), and the control unit (202) includes an image information database (232) and a product information database (233) including image data and information associated with each other. The first information is acquired, the similar image similar to the image associated with the first information is specified, and the second information is specified. [Selection] Figure 1

Description

  The present invention relates to an information processing device, an information processing system, a terminal device, a program, and an information processing method that specify second information with reference to the first information.

  A technique for presenting a user with second information having a high correlation with the first information based on the first information is known.

  For example, Patent Document 1 describes a method of estimating a user's skin color from an image and presenting a product with a high correlation with the skin color to the user.

JP 2010-520551 A (released on June 10, 2010)

  However, the conventional technology as described above can only recommend a product having a high correlation with the skin color to the user. Therefore, even if the first information and the second information are similar as a whole, there is a problem that information whose skin color is not similar cannot be presented to the user as the second information.

  The present invention is based on the above problems, and an object of the present invention is to provide an information processing apparatus and the like that can suitably present to a user second information similar to the first information.

  In order to solve the above-described problem, an information processing apparatus according to an aspect of the present invention refers to an information processing apparatus that refers to a database including image data and information associated with each other, and includes a control unit. The control unit acquires the first information, refers to the database, specifies a similar image similar to the image associated with the first information, and sets the information associated with the similar image to the second Identify as information.

  In order to solve the above problem, an information processing apparatus according to an aspect of the present invention refers to an information processing apparatus that refers to a database including sound data and information associated with each other, and includes a control unit. The control unit acquires the first information, refers to the database, specifies a similar sound similar to the sound associated with the first information, and sets the information associated with the similar sound to the second Identify as information.

  In order to solve the above problem, a terminal device according to an aspect of the present invention is a terminal device including a control unit, a display unit, and a communication unit, and the control unit processes the first information. Transmitting to the apparatus via the communication unit, receiving second information associated with a similar image similar to the image associated with the first information from the information processing apparatus via the communication unit, and The second information is displayed on the display unit.

  In order to solve the above problem, a terminal device according to an aspect of the present invention is a terminal device including a control unit, a display unit, and a communication unit, and the control unit processes the first information. Transmitting to the apparatus via the communication unit, receiving second information associated with a similar sound similar to the sound associated with the first information from the information processing apparatus via the communication unit, and Second information associated with the similar sound is displayed on the display unit.

  In order to solve the above-described problem, an information processing method according to an aspect of the present invention is an information processing method that refers to a database including image data and information associated with each other, and acquires first information. A first information acquisition step, a similar image specifying step for specifying a similar image similar to the image associated with the first information with reference to the database, and a second information for the similar image. And a second information specifying step for specifying as the information.

  In order to solve the above-described problem, an information processing method according to an aspect of the present invention refers to first information that refers to a database including sound data and information associated with each other. An information processing method for specifying, a first information acquisition step for acquiring first information, and a similar sound for specifying a similar sound similar to a sound associated with the first information with reference to the database A specifying step and a second information specifying step of specifying information associated with the similar sound as second information.

  According to one embodiment of the present invention, there is an effect that it is possible to provide an information processing apparatus and the like that can suitably present second information similar to the first information to the user.

It is a block diagram which shows the principal part structure of the information processing system which concerns on Embodiment 1 of this invention. It is a figure which shows typically the information processing system which concerns on Embodiment 1 of this invention. It is a figure which shows the relationship between the 1st information utilized in the information processing system which concerns on Embodiment 1 of this invention, the image linked | related with 1st information, a similar image, and 2nd information. It is a sequence diagram which shows the flow of the information processing in the information processing system which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the image information database and merchandise information database which are stored in the memory | storage part of the server which concerns on Embodiment 1 of this invention. It is a block diagram which shows the principal part structure of the information processing system which concerns on Embodiment 2 of this invention. It is a figure which shows an example of the image information database and merchandise information database which are stored in the memory | storage part of the server which concerns on Embodiment 2 of this invention. It is a sequence diagram which shows the flow of the information processing in the information processing system which concerns on Embodiment 2 of this invention. It is a block diagram which shows the principal part structure of the information processing system which concerns on Embodiment 3 of this invention. It is a sequence diagram which shows the flow of the information processing in the information processing system which concerns on Embodiment 3 of this invention. It is a block diagram which shows the principal part structure of the information processing system which concerns on Embodiment 4 of this invention. It is a sequence diagram which shows the flow of the information processing in the information processing system which concerns on Embodiment 4 of this invention. It is a block diagram which shows the principal part structure of the information processing system which concerns on Embodiment 6 of this invention. It is a block diagram which shows the principal part structure of the information processing system which concerns on Embodiment 7 of this invention. It is a block diagram which shows the principal part structure of the information processing system which concerns on Embodiment 9 of this invention.

<Embodiment 1>
The information processing system 1 according to the present embodiment will be described below with reference to FIGS. 1 to 5. However, the configuration described in this embodiment is merely an illustrative example, and is not intended to limit the scope of the present invention only to that unless otherwise specified.

[Information processing system 1]
First, an outline of the information processing system 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is an external view showing an outline of the information processing system 1 according to the present embodiment.

  As illustrated in FIG. 2, the information processing system 1 according to the present embodiment includes a terminal device 10 and a server (information processing device) 20. As shown in FIG. 2, the terminal device 10 and the server 20 are connected via the network 2. When the terminal device 10 and the server 20 are arranged in different buildings, a global network such as the Internet may be used as the network 2. When both the terminal device 10 and the server 20 are in the same building, a local area network such as a home network may be used as the network 2.

  In the information processing system 1, when a human (user) inputs first information to the terminal device 10, the server 20 specifies a similar image that is similar to an image associated with the input first information. Further, the server 20 specifies information associated with the similar image as the second information. Thereby, the information processing system 1 according to the present embodiment can suitably present the second information similar to the first information to the user.

  Next, a configuration of main parts of the information processing system 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of an information processing system 1 according to the present embodiment.

[Terminal device 10]
The configuration of the terminal device 10 according to the present embodiment will be described with reference to FIG. As illustrated in FIG. 1, the terminal device 10 according to the present embodiment includes a communication unit 101, a control unit 102, a display unit 103, and an operation unit 104.

  Examples of the terminal device 10 include a smartphone, a personal computer, and a television.

(Communication unit 101)
The communication unit 101 is means for performing communication with the outside.

  The communication unit 101 may perform wireless communication or wired communication.

(Control unit 102)
The control unit 102 comprehensively controls the communication unit 101, the display unit 103, the operation unit 104, and the like, which are each unit of the terminal device 10.

  For example, the control unit 102 controls the display unit 103 to display the first information input from the operation unit 104 and transmit the first information to the server 20 via the communication unit 101. Further, the control unit 102 performs control so that the second information received via the communication unit 101 is displayed on the display unit 103.

  The function of the control unit 102 is realized by, for example, a CPU (Central Processing Unit) executing a program stored in a storage device such as a RAM (Random Access Memory) and a flash memory (all not shown).

(Display unit 103)
The display unit 103 is an output device that displays information such as first information and second information indicated by an input signal.

  In the present embodiment, examples of the display unit 103 include a smartphone screen and a personal computer screen. The user confirms the first information and the second information by looking at the image displayed on the display unit 103.

(Operation unit 104)
The operation unit 104 is an input device that receives an operation by a user.

  The operation unit 104 may take any form such as a keyboard and a touch panel, for example, as long as it has a function that allows the user to input the first information or browse the second information. Can do.

[Server 20]
Next, the configuration of the server 20 according to the present embodiment will be described with reference to FIG. As illustrated in FIG. 1, the server 20 according to the present embodiment includes a communication unit 201, a control unit 202, and a storage unit 203.

  In the above example, the configuration in which the server 20 is realized by one server will be described as an example, but the present embodiment is not limited to this. In this embodiment, you may employ | adopt the structure which implement | achieves at least one part of each part (each function) with which the server 20 is provided with another server.

(Communication unit 201)
The communication unit 201 is a means for performing communication with the outside.

  The communication unit 201 may perform wireless communication with the terminal device 10 via the network 2 such as the Internet, or may be wired with the terminal device 10 and perform wired communication.

(Control unit 202)
The control unit 202 comprehensively controls each unit such as the communication unit 201 and the storage unit 203 of the server 20.

  In addition, the control unit 202 acquires the first information, and specifies a similar image that is similar to the image associated with the first information. In addition, the control unit 202 identifies information associated with the similar image as second information.

(Example of first information and second information)
Next, examples of the first information and the second information will be described with reference to FIG. (A) of FIG. 3 shows the relationship between the 1st information utilized in the information processing system 1 which concerns on this embodiment, the image linked | related with 1st information, a similar image, and 2nd information. FIG.

  As illustrated in FIG. 3A, when the first information is information on the product A that is product information on cosmetics such as lipstick, the control unit 202 uses the product A as an image associated with the product A. The photograph A, which is an image painted with lipstick, is identified. Thus, as an image linked | related with 1st information, the image etc. of the usage example of 1st information can be mentioned, for example.

  Next, the control unit 202 specifies the photo B as a similar image similar to the photo A, and specifies the information of the product B, which is the lipstick painted on the lips, shown in the photo B as the second information. As shown in (a) of FIG. 3, since the photos A and B are similar, it can be considered that the products A and B are similar.

  Here, if only information in which the product name, color, price, etc. are written in characters is compared, it cannot be determined that the first information and the second information are similar, and the second information is used by the user. In some cases, it cannot be suitably presented. On the other hand, in the present embodiment, the control unit 202 can appropriately present the second information similar to the first information to the user by determining whether the images are similar.

  Note that when there are a plurality of similar images, the control unit 202 may specify information associated with a similar image having a higher similarity as the second information. A method for specifying a similar image having a higher similarity will be described later.

(First modification example of first information and second information)
In the above-described example, the case where the first information and the second information are lipsticks has been described. However, the present embodiment is not limited to this. For example, as shown in FIG. 3B, the first information and the second information may be information on a product button.

  As illustrated in FIG. 3B, when the first information is information on the product button C, the control unit 202 displays the product button C as an image associated with the product button C. A photograph C, which is an image of a handicraft product sewn, is identified. Hereinafter, similarly to the above-described example, the control unit 202 can specify the photo D similar to the photo C and suitably present the product button D similar to the product button C to the user.

(Modification example 2 of first information and second information)
In the above-described example, the case where the first information and the second information are product information has been described. However, the present embodiment is not limited to this. In the present embodiment, the first information and the second information may be anything that can be associated with an image.

  For example, as illustrated in FIG. 3C, when the first information is the tourist attraction E mountain, the control unit 202 uses a photograph of the tourist attraction E mountain as an image associated with the tourist attraction E mountain. E is specified. As described above, the image associated with the first information may be an image representing the name input as the first information. In addition, the user may input character information representing the first information, such as a product name, to the terminal device 10 as the first information instead of the image information.

  Hereinafter, similarly to the above-described example, the control unit 202 can specify the photograph F similar to the photograph E and suitably present the tourist attraction F mountain similar to the tourist attraction E mountain to the user.

(Modification example 3 of first information and second information)
The first information and the second information may be food materials.

  As shown in (d) of FIG. 3, when the first information is the food G, the control unit 202 uses a food photo G obtained using the food G as an image associated with the food G. Identify. As described above, in the present embodiment, when the image associated with the first information is an image of the usage example, the image of the usage example of the first information is identified in the target for which the first information is used. It may not be possible. In other words, the image of the usage example of the first information may be an image that is suddenly integrated with the target on which the first information is used and cannot be identified.

  Hereinafter, similarly to the above-described example, the control unit 202 can specify a photo H similar to the photo G and suitably present the food H similar to the food G to the user.

  A specific method for specifying a similar image similar to the image associated with the first information will be described later along with the details of the configuration of the control unit 202.

  The function of the control unit 202 includes, for example, a program stored in a storage device such as a RAM (Random Access Memory) and a flash memory, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and a DSP (digital). This is realized by execution of a processing device such as a signal processor (not shown).

(Storage unit 203)
The storage unit 203 stores various data referred to by the control unit 202 described later. As various data, for example, an image 231, an image information database 232 (database), a product information database 233 (database), and the like are stored.

  Details of the image 231, the image information database 232, and the product information database 233 will be described later with different drawings.

[Configuration of Control Unit 202]
Next, the configuration of the control unit 202 included in the server 20 will be described with reference to FIG. As shown in FIG. 1, the control unit 202 functions as a parameter calculation unit 221.

(Parameter calculation unit 221)
The parameter calculation unit 221 calculates a parameter used for specifying a similar image by analyzing an image associated with the first information.

  In the present embodiment, the parameter calculation unit 221 uses hue, brightness, saturation, and atmosphere as parameters. Here, “hue” means the difference in color appearance such as red, yellow, green, blue, and purple, “brightness” means the brightness of the color, and “saturation” means the vividness of the color. To do.

  The parameter calculation unit 221 first determines the representative color by averaging the pixels of the entire image associated with the first image. Next, the parameter calculation unit 221 digitizes the hue, brightness, and saturation of the representative color by comparing with reference data (not shown) stored in the storage unit 203. The reference data is numbered in advance, and the parameter calculation unit 221 selects the closest reference color to the representative color from among the plurality of reference data for hue, brightness, and saturation. Then, the parameter calculation unit 221 determines the numerical values of the hue, brightness, and saturation of the representative color from the numerical values attached to the reference data.

  Here, the numerical values of the hue, brightness, and saturation of the representative color can be set according to arbitrary criteria.

  For example, the numerical value of the hue may be set so that the numerical value is 0 when white, the numerical value increases as the red distribution increases, and the numerical value decreases as the blue distribution increases. The numerical value of brightness may be set such that the numerical value is 0 at the median value of light and dark, and the numerical value is higher as it is brighter and lower as it is darker. The saturation value may be set such that the value is 0 when the median value is light and dark, and the darker the value, the higher the value, and the lighter the value, the lower the value.

  Further, the parameter calculation unit 221 determines the atmosphere of the image associated with the first image by comparing the image associated with the first image with the image 231 stored in the storage unit 203.

  For example, the parameter calculation unit 221 compares the image associated with the first image with a plurality of images each having an atmosphere such as cool, gentle, cute, soft, cool, and exotic. Then, the parameter calculation unit 221 determines that the atmosphere of the reference image having the highest similarity is the atmosphere of the image associated with the first image. Examples of the comparison method include a method using an average hash method.

  As described above, by calculating a parameter and searching for a similar image using the parameter, a similar image similar to the image associated with the first information can be suitably specified. Thereby, 2nd information similar to 1st information can be suitably shown to a user suitably.

  In addition, by using at least one of hue, brightness, saturation, and atmosphere as a parameter, a similar image that is more similar to the image associated with the first information can be specified. In particular, by using a plurality of these parameters such as hue, brightness, saturation, and atmosphere as described above, a similar image that is more similar to the image associated with the first information can be specified.

[Information processing]
Next, information processing (information processing method) in the information processing system 1 according to the present embodiment will be described with reference to FIG. FIG. 4 is a sequence diagram showing a flow of information processing in the information processing system 1 according to the present embodiment.

  Step S101: As shown in FIG. 4, first, the terminal apparatus 10 transmits first information to the server 20 via the communication unit 101.

  Step S <b> 102 (first information acquisition step): The server 20 receives first information from the terminal device 10 via the communication unit 201.

  Step S103: The control unit 202 specifies an image associated with the first information. And the control part 202 calculates a parameter by analyzing the image linked | related with 1st information by the parameter calculation part 221. FIG.

  Step S104 (similar image specifying step): The control unit 202 specifies a similar image by referring to the image information database 232 using the calculated parameters.

  Step S105 (second information specifying step): The control unit 202 specifies the information associated with the similar image as the second information by referring to the image information database 232 and the product information database 233.

  Step S106: The server 20 transmits the second information to the terminal device 10 via the communication unit 201.

  Step S107: The terminal device 10 receives the second information from the server 20 via the communication unit 101.

  Step S108: The terminal device 10 displays the second information on the display unit 103, and presents the second information to the user.

  In the above-described example, the parameter is calculated by analyzing the image associated with the first information in step S103. However, the present embodiment is not limited to this. For example, if the image parameter associated with the first information is clear, step S103 can be omitted.

[Identification of similar image and second information]
Here, the specification of the similar image and the second information in the control unit 202 will be described more specifically with reference to FIG.

  FIG. 5A is a diagram illustrating an example of an image information database 232 describing the hue, brightness, saturation, atmosphere, and product ID in each image. FIG. 5B is a diagram illustrating an example of a product information database 233 indicating product information regarding a correspondence relationship between a product ID, a product name, and a product image.

  After calculating the parameter of the image associated with the first information by the parameter calculation unit 221, the control unit 202 refers to the image information database 232 in FIG. 5A and identifies a similar image. Specifically, the control unit 202 searches the image information database 232 for images that are close to the numerical values of the specified parameters, such as hue, brightness, and saturation, and have the same atmosphere, and specifies the images as similar images. . Here, the values of hue, lightness, and saturation are close, for example, the hue, lightness, and saturation in the image associated with the first information and the similar image in FIG. The difference may be 5 or less.

  Moreover, the control part 202 may specify an image with higher similarity as a similar image, when there exist two or more images close | similar to the numerical value of the specified hue, brightness, saturation, and atmosphere.

  For example, as shown in FIG. 5A, the moving image 001 and the still image 001 are similar in hue, brightness, saturation, and atmosphere. In this case, the control unit 202 may calculate how many of the four parameters are more similar to the moving image 001 or the still image 001. At this time, among the four parameters, one that is more similar than three or more may be regarded as a similar image having a higher similarity. As described above, the second information that is more similar to the first information can be specified by specifying the information associated with the similar image having the higher similarity as the second information.

  After identifying the similar image, the control unit 202 refers to the image information database 232 in FIG. 5A and identifies the product ID corresponding to the similar image. Next, the control unit 202 refers to the product information database 233 in FIG. 5B, and sets the product name and product image corresponding to the product ID of the similar image specified in FIG. As specified. For example, when the similar image is the moving image 001, the product ID of the similar image is specified as C0001, C0024, C0055, and C003 from the image information database 232 in FIG. In addition, the second information is specified to the product A, the product image A, the product B, the product image B, the product C, the product image C, the product D, and the product image D from the product information database 233 in FIG. Is done.

  In this way, the control unit 202 can specify information associated with the similar image as the second information. As described above, according to the present embodiment, even if one piece of first information is input, the control unit 202 can specify a plurality of pieces of second information. Therefore, for example, when a lipstick is input as the first information, a plurality of pieces of information such as lipstick, foundation, eye shadow, and cheek can be specified as the second information.

[Specific modification of similar image and second information]
In the above example, the control unit 202 first calculates the parameter of the image associated with the first information by the parameter calculation unit 221. Then, the control unit 202 refers to the image information database 232 in FIG. 5A in order to specify a similar image after calculating the parameters.

  However, in this embodiment, the parameter calculation unit 221 does not have to calculate the parameter of the image associated with the first information. For example, the control unit 202 may determine an image associated with the first information and a parameter corresponding to the image with reference to the image information database 232 in FIG.

  For example, when the product name “product A” is input to the terminal device 10 as the first information, the control unit 202 of the server 20 first refers to the product information database 233. From the product information database 233 of FIG. 5B, the control unit 202 specifies the product ID corresponding to the product A as C0001.

  Next, the control unit 202 refers to the image information database 232 in FIG. 5A and identifies the moving image 001 corresponding to the product IDC0001. Then, the control unit 202 identifies the still image 001 as a similar image as an image close to the hue, brightness, saturation, and atmosphere that are parameters of the moving image 001.

  Next, the control unit 202 specifies the product ID associated with the still image 001 as C1022, C0010, C0088, and C0452. Then, the control unit 202 refers to the product information database 233 in FIG. 5B, and corresponds to the product ID, the product I, the product image I, the product J, the product information J, the product K, the product image K, The product L and the product image L can be specified as the second information.

  As described above, the control unit 202 of the server 20 according to the present embodiment may appropriately change the usage order and usage of the parameter calculation unit 221, the image information database 232, and the product information database 233. Thereby, the information processing system 1 provided with the server 20 can suitably present the second information to the user in accordance with various types of the first information appropriately.

[Image information and product information storage method]
Next, a method for storing image information and product information will be described. In other words, a method for creating the image information database 232 in FIG. 5A and the product information database 233 in FIG. 5B will be described.

  The user transmits the first information and transmits the product information and the posted image associated with the product information in advance from the terminal device 10 to the server 20 before acquiring the second information (before the information processing). To do.

  The control unit 202 of the server 20 stores the product ID and the product name indicated by the product information posted by the user and the product image in the product information database 233 in association with each other. The user also posts other product information and images associated with the other product information to the server 20 in the same manner. Thereby, a product information database 233 as shown in FIG. 5B is created.

  Next, the control unit 202 uses the parameter calculation unit 221 to calculate image parameters associated with the above-described product information posted by the user, and stores the parameters and the product ID of the product information in the image information database 232. .

  For example, product information posted by the user is C0001, product A, and product image A, and the image associated with the product information is a moving image. At this time, the control unit 202 associates the image (moving image 001), the parameters (hue 5, brightness 5, saturation-10), and the product ID (C0001) with the image information database 232 in FIG. And save.

  The control unit 202 similarly specifies a parameter for an image associated with another product information, and stores the parameter in the image information database 232 in association with the product ID of the posted product information. As a result, an image information database 232 as shown in FIG. 5A is created.

[Modification Example 1 for Saving Image Information and Product Information]
In the above example, the user (poster) who posts the product information and the posted image associated with the product information is the same as the user (viewer) who transmits the first information and acquires the second information. Or may be separate. In other words, in the above example, only one terminal device 10 is used. However, the terminal device of the poster may be a terminal device 100 (not shown) different from the terminal device 10 of the viewer. .

  In this case, the control unit 202 of the server 20 does not create the image information database 232 in FIG. 5A and the product information database 233 in FIG. Can be transmitted to the server 20 to obtain the second information.

[Example 2 of changing image information and product information storage method]
In the above-described example, the control unit 202 controls the database to be created in advance before the user transmits the first information and acquires the second information. Is not limited to this.

  The control unit 202 may not only create these databases in advance, but may further add image information and product information to these databases later.

  That is, the control unit 202 may further add image information and product information to these databases in parallel with transmitting the first information and acquiring the second information. At this time, the control unit 202 performs control so as to store the first information and data such as image parameters associated with the first information in a form that updates the image information database 232 and the product information database 233. To do.

  For example, it is assumed that the control unit 202 acquires a product ID (C7700), a product O, and a product image O as the first information. In this case, as illustrated in FIG. 5B, the control unit 202 controls to add C7700, the product O, and the product image O to the product ID, the product name, and the product image in the product information database 233.

  In addition, the control unit 202 controls the parameter calculation unit 221 to calculate the parameter of the product image O, and stores the product ID and the parameter in the image information database 232 in FIG. Here, the control unit 202 assigns and stores a number as a moving image when the product image is a moving image, and as a still image when the product image is a still image. For example, when the product image O is a still image, the control unit 202 performs control so that the image is stored as a still image 002 in the image column as illustrated in FIG.

  When the control unit 202 acquires other product information, the image information database 232 and the product information database 233 are similarly controlled to be updated.

  Accordingly, the control unit 202 can specify a more accurate similar image and second information when calculating the parameters of the next and subsequent images.

  Note that the control unit 202 may perform control so that the image associated with the first information is stored in the storage unit 203 as the image 231.

  As described above, the server 20 according to the present embodiment is a server 20 that refers to the image information database (232) and the product information database (233) including image data and information associated with each other, and includes a control unit 202. The control unit 202 acquires the first information and refers to the image information database (232) and the product information database (233) to identify a similar image similar to the image associated with the first information Then, the information associated with the similar image is specified as the second information.

  Since the image associated with the first information is similar to the similar image, it can be considered that the first information and the second information are similar. Therefore, the server 20 can suitably present the second information similar to the first information to the user.

  In the server 20 according to the present embodiment, the control unit 202 calculates a parameter used for specifying a similar image by analyzing an image associated with the first information.

  The control unit 202 uses a parameter calculated by analyzing an image associated with the first information. Thereby, the control part 202 can specify suitably the similar image similar to the image linked | related with 1st information. As a result, the server 20 can suitably present to the user second information similar to the first information.

  In the server 20 according to the present embodiment, the parameter is at least one of hue, brightness, saturation, and atmosphere.

  The control unit 202 can specify a similar image that is more similar to the image associated with the first information by using at least one of hue, brightness, saturation, and atmosphere as a parameter. Therefore, the server 20 can suitably present the second information that is more similar to the first information to the user.

  Further, in the server 20 according to the present embodiment, when there are a plurality of similar images, the control unit 202 specifies information associated with a similar image with a higher similarity as the second information.

  The control unit 202 identifies information associated with a similar image having a higher similarity as second information. Therefore, the server 20 can specify the second information that is more similar to the first information.

  In the server 20 according to the present embodiment, the first information is a product name, and the second information is product information related to a product different from the first information.

  Even when a product name is input as the first information, the server 20 according to the present embodiment is suitable for the user as product information similar to the product information of the product name input as the first information as the second information. Can be presented.

  The information processing system 1 according to the present embodiment is the information processing system 1 including the server 20 and the terminal device 10, and the terminal device 10 receives the second information from the server 20. And a display unit 103 that displays the second information to the user.

  Therefore, the information processing system 1 can suitably present the user with second information similar to the first information.

  Further, the terminal device 10 according to the present embodiment is a terminal device 10 including a control unit 102, a display unit 103, and a communication unit 101. The control unit 102 sends the first information to the server 20 and the communication unit 101. The second information associated with the similar image similar to the image associated with the first information is received from the server 20 via the communication unit 101, and the second information is displayed on the display unit 103. Let

  Since the image associated with the first information is similar to the similar image, it can be considered that the first information and the second information are similar. Therefore, the terminal device 10 can suitably present the second information similar to the first information to the user.

  In addition, the information processing system 1 according to the present embodiment is the information processing system 1 including the terminal device 10 and the server 20, and the server 20 includes a control unit 202 that specifies second information. .

  Therefore, the information processing system 1 can suitably present the user with second information similar to the first information.

  The information processing method according to the present embodiment is an information processing method that refers to an image information database (232) and a product information database (233) including image data and information associated with each other. A first information acquisition step for acquiring information, and a similar image specifying step for specifying a similar image similar to the image associated with the first information with reference to the image information database (232) and the product information database (233) And a second information specifying step for specifying the information associated with the similar image as the second information.

  Since the image associated with the first information is similar to the similar image, it can be considered that the first information and the second information are similar. Therefore, according to the information processing method according to the present embodiment, the second information similar to the first information can be suitably presented to the user.

<Embodiment 2>
In the first embodiment, the control unit 202 of the server 20 functions as the parameter calculation unit 221. However, as in the second embodiment, the control unit 202 may function as the machine learning unit 241 instead of the parameter calculation unit 221. Good.

  A second embodiment will be described with reference to FIGS. For convenience of explanation, members having the same functions as those described in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

[Configuration of Information Processing System 3]
FIG. 6 is a block diagram showing a main configuration of the information processing system 3 according to the present embodiment. As illustrated in FIG. 6, the information processing system 3 according to the present embodiment includes a terminal device 10 and a server 21.

  As shown in FIG. 6, in the server 21, the control unit 204 functions as a machine learning unit 241 instead of the parameter calculation unit 221. In the server 21, the storage unit 205 includes an image information database 235 instead of the image information database 232. Except for these points, the server 21 has the same configuration as the server 20 according to the first embodiment.

(Configuration of server 21)
The control unit 204 of the server 21 functions as a machine learning unit 241. The control unit 204 specifies a similar image similar to the image associated with the first information based on the machine learning by the machine learning unit 241.

  Hereinafter, the function of the machine learning unit 241 will be described with reference to FIG. 7 together with a method for storing image information and product information. That is, the function of the machine learning unit 241 will be described together with the method for creating the image information database 235 in FIG. 7A and the product information database 233 in FIG. As for the method of creating the image information database 235, only differences from the first embodiment will be described. Since the creation method of the product information database 233 is created in the same manner as the method described in the first embodiment, the description thereof is omitted.

  FIG. 7A is a diagram illustrating an example of the image information database 235 describing the correspondence between each image and the product ID. FIG. 7B is a diagram illustrating an example of a product information database 233 indicating product information about the correspondence relationship between the product ID, the product name, and the product image.

[Function of machine learning unit 241 and storage method of image information and product information]
First, the user posts the product information and an image associated with the product information in advance to the server 20 before transmitting the first information and acquiring the second information.

  Here, each time the machine learning unit 241 acquires a new image associated with the product information posted by the user, the new image data and the past image data stored in the image information database 235 are acquired. And compare. Next, the machine learning unit 241 constructs a reference for calculating a similarity indicating how similar the image data is to each other.

  For example, it is assumed that the new image data associated with the product information posted by the user corresponds to the moving image 002, and the image data acquired in the past is the moving image 001. At this time, the machine learning unit 241 compares the new image / moving image 002 with the past image / moving image 001 and analyzes how much they are similar to each other.

  Similarly, it is assumed that data of a still image 001 is posted as an image newly associated with product information by the user. At this time, the machine learning unit 241 compares the new image, the still image 001, all the past images, the moving image 001, and the moving image 002, and analyzes how much they are similar to each other.

  The machine learning unit 241 analyzes how much a new image and a past image in the image information database 235 are similar to each other when a user newly submits an image associated with product information. Go. As a result, the image information database 235 is created and a criterion for calculating the similarity is established.

(Identification of similar image and second information)
After the image information database 235 and the product information database 233 are created and a criterion for calculating the similarity is established, the user transmits the first information to the server 21. The control unit 204 that has acquired the first information calculates the similarity of the past image with respect to the image associated with the first information based on the criterion for calculating the similarity.

  Further, the control unit 204 refers to the image information database 235 in FIG. 7A to identify an image having a high similarity to the image associated with the first information as a similar image. Then, the control unit 204 refers to the image information database 235 and identifies a product ID corresponding to the similar image.

  Next, the control unit 204 refers to the product information database 233 in FIG. 7B, and specifies the product name and product image corresponding to the product ID of the similar image as the second information.

  For example, if the similar image is a moving image 001, the product ID is C0001, C0024, C0055, C003, and the second information is product A, product image A, product B, product image B, product C, product image C. , Product D, and product image D. Thus, even if the control unit 204 functions as the machine learning unit 241 instead of the parameter calculation unit 221, the server 21 can suitably present the second information to the user.

[Information processing]
Next, information processing (information processing method) in the information processing system 3 according to the present embodiment will be described with reference to FIG. FIG. 8 is a sequence diagram showing a flow of information processing in the information processing system 3 according to the present embodiment.

  Steps S201, S202, and S205 to S207 in FIG. 8 are the same as S101, S102, and S106 to S108 shown in FIG.

  Step S203 (similar image specifying step): The control unit 202 specifies a similar image by calculating the similarity of the image data in the image information database 235 with respect to the image associated with the first image.

  Step S204 (second information specifying step): The control unit 202 specifies information associated with the similar image as second information by referring to the image information database 235 and the product information database 233.

  In addition, although Embodiment 1 and 2 demonstrated the form provided with the parameter calculation part 221 and the machine learning part 241, respectively, Embodiment 1 and 2 may be combined suitably. That is, an information processing system including both the parameter calculation unit 221 and the machine learning unit 241 may be used. Thereby, compared with the case where only one of parameter calculation part 221 and machine learning part 241 is provided, the 2nd information with higher similarity can be shown to a user suitably.

  As described above, in the server 21 according to the present embodiment, the control unit 204 specifies a similar image based on machine learning that refers to a new image and a past image.

  The control unit 204 constructs a reference for calculating a similarity indicating how similar each other image is by comparing a new image and a past image. Accordingly, the control unit 204 calculates the similarity of the past image with respect to the image associated with the first information based on the criterion for calculating the similarity. In addition, the control unit 204 specifies a past image having a high similarity to the image associated with the first information as a similar image. As a result, the server 21 can suitably present to the user second information similar to the first information.

<Embodiment 3>
In the first embodiment, the control unit 202 of the server 20 functions as the parameter calculation unit 221. However, as in the third embodiment, the control unit 105 of the terminal device 11 is replaced by the parameter calculation unit 221 instead of the control unit 202 of the server 20. May function as

  A third embodiment will be described with reference to FIGS. For convenience of explanation, members having the same functions as those described in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

[Configuration of Information Processing System 4]
FIG. 9 is a block diagram showing a main configuration of the information processing system 4 according to the present embodiment. As illustrated in FIG. 9, the information processing system 4 according to the present embodiment includes a terminal device 11 and a server 22.

  As illustrated in FIG. 9, in the terminal device 11 according to the present embodiment, the control unit 105 of the terminal device 11 functions as the parameter calculation unit 221 instead of the control unit 206 of the server 22. Further, instead of the storage unit 207 of the server 22, the terminal device 11 includes the image 231 in the storage unit 106. Except for these points, the information processing system 4 according to the present embodiment has the same configuration as the information processing system 1 according to the first embodiment.

(Configuration of terminal device 11)
The control unit 105 of the terminal device 11 functions as the parameter calculation unit 221. The control unit 105 acquires the first information, and the parameter calculation unit 221 of the control unit 105 calculates an image parameter associated with the first information as in the first embodiment. The parameter calculation unit 221 determines the atmosphere in the same manner as in the first embodiment with reference to the reference image in the image 231 stored in the storage unit 106.

  The terminal device 11 transmits the calculated parameter to the server 22. The server 22 uses the parameters received via the communication unit 201 to specify the similar image and the second information as in the first embodiment.

  Thus, in the present embodiment, the parameter of the image associated with the first image is calculated by the terminal device 11, and the parameter calculation and the identification of the similar image and the second information are performed by separate control units. . Thereby, compared with the case where parameter calculation and identification of similar images and second information are performed by one server, the burden on the server can be reduced. As a result, the second information similar to the first information can be identified more efficiently.

[Image information and product information storage method]
Next, a method for storing image information and product information, that is, a method for creating the image information database 232 and the product information database 233 will be described.

  In this embodiment, instead of the control unit 202 of the server 20, the parameter calculation unit 221 of the control unit 105 of the terminal device 11 calculates image parameters associated with the posted product information. The terminal device 11 transmits a parameter to the server 22, and the control unit 206 of the server 22 acquires the parameter. The server 22 controls the image information database 232 of the storage unit 207 so as to store it as an image parameter associated with the posted product information.

  Except for the points described above, the image information database 232 and the product information database 233 can be created as in the first embodiment.

[Information processing]
Next, information processing (information processing method) in the information processing system 4 according to the present embodiment will be described with reference to FIG. FIG. 10 is a sequence diagram showing a flow of information processing in the information processing system 4 according to the present embodiment.

  Since the processing of steps S305 to S309 shown in FIG. 10 is the same as that of steps S104 to S108 shown in FIG. 4, the description thereof is omitted here.

  Step S301 (first information acquisition step): First, the control unit 105 of the terminal device 10 acquires first information by an input from the operation unit 104 by the user.

  Step S302: The control unit 105 calculates a parameter by analyzing an image associated with the first information by the parameter calculation unit 221.

  Step S303: The terminal device 11 transmits the parameter to the server 22 via the communication unit 101.

  Step S304: The server 22 receives parameters from the terminal apparatus 11 via the communication unit 201.

<Embodiment 4>
In the second embodiment, the control unit 204 of the server 21 functions as the machine learning unit 241, but as in the fourth embodiment, the control unit 107 of the terminal device 12 is replaced by the machine learning unit 241 instead of the control unit 204 of the server 21. May function as

  A third embodiment will be described with reference to FIGS. For convenience of explanation, members having the same functions as those described in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

[Configuration of Information Processing System 5]
FIG. 11 is a block diagram showing a main configuration of the information processing system 5 according to the present embodiment. As illustrated in FIG. 11, the information processing system 5 according to the present embodiment includes a terminal device 12 and a server 22.

  As illustrated in FIG. 11, in the terminal device 12 according to the present embodiment, the control unit 107 of the terminal device 12 functions as a machine learning unit 241 instead of the control unit 206 of the server 22. The terminal device 12 includes the image 231 in the storage unit 108 instead of the storage unit 207 of the server 22. Except for these points, the information processing system 5 according to the present embodiment has the same configuration as the information processing system 3 according to the second embodiment.

(Configuration of terminal device 12)
The control unit 107 of the terminal device 12 functions as a machine learning unit 241.

  The control unit 107 refers to the image information database 235 and the product information database 233 of the server 22 when the machine learning unit 241 constructs a standard for calculating the similarity. As described above, the control unit 107 is described in the same manner as the control unit 204 of the second embodiment except that the external member database is referred to via the network 2.

  In this way, machine learning is performed by the control unit 107 in the terminal device 12, compared with a case where machine learning, identification of similar images, and identification of second information are all performed by one server. The burden on one server can be reduced.

[Image information and product information storage method]
In the creation method of the image information database 235 and the product information database 233, a reference for calculating the similarity is constructed by the machine learning unit 241 of the control unit 107 of the terminal device 12 instead of the control unit 204 of the server 21. Except this point, the second embodiment is the same as the second embodiment.

[Information processing]
Next, information processing (information processing method) in the information processing system 5 according to the present embodiment will be described with reference to FIG. FIG. 12 is a sequence diagram showing a flow of information processing in the information processing system 5 according to the present embodiment.

  The processes in steps S405 to S408 shown in FIG. 12 are the same as steps S204 to S207 shown in FIG.

  Step S401 (first information acquisition step): First, the control unit 107 of the terminal device 12 acquires first information by an input from the operation unit 104 by the user.

  Step S402 (similar image specifying step): The control unit 107 specifies a similar image by calculating the similarity of the image data in the image information database 235 to the image associated with the first image.

  Step S403: The terminal apparatus 12 transmits similar image data to the server 22 via the communication unit 101.

  Step S <b> 404: The server 22 receives similar image data from the terminal device 12 via the communication unit 201.

<Embodiment 5>
In the first embodiment, the control unit 202 of the server 20 identifies a similar image similar to the image associated with the first information, and identifies the information associated with the similar image as the second information. However, the present embodiment is not limited to this. The object associated with the first information and the second information may be a sound.

[Configuration of Information Processing System 6]
The information processing system 6 (not shown) according to the present embodiment includes a server 23 (not shown) and a terminal device 13 (not shown).

  The control unit 208 (not shown) of the server 23 identifies a similar sound similar to the sound associated with the first information, and identifies information associated with the similar sound as the second information. The terminal device 13 displays the second information on the display unit 113 (not shown).

  At this time, as a method for identifying similar sounds, as in the first embodiment, the control unit 208 of the server 23 functions as a parameter calculation unit and performs parameter calculation for the sound associated with the first information. May be. At this time, examples of the parameters include height, size, tone color, and the like. Similarly, the control unit 208 of the server 23 may function as a machine learning unit and specify a similar sound similar to the sound associated with the first information by machine learning. Machine learning can be performed in the same manner as the methods shown in the second and fourth embodiments except that the image is replaced with sound.

  Further, as in the terminal devices 11 and 12 of the third and fourth embodiments, instead of the control unit 208 of the server 23, the control unit 109 (not shown) of the terminal device 13 functions as a parameter calculation unit or a machine learning unit. May be. In this case as well, similar images and second information can be specified as in the case where the control unit 208 of the server 23 functions as a parameter calculation unit or a machine learning unit.

  Note that the display unit 113 (not shown) of the terminal device 13 may be a screen of a smartphone, a personal computer, or a television, or a device that outputs sound, such as the display unit 103 of the above-described embodiment. It may be.

  As described above, even when similar sounds are specified instead of similar images, the same members as those in the above-described embodiment are used except that the images are replaced with sound-related components except for the above-described members. Can do. Therefore, description of other members is omitted.

[Information processing]
The information processing (information processing method) in the information processing system 6 according to the present embodiment specifies a first information acquisition step of acquiring first information and a similar sound similar to the sound associated with the first information. A similar sound specifying step, and a second information specifying step of specifying information associated with the similar sound as second information. If these steps are included, the information processing in the information processing system 6 according to the present embodiment is not particularly limited.

  For example, when the control unit 208 of the server 23 functions as a parameter calculation unit, it can be performed in the same manner as in the first embodiment except that the information processing image according to the first embodiment is replaced with sound.

  Further, when the control unit 208 of the server 23 functions as a machine learning unit, it can be performed in the same manner as in the second embodiment except that the information processing image according to the second embodiment is replaced with sound.

  Similarly, when the control unit 109 of the terminal device 13 functions as a parameter calculation unit, it can be performed in the same manner as in the third embodiment, except that the information processing image according to the third embodiment is replaced with sound. Also, when the control unit 109 of the terminal device functions as a machine learning unit, it can be performed in the same manner as in the fourth embodiment except that the information processing image according to the fourth embodiment is replaced with sound.

  As described above, the server 23 according to the present embodiment is a server 23 that refers to a database including sound data and information associated with each other, and includes the control unit 208. The control unit 208 includes the first information. And referring to the database, the similar sound similar to the sound associated with the first information is identified, and the information associated with the similar sound is identified as the second information.

  Since the sound associated with the first information is similar to the similar sound, it can be considered that the first information and the second information are similar. Thereby, the server 23 can suitably present the second information similar to the first information to the user.

  Further, the terminal device 13 according to the present embodiment is a terminal device 13 including a display unit 113 and a communication unit 101, and the control unit 102 transmits first information to the server 23 via the communication unit 101. The second information associated with the similar sound similar to the sound associated with the first information is received from the server 23 via the communication unit 101, and the second information associated with the similar sound is displayed on the display unit 113. To display.

  Since the sound associated with the first information is similar to the similar sound, it can be considered that the first information and the second information are similar. Thereby, the terminal device 13 can suitably present the second information similar to the first information to the user.

  An information processing method according to the present embodiment is an information processing method that refers to a database including sound data and information associated with each other, and includes a first information acquisition step of acquiring first information, A similar sound specifying step for specifying a similar sound similar to the sound associated with the first information with reference to the database, and a second information specifying step for specifying the information associated with the similar sound as the second information And.

  Since the sound associated with the first information is similar to the similar sound, it can be considered that the first information and the second information are similar. Thereby, according to the information processing method concerning this embodiment, the 2nd information similar to the 1st information can be suitably shown to a user.

<Embodiment 6>
In the example described above, the information processing systems 1 and 3 to 6 including the terminal device 10, 11, 12, or 13 and the server 20, 21, 22, or 23 have been described. The information processing system may not include any of the terminal devices 10, 11, 12, or 13 and the servers 20, 21, 22, or 23.

  That is, all the members may be included in the terminal device 10, 11, 12, or 13, and all the members may be included in the server 20, 21, 22, or 23.

  The information processing system 7 that does not include the server 20, 21, 22, or 23 will be described below.

[Configuration of information processing system]
The information processing system 7 according to the present embodiment includes a terminal device 14.

  FIG. 13 is a block diagram illustrating a main configuration of the information processing system 7 according to the present embodiment. As illustrated in FIG. 13, the terminal device 14 according to the present embodiment stores the storage unit 203 provided in the server 20 in the first embodiment in addition to the configuration of the terminal device 10, 11, 12, or 13 described above. The unit 110 is provided. Moreover, the terminal device 10, 11, 12, or 13 is provided with the control part 105 also including the parameter calculation part 221 of the control part 202 of the server 20 in Embodiment 1. FIG.

  The information processing system 7 according to the sixth embodiment can achieve the same effects as the information processing system 1 according to the first embodiment.

  About the member which has the same function as the member demonstrated in the above-mentioned embodiment, the same code | symbol is attached and the description is abbreviate | omitted.

[Information processing]
Information processing (information processing method) in the information processing system 7 according to the present embodiment does not exchange data between the communication unit 101 and the communication unit 201. Further, the control unit 105 of the terminal device 14 performs control instead of the control unit 202 of the server 20. Except for these points, the information processing in the information processing system 7 according to the present embodiment is performed in the same manner as the information processing of the information processing system 1 according to the first embodiment.

<Embodiment 7>
In the sixth embodiment, the control unit 105 of the terminal device 14 functions as the parameter calculation unit 221. However, as in the information processing system 8 according to the seventh embodiment, the control unit 107 includes a machine learning unit instead of the parameter calculation unit 221. 241 may function.

  The information processing system 8 according to the present embodiment includes a terminal device 15.

  FIG. 14 is a block diagram showing a main configuration of the information processing system 8 according to the present embodiment. As illustrated in FIG. 14, the terminal device 15 according to the present embodiment stores a storage unit 205 included in the server 21 in the second embodiment in addition to the configuration of the terminal device 10, 11, 12, or 13 described above. The unit 111 is provided. Moreover, the terminal device 10, 11, 12, or 13 is provided with the control part 107 also including the machine learning part 241 of the control part 204 of the server 21 in Embodiment 2.

  The information processing system 8 according to the seventh embodiment can achieve the same effects as the information processing system 3 according to the second embodiment.

  About the member which has the same function as the member demonstrated in the above-mentioned embodiment, the same code | symbol is attached and the description is abbreviate | omitted.

[Information processing]
Information processing (information processing method) in the information processing system 8 according to the present embodiment does not exchange data between the communication unit 101 and the communication unit 201. Control is performed by the control unit 107 of the terminal device 15 instead of the control unit 204 of the server 21. Except for these points, the information processing in the information processing system 8 according to the present embodiment is performed in the same manner as the information processing of the information processing system 3 according to the second embodiment.

<Eighth embodiment>
In the sixth and seventh embodiments, the control unit 105 of the terminal device 14 and the control unit 107 of the terminal device 15 identify a similar image similar to the image associated with the first information, and information associated with the similar image Is specified as the second information. This embodiment is not limited to this. The object associated with the first information and the second information may be a sound.

[Configuration of Information Processing System 9]
The information processing system 9 (not shown) according to the present embodiment includes a terminal device 16 (not shown).

  The terminal device 16 according to the present embodiment includes a control unit 112 (not illustrated) that functions in the same manner as the control unit 208 (not illustrated) of the server 23 included in the fifth embodiment, and a second associated with the similar sound. A display unit 113 (not shown) for displaying information to the user is provided.

  Also in the information processing system 9 according to the eighth embodiment, the same effect as the information processing system 6 according to the fifth embodiment can be obtained except that the target associated with the first information and the second information is a sound. it can.

  Description of members having the same functions as those described in the above-described embodiments is omitted.

[Information processing]
In the information processing (information processing method) in the information processing system 9 according to the present embodiment, there is no data exchange between the communication unit 101 and the communication unit 201. Further, the control unit 112 of the terminal device 16 performs control instead of the control unit 208 of the server 23. Except for these points, the information processing in the information processing system 9 according to the present embodiment is performed in the same manner as the information processing of the information processing system 9 according to the fifth embodiment.

<Ninth Embodiment>
Each block of the terminal devices 10 to 16 and the servers 20 to 23 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or software using a CPU (Central Processing Unit). It may be realized by. In the latter case, each of the terminal devices 10 to 16 and the servers 20 to 23 can be configured using a computer (electronic computer) as shown in FIG.

  FIG. 15 is a block diagram illustrating a configuration of a computer 910 that can be used as the terminal devices 10 to 16 and the servers 20 to 23. The computer 910 includes an arithmetic device 912, a main storage device 913, an auxiliary storage device 914, an input / output interface 915, and a communication interface 916 that are connected to each other via a bus 911. The arithmetic device 912, the main storage device 913, and the auxiliary storage device 914 may be storages such as a CPU, a random access memory (RAM), a hard disk drive, and a flash memory, respectively. Connected to the input / output interface 915 are an input device 920 for the user to input various information to the computer 910 and an output device 930 for the computer 910 to output various information to the user. The input device 920 and the output device 930 may be built in the computer 910 or may be connected (externally attached) to the computer 910. For example, the input device 920 may be a keyboard, a mouse, a touch sensor, or the like, and the output device 930 may be a display, a printer, a speaker, or the like. A device having both functions of the input device 920 and the output device 930, such as a touch panel in which a touch sensor and a display are integrated, may be applied. The communication interface 916 is an interface for the computer 910 to communicate with an external device.

  The auxiliary storage device 914 stores various programs for operating the computer 910 as the terminal devices 10 to 16 and the servers 20 to 23. Then, the arithmetic device 912 expands the above-described program stored in the auxiliary storage device 914 on the main storage device 913, and executes instructions included in the program. Accordingly, the computer 910 is caused to function as each unit included in the terminal devices 10 to 16 or the servers 20 to 23. Note that the recording medium for recording information such as programs provided in the auxiliary storage device 914 may be a computer-readable “non-temporary tangible medium”. For example, tape, disk, card, semiconductor memory, programmable logic, etc. It may be a circuit or the like.

  Moreover, the above-mentioned program may be acquired from the outside of the computer 910, and in this case, it may be acquired via an arbitrary transmission medium (such as a communication network or a broadcast wave). The embodiment can also be realized in the form of a data signal embedded in a carrier wave in which the above-described program is embodied by electronic transmission.

  As described above, the program for causing the computer 910 according to the present embodiment to function as the control unit 202, 204, 206, or 207 is a program for causing the computer 910 to function as any of the servers 20 to 23.

  A program for causing the computer 910 to function can be suitably functioned as the control units 202, 204, 206, or 207 of the servers 20-23.

  Further, a program for causing the computer 910 according to the present embodiment to function as the control unit 102, 105, 107, 109, or 112 is a program for causing the computer to function as any of the terminal devices 10 to 16.

  A program for causing the computer 910 to function can be suitably caused to function as the control unit 102, 105, 107, 109, or 112 of the terminal device 10-16.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

1, 3-9 Information processing system 2 Network 10-16 Terminal device 20-23 Server 101, 201 Communication unit 102, 105, 107, 109, 112, 202, 204, 206, 208 Control unit 103, 113 Display unit 104 Operation Unit 106, 108, 110, 111, 203, 205, 207 Storage unit 221 Parameter calculation unit 231 Image 232, 235 Image information database (database)
233 Product Information Database (Database)
241 Machine learning unit 910 Computer 911 Bus 912 Arithmetic device 913 Main storage device 914 Auxiliary storage device 915 Input / output interface 916 Communication interface 920 Input device 930 Output device

Claims (15)

An information processing apparatus that refers to a database including image data and information associated with each other,
With a control unit,
The control unit
Get the first information,
Referring to the database to identify a similar image similar to the image associated with the first information;
An information processing apparatus characterized by identifying information associated with the similar image as second information.   The information processing apparatus according to claim 1, wherein the control unit calculates a parameter used for specifying the similar image by analyzing an image associated with the first information.   The information processing apparatus according to claim 2, wherein the parameter is at least one of hue, brightness, saturation, and atmosphere.   The information processing apparatus according to claim 1, wherein the control unit identifies the similar image based on machine learning that refers to a new image and a past image. .   The said control part specifies the information linked | related with the similar image with higher similarity as said 2nd information, when the said similar image exists in multiple numbers, The any one of Claims 1-4 characterized by the above-mentioned. The information processing apparatus according to item 1. An information processing apparatus that refers to a database including sound data and information associated with each other,
With a control unit,
The control unit
Get the first information,
Referring to the database to identify similar sounds similar to the sound associated with the first information;
An information processing apparatus that identifies information associated with the similar sound as second information.   7. The device according to claim 1, wherein the first information is a product name, and the second information is product information related to a product different from the first information. Information processing device. The information processing apparatus according to any one of claims 1 to 7,
An information processing system comprising a terminal device,
The terminal device is
A communication unit that receives the second information from the information processing apparatus;
An information processing system comprising: a display unit that displays the second information to a user. A terminal device including a control unit, a display unit, and a communication unit,
The control unit
Transmitting the first information to the information processing apparatus via the communication unit;
Receiving second information associated with a similar image similar to the image associated with the first information from the information processing apparatus via the communication unit;
A terminal device that displays the second information on the display unit. A terminal device including a control unit, a display unit, and a communication unit,
The control unit
Transmitting the first information to the information processing apparatus via the communication unit;
Receiving second information associated with a similar sound similar to the sound associated with the first information from the information processing apparatus via the communication unit;
A terminal device that displays second information associated with the similar sound on the display unit. The terminal device according to claim 9 or 10,
An information processing system comprising an information processing device,
The information processing apparatus includes a control unit that identifies the second information.   A program for causing a computer to function as the information processing apparatus according to claim 1, wherein the program causes the computer to function as the control unit.   The program for functioning a computer as a terminal device of Claim 9 or 10, Comprising: The program for functioning the said computer as said control part. An information processing method for referring to a database including image data and information associated with each other,
A first information acquisition step of acquiring first information;
A similar image specifying step of specifying a similar image similar to the image associated with the first information with reference to the database;
An information processing method comprising: a second information specifying step of specifying information associated with the similar image as second information. An information processing method for referring to a database including sound data and information associated with each other,
A first information acquisition step of acquiring first information;
A similar sound identifying step of referring to the database to identify a similar sound similar to the sound associated with the first information;
An information processing method comprising: a second information specifying step of specifying information associated with the similar sound as second information.

Images