WO2024075150A1 - Information processing device, information processing method, program, and recording medium - Google Patents

Abstract

[Problem] To provide an information processing device capable of suppressing inclusion of subjectivity of a user in reaction information acquired from a user terminal. [Solution] A server 11 comprising a content acquisition unit 18 that acquires a content from a provider terminal 12 via a network 14 and a content provision unit 19 that provides the content acquired by the content acquisition unit 18 to a user terminal 13 via the network 14, the server 11 comprising a reaction recognition unit 20 that acquires reaction information relating to the user on the basis of at least one of biometric information relating to the user and video information obtained by capturing an expression of the face of the user when the user uses the content on the user terminal 13 and a processing execution unit 21 that performs predetermined processing that associates the content and the user terminal 13 with each other on the basis of the reaction information acquired by the reaction recognition unit 20.

Description

Information processing device, information processing method, program, and recording medium

This disclosure relates to an information processing device, information processing method, program, and recording medium that acquires content from a provider terminal via a network and provides the acquired content to a user terminal via the network.

Patent Document 1 describes an example of an information processing device that provides content provided by an information provider to a user terminal used by a user via a network. The information processing device described in Patent Document 1 is a server device. This server device is characterized by having an acquisition means for acquiring input information including at least one of information regarding tips given to players and impressions from spectators (users) who watched the player's match (content), an evaluation means for evaluating the input information acquired by the acquisition means for each player, and a provision means for providing the evaluation information evaluated by the evaluation means to the outside.

The acquisition means described in Patent Document 1 includes a display control means for displaying an input screen for inputting input information on a device owned by a spectator, and a receiving means for receiving the input information input via the input screen. Furthermore, it is described that the input screen includes a button for inputting tips, and a button for continuously inputting impression points that indicate the impression the spectator has on a player. Specifically, spectators watch the game at the venue or via a television broadcast, and depending on the degree of impression they feel as a result of watching the game, can access the site server via a personal computer (user terminal) or mobile terminal (user terminal) and input the information via a browser screen.

JP 2017-174134 A

The inventors of this application recognized the problem that, in the server device described in Patent Document 1, users operate their user terminals to input their own impression points, and therefore the impression points acquired by the server device are determined subjectively by the users.

In addition to the invention of Patent Document 1, it has been difficult to ensure the true meaning of reviews of various products and services using only text and images. The purpose of this disclosure is to provide an information processing device, information processing method, program, and recording medium that can prevent the reaction information acquired from a user terminal from including the user's subjective opinion.

The present disclosure relates to an information processing device having a content acquisition unit that acquires content from a provider terminal via a network, and a content provision unit that provides the content acquired by the content acquisition unit to a user terminal via the network, the information processing device having a reaction recognition unit that acquires reaction information of the user based on at least one of biometric authentication information of the user when the user uses the content on the user terminal or video information capturing the facial expression of the user, and a processing execution unit that performs a predetermined process that associates the content with the user terminal based on the reaction information acquired by the reaction recognition unit.

According to the present disclosure, it is possible to prevent the reaction information acquired by an information processing device from a user terminal from including the subjectivity of the user.

1 is a block diagram showing a configuration of an information processing system including an information processing device and a recording medium. 1 is a flowchart illustrating an example of an information processing method performed in an information processing system. FIG. 3A is a flowchart showing another example of processing performed in the information processing system, and FIG. 3B is a flowchart showing another example of processing performed in the information processing system. FIG. 4A is a flowchart showing another example of processing 3 performed in the information processing system, and FIG. 4B is a flowchart showing another example of processing 4 performed in the information processing system.

(overview)
The present disclosure relates to an information processing device, an information processing method, a program, and a recording medium for obtaining content from a provider terminal via a network, providing the obtained content to a user terminal via the network, and obtaining facial expression and biometric information and associating the user with the content. The information processing system described below includes these information processing devices, information processing methods, programs, and recording media. Below, several embodiments included in the information processing system will be described with reference to the drawings. In the drawings for explaining the embodiments of the information processing system, the same parts are generally designated by the same reference numerals, and repeated description will be omitted.

The information processing system 10 shown in FIG. 1 includes a server 11 as an information processing device, a provider terminal 12, a user terminal 13, a biometric authentication device 36, and a recording medium 70. The server 11 and the provider terminal 12 are configured to be able to communicate with each other via a network 14, and the server 11 and the user terminal 13 are configured to be able to communicate with each other via the network 14.

The biometric authentication device 36 is a device that detects the biometric information of the user of the user terminal 13 and outputs a signal according to the detection result. For convenience, a single provider terminal 12 is shown in FIG. 1, but multiple provider terminals 12 can be connected to the server 11 independently. Also, a single user terminal 13 is shown, but multiple user terminals 13, 13A can be connected to the server 11 independently.

In this disclosure, the server 11 is managed and operated by an information administrator. The provider terminal 12 is operated and used by a provider who publishes content on the network 14. The user terminal 13 is operated and used by a user who uses the content published on the network 14. The content includes digital content such as video including audio information, still images, music, games, etc. The use of content includes purchase, download, playback, display, operation, etc. Downloading includes streaming. The use of content may be either using the content in parallel with the acquisition of the content on the user terminal 13, or using the content on the user terminal 13 a predetermined time after acquiring and storing the content on the user terminal 13.

(Description of Recording Medium)
The recording medium 70 includes a magnetic tape, a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. The recording medium 70 records, that is, stores, programs and applications that are started in the server 11 to perform processing, judgment, etc.

(Server description)
The server 11 is a computer capable of performing various processes, judgments, decisions, etc., based on input signals and pre-stored information such as programs, applications, data, etc. The server 11 has a control unit 15, a memory unit 16, a communication unit 17, and a reading unit 71. The control unit 15 has an input port, an output port, and an arithmetic processing circuit. The control unit 15 can transmit and receive signals between the memory unit 16 and the communication unit 17. The memory unit 16 stores information such as programs, applications, data, etc. in advance. The memory unit 16 also stores information transmitted from the provider terminal 12, information transmitted from the user terminal 13, contract contents exchanged between the provider terminal 12 and the user terminal 13, etc.

The communication unit 17 has a function of transmitting signals output from the control unit 15 to the provider terminal 12 and the user terminal 13 via the network 14, and a function of sending signals received from the provider terminal 12 and the user terminal 13 via the network 14 to the control unit 15. Furthermore, the communication unit 17 can also transmit and receive signals to and from computers other than the provider terminal 12 and the user terminal 13 via the network 14. The reading unit 71 reads programs, applications, etc. from the recording medium 70, and sends the read programs, applications, etc. to the control unit 15.

The control unit 15 has a content acquisition unit 18, a content provision unit 19, a reaction recognition unit 20, a processing execution unit 21, a content recommendation unit 22, a reaction memory unit 39, a customer management unit 40, and a consideration management unit 41. The content acquisition unit 18 has a function of acquiring content received from the provider terminal 12 and processing the content. The content provision unit 19 has a function of publishing the acquired content on the network 14, and a function of providing content to the user terminal 13 in response to a request from the user terminal 13.

The reaction recognition unit 20 has a function of recognizing and judging reaction information received from the user terminal 13. The meaning of the reaction information will be described later. The reaction memory unit 39 stores the reaction information processed by the reaction recognition unit 20. The processing execution unit 21 performs a predetermined process that associates content with the user terminal 13 based on the reaction information. The predetermined process will be described later. The content recommendation unit 22 has a function of recommending to the user terminal 13 content that has not been provided to the user terminal 13 before.

The customer management unit 40 has a function of managing the provider information of the provider terminal 12 and the user information of the user terminal 13. The customer management unit 40 also has a function of determining the characteristics and trends of the content used for each user terminal 13, and accumulating and analyzing reaction information to the content used for each user terminal 13. The compensation management unit 41 manages the account numbers included in the user information, the account numbers included in the provider information, and the deposit account set up by the server 11 on the network 14. The compensation management unit 41 also manages the compensation granted to the user terminal 13 from the deposit account, the fees paid from the user terminal 13, and the fees paid from the provider terminal 12 to the server 11.

The control unit 15 can store the programs, applications, etc. that the reading unit 71 reads from the recording medium 70 in the memory unit 16. The control unit 15 activates the programs, applications, etc. that the reading unit 71 reads from the recording medium 70, thereby causing the content providing unit 19, content acquiring unit 18, reaction recognition unit 20, processing execution unit 21, content recommendation unit 22, reaction storage unit 39, customer management unit 40, and consideration management unit 41 to function. The control unit 15 performs processing, comparison, and judgment based on signals input via the communication unit 17, information stored in the reaction storage unit 39, information stored in the customer management unit 40, information in the consideration management unit 41, and information stored in the memory unit 16. The control unit 15 also stores the results of the executed processing, comparison, and judgment in the memory unit 16.

Note that the server 11 can start programs, applications, etc. recorded on the recording medium 70 while the reading unit 71 is connected to the recording medium 70. The server 11 can also start programs, applications, etc. read from the recording medium 70 while the reading unit 71 is not connected to the recording medium 70 after reading the programs, applications, etc. recorded on the recording medium 70 with the reading unit 71 and storing them in the memory unit 16.

(Explanation of provider terminal)
The provider terminal 12 may be any of a desktop personal computer, a notebook personal computer, a smartphone, a tablet terminal, etc. The provider terminal 12 has a control unit 23, an operation unit 24, a display unit 25, a storage unit 26, and a communication unit 27. The control unit 23 has an arithmetic processing circuit, an input port, and an output port. The control unit 23 can transmit and receive signals between the storage unit 26 and the communication unit 27. The storage unit 26 stores information such as programs, applications, and data in advance. The storage unit 26 also stores information transmitted from the server 11, the contents of the contract exchanged between the provider terminal 12 and the user terminal 13, and the results of processing and judgment performed by the control unit 23.

The communication unit 27 has a function of transmitting a signal output from the control unit 23 to the server 11 via the network 14, and a function of sending a signal received from the server 11 via the network 14 to the control unit 23. When the communication unit 27 sends a signal to the server 11, the signal is transmitted in association with the provider information of the provider terminal 12. Furthermore, the communication unit 27 can also transmit and receive signals to and from computers other than the server 11 via the network 14.

The operation unit 24 is constructed with at least one element of a touch switch, a display screen such as a liquid crystal panel, a keyboard, a mouse, a scanner, etc. When the provider operates the operation unit 24, a signal corresponding to the operation is input to the control unit 23. The display unit 25 is constructed with a touch panel, a liquid crystal panel, etc. The display unit 25 displays information input at the provider terminal 12, information acquired from the server 11 and the user terminal 13, etc. The content displayed on the display unit 25 is controlled and switched by the control unit 23. If the provider terminal 12 is a smartphone or a tablet terminal, the operation unit 24 corresponds to an operation menu (operation buttons) displayed on the display screen of the display unit 25. The control unit 23 performs processing, comparison, judgment, etc. based on the signal input via the communication unit 27, the signal corresponding to the operation of the operation unit 24, and the information stored in the memory unit 16.

(Explanation of user terminal)
The user terminal 13 may be any of a desktop personal computer, a notebook personal computer, a smartphone, a tablet terminal, etc. The user terminal 13 has a control unit 28, an operation unit 29, a display unit 30, a memory unit 31, a communication unit 32, a speaker 33, a camera 34, and a microphone 35. The control unit 28 has an arithmetic processing circuit, an input port, and an output port. The control unit 28 can transmit and receive signals between the memory unit 31, the communication unit 32, the speaker 33, the camera 34, and the microphone 35. The memory unit 31 stores information such as programs, applications, and data in advance. The memory unit 31 also stores information transmitted from the server 11, the contents of the contract exchanged between the provider terminal 12 and the user terminal 13, and the results of processing and judgment performed by the control unit 28.

The communication unit 32 has a function of transmitting a signal output from the control unit 28 to the server 11 via the network 14, and a function of sending a signal received from the server 11 via the network 14 to the control unit 28. When the communication unit 32 transmits a signal to the server 11, the signal is transmitted in association with the user information of the user terminal 13. Furthermore, the communication unit 32 can also transmit and receive signals to and from computers other than the server 11 via the network 14.

The operation unit 29 is constructed with at least one element of a touch switch, a display screen such as a liquid crystal panel, a keyboard, a mouse, a scanner, etc. When a user operates the operation unit 29, a signal corresponding to the operation is input to the control unit 28. The display unit 30 is constructed with a touch panel, a liquid crystal panel, etc. The display unit 30 displays information input at the user terminal 13, information acquired from the server 11 and the provider terminal 12, and images included in the acquired content. The images include still images and videos. The content displayed on the display unit 30 is controlled and switched by the control unit 28. If the user terminal 13 is a smartphone or a tablet terminal, the operation unit 29 corresponds to an operation menu (operation buttons) displayed on the display screen of the display unit 30.

The camera 34 may be either directly attached to the main body of the user terminal 13, or connected to the user terminal 13 via a signal cable. The camera 34 captures the user's face and facial expression, and a signal of the captured video information is input to the control unit 28. The video captured by the camera 34 may be either a still image or a video. A signal including shooting information such as the shooting date and shooting time is attached to the video captured by the camera 34. The microphone 35 collects sounds such as laughter and cheers made by the user, and a signal corresponding to the collected sound and volume is input to the control unit 28. The speaker 33 is controlled by the control unit 28, and outputs the sound and music included in the content obtained from the server 11.

(Explanation of the biometric authentication device)
The biometric authentication device 36 is a reaction information detection device that detects reaction information of a user who uses content and outputs a signal. The biometric authentication device 36 detects the reaction information of the user from the biometric authentication information and behavioral characteristics of the user. The biometric authentication device 36 includes a heart rate monitor 37 and a blood pressure monitor 38 in addition to the above-mentioned camera 34 and microphone 35. The heart rate monitor 37 measures the user's heart rate per predetermined time and outputs a signal. The blood pressure monitor 38 measures the user's blood pressure and outputs a signal. The signal output from the heart rate monitor 37 and the signal output from the blood pressure monitor 38 are processed by the control unit 28. The user's laughter and cheers, the user's facial expression when laughing, the user's facial expression when moved, etc. are the user's behavioral characteristics. The user's pulse rate and blood pressure are the user's biometric authentication information.

The control unit 28 performs processing and judgment based on signals input via the communication unit 32, signals corresponding to the operation of the operation unit 29, signals input from the camera 34, signals input from the microphone 35, signals input from the heart rate monitor 37, signals input from the blood pressure monitor 38, and programs and applications stored in the memory unit 31. The control unit 28 also sends signals corresponding to the results of the processing and judgment to the network 14 via the communication unit 32.

(Processing example)
An example of processing performed in the information processing system 10 will be described with reference to Fig. 2. Among the example of processing shown in Fig. 2, the server 11 executes the processing and judgment steps by starting up the programs and applications acquired from the recording medium 70. The user terminal 13 inputs user information in step S10 and transmits it to the server 11. The user information includes the identification number of the user terminal 13, the user's name (name), address, date of birth, age, password, user ID, telephone number, email address, bank or post office account number, account number for electronic money or cryptocurrency, etc. Cryptocurrency includes virtual currency.

Furthermore, when content is not being used on the user terminal 13, the user's face (facial expression) is photographed by the camera 34, the user's heart rate is measured by the heart rate meter 37, and the user's blood pressure is measured by the blood pressure meter 38. In step S10, a signal including the image information of the user's face photographed by the camera 34, the user's heart rate per specified time, the user's blood pressure, etc. is transmitted from the user terminal 13 to the server 11.

The provider terminal 12 inputs provider information in step S11 and transmits it to the server 11. The provider information includes the identification number of the provider terminal 12, the provider's name (title), address, password, user ID, telephone number, email address, bank or post office account number, account number for electronic money or crypto assets, etc. Crypto assets include virtual currencies. The server 11 processes and stores the information transmitted from the user terminal 13 in step S12. The server 11 also processes and stores the information transmitted from the provider terminal 12.

The user terminal 13 inputs the contract details in step S13 and transmits them to the server 11, and the provider terminal 12 inputs the contract details in step S14 and transmits them to the server 11. The server 11 acquires and stores the contract details exchanged between the user terminal 13 and the provider terminal 12 in step S15. The contract details include the following. For example, it includes a contract whereby the user terminal 13 pays a fee (usage fee) to the provider terminal 12 when content is used at the user terminal 13 and the user uses the content and shows a reaction. It also includes a contract whereby the user terminal 13 does not pay a fee to the provider terminal 12 when the user uses the content and shows no reaction. Here, "a reaction when using the content" includes at least one of the following: a smile on the user's face, the user laughs, and the user cheers.

Furthermore, it includes a contract that changes the compensation paid from the user terminal 13 to the provider terminal 12 in response to a user's reaction to the content depending on the level of the reaction. For example, the higher the level of the reaction, the higher the compensation. The compensation paid from the user terminal 13 to the provider terminal 12 includes cash, cryptocurrency, points, etc. Furthermore, in step S15, the server 11 performs a process to receive the compensation included in the contract. Note that steps S10, S11, and S12 may be performed after steps S13, S14, and S15 have been performed.

After the processes of steps S12 and S15 are performed by the server 11, the provider terminal 12 transmits the content to the server 11 in step S16. The server 11 acquires the content in step S17 and stores it in the storage unit 16. The server 11 also publishes on the network 14 in step S17 that the acquired content can be viewed from outside.

In step S18, the user terminal 13 can check a list of content published on the network 14. The list of content is displayed on the display unit 30. In addition, when an operation to select any content is performed on the operation unit 29 in the user terminal 13, a request to acquire the selected content can be sent to the server 11 in step S18. Then, the server 11 that has received the request to acquire the content sends the content to the user terminal 13 in step S19. In addition, the server 11 associates the history of receiving requests to acquire content from the user terminal 13 and the history of sending content to the user terminal 13 with the user information of the user terminal 13 and stores them in the storage unit 16 in step S19.

In step S20, the user terminal 13 acquires the content from the server 11 and uses the content. Using the content includes displaying still images or videos on the display unit 30, outputting music and audio contained in the content from the speaker 33, and the like. This allows the user to enjoy the provided content. In addition, while the user is using the content, the biometric authentication device 36 detects the user's reaction information and outputs a signal.

The reaction information detected by the biometric authentication device 36 is processed in the user terminal 13 in step S21. The user terminal 13 transmits the reaction information to the server 11 in step S22. The server 11 acquires the reaction information from the user terminal 13 in step S23, and the reaction recognition unit 20 processes and judges the reaction information, and stores the judgment result in the memory unit 16. Specifically, the reaction recognition unit 20 processes the reaction information including the change in the facial expression of the user of the user terminal 13, the heart rate of the user of the user terminal 13 stored in step S12, the blood pressure of the user of the user terminal 13 stored in step S12, and laughter and cheers emitted by the user, thereby making it possible to determine whether or not the user of the user terminal 13 has reacted, the number of times the user of the user terminal 13 has reacted within a specified period of time, the timing at which the user of the user terminal 13 reacted, etc. The presence or absence of a reaction of the user of user terminal 13 refers to whether the user of user terminal 13 laughed, whether the user of user terminal 13 cheered, and whether the user of user terminal 13 became excited. Whether the user of user terminal 13 laughed can be determined from a change in facial expression and the presence or absence of laughter. The number of times the user of user terminal 13 reacted within a specified time period refers to the number of times the user of user terminal 13 laughed, the number of times the user of user terminal 13 cheered, and the number of times the user of user terminal 13 became excited within the specified time period. The timing at which the user of user terminal 13 reacted refers to the timing at which the user reacted between the start and end of use of the content.

The reaction recognition unit 20 can determine whether the user of the user terminal 13 has laughed or not by performing face recognition processing by comparing the image captured by the camera 34 with the image of the face of the user of the user terminal 13 previously stored in step S12. Since face recognition processing is publicly known as described in JP 2005-275605 A, JP 2005-352892 A, JP 2007-148968 A, etc., a detailed explanation will be omitted. The reaction recognition unit 20 determines the level of laughter of the user of the user terminal 13 from the volume (volume) of the laughter of the user of the user terminal 13 when using the content. Specifically, it is determined that the louder the laughter, the higher the level of laughter. The reaction recognition unit 20 compares the heart rate of the user of the user terminal 13 when not using the content with the heart rate of the user of the user terminal 13 when using the content, and determines whether the user of the user terminal 13 is excited, the level of excitement of the user of the user terminal 13, etc.

The reaction recognition unit 20 also compares the blood pressure of the user of the user terminal 13 when not using the content with the blood pressure of the user of the user terminal 13 when using the content, and judges whether or not the user of the user terminal 13 is excited, and the level of excitement of the user of the user terminal 13. For example, it judges that the greater the increase in heart rate, the higher the level of excitement, and that the greater the increase in blood pressure, the higher the level of excitement. In step S23, the server 11 also creates evaluation information of the user of the user terminal 13 regarding the content based on the reaction information acquired from the user terminal 13, and stores the evaluation information in the storage unit 16. The evaluation information associates the content with the presence or absence of a reaction of the user of the user terminal 13 corresponding to the content, and the reaction level of the user of the user terminal 13.

In step S24, the server 11 judges whether the contract contents can be executed. The server 11 makes the judgment in step S24 based on the judgment result of the reaction information. For example, if there is a reaction from the user of the user terminal 13, it judges that "the contract contents will be executed," and if there is no reaction from the user of the user terminal 13, it judges that "the contract contents will not be executed." Here, if at least one of the reaction information including a smiling face, a laughing voice, a cheer, an increase in heart rate or blood pressure, etc. is detected, it is judged that there is a reaction from the user of the user terminal 13. Also, if none of the reaction information including a smiling face, a laughing voice, a cheer, an increase in heart rate or blood pressure, etc. is detected, it is judged that there is no reaction from the user of the user terminal 13.

In addition, the server 11 may determine that the contract contents are to be executed if the number of times the user of the user terminal 13 responds within a specified time period, or the response level of the user of the user terminal 13, exceeds a threshold value previously stored in the storage unit 16. In contrast, the server 11 may determine that the contract contents are not to be executed if the number of times the user of the user terminal 13 responds within a specified time period, or the response level of the user of the user terminal 13, is equal to or lower than a threshold value previously stored in the storage unit 16.

Furthermore, when the server 11 determines in step S24 that the "contract contents are to be executed," it may change the "degree of execution of the contract contents" according to the number of times the user of the user terminal 13 reacts within a specified time period, or the reaction level of the user of the user terminal 13. Here, the "degree of execution of the contract contents" includes increasing the amount of compensation paid the higher the reaction level, increasing the amount of cryptocurrency paid the higher the reaction level, increasing the number of points awarded the higher the reaction level, etc.

If the server 11 determines in step S24 that the contract contents are to be executed, the server 11 performs the procedures specified in the contract contents in step S24. That is, the server 11 performs processes such as payment and settlement of cash or cryptocurrency to the user's account in the user terminal 13, granting points to the user terminal 13, and payment and settlement to the provider's account. In step S25, the server 11 transmits information to the user terminal 13 and the provider terminal 12 indicating that the procedures specified in the contract contents have been performed or that the procedures specified in the contract contents have not been performed. Furthermore, the information transmitted to the provider terminal 12 in step S25 may include evaluation information of the user of the user terminal 13 regarding the content. The user terminal 13 acquires information from the server 11 in step S26. The provider terminal 12 acquires information from the server 11 in step S27.

In this way, the reaction information acquired by the server 11 from the user terminal 13 is detected by the biometric authentication device 36. Therefore, it is possible to prevent the reaction information acquired by the server 11 from including the subjective opinion of the user. Furthermore, the provider terminal 12 can acquire evaluation information on the content provided to the user terminal 13 in step S27. Therefore, the provider who manages the provider terminal 12 can use the evaluation information acquired from the server 11 when promoting its own products, i.e., content, on social networking services (SNS), TikTok (registered trademark), YouTube (registered trademark), etc. on the network 14. Furthermore, the provider can use the reaction information acquired from the server 11 for business-to-business transactions via other computers connected to the network 14. Furthermore, the server 11 can also send a message to the provider terminal 12 in step S25 stating, "If the reaction of the user terminal is good, we will publish your company's advertisement on the network free of charge."

(Another Processing Example 1)
Furthermore, the information processing system 10 can also perform the processing of Fig. 3A on the premise that steps S17, S19, and S23 of Fig. 2 have been performed. In the processing example shown in Fig. 3A, the processing and judgment steps executed by the server 11 are executed by the server 11 by activating a program or application acquired from the recording medium 70.

In step S30, the server 11 selects other content that is presumed to provide reaction information similar to the reaction information of the content acquired by the user terminal 13, from among the content that the user terminal 13 has not previously acquired. The server 11 then recommends the other content selected in step S30 to the user terminal 13 in step S31. The user terminal 13 can display the recommended information on the display unit 30, and issue a request to acquire other content in step S18. This makes it easier for the user of the user terminal 13 to search for content that matches their preferences.

In the control example of FIG. 2, the following process may be performed. When the user terminal 13A is connected to the server 12, the user terminal 13A can execute the contents of steps S10, S13, S18, S20, S21, S22, and S26 in FIG. 2. The server 12 also executes the contents of steps S12, S15, S19, S23, S24, and S25 based on the information transmitted from the user terminal 13A. The control unit 15 of the server 12 processes and stores the reaction information transmitted from the multiple user terminals 13A in step S23. Here, the users of the multiple user terminals 13A are stratified into multiple age groups. Furthermore, the average heart rate and the average blood pressure are calculated and stored for each age group. Also, for each content provided to the multiple user terminals 13A, the presence or absence of a reaction from the user, the number of times the user laughed, the number of times the user reacted within a specified time, the timing of the user's reaction, and the like are stored.

Then, when the user terminal 13 is connected to the server 12, the control unit 15 can execute the following process in step S23. By comparing the average heart rate for each age group of users acquired by the server 12 from the user terminal 13A and the average blood pressure for each age group of users acquired by the server 12 from the user terminal 13A with the heart rate and blood pressure of the user transmitted from the user terminal 13 in step S22, it is possible to determine whether or not the user of the user terminal 13 has responded, and to determine whether or not the user of the user terminal 13 is excited, the level of excitement of the user of the user terminal 13, etc.

Furthermore, the average heart rate and average blood pressure for each age group published by a public institution may be stored in advance in the memory unit 16 of the server 11. The control unit 15 of the server 11 then compares the average heart rate for each age group stored in the memory unit 16 and the average blood pressure for each age group stored in the memory unit 16 with the user's heart rate and blood pressure transmitted from the user terminal 13 in step S22 to determine whether or not the user of the user terminal 13 has responded, and can also determine whether or not the user of the user terminal 13 is excited, the level of excitement of the user of the user terminal 13, etc.

(Another Processing Example 2)
Furthermore, the information processing system 10 can also perform the processing of FIG. 3B on the premise that steps S17, S19, and S23 of FIG. 2 have been performed. In the processing example shown in FIG. 3B, the server 11 executes the processing and judgment steps by starting a program and application acquired from the recording medium 70. In step S40, the server 11 can detect the presence or absence of a user terminal 13 that has acquired similar reaction information among a plurality of user terminals 13 that have used the same content. The similar reaction information includes laughing at the same timing, cheering at the same timing, getting excited at the same timing, the difference in the number of laughs being a predetermined number or less, the difference in the number of cheers being a predetermined number or less, the difference in the number of excited times being a predetermined number or less, and the like, during the use of the content. When at least one of these is detected, it can be determined that there is a user terminal 13 that has acquired similar reaction information.

Then, in step S41, the server 11 can transmit auxiliary information such as "There is another user terminal that has had similar reaction information about the content you used" to each of the multiple user terminals 13 that have obtained similar reaction information by using the same content. The multiple user terminals 13 can obtain the auxiliary information in step S42 and display the auxiliary information on the display unit 30.

When the process of FIG. 3(B) is performed, a plurality of user terminals 13, 13A search for other user terminals 13A that have similar reactions to the same content on the network 14, which becomes a clue for connecting the user terminals 13, 13A with each other. A plurality of user terminals 13, 13A can search for partners, for example, through an application programming interface (API), a social networking service (SNS), a matching app, etc. Thus, users can easily find user terminals 13 that show similar reactions when using content. Note that the level of information to be sent to each user terminal 13, 13A, for example the level of connection, may be changed according to the degree to which similar reaction information regarding the same content has been obtained. For example, the higher the volume, the stronger the level of connection, the longer the duration of laughter, or the more times the user laughs, the stronger the level of connection.

(Other Processing Example 3)
On the premise that the information processing system 10 has performed steps S17, S19, and S23 in FIG. 2, the information processing system 10 can execute the process of FIG. 4A. In the process example shown in FIG. 4A, the server 11 executes the process and judgment steps by starting up a program and application acquired from the recording medium 70. In step S50, the server 11 randomly selects a user terminal 13 based on the content usage history of the first user terminal 13 and the history of reaction information when the content is used in the first user terminal 13. The user terminal 13 to be selected is a second user terminal 13A that has no history of acquiring the content acquired in the first user terminal 13 and is different from the first user terminal 13. The second user terminal 13A may be either a single terminal or a plurality of terminals.

Then, in step S51, the server 11 performs a process of transmitting information recommending new content to the second user terminal 13A selected in step S50. The second user terminal 13A obtains the recommended new information, and in step S18, can transmit a request to obtain the content. This makes it easier for the user of the second user terminal 13A to search for new content that matches their preferences.

(Other Processing Example 4)
The information processing system 10 can execute the process of Fig. 4B on the premise that steps S17, S19, and S23 of Fig. 2 have been performed. Among the process examples shown in Fig. 4B, the process and judgment steps executed by the server 11 are executed by the server 11 activating a program and an application acquired from the recording medium 70.

In step S60, the server 60 selects other content that has not received a content acquisition request from the specified user terminal 13 and is presumed to produce reaction information similar to the reaction information for the content acquired by the specified user terminal 13. The server 11 then recommends the other content to the specified user terminal 13 in step S61. It also sends a message to the specified user terminal 13 stating, "If the recommended content is not interesting, we will provide you with compensation."

Then, the same processing as steps S18, S20, S21, and S22 in FIG. 2 is performed at the specified user terminal 13. After that, the server 11 proceeds to step S23. If there is no reaction from the user, the server 11 can also make a decision to grant a compensation to the specified user terminal 13 at step S62. Therefore, the user of the specified user terminal 13 can obtain the compensation. Note that if there is no reaction from the user at step S23 on the server 11, the server 11 makes a decision not to grant a compensation to the specified user terminal 13 at step S62.

An example of the technical meaning of the matters described in this embodiment is as follows. The predetermined processing includes executing the contract exchanged between the provider terminal 12 and the user terminal 13 in step S24 of FIG. 2, the processing of step S31 of FIG. 3(A), the processing of step S41 of FIG. 3(B), the processing of step S51 of FIG. 4(A), the processing of step S61 of FIG. 4(B), etc.

The server 11 is an example of an information processing device. The content acquisition unit 18 can also be understood as a content acquisition circuit or a content acquirer. The content provision unit 19 can also be understood as a content provision circuit or a content provision circuit. The reaction recognition unit 20 can also be understood as a reaction processing circuit or a reaction processor. The processing execution unit 21 can also be understood as a processing execution circuit or a processing execution unit. The customer management unit 40 can also be understood as a customer management circuit or a customer management unit. The content recommendation unit 22 can also be understood as a content recommendation circuit or a content recommender. The biometric authentication device 36 can also be recognized as a reaction detection circuit or a reaction detector.

The process shown in FIG. 2, the process shown in FIGS. 3(A) and (B), and the process shown in FIGS. 4(A) and (B) are each an example of an information processing method. Step S17 in FIG. 2 is an example of a content acquisition step. Step S19 is an example of a content provision step. Step S23 is an example of a reaction recognition step. Step S24 is an example of a process execution step. The content acquisition step can also be understood as a content acquisition means. The content provision step can also be understood as a content provision means. The reaction recognition step can also be understood as a reaction recognition means. The process execution step can also be understood as a process execution means.

This embodiment is not limited to what is disclosed using the drawings, and various modifications are possible without departing from the gist of the present invention. For example, the information processing system may be understood as an information management system. Furthermore, the information processing device may be understood as an information management device. In this embodiment, the biometric authentication device may be either one that is provided in the user terminal itself, or an external device provided separately from the user terminal. The information processing device is a computer that performs various processes, judgments, decisions, etc., based on information including input signals, pre-stored programs, applications, data, etc. The computer as the information processing device includes at least one of a server, a workstation, a mainframe, a supercomputer, etc.

This disclosure can be used in an information processing device, information processing method, program, and recording medium that provide information prepared by an information provider to a user terminal used by a user via a network.

11...server, 12...provider terminal, 18...content acquisition unit, 19...content provision unit, 20...response recognition unit, 21...processing execution unit, 22...content recommendation unit, 40...customer management unit, 70...recording medium

Claims (10)

a content acquisition unit that acquires content from a provider terminal via a network;
a content providing unit that provides the content acquired by the content acquiring unit to a user terminal via the network;
An information processing device having
a reaction recognition unit that acquires reaction information of the user based on at least one of biometric authentication information of the user when the user uses the content on the user terminal and video information capturing a facial expression of the user;
a processing execution unit that performs a predetermined process of associating the content with the user terminal based on the reaction information acquired by the reaction recognition unit;
An information processing device having the above configuration. 2. The information processing device according to claim 1,
a customer management unit for storing a contract concluded between the provider terminal and the user terminal;
An information processing device, wherein the predetermined processing performed by the processing execution unit includes executing a contract concluded between the provider terminal and the user terminal. 2. The information processing device according to claim 1,
An information processing device having a content recommendation unit that recommends to the user terminal other content that is estimated to produce reaction information similar to the reaction information when the content is used on the user terminal. 2. The information processing device according to claim 1,
the content providing unit is capable of providing the content to a plurality of the user terminals via the network;
An information processing device having a content recommendation unit that recommends the content used on a first user terminal to a second user terminal other than the first user terminal among the multiple user terminals, based on the content usage history of the first user terminal among the multiple user terminals and reaction information when the content is used on the first user terminal. 2. The information processing device according to claim 1,
the content providing unit is capable of providing the content to a plurality of the user terminals via the network;
The specified processing performed by the processing execution unit includes sending auxiliary information to each of the user terminals among the multiple user terminals that have used the same content and have obtained similar reaction information, indicating that there is a user terminal that has obtained similar reaction information for the provided content. 2. The information processing device according to claim 1,
An information processing device, wherein the biometric authentication information of the user includes at least one of the user's heart rate or the user's blood pressure. 2. The information processing device according to claim 1,
The information processing device, wherein the content includes at least one of digital content of video and music. An information processing device connected to a provider terminal and a user terminal via a network,
a content acquisition step of acquiring content from the provider terminal via the network;
a content providing step of providing the content acquired in the content acquiring step to the user terminal via the network;
a reaction recognition step of acquiring reaction information of the user based on at least one of biometric authentication information of the user when the user uses the content on the user terminal and video information capturing a facial expression of the user;
a processing execution step of performing a predetermined process in which the content and the user terminal are associated with each other based on the reaction information acquired in the reaction recognition step;
An information processing method. An information processing device connected to a provider terminal and a user terminal via a network,
a content acquisition unit that acquires content from the provider terminal via the network;
a content providing unit that provides the content acquired by the content acquiring unit to the user terminal via the network;
a reaction recognition unit that acquires reaction information of the user based on at least one of biometric authentication information of the user when the user uses the content on the user terminal and video information capturing a facial expression of the user;
a processing execution unit that performs a predetermined process of associating the content with the user terminal based on the reaction information acquired by the reaction recognition unit;
A program that functions as a An information processing device connected to a provider terminal and a user terminal via a network,
a content acquisition unit that acquires content from the provider terminal via the network;
a content providing unit that provides the content acquired by the content acquiring unit to the user terminal via the network;
a reaction recognition unit that acquires reaction information of the user based on at least one of biometric authentication information of the user when the user uses the content on the user terminal and video information capturing a facial expression of the user;
a processing execution unit that performs a predetermined process of associating the content with the user terminal based on the reaction information acquired by the reaction recognition unit;
A recording medium on which a program that functions as a