US20220038406A1 - Communication system and communication control method - Google Patents
Communication system and communication control method Download PDFInfo
- Publication number
- US20220038406A1 US20220038406A1 US17/499,681 US202117499681A US2022038406A1 US 20220038406 A1 US20220038406 A1 US 20220038406A1 US 202117499681 A US202117499681 A US 202117499681A US 2022038406 A1 US2022038406 A1 US 2022038406A1
- Authority
- US
- United States
- Prior art keywords
- user
- message
- transmission
- past
- history
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
- H04L51/18—Commands or executable codes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M11/00—Telephonic communication systems specially adapted for combination with other electrical systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/21—Monitoring or handling of messages
- H04L51/226—Delivery according to priorities
-
- H04L51/14—
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
- A61B5/024—Measuring pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
- G06F16/24578—Query processing with adaptation to user needs using ranking
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/06—Message adaptation to terminal or network requirements
-
- H04L51/12—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/21—Monitoring or handling of messages
- H04L51/214—Monitoring or handling of messages using selective forwarding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/21—Monitoring or handling of messages
- H04L51/224—Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/42—Mailbox-related aspects, e.g. synchronisation of mailboxes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M11/00—Telephonic communication systems specially adapted for combination with other electrical systems
- H04M11/10—Telephonic communication systems specially adapted for combination with other electrical systems with dictation recording and playback systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M19/00—Current supply arrangements for telephone systems
- H04M19/02—Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone or busy tone
- H04M19/04—Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone or busy tone the ringing-current being generated at the substations
-
- H04W72/1205—
-
- H04L51/26—
-
- H04L51/32—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72436—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. short messaging services [SMS] or e-mails
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
Definitions
- the present disclosure relates to communication systems and communication control methods.
- Patent Literature 1 listed below describes a device configured to variably control content of a message to a user and its transmission timing in accordance with context (internal and external states) of the user.
- Patent Literature 2 listed below describes a system in which devices transmit and receive appropriate information to and from each other in accordance with feelings and/or behavior of users.
- Patent Literature 3 listed below describes a delivery service system configured to transmit voice information on a date designated through delivery scheduling.
- Patent Literature 1 JP 2015-5207A
- Patent Literature 2 JP 2007-207153A
- Patent Literature 3 JP 2002-101211A
- a receiver of a transmitted message has different feelings depending on timings of reading the received message.
- the message is delivered to a receiver in almost real time. Therefore, for example, the user wants to guess a current feeling of the receiver and transmit an apology or invitation message at an optimal timing.
- the optimal timing differs depending on content of the message.
- Patent Literature 1 described above is a technology of transmitting a message to himself/herself to control his/her motivation to achieve his/her goal. Therefore, it is difficult to solve the above described problem by using Patent Literature 1.
- Patent Literature 2 described above is a technology of recommending contents such as music in accordance with a feeling and/or behavior at that time, to meet his/her preference that changes in real time. Therefore, it is difficult to solve the above described problem by using Patent Literature 2.
- Patent Literature 3 described above is a technology for a user to designate a date and time to transmit voice information to another user. Therefore, it is difficult to solve the above described problem by using Patent Literature 3.
- the present disclosure proposes a communication system and a communication control method that are capable of receiving a transmission schedule and performing control such that a receiver is notified of a message at an optimal timing in view of content of the message and a psychological situation of the receiver.
- a communication system including: a communication unit configured to receive, from a communication source, a scheduling request for scheduling transmission of a message to a specific communication destination; and a control unit configured to perform control such that the communication destination is notified of existence of the message at a predetermined timing in accordance with content of the message and a current or past psychological situation of a user corresponding to the specific communication destination received by the communication unit.
- a communication control method including, by a processor: receiving, from a communication source, a scheduling request for scheduling transmission of a message to a specific communication destination; and performing control such that the communication destination is notified of existence of the message at a predetermined timing in accordance with content of the message and a current or past psychological situation of a user corresponding to the received specific communication destination.
- FIG. 1 is a diagram illustrating an application example of an information processing system according to an embodiment of the present disclosure.
- FIG. 2 is a diagram illustrating an overall configuration of the information processing system according to the embodiment.
- FIG. 3 is a block diagram illustrating an example of a configuration of a user terminal according to the embodiment.
- FIG. 4 is a block diagram illustrating an example of a configuration of a server according to the embodiment.
- FIG. 5 is a diagram illustrating an example of various kinds of data stored in storage units according to the embodiment.
- FIG. 6 is a flowchart illustrating a message communication control process according to the embodiment.
- FIG. 7 is a diagram illustrating an example of a message input screen according to the embodiment.
- FIG. 8 is a flowchart illustrating an appropriate time slot determination process of an apology or encouragement message according to the embodiment.
- FIG. 9 is a flowchart illustrating an appropriate time slot determination process of an invitation message according to the embodiment.
- FIG. 10 is a diagram illustrating an example of a heartbeat estimation result of a user B according to a first example.
- FIG. 11 is a diagram illustrating an example of a questionnaire input screen according to the embodiment.
- FIG. 12 is a diagram illustrating an example of a heartbeat estimation result of a user C according to a second example.
- an information processing system By using an information processing system according to an embodiment of the present disclosure, it is possible to receive a transmission schedule and perform control such that a receiver is notified of a message at an optimal timing in view of content of the message and a psychological situation of the receiver.
- FIG. 1 an application example of the information processing system according to the embodiment will be described.
- FIG. 1 is a diagram illustrating the application example of the information processing system according to the embodiment of the present disclosure.
- a user A communication source
- the user A wants to transmit the message at a timing at which the user B is in a good mood, or at least a timing other than a timing at which the user B is in a bad mood.
- the information processing system receives a transmission scheduling request of a message to the user B from the user A, and controls a transmission timing of the message in accordance with psychological situations of the user B.
- control is performed such that an apology e-mail whose transmission scheduling request has been issued by the user A is not transmitted and enters a standby state while the user B is in a bad mood, and the apology e-mail is transmitted when the user B gets in a good mood.
- This can establish better communication.
- the message is transmitted and received via user terminals 1 such as smatphones, mobile phone terminals, tablet terminals, wearable terminals (such as smart bands, smartglasses, or smartwatches), or personal computers (PCs).
- user terminals 1 such as smatphones, mobile phone terminals, tablet terminals, wearable terminals (such as smart bands, smartglasses, or smartwatches), or personal computers (PCs).
- a real-time psychological situation of the user B is estimated on the basis of sensor data (such as acceleration data, positional data, cardinal direction data, vibration data, sound data, captured image data, pulse data, heartbeat data, body temperature data, sweat amount data, brain wave data, or the like) detected by various kinds of sensors installed in a wearable terminal 10 worn by the user B or various kinds of sensors installed in a user terminal 1 b .
- sensor data such as acceleration data, positional data, cardinal direction data, vibration data, sound data, captured image data, pulse data, heartbeat data, body temperature data, sweat amount data, brain wave data, or the like
- the sensor data detected by the wearable terminal 10 is transmitted to the user terminal 1 b via Wi-Fi (registered trademark) or near-field communication such as Bluetooth (registered trademark).
- a heartbeat log or behavior recognition results are continuously acquired on the basis of the sensor data, and are used for determining an appropriate time slot of a notification timing at which a server 2 notifies of a message.
- the setting such that the heartbeat log and the behavior recognition results are not always acquired.
- the various kinds of sensors installed in the wearable terminal 10 or the user terminal 1 b are intermittently activated. This achieves electric power saving.
- another system to acquire the heartbeat log and the behavior recognition results of the user B, and refer to them as necessary in conjunction with the information processing system according to the embodiment.
- a schedule of a transmission destination user or weather information may also be used when the server 2 determines an appropriate time slot of the message notification timing.
- the server 2 appropriately acquires data from an external schedule server 4 a or an external weather information server 4 b via a network 3 .
- FIG. 2 is a diagram illustrating the overall configuration of the information processing system according to the embodiment.
- the information processing system includes a user terminal 1 a serving as the communication source, a user terminal 1 b serving as the communication destination, the wearable terminal 10 , and the server 2 .
- the wearable terminal 10 is configured to acquire sensor data to be used for estimating psychological situations of a communication destination user.
- the user terminals 1 a and 1 b are distinguished from each other as a communication source terminal and a communication destination terminal.
- the embodiment is not limited thereto.
- the user terminals 1 a and 1 b are implemented as user terminals 1 having the same configuration, and it is possible to use the user terminals 1 a and 1 b as any of the communication source and the communication destination.
- the server 2 connects with the user terminals 1 a and 1 b via the network 3 and transmits/receives data. Specifically, the server 2 receives a scheduling request from the user terminal 1 a , the scheduling request scheduling transmission of a message to a specific communication destination (here, the user terminal 1 b ).
- the server 2 performs control such that the user terminal 1 b is notified of existence of the message at a predetermined timing in accordance with content of the message and psychological situations of the user corresponding to the specific communication destination.
- the psychological situations of the user are acquired by the wearable terminals 10 worn by the user of the communication destination, and estimated by the server 2 on the basis of sensor data transmitted from the user terminal 1 b to the server 2 via the network 3 .
- FIG. 3 is a block diagram illustrating a configuration example of the user terminal 1 according to the embodiment.
- the user terminal 1 includes a control unit 100 , a communication unit 110 , a positional information acquisition unit 120 , a behavior recognition unit 130 , a heartbeat information processing unit 140 , an operation input unit 150 , a storage unit 160 , a display unit 170 , a speaker 180 , and a microphone 190 .
- the control unit 100 functions as an arithmetic processing device and a control device, and controls the overall operation in the user terminal 1 in accordance with various programs.
- the control unit 100 is implemented as a central processing unit (CPU), or an electronic circuit such as a microprocessor or the like.
- the communication unit 110 exchanges data with an external device in a wired/wireless manner.
- the communication unit 110 connects with the server 2 via the network 3 , and transmits a text message input via the operation input unit 150 .
- the communication unit 110 further includes a function of exchanging data with the wearable terminal 10 via Wi-Fi or near-field communication such as Bluetooth.
- the positional information acquisition unit 120 has a function of acquiring positional information of the user terminal 1 .
- the positional information acquisition unit 120 may be a Global Positioning System (GPS) antenna and a GPS process unit configured to process GPS signals received via the GPS antenna.
- the positional information acquisition unit 120 may be a Wi-Fi antenna configured to receive Wi-Fi (registered trademark) radio waves from a plurality of base stations, and a position calculation unit configured to estimate distances from the respective base stations from reception intensities of received Wi-Fi radio waves, and calculate a current position on the basis of a principle of triangulation using the distances from the respective base stations and positions of the respective base stations.
- Wi-Fi registered trademark
- the behavior recognition unit 130 recognizes user behavior on the basis of sensor data detected by various kinds of sensor installed in the user terminal 1 or the wearable terminal 10 .
- the behavior recognition unit 130 recognizes behavior of the user on the basis of the positional information acquired by the positional information acquisition unit 120 , acceleration data detected by the acceleration sensor (not illustrated), heartbeat information acquired by the heartbeat information processing unit 140 , and the like.
- Examples of the behavior of the user include attitudes such as sitting/standing, movement such as walking/running, and contexts (states of the user) such as awakening/sleeping/working in office/studying in school/traveling by train.
- the heartbeat information processing unit 140 acquires heartbeat information of the user, trims data through a noise processing as necessary, and outputs heartbeat information to the control unit 100 .
- the heartbeat information processing unit 140 acquires heartbeat information on the basis of sensor data detected by the heartbeat sensor installed in the wearable terminal 10 .
- the operation input unit 150 is implemented as a touchscreen, a switch, a button, or the like.
- the operation input unit 150 detects operation input by the user, and outputs the detected input signal to the control unit 100 .
- the operation input unit 150 outputs a text message input by the user to the control unit 100 .
- the storage unit 160 is implemented as read only memory (ROM) or random access memory (RAM).
- ROM read only memory
- RAM random access memory
- the ROM stores programs, operation parameters, and the like that are used in processes performed by the control unit 100
- the RAM temporarily stores a parameters and the like that arbitrarily change.
- the display unit 170 is an example of the output unit.
- the display unit 170 is implemented as a display device such as a liquid crystal display (LCD) device, or an organic light emitting diode (OLED) display device.
- LCD liquid crystal display
- OLED organic light emitting diode
- the speaker 180 is an example of the output unit.
- the speaker 180 has a function of reproducing sound signals.
- the microphone 190 collects surrounding sound and outputs the collected sound data to the control unit 100 .
- the microphone 190 collects speech voice of the user and output it to the control unit 100 as a voice message.
- the control unit 100 may transmit the collected sound data to the server 2 as the voice message, or may generate a text message through a speech recognition process and transmit it to the server 2 .
- the configuration of the user terminal 1 according to the embodiment is not limited to the example illustrated in FIG. 3 .
- the user terminal 1 may further include a camera, a distance sensor, an environment sensor, or the like.
- FIG. 4 is a block diagram illustrating an example of the configuration of the server 2 according to the embodiment.
- the server 2 includes a control unit 200 , a communication unit 210 , a position history storage unit 220 , a behavior recognition history storage unit 230 , a heartbeat history storage unit 240 , a message storage unit 250 , and a questionnaire result storage unit 260 .
- the communication unit 210 exchanges data with an external device in a wired/wireless manner. For example, the communication unit 210 receives a message transmission scheduling request from the user terminal 1 serving as the communication source. In addition, the communication unit 210 transmits a message to the user terminal 1 serving as the communication destination under the control of a transmission control unit 204 (to be described later).
- the control unit 200 functions as an arithmetic processing device and a control device, and controls the overall operation in the server 2 in accordance with various programs.
- the control unit 200 is implemented as an electronic circuit such as a CPU or a microprocessor.
- the control unit 200 according to the embodiment also functions as a history accumulation control unit 201 , a language analysis unit 202 , a transmission timing determination unit 203 , a transmission control unit 204 , and a message editing unit 205 .
- the history accumulation control unit 301 controls the position history storage unit 220 , the behavior recognition history storage unit 230 , and the heartbeat history storage unit 240 to respectively accumulate positional information, behavior recognition results, and heartbeat data of users received from the respective user terminals 1 , as a position history, a behavior recognition history, and a heartbeat history of the respective user in addition to its date and time.
- the language analysis unit 202 analyzes content (meaning and overview) of a message in the message transmission scheduling request transmitted from the user terminal 1 .
- the transmission timing determination unit 203 determines a predetermined timing at which the user terminal 1 serving as the transmission destination is notified of existence of the scheduled message, in accordance with a result of message analysis performed by the language analysis unit 202 and current and past psychological situations of the user corresponding to the transmission destination of the message whose transmission scheduling request has been issued.
- the transmission timing determination unit 203 determines an appropriate time slot for a psychological situation in accordance with a type of the message (such as “apology”, “encouragement”, or “invitation”) based on the message analysis result. It is determined when the user enters various psychological situations, on the basis of a past heartbeat history corresponding to the behavior recognition history and the position history of the transmission destination user, the schedule information of the transmission destination user, and weather forecast information. In this embodiment, for example, the heartbeat history is used for estimating psychological situations of the user.
- a type of the message such as “apology”, “encouragement”, or “invitation”
- the transmission timing determination unit 203 recognizes types of heartbeats (in other words, psychological situations) depending on types of behaviors of the transmission destination user, on the basis of a past heartbeat history corresponding to the behavior recognition history, and predicts change in the psychological situations of the user in accordance with schedule information of the transmission destination user. Subsequently, the transmission timing determination unit 203 determines a time slot in which the user enters a psychological situation appropriate to the message.
- types of heartbeats in other words, psychological situations
- the transmission timing determination unit 203 is capable of acquiring weather information (weather, humidity, temperature, a discomfort index, or the like) in a place where the transmission destination user is present on the basis of weather information corresponding to positional information, and recognizing types of heartbeats (in other words, psychological situations) depending on various weather situation in view of a heartbeat history at that time.
- the transmission timing determination unit 203 predicts change in the psychological situation of the user by using schedule information (used for estimating places the user will visit) of the transmission destination user and weather forecast information (weather forecast information of the places the user will visit). Subsequently, the transmission timing determination unit 203 determines a time slot in which the user enters a psychological situation appropriate to the message.
- the transmission timing determination unit 203 may recognize tendencies indicating when and how the heartbeats (in other words, psychological situation) change by using the heartbeat history, and determine a time slot of a psychological situation appropriate to the message on the basis of the state of the heartbeats.
- the transmission timing determination unit 203 acquires a date and time at which a message in which the same expression is used as the message whose scheduling request has been issued by the transmission destination user from the message storage unit 250 , and acquires a heartbeat history of the transmission destination user at the date and time from the heartbeat history storage unit 240 .
- the transmission timing determination unit 203 recognizes what kind of heartbeats (in other words, psychological situations) means that the user of the transmission destination is in a better psychological situation when receiving the message with such an expression. Next, on the basis of the heartbeat history, the transmission timing determination unit 203 determines a time slot of a psychological situation appropriate for transmitting the message whose scheduling request has been issued this time.
- the transmission timing determination unit 203 when determining the time slot of the psychological situation appropriate to the expression (wording) used in the message, it is also possible for the transmission timing determination unit 203 to use the heartbeat history and a result of a questionnaire related to a psychological situation of the transmission destination user at a time of receiving a message with the same expression.
- the result of the questionnaire is acquired from the questionnaire result storage unit 260 .
- the transmission control unit 204 performs control such that the message is transmitted in the appropriate time slot determined by the transmission timing determination unit 203 .
- the transmission control unit 204 may acquire a real-time psychological situation or a real-time behavior recognition result of the transmission destination user in the appropriate time slot, and may perform control such that the message is transmitted at a timing at which the user enters an optimal psychological situation or the user exhibits optimal behavior (also referred to as an “appropriate timing”).
- the transmission of a message means transmission of a body of the message, transmission of only a title or a sender of the message, or transmission of a notification indicating existence of the message (such as a message “new e-mail is arrived in the server”).
- the “predetermined timing” includes the “appropriate time slot” and the “appropriate timing” described above.
- the message editing unit 205 has a function of automatically editing a message to be transmitted from the transmission control unit 204 to the transmission destination user. Specifically, the message editing unit 205 inserts a text into the message, the text describing an event occurred after receiving the scheduling request. Accordingly, it is possible to prevent the transmission destination user from knowing that the message is accumulated in the server 2 in a certain period of time, and this achieves more natural communication. In addition, when editing the message to include words of season's greetings at the top of the message as the text describing the event, such season's greeting words can lead a main topic of the message.
- the message editing unit 205 may change content of a message whose scheduling request has been issued, on the basis of content of a past received message to the transmission destination user and a psychological situation of the transmission destination user at the time of receiving the received message. In this way, for example, it is possible to change or add the expression that makes the psychological situation of the transmission destination user better.
- the message editing unit 205 may reproduce the message whose scheduling request has been issued, by voice of a predetermined pop star such as a pop star the transmission destination user likes. In this way, for example, it is possible to make the psychological situation of the transmission destination user who has received the message better.
- the position history storage unit 220 stores positional information of the respective user terminals 1 as position histories of the respective users in association with date and time, under the control of the history accumulation control unit 201 .
- the respective users may be identified by using user IDs, for example.
- the behavior recognition history storage unit 230 stores behavior recognition results of the respective user terminals 1 as behavior recognition histories of the respective users in association with date and time, under the control of the history accumulation control unit 201 .
- the heartbeat history storage unit 240 stores heartbeat information of the respective user terminals 1 as heartbeat histories of the respective users in association with date and time, under the control of the history accumulation control unit 201 .
- the message storage unit 250 stores messages transmitted and received to and from the respective user terminals 1 as transmission/reception histories of the respective users in association with date and time. In addition, the message storage unit 250 also stores transmission scheduling request messages received from the user terminals 1 .
- the questionnaire result storage unit 260 stores questionnaire results transmitted from the respective user terminals 1 in association with date and time.
- FIG. 5 illustrates an example of various kinds of data stored in the storage units according to the embodiment.
- the illustrated data is various kinds of data associated with histories of past messages transmitted by a user (user ID: aaa) of a transmission source who has issued the message transmission scheduling request.
- message transmission date and time, transmission source IDs, transmission destination IDs, content of messages may be displayed in an identifiable manner
- types of messages weather at a time of reception, a schedule of the transmission destination user at the time of reception (or behavior recognition results), heartbeats of the transmission destination user before and after the reception, questionnaire results of the transmission destination users.
- the transmission destination user inputs evaluation of the message in view of a sense of security, honesty, and a sense of affinity on a five-point scale.
- the configuration of the server 2 according to the embodiment is not limited to the example illustrated in FIG. 4 .
- another server on the network may include the respective storage units.
- the heartbeat history is used for estimating psychological situations of the user.
- the embodiment is not limited thereto. It is also possible to use other biological information (such as sweat amount history, pulse history, or brain wave history). Next, details of operation processes according to the embodiment will be described.
- FIG. 6 is a flowchart illustrating a message communication control process according to the embodiment.
- the server 2 first receives input of a message performed by a user (Step S 103 ). Specifically, the server 2 acquires the message input by the user via the user terminal 1 a serving as the transmission source.
- FIG. 7 illustrates an example of a message input screen displayed on the user terminal 1 a .
- a screen 400 illustrated on the upper side of FIG. 7 includes an address selection button 401 , an address list 402 , a message input field 403 , a send button 405 , and a scheduling button 404 .
- the user taps the address selection button 401 to select one or more addresses from a plurality of addresses.
- the one or more selected addresses are displayed in the address list 402 .
- the user inputs a message into the message input field 403 by using a virtual keyboard (not illustrated) displayed on the screen. Subsequently, in the case of transmitting the message immediately as usual, the user taps a send button 405 “SEND NOW”. Alternatively, in the case of issuing a scheduling request according to the embodiment, the user taps the scheduling button 404 . In the case where the send button 405 “SEND NOW”, the transmission control unit 204 immediately transmits the message to the transmission destination (Step S 142 ).
- Step S 109 the server 2 asks the user about a due date for transmitting the message (transmission period) and necessity of modification (automatic editing) (Step S 109 ).
- the scheduling button 404 is tapped, the display screen of the user terminal 1 a transitions to a screen 410 illustrated in the bottom side of the FIG. 7 .
- the screen 410 includes a transmission period start date and time designation field 411 , a transmission period expiration date and time designation field 412 , modification selection boxes 413 , and a scheduling button 415 .
- the “transmission period” means a period from an earliest message transmission start date and time input into the start date and time designation field 411 to the expiration date and time input into the expiration date and time designation field 412 .
- the language analysis unit 202 of the server 2 performs language analysis on the message whose scheduling request has been issued by the user (Step S 112 ). Specifically, the language analysis unit 202 recognizes an overview of the message, that is, the type of the message on the basis of semantic analysis, keywords, and the like in addition to semantic analysis of the message and keyword extraction.
- the transmission timing determination unit 203 determines an appropriate time slot for transmitting the apology or encouragement message (Step S 118 ). For example, the time slot is determined within the transmission period designated by the transmission source user in Step S 109 . Details of the determination process will be described later with reference to FIG. 8 .
- the transmission timing determination unit 203 determines an appropriate time slot for transmitting the invitation message (Step S 124 ).
- the time slot is determined within the transmission period designated by the transmission source user in Step S 109 . Details of the determination process will be described later with reference to FIG. 11 .
- the predetermined determination processes performed in the case where the type of the message is the “apology”, the “encouragement”, or the “invitation” has been described as an example.
- the types of the messages are not limited thereto. For example, it is also possible to determine an appropriate time slot for a psychological situation depending on the respective message types in the case where the message type is a “request”, a “demand”, a “reminder”, a “sales”, or the like.
- the transmission control unit 204 determines an appropriate timing for transmitting the message to the transmission destination, as a final determination (Step S 127 ). Specifically, the transmission control unit 204 recognizes a current psychological situation on the basis of real-time heartbeat information of the transmission destination user, and determines the best transmission timing.
- Step S 127 the control unit 200 of the server 2 checks whether to modify the scheduled message (Step S 130 ).
- the modification of the message means automatic modification of the message designated by the transmission source user in Step S 109 .
- the message editing unit 205 modifies the message (Step S 133 ).
- the transmission control unit 204 transmits the message whose scheduling request has been issued, to the user terminal 1 b serving as the designated transmission destination (Step S 142 ).
- the transmitted message is stored in the message storage unit 250 as a transmission/reception history.
- the transmission timing determination unit 203 determines an earliest period satisfying a condition as the appropriate time slot, on the basis of the transmission period input by the transmission source user (Step S 136 ). For example, in the case where the “from 14:00 on Xth to 14:00 on the next day” is set as the transmission period, the transmission timing determination unit 203 determines the earliest time slot “from 14:00 to 15:00 on Xth” in that period as the appropriate time slot.
- Step S 139 the transmission control unit 204 transmits the message whose scheduling request has been issued, to the user terminal 1 b serving as the designated transmission destination (Step S 142 ).
- the appropriate timing may be determined depending on a psychological situation estimated from real-time heartbeat information of the transmission destination user.
- FIG. 8 is a flowchart illustrating an appropriate time slot determination process of an apology or encouragement message according to the embodiment.
- the transmission timing determination unit 203 first extracts a message of the same type as the message whose scheduling request has been issued (here, “apology” or “encouragement” message), from a received message history of the transmission destination user stored in the message storage unit 250 (Step S 203 ). In this case, it is also possible for the transmission timing determination unit 203 to extract the message from a message history received from the transmission source user.
- the transmission timing determination unit 203 ranks transmission timings associated with “weather” on the basis of psychological situations of the transmission destination user before and after receiving the extracted message, and weather information around the transmission destination user at the time of receiving the message (Step S 206 ).
- the psychological situations of the transmission destination user are estimated from stability based on the heartbeat information or a questionnaire result.
- the weather information around the user of the transmission destination is acquired from a position history of the transmission destination user and a weather information history.
- the transmission timing determination unit 203 ranks transmission timings associated with “behavior” on the basis of psychological situations of the transmission destination user before and after receiving the extracted message, and a behavior recognition result of the transmission destination user at the time of receiving the message (Step S 209 ).
- the transmission timing determination unit 203 ranks transmission timings associated with “expression” on the basis of psychological situations of the transmission destination user before and after receiving the extracted message, and expression used in the message (Step S 212 ).
- the transmission timing determination unit 203 determines an appropriate time slot in the transmission period designated by the transmission source user (Step S 215 ).
- the appropriate time slot has a combination of the “weather”, “behavior”, and “expression” with higher ranks.
- FIG. 9 is a flowchart illustrating an appropriate time slot determination process of an invitation message according to the embodiment.
- the transmission timing determination unit 203 first extracts a message of the same type as the message whose scheduling request has been issued (here, “invitation” message), from a received message history of the transmission destination user, and further extracts a reply message from the transmission destination user to the extracted invitation message (Step S 303 ). In this case, it is also possible for the transmission timing determination unit 203 to extract the message from a message history received from the transmission source user.
- the transmission timing determination unit 203 calculates an invitation success rate associated with “weather” on the basis of weather information around the transmission destination user at the time of receiving the extracted invitation message, and content of the reply message (Step S 306 ).
- the weather information around the transmission destination user is acquired from a position history of the transmission destination user and a weather information history.
- the transmission timing determination unit 203 calculates an invitation success rate associated with “behavior” on the basis of a behavior recognition result of the transmission destination user at the time of receiving the extracted invitation message, and the content of the reply message (Step S 309 ).
- the transmission timing determination unit 203 calculates an invitation success rate associated with “expression” on the basis of expression used in the extracted invitation message, and the content of the reply message (Step S 312 ).
- the transmission timing determination unit 203 determines an appropriate time slot in the transmission period designated by the transmission source user (Step S 315 ).
- the appropriate time slot has a combination of the “weather”, “behavior”, and “expression” with higher invitation success rates.
- the user A creates an apology message to the user B by using the user terminal 1 a .
- the screen 400 illustrated in the upper side of FIG. 7 is displayed on the user terminal 1 a .
- the scheduling button 404 is tapped, the screen 410 illustrated in the bottom side of the FIG. 7 is displayed.
- the user A inputs a transmission period of the input message into the start date and time designation field 411 and the expiration date and time designation field 412 , and select modifications to be set by using the modification selection boxes 413 .
- the scheduling button 415 is tapped, a transmission scheduling request of the input message is transmitted from the user terminal 1 a to the server 2 .
- the transmission scheduling request transmitted to the server 2 is analyzed by the language analysis unit 202 , and an overview of the message is interpreted.
- the language analysis unit 202 determines that the message is an apology message in the case where a keyword such as “sorry”, “apologize”, or “apology” is extracted from the message whose scheduling request has been issued.
- the language analysis unit 202 determines that the message is an encouragement message. In the case of the message “I ate your ice cream in the fridge. Sorry.” input in the screen 400 in FIG. 7 , the message is determined as an apology message.
- the transmission timing determination unit 203 checks the transmission period designated by the user A, acquires a schedule of the user B of the transmission destination in the transmission period from the schedule server 4 a, and, on the basis of a time and a place described in the acquired schedule, acquires weather forecast information of that place at that time from the weather information server 4 b.
- the transmission timing determination unit 203 acquires a position history of the user B, past weather information, and relations between heartbeats (in other words, psychological situations) of the user B and weather situations based on a heartbeat history of the user B, or relations between behavior and heartbeats of the user B based on the heartbeat history and a behavior recognition history of the user B, and estimates a heartbeat value of the user B on the basis of the schedule of the user B, behavior prediction, or weather forecast.
- FIG. 10 illustrates an example of a heartbeat estimation result corresponding to the schedule of the user B, behavior prediction, and the weather forecast.
- heartbeat values of the user B are estimated on the basis of the schedule of the user B, behavior prediction, and weather forecast during the transmission period (see FIG. 7 ) from 14:00 to 14:00 on the next day designated by the user A of the transmission source.
- the transmission timing determination unit 203 refers to the estimation result and determines a time slot in which the user B has a more stable psychological situation as an appropriate time slot for transmitting the apology message.
- the stable psychological situation means a state in which heartbeats do not up or down significantly and the heartbeats remain in a relatively slow state.
- the transmission timing determination unit 203 determines that this is a stable time slot.
- the transmission timing determination unit 203 it is also possible for the transmission timing determination unit 203 to exclude a sleeping time slot from appropriate time slots in view of heartbeats and a sleeping time slot pattern derived from the behavior history.
- the transmission timing determination unit 203 it is also possible for the transmission timing determination unit 203 to avoid time expected to be time in which the user B is with the user of the transmission source, on the basis of behavior prediction and content of the schedule of the user B.
- the transmission timing determination unit 203 determines that the appropriate time slot for transmitting the apology message is from 15:00 to 16:00 before extracurricular activity, in the case of the example illustrated in FIG. 10 .
- the heartbeats are used for determining the stability of psychological situations.
- the embodiment is not limited thereto.
- barometric pressure, a discomfort index, or the like may be used.
- the transmission timing determination unit 203 it is also possible for the transmission timing determination unit 203 to determine a time slot in which a stable psychological situation tends to be obtained as the appropriate time slot for transmitting an apology message, on the basis of a past heartbeat history of the user B. For example, the transmission timing determination unit 203 calculates an average value of heartbeat values acquired for a predetermined period of time, and dispersion of the values, and determines a period of time having a low average value and small dispersion as the stable state.
- the transmission control unit 204 of the server 2 acquires real-time heartbeat information and real-time behavior recognition result of the user B.
- the server 2 remotely causes the user terminal 1 b and the wearable terminal 10 of the user B to activate the various kinds of sensors for acquiring the heartbeat information and the behavior information.
- the transmission control unit 204 determines that now is the appropriate timing, and transmits the apology message whose scheduling request has been issued by the user A to the user terminal 1 b of the user B. Note that, in the case where real-time positional information of the user A of the transmission source is also acquired in addition to real-time positional information of the user B of the transmission destination at this time, the transmission control unit 204 does not transmit the message if the user B of the transmission destination is with the person who has transmitted the message (user A).
- the transmission control unit 204 perform control such that the message is forcibly transmitted due to expiration of the time limit. In this case, it is possible to transmit the message within the determined appropriate time slot though not the appropriate timing.
- the transmission control unit 204 transmits the apology message that has been automatically edited by the message editing unit 205 , to the user B.
- the message editing unit 205 adds a sentence talking about weather as an opening sentence of the message on the basis of weather and season information at the time of transmission, such as “We got lucky with great weather! By, the way, I ate your ice cream in the fridge. Again!”.
- the message editing unit 205 changes the wording “Sorry.” into the wording “Sorry!” on the basis of the past heartbeat history of the user B receiving apology messages, in the case where the user B has more stable heartbeats when receiving a message with the wording “Sorry!” rather than receiving a message with the wording “Sorry”.
- the message transmitted to the user B is stored in the message storage unit 250 of the server 2 . It addition, it is possible to use a questionnaire to provide feedback about whether the transmission destination user understands an intention of the message transmitted to the user B.
- the server 2 transmits a questionnaire to the user B serving as the transmission destination user a few days after the transmission of the message. More specifically, the server 2 displays a questionnaire screen 420 as illustrated in FIG. 11 on the user terminal 1 b and prompts the user B to answer the questionnaire. In the illustrated example, the questionnaire screen 420 displays questions for asking how the user B feels about the message such as “did you feel a sense of security?”, “did you feel honesty?”, and “did you feel a sense of affinity?”.
- the server 2 stores a result of the answers to the questionnaire in the questionnaire result storage unit 260 in association with the user ID and the message reception date and time.
- Information of the questionnaire result and the change in heartbeats before and after the reception of a message may be used for automatically editing a transmission timing and a message to be transmitted to the user next time.
- the user A inputs an encouragement message such as “Your recital will be on 24th! You can do it!” into the user terminal 1 a , and taps the scheduling button 404 .
- the user inputs a transmission period, configures setting about modification of the message, and taps the scheduling button 415 .
- the server 2 interprets an overview of the message by using the language analysis unit 202 .
- the keyword “You can do it” is extracted. Therefore, the message is determined as an encouragement message.
- the transmission timing determination unit 203 estimates heartbeat values (psychological states) of the user C on the basis of a schedule of the transmission destination user C, behavior prediction, or weather forecast during the designated transmission period.
- FIG. 12 illustrates an example of a heartbeat estimation result corresponding to the schedule of the user C, the behavior prediction, and the weather forecast.
- heartbeat values of the user C are estimated on the basis of the schedule of the user C, the behavior prediction, and the weather forecast during the transmission period from 18th to 23rd designated by the user A of the transmission source.
- the transmission timing determination unit 203 refers to the estimation result and determines a time slot in which the encouragement message is more effective to the user C in a psychological state, as an appropriate time slot for transmitting the encouragement message. It may be determined that the which psychological state makes the encouragement message more effective, on the basis of a questionnaire result or change in heartbeats of the user C before and after receiving past encouragement messages to the user C. This is because some people get stable and satisfied in the case of receiving an encouragement message when they are in a stable psychological situation, but some people get stable and satisfied in the case of receiving an encouragement message when they are in an unstable psychological situation. In addition, in a way similar to the above-described example, it is possible to exclude a sleeping time slot from the appropriate time slot, and it is possible to avoid a time slot in which the receiver is with the sender.
- the server 2 determines an appropriate time slot for transmitting a message on the basis of weather information, change in heartbeats at the time of reception corresponding to a past encouragement message reception history of the user C, or the like. Specifically, for example, from the past experience, the server 2 recognizes that the encouragement to the user C on the day before the event makes the user U nervous rather than reassuring (stable heartbeats changes into unstable heartbeats), an questionnaire result indicating that the user C gains a feeling of security when the user C gets encouragement while the user C has unstable heartbeats, and that heartbeats of the user C get stable in the case of receiving an encouragement message during raining.
- the server 2 refers to a correspondence table of schedule, weather information, behavior, and estimated heartbeats as shown in FIG. 12 , and determines that the optimal time slot for transmitting the message is a day other than 23rd that is the day before the recital, a rainy day, and a time slot in which the user C has fast heartbeats and is in an unstable state. That is, the server 2 determines that the optimal time slot is 22th that is two days before the recital.
- the server 2 collects real-time heartbeats and a real-time behavior recognition result of the user C.
- the server 2 determines that now is the appropriate timing, and transmits the encouragement message whose scheduling request has been issued by the user A to a user terminal of the user C.
- the transmission control unit 204 transmits the encouragement message that has been automatically edited by the message editing unit 205 , to the user C.
- the message editing unit 205 converts the message such that the wording “24th” is interpreted into wording “the day after tomorrow” because the message will be transmitted on 22nd.
- the message editing unit 205 converts the message into a message with wording “I believe in you” on the basis of a questionnaire result indicating that the user C has felt a stronger sense of affinity when receiving a message using wording “I believe in you” rather than receiving an encouragement message using wording “you can do it” in the past.
- the details of the information processing system configured to transmit a message at an optimal timing have been described above. Accordingly, for example, it is possible to transmit an invitation e-mail, an apology e-mail, and the like to a lover at a most effective timing. Therefore, it is possible to establish a good relationship with the lover.
- an information processing system it is possible to receive a transmission schedule of a message to a specific receiver and perform control such that the receiver is notified of the message at an optimal timing in view of content of the message and a psychological situation of the receiver.
- a computer program for causing a hardware such as CPU, ROM, and RAM, which are embedded in the above described user terminals 1 or the server 2 , to execute the functions of the user terminals 1 or the server 2 .
- a computer-readable recording medium having the computer program stored therein.
- an optimal time slot for transmitting a message is determined by using the behavior recognition history, the heartbeat history, and the schedule of the user, weather forecast information, or the like.
- the weather information is used as an example of environmental information.
- the embodiment is not limited thereto. It is also possible to use barometric information acquired by a barometric sensor installed in each of the user terminals 1 .
- the heartbeat information is used as an example of biological information used for estimating psychological situations. However, the embodiment is not limited thereto. It is also possible to detect and use a body temperature, pulse, breathing, sweating, brain waves, or the like.
- present technology may also be configured as below.
- a communication system including:
- a communication control method including, by a processor:
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Psychiatry (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Cardiology (AREA)
- Data Mining & Analysis (AREA)
- Social Psychology (AREA)
- Psychology (AREA)
- Hospice & Palliative Care (AREA)
- Educational Technology (AREA)
- Developmental Disabilities (AREA)
- Child & Adolescent Psychology (AREA)
- Physiology (AREA)
- Computational Linguistics (AREA)
- Telephonic Communication Services (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Aspects of the present application provide a communication system that includes a communication unit and a control unit. The communication unit is configured to receive, from a communication source, a scheduling request for scheduling transmission of a message to a specific communication destination. The control unit is configured to perform control such that the communication destination is notified of existence of the message at a predetermined timing in accordance with content of the message and a current or past psychological situation of a user corresponding to the specific communication destination received by the communication unit.
Description
- This present application is a continuation application of U.S. patent application Ser. No. 16/848,351 filed on Apr. 14, 2020, which is continuation application of U.S. patent application Ser. No. 15/759,414 filed on Mar. 12, 2018, which is a National Stage application of PCT/JP2016/073177 filed on Aug. 5, 2016, which claims the benefit of priority to Japan Patent Application No. 2015-222865 filed on Nov. 13, 2015. The entire disclosures of the prior applications are hereby incorporated by reference in their entirety.
- The present disclosure relates to communication systems and communication control methods.
- In recent years, communication technologies have been developed, and messages have been frequently exchanged via networks. It is possible for users to check messages transmitted from other terminals or to transmit messages by using information processing terminals such as smartphones, mobile phone terminals, and tablet terminals.
- With regard to such a message transmission and reception system, for example, Patent Literature 1 listed below describes a device configured to variably control content of a message to a user and its transmission timing in accordance with context (internal and external states) of the user. In addition,
Patent Literature 2 listed below describes a system in which devices transmit and receive appropriate information to and from each other in accordance with feelings and/or behavior of users. In addition,Patent Literature 3 listed below describes a delivery service system configured to transmit voice information on a date designated through delivery scheduling. - Patent Literature 1: JP 2015-5207A
- Patent Literature 2: JP 2007-207153A
- Patent Literature 3: JP 2002-101211A
- Here, sometimes a receiver of a transmitted message has different feelings depending on timings of reading the received message. In general, in the case where a message is transmitted via e-mail, online chat, or the like, the message is delivered to a receiver in almost real time. Therefore, for example, the user wants to guess a current feeling of the receiver and transmit an apology or invitation message at an optimal timing. However, there is no way to know the current feeling of the receiver, and it is difficult to transmit such a message at the optimal timing. In addition, the optimal timing differs depending on content of the message.
- Note that, Patent Literature 1 described above is a technology of transmitting a message to himself/herself to control his/her motivation to achieve his/her goal. Therefore, it is difficult to solve the above described problem by using Patent Literature 1. In addition,
Patent Literature 2 described above is a technology of recommending contents such as music in accordance with a feeling and/or behavior at that time, to meet his/her preference that changes in real time. Therefore, it is difficult to solve the above described problem by usingPatent Literature 2. In addition,Patent Literature 3 described above is a technology for a user to designate a date and time to transmit voice information to another user. Therefore, it is difficult to solve the above described problem by usingPatent Literature 3. - Accordingly, the present disclosure proposes a communication system and a communication control method that are capable of receiving a transmission schedule and performing control such that a receiver is notified of a message at an optimal timing in view of content of the message and a psychological situation of the receiver.
- According to the present disclosure, there is provided a communication system including: a communication unit configured to receive, from a communication source, a scheduling request for scheduling transmission of a message to a specific communication destination; and a control unit configured to perform control such that the communication destination is notified of existence of the message at a predetermined timing in accordance with content of the message and a current or past psychological situation of a user corresponding to the specific communication destination received by the communication unit.
- According to the present disclosure, there is provided a communication control method including, by a processor: receiving, from a communication source, a scheduling request for scheduling transmission of a message to a specific communication destination; and performing control such that the communication destination is notified of existence of the message at a predetermined timing in accordance with content of the message and a current or past psychological situation of a user corresponding to the received specific communication destination.
- As described above, according to the present disclosure, it is possible to receive a transmission schedule and perform control such that a receiver is notified of a message at an optimal timing in view of content of the message and a psychological situation of the receiver.
- Note that the effects described above are not necessarily limitative. With or in the place of the above effects, there may be achieved any one of the effects described in this specification or other effects that may be grasped from this specification.
-
FIG. 1 is a diagram illustrating an application example of an information processing system according to an embodiment of the present disclosure. -
FIG. 2 is a diagram illustrating an overall configuration of the information processing system according to the embodiment. -
FIG. 3 is a block diagram illustrating an example of a configuration of a user terminal according to the embodiment. -
FIG. 4 is a block diagram illustrating an example of a configuration of a server according to the embodiment. -
FIG. 5 is a diagram illustrating an example of various kinds of data stored in storage units according to the embodiment. -
FIG. 6 is a flowchart illustrating a message communication control process according to the embodiment. -
FIG. 7 is a diagram illustrating an example of a message input screen according to the embodiment. -
FIG. 8 is a flowchart illustrating an appropriate time slot determination process of an apology or encouragement message according to the embodiment. -
FIG. 9 is a flowchart illustrating an appropriate time slot determination process of an invitation message according to the embodiment. -
FIG. 10 is a diagram illustrating an example of a heartbeat estimation result of a user B according to a first example. -
FIG. 11 is a diagram illustrating an example of a questionnaire input screen according to the embodiment. -
FIG. 12 is a diagram illustrating an example of a heartbeat estimation result of a user C according to a second example. - Hereinafter, (a) preferred embodiment(s) of the present disclosure will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
- Note that the description is given in the following order.
- 1. Overview of information processing system according to embodiment of present disclosure
- 2. Configuration
- 2-1. Configuration of user terminal
- 2-2. Configuration of server
- 3. Operation process
- 3-1 Message communication control process
- 3-2. Appropriate time slot determination process of apology or encouragement message
- 3-3. Appropriate time slot determination process of invitation message
- 4. Examples
- 4-1. Example of apology message
- 4-2. Example of encouragement message
- 5. Conclusion
- By using an information processing system according to an embodiment of the present disclosure, it is possible to receive a transmission schedule and perform control such that a receiver is notified of a message at an optimal timing in view of content of the message and a psychological situation of the receiver. Next, with reference to
FIG. 1 , an application example of the information processing system according to the embodiment will be described. -
FIG. 1 is a diagram illustrating the application example of the information processing system according to the embodiment of the present disclosure. For example, when a user A (communication source) transmits an apology message to a user B (communication destination), the user A wants to transmit the message at a timing at which the user B is in a good mood, or at least a timing other than a timing at which the user B is in a bad mood. However, it is difficult to know feelings of the user B. Therefore, the information processing system according to the embodiment receives a transmission scheduling request of a message to the user B from the user A, and controls a transmission timing of the message in accordance with psychological situations of the user B. - For example, as illustrated in
FIG. 1 , control is performed such that an apology e-mail whose transmission scheduling request has been issued by the user A is not transmitted and enters a standby state while the user B is in a bad mood, and the apology e-mail is transmitted when the user B gets in a good mood. This can establish better communication. In addition, it is also possible to improve impression that the user B has by automatically editing the message to include content regarding a recent fact. - Note that, the message is transmitted and received via user terminals 1 such as smatphones, mobile phone terminals, tablet terminals, wearable terminals (such as smart bands, smartglasses, or smartwatches), or personal computers (PCs).
- In addition, for example, a real-time psychological situation of the user B is estimated on the basis of sensor data (such as acceleration data, positional data, cardinal direction data, vibration data, sound data, captured image data, pulse data, heartbeat data, body temperature data, sweat amount data, brain wave data, or the like) detected by various kinds of sensors installed in a
wearable terminal 10 worn by the user B or various kinds of sensors installed in auser terminal 1 b. The sensor data detected by thewearable terminal 10 is transmitted to theuser terminal 1 b via Wi-Fi (registered trademark) or near-field communication such as Bluetooth (registered trademark). - In addition, in this embodiment, a heartbeat log or behavior recognition results (heartbeat history and behavior recognition history) are continuously acquired on the basis of the sensor data, and are used for determining an appropriate time slot of a notification timing at which a
server 2 notifies of a message. Note that, it is also possible to configure the setting such that the heartbeat log and the behavior recognition results are not always acquired. In other words, when determining a message notification timing, the various kinds of sensors installed in thewearable terminal 10 or theuser terminal 1 b are intermittently activated. This achieves electric power saving. In addition, it is also possible for another system to acquire the heartbeat log and the behavior recognition results of the user B, and refer to them as necessary in conjunction with the information processing system according to the embodiment. - In addition, a schedule of a transmission destination user or weather information may also be used when the
server 2 determines an appropriate time slot of the message notification timing. Theserver 2 appropriately acquires data from an external schedule server 4 a or an externalweather information server 4 b via anetwork 3. - Next, with reference to
FIG. 2 , an overall configuration of the information processing system according to the embodiment will be described.FIG. 2 is a diagram illustrating the overall configuration of the information processing system according to the embodiment. - As illustrated in
FIG. 2 , the information processing system according to the embodiment includes auser terminal 1 a serving as the communication source, auser terminal 1 b serving as the communication destination, thewearable terminal 10, and theserver 2. Thewearable terminal 10 is configured to acquire sensor data to be used for estimating psychological situations of a communication destination user. Note that, here, for example, the 1 a and 1 b are distinguished from each other as a communication source terminal and a communication destination terminal. However, the embodiment is not limited thereto. Theuser terminals 1 a and 1 b are implemented as user terminals 1 having the same configuration, and it is possible to use theuser terminals 1 a and 1 b as any of the communication source and the communication destination.user terminals - The
server 2 connects with the 1 a and 1 b via theuser terminals network 3 and transmits/receives data. Specifically, theserver 2 receives a scheduling request from theuser terminal 1 a, the scheduling request scheduling transmission of a message to a specific communication destination (here, theuser terminal 1 b). - Subsequently, the
server 2 performs control such that theuser terminal 1 b is notified of existence of the message at a predetermined timing in accordance with content of the message and psychological situations of the user corresponding to the specific communication destination. For example, the psychological situations of the user are acquired by thewearable terminals 10 worn by the user of the communication destination, and estimated by theserver 2 on the basis of sensor data transmitted from theuser terminal 1 b to theserver 2 via thenetwork 3. - The overview of the information processing system according to the embodiment has been described above. Next, with reference to
FIG. 3 toFIG. 4 , detailed configurations of the user terminals 1 and theserver 2 included in the information processing system according to the embodiment will be described. -
FIG. 3 is a block diagram illustrating a configuration example of the user terminal 1 according to the embodiment. As illustrated inFIG. 3 , the user terminal 1 includes acontrol unit 100, acommunication unit 110, a positionalinformation acquisition unit 120, abehavior recognition unit 130, a heartbeatinformation processing unit 140, anoperation input unit 150, astorage unit 160, adisplay unit 170, aspeaker 180, and amicrophone 190. - The
control unit 100 functions as an arithmetic processing device and a control device, and controls the overall operation in the user terminal 1 in accordance with various programs. For example, thecontrol unit 100 is implemented as a central processing unit (CPU), or an electronic circuit such as a microprocessor or the like. - The
communication unit 110 exchanges data with an external device in a wired/wireless manner. For example, thecommunication unit 110 connects with theserver 2 via thenetwork 3, and transmits a text message input via theoperation input unit 150. In addition, thecommunication unit 110 further includes a function of exchanging data with thewearable terminal 10 via Wi-Fi or near-field communication such as Bluetooth. - The positional
information acquisition unit 120 has a function of acquiring positional information of the user terminal 1. For example, the positionalinformation acquisition unit 120 may be a Global Positioning System (GPS) antenna and a GPS process unit configured to process GPS signals received via the GPS antenna. Alternatively, the positionalinformation acquisition unit 120 may be a Wi-Fi antenna configured to receive Wi-Fi (registered trademark) radio waves from a plurality of base stations, and a position calculation unit configured to estimate distances from the respective base stations from reception intensities of received Wi-Fi radio waves, and calculate a current position on the basis of a principle of triangulation using the distances from the respective base stations and positions of the respective base stations. - The
behavior recognition unit 130 recognizes user behavior on the basis of sensor data detected by various kinds of sensor installed in the user terminal 1 or thewearable terminal 10. For example, thebehavior recognition unit 130 recognizes behavior of the user on the basis of the positional information acquired by the positionalinformation acquisition unit 120, acceleration data detected by the acceleration sensor (not illustrated), heartbeat information acquired by the heartbeatinformation processing unit 140, and the like. Examples of the behavior of the user include attitudes such as sitting/standing, movement such as walking/running, and contexts (states of the user) such as awakening/sleeping/working in office/studying in school/traveling by train. - The heartbeat
information processing unit 140 acquires heartbeat information of the user, trims data through a noise processing as necessary, and outputs heartbeat information to thecontrol unit 100. For example, the heartbeatinformation processing unit 140 acquires heartbeat information on the basis of sensor data detected by the heartbeat sensor installed in thewearable terminal 10. - The
operation input unit 150 is implemented as a touchscreen, a switch, a button, or the like. Theoperation input unit 150 detects operation input by the user, and outputs the detected input signal to thecontrol unit 100. For example, theoperation input unit 150 outputs a text message input by the user to thecontrol unit 100. - The
storage unit 160 is implemented as read only memory (ROM) or random access memory (RAM). The ROM stores programs, operation parameters, and the like that are used in processes performed by thecontrol unit 100, and the RAM temporarily stores a parameters and the like that arbitrarily change. - The
display unit 170 is an example of the output unit. Thedisplay unit 170 is implemented as a display device such as a liquid crystal display (LCD) device, or an organic light emitting diode (OLED) display device. - The
speaker 180 is an example of the output unit. Thespeaker 180 has a function of reproducing sound signals. - The
microphone 190 collects surrounding sound and outputs the collected sound data to thecontrol unit 100. For example, themicrophone 190 collects speech voice of the user and output it to thecontrol unit 100 as a voice message. Thecontrol unit 100 may transmit the collected sound data to theserver 2 as the voice message, or may generate a text message through a speech recognition process and transmit it to theserver 2. - The detailed configuration of the user terminal 1 according to the embodiment has been described above. Note that, the configuration of the user terminal 1 according to the embodiment is not limited to the example illustrated in
FIG. 3 . For example, the user terminal 1 may further include a camera, a distance sensor, an environment sensor, or the like. -
FIG. 4 is a block diagram illustrating an example of the configuration of theserver 2 according to the embodiment. As illustrated inFIG. 3 , theserver 2 includes acontrol unit 200, acommunication unit 210, a positionhistory storage unit 220, a behavior recognitionhistory storage unit 230, a heartbeathistory storage unit 240, amessage storage unit 250, and a questionnaireresult storage unit 260. - The
communication unit 210 exchanges data with an external device in a wired/wireless manner. For example, thecommunication unit 210 receives a message transmission scheduling request from the user terminal 1 serving as the communication source. In addition, thecommunication unit 210 transmits a message to the user terminal 1 serving as the communication destination under the control of a transmission control unit 204 (to be described later). - The
control unit 200 functions as an arithmetic processing device and a control device, and controls the overall operation in theserver 2 in accordance with various programs. For example, thecontrol unit 200 is implemented as an electronic circuit such as a CPU or a microprocessor. In addition, thecontrol unit 200 according to the embodiment also functions as a historyaccumulation control unit 201, alanguage analysis unit 202, a transmissiontiming determination unit 203, atransmission control unit 204, and amessage editing unit 205. - The history accumulation control unit 301 controls the position
history storage unit 220, the behavior recognitionhistory storage unit 230, and the heartbeathistory storage unit 240 to respectively accumulate positional information, behavior recognition results, and heartbeat data of users received from the respective user terminals 1, as a position history, a behavior recognition history, and a heartbeat history of the respective user in addition to its date and time. - The
language analysis unit 202 analyzes content (meaning and overview) of a message in the message transmission scheduling request transmitted from the user terminal 1. - The transmission
timing determination unit 203 determines a predetermined timing at which the user terminal 1 serving as the transmission destination is notified of existence of the scheduled message, in accordance with a result of message analysis performed by thelanguage analysis unit 202 and current and past psychological situations of the user corresponding to the transmission destination of the message whose transmission scheduling request has been issued. - Specifically, for example, the transmission
timing determination unit 203 determines an appropriate time slot for a psychological situation in accordance with a type of the message (such as “apology”, “encouragement”, or “invitation”) based on the message analysis result. It is determined when the user enters various psychological situations, on the basis of a past heartbeat history corresponding to the behavior recognition history and the position history of the transmission destination user, the schedule information of the transmission destination user, and weather forecast information. In this embodiment, for example, the heartbeat history is used for estimating psychological situations of the user. - In other words, the transmission
timing determination unit 203 recognizes types of heartbeats (in other words, psychological situations) depending on types of behaviors of the transmission destination user, on the basis of a past heartbeat history corresponding to the behavior recognition history, and predicts change in the psychological situations of the user in accordance with schedule information of the transmission destination user. Subsequently, the transmissiontiming determination unit 203 determines a time slot in which the user enters a psychological situation appropriate to the message. - In addition, the transmission
timing determination unit 203 is capable of acquiring weather information (weather, humidity, temperature, a discomfort index, or the like) in a place where the transmission destination user is present on the basis of weather information corresponding to positional information, and recognizing types of heartbeats (in other words, psychological situations) depending on various weather situation in view of a heartbeat history at that time. Next, the transmissiontiming determination unit 203 predicts change in the psychological situation of the user by using schedule information (used for estimating places the user will visit) of the transmission destination user and weather forecast information (weather forecast information of the places the user will visit). Subsequently, the transmissiontiming determination unit 203 determines a time slot in which the user enters a psychological situation appropriate to the message. - Alternatively, it is also possible for the transmission
timing determination unit 203 to recognize tendencies indicating when and how the heartbeats (in other words, psychological situation) change by using the heartbeat history, and determine a time slot of a psychological situation appropriate to the message on the basis of the state of the heartbeats. - In the above described example, the time slot of the psychological situation appropriate to the type of the message has been mainly described. However, the embodiment is not limited thereto. It is also possible to determine a time slot of a psychological situation appropriate to expression (wording) used in the message. Specifically, the transmission
timing determination unit 203 acquires a date and time at which a message in which the same expression is used as the message whose scheduling request has been issued by the transmission destination user from themessage storage unit 250, and acquires a heartbeat history of the transmission destination user at the date and time from the heartbeathistory storage unit 240. Next, the transmissiontiming determination unit 203 recognizes what kind of heartbeats (in other words, psychological situations) means that the user of the transmission destination is in a better psychological situation when receiving the message with such an expression. Next, on the basis of the heartbeat history, the transmissiontiming determination unit 203 determines a time slot of a psychological situation appropriate for transmitting the message whose scheduling request has been issued this time. - In addition, when determining the time slot of the psychological situation appropriate to the expression (wording) used in the message, it is also possible for the transmission
timing determination unit 203 to use the heartbeat history and a result of a questionnaire related to a psychological situation of the transmission destination user at a time of receiving a message with the same expression. The result of the questionnaire is acquired from the questionnaireresult storage unit 260. - The
transmission control unit 204 performs control such that the message is transmitted in the appropriate time slot determined by the transmissiontiming determination unit 203. At this time, thetransmission control unit 204 may acquire a real-time psychological situation or a real-time behavior recognition result of the transmission destination user in the appropriate time slot, and may perform control such that the message is transmitted at a timing at which the user enters an optimal psychological situation or the user exhibits optimal behavior (also referred to as an “appropriate timing”). In this embodiment, the transmission of a message means transmission of a body of the message, transmission of only a title or a sender of the message, or transmission of a notification indicating existence of the message (such as a message “new e-mail is arrived in the server”). - In addition, in the embodiment, the “predetermined timing” includes the “appropriate time slot” and the “appropriate timing” described above.
- The
message editing unit 205 has a function of automatically editing a message to be transmitted from thetransmission control unit 204 to the transmission destination user. Specifically, themessage editing unit 205 inserts a text into the message, the text describing an event occurred after receiving the scheduling request. Accordingly, it is possible to prevent the transmission destination user from knowing that the message is accumulated in theserver 2 in a certain period of time, and this achieves more natural communication. In addition, when editing the message to include words of season's greetings at the top of the message as the text describing the event, such season's greeting words can lead a main topic of the message. - In addition, it is also possible for the
message editing unit 205 to change content of a message whose scheduling request has been issued, on the basis of content of a past received message to the transmission destination user and a psychological situation of the transmission destination user at the time of receiving the received message. In this way, for example, it is possible to change or add the expression that makes the psychological situation of the transmission destination user better. - In addition, it is also possible for the
message editing unit 205 to reproduce the message whose scheduling request has been issued, by voice of a predetermined pop star such as a pop star the transmission destination user likes. In this way, for example, it is possible to make the psychological situation of the transmission destination user who has received the message better. - The position
history storage unit 220 stores positional information of the respective user terminals 1 as position histories of the respective users in association with date and time, under the control of the historyaccumulation control unit 201. In this embodiment, the respective users may be identified by using user IDs, for example. - The behavior recognition
history storage unit 230 stores behavior recognition results of the respective user terminals 1 as behavior recognition histories of the respective users in association with date and time, under the control of the historyaccumulation control unit 201. - The heartbeat
history storage unit 240 stores heartbeat information of the respective user terminals 1 as heartbeat histories of the respective users in association with date and time, under the control of the historyaccumulation control unit 201. - The
message storage unit 250 stores messages transmitted and received to and from the respective user terminals 1 as transmission/reception histories of the respective users in association with date and time. In addition, themessage storage unit 250 also stores transmission scheduling request messages received from the user terminals 1. - The questionnaire
result storage unit 260 stores questionnaire results transmitted from the respective user terminals 1 in association with date and time. - The above-described data pieces stored in the respective storage units are association with each other by using date, time, and user IDs as a key. Here,
FIG. 5 illustrates an example of various kinds of data stored in the storage units according to the embodiment. The illustrated data is various kinds of data associated with histories of past messages transmitted by a user (user ID: aaa) of a transmission source who has issued the message transmission scheduling request. Specifically, message transmission date and time, transmission source IDs, transmission destination IDs, content of messages (automatically-editing parts may be displayed in an identifiable manner), types of messages, weather at a time of reception, a schedule of the transmission destination user at the time of reception (or behavior recognition results), heartbeats of the transmission destination user before and after the reception, questionnaire results of the transmission destination users. In the questionnaire result, the transmission destination user inputs evaluation of the message in view of a sense of security, honesty, and a sense of affinity on a five-point scale. - The detailed configuration of the
server 2 according to the embodiment has been described above. Note that, the configuration of theserver 2 according to the embodiment is not limited to the example illustrated inFIG. 4 . For example, another server on the network may include the respective storage units. In addition, the heartbeat history is used for estimating psychological situations of the user. However, the embodiment is not limited thereto. It is also possible to use other biological information (such as sweat amount history, pulse history, or brain wave history). Next, details of operation processes according to the embodiment will be described. -
FIG. 6 is a flowchart illustrating a message communication control process according to the embodiment. As illustrated inFIG. 6 , theserver 2 first receives input of a message performed by a user (Step S103). Specifically, theserver 2 acquires the message input by the user via theuser terminal 1 a serving as the transmission source. Here,FIG. 7 illustrates an example of a message input screen displayed on theuser terminal 1 a. Ascreen 400 illustrated on the upper side ofFIG. 7 includes anaddress selection button 401, anaddress list 402, amessage input field 403, asend button 405, and ascheduling button 404. The user taps theaddress selection button 401 to select one or more addresses from a plurality of addresses. The one or more selected addresses are displayed in theaddress list 402. In addition, the user inputs a message into themessage input field 403 by using a virtual keyboard (not illustrated) displayed on the screen. Subsequently, in the case of transmitting the message immediately as usual, the user taps asend button 405 “SEND NOW”. Alternatively, in the case of issuing a scheduling request according to the embodiment, the user taps thescheduling button 404. In the case where thesend button 405 “SEND NOW”, thetransmission control unit 204 immediately transmits the message to the transmission destination (Step S142). - On the other hand, when the
scheduling button 404 is tapped (“SCHEDULING” in Step S106), theserver 2 asks the user about a due date for transmitting the message (transmission period) and necessity of modification (automatic editing) (Step S109). Specifically, when thescheduling button 404 is tapped, the display screen of theuser terminal 1 a transitions to ascreen 410 illustrated in the bottom side of theFIG. 7 . Thescreen 410 includes a transmission period start date andtime designation field 411, a transmission period expiration date andtime designation field 412,modification selection boxes 413, and ascheduling button 415. The “transmission period” means a period from an earliest message transmission start date and time input into the start date andtime designation field 411 to the expiration date and time input into the expiration date andtime designation field 412. By using the modification selection boxes, it is possible to select automatic modification of the message and/or voice modification. In the case where the voice modification is selected, it is possible to transmit the input message as a voice message. In addition, it is possible to select voice of the voice message from a voice list (characters, pop stars, and voice actors/actresses) via avoice selection button 414. - Next, the
language analysis unit 202 of theserver 2 performs language analysis on the message whose scheduling request has been issued by the user (Step S112). Specifically, thelanguage analysis unit 202 recognizes an overview of the message, that is, the type of the message on the basis of semantic analysis, keywords, and the like in addition to semantic analysis of the message and keyword extraction. - Next, in the case where the type of the message is the “apology” or the “encouragement” (YES in Step S115), the transmission
timing determination unit 203 determines an appropriate time slot for transmitting the apology or encouragement message (Step S118). For example, the time slot is determined within the transmission period designated by the transmission source user in Step S109. Details of the determination process will be described later with reference toFIG. 8 . - On the other hand, in the case where the type of the message is the “invitation” (YES in Step S121), the transmission
timing determination unit 203 determines an appropriate time slot for transmitting the invitation message (Step S124). For example, the time slot is determined within the transmission period designated by the transmission source user in Step S109. Details of the determination process will be described later with reference toFIG. 11 . Note that, in this embodiment, the predetermined determination processes performed in the case where the type of the message is the “apology”, the “encouragement”, or the “invitation” has been described as an example. However, the types of the messages are not limited thereto. For example, it is also possible to determine an appropriate time slot for a psychological situation depending on the respective message types in the case where the message type is a “request”, a “demand”, a “reminder”, a “sales”, or the like. - Next, when the determined time slot comes, the
transmission control unit 204 determines an appropriate timing for transmitting the message to the transmission destination, as a final determination (Step S127). Specifically, thetransmission control unit 204 recognizes a current psychological situation on the basis of real-time heartbeat information of the transmission destination user, and determines the best transmission timing. - Next, when the appropriate timing comes (YES in Step S127), the
control unit 200 of theserver 2 checks whether to modify the scheduled message (Step S130). The modification of the message means automatic modification of the message designated by the transmission source user in Step S109. - Next, in the case where the modification is set (YES in Step S130), the
message editing unit 205 modifies the message (Step S133). - Next, at the appropriate timing, the
transmission control unit 204 transmits the message whose scheduling request has been issued, to theuser terminal 1 b serving as the designated transmission destination (Step S142). In addition, the transmitted message is stored in themessage storage unit 250 as a transmission/reception history. - Note that, in the case where the type of the message is not the “invitation” (NO in Step S121), the transmission
timing determination unit 203 determines an earliest period satisfying a condition as the appropriate time slot, on the basis of the transmission period input by the transmission source user (Step S136). For example, in the case where the “from 14:00 on Xth to 14:00 on the next day” is set as the transmission period, the transmissiontiming determination unit 203 determines the earliest time slot “from 14:00 to 15:00 on Xth” in that period as the appropriate time slot. - Next, in the case where the appropriate timing comes (YES in Step S139), the
transmission control unit 204 transmits the message whose scheduling request has been issued, to theuser terminal 1 b serving as the designated transmission destination (Step S142). In a way similar to Step S127, the appropriate timing may be determined depending on a psychological situation estimated from real-time heartbeat information of the transmission destination user. - Next, details of the determination process in S118 will be described with reference to
FIG. 8 .FIG. 8 is a flowchart illustrating an appropriate time slot determination process of an apology or encouragement message according to the embodiment. - As illustrated in
FIG. 8 , the transmissiontiming determination unit 203 first extracts a message of the same type as the message whose scheduling request has been issued (here, “apology” or “encouragement” message), from a received message history of the transmission destination user stored in the message storage unit 250 (Step S203). In this case, it is also possible for the transmissiontiming determination unit 203 to extract the message from a message history received from the transmission source user. - Next, the transmission
timing determination unit 203 ranks transmission timings associated with “weather” on the basis of psychological situations of the transmission destination user before and after receiving the extracted message, and weather information around the transmission destination user at the time of receiving the message (Step S206). For example, the psychological situations of the transmission destination user are estimated from stability based on the heartbeat information or a questionnaire result. The weather information around the user of the transmission destination is acquired from a position history of the transmission destination user and a weather information history. - Next, the transmission
timing determination unit 203 ranks transmission timings associated with “behavior” on the basis of psychological situations of the transmission destination user before and after receiving the extracted message, and a behavior recognition result of the transmission destination user at the time of receiving the message (Step S209). - Next, the transmission
timing determination unit 203 ranks transmission timings associated with “expression” on the basis of psychological situations of the transmission destination user before and after receiving the extracted message, and expression used in the message (Step S212). - Next, the transmission
timing determination unit 203 determines an appropriate time slot in the transmission period designated by the transmission source user (Step S215). The appropriate time slot has a combination of the “weather”, “behavior”, and “expression” with higher ranks. - Next, details of the determination process in S124 will be described with reference to
FIG. 9 .FIG. 9 is a flowchart illustrating an appropriate time slot determination process of an invitation message according to the embodiment. - As illustrated in
FIG. 9 , the transmissiontiming determination unit 203 first extracts a message of the same type as the message whose scheduling request has been issued (here, “invitation” message), from a received message history of the transmission destination user, and further extracts a reply message from the transmission destination user to the extracted invitation message (Step S303). In this case, it is also possible for the transmissiontiming determination unit 203 to extract the message from a message history received from the transmission source user. - Next, the transmission
timing determination unit 203 calculates an invitation success rate associated with “weather” on the basis of weather information around the transmission destination user at the time of receiving the extracted invitation message, and content of the reply message (Step S306). The weather information around the transmission destination user is acquired from a position history of the transmission destination user and a weather information history. - Next, the transmission
timing determination unit 203 calculates an invitation success rate associated with “behavior” on the basis of a behavior recognition result of the transmission destination user at the time of receiving the extracted invitation message, and the content of the reply message (Step S309). - Next, the transmission
timing determination unit 203 calculates an invitation success rate associated with “expression” on the basis of expression used in the extracted invitation message, and the content of the reply message (Step S312). - Next, the transmission
timing determination unit 203 determines an appropriate time slot in the transmission period designated by the transmission source user (Step S315). The appropriate time slot has a combination of the “weather”, “behavior”, and “expression” with higher invitation success rates. - Next, detailed examples of the information processing system according to the embodiment will be described.
- For example, a situation is assumed in which the user A has secretly eaten ice cream in a refrigerator in her house, and the user B who is an older sister of the user A is furious about that because she has wanted to eat that, so the user A wants to apologize for that when the user B gets in a good mood because the user B is in the bad mood now.
- The user A creates an apology message to the user B by using the
user terminal 1 a. In this case, for example, thescreen 400 illustrated in the upper side ofFIG. 7 is displayed on theuser terminal 1 a. Next, when thescheduling button 404 is tapped, thescreen 410 illustrated in the bottom side of theFIG. 7 is displayed. The user A inputs a transmission period of the input message into the start date andtime designation field 411 and the expiration date andtime designation field 412, and select modifications to be set by using themodification selection boxes 413. Next, when thescheduling button 415 is tapped, a transmission scheduling request of the input message is transmitted from theuser terminal 1 a to theserver 2. - The transmission scheduling request transmitted to the
server 2 is analyzed by thelanguage analysis unit 202, and an overview of the message is interpreted. For example, thelanguage analysis unit 202 determines that the message is an apology message in the case where a keyword such as “sorry”, “apologize”, or “apology” is extracted from the message whose scheduling request has been issued. On the other hand, in the case where a keyword such as “you can do it” or “believe in you” is extracted, thelanguage analysis unit 202 determines that the message is an encouragement message. In the case of the message “I ate your ice cream in the fridge. Sorry.” input in thescreen 400 inFIG. 7 , the message is determined as an apology message. - Next, the transmission
timing determination unit 203 checks the transmission period designated by the user A, acquires a schedule of the user B of the transmission destination in the transmission period from the schedule server 4 a, and, on the basis of a time and a place described in the acquired schedule, acquires weather forecast information of that place at that time from theweather information server 4 b. - Next, the transmission
timing determination unit 203 acquires a position history of the user B, past weather information, and relations between heartbeats (in other words, psychological situations) of the user B and weather situations based on a heartbeat history of the user B, or relations between behavior and heartbeats of the user B based on the heartbeat history and a behavior recognition history of the user B, and estimates a heartbeat value of the user B on the basis of the schedule of the user B, behavior prediction, or weather forecast. Here,FIG. 10 illustrates an example of a heartbeat estimation result corresponding to the schedule of the user B, behavior prediction, and the weather forecast. In the illustrated example, heartbeat values of the user B are estimated on the basis of the schedule of the user B, behavior prediction, and weather forecast during the transmission period (seeFIG. 7 ) from 14:00 to 14:00 on the next day designated by the user A of the transmission source. - Subsequently, the transmission
timing determination unit 203 refers to the estimation result and determines a time slot in which the user B has a more stable psychological situation as an appropriate time slot for transmitting the apology message. For example, the stable psychological situation means a state in which heartbeats do not up or down significantly and the heartbeats remain in a relatively slow state. For example, in the case where the heartbeats are estimated to be a predetermined value or lower for a predetermined period of time, the transmissiontiming determination unit 203 determines that this is a stable time slot. In addition, it is also possible for the transmissiontiming determination unit 203 to exclude a sleeping time slot from appropriate time slots in view of heartbeats and a sleeping time slot pattern derived from the behavior history. In addition, it is also possible for the transmissiontiming determination unit 203 to avoid time expected to be time in which the user B is with the user of the transmission source, on the basis of behavior prediction and content of the schedule of the user B. - According to the above-described analysis, for example, the transmission
timing determination unit 203 determines that the appropriate time slot for transmitting the apology message is from 15:00 to 16:00 before extracurricular activity, in the case of the example illustrated inFIG. 10 . - Note that, in this embodiment, the heartbeats are used for determining the stability of psychological situations. However, the embodiment is not limited thereto. For example, barometric pressure, a discomfort index, or the like may be used. In addition, it is also possible for the transmission
timing determination unit 203 to determine a time slot in which a stable psychological situation tends to be obtained as the appropriate time slot for transmitting an apology message, on the basis of a past heartbeat history of the user B. For example, the transmissiontiming determination unit 203 calculates an average value of heartbeat values acquired for a predetermined period of time, and dispersion of the values, and determines a period of time having a low average value and small dispersion as the stable state. - Next, when the appropriate time slot determined by the transmission
timing determination unit 203 comes, thetransmission control unit 204 of theserver 2 acquires real-time heartbeat information and real-time behavior recognition result of the user B. In the case where heartbeat information and behavior information of the user B are not always acquired, theserver 2 remotely causes theuser terminal 1 b and thewearable terminal 10 of the user B to activate the various kinds of sensors for acquiring the heartbeat information and the behavior information. - Next, when it is recognized that heartbeats of the user B is stable and calm and that the user B is sitting for a while from the real-time behavior recognition result and the real-time heartbeat information, the
transmission control unit 204 determines that now is the appropriate timing, and transmits the apology message whose scheduling request has been issued by the user A to theuser terminal 1 b of the user B. Note that, in the case where real-time positional information of the user A of the transmission source is also acquired in addition to real-time positional information of the user B of the transmission destination at this time, thetransmission control unit 204 does not transmit the message if the user B of the transmission destination is with the person who has transmitted the message (user A). - In addition, in the case where the appropriate timing does not come even at the end of the appropriate time slot, it is possible for the
transmission control unit 204 to perform control such that the message is forcibly transmitted due to expiration of the time limit. In this case, it is possible to transmit the message within the determined appropriate time slot though not the appropriate timing. - In addition, in the case where the modification of the message is set, the
transmission control unit 204 transmits the apology message that has been automatically edited by themessage editing unit 205, to the user B. For example, themessage editing unit 205 adds a sentence talking about weather as an opening sentence of the message on the basis of weather and season information at the time of transmission, such as “We got lucky with great weather! By, the way, I ate your ice cream in the fridge. Sorry!”. - In addition, the
message editing unit 205 changes the wording “Sorry.” into the wording “Sorry!” on the basis of the past heartbeat history of the user B receiving apology messages, in the case where the user B has more stable heartbeats when receiving a message with the wording “Sorry!” rather than receiving a message with the wording “Sorry”. - The message transmitted to the user B is stored in the
message storage unit 250 of theserver 2. It addition, it is possible to use a questionnaire to provide feedback about whether the transmission destination user understands an intention of the message transmitted to the user B. For example, theserver 2 transmits a questionnaire to the user B serving as the transmission destination user a few days after the transmission of the message. More specifically, theserver 2 displays aquestionnaire screen 420 as illustrated inFIG. 11 on theuser terminal 1 b and prompts the user B to answer the questionnaire. In the illustrated example, thequestionnaire screen 420 displays questions for asking how the user B feels about the message such as “did you feel a sense of security?”, “did you feel honesty?”, and “did you feel a sense of affinity?”. Answers are input on a five-point scale as illustrated inFIG. 11 . Theserver 2 stores a result of the answers to the questionnaire in the questionnaireresult storage unit 260 in association with the user ID and the message reception date and time. In addition, as another way to provide feedback, it is possible to acquire change in heartbeats of the transmission destination user before and after receiving the message. Information of the questionnaire result and the change in heartbeats before and after the reception of a message may be used for automatically editing a transmission timing and a message to be transmitted to the user next time. - Next, details of the example of the encouragement message will be described. For example, a case is assumed in which a dance recital of a user C who is a friend of the user A will be held next week, but the user A cannot go or see the recital because the user A lives in a place far apart from the venue, so the user A wants to cheer the user C at a timing that does not bother the user C.
- In a way similar to the case of the apology message, the user A inputs an encouragement message such as “Your recital will be on 24th! You can do it!” into the
user terminal 1 a, and taps thescheduling button 404. Next, the user inputs a transmission period, configures setting about modification of the message, and taps thescheduling button 415. - Next, when a message scheduling request is transmitted from the
user terminal 1 a, theserver 2 interprets an overview of the message by using thelanguage analysis unit 202. Here, the keyword “You can do it” is extracted. Therefore, the message is determined as an encouragement message. - Next, in a way similar to the above-described example, the transmission
timing determination unit 203 estimates heartbeat values (psychological states) of the user C on the basis of a schedule of the transmission destination user C, behavior prediction, or weather forecast during the designated transmission period. Here,FIG. 12 illustrates an example of a heartbeat estimation result corresponding to the schedule of the user C, the behavior prediction, and the weather forecast. In the illustrated example, heartbeat values of the user C are estimated on the basis of the schedule of the user C, the behavior prediction, and the weather forecast during the transmission period from 18th to 23rd designated by the user A of the transmission source. - Subsequently, the transmission
timing determination unit 203 refers to the estimation result and determines a time slot in which the encouragement message is more effective to the user C in a psychological state, as an appropriate time slot for transmitting the encouragement message. It may be determined that the which psychological state makes the encouragement message more effective, on the basis of a questionnaire result or change in heartbeats of the user C before and after receiving past encouragement messages to the user C. This is because some people get stable and satisfied in the case of receiving an encouragement message when they are in a stable psychological situation, but some people get stable and satisfied in the case of receiving an encouragement message when they are in an unstable psychological situation. In addition, in a way similar to the above-described example, it is possible to exclude a sleeping time slot from the appropriate time slot, and it is possible to avoid a time slot in which the receiver is with the sender. - For example, the
server 2 determines an appropriate time slot for transmitting a message on the basis of weather information, change in heartbeats at the time of reception corresponding to a past encouragement message reception history of the user C, or the like. Specifically, for example, from the past experience, theserver 2 recognizes that the encouragement to the user C on the day before the event makes the user U nervous rather than reassuring (stable heartbeats changes into unstable heartbeats), an questionnaire result indicating that the user C gains a feeling of security when the user C gets encouragement while the user C has unstable heartbeats, and that heartbeats of the user C get stable in the case of receiving an encouragement message during raining. In this case, theserver 2 refers to a correspondence table of schedule, weather information, behavior, and estimated heartbeats as shown inFIG. 12 , and determines that the optimal time slot for transmitting the message is a day other than 23rd that is the day before the recital, a rainy day, and a time slot in which the user C has fast heartbeats and is in an unstable state. That is, theserver 2 determines that the optimal time slot is 22th that is two days before the recital. - Next, when 22th comes, the
server 2 collects real-time heartbeats and a real-time behavior recognition result of the user C. When it is recognized that the user C has unstable heartbeats and does not stay calm and the user C is sitting for a while, theserver 2 determines that now is the appropriate timing, and transmits the encouragement message whose scheduling request has been issued by the user A to a user terminal of the user C. - In addition, in the case where the modification of the message is set, the
transmission control unit 204 transmits the encouragement message that has been automatically edited by themessage editing unit 205, to the user C. For example, with regard to the message “Your recital will be on 24th! You can do it!”, themessage editing unit 205 converts the message such that the wording “24th” is interpreted into wording “the day after tomorrow” because the message will be transmitted on 22nd. In addition, themessage editing unit 205 converts the message into a message with wording “I believe in you” on the basis of a questionnaire result indicating that the user C has felt a stronger sense of affinity when receiving a message using wording “I believe in you” rather than receiving an encouragement message using wording “you can do it” in the past. - The details of the information processing system configured to transmit a message at an optimal timing have been described above. Accordingly, for example, it is possible to transmit an invitation e-mail, an apology e-mail, and the like to a lover at a most effective timing. Therefore, it is possible to establish a good relationship with the lover.
- As described above, by using an information processing system according to the embodiment of the present disclosure, it is possible to receive a transmission schedule of a message to a specific receiver and perform control such that the receiver is notified of the message at an optimal timing in view of content of the message and a psychological situation of the receiver.
- The preferred embodiment(s) of the present disclosure has/have been described above with reference to the accompanying drawings, whilst the present disclosure is not limited to the above examples. A person skilled in the art may find various alterations and modifications within the scope of the appended claims, and it should be understood that they will naturally come under the technical scope of the present disclosure.
- For example, it is also possible to create a computer program for causing a hardware such as CPU, ROM, and RAM, which are embedded in the above described user terminals 1 or the
server 2, to execute the functions of the user terminals 1 or theserver 2. Moreover, it may be possible to provide a computer-readable recording medium having the computer program stored therein. - In addition, in the above-described embodiment, an optimal time slot for transmitting a message is determined by using the behavior recognition history, the heartbeat history, and the schedule of the user, weather forecast information, or the like. However, it is not necessary to use all the information in the embodiment. Even when using a piece of the information, it is possible to maximally determine situations, determine the optimal time slot, and automatically edit messages.
- In addition, the weather information is used as an example of environmental information. However, the embodiment is not limited thereto. It is also possible to use barometric information acquired by a barometric sensor installed in each of the user terminals 1. In addition, the heartbeat information is used as an example of biological information used for estimating psychological situations. However, the embodiment is not limited thereto. It is also possible to detect and use a body temperature, pulse, breathing, sweating, brain waves, or the like.
- Further, the effects described in this specification are merely illustrative or exemplified effects, and are not limitative. That is, with or in the place of the above effects, the technology according to the present disclosure may achieve other effects that are clear to those skilled in the art from the description of this specification.
- Additionally, the present technology may also be configured as below.
- (1) A communication system including:
-
- a communication unit configured to receive, from a communication source, a scheduling request for scheduling transmission of a message to a specific communication destination; and
- a control unit configured to perform control such that the communication destination is notified of existence of the message at a predetermined timing in accordance with content of the message and a current or past psychological situation of a user corresponding to the specific communication destination received by the communication unit.
- (2) The communication system according to (1),
-
- in which the control unit determines an appropriate time slot for notifying the communication destination of the existence of the message, in accordance with a schedule of the user in a transmission period designated by the communication source, and a relation between a past schedule or a behavior recognition result of the user and a corresponding past psychological situation.
- (3) The communication system according to (1) or (2),
-
- in which the control unit determines an appropriate time slot for notifying the communication destination of the existence of the message, in accordance with weather forecast information in a transmission period designated by the communication source, and a relation between past surrounding weather information of the user and a corresponding past psychological situation.
- (4) The communication system according to (3),
-
- in which the weather forecast information and the surrounding weather information include weather, temperature, humidity, barometric pressure, or a discomfort index.
- (5) The communication system according to any one of (1) to (4),
-
- in which the control unit determines an appropriate time slot for notifying the communication destination of the existence of the message, in accordance with a psychological situation of the user estimated on a basis of a schedule of the user or weather forecast information in a transmission period designated by the communication source, content of the message received from the communication source, and a relation between content of a past message received by the user and a corresponding past psychological situation.
- (6) The communication system according to any one of (2) to (5),
-
- in which the past includes reception date and time of a same type of a past message received by the user as the content of the message to be transmitted.
- (7) The communication system according to any one of (2) to (6),
-
- in which the control unit performs control such that the communication destination is notified of existence of the message at an appropriate timing corresponding to a current psychological situation of the user corresponding to the specific communication destination in the determined appropriate time slot.
- (8) The communication system according to (7),
-
- in which the control unit performs control such that the communication destination is notified of existence of the message at an appropriate timing further corresponding to a current behavior recognition result of the user corresponding to the specific communication destination.
- (9) The communication system according to any one of (1) to (8),
-
- in which the control unit performs control such that the communication destination is notified of existence of a message which is requested by the scheduling request of transmission issued by the communication source, at a predetermined timing on a basis of content of a past message received by the user corresponding to the specific communication destination and a psychological situation of the user at a time of receiving the message that has been received.
- (10) The communication system according to any one of (1) to (9),
-
- in which the past psychological situation of the user is estimated on a basis of a result of a questionnaire answered by the user.
- (11) The communication system according to any one of (1) to (9),
-
- in which the past psychological situation of the user at the time of receiving the message is estimated on a basis of change in heartbeats of the user before and after receiving the message.
- (12) The communication system according to any one of (1) to (11),
-
- in which the control unit inserts a text into the message, the text describing an event occurred after receiving the scheduling request.
- (13) The communication system according to anyone of (1) to (11),
-
- in which the control unit changes content of a message which is requested by the scheduling request of the transmission, on a basis of content of a past message received by the user and a psychological situation at the time of receiving the message that has been received.
- (14) The communication system according to any one of (1) to (13),
-
- in which, when receiving the scheduling request, the control unit performs control such that a control signal is transmitted to a communication device corresponding to the user, the control signal activating a sensor for detecting a psychological situation of the user corresponding to the specific communication destination.
- (15) The communication system according to any one of (1) to (14),
-
- in which the control unit performs control such that a notification of existence of the message is issued when the user currently has a good psychological situation.
- (16) A communication control method including, by a processor:
-
- receiving, from a communication source, a scheduling request for scheduling transmission of a message to a specific communication destination; and
- performing control such that the communication destination is notified of existence of the message at a predetermined timing in accordance with content of the message and a current or past psychological situation of a user corresponding to the received specific communication destination.
-
- 1 user terminal
- 100 control unit
- 110 communication unit
- 120 positional information acquisition unit
- 130 behavior recognition unit
- 140 heartbeat information processing unit
- 150 operation input unit
- 160 storage unit
- 170 display unit
- 180 speaker
- 190 microphone
- 2 server
- 200 control unit
- 201 history accumulation control unit
- 202 language analysis unit
- 203 transmission timing determination unit
- 204 transmission control unit
- 205 message editing unit
- 210 communication unit
- 220 position history storage unit
- 230 behavior recognition history storage unit
- 240 heartbeat history storage unit
- 250 message storage unit
- 260 questionnaire result storage unit
- 3 network
- 4 a schedule server
- 4 b weather information server
- 10 wearable terminal
Claims (20)
1. A communication apparatus, comprising:
processing circuitry configured to:
receive, from a source terminal, a scheduling request for scheduling transmission of a current message to a destination terminal associated with a user;
determine, in response to the scheduling request from the source terminal, a time slot for the transmission of the current message according to content of the current message and a past psychological situation of the user, the past psychological situation being measurable according to biological information history of the user, the biological information history including a heartbeat history, a sweat amount history, a pulse history, or a brain wave history; and
determine a timing for the transmission of the current message within the determined time slot.
2. The communication apparatus according to claim 1 , wherein the processing circuitry is configured to determine the timing for the transmission of the current message within the determined time slot by estimating a current psychological situation of the user according to sensor data reported by the destination terminal and determining the timing for the transmission of the current message based on at least the estimated current psychological situation of the user.
3. The communication apparatus according to claim 2 , wherein the sensor data reported by the destination terminal includes biological information of the user including a heartbeat, a sweat amount, a pulse, or a brain wave.
4. The communication apparatus according to claim 2 , wherein the processing circuitry is configured to transmit, in response to the scheduling request from the source terminal, a control signal to a communication device associated with the user, the control signal activating a sensor for detecting the sensor data.
5. The communication apparatus according to claim 2 , wherein the processing circuitry is configured to determine a current time within the determined time slot as the timing for the transmission of the current message when the current psychological situation of the user at the current time matches a predetermined psychological situation that is determined according to the content of the current message.
6. The communication apparatus according to claim 1 , wherein the processing circuitry is configured to determine the time slot according to a schedule of the user in a transmission period designated by the source terminal and a relation between a past schedule or a behavior recognition result of the user and the past psychological situation.
7. The communication apparatus according to claim 6 , wherein the past schedule includes reception date and time of a past message received by the user, the past message and the current message being categorized as a same message type.
8. The communication apparatus according to claim 6 , wherein the processing circuitry is configured to determine the timing according to a current behavior recognition result of the user.
9. The communication apparatus according to claim 1 , wherein the processing circuitry is configured to determine the time slot according to weather forecast information in a transmission period designated by the source terminal, and a relation between past surrounding weather information of the user and the past psychological situation.
10. The communication apparatus according to claim 9 , wherein the weather forecast information and the surrounding weather information include weather, temperature, humidity, barometric pressure, or a discomfort index.
11. The communication apparatus according to claim 1 , wherein the processing circuitry is configured to determine the time slot according to an estimated psychological situation of the user estimated on a basis of a schedule of the user or weather forecast information in a transmission period designated by the source terminal, the content of the current message, and a relation between content of a past message received by the user and the past psychological situation.
12. The communication apparatus according to claim 1 , wherein the past psychological situation of the user is estimated on a basis of change in heartbeats of the user before and after receiving a past message.
13. The communication apparatus according to claim 1 , wherein the processing circuitry is configured to insert a text into the current message, the text describing an event occurred after the scheduling request is received.
14. The communication apparatus according to claim 1 , wherein the processing circuitry is configured to change the content of the current message on a basis of content of a past message received by the user and the past psychological situation at a time the past message is received.
15. A communication method, comprising:
receiving, from a source terminal, a scheduling request for scheduling transmission of a current message to a destination terminal associated with a user;
determining, by processing circuitry of a communication apparatus in response to the scheduling request from the source terminal, a time slot for the transmission of the current message according to content of the current message and a past psychological situation of the user, the past psychological situation being measurable according to biological information history of the user, the biological information history including a heartbeat history, a sweat amount history, a pulse history, or a brain wave history; and
determining, by the processing circuitry of the communication apparatus, a timing for the transmission of the current message within the determined time slot.
16. The communication method according to claim 15 , wherein the determining the timing for the transmission of the current message within the determined time slot comprises:
estimating a current psychological situation of the user according to sensor data reported by the destination terminal; and
determining the timing for the transmission of the current message based on at least the estimated current psychological situation of the user.
17. The communication method according to claim 16 , wherein the sensor data reported by the destination terminal includes biological information of the user including a heartbeat, a sweat amount, a pulse, or a brain wave.
18. A non-transitory computer-readable medium storing instructions which when executed by processing circuitry of a communication apparatus cause the communication apparatus to perform a process comprising:
receiving, from a source terminal, a scheduling request for scheduling transmission of a current message to a destination terminal associated with a user;
determining, in response to the scheduling request from the source terminal, a time slot for the transmission of the current message according to content of the current message and a past psychological situation of the user, the past psychological situation being measurable according to biological information history of the user, the biological information history including a heartbeat history, a sweat amount history, a pulse history, or a brain wave history; and
determining a timing for the transmission of the current message within the determined time slot.
19. The non-transitory computer-readable medium according to claim 18 , wherein the determining the timing for the transmission of the current message within the determined time slot comprises:
estimating a current psychological situation of the user according to sensor data reported by the destination terminal; and
determining the timing for the transmission of the current message based on at least the estimated current psychological situation of the user.
20. The non-transitory computer-readable medium according to claim 19 , wherein the sensor data reported by the destination terminal includes biological information of the user including a heartbeat, a sweat amount, a pulse, or a brain wave.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/499,681 US20220038406A1 (en) | 2015-11-13 | 2021-10-12 | Communication system and communication control method |
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015-222865 | 2015-11-13 | ||
| JP2015222865 | 2015-11-13 | ||
| PCT/JP2016/073177 WO2017081894A1 (en) | 2015-11-13 | 2016-08-05 | Communication system and communication control method |
| US201815759414A | 2018-03-12 | 2018-03-12 | |
| US16/848,351 US11184311B2 (en) | 2015-11-13 | 2020-04-14 | Communication system and communication control method |
| US17/499,681 US20220038406A1 (en) | 2015-11-13 | 2021-10-12 | Communication system and communication control method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US16/848,351 Continuation US11184311B2 (en) | 2015-11-13 | 2020-04-14 | Communication system and communication control method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20220038406A1 true US20220038406A1 (en) | 2022-02-03 |
Family
ID=58694983
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/759,414 Expired - Fee Related US10680990B2 (en) | 2015-11-13 | 2016-08-05 | Communication system and communication control method |
| US16/848,351 Active US11184311B2 (en) | 2015-11-13 | 2020-04-14 | Communication system and communication control method |
| US17/499,681 Abandoned US20220038406A1 (en) | 2015-11-13 | 2021-10-12 | Communication system and communication control method |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/759,414 Expired - Fee Related US10680990B2 (en) | 2015-11-13 | 2016-08-05 | Communication system and communication control method |
| US16/848,351 Active US11184311B2 (en) | 2015-11-13 | 2020-04-14 | Communication system and communication control method |
Country Status (5)
| Country | Link |
|---|---|
| US (3) | US10680990B2 (en) |
| EP (2) | EP3958131A1 (en) |
| KR (2) | KR20180084038A (en) |
| CN (2) | CN114553816A (en) |
| WO (1) | WO2017081894A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2025048965A (en) * | 2023-09-21 | 2025-04-03 | ソフトバンクグループ株式会社 | system |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6906197B2 (en) * | 2017-09-29 | 2021-07-21 | パナソニックIpマネジメント株式会社 | Information processing method, information processing device and information processing program |
| JP7550742B2 (en) * | 2021-11-09 | 2024-09-13 | Kddi株式会社 | Message distribution device, message distribution method and message distribution program |
| FR3131159B1 (en) * | 2021-12-17 | 2024-12-20 | Orange | Method and device for managing a message intended for at least one terminal of a user. |
Family Cites Families (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002101211A (en) | 2000-09-25 | 2002-04-05 | E Culture Kk | Delivery service system |
| US20030003964A1 (en) * | 2001-06-27 | 2003-01-02 | Wroblewski Gary T. | Method and apparatus for selectively admitting messages to a mobile station |
| US7142664B2 (en) * | 2002-05-06 | 2006-11-28 | Avaya Technology Corp. | Intelligent multimode message alerts |
| US7874983B2 (en) | 2003-01-27 | 2011-01-25 | Motorola Mobility, Inc. | Determination of emotional and physiological states of a recipient of a communication |
| US7720690B2 (en) * | 2005-03-25 | 2010-05-18 | J2 Global Communications | Real-time customer service assistance using collected customer life cycle data |
| US20060230117A1 (en) * | 2005-04-08 | 2006-10-12 | Cisco Technology, Inc. | System and method for message prioritization |
| US20060293838A1 (en) | 2005-06-13 | 2006-12-28 | Kakuya Yamamoto | Guidance apparatus |
| JP2007026429A (en) | 2005-06-13 | 2007-02-01 | Matsushita Electric Ind Co Ltd | Guidance device |
| US7849154B2 (en) * | 2005-06-27 | 2010-12-07 | M:Metrics, Inc. | Acquiring, storing, and correlating profile data of cellular mobile communications system's users to events |
| JP2007207153A (en) | 2006-02-06 | 2007-08-16 | Sony Corp | COMMUNICATION TERMINAL DEVICE, INFORMATION PROVIDING SYSTEM, SERVER DEVICE, INFORMATION PROVIDING METHOD, AND INFORMATION PROVIDING PROGRAM |
| US20090249222A1 (en) * | 2008-03-25 | 2009-10-01 | Square Products Corporation | System and method for simultaneous media presentation |
| US20100082751A1 (en) * | 2008-09-29 | 2010-04-01 | Microsoft Corporation | User perception of electronic messaging |
| JP5245873B2 (en) * | 2009-02-02 | 2013-07-24 | 日本電気株式会社 | Date / time expression conversion device, electronic mail device, mail server, control method thereof, and program |
| US20100223341A1 (en) * | 2009-02-27 | 2010-09-02 | Microsoft Corporation | Electronic messaging tailored to user interest |
| KR101668249B1 (en) * | 2010-08-24 | 2016-10-21 | 엘지전자 주식회사 | Mobile terminal and operation control method thereof |
| US8620850B2 (en) * | 2010-09-07 | 2013-12-31 | Blackberry Limited | Dynamically manipulating an emoticon or avatar |
| US10248960B2 (en) | 2010-11-16 | 2019-04-02 | Disney Enterprises, Inc. | Data mining to determine online user responses to broadcast messages |
| US8947226B2 (en) * | 2011-06-03 | 2015-02-03 | Brian M. Dugan | Bands for measuring biometric information |
| RU2634680C2 (en) | 2011-11-22 | 2017-11-02 | Конинклейке Филипс Н.В. | Evaluation of cortisol level and psychological equilibrium or violation of psychological equilibrium |
| US9602448B2 (en) * | 2012-06-14 | 2017-03-21 | At&T Intellectual Property I, L.P. | Presence information based messaging |
| US20150195378A1 (en) * | 2012-07-17 | 2015-07-09 | Sony Corporation | Information processing apparatus, server, information processing method, and information processing system |
| KR101990074B1 (en) * | 2012-11-12 | 2019-06-17 | 삼성전자주식회사 | Method and apparatus for message management and message transfer in electronic device |
| JP6181437B2 (en) | 2013-06-21 | 2017-08-16 | 浩二 川西 | Information processing apparatus, information processing method, and program |
| JP6230063B2 (en) * | 2014-02-05 | 2017-11-15 | 株式会社フォーカルワークス | Message distribution server and message transmission device |
| US9386110B2 (en) | 2014-03-13 | 2016-07-05 | Lenovo Enterprise Solutions (Singapore) Pte. Ltd. | Communications responsive to recipient sentiment |
| US9830475B2 (en) * | 2014-07-15 | 2017-11-28 | Sagesurfer Inc. | Integrated collaboration platform for contextual communication |
| US11240189B2 (en) * | 2016-10-14 | 2022-02-01 | International Business Machines Corporation | Biometric-based sentiment management in a social networking environment |
-
2016
- 2016-08-05 CN CN202210087290.2A patent/CN114553816A/en not_active Withdrawn
- 2016-08-05 KR KR1020187010109A patent/KR20180084038A/en not_active Ceased
- 2016-08-05 WO PCT/JP2016/073177 patent/WO2017081894A1/en not_active Ceased
- 2016-08-05 EP EP21196693.2A patent/EP3958131A1/en not_active Withdrawn
- 2016-08-05 EP EP16863858.3A patent/EP3376396B1/en active Active
- 2016-08-05 KR KR1020237011141A patent/KR102822555B1/en active Active
- 2016-08-05 US US15/759,414 patent/US10680990B2/en not_active Expired - Fee Related
- 2016-08-05 CN CN201680064746.6A patent/CN108351846B/en not_active Expired - Fee Related
-
2020
- 2020-04-14 US US16/848,351 patent/US11184311B2/en active Active
-
2021
- 2021-10-12 US US17/499,681 patent/US20220038406A1/en not_active Abandoned
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2025048965A (en) * | 2023-09-21 | 2025-04-03 | ソフトバンクグループ株式会社 | system |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3376396B1 (en) | 2021-11-17 |
| EP3958131A1 (en) | 2022-02-23 |
| EP3376396A4 (en) | 2018-10-10 |
| US20200244613A1 (en) | 2020-07-30 |
| US20180212914A1 (en) | 2018-07-26 |
| EP3376396A1 (en) | 2018-09-19 |
| US10680990B2 (en) | 2020-06-09 |
| KR20180084038A (en) | 2018-07-24 |
| CN114553816A (en) | 2022-05-27 |
| US11184311B2 (en) | 2021-11-23 |
| KR20230050473A (en) | 2023-04-14 |
| KR102822555B1 (en) | 2025-06-20 |
| CN108351846B (en) | 2022-03-01 |
| WO2017081894A1 (en) | 2017-05-18 |
| CN108351846A (en) | 2018-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220038406A1 (en) | Communication system and communication control method | |
| US20240356772A1 (en) | Information processing system, information processing device, information processing method, and recording medium | |
| CN102986201B (en) | User interfaces | |
| US20250106364A1 (en) | Personalized Keyword Log | |
| US10791072B2 (en) | Generating conversations for behavior encouragement | |
| US20150338917A1 (en) | Device, system, and method of controlling electronic devices via thought | |
| JP7163914B2 (en) | Information processing device, information processing method, and program | |
| US20180013698A1 (en) | Messaging system having send-recommendation functionality | |
| WO2018174956A1 (en) | Proactive incorporation of unsolicited content into human-to-computer dialogs | |
| US20200297264A1 (en) | Information processing device, information processing method, and program | |
| CN110214301B (en) | Information processing apparatus, information processing method, and program | |
| KR102585230B1 (en) | Device and method for providing notification message for call request | |
| US11298080B2 (en) | Reproduction terminal and reproduction method | |
| US20140289356A1 (en) | Terminal control system, method for controlling terminal, and electronic device | |
| EP3858450A1 (en) | Electronic device for providing interactive game and operating method therefor | |
| US20170263036A1 (en) | User interface device, program, and method of notifying content | |
| US20210224720A1 (en) | Information processing apparatus, control method, and program | |
| JP2016212478A (en) | Terminal device, notification method, program, and content providing system | |
| JP2017126305A (en) | Information providing device, system, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |