JP2013038569A - Portable user terminal, message transmission method, and message transmission program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable user terminal, a message transmission method, and a message transmission program which can properly switch between voice communication and screen display/input.SOLUTION: A portable user terminal 10 detects an inclination of the portable user terminal 10 by a sensor while a user is performing a telephone call, and according to the inclination detected by the sensor, determines whether the user performing a telephone call by the portable user terminal 10 has detached his/her ear from the portable user terminal 10. Then, when it is determined that the user has detached the ear from the terminal, the device converts communication voice into a display message and outputs the display message.

Description

  The present invention relates to a portable user terminal, a message transmission method, and a message transmission program that perform communication using a message including a telephone call between user terminals connected via a public line network.

  In recent years, various services are provided to users by connecting a mobile terminal connected to a public network to a Web server or the like. In particular, with the advent of smartphones (high-function mobile phones), it has become possible to perform advanced services that have been provided for personal computers with mobile phones.

  In addition, various functions are installed in the smartphone itself, not the service provided by the server. Therefore, it often takes time for the user to become familiar with all the functions installed. For example, even if a function desired by the user is mounted on a smartphone, the method of setting the function is unclear, so that the user cannot use the function.

  Therefore, in order to make maximum use of such advanced Web services and advanced smartphone functions, the user needs to be familiar with setting operations and functions for the smartphone. Furthermore, when a user unfamiliar with the operation makes settings for the terminal for the first time, setting information that should not be deleted is often deleted, or errors are caused by inappropriate settings. .

  For such a problem, a method for remotely setting a user's terminal or instructing a user from a remote location by performing remote support (remote maintenance) on the user's terminal from the system is known. . For example, in Patent Document 1, the screen information of each client to be supported is acquired on the server side, and the screen information is always displayed in a list on the server, thereby improving the efficiency of support and monitoring for the client. It is disclosed.

  Further, as disclosed in Patent Document 2, a technique is disclosed that enables remote support using augmented reality without installing special agent software on the portable user terminal side.

  For example, when performing remote support using a camera of a portable user terminal as in Patent Document 2, the user often speaks of this terminal from his / her ear. In this case, the user can listen to the call by switching the voice of the call to the speaker output.

Japanese Patent Laid-Open No. 2003-6062 JP 2011-34315 A

  However, if the user does not want to listen to his / her utterance or if the operation to switch the call to speaker output is unknown, the user cannot properly listen to the call from the other party. . In addition, during a call, if a secret message such as personal information must be transmitted to the other party over the telephone, it may be heard by other people around by speaking. Furthermore, when speaking, the user must keep the terminal close to the mouth and may not be able to talk easily.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a portable user terminal, a message transmission method, and a message transmission program capable of appropriately converting voice calls and screen display and input. .

  The present invention provides the following solutions.

The invention according to the first feature is
A sensor for detecting the tilt of the portable user terminal during a call;
A determination module that determines whether a user who makes a call with the portable user terminal releases his / her ear with respect to the portable user terminal according to the inclination detected by the sensor;
When it is determined that the user has removed his / her ear, a portable user terminal is provided that includes an output switching module that switches a voice during a call to a display message and outputs the message.

  According to the first aspect of the invention, the user of the portable user terminal detects the inclination of the portable user terminal during a call and makes a call using the portable user terminal according to the inclination detected by the sensor. In contrast, it is determined whether the ear has been released. When it is determined that the user has removed his / her ear, the voice during a call is switched to a display message and output. Therefore, a portable user terminal capable of appropriately converting voice calls and screen display and input is provided.

  The invention according to the first feature exhibits the same actions and effects not only in the portable user terminal but also in the method and program in the category of the invention.

The invention according to the second feature is
A sensor for detecting the tilt of the portable user terminal during a call;
A determination module that determines whether a user who makes a call with the portable user terminal releases his / her ear with respect to the portable user terminal according to the inclination detected by the sensor;
A portable user terminal comprising: a notification module for notifying that the user has removed his / her ear to the other party's terminal that the portable user terminal is in a call when it is determined that the user has released his / her ear; provide.

  According to the second aspect of the invention, the inclination of the portable user terminal is detected during a call, and a user who makes a call with the portable user terminal responds to the portable user terminal according to the detected inclination. Then, if it is determined whether the user has released his / her ear, and the user determines that he / she has released his / her ear, the portable user terminal notifies the other terminal of the call that the user has released his / her ear. Therefore, the other party during the call can recognize that it is more effective to convey the message by the display message than to convey the message by voice to the portable user terminal.

  The invention according to the second feature exhibits the same operation and effect not only in the portable user terminal but also in the method and program in the category of the invention.

  According to the present invention, it is possible to provide a portable user terminal, a message transmission method, and a message transmission program capable of appropriately converting voice calls and screen display and input.

FIG. 1 is an overall configuration diagram of the communication system 1. FIG. 2 is a functional block diagram of the control server 100, the portable user terminal 10, and the support terminal 150. FIG. 3 is a flowchart showing terminal type control processing executed by the portable user terminal 10. FIG. 4 is a flowchart showing an inter-terminal type control process executed by the portable user terminal 10 and the support terminal 150. FIG. 5 is a screen image diagram displayed on the portable user terminal 10. FIG. 6 is a screen image displayed on the support terminal 150. FIG. 7 is a screen image displayed on the portable user terminal 10.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. This is merely an example, and the technical scope of the present invention is not limited to this.

[System configuration of communication system]
FIG. 1 is a system configuration diagram of a communication system 1 which is a preferred embodiment of the present invention. The communication system 1 includes portable user terminals 10a and 10b (hereinafter simply referred to as “10”), a control server 100 (remote server), a public network 3 (for example, the Internet network, the third generation, the fourth generation communication network). Etc.) and a support terminal 150 (remote terminal). As will be described later, the control server 100 is not an essential component.

  The portable user terminal 10 communicates radio waves with the base station by wireless communication, is connected to the exchange from the base station, is connected to the public network 3, and the control server 100 is connected via the public network 3. Is communicably connected. The control server 100 and the support terminal 150 may be connected via a LAN (Local Area Network) or may be connected via the public line network 3. The communication in the communication system 1 may be wireless communication or wired communication. In order for the portable user terminal 10 to connect to the public line network 3, communication may be possible via a network device such as a router.

  The portable user terminal 10 may be a general information terminal for a user to communicate, and is an information device or an electrical appliance having functions to be described later including a call function. The portable user terminal 10 may be, for example, a slate terminal 10a, a smartphone 10b, a mobile phone, a computer, or a general information appliance such as a home phone, a netbook terminal, an electronic book terminal, or an electronic dictionary terminal. It may be.

  The support terminal 150 is a general information terminal used by a support person who supports the portable user terminal 10. In the present embodiment, the case where the partner terminal that communicates with the portable user terminal 10 is the support terminal 150 will be described. However, the usage of the present invention is limited to the support terminal 150 such as remote support. It is clear that there is no such thing.

[Description of each function]
FIG. 2 is a diagram illustrating functional blocks of the support terminal 150, the control server 100, and the portable user terminal 10. The hardware configuration of each device will be described with reference to FIG.

  The portable user terminal 10 is a terminal used by a user who performs communication. As long as the portable user terminal 10 includes a control unit 11, a data storage unit 12, a data communication unit 13, a touch input display unit 14, an acceleration sensor 15, and a voice call unit 16, home appliances and commercial appliances are provided. Any of a portable terminal and a business terminal may be used.

  The control unit 11 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The data communication unit 13 is, for example, a WiFi (Wireless Fidelity) device compliant with IEEE 802.11. Alternatively, a wireless device or the like conforming to the IMT-2000 standard such as a third generation mobile communication system is provided. The data communication unit 13 may be a wired LAN connection.

  The data storage unit 12 includes one or both of an HDD (Hard Disk Drive), an SSD (Solid State Drive), and a memory. Furthermore, the touch input display unit 14 includes a display unit such as a liquid crystal monitor that displays an image or a text message, and an input unit such as a keyboard, a touch panel, or a voice input that accepts input from the user.

  The voice call unit 16 receives a speech from a partner terminal (support terminal 150) that performs communication as a digital signal, and receives a speech data reception / output function that enables the user to listen to it and inputs the user's speech as a digital signal. However, it is a device having an audio data transmission function for transmitting audio data to the counterpart terminal.

  The acceleration sensor 15 is a sensor that measures the acceleration of the portable user terminal 10 and may be any of a mechanical type, an optical type, and a semiconductor type, and the number of detection axes is X axis, Y axis, or Z axis. It is desirable to have three axes. By measuring the gravitational acceleration of the earth, the inclination of the portable user terminal 10 is detected to determine what direction the touch input display unit 14 is facing the user. Then, the acceleration sensor 15 determines whether or not the user is touching the portable user terminal 10 according to the direction.

  Specifically, the acceleration that changes over time from when the user tries to use the portable user terminal 10 away from the ear from the magnitude and direction of the acceleration measured when the portable user terminal 10 is put on the ear. The size and orientation are stored in the portable user terminal 10 in advance, and when the acceleration that changes with time is detected, it may be determined that the user has removed the portable user terminal 10 from the ear. In the following, the acceleration sensor 15 will be described as a sensor for determining whether or not the ear is separated from the portable user terminal 10, but if a similar effect is obtained, the sensor may be a gyro sensor, a contact sensor, or the like. It may be a predetermined sensor.

  The support terminal 150 is a terminal used by a supporter who supports the user. The support terminal 150 may be a computer such as a normal personal computer. Since the hardware configuration of the support terminal 150 may be the same as that of the portable user terminal 10, the description thereof is omitted. Note that, unlike the portable user terminal 10, the input display unit 154 is not limited to a touch panel, and may be a normal keyboard or monitor, and is described as such. The input display unit 154 is a device that receives and displays input of images and characters.

  The control server 100 is a server that relays communication between the portable user terminal 10 and the support terminal 150, although it is not an essential component of the present invention. The control server 100 includes a control unit 101, a data storage unit 102, and a data communication unit 103.

  The control unit 101 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The data communication unit 103 includes a wired or wireless communication device. , HDD (Hard Disk Drive), SSD (Solid State Drive), or the like.

[Terminal control processing]
FIG. 3 is a flowchart of a terminal type control process executed by the portable user terminal 10. This processing is based on the assumption that the portable user terminal 10 is making a call using the voice call unit 16 with the other party's telephone (which may be the support terminal 150). That is, it is assumed that the user is making a call with the portable user terminal 10 placed on his / her ear, and the user does not use the speakerphone function of outputting the speaker so that the voice of the call can be heard even if it is away from the ear. .

  First, during the call, the portable user terminal 10 detects the inclination of the portable user terminal 10 based on the gravitational acceleration measured by the portable user terminal 10 itself (step S01). When the tilt is detected, it is determined whether the tilt has a predetermined size and orientation, and it is determined whether the user has taken the portable user terminal 10 away from the ear (step S02).

  Note that the process of step 02 may simply be a process in which the contact sensor of the portable user terminal 10 determines whether the user has removed his / her ear. In this case, the process of step S01 is not necessary.

  When the portable user terminal 10 determines that the inclination is a predetermined size and orientation, the portable user terminal 10 determines whether the user has removed the portable user terminal 10 from the ear (step S02: “YES”), The process moves to step S03. On the other hand, when the portable user terminal 10 determines that the inclination is not the predetermined magnitude and orientation, the portable user terminal 10 determines that the user has not removed the portable user terminal 10 from the ear (step S02: “NO”), The process moves to step S01. Here, the determination that the inclination is a predetermined size and direction is based on whether or not an acceleration that has been stored in advance in the portable user terminal 10 and that changes with time is detected. Good.

  Next, the portable user terminal 10 waits for voice input from the counterpart terminal, but when voice is received from the counterpart terminal (step S03: “YES”), the process proceeds to step S04. Until the voice is received from the partner terminal (step S03: “NO”), the process is on standby.

  The portable user terminal 10 recognizes the voice received from the counterpart terminal and performs text processing for character display (step S04). Then, the portable user terminal 10 displays the text-processed characters on the screen (step S05).

  FIG. 5 is a diagram showing, as an example, a case where the portable user terminal 10 recognizes a voice input by a phone call and displays the text characters extracted here on the screen. As shown in FIG. 5, when step S02 is “YES”, the portable user terminal 10 displays “switch the call from voice output to screen display”. When the voice of “Please press the home button to output the setting screen ...” is received from the other party's terminal, it is converted into text characters and as shown in FIG. Please output the screen .... "is displayed.

  Next, at an arbitrary timing, the portable user terminal 10 performs screen display of the input reception interface (step S06). The input reception interface has a function for receiving a key input from the user, and corresponds to buttons 54 such as “Yes” and “No” on the screen as shown in FIG.

  When the portable user terminal 10 accepts an input to the input acceptance interface from the user (step S07: “YES”), the process proceeds to step S08. The portable user terminal 10 is on standby until it receives an input to the input reception interface from the user (step S07: “NO”).

  Next, the portable user terminal 10 performs an audio output process (step S08). That is, in the example of FIG. 7, when the user presses the “Yes” button, a voice message “Yes” is transmitted to the partner terminal by voice output “Yes”. That is, with the touch operation of “Yes”, the portable user terminal 10 can output “Yes” voice, and the other terminal can make a voice response on behalf of the user.

  Note that, when the button 54 is pressed by a touch operation on the portable user terminal 10, the portable user terminal 10 itself may not output the sound, and the sound may be transmitted only to the partner terminal. In other words, if you do not want to use the portable user terminal 10 to output audio, you can output audio only to the other party's terminal, but do not output audio by yourself, so that other people around the user cannot hear the message. There are benefits.

[End-to-end control processing]
Next, an inter-terminal type control process executed in cooperation with the support terminal 150 will be described instead of the process of the portable user terminal 10 alone as described above. FIG. 4 is a flowchart of the inter-terminal type control process executed by the portable user terminal 10 and the support terminal 150.
This processing is based on the assumption that the portable user terminal 10 is making a call using the voice call unit 16 with the other party's telephone (which may be the support terminal 150). That is, it is assumed that the user is making a call with the portable user terminal 10 placed on his / her ear, and the user does not use the speakerphone function of outputting the speaker so that the voice of the call can be heard even if it is away from the ear. .

  Initially, similar to the terminal-type control process, the portable user terminal 10 detects the inclination of the portable user terminal 10 during a call on the basis of the gravitational acceleration measured by the portable user terminal 10 itself (step S10). ). When the tilt is detected, it is determined whether the tilt has a predetermined size and orientation, and it is determined whether the user has taken the portable user terminal 10 away from the ear (step S11).

  Note that the process of step S11 may simply be a process in which the contact sensor of the portable user terminal 10 determines whether or not the user has removed his / her ear. In this case, the process of step S10 is not necessary.

  When the portable user terminal 10 determines that the inclination is a predetermined size and orientation, the portable user terminal 10 determines whether the user has removed the portable user terminal 10 from the ear (step S11: “YES”), The process moves to step S12. On the other hand, when the portable user terminal 10 determines that the inclination is not the predetermined magnitude and orientation, the portable user terminal 10 determines that the user has not removed the portable user terminal 10 from the ear (step S11: “NO”). The process moves to step S10. Here, the determination that the inclination is a predetermined size and direction is based on whether or not an acceleration that has been stored in advance in the portable user terminal 10 and that changes with time is detected. Good.

  Next, the portable user terminal 10 notifies the support terminal 150 that the user has judged whether or not the portable user terminal 10 has been removed from the ear (judgment result) (step S12). In response to this, the support terminal 150 displays a message regarding the determination result (step S13). This message is a message for calling attention to a support person who operates the support terminal 150. For example, as shown in FIG. 6, “It is assumed that the user has lifted the terminal away from the ear. “Do you want to switch the transmission method to output display?”

  Next, the support terminal 150 receives an instruction for a message from the supporter (step S14). That is, it is determined whether or not the message transmission method is switched from the voice output by the call to the screen display from the support person. Here, when an instruction to switch to the screen display is received from the supporter (step S13: “YES”), the process proceeds to step S15. When an instruction is received from the supporter not to switch to the screen display (step S13: “NO”), the process is terminated in order to continue using the voice output by the call.

  Next, the support terminal 150 transmits a display message according to the instruction of the supporter (step S15). Specifically, text characters such as chat correspond to the display message, and this display message may be transmitted. Alternatively, when a predetermined icon displayed on the support terminal 150 is clicked, a predetermined character (for example, press the home button to output a setting screen) may be transmitted.

  The portable user terminal 10 receives the display message transmitted from the support terminal 150 and displays it on the screen (step S16).

  Next, at an arbitrary timing, the support terminal 150 transmits an input reception interface to the portable user terminal 10 (step S15). The input reception interface has a function for receiving a key input from the user, and corresponds to buttons 54 such as “Yes” and “No” on the screen of the portable user terminal 10 as shown in FIG. . For example, the support terminal 150 transmits this input reception interface when the supporter desires consent or intention confirmation from the user.

  The portable user terminal 10 receives the input reception interface transmitted from the support terminal 150 and performs screen display (step S18).

  When the portable user terminal 10 receives an input to the input reception interface from the user (step S19: “YES”), the input content is transmitted to the portable user terminal 10, and the process proceeds to step S20. . The portable user terminal 10 is on standby until it receives an input to the input reception interface from the user (step S19: “NO”).

  The support terminal 150 displays that there is an input content from the user for the input reception interface (step S20).

  As an example of this input reception interface, as shown in FIG. 7, an input for accepting whether or not to permit the change of the setting is accepted by a button 54 of the input reception interface. In response to this input, when the support terminal 150 receives the consent, the support person can perform an operation to change the setting.

  In the inter-terminal type control process, the control server 100 may control the process between the support terminal 150 and the portable user terminal 10. That is, the support terminal 150 only accepts input from the supporter and displays it on the screen. The display message and the input reception interface are stored in the control server 100 and displayed on the support terminal 150 and the portable user terminal 10. May be.

  The means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program. The program is provided in a form recorded on a computer-readable recording medium such as a flexible disk, CD (CD-ROM, etc.), DVD (DVD-ROM, DVD-RAM, etc.), for example. In this case, the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it. The program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to these embodiment mentioned above. The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

  1 communication system, 3 public line network, 10 portable user terminal, 100 control server, 150 support terminal

Claims (4)

A sensor for detecting the tilt of the portable user terminal during a call;
A determination module that determines whether a user who makes a call with the portable user terminal releases his / her ear with respect to the portable user terminal according to the inclination detected by the sensor;
If it is determined that the user has removed his / her ear, an output switching module that outputs the voice during a call by switching to a display message; and
A portable user terminal comprising: A sensor for detecting the tilt of the portable user terminal during a call;
A determination module that determines whether a user who makes a call with the portable user terminal releases his / her ear with respect to the portable user terminal according to the inclination detected by the sensor;
If it is determined that the user has released his ear, the portable user terminal notifies the other party's terminal that is in a call to notify that the user has released his ear;
A portable user terminal comprising: A message transmission method executed by a portable user terminal,
Detecting the tilt of the portable user terminal during a call;
Determining whether a user who makes a call with the portable user terminal releases his / her ear with respect to the portable user terminal according to the inclination detected by the sensor;
If it is determined that the user has removed his / her ear, the step of switching the voice during a call to a display message and outputting it;
A message transmission method comprising: In portable user terminal,
Detecting the tilt of the portable user terminal during a call;
Determining whether or not a user making a call with the portable user terminal releases his / her ear from the portable user terminal according to the inclination detected by the sensor;
If it is determined that the user has removed his / her ear, a step of switching the voice during a call to a display message and outputting it,
A message sending program to execute.

Images