JP2008005397A - Mobile terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile terminal device, wherein even when users are located at placed away from each other, a user can teach an operating method to an opposite user through a simple method. <P>SOLUTION: A mobile terminal device 1 generates script data SD from key pressing information indicating operation contents of a user and picture display information indicating display contents to be displayed on a display unit of the mobile terminal device 1 in response to the operation contents of the user, and transmits the script data SD to another mobile terminal device 2 by electronic mail or the like. The mobile terminal device 2 displays at least either the key pressing information or the picture display information contained in the script data SD transmitted from the mobile terminal device 1. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a portable terminal device carried by a user, for example.

  In recent years, portable terminal devices such as mobile phones, PHS (Personal Handyphone System), and PDA (Personal Digital Assistants) have become widespread, and communication and communication are possible regardless of location. By the way, it is one of the greatest advantages that these portable terminal devices are portable. In other words, there is a possibility that the portable terminal device may be lost or stolen. That is.

The following Patent Document 1 focuses on the fact that many mobile phones have an e-mail function, and receives and receives e-mails sent from any of mobile phones, general phones, and computers. There is disclosed a mobile phone that identifies contents described in an e-mail and performs control according to the contents. Here, the control performed by the mobile phone that has received the e-mail is, for example, setting / cancellation of various functions, registration of memory dial information, or reading of information of the memory dial.
JP 2001-8270 A

  By the way, recent portable terminal devices are multi-functionalized for the purpose of improving convenience and the like, and special operations are required when using various functions. For this reason, when the user wants to use a certain function, if he / she does not know the operation content, refer to the manual to learn the operation content, or to another user who owns a mobile terminal device of the same model as the mobile terminal device You need to be taught the operation.

  When the user who remembers the operation of the mobile terminal device and the user who does not remember the operation are in a place where they can talk to each other, the user who does not remember the operation actually tells the user who remembers the operation The operation can be remembered by having it operated. On the other hand, when a user who remembers the operation of the mobile terminal device and a user who does not remember the operation are remote, the user who does not remember the operation is instructed by a call or describes the operation procedure. The only way to get an email is However, when the operation method is taught by the above method, there is often a case where communication between the two users cannot be sufficiently performed.

  By using the technique disclosed in Patent Document 1 above, by sending an e-mail in which a control command is described, a user who remembers the operation of the mobile terminal device and a user who does not remember the operation are separated. Even if the user is in a location, a user who does not remember the operation can temporarily use the function. However, when the user tries to use the function again, it is necessary to have the e-mail sent again, which is inconvenient for both users.

  The present invention has been made in view of the above circumstances, and provides a portable terminal device that can teach an operation method to a partner user in a simple manner even when the users are in a remote place. With the goal.

In order to solve the above problems, a mobile terminal device according to the present invention is a mobile terminal device including an operation unit operated by a user and a display unit that displays information for the user. A data generation unit that generates operation data including first information indicating the second information indicating the display content of the display unit according to the operation content of the operation unit, and the operation generated by the data generation unit And a transmission unit that transmits data to another portable terminal device.
Here, in the mobile terminal device of the present invention, it is preferable that the operation data is such that the first information and the second information are associated in time series.
Moreover, the portable terminal device of the present invention includes a data receiving unit that receives the operation data, and a display that displays at least one of the first information and the second information included in the operation data received by the data receiving unit. And a control means.
In the mobile terminal device of the present invention, the operation unit includes a plurality of operation keys and a light-emitting unit that emits each of the operation keys, and the display control unit is configured to emit the light emission based on the first information. The second information is displayed by causing the portion to emit light.
In the mobile terminal device of the present invention, it is preferable that a time interval at which the display control unit displays the first information and the second information is variable.
Furthermore, the portable terminal device of the present invention is characterized by including a control unit that executes an operation according to the first information included in the operation data received by the data receiving unit.

According to the present invention, the operation data including the first information indicating the operation content of the mobile terminal device by the user and the second information indicating the display content displayed on the display unit of the mobile terminal device according to the user operation content. Is generated. If this data is reproduced (displayed) on another portable terminal device, there is an effect that the operation method can be taught to the other user in a simple manner even when the users are away from each other.
In addition, although the operation method can be instructed by telephone call or e-mail, the use of the present invention has the effect that communication between the two can be sufficiently performed without generating unnecessary call charges and communication charges. is there.
In addition, since the time interval for displaying the first information and the second information is variable, the operation method can be learned according to the pace of the user.
Further, in addition to displaying the first information and the second information included in the operation data, an operation according to the first information can be executed, so that the user performs a special operation on the portable terminal device possessed by the user. It is also possible to automatically carry out the contents operated by the partner user with the portable terminal device that the user owns.

  Hereinafter, a mobile terminal device according to an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing a schematic configuration of a communication system in which a mobile terminal device according to an embodiment of the present invention is used. As shown in FIG. 1, the communication system includes portable terminal devices 1 to 3 and a network N according to an embodiment of the present invention. A plurality of base stations (not shown) are connected to the network N, and the mobile terminal devices 1 to 3 perform wireless communication with the base station, whereby the mobile terminal devices 1 to 3 via the network N are connected. Communication between them.

  In addition, the mobile terminal devices 1 to 3 of the present embodiment can transmit and receive script data SD (operation data) with other mobile terminal devices via the network N or without the network N. . Here, the script data SD includes key press information (first information) indicating the operation content of the mobile terminal device by the user, and screen display information (display information on the display unit in the mobile terminal device corresponding to the user operation content). Second information). In the following description, it is assumed that the mobile terminal devices 1 and 2 are of the same model, and the case where the script data SD is transmitted from the mobile terminal device 1 to the mobile terminal device 2 will be described as an example.

  FIG. 2 is a block diagram illustrating a schematic configuration of the mobile terminal devices 1 and 2. As shown in FIG. 2, the mobile terminal devices 1 and 2 include a wireless communication unit 11, a communication unit 12, an operation unit 13, a display unit 14, a voice input / output unit 15, an image capturing unit 16, a control unit 17, and a ROM (Read Only). Memory 18 and RAM (Random Access Memory) 19 are included.

  The wireless communication unit 11 performs wireless communication with a base station (not shown) using a predetermined communication method such as a CDMA method under the control of the control unit 17. The communication unit 12 is under the control of the control unit 17, for example, another mobile terminal device located at a distance of about several tens to a hundred meters (for example, when the mobile terminal device shown in FIG. Communicates with the portable terminal device 2) by transmitting and receiving local wireless communication. As a communication standard of the communication unit 12, for example, Bluetooth (registered trademark) communication can be used.

  The operation unit 13 includes a dial key, a function key, a side key, a power key, and the like, and outputs operation contents of these keys by a user to the control unit 17 as an operation signal. Each of the keys provided on the operation unit 13 is provided with a light emitting element (light emitting unit) such as an LED (Light Emitting Diode), for example, so that the key operated by the user emits light. ing.

  The display unit 14 is, for example, a liquid crystal display or an organic EL display, and displays various messages, telephone numbers, images, and the like based on display control signals input from the control unit 17. The voice input / output unit 15 includes a speaker and a microphone. The voice input / output unit 15 outputs voice and music to the outside through the speaker based on the voice signal input from the control unit 17, while the voice input through the microphone is voiced. It converts into a signal and outputs it to the control part 17. The image capturing unit 16 includes an image sensor such as a CCD (Charge Coupled Device) camera, and outputs captured image data to the control unit 17 under the control of the control unit 17. Note that the image capturing unit 16 can use either a still image or a moving image that can be captured, or a still image or a moving image that can be captured.

  The control unit 17 is based on a predetermined control program stored in advance in the ROM 18, an operation signal input from the operation unit 13, a communication state of the wireless communication unit 11 or a communication state of the communication unit 12, and the like. , 2 is controlled. In addition, the control unit 17 realizes the data generation unit 21 and the display control unit 22 by executing the control program. Here, the data generation unit 21 generates the script data SD described above, and the display control unit 22 reproduces (displays) the script data SD.

  The ROM 18 is a flash memory, for example, and stores a control program executed by the control unit 17 and various data. Further, an address book including personal information such as a telephone number and an e-mail address for each user is stored. In addition, shooting data shot by the image shooting unit 16 is also stored. The RAM 17 is a working area used for control operations by the control unit 17.

  Next, the script data SD will be described. FIG. 3 is a diagram illustrating an example of the script data SD. As described above, the script data SD is data including pressing information KI indicating the operation content of the mobile terminal device by the user and screen display information DI indicating the display content of the display unit in the mobile terminal device according to the user operation content. It is. FIG. 3A is a diagram showing an example of the pressing information KI, in which key information indicating a key operated by the user corresponds to a file name of display screen data on the display unit 14 when the key is operated. Text data that is attached and enumerated in time series.

  For example, in the first line, key information “Left” indicating that the “left key” has been operated, and a file name “0001.jpg” indicating display screen data when the “left key” has been operated. Are associated with each other. In the second row, key information “Center” indicating that the “center key” arranged at the center of the up, down, left, and right keys is operated, and a display screen when the “center key” is operated. The file name “0002.jpg” indicating the data is associated.

  FIG. 3B is a diagram illustrating an example of the screen display information DI, and includes a plurality of image data indicating the contents of the display screen displayed on the display unit 14. The data format of the image data is, for example, a JPEG (Joint Photographic Experts Group) format, and is stored in a preset storage location (for example, a data folder). Note that the file name of each image data is uniquely determined, and the file name of each image data is recorded in the pressing information KI shown in FIG.

  FIG. 3C is a diagram showing an example of the script data SD, and includes pressing information KI and screen display information DI as shown. As described above, the pressing information KI is data in text format, and the screen display information DI is image data, but the script data SD is an integration of these, and can be data in any format. it can. FIG. 3B shows an example in which the pressing information KI is stored in the head portion of the script data SD, and the screen display information DI is subsequently stored. Optional.

  Next, a procedure when the user of the mobile terminal device 1 teaches the operation method to the user of the mobile terminal device 2 will be described. It is assumed that the user of the mobile terminal device 1 and the user of the mobile terminal device 2 are in remote locations and cannot talk to each other. For example, when the user wants to use a certain function in the mobile terminal device 2 and does not know how to use the function, call the user who owns the mobile terminal device 1 of the same model, or Send an e-mail indicating that you want to use a function. When the user of the mobile terminal device 1 knows how to use the function, the script data SD is created by performing the operation shown in FIG.

  FIG. 4 is a flowchart showing an example of a procedure for creating the script data SD. When the user of the mobile terminal device 1 presses a side key provided on the mobile terminal device 1, the control unit 17 displays a screen for confirming whether or not to start an operation recording mode for recording the operation content of the user (for example, “YES” and “NO” display on the pop-up screen) are displayed on the display unit 14 (step S11). When this display is performed, the control unit 17 determines whether or not to start the operation recording mode by the operation of the operation unit 13 by the user (step S12). When the user selects “NO”, the control unit 17 ends the series of processes. On the other hand, when the user operates the operation unit 13 and selects “YES”, the control unit 17 starts the operation recording mode. When the operation recording mode is started, for example, it is desirable to display an icon indicating that the operation recording mode is in a part of the display unit 14.

  When the operation recording mode is started, the control unit 17 determines whether or not there is an operation signal output when the operation unit 13 is operated by the user (step S13). If the determination result is “NO”, the determination in step S13 is repeated. On the other hand, when the operation unit 13 is operated by the user and an operation signal is output, the control unit 17 determines whether or not the operation signal is output by operating the recording end key ( Step S14). For example, a side key can be used as the recording end key. If the determination result is “NO”, the control unit 17 sets the pressed key number (unique key number assigned in advance to each key) in the pressed information KI (step S15).

  Next, the control part 17 acquires the screen display content (image data) currently displayed on the display part 14, when a key is operated by the user (step S16). The format of the image data is, for example, bitmap format data (BMP data). When this image data is acquired, the control unit 17 performs a process of converting the format of the image data in order to reduce the amount of data (step S17). For example, BMP format image data is converted to JPEG format image data. The control unit 17 stores the JPEG format image data obtained by the conversion in a preset storage location (for example, a data folder), and the file name corresponds to the pressed key number set in step S15. Then, the pressed information KI is set (step S18).

  When the above process is completed, the process returns to step S13, and it is determined whether or not the operation unit 13 has been operated by the user. When it is determined that an operation has been performed (when the determination result of step S13 is “YES”), it is determined whether or not the operated key is a recording end key (step S14). Thereafter, the process from step S13 to step S18 is repeated until the determination result of step S14 becomes “YES” by pressing the recording end key by the user, and the pressing key number and the file name are set in the pressing information KI. In addition, the screen display content is saved.

  When the recording end key is operated by the user, the determination result in step S14 is “YES”, and the operation recording mode ends. Note that when the recording end key is operated, the operation recording mode is not immediately terminated, but a screen display for confirming whether or not to terminate the operation recording mode (for example, “YES”, “NO” on a pop-up screen) "Display" is displayed on the display unit 14, and the operation recording mode is desirably ended when the user performs an operation (an operation for selecting "YES") to end the operation recording mode.

  When the operation recording mode ends, the data generation unit 21 of the control unit 17 creates the script data SD from the press information KI and the screen display information DI recorded by the processes of steps S15 to S18 (step S19). When the script data SD is created, the control unit 17 sends the script data SD as an attachment to the e-mail (step S20). Note that the transmission destination of the script data SD is designated by the user when the electronic mail is transmitted.

  Script data SD including key press information indicating the operation content of the mobile terminal device 1 by the user and screen display information indicating the display content of the display unit 14 in the mobile terminal device 1 according to the user operation content by the above processing. Is transmitted to the mobile terminal device 2. Here, a case where the script data SD is transmitted by e-mail is taken as an example, but means for transmitting the script data SD is not limited to e-mail, and can be performed via the communication unit 12, for example. is there.

  FIG. 5 is a flowchart showing an example of the reproduction process of the script data SD. When the e-mail attached with the script data SD transmitted from the mobile terminal device 1 is received, the mobile terminal device 2 stores it in a preset storage location (for example, a data folder) (step S21). Then, when the user of the mobile terminal device 2 operates the operation unit 13 to place the cursor on the script data SD attached to the received e-mail and press the center key, the script data SD is executed ( Step S22).

  When the script data SD is executed, first, a timer value for changing the screen transition speed is set on the display unit 14 (step S23). This timer value is a value that defines a time interval for displaying the script data SD on the portable terminal device 2. For example, when the timer value is decreased, the switching time of the script data SD is shortened, and when the timer value is increased, the script data SD is changed. Switching time becomes longer. Note that the processing of step S23 can be omitted by setting a timer value in advance.

  Next, the control unit 17 of the mobile terminal device 2 performs a screen display (for example, a pop-up selection screen display) for selecting whether to perform “normal execution” or “navigation execution”. Here, “normal execution” is an execution mode in which the portable terminal device 2 is automatically operated according to the script data SD, and “navigation execution” is a script on the display unit 14 of the portable terminal device 2. This is an execution mode that only displays the data SD. That is, when “normal execution” is selected, an operation similar to the operation performed on the mobile terminal device 1 is automatically performed on the mobile terminal device 2. On the other hand, when “navi execution” is selected, a display similar to the display content of the display unit 13 when an operation is performed on the mobile terminal device 1 is displayed on the display unit 13 of the mobile terminal device 2.

  When the selection screen is displayed, the control unit 17 of the mobile terminal device 2 determines whether or not “execute navigation” is selected (step S24). If the determination result is “YES”, the display control unit 22 provided in the control unit 17 of the mobile terminal device 2 performs display processing according to the script data SD (step S25). FIG. 6 is a flowchart illustrating display processing according to the script data SD performed in the mobile terminal device 2.

  As shown in FIG. 6, when the display process is started, the display control unit 22 acquires a script on the Nth line (N is an integer of 1 or more) stored in the press information KI of the script data SD ( Step S31). Then, the pressed key number is acquired from the acquired script (step S32). When the pressed key number is acquired, the display control unit 22 displays the key indicated by the pressed key number by causing a light emitting element (not shown) provided along with the key indicated by the acquired pressed key number to emit light. (Step S33).

  Next, the display control unit 22 acquires the file name of the screen display information DI (the file name of the image data in JPEG format) from the script acquired in step S31 (step S34), and the script data SD stored in the data folder. The image data of the file name is acquired from (Step S35). Then, this image data is decoded (for example, JPEG format image data is converted into BMP format image data) and displayed on the display unit 14 (step S36). Thereby, the key operated by the user of the mobile terminal device 1 and the contents of the screen display when the key is operated are displayed on the mobile terminal device 2. The processes in steps S31 to S36 in FIG. 6 are performed for the number of lines of the pressing information KI included in the script data SD.

  When the process of step S25 is completed, and when the normal execution is selected and the determination result of step S24 is “NO”, the control unit 17 of the mobile terminal device 2 has selected “normal execution”. It is determined whether or not (step S26). When the determination result is “YES”, the control unit 17 of the mobile terminal device 2 executes the script data SD along the script data SD (step S27). Thereby, the same operation as the operation performed on the mobile terminal device 1 by the user of the mobile terminal device 1 is automatically performed on the mobile terminal device 2. In addition, when the process of step S27 is complete | finished and when the judgment result of step S26 is "NO", a series of processes are complete | finished.

  As described above, in the present embodiment, the key press information KI indicating the operation content of the mobile terminal device 1 by the user and the screen display information indicating the display content of the display unit 14 in the mobile terminal device 1 according to the user operation content. Since the script data SD including DI is transmitted to the mobile terminal device 2 and the content is displayed on the mobile terminal device 2, even if the users are away from each other, it is easy for the other user to use. Can teach how to operate. In addition, although the operation method can be instructed by telephone call or e-mail, the use of the present embodiment makes it possible to sufficiently communicate with each other without generating unnecessary call charges and communication charges.

  The mobile terminal device according to the embodiment of the present invention has been described above, but the present invention is not limited to the above-described embodiment, and can be freely changed within the scope of the present invention. For example, in the embodiment described above, the key indicated by the pressed key number is displayed by causing the light emitting element provided along with the key to emit light. However, any display method can be used for displaying the keys. For example, the keys provided on the operation unit 13 are displayed on the display unit 14 in a small size (for example, displayed on the lower half of the screen or the lower third of the screen), and the key display corresponding to the pressed key number is changed. The operated keys may be displayed.

  Moreover, in the said embodiment, the case where the key press information KI and the screen display information DI which are contained in the script data SD transmitted from the portable terminal device 1 were displayed on the portable terminal device 2 was mentioned as an example. However, only the screen display information DI may be displayed on the mobile terminal device 2 or only the key press information KI may be displayed. The present invention can be applied to any terminal device including an operation unit operated by a user such as a mobile phone, a PHS, and a PDA and a display unit that performs display for the user.

It is a figure which shows schematic structure of the communication system with which the portable terminal device by one Embodiment of this invention is used. It is a block diagram which shows schematic structure of the portable terminal devices 1 and 2. FIG. It is a figure which shows an example of the script data SD. It is a flowchart which shows an example of the production procedure of script data SD. It is a flowchart which shows an example of the reproduction | regeneration processing of script data SD. 10 is a flowchart showing display processing according to script data SD performed in the mobile terminal device 2.

Explanation of symbols

1, 2, 3 Mobile terminal device 11 Wireless communication unit 12 Communication unit 13 Operation unit 14 Display unit 17 Control unit 22 Display control unit DI Screen display information KI key press information SD script data

Claims (6)

In a mobile terminal device comprising an operation unit operated by a user and a display unit that displays information for the user,
A data generation unit that generates operation data including first information indicating the operation content of the operation unit and second information indicating the display content of the display unit according to the operation content of the operation unit;
A mobile terminal device comprising: a transmission unit that transmits the operation data generated by the data generation unit to another mobile terminal device.   The portable terminal device according to claim 1, wherein the operation data includes the first information and the second information associated with each other in time series. A data receiving unit for receiving the operation data;
The mobile terminal according to claim 1, further comprising: a display control unit configured to display at least one of the first information and the second information included in the operation data received by the data receiving unit. apparatus. The operation unit includes a plurality of operation keys and a light emitting unit that emits light to each of the operation keys.
4. The portable terminal device according to claim 3, wherein the display control unit displays the second information by causing the light emitting unit to emit light based on the first information.   The portable terminal device according to claim 3 or 4, wherein the display control means has a variable time interval for displaying the first information and the second information. The mobile terminal according to any one of claims 3 to 5, further comprising a control unit that executes an operation according to the first information included in the operation data received by the data receiving unit. apparatus.

Images