JP2002312115A - Mobile terminal device - Google Patents

Abstract

(57) [Summary] [Problem] To provide a technology capable of reducing the burden of operating a keyboard or the like, and naturally inputting and reproducing characters and the like beautifully, so that a user can easily use an e-mail or the like. A mobile terminal device that can be realized. Kind Code: A1 A portable terminal device according to the present invention includes a detecting means for detecting coordinates of a pen tip for writing contents written by a pen on a writing medium, and sampling the coordinates of the detected pen tip every predetermined unit time. Sampling means for generating handwriting data and storing the same for each writing medium; display means for reproducing and displaying handwriting contents based on the handwriting data; and transmitting / receiving means for transmitting / receiving handwriting data. The sampling means generates handwriting data by deleting redundant points. The display means adjusts and displays the characteristics of the reproduced handwriting between the two points included in the handwriting data, based on at least the number of deleted points between the points.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal device having a function of transmitting and receiving information via a communication network, and more particularly to a function of transmitting and receiving information relating to writing contents written on a writing medium such as paper with a pen. The present invention relates to a mobile terminal device provided with:

[0002]

2. Description of the Related Art With the explosive spread of the Internet,
Electronic mail and the like have been widely used as communication tools. In recent years, electronic mails and the like are often transmitted and received via a wireless communication network using a mobile phone, a PDA (Personal Digital (Data) Assistants), or the like.

When sending and receiving e-mails and the like using a mobile phone or a PDA, the following are conceivable as input forms of characters and the like.

[0004] The first is a mode in which characters and the like are input using a keyboard in the same manner as a normal personal computer or the like. PDA
In some cases, a keyboard is provided as hardware, but in many cases, it is implemented on software by software so as not to impair portability. In addition, in a mobile phone and the like, since the hardware buttons that can be used are limited, a method of inputting characters by skillfully combining the hardware buttons is adopted.

[0005] The second is a form in which characters and the like are handwritten using a liquid crystal tablet or the like. In such a form, a method in which handwritten input is directly handled as an image,
There is a method of performing character recognition and converting to a text code.

[0006]

When the first mode is adopted, the user needs to learn keyboard and button operations. However, it is not always easy for a user who is not used to operating a computer to operate a keyboard.Especially for elderly people who have few opportunities to learn how to operate a computer, they can operate the keyboard to send e-mail and the like. Sending and receiving was a very difficult task.

[0007] In the case of adopting the second mode, it is only necessary to input by handwriting, so that the operation load of a keyboard or the like is reduced. However, when performing handwriting input on a liquid crystal tablet or the like, a shift based on parallax or the like occurs between a pen tip and a handwriting displayed on the tablet, so that the user often feels unnatural when inputting. Further, it is difficult to smoothly move the pen on the surface of the liquid crystal tablet in terms of material, and it is extremely difficult to beautifully write characters and the like.

Accordingly, the present invention provides a technique capable of reducing the operation load on a keyboard and the like, and also of enabling a user to input and reproduce characters and the like with a good writing feel naturally and beautifully. It is an object of the present invention to realize a portable terminal device capable of performing the above.

[0009]

According to the present invention, there is provided a portable terminal device, comprising: detecting means for detecting the coordinates of a pen tip for writing contents written on a writing medium by a pen; The handwriting data is generated by sampling the preceding coordinates (hereinafter, the sampled coordinates are referred to as "points"), and a sampling means for storing for each writing medium, and the handwriting contents are reproduced and displayed based on the handwriting data. And display means for transmitting and receiving the handwriting data.

The sampling means removes redundant points and deletes the remaining points (hereinafter, the deleted points are referred to as “deleted points” and the remaining points are referred to as “remaining points”).
Call. ), It is desirable to generate handwriting data.

[0011] The display means adjusts the characteristic of a reproduced handwriting between the remaining points based on at least the number of deleted points between the two remaining points included in the handwriting data. It is desirable to display.

Preferably, the detecting means is further configured to detect the type of pen, and the display means adjusts and displays the characteristics of the reproduced handwriting in accordance with the detected type of pen.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS (First Embodiment) Next, a preferred embodiment of the present invention will be described with reference to the drawings.
FIG. 1 shows a block diagram of the portable terminal device 100 of the present embodiment. As shown in FIG. 1, the portable terminal device 100 includes:
CPU 1 that controls the overall operation of the portable terminal device 100
1. ROM 1 storing a program for CPU 11
2. RAM 13 used as a work area for storing information on sampled points, handwriting data, received data, etc., a sensor board 14 for detecting coordinates of a pen point, a display for displaying handwritten input handwritten contents, and the like. Means 15, an input means 16 for receiving an instruction input from a user, a communication interface means 17 for performing transmission and reception with another portable terminal device or the like via a wireless communication network.
And so on. The ROM 12 and the RAM 13 may be of a removable card type.

FIG. 2 is an external perspective view of the portable terminal device 100. As shown in FIG. 2, the portable terminal device 100 has a two-fold board-like shape, and a writing medium such as paper can be placed on the sensor board 14. Here, a configuration in which the writing medium is fixed by sandwiching the clip so that the writing medium is stably placed,
It is desirable to provide a configuration in which an adhesive portion is provided on the back surface (the surface in contact with the sensor board 14) of the writing medium. The bonding portion,
For example, it can be constituted by applying an adhesive having an adhesive ability to such an extent that it can be repeatedly attached and detached. Such an adhesive is used for, for example, Post-It (registered trademark).

The writing medium may be plain paper, and if necessary, paper of a predetermined format such as manuscript paper or staff can be used.

The user can use the pen 101 to write characters and the like on a writing medium placed on the sensor board 14. Here, the pen 101 has a normal writing function and a function of emitting an electromagnetic field.
The power for driving the pen 101 may be configured to be supplied from the portable terminal device (see FIG. 2).

The sensor board 14 has a function of detecting the electric field intensity of the electromagnetic wave emitted from the pen 101.
When the pen 101 approaches the sensor board 14, the sensor board 14 detects the position of the pen tip by detecting the electromagnetic field from the pen 101. In this case, for example, pen 1
It is also conceivable to configure so that sensing is started on the condition that writing is performed on the writing medium using 01 (the pen 101 contacts the writing medium).

The position of the pen tip is specified as a coordinate value on a two-dimensional coordinate system with the reference position of the sensor board 14 as the origin. The sensor board 14 samples the coordinate values of the pen tip at a predetermined timing (hereinafter, the sampled coordinate values are referred to as “points”) and stores them in the RAM 13 as time-series data. The sampling interval is, for example, 1 to detect fast movement of the pen 101.
It is set at a constant interval of 00 times / sec or more.

The ROM 12 stores programs for implementing various functions described below. This program may be supplied from an external storage medium. In this case, the ROM 12 stores only the initial program.

The RAM 13 is used as a work area of the CPU 11. When the program is configured to be executable by being transferred, it is also used as a program area. The work area includes, for example, an area for storing points sampled by the sensor board 14, an area for storing handwriting data generated based on the points, and the like. Handwriting data is stored as one file for one writing medium, and a plurality of files can be stored for a plurality of writing media.
Note that a part of the RAM 102 (for example, an area for storing handwriting data) may be configured using a flash memory or the like that retains the stored contents even when the power is turned off.

The CPU 11 executes various programs (calls, e-mail transmission / reception, schedule management, ToDo list management, dictionary, Internet connection / Web browsing, etc.) provided by the ordinary portable terminal by executing the program written in the ROM 12. And the overall operation of the mobile terminal device is controlled. When configured to transfer a program, the CPU 11 first executes the initial program with reference to the ROM 12, and then reads the program file stored in the external storage medium to read the program file from the RAM.
13 so as to be executable.

The display means 15 is controlled by the CPU 11
Based on data stored in the ROM 12 and the RAM 13, characters, images, icons, and the like are displayed. Display means 15
For example, a liquid crystal display can be used. Further, a touch panel may be used.

The input means 16 is controlled by the CPU 11
When a user presses a button, touches a touch panel, or the like, a corresponding operation signal is output to the CPU 11.

The communication interface means 17 includes a communication antenna and the like, and under the control of the CPU 11, for example, via a wireless communication network, an external computer device or another portable terminal device according to the present invention, electronic mail information, handwriting. It is configured to be able to transmit and receive data and the like. Note that the communication interface means 10 may be configured to be detachable, and such a type may be, for example, a data card type PHS manufactured by NTT DoCoMo.
"P-in Comp @ ct"
A GSM communication module of Palm is known.

(Operation Method) The operation method of the portable terminal device of the present invention will be described below with reference to the flowchart shown in FIG. Each step can be executed by arbitrarily changing the order within a range that does not cause inconsistency in the processing contents.

When the user turns on the power supply of the portable terminal device, the CPU 11 executes an initial setting process (S11).
100). Here, the power may be turned on by opening the folded state, and turned off by closing.

As the initial setting process, for example, a process for shifting the input means 16 to a standby state in which an input from a user (such as pressing a button) can be accepted, and a display means 1
For example, a process of displaying an initial screen (for example, a menu screen or the like) on the screen 5 can be considered. The information on the initial screen is R
It is assumed that it is stored in the OM 12.

The user refers to the initial screen and selects a function by pressing a predetermined button or the like (S101). The functions that can be selected by the user include various functions provided by ordinary mobile terminals (call, e-mail transmission / reception, schedule management,
ToDo list management, dictionary, Internet connection / We
b browsing, etc.) can be considered and can be determined according to the design, but it is necessary that at least the handwriting input function be configured to be able to be selected and executed.

Icons (functions) corresponding to each function are displayed on the display means 15, and the user can select an icon (function) by operating a button or a trackball, or by directly touching the touch panel. It may be configured as follows.

The input means 16 outputs an operation signal corresponding to the operation of the user to the CPU 11, and the CPU 11 executes a process corresponding to the operation signal (that is, reads and executes a program stored in the ROM 12) (S102). ).
Thereby, the function selected by the user is realized.

Hereinafter, the case where the user selects the handwriting input function will be described.

The user further presses a predetermined button or the like,
The purpose of use is selected (S103). The information of the selected purpose of use is transmitted to the CPU 11 via the input means 16 and stored in the RAM 13. Possible uses include e-mail, chat, and handwritten notes. Thereafter, the information input by handwriting is stored after being classified for each purpose of use.

The user sets a writing medium such as paper on the sensor board 14. At this time, the writing medium is stably placed by the action of the clip or the adhesive portion.
The writing medium to be set may be a stack of a plurality of sheets.

The user writes desired contents on a writing medium using the pen 101 (S104). The user may write in any combination of characters, figures, symbols, and the like. Depending on the design, a function for imposing characters and the like using a software keyboard and a function for editing written contents (erasing, color conversion, setting of ruled lines and line widths, character decoration, etc.) may be provided. When an editing function is provided, an area where a color, a line width, and the like can be selected is provided on the sensor board (see FIG. 2), and the editing function can be selected and executed by selecting and touching the area with the pen 101. It is also conceivable to configure it.

In this embodiment, the user does not write on a liquid crystal tablet using a stylus pen as in the prior art, but writes on a writing medium such as paper. Can write with precision and stability. In addition, there is an advantage that the writing medium can be used as evidence in various situations because the writing medium is physically left at hand. Furthermore, since the written medium already described can be added to or modified on the sensor board of the portable terminal device again, not only the display on the screen but also the written contents on the written medium can be directly checked. While doing so, it is possible to make additions and corrections.

Here, as described above, in the present embodiment, it is assumed that one handwriting data file is associated and managed for each writing medium. Therefore, when the user finishes writing on one writing medium,
It is necessary to notify the portable terminal device of this. In order to perform such notification, it is desirable to set, for example, an end (or next page) button, an icon, and the like.

The sensor board 14 detects the electromagnetic field emitted from the pen tip of the pen 101 and identifies the position of the pen tip (S105). The position of the pen tip is defined by a predetermined reference position (for example, an upper left corner position of the sensor board 14) as an origin.
It is specified by the coordinate values (X, Y) of the dimensional coordinate system.

Here, the sensor board 14 may be configured to shift to a start-up state (sensing enabled state) upon power-on in S100.
The configuration may be such that ON / OFF of the activated state is automatically switched according to the strength of the electromagnetic field from the pen tip.

By preparing a plurality of types of pens 101 and emitting electromagnetic waves having different frequencies, the sensor board 14 may identify the type of the pens 101 based on the difference in frequency. . In this case, the characteristics of the reproduced handwriting displayed according to the type of the pen 101 are associated with the characteristics of the reproduced handwriting (for example, the color of the line, the line type (dotted line, broken line, etc.), the brush type, etc.). It is possible to realize a flexible input form, such as making them different.

The sensor board 14 samples the coordinate value of the pen tip at a predetermined timing (for example, 100 times / sec) to extract a point, and time-series data (X, Y, sampling time) of the coordinate value of the point. Is stored in the RAM 13 (S106). Note that the sampling time may be stored in units of strokes (a series of points from pen down to pen up) instead of in units of points.

The CPU 11 deletes redundant points based on the time series data of the coordinate values stored in the RAM 13 based on a predetermined thinning algorithm, and removes the remaining points that have not been deleted (hereinafter referred to as “remaining points”). Call.)
Then, handwriting data is generated based on the number of deleted points and stored in the RAM 13 (S107). The handwriting data includes, for each residual point (coordinate value X, coordinate value Y, the number of points deleted between the immediately preceding residual point,
(Sampling time). If the type of the pen 101 is configured to be identifiable, the handwriting data further includes information indicating the pen type.

As the thinning algorithm, for example, the following method can be considered (see FIG. 4).

Now, the time series data (X (t), Y (t))
(T is a sampling number).

First, 0 is set to the point of interest variable p (S200).

The maximum value of a (a> 1) that satisfies the following condition is obtained (S201). Here, T is a parameter indicating the degree of thinning, and as T increases, points to be deleted (thinned out) increase.

Condition: (Y (p + a) -Y (p)) / (X
(P + a) -X (p)) <(Y (p + b) -Y (p))
/ (X (p + b) -X (p))-T for any b where
1 ≦ b <a If there is a maximum value of “a” that satisfies the above condition, the points specified by the sampling numbers t = p + 1 to t = a−1 are registered as deletion targets, and p = a is set as S201.
Return to (S202). If there is no maximum value of a that satisfies the above condition, the thinning process ends.

Based on the handwriting data stored in the RAM 13, the CPU 11 reproduces the written contents written on the writing medium and causes the display means 15 to display the reproduced written contents (S108). As a display method, the written content of one page (one file) is reproduced in the RAM 13 in advance, and
A method of displaying the pages in a lump and a method of using the sampling time included in the handwriting data to reproduce and display the pages in the order written by the writer can be considered. When the latter method is used, the process of writing by the scribe is reproduced, so that not only the written contents but also the psychological state at the time of writing can be reproduced together.

If a paper of a predetermined format is used as the writing medium, the format may be displayed on the display means 15 in advance.

Here, based on the information included in the handwriting data (the number of points deleted from the immediately preceding residual point) and the distance between the residual points which can be calculated from the coordinates (X, Y) of the residual point. , Adjust the characteristics of handwriting reproduction of the two remaining points in time series,
You may comprise so that it may display on the display means 15.

As the adjustment method, for example, the following method can be considered.

First, the coordinate values (X
The distance D between the remaining points is calculated based on (k), Y (k), (X (k + 1), Y (k + 1), where k
Is a number indicating the chronological order of the remaining points.

Next, a parameter V = (the number of points deleted between the distance D / kth residual point and the (k + 1) th residual point) is obtained. The line width characteristic of the reproduced handwriting is adjusted according to the size of V. That is, the larger the V, the smaller the line width is reproduced, and the smaller the V, the larger the line width is reproduced.

It should be noted that a configuration may be adopted in which a difference in sampling time is used instead of the number of deleted points.

The user confirms the handwritten content reproduced on the display means 15, and sets a destination when an e-mail or chat is selected for the purpose of use, and presses the send button.
When a handwritten memo is selected, an instruction such as transmission is input by pressing a registration button or the like (S109). It is conceivable that a destination such as an e-mail or chat is set using a software keyboard.

When the CPU 11 receives the operation signal corresponding to the transmission button from the input unit 15, the CPU 11 writes or attaches the handwriting data to the electronic mail via the communication interface unit 17 (S110). The handwriting data over a plurality of pages may be transmitted at the same time.

In the present embodiment, since the handwritten data is generated by thinning out the redundant points instead of using the sampled points as they are, the handwritten data can be made compact. Furthermore, by adjusting and reproducing the characteristic of the line width according to the number of deleted points, a more natural and beautiful handwriting can be reproduced.

(Others) The present invention is not limited to the above embodiment, but can be applied in various modifications. For example, instead of S103 to S107 of the above-described embodiment, handwriting data (including data described and attached to a received e-mail) already stored in the RAM 13 is input in response to a user input (for example, a file number or a file number). It may be configured to have a function of searching and selecting (using the sampling time or the like as a key), and displaying / editing the selected handwriting data.

Further, for example, a configuration may be provided in which handwriting data registered as a handwritten memo is selected, and this is described or attached to an electronic mail and transmitted.

Further, for example, a configuration may be provided in which a function of directly transmitting and receiving handwriting contents displayed on the display means 15 as image data is provided.

For example, as a configuration for detecting the coordinates of the pen tip, the sensor board 14 generates an electromagnetic field, detects a change in the electromagnetic field due to the proximity of the pen, and identifies the position of the pen tip. Many pressure sensors are arranged at the lower part of the surface of the
A configuration for identifying the position of the pen tip may be used.

[0061]

According to the structure of the present invention, handwriting data is generated based on the position of a pen tip for handwritten contents handwritten on a writing medium, and the attributes of the handwriting to be reproduced are adjusted based on the data. Is reproduced and displayed, characters and the like can be input and reproduced naturally and beautifully without imposing a burden on the user for operating the keyboard and the like. In addition, it is possible to realize a portable terminal device that can easily transmit and receive the handwriting content using electronic mail or the like.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a portable terminal device of the present invention.

FIG. 2 is an external perspective view of the portable terminal device of the present invention.

FIG. 3 is a flowchart showing a method of operating the portable terminal device of the present invention.

FIG. 4 is a flowchart for explaining a thinning algorithm.

[Explanation of symbols]

 Reference Signs List 11 CPU 12 ROM 13 RAM 14 Sensor board 15 Display means 16 Input means 17 Communication interface means 100 Portable terminal device 101 Pen

Continuation of the front page F term (reference) 5B019 DA07 GA10 5B068 CC12 CC19 DE12 5K027 AA11 BB01 EE00 FF22 HH26

Claims (4)

[Claims] 1. A detecting means for detecting the coordinates of a pen tip for writing contents written by a pen on a writing medium, and sampling the coordinates of the detected pen tip at predetermined unit times to generate handwriting data. (Hereinafter, the sampled coordinates will be referred to as "points."), Sampling means for storing for each writing medium, display means for reproducing and displaying handwritten contents based on the handwritten data, and transmitting / receiving means for transmitting / receiving the handwritten data. A portable terminal device comprising: 2. The sampling means generates handwriting data based on points left after redundant points have been deleted (hereinafter, the deleted points are referred to as “deleted points” and the remaining points are referred to as “remaining points”). The portable terminal device according to claim 1, wherein 3. The display device according to claim 1, wherein said display means determines, based on at least the number of deleted points between the two remaining points included in the handwriting data, a characteristic of a reproduced handwriting between the remaining points. 3. The mobile terminal device according to claim 2, wherein the display is adjusted. 4. The method according to claim 1, wherein the detecting means is further configured to detect a pen type, and the display means adjusts and displays the characteristics of the reproduced handwriting according to the detected pen type. The mobile terminal device according to claim 1.