KR101512082B1 - system and method for mode switching of electronic pen - Google Patents

Abstract

The present invention relates to a system and method for switching modes of an electronic pen, and more particularly, to a system and method for switching a mode of an electronic pen, which recognizes different code systems of dots printed on a paper or film and classifies them into a handwriting mode or a mouse mode To a mode switching system and method of an operating electronic pen.
The mode switching system of the electronic pen according to the embodiment of the present invention can recognize a paper or film by capturing a paper or a film on which dots having different codes are printed by using a camera or recognize different code systems, And a smart device for processing data transmitted from a subsequent electronic pen on the basis of recognition information transmitted from the electronic pen, into a writing mode and a mouse mode so as to operate the smart device.

Description

Technical Field [0001] The present invention relates to a system and a method for switching an electronic pen,

The present invention relates to a system and method for switching modes of an electronic pen, and more particularly, to a system and method for switching a mode of an electronic pen, which recognizes different code systems of dots printed on a paper or film and classifies them into a handwriting mode or a mouse mode To a mode switching system and method of an operating electronic pen.

Various input devices such as a keyboard, a mouse, a stylus, and the like are used for inputting command signals to computers and the like.

A mouse is generally used as a positioning device used to move a pointer displayed on a dual computer screen.

The mechanical ball mouse uses a method of determining the position value of the mouse in accordance with the amount of rotation of the ball when the ball moves on a uniform plane such as a mouse pad. The optical mouse is emitted to the bottom surface to recognize the reflected light And the amount of movement of the mouse is calculated.

However, conventional input devices are insufficient to meet various demands of users.

That is, the keyboard can be used to input a code such as a character using a predetermined button, or to move the pointer in left and right and up and down directions. When the mouse and the stylus are separated from the surface of the designated object for operation, Has a limited limit.

On the other hand, in recent years, an input device has been developed which inputs the input information to a paper or film on which a dot code is printed with an electronic pen, and transmits the inputted information to a computer or a smart device (for example, smart phone) Has been used in the field.

When using the electronic pen, it is possible to write characters, numbers, or images that the user directly wants to input on a predetermined device or a paper or film on which a special pattern is drawn (a dot code is printed) using the electronic pen, There is an advantage that the desired data can be input.

Such a character input method using an electronic pen includes generating stroke information through a predetermined sensor and a camera provided in the electronic pen, and performing character recognition using the generated stroke information Step < / RTI >

Such an electronic pen performs only one function of a handwriting function for inputting characters, and thus the developed mobile smart device is unable to support the mouse as an input device although it can use all of the mouse.

In addition, although a technology for supporting a handwriting function and a mouse function of an electronic pen is disclosed in a computer, a user must manually switch to a mouse mode in order to perform a mouse function with the electronic pen, , There was an inconvenience to switch writing mode and mouse mode one by one.

In addition, when the electronic pen is used in a writing mode in a state in which the electronic pen is switched to the mouse mode and used, the writing data recorded on the electronic paper is lost.

Registration No. 10-0962511 (June 03, 2010)

The present invention has been conceived to solve the above-mentioned problems, and it is an object of the present invention to provide a portable electronic device capable of not only a handwriting function of an electronic pen but also a mouse function, The present invention is directed to a system and method for switching a mode of an electronic pen.

Another object of the present invention is to automatically recognize a paper or film on which a dot is printed, automatically recognize a stylus tip mounted on the electronic pen, and switch the mode so that the user needs to control the operation according to each mode The present invention provides a system and method for switching a mode of an electronic pen.

According to another aspect of the present invention, there is provided a system for switching the mode of an electronic pen, comprising: a camera for capturing a paper or film on which dots having different codes are printed by using a camera, And transmits the recognition information; And

A smart device for dividing data transmitted from a subsequent electronic pen into a handwriting mode and a mouse mode on the basis of recognition information transmitted from the electronic pen and processing the data; .

According to another aspect of the present invention, there is provided a method of switching an electronic pen, the method comprising the steps of: (a) capturing a paper or film on which a dot having a different code scheme is printed;

(b) transmitting a handwriting recognition code or a mouse recognition code to the smart device according to the recognition of the code system or the stylus recognized by the electronic pen; And

(c) if the handwriting recognition code is received from the smart device, the data transmitted from the handwriting pen is processed in a handwriting mode so as to be processed, and when the mouse recognition code is received, ; .

According to the means for solving the above-mentioned problems, the user can automatically switch between the handwriting mode and the mouse mode through different code systems or stylus recognition, , The electronic pen can be used as a mouse function to freely manipulate and input the smart device.

1 is a block diagram of a mode switching system of an electronic pen according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a configuration in which a pen tip is recognized as a stylus through the infrared transmitting / receiving unit shown in FIG. 1;
3 is a flowchart showing a mode switching method of the electronic pen according to the embodiment of the present invention.
4 is a detailed flowchart of the mouse operation step of FIG.
FIG. 5 is a diagram for explaining the mouse operation steps of FIG. 4. FIG.
FIG. 6 is a diagram for explaining an interlocking relationship with a smart device during a mouse operation according to the manual mode switching of FIG. 3. FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

It is to be noted that the same components of the drawings are denoted by the same reference numerals and symbols as possible even if they are shown in different drawings.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

Also, when a part is referred to as "including " an element, it does not exclude other elements unless specifically stated otherwise.

1 is a block diagram of a mode switching system of an electronic pen according to an embodiment of the present invention.

As shown in FIG. 1, the electronic pen 100 and a smart device (including a PC) 200 are connected by wired / wireless communication.

The electronic pen 100 includes a processor 110, a camera 140, a pressure sensor 150, an infrared transmission / reception unit 160, a mode selection unit 130, and a communication unit 120, 200 includes a communication unit 220, a central processing unit 210, an operation unit 260, a display unit 250, a storage unit 240, and a mode selection unit 230.

The electronic pen 100 combines an electronic pen tip or a stylus tip to perform an input function or a stylus function on a dots-printed paper or film.

The camera 140 photographs the paper or film on which the dots are printed and outputs it to the processor 110.

The processor 110 analyzes the image of the paper or film photographed by the camera to recognize the code system or the paper or film.

The code schemes of the dots printed on the paper or film are different from each other.

For example, the code system of dots printed on paper is a code system (hereinafter referred to as a dense code system) in which a total of 36 (6 × 6) dots form one coordinate value, that is, six horizontal dots and six vertical dots, It is suitable for handwriting because it can have stable recognition and can have many coordinate values.

The code system of the dots printed on the film is a code system (hereinafter referred to as a rare code system) in which three horizontal dots and three vertical dots, that is, 9 (3X3) dots form one coordinate value, It is possible to obtain multiple coordinate values at the same time in one image, which is suitable for the mouse mode because it can correct the code recognition error due to diffuse reflection or bending phenomenon.

The processor 110 recognizes the different code schemes of the dots in the image taken by the camera 140 and determines whether the code is a handwriting recognition code or a corpus recognition code.

When the paper on which the dot is printed is photographed by the camera 140, a black dot appears on the white background image of the image, and when the film is photographed, the image appears as a white dot on the black background.

The processor 110 recognizes the paper or film as an output screen of the image photographed by the camera and determines whether it is a handwriting recognition code or a coring recognition code.

Even if a dense code system and a rare code system are printed on paper, it can be recognized by handwriting or mouse mode according to the code system printed on paper by the recognition algorithm.

As a result, paper and dense, rare code systems, film and dense, and rare code systems are recognized as handwriting recognition codes and mouse recognition codes according to printed dense, rare code systems as well as paper and film recognition as different recognition codes.

The processor 110 transmits a handwriting recognition code to the smart device 200 or transmits a mouse recognition code to the smart device 200 through the communication unit 120 according to the recognized code scheme (dense, rare) or the type or film.

The infrared transmission / reception unit 160 transmits infrared rays to a pen tip coupled to the electronic pen 100 and outputs the reception result to the processor 110. The processor 110 determines the type of the pen tip based on the reception result.

This will be described in detail with reference to FIG.

2, an infrared absorption region 174 and an infrared reflection region 172 are separately formed on an outer circumferential surface of the pen tip 170. As shown in FIG.

In this embodiment, an infrared absorption region 174 is formed by printing a carbon ink having a property of absorbing infrared light on the outer peripheral surface of the pen tip 170 in the form of a band, and the pen tip 170 excluding the infrared absorption region 174 is formed. The outer peripheral surface of the infrared ray reflection area 172 becomes an infrared ray reflection area 172. [

One or more infrared absorption regions 174 printed on one pen tip 170 are binarized to 0 or 1 depending on the presence or absence of the arrangement so that a pen tip 174 corresponding to 2 ⁿ when the infrared absorption region 174 is n The infrared ray transmitting unit 162 and the infrared ray receiving unit 164 for infrared ray recognition of the respective infrared ray absorption regions 174 by the number of the infrared ray absorption regions 174 can be discriminated by discriminating the type of the pen tip 170 Are provided in pairs.

The plurality of infrared ray transmitting units 162 emit infrared rays simultaneously to the pen tip 170 under the control of the processor 110. The infrared ray receiving unit 164 simultaneously receives infrared rays and the processor 110 The type of the pen tip 170 is recognized.

Here, the type of the pen tip 170 can be divided into an electronic pen tip and a stylus tip in terms of its function, and in the case of an electronic pen tip,

The processor 110 senses in real time the defined colors and defined functions through different arrangements of the infrared absorbing regions 174 to replace the pen tip during use of the electronic pen, It can operate as a pen tip.

For example, each unique binarized ID code is assigned to fit different arrangements of the infrared absorption region 174, the black electronic pen tip being 11 ID code, the red electronic pen tip being 10 ID code, It is assumed that the 01 ID code and the stylus tip are assigned the 00 ID code, and that each of these ID codes is stored in the processor 110.

When the infrared ray reflected by the infrared ray receiver 164 is detected as binary 1, and when the infrared ray is not detected as binary 0, the infrared ray absorption region can be regarded as being binarized to 0 and 1 .

2, since the infrared ray absorbing region 174 is formed on the right side only, the light is detected only by the infrared ray receiving portion on the left of the two infrared ray receiving portions 164, so that the processor 110 is binarized to 10 It is recognized as an electronic pen tip.

If both of the infrared absorption regions 174 are formed, the two infrared ray receiving units 164 can not detect the light, so that the infrared rays are binarized to 00 (long) and the processor 110 recognizes the stylus tip.

1, the pressure sensor 150 senses the pressure of the electronic pen 100 that presses the paper or film on which the dot is printed, and outputs the sensed pressure to the processor 110.

The processor 110 transmits the input information to the smart device 200 to determine the thickness of the line in the handwriting mode at this pressure in the smart device 200 and to select the operation for the movement in the mouse mode .

The mode selection unit 130 is for manually switching from a handwriting mode to a mouse mode or from a mouse mode to a handwriting mode. For example, the mode selection unit 130 may include a button on the electronic pen 100, 110 informs the smart device 200 of the mode change via the communication unit 120. [

The communication unit 120 is for transmitting / receiving data to / from the smart device 200 by wire / wireless.

The electronic pen 100 acquires coordinate information, time information, pressure information, code system (or paper or film) information, pen tip information (kind, color), etc. and determines a recognition code from the code system, Together with coordinate information, time information, pressure information, pen tip information (kind, color), etc., to the smart device.

The central processing unit 210 that performs a function of controlling the overall operation of the smart device 200 processes the data received through the communication unit 220 and outputs the processed data to the display unit 250, When the handwriting recognition code is transmitted, the handwriting mode is operated to cause the display unit 250 to output the input contents of the paper or film in the same manner. When the mouse recognition code is transmitted, Mode so that the cursor is activated on the display unit 250 so that the user can recognize the movement of the position.

That is, the operation unit 260 separates the operation mode into the handwriting mode and the mouse mode under the control of the central processing unit 210, and outputs the contents to the display unit 250.

The mode selection unit 230 is for manually switching from a handwriting mode to a mouse mode or from a mouse mode to a handwriting mode like the mode selection unit 130 of the electronic pen 100 and can be implemented simply by a program.

Even when the smart device 200 manually switches the mode, the mode switching is notified to the electronic pen 100 via the communication unit 220.

3 is a flowchart showing a mode switching method of the electronic pen according to the embodiment of the present invention.

As shown in FIG. 3, the processor 110 of the electronic pen 100 may be configured such that when the power is turned off and then turned on while the pen tip 170 is engaged, or when a predetermined time has elapsed from when the pen tip 170 is turned on, The infrared ray transmitter 162 is controlled before inputting to the printed paper or film to simultaneously irradiate infrared rays to the pen tip 170 to be sensed.

At this time, the infrared ray receiver 164 near the infrared ray absorption region 174 can not detect the infrared ray due to the nature of the carbon that absorbs the infrared ray, and the infrared ray receiver 164 of the portion where the infrared ray absorption region is not formed detects And outputs reception information (presence / absence of detection) to the processor 110 (S302).

The processor 110 recognizes the type of the pen tip including the color of the pen tip 170 and the function (electronic pen tip or stylus tip) by comparing it with the previously stored ID code, (S303).

If the recognized pen tip is a stylus tip (S304), the processor 110 can not write with the stylus tip. Therefore, the processor 110 determines that the mouse recognition code is transmitted and transmits the mouse recognition code to the smart device 200 through the communication unit 120 The central processing unit 210 of the smart device 200 controls the operation unit 260 to operate in the mouse mode so as to activate the cursor on the display unit 250, 4 is performed (S322).

It is impossible to switch the mode by manual operation of the user in the mouse mode operation by recognizing the stylus tip.

If the pen tip recognized in step S304 is not a stylus tip, that is, an electronic pen tip, the camera 140 photographs an object (paper or film) to be written with the electronic pen 100, (S306).

The processor 110 recognizes the code system of the dot printed on the photographed paper or film (S308). If the dense code system is the dense code system (S310), the dense code system is suitable for handwriting, The central processing unit 210 of the smart device 200 controls the operation unit 260 to operate in the handwriting mode and then transmits the handwriting content from the electronic pen 100 to the smart device 200 When the related data is transmitted, the handwritten content is output to the display unit 250 in real time (S314).

If the handwriting recognition code includes information on the color of the electronic pen tip, the handwriting recognition unit 230 outputs the handwriting content to the display unit 250 using the corresponding color.

When the user operates the handwriting mode and the user manually switches the mode to the mouse mode through the mode selection units 130 and 230 of the electronic pen 100 or the smart device 220 at step S316, The central processing unit 210 of the smart device 200 controls the operation unit 260 to operate in the mouse mode to activate the cursor on the display unit 250, When the data is transmitted, the operation as shown in FIG. 4 is performed (S318).

If the dot code system recognized in step S310 is not a dense code system, that is, a rare code system, the rare code system is not suitable for handwriting. Therefore, the mouse recognition code is transmitted to the smart device 200 through the communication unit 120 The central processing unit 210 of the smart device 200 controls the operation unit 260 to operate in the mouse mode to activate the cursor on the display unit and then transmit data from the electronic pen 100 The operation is performed as shown in FIG. 4 (S332).

When the user operates the mouse mode and the user manually switches to the writing mode through the mode selection units 130 and 230 of the electronic pen 100 or the smart device 200 in step S324, The central processing unit 210 of the smart device 200 controls the operation unit 260 to deactivate the activated cursor and operates in the handwriting mode so that the handwriting content And outputs the written contents to the display unit 250 in real time (S336).

If the handwriting recognition code includes information on the color of the electronic pen tip, the handwriting recognition unit outputs the handwriting content to the display unit with the corresponding color.

In another embodiment of the present invention, if it is determined in step S308 that the object to be handled is paper or film, if the handwriting recognized in step S310 is paper, the handwriting recognition code in step S312 is transmitted. In step S310, In the case of this film, the handwriting recognition code in step S330 may be transmitted to perform the subsequent steps.

FIG. 4 is a detailed flowchart of the mouse mode operation step of FIG. 3, and FIG. 5 is a diagram for explaining the mouse operation steps of FIG.

If the measurement pressure included in the data received from the electronic pen 100 during operation in the mouse mode of the smart device 100 is 0 (S402), then the paper or film 300 is not pressed by the electronic pen 100 Since the electronic pen 100 is in the moving state, the activated cursor operates in the moving mode and moves along the coordinate information included in the data like the general mouse 400 (S408).

If the measured pressure is not 0, the measured pressure is compared with the reference pressure (S404). If the measured pressure is lower than the reference pressure, the electronic pen 100 mistakenly presses the paper or film 300 by mistake by the user during movement of the electronic pen 100 And moves the activated cursor in accordance with the coordinate information included in the data like the general mouse 400 (S408).

If the measured pressure is higher than the reference pressure, it is determined that the user has pressed the paper or film 300 with the electronic pen 100, and operates as a left click of the general mouse 400.

That is, when the paper or film 300 is pressed with the electronic pen 100, when the coordinate information changes, it is determined that the portion corresponding to the changed coordinates is selected and the corresponding portion is reversed, Or if the icon for executing the film 300 is pressed, the corresponding icon is executed.

FIG. 6 is a diagram for explaining an interlocking relationship with a smart device during a mouse operation according to the manual mode switching of FIG. 3. FIG.

6, when writing is performed with the electronic pen 100 on the paper or film 300 on which the dots 310 are printed in the writing mode, the electronic pen 100 is paired with the smart device 200 The same handwritten image is output to the display unit 250 of the smart device 200 in real time.

When the user manually switches the mode to the mouse mode through the mode selection unit 130 or 230 during the handwriting mode operation, the conversion is transmitted to the other side, and the smart device 200 operates in the mouse mode, The cursor 252 is activated and shown at the position of the display unit 250 corresponding to the coordinate information.

The cursor 252 can be checked to confirm that the user is operating in the mouse mode.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, And it goes without saying that the invention belongs to the scope of the invention.

100: Electronic pen 200: Smart device (including PC)
300: Paper or film on which dots are printed 400: Mouse

Claims (13)

Depending on the degree of density, an output image of a video image of a dots printed with different code schemes or images of a film is recognized as paper or film or a different code system, Transmits the infrared code to the pen tip to be combined, determines the type of the pen tip including the function of the pen tip and the color of the received pen tip, An electronic pen for transferring the kind; And
A smart device for dividing data transmitted from a subsequent electronic pen into a handwriting mode and a mouse mode on the basis of a recognition code transmitted from the electronic pen; The mode switching system comprising: The method according to claim 1,
Wherein the electronic pen has a relatively denser code system among the different code systems or transmits the handwriting recognition code to the smart device when the paper is recognized and has a relatively less dense code system, And transmits the mouse recognition code to the smart device if it is recognized. The method according to claim 1,
Wherein the electronic pen and the smart device are each provided with a mode selection unit for manually switching from a handwriting mode to a mouse mode and from a mouse mode to a handwriting mode, Pen mode switching system. The method according to claim 1,
Wherein the smart device activates a cursor on a display unit of the smart device when the smart device operates in the mouse mode. The method according to claim 1,
Wherein the smart device operates in a moving mode when the pressure of the data transmitted from the electronic pen is 0, and operates in a left-click mode of the general mouse when the pressure is not zero. The method according to claim 1,
Wherein the smart device processes the data transmitted from the electronic pen to operate in a mouse mode when the function of the pen tip coupled to the electronic pen is a stylus tip. The method according to claim 6,
And an infrared transmission / reception unit for forming a large number of infrared absorption regions and infrared reflection regions so as to distinguish the type of pen tip from the pen tip and irradiating infrared rays to the pen tip to detect only light reflected from the infrared reflection region, And recognizes the type of the pen tip based on the received information received by the electronic pen. 8. The method of claim 7,
Wherein a binary ID code is stored for each kind of pen tip in the electronic pen and an infrared absorption region is arranged in the pen tip so as to correspond to the ID code. (a-1) recognizing whether the pen tip coupled to the electronic pen in the electronic pen is an electronic pen tip or a stylus tip;
(a) capturing a paper or film printed with dots having different codes in the electronic pen to recognize a code system;
(b) transmitting a handwriting recognition code or a mouse recognition code to the smart device according to the relative density of the code system recognized by the electronic pen; And
(c) if the handwriting recognition code is received from the smart device, the data transmitted from the handwriting pen is processed in a handwriting mode so as to be processed, and when the mouse recognition code is received, ; , ≪ / RTI &
In the step (a-1), infrared light is irradiated to the pen tip having a plurality of infrared absorption regions and infrared reflection regions so as to be distinguished so as to distinguish the types of pen tips, and the infrared transmission / And recognizing the type of the pen tip on the basis of the received information. (a-1 ') recognizing whether the pen tip coupled to the electronic pen in the electronic pen is an electronic pen tip or a stylus tip;
(a ') photographing a paper or film on which dots having different code schemes are printed on the electronic pen to recognize a paper or film as a writing target;
(b ') transmitting a handwriting recognition code or a mouse recognition code to the smart device according to whether the handwriting recognized by the stylus is a bell or a film; And
(c) if the handwriting recognition code is received from the smart device, the data transmitted from the handwriting pen is processed in a handwriting mode so as to be processed, and when the mouse recognition code is received, ; , ≪ / RTI &
An infrared transmission / reception unit for irradiating infrared rays to the pen tip having a plurality of infrared absorption regions and infrared reflection regions so as to distinguish the types of pen-tips in the step (a-1 ') so as to detect only the light reflected from the infrared reflection region And recognizing the type of the pen tip on the basis of the received information. 11. The method according to claim 9 or 10,
In the step (a-1) or (a-1 '), the pen tip coupled to the electronic pen recognizes whether it is an electronic pen tip or a stylus tip, transmits a mouse recognition code to the smart device if the tip is a stylus tip,
(d) The method further comprises the step of causing the smart device to process data transmitted from the electronic pen in a mouse mode. 12. The method of claim 11,
(C) and (d), wherein the smart device activates a cursor at a corresponding position of the electronic pen, and outputs the activated mode to the display unit. 12. The method of claim 11,
(C) and (d) are performed in the mouse mode, the smart device operates in a moving mode when the pressure included in the data transmitted from the electronic pen is 0, and when it is not 0, The mode is switched to the left-click mode.

Images