CN102193710A - Screen keyboard system and operation method thereof - Google Patents

Abstract

The invention discloses a screen keyboard system and an operation method thereof, which display a screen keyboard with a plurality of software keys in a frame line mode, and allow the pressing of the entity keys of the entity keyboard to make a cursor move or move and click, thereby achieving the technical effect of improving the operation convenience of the cursor.

Description

On-Screen Keyboard System and Its Operation Method

technical field

The present invention relates to an on-screen keyboard system and its operating method, in particular to an on-screen keyboard system that displays an on-screen keyboard in a framed manner and can control a cursor and its operating method.

Background technique

In recent years, with the vigorous development of mobile devices, the price, performance and convenience have been widely accepted by users. However, when using a mobile device, it is usually inconvenient to use an external mouse to operate the cursor. Therefore, how to provide users with convenient operation of the cursor has become one of the problems that various manufacturers want to solve.

Generally speaking, mobile devices have a Graphics User Interface (GUI), and provide users with a cursor to perform various operations in this GUI, for example: use the cursor to click on desktop icons (ICONs) to Execute the application. However, the user cannot control the cursor unless an external device such as a mouse or a joystick is connected, which is very inconvenient for a GUI.

In view of this, some manufacturers propose to use the direction buttons of the mobile device as the basis for controlling the cursor. For example, the user can control the moving direction and position of the cursor by using direction keys, such as: up, down, left and right . . . and other direction keys. However, when the moving distance of the cursor is longer, controlling the cursor in this way will cause a considerable burden on the user, and the efficiency is also very low. Therefore, it is still not enough to solve the problem of inconvenient cursor operation when the mouse cannot be used. .

To sum up, it can be seen that the prior art has long had the problem of inconvenient cursor operation when the mouse cannot be used. Therefore, it is necessary to propose improved technical means to solve this problem.

Contents of the invention

In view of the problems existing in the prior art, the present invention discloses an on-screen keyboard system and its operating method.

The on-screen keyboard system disclosed by the present invention is applied in a graphical user interface and includes: an initial module, a display module, a detection module, a comparison module and an operation module. Wherein, the initialization module is used to initialize the screen keyboard, and the screen keyboard has a plurality of software keys, wherein each software key corresponds to a coordinate area and an identification code; On the graphical user interface; the detection module is used to detect the key code corresponding to the physical keyboard when the physical key of the physical keyboard is pressed; the comparison module is used to compare the key code with the identification code of each software key Comparing, and obtaining the software key corresponding to the identification code when the comparison matches; the operation module is used to move the cursor to the coordinate area of the obtained software key according to the operating conditions, or move the cursor to the obtained software key within the coordinate area and perform a click operation.

As for the on-screen keyboard operation method of the present invention, it is applied in a graphical user interface, and its steps include: initializing the on-screen keyboard, the on-screen keyboard has a plurality of software keys, wherein each software key corresponds to a coordinate area and an identification code; After the physical key of the physical keyboard is detected, the key code corresponding to the physical key is detected; the key code is compared with the identification code of each software key, and the software key corresponding to the identification code is obtained when the comparison matches; according to Operating conditions Move the cursor to the coordinate area of the obtained software key, or move the cursor to the obtained coordinate area of the software key and perform a click operation.

The system and method disclosed in the present invention are as above, and the difference between the present invention and the prior art is that the present invention displays an on-screen keyboard with a plurality of software keys in a framed manner, and allows pressing the physical keys of the physical keyboard to make the cursor Move or move and click.

Through the above-mentioned technical means, the present invention can achieve the technical effect of improving the convenience of cursor operation.

Description of drawings

FIG. 1 is a system block diagram of the on-screen keyboard system of the present invention.

Fig. 2 is a method flow chart of the screen keyboard operation method of the present invention.

Fig. 3 is a schematic diagram of displaying an on-screen keyboard using the present invention.

FIG. 4 is a schematic diagram of a first embodiment of using the on-screen keyboard to control the cursor of the present invention.

FIG. 5 is a schematic diagram of a second embodiment of using the on-screen keyboard to control the cursor of the present invention.

Fig. 6 is a schematic diagram of merging adjacent software keys in an on-screen keyboard according to the present invention.

FIG. 7 is a schematic diagram of applying the present invention to set the coordinate area of the software key in the on-screen keyboard.

FIG. 8 is a schematic diagram of a setting window of the present invention.

[Description of main component symbols]

101 Initial Module

102 display module

103 detection module

104 comparison module

105 operation modules

106 adjustment modules

300 Graphical User Interface

301 Cursor

400 screen keyboard

400a～400c on-screen keyboard

401~414 software keys

401a～414a software keys

413b, 414b software keys

510 desktop icons

601 integrated buttons

700 setting window

710 set block

711 Determining components

712 cancel components

Detailed ways

The implementation of the present invention will be described in detail below in conjunction with the drawings and examples, so that the realization process of how to use technical means to solve technical problems and achieve technical effects in the present invention can be fully understood and implemented accordingly.

Before explaining the on-screen keyboard system disclosed in the present invention and its operating method, the nouns defined by the present invention are described first. The on-screen keyboard mentioned in the present invention refers to the display on the Graphics User Interface (Graphics User Interface, GUI) The two-dimensional graphics feature in the , which has multiple software buttons and is presented in a framed manner. The framed method refers to only displaying the on-screen keyboard and the border lines of each software button. In actual implementation, each software Characters can also be displayed in the keys, such as: "A", "8", "~", etc. The on-screen keyboard will be described in detail later in conjunction with the embodiments and drawings.

The on-screen keyboard system of the present invention and its operation method are further described below in conjunction with the drawings. First, the on-screen keyboard system of the present invention is described first. Please refer to FIG. 1. FIG. 1 is a system block diagram of the on-screen keyboard system of the present invention, including: initial Module 101 , display module 102 , detection module 103 , comparison module 104 and operation module 105 . Wherein, the initialization module 101 is used for initializing the on-screen keyboard with a plurality of software keys, wherein each software key corresponds to a coordinate area and an identification code. When the module 101 is initialized, it is used to correspond or adjust with the corresponding software keys. The coordinate area can be represented by (x, y, l, w), wherein "x" and "y" represent the coordinate value of the upper left corner of the software button in the graphical user interface (or called starting point coordinates), "l" is the value of the length of the software key, and "w" is the value of the width of the software key. In addition, the identification code is used as a basis for identifying each software key, and the identification code is a non-repetitive code. In actual implementation, the identification code corresponds to the key code (keycode) of the physical keyboard. In other words, assuming that the key code of the physical key "A" of the physical keyboard is "0x65", the identification code of the software key "A" of the on-screen keyboard is also "0x65". In particular, it should be noted that the initialization of the initial module 101 can cause the on-screen keyboard to correspond to the physical keys of the physical keyboard one by one, or one software key of the on-screen keyboard to correspond to multiple physical keys of the physical keyboard at the same time.

The display module 102 is used for displaying the on-screen keyboard in a frame-line manner, and overlaying and displaying it on the GUI. Since the display of the on-screen keyboard in the form of frame lines has been explained in the existing self-defined nouns, so it will not be repeated here, and the overlapping display on the GUI refers to when the GUI has multiple When layering, the on-screen keyboard will be superimposed on these layers in the way of displaying the top layer, and everything outside the frame will be displayed in a transparent manner. The presentation method will be described in detail later with the diagram.

The detection module 103 is used for detecting the key code corresponding to the physical key after the user presses the physical key of the physical keyboard. For example, assuming that the user presses the physical key "A", the detection module 103 will detect the key code corresponding to the physical key "A", such as "0x65". It should be noted that the detection of the key code corresponding to the physical key is a prior art, so it will not be repeated here.

The comparison module 104 is used for comparing the key code with the identification code of each software key, and obtaining the software key corresponding to the identification code when the comparison is matched. For the above example, assuming that the key code detected by the detection module 103 is "0x65", and the identification code of the software key "A" is "0x65", then the comparison module 104 compares the key code with each software key When the identification codes of the keys are compared, it is judged that the key code "0x65" matches the identification code "0x65", and the software key "A" corresponding to the identification code "0x65" is obtained. In other words, since the key code corresponding to the physical key corresponds to the identification code corresponding to the software key, when the user presses the physical key (for example: "A"), it can be identified by comparing the key code with the identification code. By means of the code, the corresponding software key (for example: "A") is obtained.

The operation module 105 is used to move the cursor to the obtained coordinate area of the software key according to the operation condition, or move the cursor to the obtained coordinate area of the software key and perform a click operation. For example, assuming that the operation condition is set to "move and click", and the software key obtained by the comparison module 104 is "A", the operation module 105 will move the cursor to the software key "A" according to the operation condition ” in the coordinate area, and click in this coordinate area. The coordinate area may be composed of starting point coordinates, length and width, wherein the starting point coordinate is the coordinate position of the upper left corner of this coordinate area, assuming that the starting point coordinates (20, 20) and the length are the value "5" and the width is "3", then the coordinate area is the area range composed of coordinates (20, 20), coordinates (25, 20), coordinates (20, 23) and coordinates (25, 23). In actual implementation, the coordinate area corresponding to each software key can be preset or generated by an algorithm.

In addition, the on-screen keyboard system of the present invention may further include an adjustment module 106 for allowing the user to set the starting point coordinates, length and width of the software keys by dragging the frame of the on-screen keyboard with the cursor. For example, assuming that the frame length of the software button "A" is "10" and the width is "5", the user can drag the frame line with the cursor to change the starting point coordinates, length and width, and set the The changes are reset to the coordinate area of the software key "A". In addition, the adjustment module 106 can further combine the selected adjacent software keys to generate an integrated key, and the integrated key corresponds to a coordinate area and an identification code. In addition, the adjustment module 106 can also restore the integrated button selected by the user to be an adjacent software button. This part will be described in detail later with reference to the figures.

As shown in Figure 2, Figure 2 is a method flow chart of the screen keyboard operation method of the present invention, which is applied in a graphical user interface, and its steps include: initializing the screen keyboard, which has a plurality of software keys, wherein each software key Corresponding to the coordinate area and the identification code (step 210); present the on-screen keyboard in a framed manner, and overlay it on the graphical user interface (step 220); after pressing the physical key of the physical keyboard, detect the physical key Corresponding key code (step 230); The key code is compared with the identification code of each software key, and obtains the corresponding software key (step 240) with identification code when comparing and matching; Cursor is moved according to operating condition Go to the coordinate area of the obtained software key, or move the cursor to the coordinate area of the obtained software key and perform a click operation (step 250). Through the above steps, the on-screen keyboard with multiple software keys can be displayed in a framed manner, and the physical keys of the physical keyboard can be pressed to make the cursor move or move and click.

In addition, after the on-screen keyboard is presented as a frame in step 220, the user can set the coordinate area of the software button by dragging the frame of the on-screen keyboard with the cursor, such as: starting point coordinates, length and width (step 221); and after step 220, the selected adjacent software keys can also be combined to generate an integrated key, and the selected integrated key can be restored to an adjacent software key (step 222). In addition, the operating conditions can be set by setting windows or pressing function keys (step 260 ). Through the above steps, the coordinate area of the software key and the operating conditions can be set.

The following description will be made in the form of an embodiment in conjunction with Fig. 3 to Fig. 8. Please refer to Fig. 3 first. Fig. 3 is a schematic diagram of an on-screen keyboard applied to the present invention, including: a graphical user interface 300, a cursor 301, an on-screen keyboard 400 and software Keys (401~414). In particular, the present invention does not limit the size and display position of the on-screen keyboard 400 , and the quantity and arrangement of the software keys ( 401 - 414 ).

When the user wants to control the cursor 301 with the physical keyboard, the on-screen keyboard of the present invention can be activated. At this point, the initialization module 101 initializes the on-screen keyboard to have a plurality of software keys (401-414), wherein each software key (401-414) corresponds to a coordinate area and an identification code. Next, the display module 102 presents the initialized on-screen keyboard as a frame, and overlays and displays the initialized on-screen keyboard 400 on the GUI 300 as shown in FIG. 3 .

Next, please refer to FIG. 4 . FIG. 4 is a schematic diagram of a first embodiment of using the on-screen keyboard to control the cursor of the present invention. Assuming that the user wants to move the cursor 301 to the coordinate area of the software key 413 in the on-screen keyboard 400, from the characters displayed on the software key 413, it can be seen that the software key 413 is consistent with the physical key "blank key" of the physical keyboard. Correspondingly, therefore, the user can press the physical key "blank key". At this time, the detection module 103 will detect the button code corresponding to the physical button pressed by the user, such as: "0x32", and then the comparison module 104 will compare the detected button code "0x32" with each The identification code of a software key (401-414) is compared. In this first embodiment, since the identification code corresponding to the software key 413 and the key code are both "0x32", the comparison module 104 will therefore determine that Compare and obtain the software key 413 corresponding to the identification code "0x32".

As mentioned above, after obtaining the software key 413, the operating module 105 moves the cursor 301 to the coordinate area of the software key 413 according to the operating conditions, or moves the cursor 301 to the coordinate area of the software key 413 and performs Click Actions. For example, assuming that the operating condition is set to “move”, the operating module 105 will move the cursor 301 to the coordinate area of the software key 413 as shown in FIG. 4 . Conversely, if the operation condition is set to "move and click", the operation module 105 will move the cursor 301 to the coordinate area of the software button 413 and perform a click operation. In this case, if the cursor 301 moves to In the coordinate area of the application, there is no "desktop icon (Icon)" of the application, or the cursor does not overlap the "desktop icon (Icon)", then although the click operation will be performed, but no application will be executed Procedures, this part will be described in detail later with the diagram. In addition, in actual implementation, the moving method of the cursor 301 can be preset to move to the center position of the coordinate area. Since the calculation method of the center position is in the prior art, it will not be repeated here. In addition to moving the cursor 301 to the center of the coordinate area, it can also be preset to move to any corner of the coordinate area. This corner is obtained by numerical calculation of (x, y, l, w), for example : The coordinates of the upper left corner are (x, y), the coordinates of the upper right corner are (x+w, y)...etc. In other words, the present invention does not limit the position where the cursor 301 moves to its coordinate area by the above examples.

Please refer to FIG. 5 . FIG. 5 is a schematic diagram of a second embodiment of using the on-screen keyboard to control the cursor of the present invention. As mentioned above, assuming that the operation condition is set to "move and click", the operation module 105 will move the cursor 301 to the obtained coordinate area of the software key according to the operation condition and perform a click operation. In actual implementation, assuming that the graphical user interface 300 displays a desktop icon 510, at this time, the user can drag the frame line of the on-screen keyboard 400 through the cursor 301, so that the adjustment module 106 will reset the on-screen keyboard 400 The coordinate area of each software key (401-414) is used to provide the initial module 101 to initialize again, so that the screen keyboard 400 can become the screen keyboard 400a as shown in Figure 5, and has a plurality of software keys (401a-414a) . It should be noted that the second embodiment is similar to the first embodiment, so only the differences will be described, and the same parts will not be repeated.

When the user wants to click the desktop icon 510 with the cursor 301, since the desktop icon 510 is in the coordinate area of the software button 407a, the user can press the physical key "Caps Lock" of the physical keyboard. At this time, the detection The module 103 will detect that the key code corresponding to the physical key "Caps Lock" is "0x20". Next, the comparison module 104 will obtain the software key 407a after performing the comparison as in the first embodiment (because the identification code corresponding to the software key 407a is also "0x20"). Next, the operation module 105 moves the cursor to the obtained coordinate area of the software key 407a according to the operation condition (ie, the operation condition is set to "move and click") and performs a click operation. In this way, the cursor 301 will move to the software button 407a as shown in FIG. 5 and click on the desktop icon 510 .

It should be noted that, in this second embodiment, the cursor 301 will move to the center position of the coordinate area of the software key 407a, and the center position can be calculated according to the starting point coordinates, length and width of the coordinate area Calculated. For example, assuming that the starting point coordinates of the coordinate area are (20, 20), the length is "20" and the width is "10", then the "x" axis of the center position is "20+20/2", " The y" axis is "20+10/2", so far the center position (30, 25) is calculated by the algorithm. Next, after the cursor 301 moves to the above-mentioned center position, since the cursor 301 overlaps with the desktop icon 510 , the desktop icon 510 can be clicked successfully to execute the application program corresponding to the desktop icon 510 . In other words, whether the cursor 301 can successfully click the desktop icon 510 depends on whether the cursor 301 overlaps with the desktop icon 510 , rather than directly clicking the desktop icon 510 in the coordinate area of the software button 407 a. Therefore, even if there are incomplete desktop icons or more than two desktop icons in the coordinate area, the clicking operation will not be affected.

As shown in FIG. 6 , FIG. 6 is a schematic diagram of merging adjacent software keys in an on-screen keyboard according to the present invention. As mentioned above, the adjustment module 106 can further combine the selected adjacent software keys to generate an integrated key, and the integrated key is the same as the software key and corresponds to a coordinate area and an identification code. Please refer to FIG. 3 , assuming that the user selects the adjacent software button 413 and software button 414 in the on-screen keyboard 400, at this time, the adjustment module 106 will combine the two software buttons (413, 414) into one as shown in FIG. 6 In actual implementation, the on-screen keyboard 400b presented in the form of frame lines will hide the adjacent frame lines of the two software keys (413, 414), while the integrated keys 601 in the on-screen keyboard 400b The corresponding coordinate areas and identification codes will simultaneously record the coordinate areas and identification codes of the two software keys (413, 414). In this example, assume that the coordinate area of the software button 413 is "(30, 20, 10, 10)" and the identification code is "0x32"; the coordinate area of the software button 414 is "(40, 20, 10, 10)", the identification code is "0x18", then the coordinate area of the integrated button 601 will become "(30, 20, 10, 10); (40, 20, 10, 10)", the identification code is "0x32; 0x18 ". In particular, since the integration button 601 is composed of two software buttons (413, 414), when the user presses any physical button corresponding to the two software buttons (413, 414), Both can be regarded as pressing the integration button 601 . However, the present invention is not limited thereto.

In addition, if the user wants to restore the integration button 601 to the state before integration, he can select the integration button 601 and press a preset function key (for example, the physical key “Esc” of the physical keyboard). At this time, the adjustment module 106 will restore the integrated key 601 according to the coordinate area "(30, 20, 10, 10); (40, 20, 10, 10)" and the identification code "0x32; 0x18". The two software keys (413, 414) in front.

Please refer to FIG. 7 . FIG. 7 is a schematic diagram of applying the present invention to set the coordinate areas of the software keys in the on-screen keyboard. In addition to the above-mentioned integration of adjacent software keys (413, 414), in actual implementation, the on-screen keyboard 400c presented with a frame line can also be shown in Figure 7, allowing the user to drag the two software keys (413, 414) ), for example: drag to the left or drag to the right. After the dragging is completed, the adjustment module 106 resets the coordinate areas of the software button 413b and the software button 414b according to the dragging result. It should be noted that in this example, the starting point coordinates and width of the coordinate area of the software key 413b do not need to be reset, only the length needs to be reset; and the width of the coordinate area of the software key 414b does not need to be reset. , only need to reset the starting point coordinates and length.

Finally, please refer to FIG. 8 , which is a schematic diagram of the setting window of the present invention. As mentioned above, the operation module 105 will select the corresponding action according to the operation conditions. In actual implementation, the operation conditions can be set through the setting window 700. The way is to set the operation conditions in the setting block 710 Set to "Move" or "Move and Click", and then click the confirm element 711 to complete the setting, or click the cancel element 712 to cancel the setting. In particular, it should be noted that in actual implementation, the operation condition can also be set by pressing the function key, for example: pressing the physical key "F1" of the physical keyboard means setting the operating condition as "move", or pressing the physical The physical key "F2" on the keyboard represents setting the operation condition to "move and click".

In summary, it can be seen that the difference between the present invention and the prior art lies in displaying an on-screen keyboard with a plurality of software keys in a framed manner, and allowing the physical keys of the physical keyboard to be pressed to move or move the cursor and The operation of clicking can solve the problems existing in the prior art by means of this technical means, and then achieve the technical effect of improving the convenience of cursor operation.

Although the foregoing embodiments of the present invention are disclosed as above, they are not intended to limit the present invention. Any person skilled in the art may make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the present invention The scope of patent protection must be defined by the claims attached to this specification.

Claims (10)

1. on-screen keyboard system is applied to it is characterized in that this system comprises in the figure user interface:

One initial module, in order to initialization one on-screen keyboard, this on-screen keyboard has a plurality of software keys, wherein each a software keys corresponding coordinate zone and an identification code;

One display module, in order to this on-screen keyboard is presented in frame line mode, and overlapping being shown on this figure user interface;

One detecting module after being used to push a physical button of physical keyboard, is detected the pairing key set code of this physical button;

One comparing module in order to this identification code of this key set code and each software keys is compared, and obtains when comparison meets and corresponding this software keys of this identification code; And

One operational module in this coordinate zone in order to this software keys of one cursor being moved to acquisition according to an operating conditions, maybe moves to this cursor in this coordinate zone of this software keys of acquisition and clicks operation.

2. on-screen keyboard as claimed in claim 1 system is characterized in that this coordinate zone is by point coordinates, a length and a width are formed together.

3. on-screen keyboard as claimed in claim 2 system is characterized in that this system more comprises an adjusting module, sets this in order to this cursor of arranging in pairs or groups in the mode of the frame line that pulls this on-screen keyboard and plays point coordinates, this length and this width.

4. on-screen keyboard as claimed in claim 3 system, it is characterized in that, this adjusting module more comprises adjacent those software keys that are selected is carried out combination to produce an integrating keys, and this integrating keys that will be selected reverts to those adjacent software keys, and this integrating keys is to having a coordinate zone and an identification code.

5. on-screen keyboard as claimed in claim 1 system is characterized in that, this operating conditions comprises and moves and click, and sets by the mode of a setting window or pressing function key.

6. on-screen keyboard method is applied to it is characterized in that its step comprises in the figure user interface:

Initialization one on-screen keyboard, this on-screen keyboard has a plurality of software keys, wherein each a software keys corresponding coordinate zone and an identification code;

This on-screen keyboard is presented in frame line mode, and overlapping being shown on this figure user interface;

Behind a physical button of pushing physical keyboard, detect the pairing key set code of this physical button;

This identification code of this key set code and each software keys is compared, and when comparison meets, obtain and corresponding this software keys of this identification code; And

According to an operating conditions one cursor is moved in this coordinate zone of this software keys of acquisition, maybe this cursor is moved in this coordinate zone of this software keys of acquisition and click operation.

7. on-screen keyboard method as claimed in claim 6 is characterized in that, this coordinate zone is by point coordinates, a length and a width are formed together.

8. on-screen keyboard method as claimed in claim 7 is characterized in that, this method more comprises this cursor of collocation and sets the step that this plays point coordinates, this length and this width in the mode of the frame line that pulls this on-screen keyboard.

9. on-screen keyboard method as claimed in claim 6, it is characterized in that, this method more comprises carries out combination to produce an integrating keys with adjacent those software keys that are selected, and this integrating keys that will be selected reverts to the step of those adjacent software keys, and this integrating keys is to having a coordinate zone and an identification code.

10. on-screen keyboard method as claimed in claim 6 is characterized in that, this method more comprises the step of setting this operating conditions by the mode of a setting window or pressing function key, and this operating conditions comprises mobile and clicks.

Images