CN103076924A - Gesture keyboard application method - Google Patents

Abstract

The invention relates to a gesture keyboard application method, comprising a touch panel or a finger cot; a keyboard; a TV program that can be reproduced by a TV card based on the keyboard, or a media stored in a storage medium of the keyboard, or a video that can be played on the network; the keyboard is connected to a circuit network; power supply. The touchpad is an independent device, and it can also be a part of the keyboard. It generates defined actions for the touch of the user's fingers, and feeds back to the keyboard to assist in the recognition of operations. There are microvoltage or electromagnetic, level signal monitoring, mutual induction (repulsion), when the fingers are curled or stretched together, a defined action is generated, which is fed back to the keyboard to assist in the recognition of the operation; the keyboard circuit has a circuit chip with corresponding functions, for The keyboard provides data processing and identification, network connection, TV video, and telephone applications; the keyboard storage medium provides a carrier for the keyboard's own software system (OS), and is used for data analysis, supervision, and storage; the power supply is the keyboard circuit, keyboard storage medium, finger socket or touchpad.

Description

Gesture keyboard application method

technical field

The invention relates to a gesture keyboard application method, in particular, the gesture can be defined to realize a mouse-like function.

Background technique

Since the late 1960s, Dr. Douglas Engelbart of the Stanford Research Institute in the United States invented the mouse. From the original mouse, mechanical mouse, optical mouse (optical mouse, laser mouse) to today's touch mouse, the mouse has become an important tool for computer input and output.

Although Apple, HP, Lenovo and other notebook hardware manufacturers have similar touchpad technology, the definition of gesture recognition applications is relatively narrow, and mouse applications are still required to improve the experience. This application aims to propose a new solution to the above-mentioned deficiencies.

Contents of the invention

A gesture keyboard, including a touchpad that can be controlled by gesture recognition, or an action command based on the signal of the finger cot that cooperates with each other, or a cursor and gesture gravity induction recognition based on a remote control design; a keyboard; a TV video that can be reproduced by a TV card based on the keyboard Programs, or media stored in the storage medium from the keyboard, or video that can be played on the network; the network connected to the keyboard circuit; power supply;

The touchpad is an independent device, and it can also be a part of the keyboard, which generates defined actions for the touch of the user's fingers, and feeds back to the keyboard to assist in the recognition of operations;

The finger cot and the keyboard are connected by wire and/or wirelessly, because there are microvoltage or electromagnetic, level signal monitoring and mutual induction (repulsion) in the finger cot. When the fingers are curled or stretched together, a defined action will be generated. Operation assistance recognition fed back to the keyboard;

The keyboard circuit has circuit chips with corresponding functions, providing data processing and identification, network connection, TV video, and telephone applications for the keyboard;

The keyboard storage medium provides a carrier for the keyboard's own software system (OS), and analyzes, monitors, and saves data; the power supply supplies power to the keyboard circuit, keyboard storage medium, finger cot or touchpad.

Gesture keyboard, generate defined action commands through fingertips or touchpad, as follows: drag and drop, zoom out, zoom in, select, copy, cut, delete, volume up, volume down, left button, right button, confirm.

Gesture keyboard, when the finger cot or touchpad defines the action, at least 1 to 2 fingers are coordinated, as follows:

Drag and drop: In the touchpad, place two fingers in the upper and lower areas at the same time, one finger moves from left to right from the top, and the other finger stays still at the bottom, forming a content area selection cursor to insert, and the selected content area is in gesture recognition After the action is confirmed, it prompts to drag and drop. At this time, push and pull the other finger at the bottom, up, down, left, and right to the position of the release paragraph. The finger moved to the right leaves the touchpad area to complete the drag and drop. The other finger can also leave the touchpad area. ; When using the finger cot, the two fingers are combined to be selected. When one finger is curled and does not move, the other finger moves from left to right (separated from the other finger), forming a content area selection cursor to insert, and the selected content area is in the gesture After the recognition action is confirmed, it prompts to drag and drop. At this time, the curled finger is flipped down or lifted up, and the curled finger is pushed and pulled from the left and right to the position of the release paragraph. After the two fingers are merged into the initial state, the drag and drop is completed. ;

Zoom out: In the touchpad, slide two fingers from top to bottom at the same time; when using the finger cover, merge the two fingers to be selected, and slide the two fingers from top to bottom at the same time;

Zoom in: In the touchpad, slide two fingers from bottom to top at the same time; when using the finger cot, combine two fingers to be selected, and slide two fingers from bottom to top at the same time;

Selection: In the touchpad, slide two fingers from left to right at the same time; when using the finger cot, combine the two fingers to be selected, and slide the two fingers from left to right at the same time;

Copy: In the touchpad, one finger moves in an arc from left to right; when using the finger cot, two fingers are merged to be selected, and both fingers move in an arc from left to right at the same time;

Cut: In the touchpad, one finger moves in an arc from right to left; when using a finger cot, two fingers are merged to be selected, and both fingers move in an arc from right to left at the same time;

Delete: In the touchpad, slide two fingers from right to left at the same time; when using the finger cot, two fingers are merged to be selected, and two fingers slide from right to left at the same time;

Volume up: In the touchpad, one finger moves from bottom to top; when using the finger cot, two fingers are combined to be selected, and both fingers move from bottom to top at the same time;

Volume reduction: In the touchpad, one finger moves from top to bottom; when using the finger cot, two fingers are combined to be selected, and both fingers move from top to bottom at the same time;

Left button: In the touchpad, one finger (two fingers) moves in an arc from top to left to form a single (double) left click; when using a finger cover, two fingers are combined to be selected, and two fingers are simultaneously from top to left move in an arc

Right button: In the touchpad, move one finger (two fingers) in an arc from top to right to form a single (double) right click; when using the finger cover, merge the two fingers to be selected, and both fingers form an arc from top to right at the same time move;

Confirmation: In the touchpad, slide two fingers from the left and right sides to the middle of the touchpad; when using the finger cot, spread the two fingers apart, and merge the two fingers from the left and right sides to the middle.

Gesture keyboard, touchpad: the appearance surface is divided into two areas, one area is the finger touch area, and the other area is the identification auxiliary area marked with left, right keys and pulleys; through the intermediate circuit, the circuit components that are sensitive to electromagnetic, voltage, etc. capture the corresponding The interval movement mode of the gesture action, establish the corresponding instruction for auxiliary recognition, and feed back to the operation of the computer; or there is a micro-aperture camera on the side of the touchpad, and the interval movement mode of the corresponding gesture action is captured by the micro-aperture camera, and the corresponding instruction for auxiliary recognition is established , Feedback to the operation of the computer; and/or cover and block the light transmission of the liquid crystal panel in the finger touch area or the back of the touch panel with a light source through the finger, resulting in the induction of the light source (temperature) of the thermistor around the finger touch area Irregular changes are analyzed by the auxiliary chain identified by similar resistors as the signal source, and the corresponding instructions for auxiliary recognition are established for the interval movement mode of the corresponding gesture action, which is fed back to the operation of the keyboard system (and/or computer).

Gesture keyboard, finger cover is the combination of RFID (Radio Frequency IDentification) technology and micro-aperture imaging technology. The spacing between the electronic tags enables radio frequency identification, and according to the degaussing between the two merged spaces, corresponding instructions for auxiliary identification can be established and fed back to the operation of the keyboard system (and/or computer).

The gesture keyboard and the remote control are independent components that can be used as an auxiliary tool for the keyboard, including: front and back panels; a sensor with multi-axis gravity sensing in the middle, or a sensor with integrated multi-axis gravity sensing in the circuit; The surrounding light field sensors capture the deviation of the remote controller's up, down, left, and right movements, establish corresponding instructions for auxiliary recognition, and feed back to the operation of the keyboard system (and/or computer).

Gesture keyboard, remote control is an independent component, and/or a finger cot that combines RFID (Radio Frequency IDentification) technology with micro-aperture imaging technology, which can be designed as a watch;

This application has a light field sensor, a gravity sensor, a micro-aperture camera;

Through a circuit with a built-in electronic battery, the user's gestures can be connected to the keyboard system in a wireless manner, and corresponding commands for assisting recognition can be established and fed back to the operation of the keyboard system (and/or computer).

The gesture keyboard is a keyboard with a projector; the keyboard can be connected to an external voice microphone, and the projector provides corresponding projection images for the TV card and network (storage medium) video, and provides corresponding data interfaces for the voice microphone.

The gesture keyboard circuit bus has a chip, and one of the following solutions can be selected:

Or microprocessor, data TV card;

Or microprocessors, memory chips, display chips, sound and sound chips;

Or microprocessor, optical transceiver integrated module;

Or microprocessors, printing chips, memory chips, display chips, network chips, sound and sound chips;

Or communication radio frequency chips, baseband chips, antennas, SIM card slots or integrated SIM cards, microprocessors; or technical application solutions that include the selection of combinations of the above technologies.

An application method of a gesture keyboard, the steps are as follows:

S1. Through the exercise of the user's action model and familiarity with the definition of gesture actions, connect the user's gesture actions with the keyboard system, establish corresponding instructions for auxiliary recognition, and feed back to the operation of the computer and/or the smart keyboard system;

S2. Through the software of the gesture keyboard and auxiliary recognition tools (such as remote control, finger cot, wrist watch, touchpad) to analyze the user's gesture action behavior, error correction, reminder, recording, and enhance the efficiency of use;

S3. The process of use, analyze the use behavior, compile and execute the software that meets the gesture recognition application, and increase the scope of gesture recognition use;

S4. Through feedback to users, based on the principles of the above technologies, strengthen the improvement of existing gesture recognition technology hardware;

S5. Complete.

The inventor envisages: change the dependence on the above-mentioned mouse application technology, make the gesture recognition technology replace the existing mouse-like functions, make the keyboard system have independent operability, and can become the only host computer and a tool for identifying input and output of future IT computers.

Description of drawings

Fig. 1 is a schematic diagram of touchpad gesture action of the present invention,

Fig. 2 is a schematic plan view of a touch panel of the present invention,

Fig. 3 is a schematic structural view of the finger cot of the present invention,

Fig. 4 is a structural schematic diagram of the remote controller of the present invention,

Fig. 5 is a schematic front view of the remote controller of the present invention,

Fig. 6 is a structural schematic diagram of the wrist watch of the present invention,

Fig. 7 is a circuit structure diagram of the present invention,

Fig. 8 is a diagram of the method steps of the present invention.

Detailed ways

A gesture keyboard, including a touchpad 13 that can be controlled by gesture recognition, or an action command based on the signal of the finger cot 17 that cooperates with each other, or a cursor and gesture gravity induction recognition based on a remote control 20; keyboard; a TV card 28 based on the keyboard Reprinted TV video programs, or media stored in keyboard storage media, or videos that can be played on the Internet; the network connected to the keyboard circuit; power supply;

The touchpad 13 is an independent device, and can also be a part of the keyboard, which generates defined actions for the touch of the user's finger, and feeds back to the keyboard to assist in the recognition of operations;

The finger cot 17 is wired and/or wirelessly connected to the keyboard, because there are microvoltage or electromagnetic, level signal monitoring and mutual induction (repulsion) in the finger cot. When the fingers are curled or stretched together, a defined action is generated. , fed back to the keyboard for operation-assisted recognition;

The keyboard circuit has circuit 23 chips with corresponding functions, which provide data processing and identification, network connection, TV video, and telephone applications for the keyboard;

The keyboard storage medium provides a carrier for the keyboard's own software system (OS), and is used for data analysis, supervision, and storage;

Referring to Figure 1, the gesture keyboard generates defined action commands through finger cots or touchpads, as follows: drag and drop 1, zoom out 2, zoom in 3, select 4, copy 5, cut 6, delete 7, volume up 8, volume Zoom out 9, left button 10, right button 11, confirm 12. Regarding the drag-and-drop 1 in Figure 1, the arrow icon with the up, down, left, and right interval selection in the lower part should be marked with a dotted line, because the imaging effect is different, so this shall prevail.

Gesture keyboard, when the finger cot or touchpad defines the action, at least 1 to 2 fingers are coordinated, as follows:

Drag and drop 1: In the touchpad 13, place 2 fingers in the upper and lower sections at the same time, one finger moves from left to right from the top, and the other finger stays still below to form a content section selection cursor to insert, and the selected content area is in the After the gesture recognition action is confirmed, it prompts to drag and drop. At this time, push and pull the other finger at the bottom, up, down, left, and right to the position of the release paragraph, and the finger moved to the right leaves the touchpad area to complete the drag and drop. The other finger can also leave the touch pad Panel section; when using the finger cover 17, two fingers are combined to be selected, when one finger is curled and does not move, the other finger moves from left to right (separated from the other finger), forming a content section selection cursor to insert, and select content After the gesture recognition action is confirmed, the area prompts to drag and drop. At this time, the curled finger is flipped down or lifted up, and the curled finger is pushed and pulled from the left and right to the release segment position. The initial state is obtained by combining the two fingers. After finishing dragging and dropping, wait until the two fingers are bent to complete the action;

Zoom out 2: In the touchpad 13, slide two fingers from top to bottom at the same time; when using the finger cover 17, merge the two fingers to be selected, and slide the two fingers from top to bottom at the same time, and the action ends when the two fingers are bent;

Enlarge 3: In the touchpad, slide two fingers from bottom to top at the same time; when using the finger cot, merge the two fingers to be selected, and slide the two fingers from bottom to top at the same time, and the action ends when the two fingers are bent;

Option 4: In the touchpad, slide two fingers from left to right at the same time; when using the finger cot, combine the two fingers to be selected, slide the two fingers from left to right at the same time, and wait for the two fingers to bend to complete the action;

Copy 5: In the touchpad, move one finger in an arc from left to right; when using the finger cot, merge the two fingers together to be selected, move both fingers in an arc from left to right at the same time, and wait for the two fingers to bend. for the end of the action;

Cut 6: In the touchpad, one finger moves in an arc from right to left; when using the finger cot, two fingers merge to be selected, and both fingers move in an arc from right to left at the same time, until the two fingers are bent , is the end of the action;

Delete 7: In the touchpad, slide two fingers from right to left at the same time; when using the finger cover, merge the two fingers to be in the selection state, slide the two fingers from right to left at the same time, and wait for the two fingers to bend to end the action;

Volume up 8: In the touchpad, one finger moves from bottom to top; when using the finger cot, two fingers merge to be selected, and two fingers move from bottom to top at the same time, and the action ends when the two fingers are bent;

Volume reduction 9: In the touchpad, one finger moves from top to bottom; when using the finger cot, two fingers are combined to be selected, and two fingers move from top to bottom at the same time, and the action ends when the two fingers are bent;

Left button 10: In the touchpad, one finger (two fingers) moves in an arc from top to left to form a left button single (double) click; Move in an arc to the left, and when the two fingers are bent, the movement ends;

Right button 11: In the touchpad, one finger (two fingers) moves in an arc from top to right to form a single (double) right click; Move in an arc shape, and when the two fingers are bent, the action ends;

Confirmation 12: In the touchpad, slide two fingers from the left and right sides to the middle of the touchpad; when using the finger cover, spread the two fingers apart, and merge the two fingers from the left and right sides to the middle respectively, and the action ends when the two fingers are bent .

The above scheme is that when the finger touches the touchpad 13, it is the instruction preprocessing state; when all the fingers in the touchpad are separated from the touchpad, it is the end of the action; Bending two fingers is the end of the action command.

Referring to Fig. 2, the touch panel 13: the appearance surface is two intervals, one interval is the finger touch area 14, and the other interval is the identification auxiliary area 15 marked with the left and right keys and the pulley 16; through the intermediate circuit 23, the electromagnetic, voltage and other tactile sensations are sensed. The circuit 23 component of the circuit 23 captures the interval movement mode of the corresponding gesture action, establishes the corresponding instruction for auxiliary recognition, and feeds back to the operation of the computer; or there is a micro-aperture camera 19 on the side of the touchpad 13, and the corresponding gesture action is captured through the micro-aperture camera 19 The corresponding interval movement mode is established, and corresponding instructions for auxiliary recognition are established, which are fed back to the operation of the keyboard system (and/or computer). This image is an example of touchpad and keyboard integration. This microporous camera 19 can also be a similar camera, and when the camera is used to identify and analyze the corresponding gestures, the intermediate circuit 23 does not need to be designed with circuit components that are sensitive to touch such as electromagnetism and voltage; or this touch panel can adopt the above-mentioned Various techniques are applied and/or selected.

There are left and right keys to provide left and right auxiliary control for the cursor in the page interval; pulley 16 can provide convenience for pushing and pulling up and down the visible page; the buttons or pulleys in the identification auxiliary area 15 marked with left, right and pulley 16 can be touch-sensitive Electromagnetic, voltage and other tactile sensing circuits 23 component design; can also be designed for physical left and right keys and pulleys; or the micro-aperture camera 19 captures the range of finger intervals, and identifies and analyzes the corresponding gestures.

Or in theory, the micro-aperture camera 19 can also be replaced with a resistor 21 similar to a thermal gradient sensor, and through the covering and blocking of the light transmission on the back of the finger touch area 14 liquid crystal panel or the touch panel 13 with a light source, the finger The induction of the light source (temperature) of the thermistor around the touch area 13 changes irregularly, and the adjacent resistance 21 is used as the auxiliary chain analysis of the signal source identification, and the corresponding interval movement mode of the corresponding gesture action is established. Instructions, feedback to the operation of the keyboard system (and/or computer).

In this case, due to the induction of the peripheral thermistor 21 to the light source, in the absence of finger blocking or blocking, the following possibilities are possible: the thermal sensitivity value of each peripheral thermistor is the same; or the peripheral thermistor Parts are different due to the distance of the light source on the back side; in the case of fingers blocking or blocking, the relative light induction (thermal sensitivity value) of a certain peripheral thermistor part 21 has a strong or weak distinction, and can assist The peripheral thermistor in the change of the sensing value, when the finger is blocked or obstructed, that is, the movement trajectory of the finger is analyzed and summarized, and the instructions after the corresponding gesture actions are identified are fed back to the keyboard system (and/or computer) operate.

Even the touchpad 13 can also use the virtual keys (physical keys) displaying the above actions to replace the gesture recognition action process to achieve similar technical effects. Here, such non-independent creative solutions should not be regarded as a deviation from the principle of comprehensive coverage of this technology or the principle of equivalents.

Referring to Fig. 3, finger cot 17 is the combination of radio frequency identification RFID (Radio Frequency IDentification) technology of electronic tag 18 and camera 19 of micro-aperture imaging technology. The distance between opening and closing enables the radio frequency identification of the electronic tag, and according to the degaussing of the two combined spaces, the corresponding instructions for auxiliary identification can be established and fed back to the operation of the keyboard system (and/or computer).

The appearance of the finger cot is made of soft materials such as rubber. The built-in microcircuit integrates the electronic tag and the micro-aperture imaging component, and the gesture action is recorded through the micro-aperture imaging. The electronic tags identify and match each other, and the signal can be transmitted wirelessly. It is transmitted to the keyboard system for processing, powered by a built-in electronic battery; or the finger cot is connected to the keyboard system by wire, and the keyboard system supplies power to the relevant circuits of the finger cot.

Referring to Fig. 4, the remote control 20 is an independent component, which can be used as an auxiliary tool for the keyboard, including: front and back panels; a sensor 22 with multi-axis gravity sensing in the middle, or a circuit 23 integrated with a sensor 22 for multi-axis gravity sensing; the top can be The surrounding light field sensor 24 of the light beam from the front captures the deviation of the remote controller's up, down, left, and right movements, establishes corresponding instructions for auxiliary recognition, and feeds back to the operation of the keyboard system (and/or computer).

The light field sensor 24 described in this case can also be replaced by the micro-aperture camera 19 on the plane and the side; or the light field sensor itself is an integration of the thermistor 21 . Now use the combination technology between the micro-aperture camera 19 on the plane and the side, and the sensor 22 of multi-axis gravity induction to briefly describe the analysis, in order to hope to obtain a more clear and practical technology. There is at least one micro-aperture camera 19 on the plane and on the side. Through the multi-axis gravity sensing sensor 22, the horizontal static initial state, the rollover state, the translation state, the vertical state, and the downward tilt state define preset action commands. Through the multi-frame dynamic recording and analysis of the action form of the remote control by the micro-aperture camera at the position of the plane and the side, the corresponding instructions for auxiliary recognition are established and fed back to the operation of the keyboard system (and/or computer).

Similarly, the combined technology between the thermistor 21 and the multi-axis gravity sensing sensor 22 can also be differentiated according to the light sensitivity (thermal sensitivity value) of the projected beam, such as the light source from the front, or itself The remote control's own light source and thermistor form a light-sensing (thermal-sensing value) value similar to a checkerboard interval on the grating. By comparing the light-sensing (thermal-sensing value) value, combined with the sensor 22 levels of multi-axis gravity sensing Static initial state, rollover state, translation state, vertical state, downward tilt state, define preset action instructions, establish corresponding instructions for auxiliary recognition, and feed back to the operation of the keyboard system (and/or computer).

Further, with respect to the numerical comparison between the thermistors 21, it is assumed that around the top of the remote controller 20, there are respectively thermistors 21A (... 21N) in the horizontal direction (down), and there are thermosensitive resistors in the vertical left (right). Resistors 21a (... 21n), 21A and 21a form a sensing area. When the sensor 22 of the multi-axis gravity sensing of the remote control 20 is horizontally stationary, the initial state changes, resulting in an instantaneous light sensing (heat-sensitive response value) of each sensing area. ) numerical difference, thus forming the judgment of gesture action behavior change.

The panel of the remote control 20 of FIG. 4 can be considered as an illustration of the back panel.

Referring to Fig. 5, the front panel of the remote controller 20 is marked with a gesture recognition command (illustration or corresponding text) in a button mode, and has a beam of a projector 26, preferably an infrared beam projection, which can be used in a strong light environment;

Or the back panel of the remote controller is designed for the touchpad 13.

Regarding the drag-and-drop 1 in Figure 5, the arrow icon with the selection of up, down, left, and right intervals in the lower part should be marked with a dotted line, because the imaging effect is different, so this shall prevail.

Referring to Fig. 6, the remote controller 20 is an independent component, and/or is a finger cot 17 combined with an electronic tag 18 radio frequency identification (RFID (Radio Frequency IDentification) technology and micro-aperture imaging technology), which can be designed as a wrist watch 25;

This application has a light field sensor 24, a gravity sensor 22, a micro-aperture camera 19;

Through the circuit 23 with a built-in electronic battery, the gesture action of the user can be connected to the keyboard system in a wireless manner, and corresponding commands for assisting recognition can be established and fed back to the operation of the keyboard system (and/or computer).

Based on the above cases, the gesture action designed by the watch 25 can be a combination technology between the thermistor 21 and the multi-axis gravity sensing sensor 22, or a combination technology between the micro-aperture camera 19 and the multi-axis gravity sensing sensor 22 , the light field sensor 24 captures the offset of the remote control's up, down, left, and right movements, etc., and selects a suitable application in the above-mentioned schemes, and can define the motions of the wrist and/or elbow such as translation, flexion, erection, and lowering. Similar commands are fed back to the operation of the keyboard system (and/or computer).

The gesture keyboard is a keyboard with a projector 26; the keyboard can be an external voice microphone, and the projector provides corresponding projection images for the TV card and network (storage medium) video, and provides corresponding data interfaces for the voice microphone.

Referring to Fig. 7, the gesture keyboard circuit 23 bus is tapped with a chip, and one of the following schemes can be selected:

Or microprocessor 27, data TV card 28; This solution is to realize the one-way data identification through the reception of TV data through the network;

Or microprocessor 27, storage chip 29, display chip 30, sound effect chip 31; This scheme is to be able to satisfy basic computer application; Under different application conditions, sound effect chip 31 can be used as independent circuit circuit design;

Or microprocessor 27, optical transceiver integrated module 32; this scheme lies in the connection of optical communication network, can two-way data transmission exchange, the key lies in the application of network environment;

Or a microprocessor 27, a printing chip 33, a memory chip 29, a display chip 30, a network chip 34, and a sound effect chip 31; this solution lies in the application of its own office environment, and a certain network connection method can be selected;

Or communication radio frequency chip 35, baseband chip 36, antenna 37, SIM card slot or integrated SIM card 38, microprocessor 27; this solution lies in the application of wireless network.

Or the technical application scheme includes the selection of the combination of the above technologies.

The communication radio frequency chip 35 and the baseband chip 36 of the circuit select the chips applicable to the following communication standards: the communication standards are TD-SCDMA, TD-SCDMA to HSPA, TD MBMS to TDD LTE, WCDMA, HSDPA, CDMA20001×EV-D0, UMB, UWB, Wimax802.16d\e\m, LTE\SAE, Wapi, Wifi802.11b\g\n\aq compatible with Wlan, Mimo ofdm, IGRS, Bluetooth or McWiLL chip;

The circuit guides the working wireless frequency bands through the antenna: 400mhz, 450~470mhz, 698mhz~806mhz, 900mhz, 1110mhz, 1800mhz, 1900mhz, 2100mhz, 2300~2400mhz, 2,500~2,690mhz, 3300mhz, 3400~3700mhz; Internet connection and communication phone functions;

Circuit optical transceiver integrated module 32 optional wavelength range:

In 850nm, 1310nm, 1490nm, 1550nm, CWDM, DWDM, realize data exchange in optical communication environment, and exchange data and optical data through wired network or wireless network.

This kind of conversion between wired data and wireless data, or the conversion of wired data into optical communication data, or the transfer of wireless data into optical communication data, is not only to solve the intercommunication between data, but also to be able to serve other users in the applicable network. The device provides network usage service support.

The technical integration of the above-mentioned communication radio frequency chip and baseband chip standard module, the single chip design has the possibility of application of existing technology. Or, the integration of communication modules and optical transceiver integrated modules, or the technical integration of optical transceiver modules and radio frequency chips, baseband chip specification modules, the improvement of optical transceiver modules and IC sensing chips or microprocessor technology integration, and the integration of component chip functions The omission of elements resulting in non-innovative elements should not be considered as a violation of the principle of complete and comprehensive coverage of the invention.

Microprocessors are suitable for the following DSP, CPU or GPU, RISC architecture of APU, MIPS architecture, ARM or x86 architecture, quantum or photonic CPU technology selection. Throughout the technological development of the microprocessor 13 there has been a convergence of technologies:

1. Intel intends to build the WiFi function into the semiconductor chip, especially the development direction of the south bridge chip is mainly to integrate more functions, such as network card, RAID, IEEE 1394, and even WI-FI wireless network, etc. IT and communication Chip fusion design.

2. The invention of optical communication chips and graphene chips has caused unknown changes in network development hardware, and technological progress is only a reference for selecting standards.

However, due to the improvement of inferior inventions, or cost considerations, or unscrupulous manufacturers to avoid the principle of comprehensive patent coverage, they only choose practical technical solutions.

The keyboard has a dedicated interface, not limited to one of the following interfaces: USB interface, IEEE1394 interface, parallel interface, PC card slot interface, card reader interface, serial interface, Micro SATA interface, PCMCIA interface, PS/2 interface, TV- OUT interface, TV-Tuner interface, S-VIDEO interface, MODEM interface, network card interface, Station interface, Kensington interface.

Referring to Fig. 8, a method for applying a gesture keyboard, the steps are as follows:

S1. Through the exercise of the user's action model and familiarity with the definition of gesture actions, connect the user's gesture actions with the keyboard system, establish corresponding instructions for auxiliary recognition, and feed back to the operation of the computer and/or the smart keyboard system;

S2. Through the software of the gesture keyboard and auxiliary recognition tools (such as remote control, finger cot, wrist watch, touchpad) to analyze the user's gesture action behavior, error correction, reminder, recording, and enhance the efficiency of use;

S3. The process of use, analyze the use behavior, compile and execute the software that meets the gesture recognition application, and increase the scope of gesture recognition use;

S4. Through feedback to users, based on the principles of the above technologies, strengthen the improvement of existing gesture recognition technology hardware;

S5. Complete.

Claims (10)

1. A gesture keyboard, including a touchpad that can be controlled by gesture recognition, or an action command based on the signal of the finger cot that cooperates with each other, or a cursor designed based on the remote control and gesture gravity induction recognition; keyboard; based on the keyboard, it can be reproduced by a TV card TV video programs, or media stored in the storage medium from the keyboard, or video that can be played on the Internet; the network connected to the keyboard circuit; power supply; The touchpad is an independent device, and it can also be a part of the keyboard, which generates defined actions for the touch of the user's fingers, and feeds back to the keyboard to assist in the recognition of operations; The finger cot and the keyboard are connected by wire and/or wirelessly, because there are microvoltage or electromagnetic, level signal monitoring and mutual induction (repulsion) in the finger cot. When the fingers are curled or stretched together, a defined action will be generated. Operation assistance recognition fed back to the keyboard; The keyboard circuit has circuit chips with corresponding functions, providing data processing and identification, network connection, TV video, and telephone applications for the keyboard; The keyboard storage medium provides a carrier for the keyboard's own software system (OS), and analyzes, monitors, and saves data; the power supply supplies power to the keyboard circuit, keyboard storage medium, finger cot or touchpad. 2. The gesture keyboard according to claim 1, characterized in that the finger cot or the touchpad generates defined action commands as follows: drag and drop (1), zoom out (2), zoom in (3), select (4), copy (5), cut (6), delete (7), volume up (8), volume down (9), left key (10), right key (11), confirmation (12). 3. The gesture keyboard according to claim 1, characterized in that when the finger cover or the touchpad defines an action, at least 1 to 2 fingers coordinate their actions as follows: Drag and drop (1): In the touchpad (13), place 1 and/or 2 fingers in the upper and lower intervals to be selected simultaneously, one finger moves from left to right from the top, and the other finger stays still below, forming The cursor is inserted in the content area selection. After the gesture recognition action is confirmed, the selected content area will be prompted to drag and drop. At this time, the other finger at the bottom is pushed and pulled from the upper, lower, left, and right areas to the position of the release paragraph, and the finger moving to the right leaves the touchpad area. After dragging and dropping, the other finger can also leave the touchpad area; when using the finger cot, the two fingers are combined to be selected, and when one finger is curled and still, the other finger moves from left to right (separated from the other finger), Form the content area to select the cursor to insert. After the gesture recognition action is confirmed, the selected content area will be prompted to drag and drop. At this time, the curled finger is turned down or lifted up, and the curled finger is pushed and pulled to the release paragraph position. , complete the drag and drop by combining two fingers to the initial state; Zoom out (2): In the touchpad, slide two fingers from top to bottom at the same time; when using the finger cot, merge the two fingers to be selected, and slide the two fingers from top to bottom at the same time; Zoom in (3): In the touchpad, slide two fingers from bottom to top at the same time; when using the finger cot, merge the two fingers to be selected, and slide the two fingers from bottom to top at the same time; Selection (4): In the touchpad, slide two fingers from left to right at the same time; when using the finger cot, combine the two fingers to be selected, and slide the two fingers from left to right at the same time; Copy (5): In the touchpad, one finger moves in an arc from left to right; when using a finger cot, two fingers merge to be selected, and both fingers move in an arc from left to right at the same time; Cut (6): In the touchpad, one finger moves in an arc from right to left; when using a finger cover, two fingers merge to be selected, and both fingers move in an arc from right to left at the same time; Delete (7): In the touchpad, two fingers slide from right to left at the same time; when using finger cots, two fingers are merged to be selected, and two fingers slide from right to left at the same time; Volume up (8): In the touchpad, one finger moves from bottom to top; when using the finger cot, two fingers are combined to be selected, and both fingers move from bottom to top at the same time; Volume reduction (9): In the touchpad, one finger moves from top to bottom; when using the finger cot, two fingers are combined to be selected, and both fingers move from top to bottom at the same time; Left button (10): In the touchpad, one finger (two fingers) moves in an arc from top to left to form a single (double) click of the left button; Move in an arc from up to left; Right button (11): In the touchpad, one finger moves in an arc from top to right; when using a finger cover, two fingers are combined to be selected, and both fingers move in an arc from top to right at the same time; Confirmation (12): In the touchpad, slide two fingers from the left and right sides to the middle of the touchpad; when using the finger cover, open the two fingers and merge the two fingers from the left and right sides to the middle. 4. The gesture keyboard according to claim 1, characterized in that the touch panel (13): the appearance surface has two sections, one section is the finger touch area (14), and the other section is marked with left, right and pulleys (16) The identification auxiliary area (15); through the intermediate circuit (23) to the electromagnetic, voltage and other touch-sensitive circuit components to capture the interval movement mode of the corresponding gesture action, establish a corresponding instruction for auxiliary recognition, and feed back to the operation of the computer; and/or There is a micro-aperture camera (19) on one side of the touchpad (13), and the interval movement mode of the corresponding gesture action is captured by the micro-aperture camera (19), and the corresponding instructions for auxiliary recognition are established and fed back to the operation of the computer; and/or through the finger Covering and blocking the light transmission on the back of the liquid crystal panel in the finger touch area (14) or the touch panel (13) with a light source, resulting in the induction of the light source (temperature) of the thermistor (21) around the finger touch area (13) Irregular changes are analyzed by the auxiliary chain identified by similar resistors as the signal source, and the corresponding instructions for auxiliary recognition are established for the interval movement mode of the corresponding gesture action, which is fed back to the operation of the keyboard system (and/or computer). 5. The gesture keyboard according to claim 1, wherein the finger cover (17) is an electronic tag (18) radio frequency identification (RFID (Radio Frequency IDentification) technology combined with a camera (19) of micro-aperture imaging technology, the micro-aperture The imaging component captures the touch between the fingers to generate a defined action, combined with the distance between the user's two fingers, the radio frequency identification of the electronic tag can be established, and the corresponding instructions for auxiliary identification can be established according to the degaussing between the two merged fingers, and fed back to the Operation of keyboard systems (and/or computers). 6. The gesture keyboard according to claim 1, characterized in that the remote controller (20) is an independent component, which can be used as an auxiliary tool for the keyboard, including: front and back panels; a sensor (22) with multi-axis gravity sensing in the middle, Or the circuit (23) integrates a sensor with multi-axis gravity sensing; the light field sensor (24) around the top can capture the offset of the remote controller's up, down, left, and right movements from the front light beam, establish a corresponding command for auxiliary recognition, and feed it back to the computer or the front and back panels of the remote controller (20) have symbols similar to gestures or text prompts of corresponding instructions. 7. The gesture keyboard according to claim 5 or 6, characterized in that the remote controller (20) is an independent component, and/or is an electronic tag (18) radio frequency identification (RFID (Radio Frequency IDentification) technology and micro-aperture imaging The finger cot (17) combined with technology can be designed as a watch (25); This application has a light field sensor (24), a gravity sensor (22), a micro-aperture camera (19); Through a circuit with a built-in electronic battery, the user's gestures can be connected to the keyboard system in a wireless manner, and corresponding commands for assisting recognition can be established and fed back to the operation of the keyboard system (and/or computer). 8. The gesture keyboard according to claim 7, characterized in that there is a keyboard of a projector (26); the keyboard can be an external voice microphone, and the projector (26) provides corresponding projection for TV card, network (storage medium) video Display, and provide the corresponding data interface for the voice microphone. 9. The gesture keyboard according to claim 1, characterized in that the circuit bus is tapped with a chip, and one of the following schemes can be selected: Or microprocessor (27), data TV card (28); Or microprocessor (27), memory chip (29), display chip (30), sound effect chip (31); Or a microprocessor (27), an integrated optical transceiver module (32); Or microprocessor (27), printing chip (33), storage chip (29), display chip (30), network chip (34), sound effect chip (31); Or a communication radio frequency chip (35), a baseband chip (36), an antenna (37), a SIM card slot or an integrated SIM card (38), and a microprocessor (27); or the technical application scheme includes the selection of the combination of the above technologies. 10. An application method of a gesture keyboard, the steps are as follows: S1. Through the exercise of the user's action model and familiarity with the definition of gesture actions, connect the user's gesture actions with the keyboard system, establish corresponding instructions for auxiliary recognition, and feed back to the operation of the computer and/or the smart keyboard system; S2. Through the software of the gesture keyboard and auxiliary recognition tools (such as remote control, finger cot, wrist watch, touchpad) to analyze the user's gesture action behavior, error correction, reminder, recording, and enhance the efficiency of use; S3. The process of use, analyze the use behavior, compile and execute the software that meets the gesture recognition application, and increase the scope of gesture recognition use; S4. Through feedback to users, based on the principles of the above technologies, strengthen the improvement of existing gesture recognition technology hardware; S5. Complete.

Images