HK1054821B

HK1054821B - Integrated keypad system

Info

Publication number: HK1054821B
Application number: HK03107047.5A
Authority: HK
Inventors: 菲罗兹‧加萨比安
Original assignee: 菲罗兹‧加萨比安
Priority date: 1999-10-27
Filing date: 2000-10-27
Publication date: 2009-06-19

Description

Integrated keypad system

Cross reference to related application

This application is based on the following U.S. provisional patent applications filed by the applicant and claiming priority: serial No.60/163,996 (filed on 27.10.1999), Serial No.60/164,656 (filed on 4.11.1999), Serial No.60/164,597 (filed on 10.11.1999), Serial No.60/169,149 (filed on 6.12.1999), Serial No.60/194,767 (filed on 3.4.2000), Serial No.60/208,619 (filed on 1.6.2000), and Serial No.60/220,578 (filed on 25.7.25.2000). The entire disclosures of all of the above applications are hereby incorporated by reference in their entirety.

Technical Field

The present invention relates to keypads, finger, palm, voice, lip, face and other detection systems, and more particularly, to a keypad (e.g., a standard telephone keypad) with key recognition devices that can be used in conjunction with the above recognition systems in order to provide full text and function input in a natural, convenient and quick manner.

Background

Miniaturization has been a key factor in recent technological advances, and many devices have been manufactured that, without miniaturization, would be impractical for reasons of size only. Therefore, our current desktop computers are much more powerful and smaller than their predecessor mainframes. Also, digital clocks, video games and commonly used appliances further present the benefits of miniaturization. In fact, it is the essence of portable computers and cell phones, for example, that it is their size as a primary feature.

However, the development of miniaturization in several areas has faced a number of obstacles, primarily due to human constraints. For example, it may be desirable to have a portable computer that can be placed in a purse, but such a computer cannot be used without a large input device to enable a person to operate the computer. In other words, sophisticated microcomputers and certain devices, such as cell phones (which are now also used for internet access, e-mail, mobile commerce, SMS (short message service), etc.), notebooks and PDAs, require a keyboard, keypad or other input device to enable a user to enter a telephone number, send an e-mail or transcribe a letter, etc. Therefore, even though the degree of progress in miniaturization technology may be achieved, some devices may not be truly miniaturized due to human factors.

It is well known that for a successful technical product, a key feature is its ease of handling. For the above mentioned appliances and similar devices a quick, convenient and above all natural full text and function input system is essential.

For small electronic and communication appliances, the telephone-type keypad familiar to the public is the most common input device. It is integrated in many electronic devices such as mobile and stationary phones, PDAs, notebooks, laptops, fax machines, television remote controls or other electronic devices, cameras, etc. Such keypads typically have 12 keys, however the number of characters and function keys used to write text or information may be 7 times that number. For example, a computer keyboard has more than 80 keys, and some keys also serve as two characters, symbols, or functions.

Because of the insufficient number of keys on a telephone keypad (e.g., a handset keypad), each key on a standard telephone keypad contains a set of characters and typically a number. Consumers are very paying a lot when surfing the internet or even inputting a short message.

How to quickly and conveniently enter text and functions when using small communication devices? Some solutions have been proposed to address this basic human-machine interface problem.

One solution is to press a single key multiple times to select one of the letters or symbols it represents. Such systems are currently used for the keypads of most cell phones. This is a time consuming method that is frustrating to the user.

To improve such systems, software products for word disambiguation were developed. A thesaurus database and language model are used to scan and suggest possible words based on the key pressed. The user then selects the desired word among the possible options prompted. This approach also creates a number of problems, such as words that go beyond the vocabulary, and forces the user to concentrate on selecting a desired word. Furthermore, entering numbers or single characters is a time consuming process. To exploit this problem, miniaturized external keyboards have also been produced, but this forces users to carry two different appliances, contrary to the basic concept of small electronic products, portability.

One new technique that attempts to overcome this limitation is speech/voice recognition technology. The process of speech recognition is to recognize one or more speech patterns from a person's speech as corresponding computer input commands, words or functions. For example, instead of typing a letter on the keyboard, a user speaks the letter and the recognition device associates the speech pattern of the letter to the computer input character to which the letter corresponds. Thus, an individual can operate the device without an input device in this manner, as the user's voice provides all of the input. Unfortunately, given the many complex characteristics of a person's voice, none of the recognition devices recognize speech patterns with sufficient accuracy to completely replace input devices.

In addition, there are several letters, such as "B" and "P", and "D" and "T", that can be easily confused in the speech engine. This is not a deficiency of the engine as these letters are also confusing. Some of the problems and disadvantages associated with speech/language recognition systems are listed below:

● is used only for language and is mostly English

● recognizing only one person's voice

● eliminate noise interference (especially when using mobile telecommunication devices)

● devices with small displays are not effective because of the inconvenience of modification (especially when using devices with small LCDs, such as cell phones)

● speaking a single word (discrete speech), many errors may occur

● homophones (e.g. two, to)

● not predicting the user's intention when writing numbers (e.g., twenty-four, 24)

● blending written numbers and symbols (e.g., six by four, 6 by 4,6 x 4) does not predict the user's intent

● difficulty in distinguishing letters (man B, P)

In addition, portable and other electronic devices, while addressing miniaturization issues, have many safety and efficiency issues. For example, a person forgets or loses a cell phone and must fire off its communication services before a thief or other person can use the phone to incur an unauthorized charge. One known method of preventing such unauthorized use is to lock the handset or other device with a cryptographic system. While effective in many cases, this system makes the real owner laborious and inefficient who must activate the handset through a lengthy process before dialing. Also, there is no simple way to prevent unauthorized use of many electronic devices, other than first locking the device with a cryptographic system or other time consuming and inefficient process.

What is needed, therefore, is a technique to address the above-mentioned challenges posed by the person's own constraints, so that miniaturization continues to realize its true potential. In addition, such techniques should also provide a more secure and efficient mechanism for preventing unauthorized use of the device, as well as other hazards, than the prior art. Also, there is a need to improve the reliability of speech recognition techniques. The required data entry method is preferably performed character by character using a conventional, limited number of keys input device (e.g. telephone keypad) where each key contains a set of characters, symbols and commands available on a computer keyboard or similar device, in combination with some other recognition system such as fingers, voice, lips, eyes, face, etc. to determine the individual character from the input operation of the individual key.

Disclosure of Invention

According to a first aspect of the present invention, there is provided a data entry system comprising: a predetermined number of keys for entering at least a plurality of characters character by said keys, wherein said data entry system uses a number of symbols, said symbols comprising at least the letters of the alphabet of at least one language, and wherein said symbols are assigned to said keys such that at least two of said letters are assigned to at least one of said keys, and wherein the symbols assigned to a key are entered such that: providing predetermined interactions with the keys on the keys and providing speech information corresponding to the symbols for selecting the symbols among the symbols assigned to the keys, wherein the speech information is detected and analyzed based on at least one of the user's voice and the user's lip movements.

According to a second aspect of the present invention, there is provided a data entry system for entering at least an arbitrary character, the system comprising: a number of keys; and a number of symbols assigned to said keys, wherein said symbols comprise at least alphabet letters of at least one language, additional symbols comprise at least one of numeric symbols, punctuation characters, commands and functions, wherein said symbols are assigned to said keys such that the number of said alphabet letters of said at least one language is larger than the number of keys to which said letters are assigned, and wherein said data input system has at least a first type of input procedure for inputting symbols assigned to one of said keys, wherein said at least one first type of procedure comprises: providing a predetermined type of interaction with said key, such as a predetermined press operation on said key, wherein said predetermined type of interaction is at least one predetermined type of interaction with said key; and providing a predetermined speech corresponding to the symbols, wherein any two symbols assigned to a key that are input with the same predetermined type of interaction with the key have different assigned predetermined speech, the speech being detected and analyzed based on at least one of a user's voice and a user's lip movements.

According to a third aspect of the present invention there is provided an input data input system comprising: a predetermined number of keys for inputting at least any character via said keys, wherein said data input system uses a number of symbols comprising at least the letters of the alphabet of at least one language, and wherein said symbols are assigned to said keys such that at least two of said letters of said at least one language are assigned to at least one of said keys, and wherein the symbols assigned to the keys form at least one set of symbols comprising at least one of said symbols, each of said at least one set of symbols of a key being assigned to one of at least one predetermined type of interaction with said key, such as one of at least one type of press-down operation on said key, and wherein the symbols of a set of said sets of symbols of said key are input such that: providing the predetermined interaction with the key corresponding to the set of symbols, and providing speech information corresponding to the symbols for selecting the symbols among the set of symbols of the key, wherein the speech information is detected and analyzed based on at least one of a user's voice and a user's lip movements.

According to a fourth aspect of the present invention there is provided a data entry system for entering at least a plurality of characters on a character-by-character basis, wherein: the data input system uses a number of symbols comprising at least letters of the alphabet of at least one language, and wherein the symbols are assigned to a number of press-down operations on different locations on a touch-sensitive surface such that at least two of the letters are assigned to a press-down operation on one of the locations on the surface, and wherein, based on the location of the press-down operation on one of the locations on the surface in relation to the location of at least one other press-down operation on a different location on the surface, the system identifies the press-down operation assigned to said one of the locations on the surface, and wherein the symbol assigned to the press-down operation on said one of the locations on the surface is entered such that: providing the pressing operation on the one of the positions on the surface and providing speech information corresponding to the symbols to select the symbols between symbols assigned to the pressing operation on the one of the positions on the surface, wherein the speech information is detected and analyzed based on at least one of a voice of a user and an action of a lip of the user.

A fingerprint sensing device is provided that includes one or more electronic pads configured to identify differences in patterns for each finger of a user. Such patterns relate to finger characteristics (such as size, shape, color, etc.) of the entire finger or portions of the finger. Such patterns are also associated with other information, such as the characteristics of the finger tip surface (fingerprint, size, shape), the characteristics of the nail (shape, size, gloss), and so forth. Such pattern differences may also be used for communication, so that human input may be communicated to an electronic device by the process of touching the fingerprint detection device with a human finger. Thus, a person may use his finger in conjunction with the fingerprint detection device to enter a telephone number into the telephone device, to enter characters into a computer, to trigger various macros or functions on the PDA, and so on.

The fingerprint sensing device must initially be trained or "taught" so that it maps a particular finger to a corresponding symbol or function, such as a number, letter, macro or other action. For example, this method may be used to map a different digit to each of a person's fingers (e.g., digits 0 through 9 constitute 10 digits, which may correspond to each of a person's ten fingers), and then a telephone number may be dialed using only one person's hand and one fingerboard. This saves space and only requires one pad to replace many number keys.

It is noted that more than one symbol or function may be mapped to each finger. For example, according to one embodiment of the invention, the fingerprint detection device is configured to interpret that two consecutive taps of a particular finger correspond to one number, while one tap of the same finger may correspond to another number.

It will be readily seen that tapping once with the index finger may correspond to the number "2" and tapping twice with the same finger may correspond to the number "7". Thus, a total of ten digits can be entered using one hand and a fingerprint pad. Also, this method can be generalized to input letters, symbols, or other functions.

In other embodiments, each finger maps to a different symbol or function depending on the position of the finger, such as a different corner of the electronic pad. Therefore, a tap at the upper right corner of the electronic pad will interpret the result differently than at the lower right corner, and so on. More than one shim plate may be provided to achieve this purpose if desired.

One of the main advantages of such a fingerprint detection device is its small size. In this way, instead of a large numeric keypad on the phone, a smaller fingerprint pad can be used. Also, the keyboard of the computer, and the PDA input device, etc. may be replaced or modified.

According to one embodiment of the invention, the fingerprint detection device is configured to distinguish the fingers from the fingerprint. Thus, it provides a security safeguard for the user, since the fingerboard can only be operated with specific fingers, which is of no use in the hands of unauthorized users.

According to another embodiment, the finger detecting means detects biological differences between the finger features by means of non-fingerprint detection. These biological differences include size, shape, location, temperature, and the like. For example, the finger detecting device is configured to quickly distinguish between different fingers based on size and shape. This process avoids the lengthy and complex task of scanning all or part of a fingerprint. It will be appreciated that different detection systems and devices may be used for identifying fingerprints and biometric characteristics of the finger, such as any kind of sensitive touch pad, touch screen, heat, light or other identification methods.

In accordance with yet another embodiment of the present invention, the detection device is configured to accept multiple forms of input to improve accuracy and ease of use. For example, the detecting means may be configured as a device that is both finger detecting and speech recognition, characterized in that the detecting means determines a corresponding character or function based on two mode inputs of a person's finger and speech.

Not only does this approach improve accuracy, it also enables people to more easily enter distinct characters, words, and/or functions. For example, without this method, when a person wants to input alphanumeric characters with their fingers, each finger must be assigned three or more letters or symbols, because there are many more letters and numbers than there are human fingers. Therefore, it is not sufficient to tap only one's finger when inputting a character, because the input device still needs to distinguish between several characters assigned to this finger. Thus, providing multiple forms of input solves this problem. When a person places a finger on the detection plate, he or she can also say the desired letter or function. The person's voice enables the detection means to distinguish between a number of characters assigned to a particular finger. Furthermore, since the finger detecting device narrows down the voice recognition from a large range to one of the digraphic letters and symbols, the limitation of the voice recognition is avoided. For example, with such a system, in conjunction with the character arrangement of the telephone keypad, the speech recognition engine will not mistake the letters "B" and "P" because they are located in two different groups (e.g., keys) 2 and 7, respectively. The letters "D" and "T" are also located at keys 3 and 8, respectively.

It should be appreciated that the embodiments described above may be configured to use speech recognition with any of the finger detecting devices described herein. For example, speech recognition may be combined with the operation of fingerprint detection. The voice recognition may further be combined with a finger detection operation based on a biometric feature rather than a fingerprint. It may also be configured to operate with the optical scanning device described herein, and the like.

The foregoing description has set forth rather broadly the important features of the present invention in order that the detailed description thereof that follows may be understood, and in order that the present contribution to the art may be better appreciated. Other objects and features of the present invention will become apparent from the following detailed descriptions considered in conjunction with the accompanying drawings. It is to be understood, however, that the drawings are designed solely for purposes of illustration and not as a definition of the limits of the invention, for which reference should be made to the appended claims.

Detailed description of the drawings

In the drawings, like reference characters designate like elements throughout the several views:

FIG. 1 illustrates a fingerprint detection interface capable of inputting numbers, letters, or other symbols and commands to a device through fingerprints or other biological differences between fingers, according to one embodiment of the present invention;

FIG. 2 is a mapping table portion of a database illustrating that a particular finger is logically mapped to one or more corresponding functions or symbols in accordance with one embodiment of the present invention;

FIG. 3 is a watch with a fingerprint detection pad, so that the watch may be configured as a radio, telephone, or other device without a control panel, numeric keypad, or other cumbersome input device, in accordance with one embodiment of the present invention;

FIG. 4 is a block diagram of a calculator with a fingerprint detection pad so that functions or other commands can be input through fingerprint detection according to an embodiment of the present invention;

FIG. 5 illustrates the fingerprint detection interface of FIG. 1 having four fingerprint plates in accordance with one embodiment of the present invention;

FIG. 6a is a diagram of a wrist-mounted telephone device having a fingerprint pad for dialing in place of a numeric keypad in accordance with one embodiment of the present invention;

FIG. 6b shows the wrist phone device of FIG. 6a with two finger pads for additional functionality in accordance with one embodiment of the present invention;

FIG. 7 illustrates an optical finger detection device for capturing an image of a finger, palm or portion of a finger or palm for detecting a particular corresponding character, number, function or command in accordance with one embodiment of the present invention;

FIG. 8 shows a detection device that includes both optical finger detection and speech recognition methods in accordance with one embodiment of the present invention;

FIG. 9 illustrates a finger map in accordance with one embodiment of the present invention;

FIG. 10 shows a telephone keypad with a speech recognition device according to an embodiment of the present invention;

FIG. 11 shows a front view of a conventional keyboard;

FIG. 11a shows a fingerboard detection device configured to enhance a keyboard and/or display device in accordance with an embodiment of the present invention;

FIG. 12 shows a front view of a telephone keypad;

FIG. 13 illustrates an enhanced keypad apparatus having multiple configurations in accordance with an embodiment of the present invention;

FIG. 13a shows an illustrative view of the enhanced keypad used in FIG. 13 in accordance with one embodiment of the present invention;

FIG. 14 shows an enhanced keypad with lip, voice and other input and recognition methods in accordance with an embodiment of the present invention;

FIG. 14a shows an enhanced keypad with lip, voice and other input and recognition methods according to another embodiment of the present invention;

FIG. 14b shows an enhanced keypad with lip, voice and other input and recognition methods in accordance with another embodiment of the present invention;

FIG. 14c shows an enhanced keypad with lip, voice and other input and recognition methods in accordance with another embodiment of the present invention;

FIG. 14d illustrates an arrangement of keys forming an enhanced keypad, using the recognition technique of FIG. 14b, in accordance with one embodiment of the present invention;

FIG. 14e illustrates an arrangement of keys forming an enhanced keypad using the recognition technique of FIG. 14b, in accordance with one embodiment of the present invention;

FIG. 15 shows an enhanced keypad including light sensors and pressure sensing means in accordance with one embodiment of the present invention;

FIG. 15b illustrates one key arrangement constituting an enhanced keypad, in accordance with one embodiment of the present invention;

FIG. 15c shows an arrangement of keys forming an enhanced keypad, in accordance with one embodiment of the present invention;

FIG. 16 shows a multi-chip LCD incorporating an enhanced keypad, in accordance with one embodiment of the present invention;

FIG. 16a shows an LCD device, sized like a credit card, according to one embodiment of the present invention;

FIG. 16b shows a multi-chip type LCD according to an embodiment of the present invention;

FIG. 16c shows a multi-chip type LCD according to one embodiment of the present invention;

FIG. 16d shows a multi-chip type LCD including an enhanced keypad, in accordance with one embodiment of the present invention;

FIG. 16e shows a credit card sized computer with a multi-piece LCD and enhanced keypad in accordance with one embodiment of the present invention;

FIG. 16g shows a credit card sized computer and telecommunications device in accordance with an embodiment of the present invention;

FIG. 17 shows a large LCD panel with multiple hinges to increase the number of folds and increase miniaturization;

FIG. 18 shows a watch phone and PDA that includes a hidden, enhanced keypad with a locking mechanism in accordance with an embodiment of the present invention;

FIG. 19 shows an enhanced keypad apparatus having two keypads, according to an embodiment of the present invention;

FIG. 20 shows an enhanced keypad apparatus having a detachable handset including a display panel in accordance with one embodiment of the present invention;

FIG. 21 shows a handset device with a display panel on the rear of the handset, in accordance with an embodiment of the invention;

FIG. 22 illustrates a handset device configured to be detachably connected to the enhanced keypad device of FIG. 20, in accordance with one embodiment of the invention.

FIG. 23 shows a flowchart relating to the general steps of a character, symbol and function recognition system, in accordance with a preferred embodiment.

FIG. 24 shows a flowchart of steps involved in alphabetic character and symbol recognition in accordance with a preferred embodiment.

FIG. 25 shows a flowchart of steps involved in numeric character and symbol recognition, in accordance with a preferred embodiment.

FIG. 26 shows a flowchart relating to the steps of command and function recognition, in accordance with a preferred embodiment.

FIG. 27a shows a key on an enhanced keypad using a click sensing mat according to one embodiment of the present invention.

FIG. 27b shows a key on an enhanced keypad using a click sensing mat, in accordance with one embodiment of the present invention.

FIG. 28 illustrates a key on an enhanced keypad using a click sensing mat according to one embodiment of the present invention.

FIG. 29a shows an enhanced multi-piece keypad according to one embodiment of the present invention.

FIG. 29b shows an enhanced multi-sheet keypad with an LCD according to one embodiment of the present invention.

FIG. 29c shows an enhanced multi-pad keypad in a closed position in accordance with one embodiment of the present invention.

Detailed description of the invention

Referring initially to FIG. 1, the fingerprint detection interface 100 includes a fingerprint detection pad 126 configured to identify differences in patterns of each finger of a user, according to one embodiment of the present invention. This pattern difference can be used for communication, so that the human input can be transmitted to an electronic device electronically by the process of touching the fingerprint detection device with a finger.

According to one embodiment of the present invention, the fingerprint detection interface 100 further includes a display 122, indicator lights 124, command buttons 128 and 136, switches 138, and wireless communication device 126. Briefly, a person touches the fingerprint detection pad 126 with a plurality of fingers, such as finger 102 and finger 120, to provide an input signal, and the fingerprint detection device 100 transmits the input signal to another device, such as a phone or computer, via the communication device 126. The type of input signal provided depends on a combination of several factors, including which finger or which part of a finger is used, and what action this finger has taken. For example, a person may tap twice with their right thumb to provide one signal and a second tap with their left index finger to provide the other signal. The method and use of such fingerprint detection will be described in more detail below. Therefore, the fingerprint detection device can be used to replace a more bulky computer keyboard, a telephone keypad or any other input device.

With continued reference to FIG. 1, a display screen 122 is provided as an optional, visual indication of the progress of the fingerprint detection. For example, when a person enters a telephone number through a fingerprint device, the person can see that the detected telephone number is displayed on the display screen. According to one embodiment of the invention the display is provided as a buffer, characterized in that the person can observe the display to correct any errors and finally transfer the information in the buffer to a corresponding device, such as a telephone. As will be explained below, command buttons 132 and 134 may be used for this purpose.

Additionally, the indicator light 124 may be configured to flash and/or beep to indicate operation of the fingerprint device. Therefore, when a person uses the fingerprint plate, the display screen can not be seen, and when the fingerprint detection process of each finger is finished, the indicating lamp can flash or buzz. This provides the user with an indication signal so he or she can proceed with another finger action or signal input.

As described above, command buttons 128 and 136 provide several useful functions. For example, command buttons 128 and 130 may be used to initialize and schedule the device. It will be appreciated that the fingerprint sensing device must be trained or "taught" so that it maps a particular fingerprint to a corresponding symbol or function, such as a number, letter, macro or other action. Therefore, the command buttons 128 and 130 may act as record and select buttons, and thus may select one or more symbols or functions to be mapped to a particular fingerprint. In addition, command buttons 132 and 134 may be used to clear and transfer information in the buffer or on the display screen, respectively. Similarly, command button 136 may instruct the fingerprinting device to bypass the buffer system and transfer all information directly to the corresponding device, such as a telephone. Of course, in one embodiment, there may be no command buttons and all of the system's functions are implemented by the fingerprint board.

In addition, the switch 138 provides additional functionality, such as a power switch, a detection mode switch, a personal user switch, and the like. For example, a fingerprint device may be designed to map fingerprints of more than one person. To improve efficiency, one of these switches may be configured to indicate which person is using the fingerprint device, which limits the number of fingerprints that must be matched, thereby reducing the processing time of the device. Furthermore, a detection mode switch may be utilized to indicate primary purposes, such as whether a fingerprint should be interpreted as a number, letter, function, and the like. The switch may, therefore, inform the device to map a single tap of a finger to a common letter when a letter is entered, to map a single tap of a finger to a number when a phone number is dialed, and so on,

it should be understood that the illustrated fingerprint device is merely one embodiment of the present invention and is not so limited. In another embodiment, the fingerprint device may be incorporated as a component in a computer or telephone rather than a separate external device. In addition, any other technique may be used in addition to wireless communication.

Referring to fig. 2, a mapping table 200 is shown that illustrates how a database system may map individual fingerprints to one or more corresponding symbols or functions. The mapping table 200 according to one embodiment is shown to include a fingerprint ID index 202 to store fingerprints in the form of numeric identification numbers, such as identification number 212. In addition, the mapping table 200 further includes a mapping index 204 and 210 for assigning a specific action to a symbol or function.

For example, one tap with one finger may produce the number "0" and two consecutive taps with the same finger may produce the number "6" corresponding to identification number 212. In turn, all ten digits can be entered with one hand and a piece of the fingerprint pad, using only one tap and two consecutive taps. Also, this method may be generalized to entering letters, symbols, or other functions, such as using a shuffle action 210, and so forth.

Of course, the mapping table may be informed to map only one of several fingers, in whole or in part, if desired. Also, the mapping table may assign the same function or symbol to multiple fingers or the same finger of the corresponding hand, and so on.

It is noted that the mapping table of fig. 2 may be stored in the local fingerprint device, in a remote database system, or even centralized at a central station. Indeed, the storage of the mapping data at the central station enables one to use almost any fingerprint device within range of the central station without having to retrain its fingerprint code. Of course, this feature may compromise some of the security benefits of the fingerprint device.

Referring to fig. 3, a conventional wristwatch 300 is shown having a fingerprint detection plate 302. According to this embodiment, the plate may incorporate a telephone, radio or other device in the watch without having to include a bulky input device. Therefore, the user 306 can use such a watch as a telephone or the like without difficulty after wearing the headphone/microphone 304.

Also, referring to fig. 4, a calculator 400 is shown having a fingerprint detection pad 404, as well as a display screen 402 and command buttons 406. Thus, with the fingerprint plate, a small calculator can now incorporate more functionality than many scientific or computer-type calculators in a much smaller space. Similar to the methods used above, here a variety of fingerprints and actions can be mapped onto several functions and mathematical computations.

FIG. 5 illustrates a fingerprint detection device 500 similar to the device 100 of FIG. 1, but with four fingerprint plates 502 and 508. According to one embodiment, rather than using different actions, such as two taps or double taps in succession, the user may use multiple pieces of the fingerprint pad to correspond to different symbols or functions. Of course, such a device may use both multiple pieces of fingerprint board, multiple motions, and other functions. Also, instead of having four fingerprint plates, one fingerprint plate may be used, but with sensors in each of the four corners of the plate.

Fig. 6a illustrates a wrist-worn telephone device 600. Rather than having a cumbersome numeric keypad to dial a telephone number, a piece of fingerprint board 602, and optionally command buttons 604, are used to accomplish the same task in a smaller space.

Similarly, FIG. 6b shows another wrist-mounted telephone device 650, but with two finger-print pads 652 and 654, and an optional command button 656. As described above, the addition of one or more fingerprint plates may be configured to increase usability, and the like. Such a fingerprint board is more convenient than a large numeric keypad, especially as such a wrist-mounted device.

It will be appreciated that the fingerprint detection apparatus described above and herein may be configured to operate in one of a number of environments. For example, different fingers may be mapped to several notes, and one may tap one's finger on the fingerboard to play music. Depending on the embodiment, seven fingers may be assigned to seven different notes or more, different fingerprint panels or different parts of a finger or a piece of fingerprint panel may be assigned to higher or lower tones, and so on.

In yet another embodiment, the fingerprint device may be configured to scan only a very small portion of a human finger, rather than the entire finger. In this embodiment, the device need not relate to a security metric, but rather to distinguishing one finger from another, or a portion of one finger from another portion of the same finger or another finger. Thus, only a minimum range needs to be scanned just enough to know which finger or which part is used. Of course, the device may also be configured to scan more or less depending on safety and speed priorities.

In yet another embodiment of the present invention, a device may be configured to scan a person for biological differences between their fingers, rather than fingerprints. These biological differences include size, shape, location, temperature, and the like. For example, fingerprint detection devices are configured to quickly distinguish between different fingers based on size and shape, and the like. This process avoids the lengthy and complex task of scanning all or part of a fingerprint.

According to one embodiment, this process of scanning for biological differences involves merely distinguishing between individual fingers of a person. Therefore, the fingerprint detection device only needs to interpret the shape and/or size of one finger, for example, to distinguish one thumb or part of one thumb from one index finger or part of one index finger from five fingers of one hand or ten fingers of two hands. This is a simpler and faster task than having to distinguish one person's thumb from another. This may be accomplished through a database containing information for a plurality of thumbs, index fingers, etc. When a person touches the fingerprint plate, the detection means matches this finger with a number of "template" fingers in the database. For example, a finger closest to a thumb may be classified as a thumb, and so on. Of course, different people may train or "teach" the system to recognize their fingers more efficiently.

Referring to FIG. 7, a finger telemetry device 700 is shown, in accordance with yet another embodiment of the present invention. The detection device 700 includes an optical or other scanning device 702 to detect and scan the finger and finger motion, rather than the fingerprint plate of the above-described embodiment. The operation of the scanning device 702 is to take an image of a finger or a portion of a finger, such as the finger 704, and analyze the finger image against a database of finger images to determine if the finger is a thumb, forefinger, etc. Such databases are customized to the shape or variety of the user's fingers, based on known biological differences between the various fingers of one hand.

Thus, one can dial a telephone number or enter characters without touching the pad but by scanning the device. In fact, a person's finger may be configured as a remote control, characterized in that the scanning device is connected to a device, such as a television set. For example, a person may send a signal with finger 704 indicating that the volume of the television should be increased. Likewise, another finger may operate the channel control of the television. Indeed, the remote scanning device may be located in any one or more of an appliance, a light switch, a plumbing fixture, and the like. To avoid an endless activation of the detection device, one can point or signal with a desired finger, so that the detection device knows that it should start scanning.

With continued reference to FIG. 7, scan lines 706-712 illustrate the scanning and detection process of one embodiment of the present invention. For example, one scanning method includes configuring the scanning device 702 to normally scan the entire finger 704 via the normal scan lines 706-710. As described above, this process compares the image of the entire scanned thumb to other types or customized images of thumbs in the database. Other factors, such as shape and position, may also be considered during the scanning process. Another scanning method configures the scanning device 702 to narrowly scan the finger 704 such that only a portion of the finger 704 is scanned, e.g., using only scan lines 706 and 708. This is a faster and potentially more efficient process because only a small portion of the finger is scanned. Yet another approach configures the scanning device 702 to broadly scan the entire palm or a portion of the palm, e.g., using scan lines 706 and 712. This process allows the detection device to see a larger image to better identify the finger 704. For example, the scanning device may see finger 704 to the right of the other four fingers of one hand, and thus necessarily a thumb. This process may also be used to detect other fingers of one hand, etc.

It will be appreciated that there are many ways in which a finger, or different parts of a finger, may be detected and identified by the system of the invention, and that the above embodiments are only examples of some of these ways. For example, according to one embodiment of the present invention, nail detection may be used, wherein different fingers are identified based on differences in nail structure, size, or appearance.

It will be appreciated that in order to enhance the security of the device, in accordance with one embodiment of the present invention, the scanning means may be trained or "taught" to better recognize the image of a human finger. One such training method includes scanning each of a human finger from several angles to produce a three-dimensional computer image of the scanned finger. This process enables the fingerprint detection device to better detect a finger or portions thereof, whether it is lying on its side or on its side, and other variations, because it is a complete image of the angle at which the finger is angled. In addition, according to one embodiment, each finger may be assigned to a different character or function based on its position and orientation, such as forward or sideways.

According to one embodiment, another way to indicate a finger command is to first place the finger normally, and perform a regular scan and/or detection. The handle is then swung sideways or up to indicate a different input command, etc.

Furthermore, according to another embodiment, multiple fingers may be used in common in addition to being used separately. For example, the index finger may correspond to one letter or number, the thumb may correspond to another, and the use of the thumb and index finger together may correspond to yet another character, number, or the like.

According to another embodiment, the scanning device may be used in conjunction with a backing plate. Therefore, scanning begins before one's finger touches the pad, but does not complete until the finger touches the pad. This feature is desirable to ensure that inadvertent finger motion does not activate the detection means. In addition, for example, a person dialing a telephone number may feel more comfortable if a pad or other platform rests their fingers. It should be understood that scanning can be performed by the pad itself (e.g., all kinds of sensitive pads), producing a two-dimensional or three-dimensional image. These images may be assigned to different symbols or functions. For example, touching a pad with one finger in an upward position (e.g., a fingertip) may correspond to one function or character, while the same or another finger in a regular position (e.g., flat) may correspond to another function or number.

This approach not only improves accuracy, it also enables people to more conveniently enter distinct characters and/or functions. For example, without this method, when a person wants to input alphanumeric characters with their fingers, each finger must be assigned three or more letters or symbols, because there are many more letters and numbers than there are human fingers. Therefore, it is not sufficient to tap only one's finger when inputting a character, because the input device still needs to distinguish between several characters assigned to this finger. Thus, providing multiple forms of input solves this problem.

When a person places a finger on the detection plate, he or she can also say the desired letter or function. The person's voice enables the detection means to distinguish between a number of characters assigned to a particular finger. Furthermore, since the finger detecting device narrows down the voice recognition from a large range to one of the digraphic letters and symbols, the limitation of the voice recognition is avoided.

Moreover, from a processing point of view, it is also beneficial to use multiple forms of input. For example, even if only one function or character is assigned to each finger, using speech recognition provides how to manipulate the orientation of the finger, thereby relieving the finger detecting device of burden. Therefore, the detection device can utilize the information of the voice recognition device and the finger recognition device so as to focus on an accurate detection result more quickly and accurately.

Referring to FIG. 8, the detection apparatus 800 is shown, in accordance with one embodiment of the present invention. The detection device 800 includes an optical scanning device 802 for detecting and scanning the finger and the finger motion, as discussed in relation to fig. 7. In addition, FIG. 8 also includes a speech recognition device 804 for detecting speech patterns, and a display screen 806.

For example, one method of providing input through the detection device 800 is to first scan a finger, such as the finger 808, with the optical device 802. It should be appreciated that in another embodiment, speech recognition or another form of scanning may be performed first. Then, in response to the recognition means, the display 806 displays one or more letters, symbols or functions associated with this finger. For example, the finger 808 may be associated with the number 2, the letter A, B, C, and the symbol @. It should be understood that the method of this embodiment may also be configured without the display 806. There are several options for this person, such as lady 810. One option is to tap the finger 808 one or more times to indicate which of the four characters or symbols was selected. Another option may be to stop the finger 808 until the desired character or symbol blinks or another indication is provided. Another option might be to use speech recognition, as described above. In accordance with this selection, the woman 810 provides a voice sample corresponding to the desired character or symbol, which the detection device 800 selects via the voice recognition device 804.

This process overcomes many of the limitations of finger and voice detection techniques. The device is able to better separate and determine the corresponding characters or functions, etc. through two forms of input, such as speech and finger modes. For example, the limitation of inaccurate speech recognition is substantially avoided since the speech recognition means is only required to select from a small list of characters and/or symbols.

Indeed, according to one embodiment of the invention, one of the input forms may be through a numeric keypad or other standard means, such as a telephone keypad. Referring to fig. 10, a telephone keypad 1000 is shown having nine keys, such as key 1020, and a speech recognition device 1040. Therefore, by providing, for example, a speech detector on the keyboard for input recognition, a person can more easily select a letter or symbol. For example, instead of having to press two or more keys, a person may press the number "3" (1020) and say "E" through key 1020 to select the letter "E" on the telephone keypad. This is a fast, convenient, and most importantly a natural system for selecting a letter.

It should be appreciated that the above-described embodiments may be further configured to use speech recognition with any of the finger detecting devices described herein. For example, speech recognition may be combined with fingerprint detection. Speech recognition may also be further combined with finger detection based on biological features rather than fingerprints. In addition to the optical scanning device described in fig. 8, the speech recognition may also be configured to cooperate with any other device, such as a gaze indication recognition system.

It is noted that, according to one embodiment of the present invention, one finger detecting device may be configured to assign all commonly used symbols and characters among ten fingers on one human hand. By way of example, FIG. 9 shows an example mapping table that maps all numbers, letters, and many symbols to different fingers on a hand. It should be understood that there are many other mapping forms and tables, according to another embodiment of the present invention.

According to yet another embodiment, the fingerboard detection device of the present invention can be configured as a keyboard. For example, referring to FIG. 11, a layout 1100 of a conventional keyboard having a plurality of keys is shown. This conventional arrangement has several disadvantages. For example, although most typists are familiar with the layout and location of the various keys on the keyboard, the hands still need to be in place before beginning the typing operation. Therefore, a typist must initially place the little finger of his left hand on the letter "A", the ring finger on "S", and so on. Once this initial position is set, a typing action can be initiated, wherein an experienced typist knows which keys to press based on their relative positions to the initial finger positions. By using this technique, the user does not need to look at the keyboard, thereby speeding up the typing process. Unfortunately, many typists tend to make mistakes in the initial digit, such as by mistake placing a little finger over the letter "S". This results in a wrong initial position, e.g. each finger misses a key to the right compared to the correct position. Thus, the input of the entire typing operation can only produce a troublesome output, since the key to be pressed is erroneously replaced by an adjacent key.

Referring to FIG. 11a, a fingerboard keyboard 1102 is shown having a piece of center fingerboard member 1104 and five peripheral fingerboard members 1106 and 1114, in accordance with one embodiment of the present invention. The addition of the fingerboard members 1104 and 1114 overcomes the limitations of the conventional keyboard 1100 due to the added use of finger detection. So, by finger detection, for example, the little finger of the left hand can be permanently assigned to the letter "A", the ring finger to the letter "S", and so on. Rather than placing a finger on the appropriate key on the keyboard as described above, the location of the key is dynamically calibrated based on the placement of the finger on the fingerboard.

Indeed, the center finger pad member 1104 does not have keys but rather is a flat plate. Initially, when a typist places his or her finger on the center fingerboard, the detection device calibrates the position of the keys based on the position of the person's corresponding finger. So, the typist can assign "Q", "A", and "Z" to his left little finger. After calibration, the position of the typist's little finger will correspond to the letter "A", while the left hand little finger will touch the positions above and below the letter "A", the areas will correspond to the letters "Q" and "Z", respectively. Likewise, the left index finger may be assigned a plurality of letters, such as "F", "G", "T", "V", and so on. The center fingerboard dynamically determines which key was pressed using finger detection and calibration positions. According to one embodiment, the keyboard recalibrates the key positions each time a person's hand leaves the fingerboard keyboard.

According to one embodiment of the present invention, the peripheral finger plate members 1106 and 1114 correspond to a variety of functions. For example, with a right hand little finger touch, the fingerboard assembly 1108 may correspond to the "Shift" key on a conventional keyboard. Similarly, fingerboard piece 1110 may correspond to the space bar on a conventional keyboard when touched with a thumb. Additionally, according to one embodiment, touching any of the fingerboard members with a thumb may correspond to a space bar.

In accordance with yet another embodiment of the present invention, center finger plate member 1104 may be configured to be both a display screen or a video output device. For example, the monitor and keyboard of a computer may be integrated into one device. This is possible because the finger detecting pads replace the keys, providing a flat or near flat surface for displaying the image.

In another embodiment, the integrated display screen may be configured to provide one or more displays corresponding to the use of the fingerboard keyboard. For example, each time the keyboard aligns itself according to the position of the typist's finger, the integrated display screen may display its image at the aligned position of the corresponding key. In addition, the image displayed when pressed may be highlighted, indicating that the typist detected a particular letter or command. In addition, the integrated display may be configured to change its appearance according to different languages or letter arrangements, or the like.

According to yet another embodiment of the present invention, the fingerboard detection device of the present invention can be configured as an enhanced keyboard. By way of example, referring to fig. 12, there is shown a conventional telephone keypad 1200 having twelve keys, such as key 1202. Since more than one symbol is assigned to each key of the keyboard 1202, multiple selections are required to select a particular symbol. Typically such keyboards assign a default number to each key. Pressing the key 1202 will automatically generate the number "3". This has proven to be an efficient system because the use of a keyboard requires more digits. However, if letters or symbols are desired, such a keyboard or other system must be adjusted to temporarily leave the default setting. Naturally, this system is not advantageous to use when both numbers and letters are often required, since pressing a key once is an ambiguous choice.

According to one embodiment of the present invention, a finger detecting keyboard (FIG. 10) is provided in which different numbers, letters, or functions are assigned to some or all of one's fingers. Thus, pressing, for example, key 1020 (FIG. 10) with one finger produces the number "3", while pressing the same key with another finger produces the letter "D", and so on. Therefore, each symbol on each key in the keyboard can be entered by pressing the key once.

According to one embodiment, the finger detecting device may be configured to output a default corresponding number when a key is pressed. To output one of the corresponding letters, a specially assigned finger may be used. Therefore, a particular middle finger may be assigned to the middle letter on a keyboard key, such as "B" or "E", etc. Likewise, a right finger may be assigned to a right letter of a key, and so on. All other fingers or undetected or unassigned fingers may correspond to default numbers.

Referring to FIG. 13, an enhanced multi-function keypad 1300 is shown, in accordance with one embodiment of the present invention. The keypad 1300 integrates a plurality of keys, such as almost every key on the keyboard 1100 (fig. 11) (e.g., a standard keyboard), into a limited number of keys of a keypad (e.g., a standard keypad) using the finger detection system discussed above. For example, in FIG. 13, the symbols and characters are arranged in three groups, the letter 1 group 1306 (mathematical) containing numeric and mathematical symbols, the letter 2 group 1304 containing symbols and functions used by alphabetic character editing text, and finally the PC commands 1302. It should be appreciated that keypad 1300 may be provided with additional or fewer keys, etc., according to another embodiment of the present invention, while still providing the functionality described herein.

Keypad 1300 includes a plurality of keys, such as key 1320, and a plurality of command buttons, including an alphabetic button 1308, a PC command button 1300, a power button 1312, a send/end button 1314, a menu button 1316, and an execute button 1318. Briefly, these command buttons are configured to perform tasks such as switching display modes, operating menus, switching power supplies, and the like.

When using the command buttons 1308 and 1310, one is selected from several different configurations. For example, with continued reference to FIG. 13, when the letter button 1308 is pressed, either the letter 1 group (mathematical) configuration 1306 or the letter 2 group configuration 1304 may be selected. In addition, when PC command button 1310 is pressed, PC command configuration 1302 is selected. As shown, each of these configurations displays different characters, symbols, or functions. For example, if the 1 letter set configuration is selected, touching key 1320 will produce the symbols "&", "6", or "/". It is noted that the choice of which of the three symbols is selected is determined by a number of factors, such as finger and voice detection. According to one embodiment, if no finger, voice or other input is provided, a default result is output. In the previous example, the number "6" may be the default symbol. To select one of the other two symbols, the user may speak the name of the symbol, or the position of the symbol on the key, say "up" or "down".

Therefore, without adding any additional keys, many characters, numbers and symbols can be selected by the enhanced keypad 1300. By way of further illustration, if the user wants to select, for example, the letter "O", the letter 2 group configuration 1304 is first selected via the command button 1308. The user then selects key 1320, which corresponds to the key with the desired symbol. Since this selection is still ambiguous, the user then provides another form of input. This other form of input may be voice recognition, lip recognition, or finger detection, among others. For example, to make a selection, the user may pronounce or speak the letter "O" when pressing key 1320. If the user does not provide one of the inputs, the key may default to a particular symbol or function, such as the up arrow function.

It should be noted that according to one embodiment, not every character, function or symbol is obtained by pressing a key. For example, unusual symbols or functions may be assigned to multiple buttons. For example, if the symbol ">" is not commonly used, it may be assigned to two keys instead of one. Therefore, in order to select the ">" symbol, the user must press the assigned two keys at the same time. This is advantageous when a less cluttered keypad is required. Furthermore, the use of such a technique enables the enhanced keypad to be smaller in profile.

It is noted that the configuration enhanced keypad 1300 may be in accordance with one of several embodiments. According to one embodiment, all the characters of all configurations are visible on the keypad at the same time, as shown. When a configuration is selected, the corresponding character of the configuration is illuminated, providing an indication of the available characters or symbols to the user. According to another embodiment of the invention, only the characters or symbols corresponding to the selected configuration are displayed. The display of keypad 1300 may be similar in appearance to configurations 1302, 1304, or 1306, etc.

It should be appreciated that the various forms of input described above may be combined for increased efficiency, according to one embodiment. For example, the enhanced keypad 1300 can detect both voice and lip motion to more quickly separate desired symbols. Also, lip recognition may be used in conjunction with finger detection (e.g., fingertip, lie flat), and the like.

Lip recognition is particularly useful in noisy public places. Rather than providing a voice recognition device where confusion may occur, an optical sensor, such as optical sensor 1428 (fig. 14), may be provided to detect the symbol based on the lip motion. It should also be understood that face recognition, which is characterized by the detection of facial expressions and features to provide input to the apparatus described herein, may also be used in accordance with other embodiments of the present invention. Further, according to one embodiment, face and lip recognition may be used simultaneously to increase accuracy. Likewise, all forms of identification disclosed herein may be used in combination with one or more other forms of identification to provide a greater degree of convenience and accuracy.

Referring to fig. 13a, there is shown the identification technique described above with reference to fig. 13, characterised in that individual/different fingers are assigned to a plurality of keys. In this embodiment, the character arrangement of keys 0 to 9 is assigned to 10 different fingers. Different positions of a finger on, for example, a sensitive pad can be assigned to different character sets. For example, the mathematical symbols "{", "6", and "|" are assigned to the upward (fingertip) position of the user's left thumb. The characters "J", "K", "L", and function "< ═ are assigned to the same finger down (flat) position. Pressing the pad with, for example, the fingernail of the same finger can also select the "PU" command. To select a character, an additional recognition system, such as speech recognition, may be used. Such a system may also replace a computer keyboard.

Referring to fig. 14, an enhanced keypad 1400 is shown according to another embodiment of the present invention, additionally including a finger probe pad 1408, a voice recognition device 1426 and a lip recognition optic 1428, as described above. According to this embodiment, instead of selecting a configuration via the command buttons described above, finger recognition is used to select the corresponding configuration. For example, key 1402 displays both a letter 2 group configuration and a letter 1 group configuration on a relative right side 1404 and a relative left side 1406. Fingers 1422 and 1424 may be used, for example, to select from a corresponding configuration. For example, finger 1422 may be assigned to the letter 2 group configuration (left side 1406) and finger 1424 may be assigned to the letter 1 group configuration (right side 1404). So, pressing key 1402 with, for example, finger 1424 will select a symbol from the group 1 alphabet configuration. Then, to resolve the symbol "? The ambiguity between "," 2 "and" & "may provide voice or lip recognition as discussed above and as will be described later in the embodiment of fig. 14 b. In addition, such ambiguity can be resolved using a plurality of fingers by a finger detection method. It should be understood that any finger or any portion of a finger may be assigned to any of the sides 1404 and 1406 described above. Any configuration may also be located on either of sides 1404 and 1406. According to one embodiment, more than two sides may also be added. For example, the PC command configuration described above may be placed on the bottom side of the keys, as shown in FIG. 13 and FIG. 14b (1458). To select a command, the user may press a button, for example, with a finger or a portion of a finger assigned by the commands. If more than one command is assigned to a key, an additional recognition system, such as the speech system described above, may be used.

It will be appreciated that the surface of the keypad may be covered with a one-piece probe pad, covering the keys of the keypad, or itself forming the keys of the keypad. The probe pad may also be made up of a plurality of small pads, each covering a different keypad key, or itself forming a keypad key. It must be noted that the keypad may be formed by a one-piece sensitive pad, theoretically divided by lines into, for example, 12 squares, each square defining a particular key according to its position on the keypad.

According to one embodiment, a calibration step using any of the described finger detection methods may be used to assign individual fingers, or finger positions (e.g., finger tips, finger pads) on the pad, to a plurality of configurations. This step may include pressing one, two or more fingers on finger pad 1408, or on any one, two or more keys of the keypad, to provide data to the keypad for future detection. Note that, according to one embodiment, distinguishing between two fingers may be a simple task-separating larger and smaller fingers, where two fingers of different sizes are used. The same is true for finger portions of the touchpad such as the tip and pad of the finger. Naturally, further embodiments may employ more sophisticated fingerprint or finger detection methods, such as the detection methods described above.

According to another embodiment of the invention, fingerboard 1408 may be configured as a fingerboard input device, similar to the embodiments discussed above. Thus, rather than having to depress a key of the keypad (e.g., a finger pointing at a key of the keypad), characters, symbols, or functions can be assigned to each finger and provide input to the system. Voice and lip recognition may also be combined with fingerboard 1408 to provide additional functionality. Also, in one embodiment, keypad apparatus 1400 may not include fingerboard 1408 at all.

Referring to FIG. 14b, an enhanced keypad 1450 configured to efficiently use multiple fingers or multiple parts of fingers is shown in accordance with another embodiment of the present invention. According to one embodiment, such efficiency is achieved by placing all English letters on the left side of each key and all Arabic numerals on the right side of each key. For example, keys 1452 may be configured with left side 1456 having letters and other symbols and right side 1454 having numbers and other symbols. It should be understood that the system described herein is merely illustrative and may be configured in many forms, such as upper and lower sides, etc.

It is noted that one reason for configuring the device according to an embodiment that distinguishes between numbers and letters is that letters and numbers are not typically used simultaneously when a user types a word. Additionally, some characters, which are commonly used in both modes, may be provided on more than one side (e.g., the numeric side and the alphabetical side) in order to reduce the transition from one mode to the other. For example, the symbol "-" is provided in both the numeric configuration of key 1407 and the alphabetic configuration of key 1409. In fig. 13, characters ".", are provided in both the numeric mode of the keys 1307 and the alphabetical mode of the keys 1309. As shown in fig. 14a, for greater efficiency, a pointer (e.g., left, right, up) or other character may be provided by a separate button 1430, which may be positioned to place other characters commonly used in both modes. For example, as shown in fig. 14a, the character "(" once assigned to the right group of buttons 1434, and may now also be assigned to the left group of buttons 1432, instead of the pointer "═ >". key 1430 may be generic to all modes.

With continued reference to fig. 14b, a person can select any displayed letter by one of several fingers. For example, three fingers may be assigned to letter symbols (e.g., a letter pattern), wherein each finger corresponds to one of three vertical rows, as shown in rows 1462-1466. A fourth finger, e.g., a little finger, may correspond to a number in all rows (e.g., a number pattern). Thus, pressing any key with a little finger will output the corresponding number (e.g., mathematical default characters). To select a non-default mathematical character, other inputs, such as speech or lip recognition, must be provided to make the selection. For example, the user may speak "up", "down", using voice, lip, etc., to specify the location of a desired character or function. Likewise, finger pressing any key with the corresponding letter pattern will output an alphabetic default character such as the center letter, or other default letter. To select a non-default letter or character, other input, such as voice or lip recognition, must be provided to make the selection. For example, the user may speak "up," "down," "left," or "right" using voice, lip, or the like, to specify the location of a desired letter, character, or function.

Also, according to one embodiment, the user may actually speak the desired letter, character, or function rather than providing its location on the key. Additionally, according to one embodiment, the thumb or finger may be used to correspond to PC or computer functions also provided by the enhanced keypad. It should be appreciated that according to one embodiment, only one finger, a portion of one finger, or a position of one finger is required to represent letters on the input device instead of three fingers.

As shown in fig. 14b, the alphabet configuration is arranged on the left side of the keypad keys (e.g., the left side of the keys 1452). Keys 2 through 9, which typically contain three or four letters, are located in standard positions (e.g., 1456 tips) on the keys of a telephone keypad. Additional characters or functions are located in the middle left of the key (e.g., 1456 middle). To isolate a character or a function (e.g., 1454) located in a key alphabet configuration, a user first presses the key, for example, with a finger or a portion of a finger assigned in an alphabet mode, to select the alphabet group of the key. If he does not incorporate any other recognition method, such as speech, the system will select the default character or function located in the middle of the left side of the key (e.g., < >. if the user needs to select one of the letters on the key, he can simply spell out the letter.

For other buttons such as 1455, the keys are not assigned letters, typically three letter symbols are provided. They are located at the top left side, the middle left side and the bottom left side of the key. The default may still be the left middle character. It will be selected as described for the button containing the letter. To select one of the other characters or functions, for example, the user may say "up" for the top left character or "down" for the bottom left character.

The characters and functions in the math mode are arranged on the right side of the keypad keys. Each key may typically have up to three characters, one at the top right, one in the middle right, and one at the bottom right. Numbers from 0 to 9, and other symbols on a standard telephone keypad such as "@" and "#", may occupy their usual positions on the keys. For example, they may be placed at the middle right on the keys (e.g., 1454). To select a number and mathematical character, the user first selects the mathematical pattern in which the digit is assigned, as in the described alphabetical pattern. If the user does not use any additional recognition methods, the system selects the default character that is centered on the right side of the key (e.g., "1" on key 1455). To select the mathematical character at the top right or bottom right of the key, the user may use additional recognition methods, such as speech-speaking, for example, its position on the key, e.g., "up" or "down".

Other functions, such as PC commands, may be located on different keys of the keypad, for example, the bottom center of the key (e.g., 1458). To select a command, such as a PC command, the user may press a button assigned by the command, for example, with a finger or a portion of a finger. If more than one command is assigned to a key, additional recognition systems, such as speech, e.g. "up", "down", can be added to the finger recognition system.

The above described embodiment is a user friendly system. It has many advantages, such as:

● the keypad may be of a standard telephone type.

● all the characters, commands and functions that are available on the keyboard of the computer, it may have.

● are located in their usual positions on the keys of the keypad.

● numbers are also located in their normal positions on the keys of the keypad.

● to select a letter, the user presses the corresponding key and spells out the letter naturally.

● the user simply has to press the corresponding button in order to select or dial a number.

● the symbols or functions commonly used in math or alphabetic mode are defaults and the user can select them by simply pressing the corresponding button.

● for all other mathematical or alphabetic symbols or functions (less common), the user simply presses the corresponding key and says "up" or "down".

● for all commands, the user simply has to press the corresponding button.

Note that according to one embodiment, if the identification device of the present invention does not satisfactorily output the desired letter, number or symbol, the user may select a "backspace" or error prompt button. For example, the key may be a "Bk" key 1458 or perhaps an error prompt button such as button 1460. The input device will then provide an additional selection, which may or may not correspond to the selection originally intended, at which point the user may also select the "backspace" button and proceed. According to one embodiment, the "backspace" button merely eliminates previous selections and does not provide additional selections. In any case, according to one embodiment, the input device may remember the previous selection so that the same error is not repeated. According to one embodiment of the present invention, a spell checker may be provided to increase the level of detection based on the correctly spelled form of the input word or the like. For example, if the user is entering a word, it is difficult for the detection device to determine one of the corresponding letters, and according to one embodiment, the letter that completes the word correctly is selected. To this end, the system may contain in its memory a database of one or more language words and functions.

Referring to FIG. 14c, an enhanced keypad 1470 is shown, in accordance with another embodiment of the present invention. Keypad 1470 shows an alphabetical arrangement, rather than alphabetical ordering. Keypad 1470 is so organized as to enhance the effectiveness of lip, voice, or other recognition techniques in the present invention. Rather, the letters most easily distinguished by such identification techniques are put together on the same key. Also, letters that are difficult to distinguish are placed on different keys. This will reduce frequent errors between the two letters that are most difficult for the input device to distinguish. It should be understood that the enhanced keypad 1470 shows only one of many possible arrangements, and that other configurations are possible depending on the distinctiveness of the characters. Note that according to one embodiment, the tone or tone transition provided by the phone keys may be maintained even if the arrangement of the letters is different. According to one embodiment, whenever a letter is detected, the tone corresponding to the key with which that letter is traditionally associated is provided. This provides backward compatibility with other telephony devices and systems.

Referring to fig. 14d and 14e, there is shown a horizontal arrangement of each hand and keys, respectively, similar to the arrangement described with reference to fig. 15b and 15 c. Figures 14b and 14c show the letter groups assigned to each finger, and the number groups assigned to the buttons, according to one embodiment. The arrangement of the buttons is different from that of fig. 14d and 14 e.

According to another embodiment of the present invention, a light sensor or pressure sensing device may be provided for the enhanced keypad device for finger detection, among other methods. By way of example, referring to FIG. 15, an enhanced keypad 1500 is shown having a light sensitive element 1502 and a pressure sensing device 1504. It should be understood that in another embodiment of the present invention, the photosensor and the pressure sensing device may be used separately or in combination to improve detection efficiency. Furthermore, it should also be understood that the light and pressure sensing devices of this embodiment may be configured in conjunction with other devices, such as the detection and input devices described above, in addition to the enhanced keypad 1500 of FIG. 15. Note that the pad need not be in accordance with an embodiment of the present invention when such a detection device is used. One can detect fingers or other movements in the air using, for example, optical, light, laser, or other detection methods, without a pad surface or the like.

The photosensor 1502 uses two detection modes. Firstly the element detects the position of the finger on the keypad and secondly determines the particular size and/or shape of the finger used. The position of the finger is determined from the intersecting X and Y coordinates of the two directions of sensitive light. For example, the light sensitive elements can emit both horizontally and vertically. Horizontal and vertical light is emitted to sense an obstructing object, such as a finger. The position of the finger is therefore the intersection of the horizontal and vertical light sensitive elements activated on the two-dimensional pad of the keypad.

The particular size and/or shape of the finger used is determined by the number of activated light sensitive elements. A wide finger will naturally activate more elements, wherein the light sensitive elements are configured with sufficient sensitivity and resolution. Therefore, based on the determination of size and shape, the particular finger used can be distinguished. Once the location and exact fingers are known, the operation of such a keypad or input device may be similar to the embodiments described above.

Pressure sensing device 1504 is also capable of detecting the position of the finger and the particular type of finger used. The determination of the position is based on a pressure mechanism. That is, the location where the pressure is sensed is the location of the finger depression. In addition, a very sensitive pressure sensing device can also determine the exact size of a finger based on the exact area of pressure sensed. Similar to the light sensitive elements, fingers of different sizes can be detected in this manner. It is noted that such very sensitive pressure sensing devices are available in the art. For example, U.S. patent No.5,952,585 entitled Portable Pressure Sensing apparatus, to Trantzas et al, which is incorporated herein by reference, describes such a device. Such a system operates in a manner similar to one of the embodiments described above. It will be appreciated that the pressure sensing pads and light sensing means may be used in combination, first the system determining the position of the finger to determine, for example, the key pressed, and then the system measuring the size of the finger to determine which finger was used.

It is noted that the light and pressure sensing devices described above may also be configured in conjunction with other forms of input or detection devices in accordance with an embodiment of the present invention. For example, voice or lip detection may be added to increase functionality or accuracy.

According to one embodiment of the present invention, a device using the above-described light sensitive elements and/or pressure sensing means is configured without keys, buttons or similar signal input means. Indeed, with continued reference to FIG. 15, a piece of recessed pad 1506 is shown, with no keys or buttons on the central input area. If there is a commanded image or display, it is displayed on a flat surface. The configuration of this embodiment provides several advantages. Specifically, the recessed pad 1506 may be configured for additional uses due to the flat and/or smooth surface. For example, such a device may be configured to be both an input device for a watch-type mobile phone and a latch. For example, the flat area of the pad 1506 may incorporate a latch or latching mechanism to close the watch-type phone around the wrist when the phone is not in use. Therefore, the shim plate may become ineffective and invisible. Furthermore, the light sensor or pressure sensing means may be automatically activated when the latch is released and the phone is removed from the wrist for normal use. The recessed area is ideal as such a latch or latching mechanism, particularly because the light sensitive element detects a distance above the backing plate 1506.

Referring to fig. 18, the above described wristwatch type phone/PDA is shown with an enhanced keypad 1806 in accordance with one embodiment of the present invention. Briefly, the phone has a removable portion 1804 that latches or otherwise attaches to a recessed enhanced keypad 1806, as described above. When disconnected, the handset 1804 can be opened into the handset 1802 for use as a telephone with a keypad 1806 or the like.

It should be understood that the input and recognition devices described herein may be configured as a variety of tools and/or surfaces. For example, according to one embodiment, an input device with keys may be provided, while according to another embodiment, a touch screen display is used, and so on. Any identification means may be incorporated as well, including cameras and optical detection, laser detection and artificial fibre detection. It is noted that regardless of the surface, each of the keys or surface locations may be customized by the user to correspond to different functions, letters, symbols, etc., in accordance with one embodiment. If the surface application technology is not capable of dynamically displaying the user's modifications, an overlay of the key image may be provided by paper or other material, corresponding to the user's customization.

Referring to FIG. 15b, an enhanced keypad 1550 is shown with vertically arranged keys, such as key 1552, in accordance with another embodiment of the invention. The keypad 1550 is configured to function similarly to the devices described above, such as the keypad 1500 and the keypad 1450. The keypad 1550 is constructed not according to the structure of a standard keypad but is vertically arranged. It should be understood that many arrangements other than the typical rectangular configuration of a conventional keypad are possible in accordance with other embodiments of the present invention. Also, referring to FIG. 15c, an angled keypad 1570 is shown arranged so that both of the user's hands can more easily rest on keys, such as key 1572. As detailed above, in addition to the keys in this embodiment, these embodiments may also include other input surfaces and devices, such as a smooth fingerboard surface.

Referring to fig. 29a, 29b and 29c, a multi-piece keypad using the previously described technology is shown. In the closed position (see fig. 29c), this device minimizes the size of the keypad. It should be understood that the tiles may be interconnected by any of the methods described in fig. 16 and 17. This keypad may contain other features such as an LCD display, headphones, a microphone, a camera, etc. (fig. 29b), as described in fig. 20 to 22. In this example, the keypad is made up of two pieces, one piece having two rows of four keys each, and the other piece having one of the four keys. This keypad can be used for certain devices such as a wrist phone or a wrist PDA.

As previously described, a character, function, symbol, or combination thereof may be assigned to a scanned location, position, or action of one or more fingers. For example, two groups of one or more characters, functions or symbols may be assigned to two different positions or locations of a finger on the sensitive pad. The scanning system may be constituted by a thermal, pressure, optical or any other identification means.

This method can be used to select different character sets in the enhanced keypad 1400. According to another embodiment of the invention, instead of using different fingers to select different configurations, different portions of one finger may be used to select different configurations. For example, a tip portion 1422a of one finger 1422 may be assigned to a certain function, while a pad portion 1422b of the finger 1422 may be assigned to a different function. Furthermore, the keys or buttons of the keypad are configured to detect multiple portions of the user's finger. Thus, the user may press one of the buttons or keys on the keypad with the fingertip portion 1422a to select the alphabetic configuration, and likewise the user may select the mathematical configuration with the finger pad portion 1422b of the same finger.

This system will give the user greater flexibility and may multiply the possibilities of allocation. For example, the user may select the alphabetic configuration by pressing a key on the keypad with the finger pad 1422b of the finger 1422. He may also select a mathematical configuration by pressing a key on the keypad with the fingertip portion 1422a of the finger 1422 or another fingertip portion of another finger, such as 1424. For example, a button may be pressed to select a command using the thumb, a portion of a finger, or both.

As described above, according to a preferred embodiment of the present invention, in combination with the arrangement of the characters, symbols and functions (hereinafter collectively referred to as symbols) on the keys of the keypad, the finger recognition system, the speech/voice recognition system and the keypad (e.g., telephone keypad), the user need only press or point one button once to accomplish the distinction of one of the symbols. As will be explained in more detail hereinafter, other distinguishing methods such as keypad key click systems may also be incorporated into the above combination.

It should be understood that in some embodiments, selecting a symbol may not require all of the above-described character/function selection methods, such as voice or finger position or finger shape or fingerprint, but only some or even one of them. For example, the combination of the above symbol selection methods may be different for each keypad or for a key on a keypad. Therefore, different symbol arrangements on the keys may be provided for different keypads. Thus, a key contains only one or two symbols, and only one selection method, for example, is needed to select the desired symbol.

As mentioned earlier, in embodiments employing speech or voice recognition, to select a letter, the user presses a button with the finger or a portion of the finger assigned to the alphabetic character, while he only has to speak the letter he desires. He may not have to speak for all other symbols in the alphabet configuration. As long as the key is pressed without speaking, the symbol will be selected by default. In mathematical configurations, there are typically three choices for each key user. If he does not use his voice, he will automatically select the default symbol. To select other mathematical symbols on this key he can use his voice to say e.g. "up", "down" or any other voice signal he needs (the assigned combination of these voice signals and different fingerprints can teach the machine a priori with one or more users). Commonly used numbers or other mathematical symbols may be preferred as a default choice. In this case, the user will rarely use his voice to select a mathematical symbol.

The above embodiments allow a user to conveniently, quickly and naturally enter text and functions through a telephone keypad.

In yet another embodiment of the present invention, the keys on the keypad are comprised of click sensitive pads. The click-sensitive pad is configured to respond to two levels of finger pressure. A slight pressure produces one response and a greater pressure produces another response with a click sound to inform the user. The click sound system may be combined with any other recognition system, in particular the system described above. For example, in fig. 14, a click system may be incorporated with the finger recognition system to select a configuration. The user may use a finger 1422 to press a key lightly to select the alphabetic configuration, while using the same or another finger to press a key harder to use the mathematical configuration and produce a click.

The system described above can also be used to select symbols without the user's voice. There is a set of symbols on one key, and the user can assign some of these symbols to each finger. A finger may be explicitly moved over the key or a finger portion of the key may be depressed to select the desired symbol. For example in fig. 27a, eight different symbols are arranged on this key. They are arranged in two rows and four columns. The letters are arranged in the upper row 2404 and a set of other symbols in the lower row 2402. The user's four different fingers are assigned to the different four columns, one for each column. The button is pressed, for example, by a finger, and the corresponding column 2412 is selected. If the user presses the button with the finger pad of the finger in a position below (e.g., a flat portion), the letter "X" is selected. He presses the button with the tip of his finger and can select "+".

The key may also incorporate a click system rather than differentiating between finger locations where the button is pressed. In this case, for example, after the user selects column 2412 with the corresponding finger, he may press with any position or portion of his finger. He can press the button gently to select the letter "X". If he needs to select the symbol "+", he must press the button harder to make it click.

In yet another embodiment of the present invention, in FIG. 28, each key of the keypad is assigned a set of symbols. To select the desired symbol by this embodiment, different recognition systems such as voice/speech recognition systems and finger recognition systems may be combined with a touch sensitive keypad with a click system under each button, for example.

In order to make it easy for the user to enter symbols on a key, they may be arranged in different rows on the key. In the example of fig. 28, the symbols are arranged in three rows. The top row includes, for example, the letters "ABC". To select a letter from this line, the user must press the button with a finger while spelling the desired letter.

The middle row comprises for example two symbols. To select one of these symbols, different methods may be used. The symbols on the left side may be assigned to the tip of one finger and the symbols on the right side to the tip of the other finger, neither finger having to click the button when touching it. In connection with pressing the button with any finger, for example in an upper (e.g. fingertip) position, it is also possible to use a speech input such as "left" or "right" to select one of the symbols.

The lower row also includes two characters. To select a symbol in this row, the user may use the same system as the second row, but push the button harder to add a click. It will be appreciated by those skilled in the art that many variations in the combination of selection methods can be employed without departing from the invention.

Referring to fig. 14, when a button 1403 is pressed and a letter is spoken with a finger assigned to the letter, the speech or spoken sound recognition system will attempt to understand which of the only three letters "a" or "B" or "C" the sound is pronounced. Because the system only needs to recognize the sounds of three letters, different users can use the same system without having to perform phonetic teaching.

Therefore, many of the benefits of the present invention can be used to provide an improved, versatile, compact and user-friendly keypad system. As previously mentioned, the user can use his fingerprint or finger characteristics, either alone or in combination, at least according to the following principles, by entering symbols or selecting a symbol configuration (e.g. alphabetical, mathematical, functional) using a finger recognition system through a telephone-type keypad;

● at least one symbol configuration, such as a set of alphabetic characters or a set of mathematical characters or a set of commands, can be assigned to at least one finger or a combination of fingers.

● at least one symbol configuration may be assigned to at least one portion or at least one action of a finger.

According to the above principle, the user can use, for example, when convenient:

● to select different configurations with only one finger, such as pressing a key with a different portion of the finger (e.g., pressing a key with the tip of the finger or with the pad of the finger).

● one or more fingers, each used individually, to select different configurations. For example, the index finger is used for alphabetical configuration, the thumb is used for PC command configuration, and the little finger is used for mathematical configuration.

● one or more fingers, each used individually, to select the same configuration. For example, the user may use three fingers in the middle for alphabetic configuration, a thumb for PC command configuration, and a little finger for mathematical configuration.

● at least one finger to select at least one configuration. For example, the user may press the "ctrl" button with his thumb to select the command symbol, or he may simultaneously press the "ctrl" button with his thumb and the "pr" button with his index finger to select the command symbol "pr".

It should be appreciated that the fingerprint recognition application may be applied to fingers of both hands simultaneously. Additionally, voice, lip, and other recognition systems may be combined with the finger recognition system described above.

As mentioned before, a microphone may be placed in front of the user's mouth in order to speak e.g. letters aloud. Another solution is to provide a commercially available microphone in the ear of the user, whose speech is input by vibration of the ear bones.

The input system described above may be integrated in many devices such as mobile and stationary phones, PDAs, computers, laptops, remote controls for televisions or other electronic devices, fax machines, etc. In addition, the stand-alone input device formed in accordance with the system described above may be separately manufactured and used as an external input device for the product described above.

The system may include one or more databases containing words in different languages. A predictive word recognition system may also be incorporated into the system that may enter a word before all of its letters are entered. Such a system may allow the machine to automatically select the desired word, typically before the complete input is complete, even without user intervention. This is possible because by such a system selecting a character or a symbol individually (e.g. character by character), the word corresponding to the pressed key is selected, which is possible in a very small number, and it is not difficult to determine the desired word before the word is completely entered.

Even if the user enters a wrong letter in a word, or the machine fails to recognize a given letter, the predictive word recognition system can automatically correct the wrong letter because in most cases the other letters of the word are entered correctly.

It should be appreciated that the user may speak a word, rather than a letter, when the corresponding button is pressed. In this case, the aforementioned database will be used to select the desired letter by the word recognition system. Determining the end of a word may be based on a number of symbols or functions, such as "-", "; ", space, enter command, etc.

It should also be understood that the sensitive keypad may consist of one pad incorporating all of the keys or may consist of separate pads incorporating each key (e.g., twelve separate pads corresponding to twelve keys on the keypad).

According to yet another embodiment of the present invention, one or more of the above devices, such as the fingerboard detection device 800 or the enhanced keypad 1400, may be configured with a miniature display screen or a communication/computer card. Such a screen or card may include a flexible plastic LCD or similar device for display. Of course, it should be understood that the input devices described above may be combined with other devices in addition to the miniature display screens or communication/computer cards described herein. For example, the enhanced keypad 1400 may be configured as an integral part of a watch-type phone, a computer, a PDA device, or the like. It should also be understood that such an LCD may also be used in any device that requires an LCD, such as a mobile phone. The communication between them may be wireless.

Referring to FIG. 16, a multi-chip LCD panel 1600 is shown, according to one embodiment of the present invention, including a front LCD section 1602, a rear memory slot section 1604-additional memory for battery power-and a rear enhanced keypad section 1612. Note that some other components are not shown in the figure, such as internal hardware, which are additional components to LCD panel 1600.

Furthermore, the multi-piece type LCD panel 1600 includes a hinge portion 1616 for folding the panel in half to reach the size of, for example, a credit card. Note that according to another embodiment, the LCD panel may extend outward and inward instead of being folded or the like. It is noted that according to one embodiment, the entire hinge portion of the hinge 1600 is located at the back portion of the LCD panel 1600, so the front LCD portion 1602 has a flat appearance, enhancing image display effect, etc. With continued reference to FIG. 16, a front portion of the LCD panel 1600 is displayed as image 1606, a back or reverse portion is displayed as image 1608, and the LCD panel 1600 is displayed as image 1610 when closed or folded.

The rear enhanced keypad portion 1612 operates in the same manner as the keypad 1500 (FIG. 15), according to one embodiment. For input and finger detection, for example, a photosensor device, such as photosensor device 1614, may be provided. In addition, it should be understood that an enhanced keypad 1612 may also be attached to a front portion of the multi-sheet type LCD panel 1600, thus making it easier to view and use both the LCD and the enhanced keypad. According to such an embodiment, the back portion can remain unused, so the folded LCD panel 1600 can be placed in a purse or pocket, similar to a credit card or a miniature device. The internally enclosed portion would include an LCD and an enhanced keypad.

According to an embodiment of the present invention, the LCD panel 1600 may be implemented as a PDA, a watch-type PDA, a computer, an interactive newspaper, or the like. Illustratively, the LCD panel 1600 may be attached to (or communicate with) a microcomputer device, for example, as an additional LCD display screen, and may also serve as an additional input device via the enhanced keypad 1612. Alternatively, the card may be used as a PDA, while also being a wrist watch.

In addition, the card may be used as a functional LCD display, added to a phone, cell phone or other device, making it possible to interact with the device through the LCD panel. For example, when using a computer automation system over a telephone, the LCD panel 1600 may be configured to display any computer menu or other automated selection on the LCD. This avoids the hassle of pressing many phone keys to get the desired selection or position. In addition, the LCD panel 1600 may provide additional voice messaging and other computerized features for a telephone or other communication device.

Briefly, FIGS. 16 a-16 e illustrate various embodiments of the LCD device and enhanced keypad described above. A configuration of a plurality of multi-piece LCDs and keypads is shown, in accordance with one of several embodiments of the present invention.

It should be understood that the LCD device of fig. 16a may be used for an external display of a mobile electronic and communication device without an LCD or with a micro LCD. In this case, a person, for example, with a watch-type phone on the wrist, may carry an additional credit card sized LCD in their pocket. The credit card sized LCD may be used, for example, to display short messages entered on the user's telephone keypad. The credit card sized LCD may be a multi-chip type. The width of the LCD in fig. 16b or 16c may be nearly the same as the width of standard a4/a5 paper when opened or unfolded, enabling the user to work on full-size documents. It should be noted that the connection between the telecommunication device and the external LCD can be any wired or wireless means.

In yet another embodiment, there may be an external LCD in many locations, such as an office or restaurant. For example, mobile phones have LCDs with limited sizes and can be used by their carriers from any location. In one embodiment, the user may enter a password in the external LCD that is known to his phone, enabling communication between the LCD and his phone. After the use, the user releases the password of the external LCD. This system limits communication to only the desired LCD and avoids connections to other LCDs in the vicinity.

FIG. 16d shows an external multi-chip interface including an enhanced input device, as discussed in the previously described embodiments, and a multi-chip credit card sized LCD. The credit card sized LCD may be detachable and wirelessly connected to the keypad.

FIG. 16e shows a credit card sized computer including an enhanced input device such as that described in the previous embodiment, memory (not shown), battery and other components (not shown), and a multi-chip credit card sized LCD. The credit card sized LCD may be detachable and connected to the computer in a wireless manner. It should be noted that the components of the computer, such as the battery, memory, etc., may also be credit card sized and may be detachable.

FIG. 16g shows a credit card sized computer and communication device including an enhanced input device such as the one described in the previous embodiment, memory (not shown), battery and other components (not shown), and a multi-chip credit card sized LCD. The credit card sized LCD may be detachable and connected to the computer in a wireless manner.

Referring to FIG. 17, and one embodiment of the present invention, a large LCD screen 1700 is shown. The LCD screen 1700 includes a front LCD portion 1708 and a rear portion, shown in front view 1700, for optional input devices or other components (not shown). It should be understood that such input devices may also be located in the front portion, as discussed above. According to one embodiment of the present invention, LCD screen 1700 is composed of plastic and flexible materials for added convenience and flexibility.

With the folding hinges 1706 and 1708, the large LCD screen 1700 can be folded to about one-fourth of its size. Notably, the graph 1702 shows a half-folded view of a large LCD screen 1700. Further, the graphic 1704 shows the LCD panel 1700 fully collapsed graphic. It should be appreciated that large LCD screen 1700 may be configured with more or fewer hinge mechanisms to further increase or decrease the size and compactness of the device.

According to one embodiment of the invention, LCD screen 1700 may be configured as a digital newspaper. Thus, one can use LCD screen 1700 to download digitized news from one or more news sources and then read the news or other desired information. Such an arrangement is advantageous because news can be continuously updated throughout the day, and the form and content of the news can be customized by the user.

For example, a user may arrange LCD screen 1700 to download sports news from only three specific sources. Another user may simply browse local news and the like. It should be understood that the information that LCD screen 1700 can display is not limited to information provided by a conventional newspaper. Indeed, a digital environment provides a means of doing something that is not available in traditional newspaper formats. According to one embodiment of the present invention, the downloading, uploading, and updating described above are all accomplished via the Internet. Also, according to one embodiment, any of the devices described herein may be configured to upload or download data via the internet.

According to one embodiment, LCD screens 1700 are provided to a user at a plurality of download stations. Rather than waiting for a potentially long time to download the desired news, newsletters or the like may be introduced into kiosks or the like, in which the LCD screen device is accessed by people for faster download. Such a venue may have bandwidth and other technologies that are not available to the average user. According to one embodiment, such LCD screen devices may be the property of news companies, characterized by people borrowing or renting these devices for the purpose of obtaining digital news. Such an embodiment allows a large number of downloads to be made at the kiosk while a small, less intensive download is made by other means, such as wireless technology, when the LCD screen is at the user's side, if news updates are needed.

Such a system and method has a number of advantages. The newsstand can update the latest versions of information and other publications of any news agency at any time. A user may have a card (hereinafter "news card"). Using a news card, an LCD device (hereinafter referred to as a "news screen") can be borrowed from a kiosk. It can be returned to this kiosk, as well as to any other kiosk. The news card will be updated to indicate that its owner has a news screen in his or her possession. The user may ask the owner of the kiosk to provide him with a copy of any publication he desires. This process is virtually instantaneous since publications only need partial copies.

To pay, the user either uses his news card or another payment system. If the user uses his news card, he may receive a list each month listing all publications he purchased during that period. If the user does not want to carry a news screen any more, he just needs to hand it to the nearest news kiosk, and his news card will be updated accordingly, indicating that he does not have a news screen. The news screen may include a floppy disk device that allows the user to retrieve a floppy disk containing their publication. At any time the user may access another kiosk to borrow another news screen. It must be noted that a floppy disk may be of any kind and it may be the property of any party. The news screen may be a large flexible LCD such as plastic. It may include a reduced keypad with functions such as "lower page" or zoom.

According to one embodiment, a large LCD screen may be designed without hinges and thus cannot be folded. Such a device may include the plastic LCD technology described above to increase flexibility.

It should be noted that the large LCD screen 1700 may also be a fully functional computer or similar device in accordance with an embodiment of the present invention. For example, the LCD display portion may serve as both a display screen and an input device. It is noted that the input device of FIG. 11a described above may be configured to operate in conjunction, both as an input device and as a display screen. In addition, an input device may also be provided at another portion of the large LCD screen 1700. Furthermore, computer components such as memory and processor devices may be mounted in a compact form as provided by skilled technology.

Referring to FIG. 19, an enhanced keypad apparatus 1904 is shown with two keypads, according to yet another embodiment of the present invention. Instead of combining multiple configurations on one keypad, such as the keypad apparatus of fig. 13, two keypads are provided here so that both mathematical and character configurations can be used. Of course, it should be understood that any two configurations may be provided for the keypad apparatus 1904.

With continued reference to FIG. 19, the keypad 1902 is shown in a closed position, illustrating that the keypad apparatus in this embodiment can be folded in half when not in use. In accordance with one embodiment of the present invention, the keypad 1904 may provide button controls, such as button control 1908, as additional functionality, as described in the embodiments above. Furthermore, other features, such as voice detection, lip detection, and palm detection, may be added to the keypad 1904, as described in the above embodiments.

Referring to FIG. 20, an enhanced keypad 2002 is shown with a removable handset 2004 including a display panel according to yet another embodiment of the invention. The keypad apparatus 2002, initially shown in a closed position, is configured such that the hand-held display panel 2004 may be removed for use. Thus, the keypad apparatus 2002 can be configured to engage a telephone or other portable communication device in accordance with one embodiment of the present invention. The keypad part may be used for input, such as dialing a telephone number or entering characters. A display panel in the handset may be used as an output display to view input content or to read data from an external source, such as the internet or others. According to one embodiment, the display panel 2004 may be configured to be interchangeable with different keypad devices. Therefore, people can exchange the display panel between different keypad devices for convenience, functions, etc. It should be noted that according to one embodiment of the present invention, the display panel 2004 is provided with a security or bar code device to prevent the display panel from attaching to other keypad devices without proper authorization. Furthermore, the display panel can have a menu display to provide the user with a choice of such functions.

The keypad device 2002 or display 2004 may also be equipped with a camera 2006, microphone 2010, and headset 2008 to use the recognition methods described above. For example, in accordance with one embodiment of the present invention, speech recognition may be used. For example, one type of speech recognition may be when a user is typing characters or words on a keypad while speaking those words that are interpreted by speech recognition. Since the user is also typing all or part of the spoken word, the accuracy of the recognition is improved. According to one embodiment, a space or period key, or any other symbol, may be added to the keypad to indicate the beginning of a new word. It should also be understood that the speech recognition described above may also be used with lip, face, or other forms of recognition. Therefore, according to one embodiment, the user may also pronounce the entire word using lip recognition.

Referring to FIG. 21, a handset 2102 is shown having a built-in display 2104, in accordance with one embodiment of the present invention. As shown, the hand piece 2102 may be folded for portability. In addition, a display panel 2104 is provided on the back of the handset, and has other necessary components such as an earphone, a camera, and a microphone, etc.

Fig. 22 shows a handheld device 2204 similar to that of fig. 21, but without a display screen. The handheld device shown in the figure is attached to the keypad device 2202 and display of figure 20, according to one embodiment of the invention. Thus, a user may use a handset, telephone and/or display in a single device, wherein each of these components may be used separately and individually.

Fig. 23 through 26 illustrate steps for operating a keypad in connection with one embodiment of the present invention. An enhanced keypad is shown in fig. 14b, where the user can operate all the functions provided by the system. Thus, at step 3300, the user initiates an operation on the keypad and selects the mode of operation at step 3302. It should be noted that the system is preconfigured to assign one or more user fingers to a corresponding mode of operation. For example, in one embodiment of the present invention, the system may assign a thumb to "control" mode operation. The little finger may be assigned to a mathematical mode of operation. Any or all of the middle three fingers may be assigned to alphabetic mode operation. So referring to fig. 14b, if the little finger is pressed, the system points to the character function located at the right of each button. Similarly, if the thumb is depressed, the system points to the "control" character function located at the bottom of the middle of each button, and if any of the middle three fingers are depressed, the system points to the alphabetic character function. It should be noted that the invention is not limited in scope to this embodiment and any form of finger assignment may be employed to distinguish the desired mode of operation. For example, the digit pad of the user's thumb may be assigned to a command configuration. The digit pad of any other finger may be assigned to the alphabetic configuration and the tip of any finger may be assigned to the mathematical configuration.

The system determines which mode of operation has been selected based on the finger pressed in step 3304. If the alphabet mode is selected, the system proceeds to step 3306 and begins the alphabet process, as shown in FIG. 24. If the math mode is selected, the system moves to step 3308 and begins the math process, as shown in FIG. 25. Finally, if the command mode is selected, the system moves to step 3310 to begin the command process, as shown in FIG. 26.

As shown in fig. 24, the alphabetical process begins at step 3320. In step 3322, the system determines whether the user uttered a letter or word of speech, or whether the user's lip shape was active or other indicator such as a facial expression indicating a function. In the alphabet mode, the system receives, for example, a speech signal for each letter of the alphabet that needs to be typed. For example, referring to FIG. 14, when the system recognizes one of the letters pronounced as "A", for example, the system moves to step 3324 to determine which button was pressed at the same time. If, for example, button 1406 is pressed, the system selects the corresponding letter "A" based on the combination of the pronunciation of "A" and pressing button 1406 at step 3330. Current practice is to press, for example, button 1405 a number of times until the desired letter is typed, the combination of voice and finger presses reducing the number of presses required.

If the voice or lip indication is not the pronunciation of a letter but a predetermined command, such as "up" or "down", the system assigns a character located above or below the button in step 3322. For example, if the user uttered an "up" voice and pressed button 1455 in fig. 14b, the system selects the corresponding "? "symbol. However, if the system does not recognize a sound, or does not hear a sound, it proceeds to step 3340 and returns to step 3300.

If the system does not hear a sound or recognize lip movements or other facial expressions, but the user presses a button, step 3322, the system moves to step 3334 and selects a corresponding default character, symbol or function. For example, referring to FIG. 14b, if button 1455 is pressed without emitting a sound, without lip motion and other facial expressions, the system selects the TAB function, the default function. At step 3336, the user looks at the display window to determine whether the desired character is selected. If not, the user presses the backspace command at step 3338 and the system returns to step 3300 to begin operation.

If the user has selected the math mode, the system moves to step 3350, as shown in FIG. 25. In step 3352, the system again determines whether the user uttered a predetermined word, such as "up" or "down," or a non-predetermined word, or whether the user's lip or other facial expression has moved to indicate a predetermined or non-predetermined word. If so, the system moves to step 3354 to determine which predetermined word the spoken voice has been uttered in conjunction with the button being pressed.

For example, if the button 1454 is pressed with the pronunciation of the word "up," the system selects the corresponding "%" symbol at step 3356. However, if the system does not recognize a sound, or does not hear a predetermined sound, it proceeds to step 3364 and returns to step 3300. On the other hand, if there is no pronunciation of the word, the system moves to step 3358 to select a default character, such as the number "2" in FIG. 14b, in response to pressing the button 1454. If any errors occurred in the input process, the system will go to step 3362 and perform the same functions as discussed with reference to FIG. 24.

Finally, if the user selects a command process, the system moves to step 3370 and detects in step 3372 whether the user utters a word of speech, either by labiating it or by having other facial representations, indicating a predetermined signal, such as saying the word "up" or "down", or a non-predetermined word, as previously described. The system selects a corresponding command or function in response to a predetermined combination of the pronunciation of the word and the pressing of a button in step 3376. However, if the system does not recognize a sound or hear a predetermined word, it proceeds to step 3380 and returns to step 3300. If there is no pronunciation of the word or no lip or facial expression motion is recognized, the system moves to step 3378 to select a default "command". The system then exits at step 3380 and returns to step 3300 to await the next operation by the user.

Thus, while there have been shown, described, and pointed out fundamental novel features of the invention as applied to various embodiments thereof, it will be understood that various omissions and substitutions and changes in the form and details of the invention disclosed herein may be made by those skilled in the art without departing from the spirit of the invention. Accordingly, it is intended that the scope of the claims appended hereto be limited only. It should be understood that the drawings are not necessarily to scale and that they are merely representative of the basic principles.

Claims

1. A data entry system comprising:

a predetermined number of keys through which at least a plurality of characters are input character by character, wherein,

the data entry system using a number of symbols comprising at least letters of an alphabet of at least one language, and wherein the symbols are assigned to the keys such that at least two of the letters are assigned to at least one of the keys, and wherein,

the symbols assigned to the keys are thus entered: providing predetermined interactions with the keys on the keys and providing speech information corresponding to the symbols for selecting the symbols among the symbols assigned to the keys, wherein the speech information is detected and analyzed based on at least one of the user's voice and the user's lip movements.

2. The data entry system of claim 1, wherein symbols are assigned to different keys, respectively, the symbols being at least letters having similar ambiguous speech information and being difficult to distinguish from each other by their corresponding speech information.

3. The data input system of claim 2, wherein said symbols, which are difficult to distinguish from each other by their corresponding speech information, refer to those symbols having speech information that is most ambiguous and similar to each other.

4. A data entry system according to claim 1 and wherein said speech information provides said speech information corresponding to said symbol.

5. A data entry system according to any of claims 1 and 2, wherein said speech information is absent and wherein at least one of said symbols assigned to a key is entered by: providing the predetermined interaction to the key in the absence of speech, the absence of speech being detected by the system.

6. The data entry system of claim 1, wherein the symbol is a letter of the alphabet and the voice message is a sound uttering the letter.

7. A data entry system according to any preceding claim, wherein said number of symbols comprises at least one of numeric characters, punctuation characters, commands and functions.

8. The data entry system of claim 1, wherein said key press operation and said voice message are provided simultaneously.

9. A data entry system according to claim 1, wherein said data entry system performs its function generally independently of the display unit.

10. A data entry system according to claim 1, wherein said number of symbols comprises substantially all of the basic symbols used to enter or edit text or to operate a computer.

11. A data entry system according to claim 1, wherein said number of symbols is generally limited to all basic symbols used for entering or editing text or operating a computer, such that said system performs its functions generally independently of a display unit.

12. A data entry system according to claim 1, wherein said number of keys comprises 12 keys of a repeating telephone-type keypad configuration, wherein at least substantially all of said letters are assigned to said key configuration.

13. A data entry system according to claim 1 and wherein at least substantially all of said letters are assigned to 4 of said number of keys.

14. A data entry system according to claim 13, wherein said 4 keys consist of 2 columns of 2 of said keys.

15. The data entry system of claim 1, wherein words of a language are entered letter-by-letter.

16. The data entry system of claim 15, wherein said data entry system further comprises a spell checker for correcting misspelled words when entered.

17. A data entry system according to claim 1, wherein a word of a language is entered by entering a starting character of said word character by character, and wherein said data entry system further comprises a word completion system for completing remaining characters of said word.

18. A data entry system according to claim 1, wherein the surface of said key is part of a touch sensitive surface.

19. A data entry system according to claim 18 and wherein the surface of said key is part of a touch sensitive surface.

20. A data entry system for entering at least arbitrary characters, the system comprising:

a number of keys; and

a number of symbols assigned to said keys, wherein said symbols comprise at least alphabet letters of at least one language, additional symbols comprise at least one of numeric symbols, punctuation characters, commands and functions, wherein said symbols are assigned to said keys such that the number of said alphabet letters of said at least one language is greater than the number of keys to which said letters are assigned, and wherein,

said data entry system having at least a first type of input procedure for entering a symbol assigned to one of said keys, wherein said at least one first type of procedure comprises:

providing a predetermined type of interaction with said key, wherein said predetermined type of interaction is at least one predetermined type of interaction with said key; and

providing a predetermined speech corresponding to the symbols, wherein any two symbols assigned to a key that are input with the same predetermined type of interaction with the key have different assigned predetermined speech, the speech being detected and analyzed based on at least one of a user's voice and a user's lip movements.

21. A data entry system according to claim 20, wherein said data entry system further comprises at least one second type of procedure for entering symbols assigned to keys, wherein said second type of procedure comprises:

providing a predetermined type of interaction with the key in the absence of speech, wherein the absence of speech is detected by the system, wherein the predetermined type of interaction is at least one predetermined type of interaction with the key, and wherein any two different symbols are input by a different predetermined type of interaction with the key when the two symbols are input in the absence of speech.

22. A data entry system according to claim 21, wherein at least some of the symbols requiring speech and some of the symbols requiring no speech are assigned to the same key.

23. A data entry system according to any preceding claim, wherein said at least one type of interaction is at least one of a single press operation, a double press operation, a press and hold operation and a slide operation on said key.

24. The data entry system of claim 20, wherein the symbols whose entry requires speech are at least some letters.

25. The data entry system of claim 20, wherein the letters are generally entered by the same type of interaction on their corresponding keys and speaking the sounds of the letters.

26. The data entry system of claim 20, wherein a single-press operation is one of the at least one predetermined type of interaction, and wherein letters are generally entered by performing a single-press operation on their corresponding keys and speaking the pronunciation of the letter.

27. A data entry system according to claim 20, wherein the symbols allocated to pressing operations other than a single pressing operation on a key are symbols that are generally less frequently used than the symbols allocated to single pressing operations on said key.

28. A data entry system according to claim 20, wherein a double-press operation on a key is one of said at least one predetermined type of interaction with said key, and wherein at least some of said additional symbols are assigned to double-press operations on the corresponding key.

29. A data entry system according to claim 20, wherein each of said additional symbols is entered by: and providing corresponding preset pressing operation on the corresponding key and providing preset voice distributed to the symbols.

30. The data entry system of claim 20, wherein said predetermined interaction and said voice information are provided simultaneously.

31. The data entry system of claim 20, wherein said predetermined interaction and said voice information are provided simultaneously.

32. The data entry system of claim 20, wherein said number of keys comprises 12 keys of a repeating telephone-type keypad configuration, wherein at least, substantially all alphabet characters of one language are assigned to said 12 keys.

33. A data entry system according to claim 20, wherein said number of keys comprises at least 4 keys, wherein at least, substantially all alphabetic characters of one language are assigned to said 4 keys.

34. A data entry system according to claim 33 and wherein said 4 keys are arranged in 2 rows of keys, each row of said keys comprising 2 of said keys.

35. A data entry system according to claim 33 and wherein said 4 keys are comprised of 2 columns of 2 of said keys.

36. A data entry system according to claim 20, wherein symbols which require speech when entered and are difficult to distinguish from each other by their corresponding speech, and those symbols which perform the same predetermined interaction with said keys, are assigned to different keys respectively.

37. A data entry system according to claim 36, wherein said symbols which are difficult to distinguish from each other are at least those having the most ambiguous and mutually similar speech.

38. A data entry system according to claim 20, wherein said number of symbols comprises substantially all of the base symbols used to enter or edit text or to operate a computer, said base symbols including any of alphanumeric characters, punctuation symbols and commands.

39. A data entry system according to claim 20, wherein said number of symbols is generally limited to substantially all base symbols used for entering or editing text or operating a computer, said base symbols including any of alphanumeric characters, punctuation symbols and commands.

40. A data entry system according to claim 20 and wherein said data entry system provides at least any arbitrary string of characters on a character-by-character basis.

41. A data entry system according to claim 20, wherein words of a language are entered character by character.

42. A data entry system according to claim 41 and wherein said data entry system further comprises a spell checker for correcting words with spelling errors when entered.

43. The data entry system of claim 20, wherein a word of a language is entered by entering a beginning character of the word character by character, and wherein the data entry system further comprises a word completion system for completing remaining characters of the word.

44. A data entry system according to claim 20 and wherein said keys are touch sensitive keys.

45. A data entry system according to claim 44 and wherein the surface of each said key is part of a touch sensitive surface.

46. A data entry system according to claim 45 and wherein said surface is a touch screen of an electronic device.

47. The data entry system of claim 20, wherein the predetermined type of interaction is one of: the key is depressed with a fingertip portion of a finger, or depressed with a flat portion of a finger.

48. A data entry system according to claim 20 and wherein said key is a virtual key, said interaction with said key being optionally detected by the system.

49. A data entry system according to claim 20 and wherein said data entry system performs its function generally independently of the display unit.

50. A data input system comprising:

a predetermined number of keys for inputting at least arbitrary characters through said keys, wherein said data input system uses a number of symbols comprising at least letters of the alphabet of at least one language, and wherein said symbols are assigned to said keys such that at least two of said letters of said at least one language are assigned to at least one of said keys, and wherein,

the symbols assigned to the keys form at least one set of symbols, said at least one set of symbols comprising at least one of said symbols, each of said at least one set of symbols of a key being assigned to one of at least one predetermined type of interaction with said key, and wherein,

the symbols of one of said plurality of groups of symbols of said key are entered by: providing the predetermined interaction with the key corresponding to the set of symbols, and providing speech information corresponding to the symbols for selecting the symbols among the set of symbols of the key, wherein the speech information is detected and analyzed based on at least one of a user's voice and a user's lip movements.

51. A data entry system according to claim 50 and wherein said number of symbols further comprises other symbols having at least one of numeric characters, punctuation characters, commands and functions.

52. A data entry system according to claim 50 or 51, wherein the symbols assigned to a key form at least two groups of symbols, wherein a first group of said symbols and a second group of said symbols are assigned to a first type and a second type of pressing operation on said key, respectively.

53. A data entry system according to claim 52 and wherein said first and second depression operations are a single depression operation and a double depression operation, respectively, on said key.

54. A data entry system according to claim 52 wherein the symbols are entered by: providing corresponding pressing operation on the corresponding key and speaking the pronunciation of the predetermined name of the symbol.

55. A data entry system according to claim 54 and wherein letters are generally entered by a single depression on their respective keys and speaking the pronunciation of said letter.

56. A data entry system according to claim 53 and wherein the symbols allocated to a double-press operation on a key are symbols which are generally less frequently used than the symbols allocated to one of said types of press operation in at least one of said keys.

57. A data entry system according to claim 50 and wherein a single depression on a key is one of said at least one type of said depression on said key.

58. The data entry system of claim 50, wherein the letters are generally entered in association with their corresponding voices with the same predetermined depression on their corresponding keys.

59. A data entry system according to claim 58 and wherein said depression is a single depression on said key.

60. The data entry system of claim 50, wherein the single press operation is one of the at least one type of press operation, and wherein the letters or numbers are entered generally as: and executing a single pressing operation on the corresponding key and speaking the pronunciation of the letter or the number.

61. A data entry system according to claim 50 and wherein said double-press operation or sliding operation is one of said at least one type of press operation on a key.

62. A data entry system according to claim 57 wherein the symbols allocated to depression operations other than a single depression operation on a key are symbols which are generally less frequently used than the symbols allocated to single depression operations on said key.

63. A data entry system according to claim 62 and wherein said further depression is at least one of a double depression and a swipe on a corresponding key.

64. A data entry system according to claim 50 and wherein said at least one predetermined type of interaction is at least one of a light and a heavy press operation on said key.

65. A data entry system according to claim 50 and wherein said at least one type of depression is the depression of two keys simultaneously.

66. The data entry system of claim 50, wherein said voice message is a pronunciation of said symbol.

67. A data entry system according to claim 50 and wherein said voice message corresponds to a spoken position of said symbol printed on said key relative to other symbols printed on said key.

68. The data input system of claim 50, wherein a case where no voice is present is regarded as said voice information, and said system detects said case where no voice is present, and wherein in the case where no voice is present, a predetermined symbol of said group of symbols on the key is input by said pressing operation corresponding to said group.

69. A data entry system according to claim 68 and wherein said symbol is one of a punctuation character, a command or a function.

70. A data entry system according to claim 68 and wherein at least some of the symbols requiring speech and at least some of the symbols requiring no speech are assigned to the same key.

71. A data entry system according to claim 68 and wherein at least some of the symbols requiring speech and a symbol requiring no speech are assigned to the same group of symbols of a key.

72. The data entry system of claim 50, wherein said pressing operation and said voice message are provided simultaneously.

73. The data entry system of claim 50, wherein when a symbol is entered, if a key press operation and corresponding voice information are correctly provided and the system enters an erroneous symbol corresponding to a set of symbols of the key press operation, the user deletes the symbol and repeats the same key press operation and the same voice information is provided, the system selects another symbol that best matches the voice information between symbols corresponding to the key press operation.

74. A data entry system according to claim 50 and wherein at least two of said sets of symbols of said keys comprise at least the same symbol.

75. The data entry system of claim 50, wherein said keys are comprised of keys of a 12 repeating telephone-type keypad configuration in which substantially all alphanumeric characters of at least one language are assigned to at least some of said 12 keys.

76. A data entry system according to claim 50 and wherein said keys are comprised of keys of a 12 repeating telephone-type keypad configuration wherein substantially all alphanumeric characters of at least one language and at least some of said additional symbols are assigned to at least some of said 12 keys.

77. The data entry system of claim 76, wherein alphanumeric characters of at least one language are distributed over said 12 keys to repeat an alphanumeric configuration of a telephone-type keypad having said language.

78. A data entry system according to claim 50 and wherein said keys are comprised of at least 4 keys and wherein alphanumeric characters in at least substantially all of one language are assigned to said 4 keys.

79. The data entry system of claim 50, wherein said keys are comprised of at least 4 keys, wherein substantially all alphanumeric symbols and at least some of said additional symbols are assigned to said 4 keys.

80. A data entry system according to claim 78 or 79, wherein said 4 keys are arranged in 2 rows of keys, wherein each row of said keys comprises 2 of said keys.

81. A data entry system according to claim 78 or 79 and wherein said 4 keys are comprised of 2 columns of 2 of said keys.

82. The data input system of claim 50, wherein symbols which require a voice at the time of input and are hardly distinguished from each other by their corresponding voices, and those symbols which perform the same predetermined interaction with the key are respectively included in different symbol groups of the key.

83. The data entry system of claim 82, wherein the symbols requiring speech and being difficult to distinguish from each other by their corresponding speech are entered, and wherein the symbols performing the same predetermined interaction with said keys are at least those having the most ambiguous and similar speech to each other.

84. A data entry system according to claim 50 and wherein said data entry system performs its function generally independently of the display unit.

85. A data entry system according to claim 50 and wherein said number of symbols comprises substantially all of the base symbols used to enter or edit text or to operate a computer, said base symbols including any of alphanumeric characters, punctuation symbols and commands.

86. A data entry system according to claim 50 and wherein said number of symbols is generally limited to substantially all of the basic symbols used to enter or edit text or to operate a computer, said basic symbols including any of alphanumeric characters, punctuation symbols and commands, whereby said system performs its functions generally independently of a display unit.

87. A data entry system according to claim 50 and wherein words of a language are entered character by character.

88. A data entry system according to claim 87 and wherein said data entry system further comprises a spell checker for correcting words with spelling errors when entered.

89. The data entry system of claim 50, wherein a word of a language is entered by entering a beginning character of the word character by character, and wherein the data entry system further comprises a word completion system for completing remaining characters of the word.

90. A data entry system according to claim 50 and wherein said keys are touch sensitive keys.

91. The data entry system of claim 90, wherein the surface of each of said keys is part of a touch-sensitive surface.

92. The data entry system of claim 50, wherein said predetermined type of interaction is one of: the key is depressed with a fingertip portion of a finger, or depressed with a flat portion of a finger.

93. A data entry system for entering at least a plurality of characters on a character-by-character basis, wherein:

the data entry system using a number of symbols comprising at least letters of an alphabet of at least one language, and wherein the symbols are assigned to a number of press operations at different locations on a touch sensitive surface, such that at least two of the letters are assigned to a press operation at one of the locations on the surface, and wherein,

based on a location of the press operation at one of the locations of the surface in relation to locations of at least one other press operation at different locations on the surface, the system identifies the press operation assigned to the one of the locations on the surface, and wherein,

the symbol assigned to the press operation at the one of the positions on the surface is thus input: providing the pressing operation on the one of the positions on the surface and providing speech information corresponding to the symbols to select the symbols between symbols assigned to the pressing operation on the one of the positions on the surface, wherein the speech information is detected and analyzed based on at least one of a voice of a user and an action of a lip of the user.

94. A data entry system according to claim 93 and wherein those symbols which have the most ambiguous and similar speech information and are indistinguishable from each other by their corresponding speech information are assigned to different pressing operations on different parts of said surface respectively.

95. The data entry system of claim 93, wherein said voice message is a utterance that corresponds to said symbol.

96. A data entry system according to claim 93 wherein said speech information is said absence of speech and wherein at least one of said symbols is assigned to a pressing operation at a location on said surface in the absence of speech, said absence of speech being detected by said system.

97. The data entry system of claim 93, wherein said symbol is a letter and said voice message is a sound uttering said letter.

98. A data entry system according to claim 93 and wherein said number of symbols comprises substantially all of the basic symbols used to enter or edit text or to operate a computer, such as alphanumeric characters, punctuation marks and commands.

99. A data entry system according to claim 93 and at least substantially all of said letters being assigned to 10 depressed locations on said surface.

100. The data entry system of claim 99, said 10 locations on said surface being depressed by different fingers of the user.

101. A data entry system according to any preceding claim wherein said user settings are dynamically defined each time a user provides a calibration procedure.

102. A data entry system according to claim 101 and wherein said system recognizes a first user's finger press on a first location of said surface and accordingly defines further press operations provided by other fingers of the user on said surface.

103. A data entry system according to claim 93 and wherein words of a language are entered character by character.