WO2010018579A2 - Improved data entry system - Google Patents
Improved data entry system Download PDFInfo
- Publication number
- WO2010018579A2 WO2010018579A2 PCT/IL2009/000794 IL2009000794W WO2010018579A2 WO 2010018579 A2 WO2010018579 A2 WO 2010018579A2 IL 2009000794 W IL2009000794 W IL 2009000794W WO 2010018579 A2 WO2010018579 A2 WO 2010018579A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- keys
- key
- user
- processor
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
- G06F3/0236—Character input methods using selection techniques to select from displayed items
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04807—Pen manipulated menu
Definitions
- the present invention relates to data input devices and particularly to devices and methods for entering letters and other symbols.
- Mobile devices including cellular phones, personal digital aids and miniature computers are widely used as they are easily carried around and can perform many tasks.
- One problem of the mobile devices is text entry, which is problematic due to their small size.
- One solution for text entry in mobile devices is using a limited key set in which at least some of the keys are ambiguously associated with a plurality of letters. Upon receiving a sequence of key strokes, a word dictionary is consulted to guess the word intended by the user.
- US patent 5,818,437 suggests providing in addition to a main window, an additional window which provides feedback on the keys pressed, in the form of the letters associated with each key pressed for the current word.
- the 5,818,437 patent suggests displaying a plurality of possible words directly in the main window for the user to select the intended word. These feedback methods may however be confusing and may not provide the user sufficient ease in identifying errors in typing.
- Chinese patent publication 101286096 describes keys that become mode keys in response to pressing a first mode key.
- Some mobile devices receive user input through a touch screen.
- Touch screens are also used on non-portable devices.
- US patent application 2007/0097092 to Jung et al. titled: "Method of using a Touch Screen and user interface apparatus employing the same", the disclosure of which is incorporated herein by reference in its entirety, describes using a touch screen with a plurality of zones having identical keys for different users.
- US patent publication 2009/0073002 to Alvarado describes a scheme in which the letters of the alphabet are entered by straight line traces on a touch screen.
- the touch screen is divided into various cells and traces in different locations are given different interpretations.
- An aspect of some embodiments of the invention relates to a data entry system in which the same keys are used both for entering letters and as mode keys for changing the function of at least some keys of the data entry system.
- the keys have different functions when pressed for a short duration and when pressed for a long duration.
- the letter or letters associated with the key are entered.
- the data entry system optionally enters a symbol mode, in which at least some of the keys change their meaning.
- An aspect of some embodiments of the invention relates to a data entry unit which receives user selections of keys of the well known 12 key telephone keypad in the form of vectors which indicate respective positions of keys in the 12 key telephone pad.
- the vectors may be interpreted as relating to the key to which the vector points if its start point is at the middle 5 button of the telephone keypad.
- the data unit is adapted to receive indications of at least 5 or even at least 7 keys of the well known telephone keypad using the vectors.
- the other keys may be provided using other means or the data unit may not be adapted to receive indications of the other keys.
- the vectors are received in the form of sweeping gestures on a touch screen of the data entry unit.
- the vectors are received in the form of pressing a sequence of two keys in the direction of the vector.
- the vectors are associated with the keys of the 12 key telephone keypad only based on their direction. Alternatively, the length of the vector is also taken into consideration.
- the vectors are optionally associated with the keys without relation to their starting position on the touch screen.
- An aspect of some embodiments of the invention relates to a telephone unit with a touch screen which is adapted to receive sweeping gestures on the touch screen and to interpret them as digits in dialing a telephone number responsive to their direction.
- at least six of the sweeping gestures correspond to the digit on the key of the known 12 key telephone keypad in the direction of the sweeping gesture from the middle key corresponding to the digit 5 of the 12 key telephone keypad.
- the vectors are used in dialing telephone numbers to be called. Using sweeping gestures allows dialing a number substantially without looking, allowing, for example, dialing a number during driving.
- Vector dialing may be provided with speech feedback which iterates the dialed digits, so that the used does not need to look to make sure the correct number was dialed.
- a touch sensitive pad is placed on a steering wheel for dialing.
- An aspect of some embodiments of the invention relates to a data entry unit which presents guess characters for character positions associated ambiguously with a plurality of characters.
- the data entry unit is adapted to receive user indications of word portions that were guessed correctly, for groups of letters including fewer than all the letters of the word. Such indications aid the data entry unit in guessing the intended word by limiting the possibilities and hence make the guessing faster and simpler.
- An aspect of some embodiments of the present invention relates to a data entry unit which receives, for at least some character positions, user input signals ambiguously associated with a plurality of letters and displays for those character positions a single letter selected in an attempt to guess the letter intended by the user.
- the data entry unit displays letters representing character positions associated with a plurality of letters in a manner different than it displays letters representing character positions associated with a single letter.
- the letters of single letter character positions are displayed in a different font, color or size than letters of multi-letter character positions.
- letters representing multi-letter character positions are displayed with a marking adjacent the character in the character position in the same window, for example above or below the letter.
- the marking above or below the letter includes the other letters with which the character position is associated, possibly in a smaller font than the letter of the character position.
- the display of the multi-letter character positions associates the character position with the key corresponding to the letters associated with the character position.
- each key which is associated with a plurality of letters is associated with a color or other marking and letters in character positions associated with that group of letters are presented in the corresponding color or with the corresponding marking.
- the differentiation between the display of ambiguous and non-ambiguous character positions is maintained permanently.
- the differentiation in the display is applied only upon user request and/or when the data entry unit identifies that the user may need help, for example when a backspace function is used or the cursor is moved within a word.
- the extent of the display is changed between a regular state in which the differentiation is of a limited nature and a user-aid state in which the differentiation is more detailed.
- the system merely differentiates between ambiguous and non-ambiguous character positions, possibly using a first color for ambiguous positions and a second color for non-ambiguous positions.
- ambiguous character positions are associated with a display which links them to the group of letters with which they are associated.
- An aspect of some embodiments of the invention relates to a method of data input in which user sweeping gestures result in different functions responsive to the width of the gesture.
- a data entry unit differentiates between sweeping gestures provided by a stylus and gestures provided by a finger, or between gestures provided by different fingers.
- the data entry unit differentiates between sweepings entered by the tip of the finger and sweepings entered by the flat portion of the finger.
- An aspect of some embodiments of the present invention relates to a data entry unit including a touch sensitive pad, which relates in the same manner to similar movements beginning at different points within zones of the pad, but relates differently to similar movements on different zones of the pad.
- the screen is divided into at most ten zones or even into at most six zones, each zone covering at least 105, at least 15% or even at least 20% of the area of the touch sensitive pad.
- An aspect of some embodiments of the present invention relates to a detachable keypad which includes keys corresponding to all the letters of the alphabet, which is operable when detached such that the letters are split between at least two detachable units.
- the two detachable units communicate with each other wirelessly.
- An aspect of some embodiments of the invention relates to a data entry system which receives user input signals associated ambiguously with a plurality of letters and guesses intended words accordingly.
- the data entry system provides soft keys for each of the letters of the first ambiguous character position of the word, regardless of which character position had its ambiguous letter set most recently entered.
- the system automatically provides soft keys for the next character position in the word in addition to entering the selected letter to the character position.
- Providing soft keys for the first character position of the word rather than the most recently entered character position allows the user a simpler procedure to correct a word after the ambiguous letter sets were entered for the entire word if the word was not guessed properly.
- An aspect of some embodiments of the invention relates to a data entry system adapted to receive movement input signals, and to determine whether to interpret the signals as mouse pointer control signals or as sweeping gestures corresponding to input characters based on the current state of character input.
- the determination depends on whether the character input is in the middle of a word.
- the data entry system determines automatically whether to interpret the movement input signals as character input gestures or as mouse signals and thus allows controlling both with the same device without requiring that the user switch between the different operation modes.
- movement input signals are considered mouse pointer control signals, while after other characters the movement input signals are considered sweeping gestures corresponding to one or more characters.
- An aspect of some embodiments of the invention relates to a data entry device which in a data entry mode manages a plurality of cursors for indicating the character positions to which characters of input signals are applied. Different character input signals may thus be applied to different cursor positions.
- the data entry device is adapted to receive two groups of input signals, each group including signals covering all the letters of the alphabet. The signals of each group apply to different cursor positions, in a same text window.
- at least some of the input signals are ambiguously associated with a plurality of letters.
- An aspect of some embodiments of the invention relates to a data entry device adapted to associate character positions with a plurality of capital letters, ambiguously.
- a capital letter is displayed.
- An aspect of some embodiments of the invention relates to a data entry device adapted to receive input signals associated ambiguously with letters and non-letter symbols and to guess words intended by the user in a sequence of input signals using a database of words.
- the user adds to the dictionary the words used that include non-letter symbols. While these words may be added before use, they also may be added automatically each time a word is used.
- the first time a word which is not in the dictionary is used the user enters it using its corresponding sequence of input signals and then indicates the exact symbol for each character position. The resultant word is then added to the dictionary and is used in guessing the word next time it is used by the user.
- the input signals include input signals only associated with letters and input signals only associated with non-letter symbols.
- each of the input signals is associated ambiguously with a plurality of letters and with one or more non-letter symbols.
- each of the input signals is associated with a plurality of non-letter symbols.
- all the digits are associated with a single input signal, making it very easy for the user to remember where the digits are.
- the digits are distributed between the input signals so as to increase the chances that the system will successfully guess the intended word in cases in which the intended word is a telephone number or the like.
- An aspect of some embodiments of the invention relates to a remote data entry unit with a touch pad, which is adapted to receive user input through the touch pad for a master device.
- the remote data entry unit is adapted to perform substantially only tasks related to data entry, such that it has minimal power consumption and can operate on batteries for a long time.
- the data entry unit receives for character positions user signals corresponding ambiguously to a plurality of characters and determines for each character position a single character for the position.
- the data entry unit transmits to the master a single character for each character position.
- the selection of the single character representing a character for each character position is performed by the master.
- the remote data entry unit includes only a touch pad without a screen or keys.
- the remote data entry unit includes hard keys in addition to the touch pad, for example several keys on the right and left of the touch pad.
- An aspect of some embodiments of the invention relates to a data entry device including a main data entry unit and adapted to display an auxiliary small keypad including small keys on a side of the screen permanently during data entry. The device is adapted to enlarge the auxiliary keypad when a user presses one of its soft keys, to make it easier for the user to press additional soft keys.
- the device optionally reverts the auxiliary keypad to its small state when input is received through the main data entry unit and/or when otherwise it is determined that the user will not be using the auxiliary keypad, for example after a predetermined amount of time and/or after completing entering a word using the auxiliary keypad.
- a data entry system comprising a plurality of first keys, a plurality of second keys, a display; and a processor adapted to interpret a first type of user interaction with the first keys as entrance of one or more characters and to interpret a second type of interaction with the first keys as mode signals which change the meanings of at least three of the second keys.
- the first type of user interaction comprises actuation for a short period and wherein the second type of user interaction comprises actuation for a longer period.
- the second keys comprise soft keys.
- a data entry system comprising a user input interface adapted to receive user signals in the form of directed vectors; and a processor adapted to interpret at least five different directed vectors received by the user input interface as corresponding to keys of the 12 key telephone keypad located in the direction of the vector from a start point.
- the processor is adapted to interpret at least seven different directed vectors received by the user input interface as corresponding to keys of the 12 key telephone keypad.
- the processor is adapted to interpret the directed vectors as corresponding to keys of the 12 key telephone keypad located in the direction of the vector from a center key of the keypad.
- the user input interface comprises a touch screen and interprets sweeping gestures on the touch pad as vectors.
- the input interface is adapted to interpret the direction of the sweeping of the gesture as a straight line from its start point to its ending point.
- the input interface is adapted to interpret sweeping gestures on the screen which include curves as a plurality of separate vectors, each straight line segment corresponding separately to a key of the 12 key telephone keypad.
- the user input interface comprises a plurality of keys and interprets pressing of key sequences as vectors in the direction from the first key in the sequence to the last key in the sequence.
- a data entry system comprising a user input interface adapted to receive user signals corresponding ambiguously to letters of the alphabet and to receive a fixation signal; and a processor adapted to receive user signals corresponding ambiguously to letters for a plurality of character positions of a word and to provide guess letters for the character positions, the processor is adapted to update its guesses of character positions responsive to receiving additional user signals corresponding ambiguously to letters for the same word and the processor does not change the letters of character positions for which the fixation signal was applied.
- the fixation signal is received responsive to simultaneous pressing of two keys.
- the fixation signal applies to a single character position each time it is pressed.
- the fixation signal applies to all the character positions in a current word, before a current cursor position.
- the fixation signal applies to a first ambiguous character position of the current word, regardless of a current cursor position.
- a data entry system comprising a user input interface adapted to receive input signals corresponding to characters, including signals corresponding ambiguously to a plurality of characters; a screen; and a processor adapted to select for character positions for which an input signal corresponding ambiguously to a plurality of characters was received, a single character to represent the character position, and to display, on the screen, for each character position, a single character, in a manner which differentiates between character positions associated ambiguously with a plurality of characters and character positions associated with a single character.
- the processor displays characters in character positions associated ambiguously with a plurality of characters in a different color than characters in character positions associated with a single character.
- the processor displays adjacent character positions associated ambiguously with a plurality of characters, markings not displayed near character positions associated with a single character.
- the processor displays character positions associated ambiguously with a plurality of characters in a manner which associates the character position with a key of the user input interface which is used to generate the specific plurality of characters of the character position.
- a data entry unit comprising a touch screen; and a processor adapted to interpret sweeping gestures on the touch screen as indicating one or more characters, according to a trajectory and starting point of the sweeping gesture, the touch screen is considered to be divided into up to 10 zones each covering at least 10% of the area of the touch screen, and sweeping gestures of a specific trajectory starting anywhere in a zone are interpreted to correspond to the same one or more characters.
- the touch screen is considered as divided into at most six zones, possibly exactly two zones.
- the processor is adapted to interpret sweeping gestures in a first zone as matching one of a first group of directions and to interpret sweeping gestures in a second zone as matching one of a second group of directions, not the same as the first group of directions.
- the processor is adapted to interpret sweeping gestures in a first zone as matching one of a first group of directions and to interpret sweeping gestures in a second zone as matching one of a second group of directions, wherein the first and second groups of directions do not include any common directions.
- the processor is adapted to interpret sweeping gestures in all the zones as matching one of a predetermined group of directions common to all the zones.
- a data entry unit comprising: a plurality of first keys including fewer than 10 keys, which together are associated with all the letters of the alphabet; a touch screen; and a processor adapted to associate character positions of input words with groups of characters responsive to first key actuations and to provide on the touch screen soft keys for each of the letters associated with the first character position of the current word which is associated ambiguously with a plurality of characters, regardless of which first key was pressed most recently.
- a plurality of the first keys are associated with at least one non-alphanumeric symbol.
- each of two or more of the first keys is associated with a plurality of non- alphanumeric symbols.
- a data entry unit comprising a user input interface adapted to identify user movements, a screen and a processor adapted to control reception of words and their display on the screen and to control a mouse pointer on the screen responsive to identified user movements when the processor is not in the middle of entering a word and to interpret identified user movements as referring to groups of one or more characters when the processor is in the middle of receiving a word.
- the screen comprises a touch screen and the user input interface identifies the user movements on the touch screen.
- the user input interface identifies movements of fingers in the air.
- the processor is considered in the middle of receiving a word immediately after receiving an input signal corresponding to one or more letters and is considered not in the middle of receiving a word immediately after receiving a space signal, a return signal or a tab signal.
- a telephone unit comprising a touch sensitive surface; and a controller adapted to identify sweeping gestures on the touch sensitive surface, to correlate the sweeping gestures with digits according to the direction of the gestures and to dial a telephone number form of a sequence of digits determined from sweeping gestures.
- the controller is adapted to identify the digits corresponding to sweeping gestures, without relation to their starting point on the surface.
- the controller is adapted to identify the digits corresponding to at least some of the sweeping gestures, as the digit on the key of the known 12 key telephone keypad in the direction of the sweeping gesture from the middle key corresponding to the digit 5 of the 12 key telephone keypad.
- the controller is adapted to identify a tapping on the surface as the digit 5.
- the controller is adapted to associate the sweeping gestures with digits without relation to the length of the sweeping gestures except possibly for a single direction.
- the controller is adapted to identify a short downward sweeping gesture as the digit 8 and a longer downward sweeping gesture as the digit 0.
- a data entry unit comprising a touch screen; and a processor which displays on the screen a keypad, continuously during data entry, wherein the keypad is displayed in a small form when not in use and when a key of the keypad is actuated is presented in a large form.
- the small form is displayed at a corner of the screen and the large form is displayed in the middle of the screen.
- a data entry unit comprising a touch screen; and a processor adapted to identify user tapings on the screen and to select signals to which they correspond based on the size of the tapped area on the screen and a zone in which the tapping was performed, the zones used in selecting corresponding signals have at least three times the area of the thumb of an average adult.
- the zones used in selecting corresponding signals have an area of at least 10% of the touch screen.
- the processor differentiates between user tapings based on two zones: a right zone and a left zone.
- the processor differentiates between tapings by the tip of a finger and tapings by the flat area of the finger.
- a data entry unit of a vehicle comprising at least one touch pad mounted on a steering wheel of the vehicle; and a processor adapted to identify user actuations with the touch pad and interpret the actuations as input characters provided by the user.
- the at least one touch pad comprises a first touch pad on the right side of the steering wheel and a second touch pad on the left side of the steering wheel.
- the at least one touch pad is included in a unit including also hard keys.
- data entry unit includes a speech unit adapted to provide feedback to the user on characters input to the processor.
- the processor is adapted to identify taps of the user on different areas of the touch pad as different keys.
- the processor is adapted to identify sweeping gestures on the touch pad.
- Fig. 1 is a schematic illustration of a mobile phone, in accordance with an exemplary embodiment of the invention
- FIG. 2 is a flowchart of acts of a data entry system, in accordance with an exemplary embodiment of the invention
- Fig. 3A is a schematic illustration of a mobile device, in accordance with another exemplary embodiment of the invention.
- Fig. 3B is a schematic illustration of a data entry device and an auxiliary data entry unit, in accordance with an embodiment of the invention
- Fig. 3 C is a schematic illustration of a data entry device, in accordance with another exemplary embodiment of the invention.
- Fig. 4 is a schematic illustration of a mobile unit with a detachable keypad, in accordance with an exemplary embodiment of the invention
- Fig. 5 is a schematic illustration of entering data to a mobile device using sweeping acts, in accordance with an exemplary embodiment of the invention
- Fig. 6 is a schematic illustration of a key arrangement, in accordance with an exemplary embodiment of the invention.
- Fig. 7 is a schematic illustration of a display responsive to a user touching a screen, in accordance with an exemplary embodiment of the invention.
- Fig. 8 is a schematic illustration of correction of a sweeping gesture in progress, in accordance with an exemplary embodiment of the invention.
- Fig. 9 shows a four key arrangement together with various sweeping gestures entered by users, in accordance with an exemplary embodiment of the invention.
- Fig. 10 shows a key arrangement for a mobile device, in accordance with an exemplary embodiment of the invention
- Fig. 11 is a schematic illustration of a data entry device, in accordance with an exemplary embodiment of the invention.
- Fig. 12 is a schematic view of a notebook computer, in accordance with an exemplary embodiment of the invention.
- FIG. 1 is a schematic illustration of a mobile phone 100, in accordance with an exemplary embodiment of the invention.
- Mobile phone 100 comprises a plurality of input keys and an output screen 140.
- Each input key may be used by a user to provide one or more input signals, which represent letters, numbers, other symbols and/or control functions.
- input signals represent letters, numbers, other symbols and/or control functions.
- a processor 130 receives indications of the input signals actuated by the user and selects one character for each received input signal, optionally using an internal word dictionary 132, which lists words with respective ratings of frequency of use.
- the keys of mobile phone 100 are included in two main groups, a first group 150 and a second group 160, which each has keys associated with all the letters of the alphabet.
- the letters are optionally distributed between the keys in each group, such that each pair of a key from the first group 150 and a key from the second group 160 has only a single letter in common.
- the user by pressing a first group key and a second group key for a specific character location, the user indicates a specific letter unambiguously. While generally processor 130 guesses the words intended by the user based on the first keys only, when this does not occur the user can easily use the second keys to indicate the precise letters desired.
- one or more pair of first and second keys may have more than one letter in common, in order to reduce the number of keys required.
- the letters in common are ones which are generally not interchangeable in words (e.g., Q and V), such that processor 130 will nearly always guess which letter is intended, using dictionary 132.
- a mode key may be used to enter a mode in which specific letters can be entered unambiguously.
- first group 150 includes four keys, 101, 102, 103 and 104, assigned all the letters of the Latin alphabet.
- key 101 is assigned the letters HEBLXQ
- key 102 is assigned the letters FARMZT
- key 103 is assigned the letters GOVSYCK
- key 104 is assigned the letters JUINWDP.
- Other letter arrangements may be used on the four keys 101-104 and/or the letters may be arranged on a different number of first group keys.
- the letters are arranged in a manner which minimizes the chances of a sequence of key strokes corresponding to more than one frequently used word, for example by placing each of the vowels A, E, I and O on a different key.
- Keys 105 and 106 are optionally used for entering a space and a backspace, respectively.
- second group 160 includes twelve keys arranged in the standard numeric keypad arrangement used in many mobile telephones, with three columns of four rows.
- the digits are assigned to keys 111-119 and 121 and the letters of the Latin alphabet are assigned to eight keys, keys 112-119.
- a current character position In a text entering mode, a current character position, referred to herein also as a cursor position, is defined on display 140.
- the user presses a sequence of first group keys 101-104.
- the cursor position is associated with all the letters associated with the pressed key.
- One of the associated letters is displayed in the cursor position on display 140, for example a letter which in itself is a word or a letter which is most commonly used.
- the cursor position is then moved to an adjacent character position.
- the now current cursor position is associated with all the letters associated with the pressed key and one of the letters is displayed in the cursor position on display 140.
- the letter displayed for the cursor position is optionally selected based on all the keys pressed for the current word and not only the key pressed for the current cursor position.
- the letters displayed for the other character positions of the current word are optionally updated according to all the keys pressed for the current word.
- processor 130 After completing entering a word with the first group keys, processor 130 generally guesses the word intended by the user. In those cases in which the word was not guessed correctly, the user can enter additional information using the second group keys.
- a press on a second group key refers to the first character position of the word associated with a plurality of letters (referred to herein as not disambiguated).
- the character position is associated only with the letter in common to the letters of the first group key and the second group key pressed for the character position. This letter is displayed on display 140 for the character position.
- the letters displayed for the entire word are updated accordingly, based on the contents of word dictionary 132.
- the user may then press additional second group keys for subsequent character positions of the word, when processor 130 was still not able to guess the intended word. This process may be repeated, if necessary, until the entire word is entered again, this time using the second group keys.
- a second group key when a second group key is pressed it refers to the last character position of the word that was not disambiguated, rather than to the first letter of the word. It is noted that in some embodiments, the user may press second group keys before entering an entire word, for example when the user knows in advance that the word will not be guessed correctly by processor 130. It is noted that the processor 130 is configured to apply a second input signal provided by a second group key to a different position within the current word than a first input signal provided by a first group key, from a same cursor location.
- the second group key When a second group key is pressed while the cursor is in the middle of a word, with further letters of the word already entered on its right, the second group key optionally applies to the character position immediately to its left. Alternatively, as at the end of the already entered letters of the word, also when in the middle of a word, the second group keys pressed apply to the first not disambiguated character position of the word.
- an additional key is assigned a second backspace function for removing a second-group key disambiguation act, while leaving the character position associated with the letters of a first-group key.
- the second backspace function when the second backspace function is applied to a character position associated with a plurality of letters, the second backspace function has no affect.
- the second backspace function when the second backspace function is applied to a character position associated with a plurality of characters, it operates as backspace key 105 and removes the association of the character position with the group of letters.
- a single backspace key is used. When applied to a disambiguated character position the backspace function removes the disambiguation and when applied to a multi-letter character position it removes the group of letters from being associated with the character position.
- the second backspace function may optionally be applied several times in sequence until the entire current word is moved back to its original ambiguous form.
- an undo button or input signal which cancels the most recent input regardless of whether it was a first group key or second group key is provided in addition to or instead of the backspace key.
- a user can select a cursor position using a mouse control or by positioning the cursor near the position to be selected.
- the selected cursor position may optionally be anywhere on the screen not necessarily in the most recently entered word.
- Pressing a first key for the selected cursor position optionally replaces the data of the current cursor position with the letters of the first key.
- Pressing a second group key for the selected position optionally replaces any disambiguation information associated with the cursor position, with the disambiguation by the pressed second key, leaving the first key information of the cursor position unchanged.
- second group keys take no affect in single letter character positions. Further alternatively, the letters of the second group key replace the current letter or letters of the character position.
- the cursor position of mobile phone 100 remains in the same location, in case the user wants to perform disambiguation using a second group key.
- the current cursor optionally moves to the next character position, to the next character position including a letter or to the next not disambiguated character position.
- the user can control the character position affected by the second group keys, separately from the cursor location which affects the character position that will be affected by a pressed first group key.
- a correction point indicator points to a character position within the word, which will be corrected by the second group keys.
- the correction point indicator is displayed on display 140, for example as a dot above or below the letter in the character position to which the indicator points.
- the user can move the correction point indicator within the current word, for example by pressing a first sequence of two first group keys to move the indicator to the right and a second sequence to move the indicator to the left.
- the word is added to the dictionary, so that the processor will guess the word next time it is used.
- the new word is assigned a relatively low priority, such that it is chosen only if original dictionary words that match the letters of the word are not available.
- the priority of the word is raised.
- a key of mobile phone 100 or a key combination is assigned to a fixation act which tells processor 130 that the guess letter for the current character position is correct.
- the fixation act indicates to processor 130 that the guess letters for all the letters of the current word up to the current location are accurate and these locations are disambiguated accordingly.
- two different key combinations are assigned to letter and word fixation acts.
- the first group 150 keys are used to enter letters and the second group keys are used for disambiguation.
- the character position is associated with a digit associated with the pressed second key or with a symbol, function or other key meaning associated with the second key.
- the second group keys are used to enter letters and the first keys are used only for disambiguation.
- the user may initially enter letters through either the first or second keys as desired by the user, possibly switching between the first and second keys even during entering of a specific single word.
- the operation mode of processor 130 as to whether letters are initially entered through the first keys, the second keys or both, is user adjustable.
- one or more of the first group keys and/or the second group keys serve as mode keys which change the function of one or more other first group keys and/or second group keys.
- One or more mode keys optionally change the case of the letters entered by the first group keys and/or the second group keys to upper case.
- the mode keys change the functions of the second group keys to various symbol modes for entering symbols other than letters.
- one or more dedicated mode keys whose sole function is to move between modes, axe used.
- one or more keys have two for more different functions depending on how they are actuated.
- a short press on a key may have a first function, such as inputting letters or other symbols, while a longer press on the key has a different function, such as a mode key function.
- a key has a first function when pressed once and a different function when pressed twice within a short period.
- a key has a different function when pressed together with another key.
- the pressing of the first group key is interpreted as a different function than if pressed without the subsequent pressing of the second key.
- the first group keys have two functions: a regular function for entering letters, as discussed above, and a mode key function which controls the functions of the second group keys.
- a mode key function which controls the functions of the second group keys.
- one or more second group keys have a mode key function, for example when there are more modes than first group keys.
- the second group keys serve as mode keys which change the functions of the first group keys.
- the mode keys change the functions of both first and second group keys.
- processor 130 moves into a symbol mode in which all actuations of the second keys are interpreted according to the symbol mode instead of their regular function, until a different symbol mode is entered or the symbol mode is otherwise released, for example by actuating the mode key function again or by pressing a first group key such as the space key 105.
- processor 130 leaves the symbol mode when a key other than one belonging to the symbol mode is pressed.
- processor 130 leaves the symbol mode after a single actuation of a second group key.
- the symbol mode is in effect only when the mode key is held pressed.
- the user may instruct processor 130 to leave the symbol mode even if none of the second group keys were actuated during the symbol mode, for example because the user changed his mind.
- the six first group keys 101-106 define six different symbol modes which carry the various symbols and/or functions available on standard QWERTY computer keyboards.
- the symbols are optionally distributed between groups according to a common theme to allow them to be easily found by users.
- the six mode groups include: a text symbol group including the symbols _ " ' $ ; : & ? !
- the second keys may also correspond to functions not generally included on keyboard keys, such as functions included in menus (e.g., copy, paste, exit).
- one or more keys may be included in a plurality of groups to allow them to be easily found by users, for example the parenthesis may be find in both text and arithmetic groups.
- Other particular symbols which may be included in several groups include, for example, "space”, "backspace” and period which are commonly used.
- processor 130 when entering a specific mode, displays on screen 140 the layout of the symbols of the keys in the specific mode for the user's convenience.
- the layout is optionally displayed on a side of screen 140 farther from the mode key causing processor 130 to enter the specific mode.
- the layout display is optionally removed when processor 130 leaves the specific mode.
- the user may set whether the layout is displayed or not, possibly controlling the display for each mode separately.
- Some symbols and/or sequences which are used frequently may be assigned to shortcuts, for example, to a special press on one of the keys, to a pressing combination on a plurality of keys or to additional keys of mobile phone 100.
- such shortcuts may be associated with a sequence of ambiguous letters.
- the user presses a long press on one or both of keys 105, 106, which indicates to processor 130 to move into a capital letter mode.
- the guess letters for the position are always displayed capitalized even if the guess letter changes.
- Fig. 2 is a flowchart of acts of a data entry system run on processor 130, in accordance with an exemplary embodiment of the invention.
- a text entry state for example for entering a short message (SMS)
- the data entry system remains in a wait state (228) in which it waits for key actuations.
- a letter key of the first keypad 150 is actuated for a short period
- the next character position is associated (232) with all the letters corresponding to the actuated first group key.
- Processor 130 then optionally selects and displays (234) a best match word for the current input sequence.
- the displayed word is selected by selecting the most popular word that matches the available information on the input sequence.
- the processor moves (238) into a symbol mode in which the second group keys are given special character interpretations.
- the predetermined length is of a duration substantially longer than normally used by users entering data, such that only purposeful long actuation of the key will be interpreted as a state change.
- the processor remains in the symbol mode, until the key is released.
- the processor remains in the symbol mode until a different mode key is actuated.
- one of the first keys is associated with moving into the regular mode.
- processor 130 When a second key is actuated (240), processor 130 optionally determines whether (242) it is currently in a symbol mode. If (242) processor 130 is in a symbol mode, the next word position is associated (244) with the symbol corresponding to the actuated second-group key in the specific symbol mode. In some embodiments of the invention, the processor then reselects the word to be displayed (234). It is noted, however, that some states may correspond to symbols not included in words of the dictionary 132 and therefore their combination to the current word will not result in a known dictionary word. In such cases, the display may be updated only for the current position. Alternatively or additionally, the fact that the position of the recently added symbol does not include a letter is used in selecting an updated best guess word.
- processor 130 determines whether (246) the current word includes positions that ambiguously correspond to a plurality of letters and were not disambiguated. If (246) there are such non-disambiguated positions in the current word, the letters corresponding to the second key are used to limit (248) the first position in the word that was not yet disambiguated.
- each pair of first and second keys have in common only a single letter, such that the disambiguation results in a specific letter.
- pairs of first and second keys may have a plurality of letters in common, for example up to two or three letters in common.
- the next position in the current word is optionally assigned (250) a digit corresponding to the pressed second group key.
- any other set of symbols for example any of those used in one of the symbol modes, may be associated with the second group keys in cases in which there are no non-disambiguated positions in the current word.
- the next character position is associated with all the letters corresponding to the actuated second-group key.
- This alternative allows the user to choose dynamically whether to begin writing with the first keys and disambiguate with the second keys or to write with the second keys and disambiguate with the first group keys. This option is especially useful for users accustomed to using a keypad of the second group keys 160.
- the letters corresponding to each of keys 101-104 are optionally engraved on the keys and/or somewhere else on the casing of mobile phone 100. Alternatively, the corresponding letters are displayed on screen 140 at times when input of letters is expected or upon an instruction from the user. For example, one of the keys of mobile phone 100 may control the display of the letter arrangements of keys 101-104 on screen 140. The letter arrangements of the keys may be displayed at a predetermined location on screen 140 or may move along with the writing so as to be near the cursor location on screen 140 and/or so as not to interfere with seeing the written text.
- the letters corresponding to first group keys 101-104 are displayed for each key in their order in the alphabet, so as to allow the user to find a desired letter quickly.
- the letters are arranged in eight imaginary/virtual columns each containing at most one of the letters of the alphabet that is located on the corresponding key (e.g. 2-9) of a standard telephone keypad.
- the letters of a key 101-104 may be displayed with a gap in the middle, corresponding to a second group key for which the first group key does not have a letter in common.
- the letters and/or symbols associated with the second group keys are displayed.
- the arrangement of the second group keypad may be displayed continuously or may be displayed only at specific times, for example when the user did not press a key for a predetermined time and/or when the backspace was used.
- the second group keypad arrangement is displayed responsive to a user instruction.
- the arrangement displayed is the current arrangement according to the current mode which interprets the second keys. Display differentiation of ambiguous character positions
- processor 130 presents in each character position on display 140 a single letter, selected from the group of letters with which the character position is associated.
- the letters are displayed in a manner which differentiates between character positions associated with a plurality of letters, for which the displayed letter is only a guess and between character positions associated with a single letter. For example, different colors or different font sizes may be used to differentiate between single letter and multi-letter character positions.
- a marking such as a star or line are displayed above, below or otherwise adjacent letters of multi-letter character positions. Alternatively or additionally, markings are displayed adjacent letters of single letter character positions.
- the markings used for multi-letter character positions are associated with the keys generating the multi-letter group for the character position.
- character positions for which the user pressed key 101 may display their guess letter in a first color
- character positions for which the user pressed the key 102 display a letter in a second color
- positions associated with a single letter are displayed in a default color, e.g., black.
- each key is assigned a different symbol which is displayed next to the letters representing character positions associated with the letters of the key.
- processor 130 displays for recently entered character positions corresponding to a plurality of letters, some or all the letters to which the character position corresponds.
- processor 130 displays the letter currently guessed for the character position, based on the portion of the word entered so far. Beneath or above the character position, in the main window in which the selected and disambiguated letters are displayed, processor 130 optionally displays a letter row or column including the other letters associated with the character position.
- the letters in the letter row or column are optionally presented differently from the letter in the character position, for example being in a different color, a different font and/or a different size (e.g., smaller).
- a different color e.g., a different font
- a different size e.g., smaller
- the letter column of a position does not include the selected letter appearing in the character position as it is already shown.
- the selected letter appears also in the letter column to allow easier identification by the user, particularly when the letters of the column are in a different size from the selected letter.
- the order of the letters in the letter column is optionally selected without relation to the letters of other character positions of the same word, and generally the letters in the different columns do not usually form words.
- Each letter in the letter column is optionally included only once.
- the letters are organized in the columns according to their order in the alphabet.
- the letters are organized in the columns in eight rows, each row corresponding to a key of the telephone-type keypad.
- the user can control whether the symbols and/or letter columns are displayed.
- the system displays the symbols and/or letter columns automatically when the user may be confused, for example when the user presses the backspace key.
- the letter columns are displayed only responsive to a press of the user on a letter, to which press the system responds by displaying the column of the pressed letter or of all the letters of the word. Possibly, responsive to the press, the selected letter or the word of the selected letter is enlarged on the display. Alternatively, the user glides with his finger over a word for which the columns are desired.
- Fig. 1 The arrangement of keys shown in Fig. 1 is brought as an example and many other arrangements including keys of various shapes (e.g., round, square, half circle) in various arrangements (e.g., rows, columns, circle, ellipse) may be used.
- the keys of the first group and/or of the second group are arranged such that a single finger or two fingers can touch all the keys of the group concurrently, so that the user can press all the keys without looking at the keypad.
- the displayed letters in the letter columns are presented as soft keys which the user may press to associate their respective character position with the selected letter.
- the letter column soft keys may be provided instead of, or in addition to, the second group keys.
- the letter columns of the current word are presented larger than the letter columns of previous words, in order to allow easy access to the soft keys of the letters of the columns.
- the user does not need to use the soft keys of the letter columns but rather may use them if desired.
- Fig. 3A is a schematic illustration of a mobile device 300, in accordance with an exemplary embodiment of the invention.
- Mobile device 300 includes hard keys 201-206 for the first group of keys and a touch screen 320.
- the second group keys are soft keys 301-312 displayed on touch screen 320.
- mobile device 300 may have very few hard keys, for example less than ten or even less than eight hard keys.
- the first group keys are soft keys displayed on touch screen 320, such that mobile device 300 may have less than four hard keys or even may not have hard keys at all.
- Keys 201-206 optionally have the same functions as keys 101-106 (Fig. 1), respectively, although they are arranged differently.
- the second group keys 301-312 may be shown permanently on screen 320, at least whenever in a text entry mode, or may be displayed only when the user requests their display, for example by pressing a control key. In some embodiments of the invention, the second group keys 301-312 are displayed permanently in a small arrangement and are enlarged when their use is expected, for example when the user presses one of the small keys or when entering a special key mode. When a first group key is pressed, the second group keys 301-312 are optionally removed entirely from the display or are made small, until the next time they are required, so that they do not take up too much space on screen 320.
- second group keys 301-312 are displayed in the center of screen 320.
- second group keys 301-312 are displayed on one side of the screen or at the top and/or bottom of the screen 320.
- the second group keys may be displayed in one or two horizontal rows on the top and/or bottom of screen 320.
- the second group keys 301-312 are displayed at the opposite side from the key that instructed them to be displayed, e.g., a mode key.
- keys 301-312 move along screen 320 as data is entered, so as not to interfere with seeing the displayed entered data.
- the first group keys are soft keys in addition to, or instead of the second group keys.
- the first group keys may all be positioned together adjacent each other on the touch screen 320 or may be separated into two different areas on the touch screen, for example on the right and left sides of screen 320.
- processor 130 may differentiate between three or more lengths of holding a key pressed. A short press on a first group key 201-204 enters a set of letters, a longer press serves as a mode key and an even longer press enters the set of letters repeatedly until the key is released.
- a short press on a first group key enters the characters associated with the key, a longer press enters into a first symbol mode, for example a mode of numerical digits and an even longer press enters a different symbol mode, such as a function key mode.
- the principle of different pressing durations may be used also for second group keys.
- a short duration press on each key may be associated with a first function while a longer press is associated with a different function.
- a mode associated with both digits and function keys Fl -F 12 may be provided.
- a short press on one of the second group keys enters the corresponding digit, while a long press enters the corresponding function key (e.g., F7).
- screen 320 may not show the locations of the soft keys but rather the user is trusted to remember them. This is especially practical when there is only a limited number of soft keys, such as when using screen 320 for no more than six or four soft keys.
- the locations of the soft keys may be calibrated dynamically according to the user acts. For example, at the beginning of a text entry session the user may indicate the desired location of the keys, for example by entering an X shape or a single tap pressing on a specific point, such as the center of the desired keyboard.
- a short sweeping gesture in the direction of one of the four keys, from a center point at which the four keys meet, may be used both to indicate the layout of the keys and to actuate the key.
- the system optionally identifies the short sweeping gesture and according to its direction identifies the actuated soft key.
- the starting point of the sweeping gesture is identified as the meeting point of the four keys and accordingly their locations are fixed until a next calibration.
- the space and backspace soft keys are optionally fixed at the bottom left and right corners of the touch pad or at any other suitable location.
- a compromise is provided between complete marking of the locations of the soft keys and no marking at all, in the form of small hints to the locations of the keys.
- Fig. 3B is a schematic illustration of a data entry device 360, in accordance with an embodiment of the invention.
- device 360 includes soft keys 362 on the right and left of the touch screen 320. Dots 364 are displayed on screen 320 at the corners of keys 362 adjacent the center of screen 320. Thus, four dots 364 indicate the locations of the six keys, making their identification easier. It is noted that other markings may be used, such as short continuous or dotted lines along a portion of the border between adjacent keys and/or between the keys and the center of screen 320.
- Fig. 3B also illustrates the possibility of using an auxiliary small data entry unit 366 which communicates with device 360.
- Device 360 may be a computer which is heavy and auxiliary data entry unit 366 is used by the user for data entry.
- data entry unit 366 may be used with a desk top computer, a notebook computer or any other device.
- Data entry unit 366 may communicate with the main device through wires or wirelessly, using any method known in the art.
- Unit 366 optionally comprises a touch pad 369 and a processor 367.
- Processor 367 optionally differentiates between sweeping gestures, described herein below in detail, and pressing acts on touch pad 369.
- Touch pad 369 is optionally divided into six key areas, corresponding to keys 201-206 of Fig. 3 A, and processor 367 identifies for each user-press the actuated key.
- two dot markings 368 are provided on the touch surface to help the user orient fingers in pressing on the keys. Alternatively, two bulges are used so the user can feel them.
- the guessing of intended characters based on the input information from the user is optionally performed by processor 367 within unit 366. In other embodiments, the guessing is performed by a processor of device 360.
- Auxiliary unit 366 may be very simple and very inexpensive to produce.
- touch pad 369 is not a touch screen and unit 366 does not include any hard keys.
- Processor 367 is optionally dedicated only for the data reception and possibly the character guessing.
- the auxiliary unit may include additionally hard keys and/or a touch screen.
- auxiliary unit 366 is battery operated.
- unit 366 has a USB connection (or any similar connection type) through which the battery is charged.
- auxiliary unit 366 communicates with data entry device 360 through a USB connection.
- a long USB wire may be used to allow connection to the computer while auxiliary unit 366 is in the users hand.
- auxiliary data entry unit 366 is of a small size, for example having an area of less than 10 square centimeters or even less than 5 square centimeters.
- auxiliary data entry unit 366 is integrated into a USB memory stick.
- a single pocket sized device serves both as a storage unit for important data and as a keyboard for entering information.
- Auxiliary data entry unit 366 can be connected to any computer through a USB slot and the user can then access the information stored in unit 366 and use the keys and/or touch screen of unit 366 to interact with the accessed data.
- the user optionally provides a calibration signal for each portion of the keypad separately.
- the user provides a calibration signal for one portion of the first keypad and the location of the other portion is set accordingly, for example so that they are symmetrical relative to a middle axis of screen 320.
- processor 130 accepts calibration signals, such as a tap or sweeping move of a finger, only if it is provided by a specific finger, based on fingerprint comparison or finger width. For example, whenever a press with a thumb is identified it may be interpreted as a calibration signal, while pressing with other fingers are interpreted as regular data input. This prevents inadvertent calibration and/or mix-up between data entry and calibration.
- fingerprint identification may be used as a security measure to prevent use of mobile device 300 by unauthorized users.
- calibration signals are received from any finger.
- Identification of different fingers or different finger orientations may be used also in data entry. Instead of assigning the keys specific areas on screen 320, different finger presses anywhere on the touch screen are interpreted as different keys. For example, pressing with the tip of the finger may be interpreted as key 201, the wide face of the finger as key 202, with the narrow side of the finger as key 203 and pressing with the thumb as key 204.
- processor 130 determines which finger is touching screen 320 and accordingly controls which of the first and second keypads is being accessed by the user. Using a first finger or first finger orientation is interpreted that the user is pressing a key from the first group 150, while a second finger or finger orientation is used to indicate the user is pressing a key from the second group 160.
- the first and second groups of keys may have different numbers of keys than those described above, according to the specific needs of the users.
- the second group of keys may have different numbers of keys in different symbol modes as required.
- the second group in a punctuation mode the second group may include 10 or 12 keys, while in a Greek alphabet mode, the second group may include a key for each Greek letter.
- the second group keys in one or more modes, include a plurality of sets of twelve keys, each set organized in an array of three columns and four rows, even if some of the keys are not used.
- the groups of 12 keys are separated from each other such that they are distinct.
- processor 130 is adapted to identify pressing on two different virtual keys on screen 320 concurrently and provide a different input than if only one virtual key is pressed. The user may optionally press on the two virtual keys with any two fingers. Alternatively, different pairs of two fingers pressing on screen 320 are given different interpretations.
- the system may display soft keys for each of the ambiguous letters for selection.
- soft keys for disambiguation are displayed, automatically or upon a user command, when a user selects a previous character position for disambiguation thereof.
- the soft keys displayed correspond to the last actuated first group key.
- the soft keys displayed are of the first non-disambiguated character position in the current word, regardless of the cursor position, as is now described with reference to Fig. 3C.
- Fig. 3C is a schematic illustration of a data entry device 330, in accordance with another exemplary embodiment of the invention.
- Device 330 is similar to device 300, but has a different arrangement of keys.
- the letters of the alphabet are assigned to four of the keys, optionally to two keys on each die of screen 320.
- the two keys on each side to which the letters are assigned are keys 331-334 which form the columns in the key arrangements on each side.
- Fig. 3C illustrates an embodiment in which during entering a word, soft keys 336 for letters of one of the actuated keys are displayed on the screen to allow disambiguation instead of using the second group keys.
- the user has pressed for the current word on the first group keys corresponding to the letter sets HEBLXQ, HEBLXQ, FARMZT and GOVSYCK. Assuming the following dictionary content words and respective scores:
- processor 130 guessed the word XEAC, which has the highest score.
- soft keys corresponding to the letters HEBLXQ are displayed, as these letters are associated with the first character position of the word. Assuming the user is interested in the word "hero”, the user pressed on the soft key of the letter H, causing processor 130 to select the word "hers”.
- processor 130 displays the soft keys corresponding to the second character position of the word, and the user can press on the letter E. Processor 130 will then display the soft keys corresponding to the letters of the third character position and so on until the word is entirely disambiguated or the correct word was reached.
- the keys of the first keypad and the keys of the second keypad are all included in a single mobile unit. Alternatively, some of the keys are included in a separate detachable unit. For example, the first keys may be included in a main unit while the second keys are included in a detachable unit. In some embodiments of the invention, the keys of first keypad are distributed between two detachable units.
- FIG. 4 is a schematic illustration of a mobile unit 400 with a detachable keypad, in accordance with an exemplary embodiment of the invention.
- Mobile unit 400 comprises a screen 320 and two key units 410 and 420 on opposite sides of the screen 320.
- a first key unit 410 is permanently attached to screen 320, while a second key unit 420 is detachable so that it can be conveniently held in the left hand of the user while mobile unit 400 is held in the right hand.
- key unit 420 is slideably detachable from mobile unit 400, which has a respective railing to which it is attached.
- other attachment devices may be used, such as snaps, Velcro or buttons.
- unit 420 communicates wirelessly with mobile unit 400, for example using a transceiver 402 of unit 420 which communicates with a respective transceiver 404 of mobile unit 400.
- the transceivers 402 and 404 may operate using the Bluetooth protocol or any other suitable short range protocol.
- key unit 420 may be connected through wires to the main portion of mobile unit 400, for example through a USB connection which may also charge a battery of mobile unit 400. Also, a wireless USB connection may be used.
- unit 410 may be detachable.
- Mobile unit 400 may be a cellular phone, PDA or any other communication or input device.
- mobile unit 400 is a limited purpose keyboard device for entering text into an adjacent computer or television.
- mobile unit 400 may be used for text entry by a user leaning back or lying down.
- screen 320 may be much smaller, for example for displaying only a single line of text, or mobile unit 400 may not include a screen at all, and the user can view the input text on the screen of a main device receiving the input text. Sweeping gestures
- processor 130 identifies straight line sweeping gestures on screen 320 and according to their direction, length and/or other attributes, associates each identified sweeping gesture with one or more symbols or functions.
- the sweeping gestures are used for the functions of the first group keys or the second group keys, instead of providing soft keys of the respective group on screen 320.
- the sweeping gestures are optionally in directions selected according to a known arrangement of the keys of the group, such that a user accustomed to a specific key arrangement can easily adapt to using the sweeping actions.
- processor 130 is adapted to associate sweeping acts according to their directions, with the keys of the known telephone keypad arrangement.
- Use of the sweeping gestures allows the user to provide input anywhere on the screen, instead of confining the user input to a specific area on the screen.
- soft keys are not provided on screen 320 in order to avoid sweeping gestures from being interpreted as pressing on soft keys.
- screen 320 is divided into a plurality of zones, a zone for sweeping gestures and one or more zones with soft keys.
- the soft keys may be placed around the outskirts of screen 320, while the center of screen 320 is used for sweeping gestures.
- screen 320 is divided into right and left halves. One half is used for soft keys and the other for sweeping gestures.
- Fig. 5 is a schematic illustration of entering data to mobile device 300 using sweeping gestures, in accordance with an exemplary embodiment of the invention.
- the user Instead of pressing on soft keys 301-312 (Fig. 3A), the user provides straight line sweeping gestures, represented by arrows 381-388.
- Each sweeping gesture corresponds to the key in the direction from key 305 to the desired key on a standard telephone keypad or a variation thereof.
- the user to enter the letters DEF of key 303, the user provides a sweeping motion on screen 320 in the direction of arrow 383, in a diagonal between the right and the upward directions.
- a sweeping gesture in the direction of arrow 382 represents the letters ABC
- in the direction of arrow 384 represents the letters GHI
- in the downward direction of arrow 387 represents letters TUV
- in the direction of arrow 388 represents the letters WXYZ.
- to enter the letters JKL the user taps once or twice on the screen at any point, indicating the middle of the standard telephone keypad.
- the letter organization 370 shown in Fig. 6 is used, and the letters JKL are entered by a sweeping gesture in the direction of arrow 381.
- the sweeping gesture in the direction of up and to the left indicated by arrow 381, corresponding to the key of the digit "1" on the telephone keypad, is not associated with letters, but rather is interpreted as a backspace act canceling disambiguation of the previous character position.
- the sweeping gestures are required to start in a specific predetermined location, so that inadvertent sweeping gestures are not interpreted as input.
- the location of the sweeping gestures on the screen may be calibrated by the user.
- the sweeping gestures may be provided anywhere on screen 320, such that sweeping gestures following arrows 392, 395 and 396 have the same effect as those of arrows 382, 385 and 386, respectively. These embodiments allow the user more flexibility.
- the sweeping gestures are directed from the location of the desired key to the center of the keypad.
- arrow 392 corresponds to the letters TUV and arrow 395 corresponds to the letters GHI.
- Letter organization 370 (Fig. 6), or any other letter organization used, may be displayed on screen 320, may be engraved or otherwise posted on the casing of mobile device 300 or may not be provided at all, based on the assumption that users know the organization by heart.
- letter organization 370 is not shown on screen 320 regularly, but is shown when the user touches screen 320, as such touching indicates the user probably wants to enter data.
- the letter organization 370 is shown at a predetermined location on the screen or at a location which is currently vacant.
- letter organization 370 is displayed at the location where the user touched the screen, allowing the user to sweep his finger toward the direction of the displayed desired letters, from the point where the finger originally touched the screen.
- the user may optionally control if and/or how letter organization 370 is displayed.
- guiding lines are displayed showing the user the path on which the sweeping gestures are to be performed.
- border lines between the sectors of the different sweeping gestures are displayed.
- Fig. 7 is a schematic illustration of a display responsive to a user touching the screen, in accordance with an exemplary embodiment of the invention.
- letters 702 are displayed around point 700, together with grid lines 704 showing the sectors in which sweeping gestures will be interpreted as relating to the respective letters.
- the user can then easily perform, for example, sweeping gesture 706 within the grid lines of the letters DEF.
- processor 130 determines which letter will be used for each sweeping gesture for the current character position, given that it already is related to a plurality of letters from a first key actuation, and only these letters are displayed. Displaying only a single letter makes the task of identifying the desired sweeping gesture much easier. In other embodiments, all the letters are displayed, but the letter corresponding to the character position is highlighted. In still other embodiments, for each sweeping gesture direction, processor 130 displays the word that will be selected for the current word character position sequence, if the sweeping gesture is selected. In cases in which a single sweeping gesture is required to receive the desired word, this makes the selection of the sweeping gesture very simple as the user sees the desired word in the direction of the required sweeping gesture. In some embodiments of the invention, processor 130 displays both the letter and the guessed word, for the convenience of the user, in case more than one sweeping gesture is required to achieve the desired word.
- the letter or letters are displayed not when the user touches the screen but when the sweeping gesture begins or ends, and only the letter or letters corresponding to the entered sweeping gesture are displayed.
- the user is optionally given a chance to easily correct his sweeping gesture if necessary, responsive to the display of the letter corresponding to the sweeping gesture.
- the user may change the direction of the sweeping gesture in the middle, as illustrated by Fig. 8, to change from an erroneous entering of the letter N to entering the letter D.
- processor 130 identifies an abrupt slowdown in a sweeping gesture
- the sweeping gesture is ignored, as the abrupt slowdown is generally indicative of a hesitation by the user.
- the sweeping gesture is ignored.
- the speed threshold for differentiating between regular and aborted sweeping gestures may be predetermined or may be based on learning the operation habits of the user of the specific device.
- processor 130 displays the current word that will be affected by the backspace act, possibly highlighting the letter in the character position which will be affected.
- a similar display may be performed for the backspace direction in embodiments in which letters are displayed in all directions or in some of the directions.
- the key arrangement for all sweeping directions is displayed.
- the letters for all directions are removed from the display, except for the direction of the sweeping gesture in progress.
- each sweeping gesture must begin from a state in which the user's finger does not touch the screen 320. hi performing the sweeping gesture, the user presses his/her finger against the screen, glides the finger in the required direction and removes the finger from the screen. In other embodiments, the sweeping gesture does not require removing the finger from the screen when it is completed. Rather, a sequence of a plurality of sweeping gestures, referred to herein as a complex gesture, may be provided by the user without lifting the finger from the screen.
- processor 130 each time the user changes the direction of the movement of the finger on screen 320, considers the turn point as the end of a previous gesture and the beginning of a new sweeping gesture, whose direction is evaluated relative to this point. Alternatively, the direction of each straight line segment of the complex sweeping gesture is evaluated relative to the starting point of the entire complex gesture.
- a single complex gesture may be used to enter an entire word, or several complex gestures may be used to enter a single word in parts. Furthermore, a word may be entered by one or more complex gestures together with one or more single position sweeping gestures.
- a sweeping gesture when a sweeping gesture is a very long straight line it is considered as two separate sweeping gestures in the same direction.
- long sweeping gestures are considered the same as short sweeping gestures, as not always can users easily control the lengths of their sweeping gestures.
- processor 130 may differentiate between sweeping gestures representing keys in similar directions, such as keys 307 and 310 or keys 308 and 311 of Fig. 3 A, based on the length of the sweeping gesture.
- the keys are arranged such that each key has a unique direction which is not generally interchanged with the other directions.
- the key model which governs the sweeping gestures may have keys arranged in an octagon or in any of the key arrangements described in US patent publication 2007/0109276 to Kim, the disclosure of which is incorporated herein by reference in its entirety.
- Long sweeping gestures may be interpreted as long presses on their corresponding key.
- the user may indicate a short press by entering a short sweeping gesture and a long press by a long sweeping gesture.
- the gestures corresponding to short and long presses on the same key may be differentiated using other methods. For example, while short presses may be represented by simple straight lines, longer presses may be represented by wiggled lines, a loop at the end of the line or any other suitable marking.
- the function of the gesture is repeated until the user's finger is removed from screen 320, in a manner similar to the press and hold function known in the art for keyboard keys.
- the repetition is of the last function entered, even if a sequence of letters was entered in one complex sweeping gesture.
- the entire sequence of letters or functions entered by the last sweeping gesture is repeated until the user's finger is lifted.
- processor 130 acts as if keys 201, 202 and 204 are repeatedly pressed in sequence.
- crooked sweeping gestures are interpreted based on their beginning and ending points, as if they were a straight line between the beginning and ending point.
- crooked sweeping gestures are interpreted as separate sweeping gestures having a totally different meaning than the straight lines from which they are formed.
- Crooked sweeping gestures are used as shortcuts representing a plurality of keys.
- Fig. 9 shows a four key arrangement together with various sweeping gestures entered by users, in accordance with an exemplary embodiment of the invention.
- a sweeping gesture downward and to the left in the direction of arrow 921 is optionally interpreted by processor 130 as equivalent to pressing on a button corresponding to the letters in box 901.
- sweeping gestures in the directions of arrows 922, 923 and 924 are optionally interpreted as entering the letters in boxes 902, 903 and 904, respectively.
- the space and backspace functions are optionally represented by short sweeping gestures to the right and left, respectively.
- the model sharing the first keys 201- 206 for both entering letters and mode keys is used.
- a specific mode key task For a specific mode key task, the same sweeping gesture as used for the letters on the key of the specific mode key task is used, but with a variation indicating its mode key task, such as performing the sweeping gesture much slower or pausing at the end of the sweeping gesture while pressing on screen 320. If necessary, additional sweeping gestures may be used for further modes, such as up and down gestures not otherwise used.
- an arrow from the direction of the column of the desired first box, followed by an arrow in the direction of the row of the desired second box may be used.
- a sweeping gesture in the direction of arrow 931 is optionally interpreted as entering the letters of box 903 followed by the letters of box 904.
- the sweeping gesture is formed of a long portion and then a short portion.
- the sweeping gesture may be formed of a short gesture and then a long gesture or of similar length gestures.
- a sweeping gesture in the direction of arrow 932 is optionally interpreted as corresponding to box 902, and then box 901.
- a sweeping gesture in the direction of arrow 937 is optionally interpreted as corresponding to box 904 and then box 901.
- arrows 931 and 932 may be interpreted to correspond to a box in the column toward which the long portion of the gesture is directed followed by the box in the row toward which the short portion is directed.
- sweeping acts following arrows 934 and 935 are interpreted as arrow 931.
- the sweeping gestures are used to represent only some of the functions of the second keys, such as the letter groups, while digits and/or symbols in symbol modes are provided using soft keys. In other embodiments, the sweeping gestures replace all the functions of the keys they represent. Optionally, the user may decide whether to use sweeping gestures or soft keys.
- processor 130 selects based on the contents of dictionary 132, whether to use the letters of the first sector or the neighboring sector.
- the letters of the neighboring sector are given a low priority such that they are used only if the letters of the first sector do not match a word at all or are very unlikely relative to a very likely word for the neighboring sector.
- processor 130 in which processor 130 is configured to identify sweeping gestures on screen 320, the screen is not used to control a mouse pointer, in order not to confuse processor 130.
- a switch controllable by the user indicates whether to interpret finger movements on screen 320 as text entry or as mouse movements.
- processor 130 evaluates the movements according to their speed. Fast movements are optionally interpreted as sweeping gestures representing keys, while slow movements are optionally interpreted as mouse movements.
- the speed of the sweeping gesture is determined at the end of the sweeping gesture. Acts performed by processor 130 during the entry of the sweeping gesture are optionally reversed, if necessary, when a sweeping gesture starting at a high rate is completed at a slow rate. Alternatively, the speed is determined as the average speed or the speed at the beginning of the sweeping gesture. It is noted that in other embodiments, the association between speed and specific keys may be set differently, for example associating fast gestures with the mouse control and slow movements with data entry.
- screen 320 is divided into a plurality of zones and processor 130 interprets sweeping gestures in different zones on the screen, differently.
- processor 130 interprets sweeping gestures in different zones on the screen, differently.
- the movements are used to control the mouse and in the other the movements are interpreted as gestures representing keys.
- the user is required to use different pressure levels for different meanings, for example using more pressure for key actuation than for mouse movements.
- processor 130 determines if sweeping gestures relate to mouse control or character entry based on whether the user is in the middle of entering a word.
- sweeping gestures are interpreted as referring to second-group key functions, and otherwise the sweeping gestures are used to control a mouse cursor.
- finger movements may be used to control movement of the text entry cursor and/or the disambiguation cursor.
- a sweeping gesture of the finger in a specific direction moves the cursor in that direction.
- the extent of moving the cursor is optionally proportional to the length of the gesture, for example a single cursor position for each centimeter of the sweeping gesture.
- the sweeping gestures may control the cursor movement only to the left and to the right or may also be used for up and down movements. Diagonal sweeping gestures are optionally ignored or are interpreted according to their closest horizontal or vertical angle.
- Processor 130 optionally determines whether to move the mouse or a cursor based on the sweeping gestures being in different zones, having different widths and/or any other differentiation methods described above or combinations thereof.
- the left and right mouse buttons are implemented by pressing on screen 320 at any point on the screen.
- the pressing for the left and right mouse buttons optionally differ according to the time the finger is held on screen 320 according to predefined rules, such as a very short press for the text entry button 305 (Fig. 3A), a longer press for a left mouse button and an even longer press for a right mouse button.
- Another possible method of differentiating between sweeping gestures corresponding to keys and mouse movements is the width of the object passing over screen 320.
- sweeping gestures entered by a stylus or a single finger are interpreted as corresponding to keys, while thick gestures entered by two fingers are considered as mouse movements.
- the width threshold differentiating between key entries and mouse control movements may be set at substantially any suitable width, possibly by the user.
- a thin stylus is used for gestures corresponding to keys and a single finger is used to control a mouse.
- the width threshold is optionally set accordingly between the width of the stylus and the width of a finger.
- the threshold width is set between the width of a finger when placed flat on screen 320 versus the width of a finger when its tip is placed on screen 320.
- sweeping gestures are evaluated according to their width when the gesture begins, in cases in which the width changes over time.
- the width at the end of the sweeping gesture or the average width is used. It is noted that different widths of sweeping gestures may have other interpretations, for example differentiating between gestures relating to the first keypad and gestures relating to the second keypad.
- sweeping gestures in a first zone may be interpreted as corresponding to keys of first group 150, while sweeping gestures of a second zone are interpreted as corresponding to keys of second group 160.
- sweeping gestures of one or more zones may be interpreted as corresponding to keys in a symbol mode (such as a caps-lock mode or a mathematical symbol mode), avoiding the need to press a mode key.
- one of the zones is assigned to sweeping acts which correspond to mode keys.
- specific sweeping acts are assigned to the mode key functions, such as sweeping acts which are longer than regular sweeping gestures.
- Different types of sweeping gestures may also be used to differentiate between other groups of keys.
- the user may use relatively short sweeping gestures for the first group keys and longer sweeping acts for the second group keys, or vice versa.
- the sweeping gestures differ in their shape.
- straight and curved sweeping acts may be differentiated by processor 130, and each type of sweeping act may be assigned different groups of keys.
- straight diagonal sweeping gestures are assigned to first group keys, while straight horizontal and vertical sweeping gestures and curved sweeping gestures are used to indicate the keys of the second group.
- sweeping gestures may be indentified in two different zones, and in each zone sweeping gestures in four directions are identified.
- gestures in diagonal directions are provided on the right side of the screen and sweeping gestures in horizontal and vertical directions are provided on the left side of the screen
- a first zone displays soft keys of the first keypad and the rest of the area of the screen 320 not occupied by the first keypad is considered a second zone in which sweeping gestures corresponding to second keypad keys are received.
- sweeping gestures extending between zones are ignored.
- sweeping gestures are interpreted according to their start location or end location.
- sweeping gestures are associated with the zone including the majority of their length.
- sweeping gestures using a right thumb may relate to a first group of symbols
- sweeping gestures with three fingers relate to a second group of symbols.
- Processor 130 optionally identifies the different combinations of fingers based on the relative positions and/or orientations of the fingers. For example, a sweeping gesture with both the forefinger and the pointer finger of the right hand is easily distinguishable from a sweeping gesture with the pointer finger and the pinky. In this example, processor 130 optionally determines whether the lower finger (the forefinger or pinky) is on the right or the left of the higher finger (the pointer finger). Alternatively or additionally, processor 130 uses fingerprint recognition and/or the area or width of the finger to identify which finger or fingers of the user are contacting screen 320 and accordingly selects the symbol mode to which the sweeping gesture corresponds.
- each first group key includes also a single non-letter symbol in its group of ambiguous characters.
- the symbols are optionally associated with key 301, allowing fast disambiguation when necessary.
- Fig. 10 shows a key arrangement for a mobile device 950, in accordance with an exemplary embodiment of the invention.
- Keys 201-204 are assigned the symbols shown in symbol arrangement 980, with the symbols of box 961 corresponding to key 201, the symbols of box 962 corresponding to key 202, etc.
- each key corresponds ambiguously to a set of letters and to other symbols.
- key 201 corresponds ambiguously to the digits 0 to 9 in addition to a group of letters
- key 202 corresponds ambiguously to the arithmetic characters 972 (e.g.
- key 203 corresponds ambiguously to the punctuation characters 973 (e.g. the text symbol group of characters) in addition to its set of letters
- key 204 corresponds ambiguously to the rare characters 974 (e.g. the "RARE" group of characters) in addition to its set of letters.
- Mobile device 950 recognizes two second group keypads 951 and 952.
- the characters on the keys 201-204 of the first keypad are distributed on the keys of the second virtual keypads 952 and 951, such that any key of the first keypad has at most one common character with any of the second group keys.
- Predefined tapping or sweeping actions (e.g. 982) on the right side of the touch screen optionally correspond to interacting with the keys of the second group keypad 952, and predefined tapping or sweeping actions on the left side (e.g. 984) of the touch screen optionally correspond to interacting with the keys of the second group keypad 951.
- preference is given to the letters.
- the letters and other symbols are given equal preference, depending on their rating in dictionary 132.
- the user presses the screen on the right zone and responsive thereto the layout 952 is displayed.
- the user than performs a sweeping gesture corresponding to the desired letter. Similarly, when the user wants to enter a digit or symbol in the disambiguation, the user presses on the screen in the left zone and the key arrangement 951 is displayed to direct the sweeping gesture.
- Other display methods described herein may also be used as well as other display methods known in the art.
- database 132 is adapted to learn new words frequently used by the user.
- words may be, for example, passwords, URL addresses, slang and unofficial SMS symbol talk, formulas, computer programming language expressions, etc. While in the first time these "words" are entered the user will in many cases need to enter the entire word twice, once with the first group keys and then with the second group keys (or their equivalents), the next time the same word is entered, there is a fair chance it will be guessed by processor 130.
- first group key The inclusion of all the digits on a single first group key makes it easier to remember which key is to be pressed for a digit. In other embodiments, however, the digits are distributed between the first group keys to increase the chances an intended number is identified.
- soft keys may be displayed for all the letters and symbols on the pressed first group key.
- soft keys are displayed only for the non-letter characters and the user performs disambiguation of letters by sweeping gestures.
- first key combinations instead of second keys
- Combinations of first group keys may be used as shortcuts for tasks which users may want to do in a simpler way then using mode keys and the second keys or their equivalents (e.g., sweeping gestures).
- pairs of first group keys pressed together are given meanings of tasks which are used relatively frequently.
- pairs of first group keys have the functions of arrow keys which allow navigating the cursor around the display and/or navigating a correction point indicator around the display.
- pairs of first group keys do not have any function.
- pairs of first group keys may be used to perform the functions hereinabove assigned to the second group keys. Accordingly, all the input tasks described above may be achieved with only six keys.
- processor 130 is adapted to identify three different patterns of actuations of first group keys:
- Using the four keys 201-204 provides 12 unique sequences of pressing one of the keys and then another of the keys while the previous is held pressed. These 12 unique sequences may be associated with the 12 keys of the second group keypad in any correlation. In some embodiments of the invention, a correlation which allows the user to intuitively correlate between the first key sequences and the second keys, is used.
- the correlation between the first key sequences and the second group keys is based on the direction from the first-group key that was pressed and held to the first-group key that was pressed subsequently.
- pressing and holding key 201 (Fig. 3A) and subsequently pressing key 202 defines an arrow pointing to the right.
- Pressing and holding key 203 and subsequently pressing key 202 defines an arrow pointing to the corner in the upper right.
- Each arrow is optionally interpreted as corresponding to the second-group key of key arrangement 370 (Fig. 6) to which an arrow of that direction points from the center 378.
- pressing and holding key 202 and subsequently pressing key 204 before key 202 is released refers to the key carrying the letters TUV. If processor 130 is in a letter mode, it will take as its input the letters TUV. If it is in a symbol mode it will take as its input the symbol or symbols associated with that key.
- long presses on keys 201-204 are associated with the functions of keys 305, 310, 311 and 312 (Fig. 3A), respectively, of the second key group.
- the six keys 201-206 are used to generate arrows corresponding to all 12 keys of the known telephone keypad arrangement.
- the sequences of keys (202,201), (204,203) and (206,205) generate a virtual left arrow which corresponds to key 304.
- the sequences (201,202), (203,204) and (205,206) correspond to key 306, the sequences (204, 202), (206, 204), (203,201) and (205,203) correspond to key 302 and the sequences (201,203), (203,205), (202,204) and (204,206) correspond to key 308.
- Sequences (201,204), (203, 206) correspond to key 309, sequences (203, 202) and (205, 204) correspond to key 303, sequences (202,203) and (204,205) correspond to key 307 and sequences (204,201) and (206,203) correspond to key 301.
- Sequence (201,206) corresponds to key 312
- sequence (202,205) corresponds to key 310
- sequences (202,206) and (201,205) correspond to key 311.
- sequences (205,201) and (206,201) which define a virtual long arrow upward correspond to key 305.
- the sequences (206,201) and (205,202) may be undefined or may be used for other tasks, such as entering symbol modes (instead of or in addition to long presses on the first keys), caps lock or a partial backspace which removes disambiguation signals.
- arrows defined by the order of pressing keys may be used with other arrangements of the first group keys.
- the key pair (104,101) optionally corresponds to key 301 and key pair (102,101) optionally corresponds to key 304.
- arrows in the directions of keys 310, 311 and 312 are not provided by this arrangement, other pairs may be used for these keys, such as (106,105) for key 311, as this is the longest arrow available, (106,103) for key 310 and (105,104) for key 312.
- the system may display for selection one or more words which may be used instead of the word guessed by processor 130.
- Fig. 11 is a schematic illustration of a data entry device 760, in accordance with an exemplary embodiment of the invention.
- Device 360 includes in addition to screen 320, two touch pads 762 and 764 and two hard keys 205 and 206. Presses on touch pads 762 and 764 optionally serve as first group keys, while sweeping gestures on the pads optionally serve instead of the second group keys.
- the sweeping gestures on touch pads 762 and 764 may be interpreted to have the same function or may have different functions, corresponding to different zones discussed above.
- screen 320 need not be a touch screen and therefore may be made cheaper.
- screen 320 is a touch sensitive screen and finger movements on screen 320 control a mouse pointer.
- mouse control is performed on one or both of touch pads 762 and 764 and sweeping gestures on screen 320 are interpreted as alternatives to second group keys.
- the number of keys provided included in a data entry device may be reduced by differentiating between different finger orientations when pressing keys.
- the keys may be soft keys and in identifying pressing on the screen the area of the pressing finger is determined to identify whether the press was performed with the tip of the finger or the flat portion.
- finger orientation identification allows, for example, utilizing touch pads 762 and 764 as single keys which are not identified by the area being pressed, but rather by one or more attributes of the pressing finger.
- a speech recognition system is added to the above described data entry systems or is used instead of the second group keys.
- the user may press (e.g. and-hold) the key corresponding to the group that includes the desired character and provide a predefined speech relating to the desired symbol such as speaking said symbol so the system recognizes said speech and selects the desired symbol among that group of symbols.
- symbols included in a single symbol group do not have similar names which can be confused in speech recognition. Allowing the user to use either second group keys or speech signals, allows the user flexibility to accommodate to different environments (e.g. very noisy environments, in a meeting).
- Fig. 12 is a schematic view of a notebook computer 810, in accordance with an exemplary embodiment of the invention.
- notebook computer 810 comprises a keyboard 816 and a mouse pad 814.
- a sensor strip 812 on the front side of computer 810 identifies when the user's hands touch and/or lean on the sensor strip.
- gestures on mouse pad 814 are related to only when the user touches sensor strip 812. This avoids cases in which inadvertent contact with mouse pad 814 interferes with the user's work.
- first and second groups of keys may include substantially any suitable number of keys which may be hard or soft keys or combinations of hard and soft keys.
- the keys may be organized in various configurations and the characters and symbols may be assigned to the keys in any suitable manner.
- the symbols of the system may be grouped in any number of symbol modes based of any (e.g. arbitrary) category.
- the first group of keys has fewer keys than the second group, as mainly the first group of keys are intended to be used in entering text.
- the term key is meant to include any device which identifies finger actuations including pressure sensors, thermal sensors, acceleration sensors, optical systems for tracking movements of the finger, finger caps and gloves with sensors.
- the sweeping gestures of embodiments of the invention including embodiments for dialing telephone numbers may be identified using various touch sensitive surfaces including internal or external touch screens and a mouse pad. Alternatively, sweeping gestures may be identified by an electronic stylus, acceleration sensors and/or other sensors for identifying user finger movements.
- the sensors may be mounted on a surface, on finger caps, on gloves and/or on any other suitable mount.
- the keys or touch screen may be included with processor 130 in the same housing or may be included partially or entirely in a separate unit connected through wires or wirelessly to the unit including processor 130.
- the sweeping gestures may be provided in the air and are detected by suitable sensors such as a camera and/or acceleration sensors.
- the data entry systems are adapted to provide synthesized voice feedback on the letters or symbols entered and/or the current symbol mode such that the user need not look at the screen while entering data.
- the special characters on the second keypad may be assigned mainly to a same key so that the user may easily remember their location. If the second keypad is a standard telephone- type keypad said special characters may be assigned to the key to which the digit "1" is assigned.
- the data entry device in accordance with any of the above described embodiments may be included in a mobile phone, a PDA, a computer or any other device.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
A data entry system including a plurality of first keys, a plurality of second keys, a display and a processor adapted to interpret a first type of user interaction with the first keys as entrance of one or more characters and to interpret a second type of interaction with the first keys as mode signals which change the meanings of at least three of the second keys.
Description
IMPROVED DATA ENTRY SYSTEM FIELD OF THE INVENTION
The present invention relates to data input devices and particularly to devices and methods for entering letters and other symbols.
BACKGROUND OF THE INVENTION
Mobile devices including cellular phones, personal digital aids and miniature computers are widely used as they are easily carried around and can perform many tasks. One problem of the mobile devices is text entry, which is problematic due to their small size. One solution for text entry in mobile devices is using a limited key set in which at least some of the keys are ambiguously associated with a plurality of letters. Upon receiving a sequence of key strokes, a word dictionary is consulted to guess the word intended by the user. Such a solution is described, for example, in US patent 5,818,437 to Grover et al., titled: "Reduced Keyboard Disambiguating Computer" and in US patent publication 2003/0193478 to Ng et al., titled: "Reduced Keyboard System that Emulates QWERTY-type Mapping and Typing", the disclosures of which are incorporated herein by reference in their entirety.
One problem with the use of ambiguous keys is when a user inadvertently presses an incorrect key. In such cases the system will suggest to the user words that were not intended. The user then needs to erase the incorrect letter and enter the correct key stroke.
US patent 5,818,437 suggests providing in addition to a main window, an additional window which provides feedback on the keys pressed, in the form of the letters associated with each key pressed for the current word. In one embodiment, the 5,818,437 patent suggests displaying a plurality of possible words directly in the main window for the user to select the intended word. These feedback methods may however be confusing and may not provide the user sufficient ease in identifying errors in typing.
It also has been suggested to encode all the letters of the alphabet by pairs of keys. Such suggestions are described, for example, in US patent publication 2006/0066583 to Toutonghi et al., titled: "Text entry method and system using a numeric or non-QWERTY keypad" and in US patent 5,982,303 to Smith, titled: "Method for Entering Alphanumeric Data", the disclosures of which are incorporated herein by reference in their entirety. This method, however, requires that the user remember the key sequences for all the letters.
Another problem of mobile devices is entering symbols other than the alphanumeric characters. The number of keys on the mobile devices is limited and various methods have been suggested to allow simple entering of symbols with limited keys. Still there is a need for better solutions.
US patent publication 2006/0123354 to Volovitz, the disclosure of which is incorporated herein by reference, describes a data entry system in which mode keys are used to change the meaning of other keys of the data entry system.
Chinese patent publication 101286096 describes keys that become mode keys in response to pressing a first mode key.
Some mobile devices receive user input through a touch screen. Touch screens are also used on non-portable devices. US patent application 2007/0097092 to Jung et al., titled: "Method of using a Touch Screen and user interface apparatus employing the same", the disclosure of which is incorporated herein by reference in its entirety, describes using a touch screen with a plurality of zones having identical keys for different users.
US patent publication 2009/0073002 to Alvarado describes a scheme in which the letters of the alphabet are entered by straight line traces on a touch screen. The touch screen is divided into various cells and traces in different locations are given different interpretations.
US patent publication 2002/0180797 to Backmann uses a combined method of strokes and key presses to enter words. The strokes are assigned to the vowels and to shortcuts.
US patent 7,519748 to Kuzmin, titled: "Stroke-Based Data Entry Device, System and Method", describes a method in which strokes are associated with letters for input. The strokes are interpreted according to their direction and their starting zone.
US patent 7,170,496 to Middleton, describes an input method using gestures of a data entry system. The system provides feedback in the form of the symbol corresponding to the gesture currently entered, so the user can change the gesture if necessary.
These methods require that the user remember the associations between the strokes and the letters, which may be problematic for some users.
SUMMARY OF THE INVENTION
An aspect of some embodiments of the invention relates to a data entry system in which the same keys are used both for entering letters and as mode keys for changing the function of at least some keys of the data entry system. Optionally, the keys have different functions when pressed for a short duration and when pressed for a long duration. Optionally, when pressed for a short duration the letter or letters associated with the key are entered. When pressed for a long duration, the data entry system optionally enters a symbol mode, in which at least some of the keys change their meaning.
An aspect of some embodiments of the invention relates to a data entry unit which receives user selections of keys of the well known 12 key telephone keypad in the form of
vectors which indicate respective positions of keys in the 12 key telephone pad. For example, the vectors may be interpreted as relating to the key to which the vector points if its start point is at the middle 5 button of the telephone keypad.
Optionally, the data unit is adapted to receive indications of at least 5 or even at least 7 keys of the well known telephone keypad using the vectors. The other keys may be provided using other means or the data unit may not be adapted to receive indications of the other keys.
In some embodiments of the invention, the vectors are received in the form of sweeping gestures on a touch screen of the data entry unit. In another embodiment, the vectors are received in the form of pressing a sequence of two keys in the direction of the vector. Optionally, the vectors are associated with the keys of the 12 key telephone keypad only based on their direction. Alternatively, the length of the vector is also taken into consideration. The vectors are optionally associated with the keys without relation to their starting position on the touch screen.
An aspect of some embodiments of the invention relates to a telephone unit with a touch screen which is adapted to receive sweeping gestures on the touch screen and to interpret them as digits in dialing a telephone number responsive to their direction. Optionally, at least six of the sweeping gestures correspond to the digit on the key of the known 12 key telephone keypad in the direction of the sweeping gesture from the middle key corresponding to the digit 5 of the 12 key telephone keypad.
In some embodiments of the invention, the vectors are used in dialing telephone numbers to be called. Using sweeping gestures allows dialing a number substantially without looking, allowing, for example, dialing a number during driving. Vector dialing may be provided with speech feedback which iterates the dialed digits, so that the used does not need to look to make sure the correct number was dialed. Optionally, a touch sensitive pad is placed on a steering wheel for dialing.
An aspect of some embodiments of the invention relates to a data entry unit which presents guess characters for character positions associated ambiguously with a plurality of characters. The data entry unit is adapted to receive user indications of word portions that were guessed correctly, for groups of letters including fewer than all the letters of the word. Such indications aid the data entry unit in guessing the intended word by limiting the possibilities and hence make the guessing faster and simpler.
An aspect of some embodiments of the present invention relates to a data entry unit which receives, for at least some character positions, user input signals ambiguously associated with a plurality of letters and displays for those character positions a single letter selected in an
attempt to guess the letter intended by the user. The data entry unit displays letters representing character positions associated with a plurality of letters in a manner different than it displays letters representing character positions associated with a single letter.
In some embodiments of the invention, the letters of single letter character positions are displayed in a different font, color or size than letters of multi-letter character positions. Alternatively or additionally, letters representing multi-letter character positions are displayed with a marking adjacent the character in the character position in the same window, for example above or below the letter. In some embodiments of the invention, the marking above or below the letter includes the other letters with which the character position is associated, possibly in a smaller font than the letter of the character position.
In some embodiments of the invention, the display of the multi-letter character positions associates the character position with the key corresponding to the letters associated with the character position. Optionally, each key which is associated with a plurality of letters is associated with a color or other marking and letters in character positions associated with that group of letters are presented in the corresponding color or with the corresponding marking.
Optionally, the differentiation between the display of ambiguous and non-ambiguous character positions is maintained permanently. Alternatively, the differentiation in the display is applied only upon user request and/or when the data entry unit identifies that the user may need help, for example when a backspace function is used or the cursor is moved within a word. In some embodiments of the invention, the extent of the display is changed between a regular state in which the differentiation is of a limited nature and a user-aid state in which the differentiation is more detailed. In one example, in the regular state, the system merely differentiates between ambiguous and non-ambiguous character positions, possibly using a first color for ambiguous positions and a second color for non-ambiguous positions. In a correction state (e.g., when the user uses a backspace button), however, ambiguous character positions are associated with a display which links them to the group of letters with which they are associated.
An aspect of some embodiments of the invention relates to a method of data input in which user sweeping gestures result in different functions responsive to the width of the gesture. Optionally, a data entry unit differentiates between sweeping gestures provided by a stylus and gestures provided by a finger, or between gestures provided by different fingers. Alternatively or additionally, the data entry unit differentiates between sweepings entered by the tip of the finger and sweepings entered by the flat portion of the finger.
An aspect of some embodiments of the present invention relates to a data entry unit including a touch sensitive pad, which relates in the same manner to similar movements
beginning at different points within zones of the pad, but relates differently to similar movements on different zones of the pad.
Optionally, the screen is divided into at most ten zones or even into at most six zones, each zone covering at least 105, at least 15% or even at least 20% of the area of the touch sensitive pad.
An aspect of some embodiments of the present invention relates to a detachable keypad which includes keys corresponding to all the letters of the alphabet, which is operable when detached such that the letters are split between at least two detachable units. Optionally, the two detachable units communicate with each other wirelessly.
An aspect of some embodiments of the invention relates to a data entry system which receives user input signals associated ambiguously with a plurality of letters and guesses intended words accordingly. The data entry system provides soft keys for each of the letters of the first ambiguous character position of the word, regardless of which character position had its ambiguous letter set most recently entered. Optionally, when a user actuates a soft key, the system automatically provides soft keys for the next character position in the word in addition to entering the selected letter to the character position. Providing soft keys for the first character position of the word rather than the most recently entered character position allows the user a simpler procedure to correct a word after the ambiguous letter sets were entered for the entire word if the word was not guessed properly.
An aspect of some embodiments of the invention relates to a data entry system adapted to receive movement input signals, and to determine whether to interpret the signals as mouse pointer control signals or as sweeping gestures corresponding to input characters based on the current state of character input. Optionally, the determination depends on whether the character input is in the middle of a word. The data entry system determines automatically whether to interpret the movement input signals as character input gestures or as mouse signals and thus allows controlling both with the same device without requiring that the user switch between the different operation modes. Optionally, after entering a space, tab or return input signal, movement input signals are considered mouse pointer control signals, while after other characters the movement input signals are considered sweeping gestures corresponding to one or more characters.
An aspect of some embodiments of the invention relates to a data entry device which in a data entry mode manages a plurality of cursors for indicating the character positions to which characters of input signals are applied. Different character input signals may thus be applied to different cursor positions. Optionally, the data entry device is adapted to receive two groups of
input signals, each group including signals covering all the letters of the alphabet. The signals of each group apply to different cursor positions, in a same text window. Optionally, at least some of the input signals are ambiguously associated with a plurality of letters.
An aspect of some embodiments of the invention relates to a data entry device adapted to associate character positions with a plurality of capital letters, ambiguously. Optionally, regardless of which of the letters is selected for a character position associated with capital letters, a capital letter is displayed.
An aspect of some embodiments of the invention relates to a data entry device adapted to receive input signals associated ambiguously with letters and non-letter symbols and to guess words intended by the user in a sequence of input signals using a database of words. Optionally, the user adds to the dictionary the words used that include non-letter symbols. While these words may be added before use, they also may be added automatically each time a word is used. In some embodiments of the invention, the first time a word which is not in the dictionary is used, the user enters it using its corresponding sequence of input signals and then indicates the exact symbol for each character position. The resultant word is then added to the dictionary and is used in guessing the word next time it is used by the user.
Optionally, the input signals include input signals only associated with letters and input signals only associated with non-letter symbols. Alternatively, each of the input signals is associated ambiguously with a plurality of letters and with one or more non-letter symbols. In some embodiments of the invention, each of the input signals is associated with a plurality of non-letter symbols.
In some embodiments of the invention, all the digits are associated with a single input signal, making it very easy for the user to remember where the digits are. Alternatively, the digits are distributed between the input signals so as to increase the chances that the system will successfully guess the intended word in cases in which the intended word is a telephone number or the like.
An aspect of some embodiments of the invention relates to a remote data entry unit with a touch pad, which is adapted to receive user input through the touch pad for a master device. Optionally, the remote data entry unit is adapted to perform substantially only tasks related to data entry, such that it has minimal power consumption and can operate on batteries for a long time.
In some embodiments, the data entry unit receives for character positions user signals corresponding ambiguously to a plurality of characters and determines for each character position a single character for the position. The data entry unit transmits to the master a single
character for each character position. Alternatively, in order to simplify the data entry unit, the selection of the single character representing a character for each character position is performed by the master.
In some embodiments of the invention, the remote data entry unit includes only a touch pad without a screen or keys. In other embodiments, the remote data entry unit includes hard keys in addition to the touch pad, for example several keys on the right and left of the touch pad. An aspect of some embodiments of the invention relates to a data entry device including a main data entry unit and adapted to display an auxiliary small keypad including small keys on a side of the screen permanently during data entry. The device is adapted to enlarge the auxiliary keypad when a user presses one of its soft keys, to make it easier for the user to press additional soft keys. The device optionally reverts the auxiliary keypad to its small state when input is received through the main data entry unit and/or when otherwise it is determined that the user will not be using the auxiliary keypad, for example after a predetermined amount of time and/or after completing entering a word using the auxiliary keypad.
There is therefore provided in accordance with an exemplary embodiment of the invention, a data entry system, comprising a plurality of first keys, a plurality of second keys, a display; and a processor adapted to interpret a first type of user interaction with the first keys as entrance of one or more characters and to interpret a second type of interaction with the first keys as mode signals which change the meanings of at least three of the second keys.
Optionally, the first type of user interaction comprises actuation for a short period and wherein the second type of user interaction comprises actuation for a longer period. Optionally, the second keys comprise soft keys.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry system, comprising a user input interface adapted to receive user signals in the form of directed vectors; and a processor adapted to interpret at least five different directed vectors received by the user input interface as corresponding to keys of the 12 key telephone keypad located in the direction of the vector from a start point.
Optionally, the processor is adapted to interpret at least seven different directed vectors received by the user input interface as corresponding to keys of the 12 key telephone keypad. Optionally, the processor is adapted to interpret the directed vectors as corresponding to keys of the 12 key telephone keypad located in the direction of the vector from a center key of the keypad. Optionally, the user input interface comprises a touch screen and interprets sweeping gestures on the touch pad as vectors. Optionally, the input interface is adapted to interpret the direction of the sweeping of the gesture as a straight line from its start point to its ending point.
Optionally, the input interface is adapted to interpret sweeping gestures on the screen which include curves as a plurality of separate vectors, each straight line segment corresponding separately to a key of the 12 key telephone keypad. Optionally, the user input interface comprises a plurality of keys and interprets pressing of key sequences as vectors in the direction from the first key in the sequence to the last key in the sequence.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry system, comprising a user input interface adapted to receive user signals corresponding ambiguously to letters of the alphabet and to receive a fixation signal; and a processor adapted to receive user signals corresponding ambiguously to letters for a plurality of character positions of a word and to provide guess letters for the character positions, the processor is adapted to update its guesses of character positions responsive to receiving additional user signals corresponding ambiguously to letters for the same word and the processor does not change the letters of character positions for which the fixation signal was applied.
Optionally, the fixation signal is received responsive to simultaneous pressing of two keys. Optionally, the fixation signal applies to a single character position each time it is pressed. Optionally, the fixation signal applies to all the character positions in a current word, before a current cursor position. Optionally, the fixation signal applies to a first ambiguous character position of the current word, regardless of a current cursor position.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry system, comprising a user input interface adapted to receive input signals corresponding to characters, including signals corresponding ambiguously to a plurality of characters; a screen; and a processor adapted to select for character positions for which an input signal corresponding ambiguously to a plurality of characters was received, a single character to represent the character position, and to display, on the screen, for each character position, a single character, in a manner which differentiates between character positions associated ambiguously with a plurality of characters and character positions associated with a single character.
Optionally, the processor displays characters in character positions associated ambiguously with a plurality of characters in a different color than characters in character positions associated with a single character. Optionally, the processor displays adjacent character positions associated ambiguously with a plurality of characters, markings not displayed near character positions associated with a single character.
Optionally, the processor displays character positions associated ambiguously with a
plurality of characters in a manner which associates the character position with a key of the user input interface which is used to generate the specific plurality of characters of the character position.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry unit, comprising a touch screen; and a processor adapted to interpret sweeping gestures on the touch screen as indicating one or more characters, according to a trajectory and starting point of the sweeping gesture, the touch screen is considered to be divided into up to 10 zones each covering at least 10% of the area of the touch screen, and sweeping gestures of a specific trajectory starting anywhere in a zone are interpreted to correspond to the same one or more characters.
Optionally, the touch screen is considered as divided into at most six zones, possibly exactly two zones. Optionally, the processor is adapted to interpret sweeping gestures in a first zone as matching one of a first group of directions and to interpret sweeping gestures in a second zone as matching one of a second group of directions, not the same as the first group of directions.
Optionally, the processor is adapted to interpret sweeping gestures in a first zone as matching one of a first group of directions and to interpret sweeping gestures in a second zone as matching one of a second group of directions, wherein the first and second groups of directions do not include any common directions.
Optionally, the processor is adapted to interpret sweeping gestures in all the zones as matching one of a predetermined group of directions common to all the zones.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry unit, comprising: a plurality of first keys including fewer than 10 keys, which together are associated with all the letters of the alphabet; a touch screen; and a processor adapted to associate character positions of input words with groups of characters responsive to first key actuations and to provide on the touch screen soft keys for each of the letters associated with the first character position of the current word which is associated ambiguously with a plurality of characters, regardless of which first key was pressed most recently.
Optionally, responsive to actuation of a soft key to associate the first character position of the current word which is associated ambiguously with a plurality of characters with the character of the actuated soft key and to automatically provide soft keys for the subsequent first
character position of the current word which is associated ambiguously with a plurality of characters.
Optionally, a plurality of the first keys are associated with at least one non-alphanumeric symbol. Optionally, each of two or more of the first keys is associated with a plurality of non- alphanumeric symbols.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry unit, comprising a user input interface adapted to identify user movements, a screen and a processor adapted to control reception of words and their display on the screen and to control a mouse pointer on the screen responsive to identified user movements when the processor is not in the middle of entering a word and to interpret identified user movements as referring to groups of one or more characters when the processor is in the middle of receiving a word.
Optionally, the screen comprises a touch screen and the user input interface identifies the user movements on the touch screen. Optionally, the user input interface identifies movements of fingers in the air. Optionally, the processor is considered in the middle of receiving a word immediately after receiving an input signal corresponding to one or more letters and is considered not in the middle of receiving a word immediately after receiving a space signal, a return signal or a tab signal.
There is further provided in accordance with an exemplary embodiment of the invention, a telephone unit, comprising a touch sensitive surface; and a controller adapted to identify sweeping gestures on the touch sensitive surface, to correlate the sweeping gestures with digits according to the direction of the gestures and to dial a telephone number form of a sequence of digits determined from sweeping gestures.
Optionally, the controller is adapted to identify the digits corresponding to sweeping gestures, without relation to their starting point on the surface. Optionally, the controller is adapted to identify the digits corresponding to at least some of the sweeping gestures, as the digit on the key of the known 12 key telephone keypad in the direction of the sweeping gesture from the middle key corresponding to the digit 5 of the 12 key telephone keypad. Optionally, the controller is adapted to identify a tapping on the surface as the digit 5. Optionally, the controller is adapted to associate the sweeping gestures with digits without relation to the length of the sweeping gestures except possibly for a single direction. Optionally, the controller is adapted to identify a short downward sweeping gesture as the digit 8 and a longer downward sweeping gesture as the digit 0.
There is further provided in accordance with an exemplary embodiment of the invention,
a data entry unit, comprising a touch screen; and a processor which displays on the screen a keypad, continuously during data entry, wherein the keypad is displayed in a small form when not in use and when a key of the keypad is actuated is presented in a large form. Optionally, the small form is displayed at a corner of the screen and the large form is displayed in the middle of the screen.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry unit, comprising a touch screen; and a processor adapted to identify user tapings on the screen and to select signals to which they correspond based on the size of the tapped area on the screen and a zone in which the tapping was performed, the zones used in selecting corresponding signals have at least three times the area of the thumb of an average adult.
Optionally, the zones used in selecting corresponding signals have an area of at least 10% of the touch screen. Optionally, the processor differentiates between user tapings based on two zones: a right zone and a left zone. Optionally, the processor differentiates between tapings by the tip of a finger and tapings by the flat area of the finger.
There is further provided in accordance with an exemplary embodiment of the invention, a data entry unit of a vehicle, comprising at least one touch pad mounted on a steering wheel of the vehicle; and a processor adapted to identify user actuations with the touch pad and interpret the actuations as input characters provided by the user.
Optionally, the at least one touch pad comprises a first touch pad on the right side of the steering wheel and a second touch pad on the left side of the steering wheel. Optionally, the at least one touch pad is included in a unit including also hard keys. Optionally, data entry unit includes a speech unit adapted to provide feedback to the user on characters input to the processor. Optionally, the processor is adapted to identify taps of the user on different areas of the touch pad as different keys. Optionally, the processor is adapted to identify sweeping gestures on the touch pad.
BRIEF DESCRIPTION OF FIGURES
Exemplary non-limiting embodiments of the invention will be described with reference to the following description of embodiments in conjunction with the figures. Identical structures, elements or parts which appear in more than one figure are preferably labeled with a same or similar number in all the figures in which they appear, in which:
Fig. 1 is a schematic illustration of a mobile phone, in accordance with an exemplary embodiment of the invention;
Fig. 2 is a flowchart of acts of a data entry system, in accordance with an exemplary embodiment of the invention;
Fig. 3A is a schematic illustration of a mobile device, in accordance with another exemplary embodiment of the invention;
Fig. 3B is a schematic illustration of a data entry device and an auxiliary data entry unit, in accordance with an embodiment of the invention;
Fig. 3 C is a schematic illustration of a data entry device, in accordance with another exemplary embodiment of the invention;
Fig. 4 is a schematic illustration of a mobile unit with a detachable keypad, in accordance with an exemplary embodiment of the invention;
Fig. 5 is a schematic illustration of entering data to a mobile device using sweeping acts, in accordance with an exemplary embodiment of the invention;
Fig. 6 is a schematic illustration of a key arrangement, in accordance with an exemplary embodiment of the invention;
Fig. 7 is a schematic illustration of a display responsive to a user touching a screen, in accordance with an exemplary embodiment of the invention;
Fig. 8 is a schematic illustration of correction of a sweeping gesture in progress, in accordance with an exemplary embodiment of the invention;
Fig. 9 shows a four key arrangement together with various sweeping gestures entered by users, in accordance with an exemplary embodiment of the invention;
Fig. 10 shows a key arrangement for a mobile device, in accordance with an exemplary embodiment of the invention;
Fig. 11 is a schematic illustration of a data entry device, in accordance with an exemplary embodiment of the invention; and
Fig. 12 is a schematic view of a notebook computer, in accordance with an exemplary embodiment of the invention.
DETAILED DESCRIPTION OF EMBODIMENTS System overview
Fig. 1 is a schematic illustration of a mobile phone 100, in accordance with an exemplary embodiment of the invention. Mobile phone 100 comprises a plurality of input keys and an output screen 140. Each input key may be used by a user to provide one or more input signals, which represent letters, numbers, other symbols and/or control functions. In order to simplify the data entry task while limiting the number of keys, at least some of the input signals are ambiguously associated with a plurality of characters. A processor 130 receives indications of the input signals actuated by the user and selects one character for each received input signal, optionally using an internal word dictionary 132, which lists words with respective ratings of
frequency of use.
In some embodiments of the invention, the keys of mobile phone 100 are included in two main groups, a first group 150 and a second group 160, which each has keys associated with all the letters of the alphabet. The letters are optionally distributed between the keys in each group, such that each pair of a key from the first group 150 and a key from the second group 160 has only a single letter in common. Thus, by pressing a first group key and a second group key for a specific character location, the user indicates a specific letter unambiguously. While generally processor 130 guesses the words intended by the user based on the first keys only, when this does not occur the user can easily use the second keys to indicate the precise letters desired. In other embodiments, one or more pair of first and second keys may have more than one letter in common, in order to reduce the number of keys required. Optionally, the letters in common are ones which are generally not interchangeable in words (e.g., Q and V), such that processor 130 will nearly always guess which letter is intended, using dictionary 132. In these embodiments, a mode key may be used to enter a mode in which specific letters can be entered unambiguously.
In an exemplary embodiment of the invention, first group 150 includes four keys, 101, 102, 103 and 104, assigned all the letters of the Latin alphabet. For example, in one embodiment, key 101 is assigned the letters HEBLXQ, key 102 is assigned the letters FARMZT, key 103 is assigned the letters GOVSYCK and key 104 is assigned the letters JUINWDP. Other letter arrangements may be used on the four keys 101-104 and/or the letters may be arranged on a different number of first group keys. Optionally, the letters are arranged in a manner which minimizes the chances of a sequence of key strokes corresponding to more than one frequently used word, for example by placing each of the vowels A, E, I and O on a different key. Keys 105 and 106 are optionally used for entering a space and a backspace, respectively.
In some embodiments of the invention, second group 160 includes twelve keys arranged in the standard numeric keypad arrangement used in many mobile telephones, with three columns of four rows. Optionally, the digits are assigned to keys 111-119 and 121 and the letters of the Latin alphabet are assigned to eight keys, keys 112-119.
In a text entering mode, a current character position, referred to herein also as a cursor position, is defined on display 140. Optionally, in entering a word, the user presses a sequence of first group keys 101-104. When the user presses a first group key 101-104 for the first position of the word, the cursor position is associated with all the letters associated with the pressed key. One of the associated letters is displayed in the cursor position on display 140, for example a letter which in itself is a word or a letter which is most commonly used. The cursor
position is then moved to an adjacent character position. When the user presses another first group key, the now current cursor position is associated with all the letters associated with the pressed key and one of the letters is displayed in the cursor position on display 140. The letter displayed for the cursor position is optionally selected based on all the keys pressed for the current word and not only the key pressed for the current cursor position. In addition, the letters displayed for the other character positions of the current word are optionally updated according to all the keys pressed for the current word.
After completing entering a word with the first group keys, processor 130 generally guesses the word intended by the user. In those cases in which the word was not guessed correctly, the user can enter additional information using the second group keys. In some embodiments of the invention, when the cursor is positioned at the end of a word, a press on a second group key refers to the first character position of the word associated with a plurality of letters (referred to herein as not disambiguated). Following the pressing of the second group key, the character position is associated only with the letter in common to the letters of the first group key and the second group key pressed for the character position. This letter is displayed on display 140 for the character position. Optionally, the letters displayed for the entire word are updated accordingly, based on the contents of word dictionary 132. The user may then press additional second group keys for subsequent character positions of the word, when processor 130 was still not able to guess the intended word. This process may be repeated, if necessary, until the entire word is entered again, this time using the second group keys.
In other embodiments of the invention, when a second group key is pressed it refers to the last character position of the word that was not disambiguated, rather than to the first letter of the word. It is noted that in some embodiments, the user may press second group keys before entering an entire word, for example when the user knows in advance that the word will not be guessed correctly by processor 130. It is noted that the processor 130 is configured to apply a second input signal provided by a second group key to a different position within the current word than a first input signal provided by a first group key, from a same cursor location.
When a second group key is pressed while the cursor is in the middle of a word, with further letters of the word already entered on its right, the second group key optionally applies to the character position immediately to its left. Alternatively, as at the end of the already entered letters of the word, also when in the middle of a word, the second group keys pressed apply to the first not disambiguated character position of the word.
In some embodiments of the invention, in addition to backspace key 105, which cancels all information regarding a character position to which it is applied, an additional key is
assigned a second backspace function for removing a second-group key disambiguation act, while leaving the character position associated with the letters of a first-group key. Optionally, when the second backspace function is applied to a character position associated with a plurality of letters, the second backspace function has no affect. Alternatively, when the second backspace function is applied to a character position associated with a plurality of characters, it operates as backspace key 105 and removes the association of the character position with the group of letters. Alternatively to two different backspace keys, a single backspace key is used. When applied to a disambiguated character position the backspace function removes the disambiguation and when applied to a multi-letter character position it removes the group of letters from being associated with the character position.
The second backspace function may optionally be applied several times in sequence until the entire current word is moved back to its original ambiguous form. In some embodiments of the invention, an undo button or input signal, which cancels the most recent input regardless of whether it was a first group key or second group key is provided in addition to or instead of the backspace key.
Optionally, a user can select a cursor position using a mouse control or by positioning the cursor near the position to be selected. The selected cursor position may optionally be anywhere on the screen not necessarily in the most recently entered word. Pressing a first key for the selected cursor position optionally replaces the data of the current cursor position with the letters of the first key. Pressing a second group key for the selected position optionally replaces any disambiguation information associated with the cursor position, with the disambiguation by the pressed second key, leaving the first key information of the cursor position unchanged. Alternatively, second group keys take no affect in single letter character positions. Further alternatively, the letters of the second group key replace the current letter or letters of the character position.
Optionally, after pressing a first key for the position, the cursor position of mobile phone 100 remains in the same location, in case the user wants to perform disambiguation using a second group key. In contrast, when a second group key is pressed, the current cursor optionally moves to the next character position, to the next character position including a letter or to the next not disambiguated character position.
In some embodiments of the invention, the user can control the character position affected by the second group keys, separately from the cursor location which affects the character position that will be affected by a pressed first group key. Optionally, a correction point indicator points to a character position within the word, which will be corrected by the
second group keys. In some embodiments of the invention, the correction point indicator is displayed on display 140, for example as a dot above or below the letter in the character position to which the indicator points. Optionally, the user can move the correction point indicator within the current word, for example by pressing a first sequence of two first group keys to move the indicator to the right and a second sequence to move the indicator to the left.
Optionally, when a user writes a word by disambiguation using the second keys, the word is added to the dictionary, so that the processor will guess the word next time it is used. Optionally, at first the new word is assigned a relatively low priority, such that it is chosen only if original dictionary words that match the letters of the word are not available. In some embodiments, each time the user enters the word, the priority of the word is raised.
Optionally, a key of mobile phone 100 or a key combination (e.g., keys 103 and 104 pressed together) is assigned to a fixation act which tells processor 130 that the guess letter for the current character position is correct. Alternatively, the fixation act indicates to processor 130 that the guess letters for all the letters of the current word up to the current location are accurate and these locations are disambiguated accordingly. Possibly, two different key combinations are assigned to letter and word fixation acts.
In some embodiments of the invention, the first group 150 keys are used to enter letters and the second group keys are used for disambiguation. Optionally, when a second group key is pressed for a character position not associated with a group of letters entered by a first key, the character position is associated with a digit associated with the pressed second key or with a symbol, function or other key meaning associated with the second key.
In other embodiments of the invention, the second group keys are used to enter letters and the first keys are used only for disambiguation. In still other embodiments, the user may initially enter letters through either the first or second keys as desired by the user, possibly switching between the first and second keys even during entering of a specific single word. In some embodiments of the invention, the operation mode of processor 130 as to whether letters are initially entered through the first keys, the second keys or both, is user adjustable.
Optionally, one or more of the first group keys and/or the second group keys serve as mode keys which change the function of one or more other first group keys and/or second group keys. One or more mode keys optionally change the case of the letters entered by the first group keys and/or the second group keys to upper case. In some embodiments of the invention, the mode keys change the functions of the second group keys to various symbol modes for entering symbols other than letters.
In an exemplary embodiment of the invention, one or more dedicated mode keys
whose sole function is to move between modes, axe used. Alternatively or additionally, one or more keys have two for more different functions depending on how they are actuated. For example, a short press on a key may have a first function, such as inputting letters or other symbols, while a longer press on the key has a different function, such as a mode key function. Alternatively or additionally, a key has a first function when pressed once and a different function when pressed twice within a short period. Further alternatively or additionally, a key has a different function when pressed together with another key. For example, in some embodiments, when a first group key is pressed and a second group key is subsequently pressed before the first group key is released, the pressing of the first group key is interpreted as a different function than if pressed without the subsequent pressing of the second key.
In some embodiments, the first group keys have two functions: a regular function for entering letters, as discussed above, and a mode key function which controls the functions of the second group keys. Possibly, also one or more second group keys have a mode key function, for example when there are more modes than first group keys. In other embodiments, the second group keys serve as mode keys which change the functions of the first group keys. In still other embodiments, the mode keys change the functions of both first and second group keys.
Optionally, when a mode key function is actuated, processor 130 moves into a symbol mode in which all actuations of the second keys are interpreted according to the symbol mode instead of their regular function, until a different symbol mode is entered or the symbol mode is otherwise released, for example by actuating the mode key function again or by pressing a first group key such as the space key 105. In some embodiments of the invention, processor 130 leaves the symbol mode when a key other than one belonging to the symbol mode is pressed. Alternatively, processor 130 leaves the symbol mode after a single actuation of a second group key. Further alternatively, the symbol mode is in effect only when the mode key is held pressed. In some embodiments, the user may instruct processor 130 to leave the symbol mode even if none of the second group keys were actuated during the symbol mode, for example because the user changed his mind.
In an exemplary embodiment of the invention, the six first group keys 101-106 define six different symbol modes which carry the various symbols and/or functions available on standard QWERTY computer keyboards. The symbols are optionally distributed between groups according to a common theme to allow them to be easily found by users. In one specific possible arrangement, the six mode groups include: a text symbol group including the symbols _ " ' $ ; : & ? ! @ ,
an arithmetic symbol group including the symbols + # - / \ * | = ( ) % a commands group including arrows, Tab, caps lock keys a rare symbol group including the symbols < > [ ] { } λ ~ a function group including the function keys Fl -F 12; and a computer function group including esc, prtsc, Pause, PgUp, Ctrl, Alt keys.
It is noted that the above arrangement is just an example and other arrangements may be used. More mode groups may be defined for other symbols, for example, for letters of mathematical symbols provided by mathematical editors, foreign alphabets or even for the Latin alphabet letters for users interested in single letter keys. Furthermore, one or more groups may be assigned to commonly used sequences of letters, such as "tion", "ture" and "tice".
The second keys may also correspond to functions not generally included on keyboard keys, such as functions included in menus (e.g., copy, paste, exit).
In some embodiments, one or more keys may be included in a plurality of groups to allow them to be easily found by users, for example the parenthesis may be find in both text and arithmetic groups. Other particular symbols which may be included in several groups include, for example, "space", "backspace" and period which are commonly used.
In some embodiments of the invention, when entering a specific mode, processor 130 displays on screen 140 the layout of the symbols of the keys in the specific mode for the user's convenience. The layout is optionally displayed on a side of screen 140 farther from the mode key causing processor 130 to enter the specific mode. The layout display is optionally removed when processor 130 leaves the specific mode.
Optionally, the user may set whether the layout is displayed or not, possibly controlling the display for each mode separately.
Some symbols and/or sequences which are used frequently may be assigned to shortcuts, for example, to a special press on one of the keys, to a pressing combination on a plurality of keys or to additional keys of mobile phone 100. In some embodiments of the invention, such shortcuts may be associated with a sequence of ambiguous letters.
Optionally, in order to enter capital letters using the first group keys 101-104, the user presses a long press on one or both of keys 105, 106, which indicates to processor 130 to move into a capital letter mode. Optionally, when a capital letter is to be used, the guess letters for the position are always displayed capitalized even if the guess letter changes.
Fig. 2 is a flowchart of acts of a data entry system run on processor 130, in accordance with an exemplary embodiment of the invention. When in a text entry state, for example for
entering a short message (SMS), the data entry system remains in a wait state (228) in which it waits for key actuations. When (230) a letter key of the first keypad 150 is actuated for a short period, the next character position is associated (232) with all the letters corresponding to the actuated first group key. Processor 130 then optionally selects and displays (234) a best match word for the current input sequence. Optionally, the displayed word is selected by selecting the most popular word that matches the available information on the input sequence.
When (236) a key of the first group is actuated for a period longer than a predetermined duration, the processor moves (238) into a symbol mode in which the second group keys are given special character interpretations. Optionally, the predetermined length is of a duration substantially longer than normally used by users entering data, such that only purposeful long actuation of the key will be interpreted as a state change. In some embodiments of the invention, the processor remains in the symbol mode, until the key is released. Alternatively, the processor remains in the symbol mode until a different mode key is actuated. Optionally, in this alternative, one of the first keys is associated with moving into the regular mode.
When a second key is actuated (240), processor 130 optionally determines whether (242) it is currently in a symbol mode. If (242) processor 130 is in a symbol mode, the next word position is associated (244) with the symbol corresponding to the actuated second-group key in the specific symbol mode. In some embodiments of the invention, the processor then reselects the word to be displayed (234). It is noted, however, that some states may correspond to symbols not included in words of the dictionary 132 and therefore their combination to the current word will not result in a known dictionary word. In such cases, the display may be updated only for the current position. Alternatively or additionally, the fact that the position of the recently added symbol does not include a letter is used in selecting an updated best guess word.
If (242) when the second key is actuated (240) processor 130 is not in a symbol mode, the processor optionally determines whether (246) the current word includes positions that ambiguously correspond to a plurality of letters and were not disambiguated. If (246) there are such non-disambiguated positions in the current word, the letters corresponding to the second key are used to limit (248) the first position in the word that was not yet disambiguated. In some embodiments of the invention, each pair of first and second keys have in common only a single letter, such that the disambiguation results in a specific letter. Alternatively, pairs of first and second keys may have a plurality of letters in common, for example up to two or three letters in common. This option allows reducing the number of letters in the first and/or second group of keys.
If (246) there are no non-disambiguated positions in the current word, the next position in the current word is optionally assigned (250) a digit corresponding to the pressed second group key. Alternatively, any other set of symbols, for example any of those used in one of the symbol modes, may be associated with the second group keys in cases in which there are no non-disambiguated positions in the current word. Further alternatively, when there are no non- disambiguated positions in the current word, the next character position is associated with all the letters corresponding to the actuated second-group key. This alternative allows the user to choose dynamically whether to begin writing with the first keys and disambiguate with the second keys or to write with the second keys and disambiguate with the first group keys. This option is especially useful for users accustomed to using a keypad of the second group keys 160.
The letters corresponding to each of keys 101-104 are optionally engraved on the keys and/or somewhere else on the casing of mobile phone 100. Alternatively, the corresponding letters are displayed on screen 140 at times when input of letters is expected or upon an instruction from the user. For example, one of the keys of mobile phone 100 may control the display of the letter arrangements of keys 101-104 on screen 140. The letter arrangements of the keys may be displayed at a predetermined location on screen 140 or may move along with the writing so as to be near the cursor location on screen 140 and/or so as not to interfere with seeing the written text.
Optionally, the letters corresponding to first group keys 101-104 are displayed for each key in their order in the alphabet, so as to allow the user to find a desired letter quickly. Alternatively or additionally, the letters are arranged in eight imaginary/virtual columns each containing at most one of the letters of the alphabet that is located on the corresponding key (e.g. 2-9) of a standard telephone keypad. Accordingly, the letters of a key 101-104 may be displayed with a gap in the middle, corresponding to a second group key for which the first group key does not have a letter in common.
Alternatively or additionally to displaying the layout of the first group keys 101-104 on display 140, the letters and/or symbols associated with the second group keys are displayed. The arrangement of the second group keypad may be displayed continuously or may be displayed only at specific times, for example when the user did not press a key for a predetermined time and/or when the backspace was used. In some embodiments, the second group keypad arrangement is displayed responsive to a user instruction. Optionally, the arrangement displayed is the current arrangement according to the current mode which interprets the second keys.
Display differentiation of ambiguous character positions
As mentioned above, in some embodiments, during entrance of letters using ambiguous keys, processor 130 presents in each character position on display 140 a single letter, selected from the group of letters with which the character position is associated. In some embodiments of the invention, the letters are displayed in a manner which differentiates between character positions associated with a plurality of letters, for which the displayed letter is only a guess and between character positions associated with a single letter. For example, different colors or different font sizes may be used to differentiate between single letter and multi-letter character positions. In some embodiments of the invention, a marking such as a star or line are displayed above, below or otherwise adjacent letters of multi-letter character positions. Alternatively or additionally, markings are displayed adjacent letters of single letter character positions.
In some embodiments of the invention, the markings used for multi-letter character positions are associated with the keys generating the multi-letter group for the character position. For example, character positions for which the user pressed key 101 may display their guess letter in a first color, character positions for which the user pressed the key 102 display a letter in a second color, etc. Optionally, positions associated with a single letter, for example because the user performed for them disambiguation with a second group key, are displayed in a default color, e.g., black. Alternatively or additionally, each key is assigned a different symbol which is displayed next to the letters representing character positions associated with the letters of the key.
Alternatively or additionally, processor 130 displays for recently entered character positions corresponding to a plurality of letters, some or all the letters to which the character position corresponds. Optionally, at the character position, processor 130 displays the letter currently guessed for the character position, based on the portion of the word entered so far. Beneath or above the character position, in the main window in which the selected and disambiguated letters are displayed, processor 130 optionally displays a letter row or column including the other letters associated with the character position. Thus, the user can easily determine whether a mistake was made in pressing the wrong key or the processor does not have enough information to guess the intended word. The letters in the letter row or column are optionally presented differently from the letter in the character position, for example being in a different color, a different font and/or a different size (e.g., smaller). Optionally, when a plurality of letter columns are displayed next to each other they are displayed in a manner such that they are not read together, for example in different colors, different fonts, different sizes
and/or with gaps between the columns.
In some embodiments of the invention, the letter column of a position does not include the selected letter appearing in the character position as it is already shown. In other embodiments, the selected letter appears also in the letter column to allow easier identification by the user, particularly when the letters of the column are in a different size from the selected letter.
The order of the letters in the letter column (or row) is optionally selected without relation to the letters of other character positions of the same word, and generally the letters in the different columns do not usually form words. Each letter in the letter column is optionally included only once. In an exemplary embodiment of the invention, the letters are organized in the columns according to their order in the alphabet. Optionally, the letters are organized in the columns in eight rows, each row corresponding to a key of the telephone-type keypad.
In some embodiments of the invention, the user can control whether the symbols and/or letter columns are displayed. Alternatively or additionally, the system displays the symbols and/or letter columns automatically when the user may be confused, for example when the user presses the backspace key. In some embodiments of the invention, the letter columns are displayed only responsive to a press of the user on a letter, to which press the system responds by displaying the column of the pressed letter or of all the letters of the word. Possibly, responsive to the press, the selected letter or the word of the selected letter is enlarged on the display. Alternatively, the user glides with his finger over a word for which the columns are desired.
The arrangement of keys shown in Fig. 1 is brought as an example and many other arrangements including keys of various shapes (e.g., round, square, half circle) in various arrangements (e.g., rows, columns, circle, ellipse) may be used. Optionally, the keys of the first group and/or of the second group are arranged such that a single finger or two fingers can touch all the keys of the group concurrently, so that the user can press all the keys without looking at the keypad.
In some embodiments of the invention, the displayed letters in the letter columns are presented as soft keys which the user may press to associate their respective character position with the selected letter. The letter column soft keys may be provided instead of, or in addition to, the second group keys. Optionally, in these embodiments, the letter columns of the current word are presented larger than the letter columns of previous words, in order to allow easy access to the soft keys of the letters of the columns. Optionally, the user does not need to use the soft keys of the letter columns but rather may use them if desired.
Soft keys
Fig. 3A is a schematic illustration of a mobile device 300, in accordance with an exemplary embodiment of the invention. Mobile device 300 includes hard keys 201-206 for the first group of keys and a touch screen 320. The second group keys are soft keys 301-312 displayed on touch screen 320. Thus, mobile device 300 may have very few hard keys, for example less than ten or even less than eight hard keys. In some embodiments of the invention, also the first group keys are soft keys displayed on touch screen 320, such that mobile device 300 may have less than four hard keys or even may not have hard keys at all. Keys 201-206 optionally have the same functions as keys 101-106 (Fig. 1), respectively, although they are arranged differently.
The second group keys 301-312 may be shown permanently on screen 320, at least whenever in a text entry mode, or may be displayed only when the user requests their display, for example by pressing a control key. In some embodiments of the invention, the second group keys 301-312 are displayed permanently in a small arrangement and are enlarged when their use is expected, for example when the user presses one of the small keys or when entering a special key mode. When a first group key is pressed, the second group keys 301-312 are optionally removed entirely from the display or are made small, until the next time they are required, so that they do not take up too much space on screen 320.
In some embodiments of the invention, second group keys 301-312 are displayed in the center of screen 320. Alternatively, second group keys 301-312 are displayed on one side of the screen or at the top and/or bottom of the screen 320. For example, the second group keys may be displayed in one or two horizontal rows on the top and/or bottom of screen 320. In some embodiments, the second group keys 301-312 are displayed at the opposite side from the key that instructed them to be displayed, e.g., a mode key. Optionally, keys 301-312 move along screen 320 as data is entered, so as not to interfere with seeing the displayed entered data.
In some embodiments of the invention, the first group keys are soft keys in addition to, or instead of the second group keys. The first group keys may all be positioned together adjacent each other on the touch screen 320 or may be separated into two different areas on the touch screen, for example on the right and left sides of screen 320.
When a second-group key is pressed and not released for a long time, the function of the key is optionally repeated until it is released. The repeating of a function of a key when held pressed may be performed also for the first group keys in those embodiments in which a long press on the key does not have a different function than the short press. Alternatively, processor 130 may differentiate between three or more lengths of holding a key pressed. A short press on
a first group key 201-204 enters a set of letters, a longer press serves as a mode key and an even longer press enters the set of letters repeatedly until the key is released. In an exemplary embodiment of the invention, a short press on a first group key enters the characters associated with the key, a longer press enters into a first symbol mode, for example a mode of numerical digits and an even longer press enters a different symbol mode, such as a function key mode.
The principle of different pressing durations may be used also for second group keys. For example, in one or more symbol modes, a short duration press on each key may be associated with a first function while a longer press is associated with a different function. For example, a mode associated with both digits and function keys Fl -F 12 may be provided. A short press on one of the second group keys enters the corresponding digit, while a long press enters the corresponding function key (e.g., F7).
In order to allow use of the entire screen 320 for display of data while it is used for soft keys, in some embodiments screen 320 may not show the locations of the soft keys but rather the user is trusted to remember them. This is especially practical when there is only a limited number of soft keys, such as when using screen 320 for no more than six or four soft keys. Alternatively or additionally, the locations of the soft keys may be calibrated dynamically according to the user acts. For example, at the beginning of a text entry session the user may indicate the desired location of the keys, for example by entering an X shape or a single tap pressing on a specific point, such as the center of the desired keyboard. A short sweeping gesture in the direction of one of the four keys, from a center point at which the four keys meet, may be used both to indicate the layout of the keys and to actuate the key. The system optionally identifies the short sweeping gesture and according to its direction identifies the actuated soft key. In addition, the starting point of the sweeping gesture is identified as the meeting point of the four keys and accordingly their locations are fixed until a next calibration. The space and backspace soft keys are optionally fixed at the bottom left and right corners of the touch pad or at any other suitable location.
In some embodiments of the invention, a compromise is provided between complete marking of the locations of the soft keys and no marking at all, in the form of small hints to the locations of the keys.
Fig. 3B is a schematic illustration of a data entry device 360, in accordance with an embodiment of the invention. Instead of including hard keys, device 360 includes soft keys 362 on the right and left of the touch screen 320. Dots 364 are displayed on screen 320 at the corners of keys 362 adjacent the center of screen 320. Thus, four dots 364 indicate the locations of the six keys, making their identification easier. It is noted that other markings may be used,
such as short continuous or dotted lines along a portion of the border between adjacent keys and/or between the keys and the center of screen 320.
Fig. 3B also illustrates the possibility of using an auxiliary small data entry unit 366 which communicates with device 360. Device 360 may be a computer which is heavy and auxiliary data entry unit 366 is used by the user for data entry. In other embodiments, data entry unit 366 may be used with a desk top computer, a notebook computer or any other device. Data entry unit 366 may communicate with the main device through wires or wirelessly, using any method known in the art.
Unit 366 optionally comprises a touch pad 369 and a processor 367. Processor 367 optionally differentiates between sweeping gestures, described herein below in detail, and pressing acts on touch pad 369. Touch pad 369 is optionally divided into six key areas, corresponding to keys 201-206 of Fig. 3 A, and processor 367 identifies for each user-press the actuated key. Optionally, two dot markings 368 are provided on the touch surface to help the user orient fingers in pressing on the keys. Alternatively, two bulges are used so the user can feel them.
In some embodiments of the invention, the guessing of intended characters based on the input information from the user is optionally performed by processor 367 within unit 366. In other embodiments, the guessing is performed by a processor of device 360.
Auxiliary unit 366 may be very simple and very inexpensive to produce. Optionally, touch pad 369 is not a touch screen and unit 366 does not include any hard keys. Processor 367 is optionally dedicated only for the data reception and possibly the character guessing. In other embodiments, the auxiliary unit may include additionally hard keys and/or a touch screen.
In some embodiments of the invention, auxiliary unit 366 is battery operated. Optionally, unit 366 has a USB connection (or any similar connection type) through which the battery is charged. Alternatively or additionally, auxiliary unit 366 communicates with data entry device 360 through a USB connection. A long USB wire may be used to allow connection to the computer while auxiliary unit 366 is in the users hand.
In some embodiments of the invention, auxiliary data entry unit 366 is of a small size, for example having an area of less than 10 square centimeters or even less than 5 square centimeters.
In some embodiments, auxiliary data entry unit 366 is integrated into a USB memory stick. Thus a single pocket sized device serves both as a storage unit for important data and as a keyboard for entering information. Auxiliary data entry unit 366 can be connected to any computer through a USB slot and the user can then access the information stored in unit 366
and use the keys and/or touch screen of unit 366 to interact with the accessed data.
When the soft keys of the first group are divided between two different locations on screen 320, the user optionally provides a calibration signal for each portion of the keypad separately. Alternatively, the user provides a calibration signal for one portion of the first keypad and the location of the other portion is set accordingly, for example so that they are symmetrical relative to a middle axis of screen 320.
In some embodiments of the invention, processor 130 accepts calibration signals, such as a tap or sweeping move of a finger, only if it is provided by a specific finger, based on fingerprint comparison or finger width. For example, whenever a press with a thumb is identified it may be interpreted as a calibration signal, while pressing with other fingers are interpreted as regular data input. This prevents inadvertent calibration and/or mix-up between data entry and calibration. In addition, fingerprint identification may be used as a security measure to prevent use of mobile device 300 by unauthorized users. In other embodiments, calibration signals are received from any finger.
Identification of different fingers or different finger orientations may be used also in data entry. Instead of assigning the keys specific areas on screen 320, different finger presses anywhere on the touch screen are interpreted as different keys. For example, pressing with the tip of the finger may be interpreted as key 201, the wide face of the finger as key 202, with the narrow side of the finger as key 203 and pressing with the thumb as key 204.
In some embodiments of the invention, processor 130 determines which finger is touching screen 320 and accordingly controls which of the first and second keypads is being accessed by the user. Using a first finger or first finger orientation is interpreted that the user is pressing a key from the first group 150, while a second finger or finger orientation is used to indicate the user is pressing a key from the second group 160.
It is noted that the first and second groups of keys may have different numbers of keys than those described above, according to the specific needs of the users. Particularly, the second group of keys may have different numbers of keys in different symbol modes as required. For example, in a punctuation mode the second group may include 10 or 12 keys, while in a Greek alphabet mode, the second group may include a key for each Greek letter. In some embodiments, in one or more modes, the second group keys include a plurality of sets of twelve keys, each set organized in an array of three columns and four rows, even if some of the keys are not used. Optionally, the groups of 12 keys are separated from each other such that they are distinct. As the 12 keypad arrangement is very well known, organizing the keys in groups of 12 keys in a 3x4 arrangement may make it easier for the user to identify the keys needed.
In some embodiments of the invention, processor 130 is adapted to identify pressing on two different virtual keys on screen 320 concurrently and provide a different input than if only one virtual key is pressed. The user may optionally press on the two virtual keys with any two fingers. Alternatively, different pairs of two fingers pressing on screen 320 are given different interpretations.
In some embodiments of the invention, in addition to allowing the use of second group keys (and their equivalents) for disambiguation, when an ambiguous key is pressed the system may display soft keys for each of the ambiguous letters for selection. Alternatively or additionally, soft keys for disambiguation are displayed, automatically or upon a user command, when a user selects a previous character position for disambiguation thereof. In some embodiments of the invention, the soft keys displayed correspond to the last actuated first group key. In other embodiments, the soft keys displayed are of the first non-disambiguated character position in the current word, regardless of the cursor position, as is now described with reference to Fig. 3C.
Fig. 3C is a schematic illustration of a data entry device 330, in accordance with another exemplary embodiment of the invention. Device 330 is similar to device 300, but has a different arrangement of keys. Optionally, the letters of the alphabet are assigned to four of the keys, optionally to two keys on each die of screen 320. Optionally, the two keys on each side to which the letters are assigned, are keys 331-334 which form the columns in the key arrangements on each side.
Fig. 3C illustrates an embodiment in which during entering a word, soft keys 336 for letters of one of the actuated keys are displayed on the screen to allow disambiguation instead of using the second group keys. In the example shown, the user has pressed for the current word on the first group keys corresponding to the letter sets HEBLXQ, HEBLXQ, FARMZT and GOVSYCK. Assuming the following dictionary content words and respective scores:
Beak 292
Berg 196
Bets 276
Hero 2300
Hers 2526
Leak 558
Leas 684
Lets 928
Lxfy 10
Xeac 4223
in response to this key sequence, processor 130 guessed the word XEAC, which has the highest
score. Optionally, during the actuation of the first group keys of the word, soft keys corresponding to the letters HEBLXQ are displayed, as these letters are associated with the first character position of the word. Assuming the user is interested in the word "hero", the user pressed on the soft key of the letter H, causing processor 130 to select the word "hers". In addition, processor 130 displays the soft keys corresponding to the second character position of the word, and the user can press on the letter E. Processor 130 will then display the soft keys corresponding to the letters of the third character position and so on until the word is entirely disambiguated or the correct word was reached. It is noted that during this entire procedure, the cursor remains after the letter S at the end of the current word and it is not necessary to move the cursor to correct the word. When a space signal is entered by the user, indicating the word was properly entered, the soft keys are optionally removed from screen 320 until a next time a word is entered. Detachable keyboard unit
In some embodiments of the invention, the keys of the first keypad and the keys of the second keypad are all included in a single mobile unit. Alternatively, some of the keys are included in a separate detachable unit. For example, the first keys may be included in a main unit while the second keys are included in a detachable unit. In some embodiments of the invention, the keys of first keypad are distributed between two detachable units.
Fig. 4 is a schematic illustration of a mobile unit 400 with a detachable keypad, in accordance with an exemplary embodiment of the invention. Mobile unit 400 comprises a screen 320 and two key units 410 and 420 on opposite sides of the screen 320. In one embodiment, a first key unit 410 is permanently attached to screen 320, while a second key unit 420 is detachable so that it can be conveniently held in the left hand of the user while mobile unit 400 is held in the right hand. Optionally, key unit 420 is slideably detachable from mobile unit 400, which has a respective railing to which it is attached. Alternatively, other attachment devices may be used, such as snaps, Velcro or buttons.
In some embodiments of the invention, unit 420 communicates wirelessly with mobile unit 400, for example using a transceiver 402 of unit 420 which communicates with a respective transceiver 404 of mobile unit 400. The transceivers 402 and 404 may operate using the Bluetooth protocol or any other suitable short range protocol. Alternatively, key unit 420 may be connected through wires to the main portion of mobile unit 400, for example through a USB connection which may also charge a battery of mobile unit 400. Also, a wireless USB connection may be used.
It is noted that in other embodiments, in addition to unit 420 or instead of unit 420, unit
410 may be detachable.
Mobile unit 400 may be a cellular phone, PDA or any other communication or input device. In some embodiments of the invention, mobile unit 400 is a limited purpose keyboard device for entering text into an adjacent computer or television. In these embodiments, mobile unit 400 may be used for text entry by a user leaning back or lying down. In such cases, screen 320 may be much smaller, for example for displaying only a single line of text, or mobile unit 400 may not include a screen at all, and the user can view the input text on the screen of a main device receiving the input text. Sweeping gestures
Instead of using soft keys on screen 320, other user gestures may indicate the various input signals. In some embodiments of the invention, processor 130 identifies straight line sweeping gestures on screen 320 and according to their direction, length and/or other attributes, associates each identified sweeping gesture with one or more symbols or functions.
In some embodiments of the invention, the sweeping gestures are used for the functions of the first group keys or the second group keys, instead of providing soft keys of the respective group on screen 320. The sweeping gestures are optionally in directions selected according to a known arrangement of the keys of the group, such that a user accustomed to a specific key arrangement can easily adapt to using the sweeping actions. For example, instead of providing a 12 key telephone keypad arrangement, processor 130 is adapted to associate sweeping acts according to their directions, with the keys of the known telephone keypad arrangement.
Use of the sweeping gestures allows the user to provide input anywhere on the screen, instead of confining the user input to a specific area on the screen.
Optionally, in embodiments in which processor 130 is adapted to identify sweeping gestures, soft keys are not provided on screen 320 in order to avoid sweeping gestures from being interpreted as pressing on soft keys. Alternatively, screen 320 is divided into a plurality of zones, a zone for sweeping gestures and one or more zones with soft keys. For example, the soft keys may be placed around the outskirts of screen 320, while the center of screen 320 is used for sweeping gestures. In another example, screen 320 is divided into right and left halves. One half is used for soft keys and the other for sweeping gestures.
Fig. 5 is a schematic illustration of entering data to mobile device 300 using sweeping gestures, in accordance with an exemplary embodiment of the invention. Instead of pressing on soft keys 301-312 (Fig. 3A), the user provides straight line sweeping gestures, represented by arrows 381-388. Each sweeping gesture corresponds to the key in the direction from key
305 to the desired key on a standard telephone keypad or a variation thereof. For example, to enter the letters DEF of key 303, the user provides a sweeping motion on screen 320 in the direction of arrow 383, in a diagonal between the right and the upward directions. Similarly, a sweeping gesture in the direction of arrow 382 represents the letters ABC, in the direction of arrow 384 represents the letters GHI, in the downward direction of arrow 387 represents letters TUV and in the direction of arrow 388 represents the letters WXYZ. In some embodiments of the invention, to enter the letters JKL the user taps once or twice on the screen at any point, indicating the middle of the standard telephone keypad. Alternatively, the letter organization 370 shown in Fig. 6 is used, and the letters JKL are entered by a sweeping gesture in the direction of arrow 381. Alternatively, the sweeping gesture in the direction of up and to the left indicated by arrow 381, corresponding to the key of the digit "1" on the telephone keypad, is not associated with letters, but rather is interpreted as a backspace act canceling disambiguation of the previous character position.
Optionally, the sweeping gestures are required to start in a specific predetermined location, so that inadvertent sweeping gestures are not interpreted as input. In some embodiments of the invention, the location of the sweeping gestures on the screen may be calibrated by the user. In other embodiments, the sweeping gestures may be provided anywhere on screen 320, such that sweeping gestures following arrows 392, 395 and 396 have the same effect as those of arrows 382, 385 and 386, respectively. These embodiments allow the user more flexibility.
In other embodiments, the sweeping gestures are directed from the location of the desired key to the center of the keypad. In these embodiments, arrow 392, for example, corresponds to the letters TUV and arrow 395 corresponds to the letters GHI.
Letter organization 370 (Fig. 6), or any other letter organization used, may be displayed on screen 320, may be engraved or otherwise posted on the casing of mobile device 300 or may not be provided at all, based on the assumption that users know the organization by heart. In some embodiments of the invention, letter organization 370 is not shown on screen 320 regularly, but is shown when the user touches screen 320, as such touching indicates the user probably wants to enter data. Optionally, the letter organization 370 is shown at a predetermined location on the screen or at a location which is currently vacant. Alternatively, letter organization 370 is displayed at the location where the user touched the screen, allowing the user to sweep his finger toward the direction of the displayed desired letters, from the point where the finger originally touched the screen. The user may optionally control if and/or how letter organization 370 is displayed.
Alternatively or additionally to displaying letter organization 370 responsive to the user touching the screen, guiding lines are displayed showing the user the path on which the sweeping gestures are to be performed. Further alternatively or additionally, border lines between the sectors of the different sweeping gestures are displayed.
Fig. 7 is a schematic illustration of a display responsive to a user touching the screen, in accordance with an exemplary embodiment of the invention. Optionally, responsive to a user touching screen 320 at point 700, letters 702 are displayed around point 700, together with grid lines 704 showing the sectors in which sweeping gestures will be interpreted as relating to the respective letters. The user can then easily perform, for example, sweeping gesture 706 within the grid lines of the letters DEF.
Instead of displaying all the letters in letter organization 370, processor 130 determines which letter will be used for each sweeping gesture for the current character position, given that it already is related to a plurality of letters from a first key actuation, and only these letters are displayed. Displaying only a single letter makes the task of identifying the desired sweeping gesture much easier. In other embodiments, all the letters are displayed, but the letter corresponding to the character position is highlighted. In still other embodiments, for each sweeping gesture direction, processor 130 displays the word that will be selected for the current word character position sequence, if the sweeping gesture is selected. In cases in which a single sweeping gesture is required to receive the desired word, this makes the selection of the sweeping gesture very simple as the user sees the desired word in the direction of the required sweeping gesture. In some embodiments of the invention, processor 130 displays both the letter and the guessed word, for the convenience of the user, in case more than one sweeping gesture is required to achieve the desired word.
In still other embodiments, the letter or letters are displayed not when the user touches the screen but when the sweeping gesture begins or ends, and only the letter or letters corresponding to the entered sweeping gesture are displayed. The user is optionally given a chance to easily correct his sweeping gesture if necessary, responsive to the display of the letter corresponding to the sweeping gesture. For example, in embodiments in which the gesture is determined based on the relative direction between the beginning and ending point, the user may change the direction of the sweeping gesture in the middle, as illustrated by Fig. 8, to change from an erroneous entering of the letter N to entering the letter D. Alternatively or additionally, when processor 130 identifies an abrupt slowdown in a sweeping gesture, the sweeping gesture is ignored, as the abrupt slowdown is generally indicative of a hesitation by the user. Similarly, in some embodiments of the invention, if an abrupt lifting of the finger is
identified responsive to the display (e.g., within a predetermined short period from the display), the sweeping gesture is ignored. The speed threshold for differentiating between regular and aborted sweeping gestures may be predetermined or may be based on learning the operation habits of the user of the specific device.
Optionally, when the user begins a backspace sweeping gesture, processor 130 displays the current word that will be affected by the backspace act, possibly highlighting the letter in the character position which will be affected. A similar display may be performed for the backspace direction in embodiments in which letters are displayed in all directions or in some of the directions.
In an exemplary embodiment of the invention, when the user touches the screen, the key arrangement for all sweeping directions, is displayed. When the user begins the sweeping gesture, the letters for all directions are removed from the display, except for the direction of the sweeping gesture in progress.
In some embodiments of the invention, each sweeping gesture must begin from a state in which the user's finger does not touch the screen 320. hi performing the sweeping gesture, the user presses his/her finger against the screen, glides the finger in the required direction and removes the finger from the screen. In other embodiments, the sweeping gesture does not require removing the finger from the screen when it is completed. Rather, a sequence of a plurality of sweeping gestures, referred to herein as a complex gesture, may be provided by the user without lifting the finger from the screen. Optionally, each time the user changes the direction of the movement of the finger on screen 320, processor 130 considers the turn point as the end of a previous gesture and the beginning of a new sweeping gesture, whose direction is evaluated relative to this point. Alternatively, the direction of each straight line segment of the complex sweeping gesture is evaluated relative to the starting point of the entire complex gesture.
A single complex gesture may be used to enter an entire word, or several complex gestures may be used to enter a single word in parts. Furthermore, a word may be entered by one or more complex gestures together with one or more single position sweeping gestures.
In some embodiments of the invention, when a sweeping gesture is a very long straight line it is considered as two separate sweeping gestures in the same direction. Alternatively, long sweeping gestures are considered the same as short sweeping gestures, as not always can users easily control the lengths of their sweeping gestures. Further alternatively, when the sweeping gestures are used to represent keys of a keypad of more than nine keys, processor 130 may differentiate between sweeping gestures representing keys in similar directions, such
as keys 307 and 310 or keys 308 and 311 of Fig. 3 A, based on the length of the sweeping gesture. In other embodiments, the keys are arranged such that each key has a unique direction which is not generally interchanged with the other directions. For example, the key model which governs the sweeping gestures may have keys arranged in an octagon or in any of the key arrangements described in US patent publication 2007/0109276 to Kim, the disclosure of which is incorporated herein by reference in its entirety.
Long sweeping gestures may be interpreted as long presses on their corresponding key. For example, in an embodiment in which a short press on a key provides a digit and a long press enters a function key, the user may indicate a short press by entering a short sweeping gesture and a long press by a long sweeping gesture. Alternatively, the gestures corresponding to short and long presses on the same key may be differentiated using other methods. For example, while short presses may be represented by simple straight lines, longer presses may be represented by wiggled lines, a loop at the end of the line or any other suitable marking.
Optionally, if the user's finger is identified as remaining touching screen 320 without moving after a sweeping gesture, the function of the gesture is repeated until the user's finger is removed from screen 320, in a manner similar to the press and hold function known in the art for keyboard keys. In some embodiments of the invention, the repetition is of the last function entered, even if a sequence of letters was entered in one complex sweeping gesture. Alternatively, the entire sequence of letters or functions entered by the last sweeping gesture is repeated until the user's finger is lifted. For example, if the user performed a complex gesture which operated as pressing keys 201, 202 and 204 in a sequence, if the user keeps his finger touching screen 320 at the end of the sequence, processor 130 acts as if keys 201, 202 and 204 are repeatedly pressed in sequence.
Alternatively to interpreting crooked sweeping gestures as formed of a plurality of straight lines, each representing a different key press, in some embodiments of the invention, crooked sweeping gestures are interpreted based on their beginning and ending points, as if they were a straight line between the beginning and ending point.
In some embodiments, crooked sweeping gestures are interpreted as separate sweeping gestures having a totally different meaning than the straight lines from which they are formed. Optionally, Crooked sweeping gestures are used as shortcuts representing a plurality of keys.
Fig. 9 shows a four key arrangement together with various sweeping gestures entered by users, in accordance with an exemplary embodiment of the invention. A sweeping gesture downward and to the left in the direction of arrow 921, is optionally interpreted by processor 130 as equivalent to pressing on a button corresponding to the letters in box 901. Similarly,
sweeping gestures in the directions of arrows 922, 923 and 924 are optionally interpreted as entering the letters in boxes 902, 903 and 904, respectively. The space and backspace functions are optionally represented by short sweeping gestures to the right and left, respectively. Optionally, to perform the mode key tasks, the model sharing the first keys 201- 206 for both entering letters and mode keys is used. For a specific mode key task, the same sweeping gesture as used for the letters on the key of the specific mode key task is used, but with a variation indicating its mode key task, such as performing the sweeping gesture much slower or pausing at the end of the sweeping gesture while pressing on screen 320. If necessary, additional sweeping gestures may be used for further modes, such as up and down gestures not otherwise used.
In an exemplary embodiment of the invention, when desired to enter letters for two character positions at once, an arrow from the direction of the column of the desired first box, followed by an arrow in the direction of the row of the desired second box may be used. For example, a sweeping gesture in the direction of arrow 931 is optionally interpreted as entering the letters of box 903 followed by the letters of box 904. As shown, the sweeping gesture is formed of a long portion and then a short portion. In other embodiments, the sweeping gesture may be formed of a short gesture and then a long gesture or of similar length gestures. A sweeping gesture in the direction of arrow 932 is optionally interpreted as corresponding to box 902, and then box 901. A sweeping gesture in the direction of arrow 937 is optionally interpreted as corresponding to box 904 and then box 901.
It is noted that any other convention may be used in defining the meaning of complex sweeping gestures. For example, arrows 931 and 932 may be interpreted to correspond to a box in the column toward which the long portion of the gesture is directed followed by the box in the row toward which the short portion is directed. Optionally, for robustness, sweeping acts following arrows 934 and 935 are interpreted as arrow 931.
In some embodiments of the invention, the sweeping gestures are used to represent only some of the functions of the second keys, such as the letter groups, while digits and/or symbols in symbol modes are provided using soft keys. In other embodiments, the sweeping gestures replace all the functions of the keys they represent. Optionally, the user may decide whether to use sweeping gestures or soft keys.
In some embodiments of the invention, if a sweeping gesture is provided in a first sector corresponding to a first set of letters, but very close to a second sector, processor 130 selects based on the contents of dictionary 132, whether to use the letters of the first sector or the neighboring sector. Optionally, the letters of the neighboring sector are given a low
priority such that they are used only if the letters of the first sector do not match a word at all or are very unlikely relative to a very likely word for the neighboring sector.
In some embodiments of the invention in which processor 130 is configured to identify sweeping gestures on screen 320, the screen is not used to control a mouse pointer, in order not to confuse processor 130. Alternatively, a switch controllable by the user indicates whether to interpret finger movements on screen 320 as text entry or as mouse movements. Further alternatively or additionally, processor 130 evaluates the movements according to their speed. Fast movements are optionally interpreted as sweeping gestures representing keys, while slow movements are optionally interpreted as mouse movements. Optionally, the speed of the sweeping gesture is determined at the end of the sweeping gesture. Acts performed by processor 130 during the entry of the sweeping gesture are optionally reversed, if necessary, when a sweeping gesture starting at a high rate is completed at a slow rate. Alternatively, the speed is determined as the average speed or the speed at the beginning of the sweeping gesture. It is noted that in other embodiments, the association between speed and specific keys may be set differently, for example associating fast gestures with the mouse control and slow movements with data entry.
Alternatively or additionally to differentiating based on speed, screen 320 is divided into a plurality of zones and processor 130 interprets sweeping gestures in different zones on the screen, differently. Optionally, in one zone the movements are used to control the mouse and in the other the movements are interpreted as gestures representing keys. In other embodiments of the invention, the user is required to use different pressure levels for different meanings, for example using more pressure for key actuation than for mouse movements.
In still other embodiments, processor 130 determines if sweeping gestures relate to mouse control or character entry based on whether the user is in the middle of entering a word. Optionally, when in a symbol mode or when in the middle of entering a word, sweeping gestures are interpreted as referring to second-group key functions, and otherwise the sweeping gestures are used to control a mouse cursor.
Alternatively or additionally to using finger movements to control a mouse cursor, finger movements may be used to control movement of the text entry cursor and/or the disambiguation cursor. Optionally, a sweeping gesture of the finger in a specific direction moves the cursor in that direction. The extent of moving the cursor is optionally proportional to the length of the gesture, for example a single cursor position for each centimeter of the sweeping gesture. The sweeping gestures may control the cursor movement only to the left and to the right or may also be used for up and down movements. Diagonal sweeping gestures
are optionally ignored or are interpreted according to their closest horizontal or vertical angle.
Processor 130 optionally determines whether to move the mouse or a cursor based on the sweeping gestures being in different zones, having different widths and/or any other differentiation methods described above or combinations thereof.
Optionally, the left and right mouse buttons are implemented by pressing on screen 320 at any point on the screen. The pressing for the left and right mouse buttons optionally differ according to the time the finger is held on screen 320 according to predefined rules, such as a very short press for the text entry button 305 (Fig. 3A), a longer press for a left mouse button and an even longer press for a right mouse button.
Another possible method of differentiating between sweeping gestures corresponding to keys and mouse movements is the width of the object passing over screen 320. Optionally, sweeping gestures entered by a stylus or a single finger are interpreted as corresponding to keys, while thick gestures entered by two fingers are considered as mouse movements. The width threshold differentiating between key entries and mouse control movements may be set at substantially any suitable width, possibly by the user. In an exemplary embodiment of the invention, a thin stylus is used for gestures corresponding to keys and a single finger is used to control a mouse. The width threshold is optionally set accordingly between the width of the stylus and the width of a finger. In other embodiments, the threshold width is set between the width of a finger when placed flat on screen 320 versus the width of a finger when its tip is placed on screen 320.
Optionally, sweeping gestures are evaluated according to their width when the gesture begins, in cases in which the width changes over time. Alternatively, the width at the end of the sweeping gesture or the average width is used. It is noted that different widths of sweeping gestures may have other interpretations, for example differentiating between gestures relating to the first keypad and gestures relating to the second keypad.
Separate zones could also be used instead of using mode keys. Instead of presenting a single copy of, for example, a 12-key telephone keypad, a plurality of copies of the telephone keypad could be provided, with or without being displayed, each copy associated with characters of a different symbol mode. In other embodiments, the screen is divided into a plurality of zones for sweeping gestures and the gestures are interpreted differently in each zone. For example, sweeping gestures in a first zone may be interpreted as corresponding to keys of first group 150, while sweeping gestures of a second zone are interpreted as corresponding to keys of second group 160. Alternatively or additionally, sweeping gestures of one or more zones may be interpreted as corresponding to keys in a symbol mode (such as a
caps-lock mode or a mathematical symbol mode), avoiding the need to press a mode key.
In an exemplary embodiment of the invention, one of the zones is assigned to sweeping acts which correspond to mode keys. Alternatively, specific sweeping acts are assigned to the mode key functions, such as sweeping acts which are longer than regular sweeping gestures. Different types of sweeping gestures may also be used to differentiate between other groups of keys. For example, in embodiments in which sweeping acts may be used for both first group and second group keys, the user may use relatively short sweeping gestures for the first group keys and longer sweeping acts for the second group keys, or vice versa. In other embodiments, the sweeping gestures differ in their shape. For example, straight and curved sweeping acts may be differentiated by processor 130, and each type of sweeping act may be assigned different groups of keys. In one embodiment, straight diagonal sweeping gestures are assigned to first group keys, while straight horizontal and vertical sweeping gestures and curved sweeping gestures are used to indicate the keys of the second group.
It is noted that separate zones may also be used in order to reduce the complexity of identifying sweeping gestures of different directions. For example, rather than identifying sweeping gestures in eight different directions, sweeping gestures may be indentified in two different zones, and in each zone sweeping gestures in four directions are identified. In one embodiment, gestures in diagonal directions are provided on the right side of the screen and sweeping gestures in horizontal and vertical directions are provided on the left side of the screen
The different zones could all be used for soft keys, could all be used for sweeping gestures or one or more could be used for sweeping gestures while one or more others are used for soft keys. In an exemplary embodiment of the invention, a first zone displays soft keys of the first keypad and the rest of the area of the screen 320 not occupied by the first keypad is considered a second zone in which sweeping gestures corresponding to second keypad keys are received.
Optionally, sweeping gestures extending between zones are ignored. Alternatively, sweeping gestures are interpreted according to their start location or end location. Further alternatively, sweeping gestures are associated with the zone including the majority of their length.
Another method to differentiate between sweeping gestures for different symbol modes is requiring use of different fingers, numbers of fingers or combinations of fingers. For example, sweeping gestures using a right thumb may relate to a first group of symbols, while sweeping gestures with three fingers relate to a second group of symbols.
Processor 130 optionally identifies the different combinations of fingers based on the relative positions and/or orientations of the fingers. For example, a sweeping gesture with both the forefinger and the pointer finger of the right hand is easily distinguishable from a sweeping gesture with the pointer finger and the pinky. In this example, processor 130 optionally determines whether the lower finger (the forefinger or pinky) is on the right or the left of the higher finger (the pointer finger). Alternatively or additionally, processor 130 uses fingerprint recognition and/or the area or width of the finger to identify which finger or fingers of the user are contacting screen 320 and accordingly selects the symbol mode to which the sweeping gesture corresponds. Extended character sets
While in the above description the first and second key groups had the Latin alphabet letters in common, the same principle may be used for other characters including other alphabets, digits and symbols. In one embodiment of the invention, each first group key includes also a single non-letter symbol in its group of ambiguous characters. In the second group keys, the symbols are optionally associated with key 301, allowing fast disambiguation when necessary.
Fig. 10 shows a key arrangement for a mobile device 950, in accordance with an exemplary embodiment of the invention. Keys 201-204 are assigned the symbols shown in symbol arrangement 980, with the symbols of box 961 corresponding to key 201, the symbols of box 962 corresponding to key 202, etc. In this example, each key corresponds ambiguously to a set of letters and to other symbols. For example, key 201 corresponds ambiguously to the digits 0 to 9 in addition to a group of letters, key 202 corresponds ambiguously to the arithmetic characters 972 (e.g. the arithmetic symbol group of characters discussed above in relation to the mode keys) in addition to the set of letters, key 203 corresponds ambiguously to the punctuation characters 973 (e.g. the text symbol group of characters) in addition to its set of letters, and key 204 corresponds ambiguously to the rare characters 974 (e.g. the "RARE" group of characters) in addition to its set of letters.
Mobile device 950 recognizes two second group keypads 951 and 952. Preferably, the characters on the keys 201-204 of the first keypad are distributed on the keys of the second virtual keypads 952 and 951, such that any key of the first keypad has at most one common character with any of the second group keys.
Predefined tapping or sweeping actions (e.g. 982) on the right side of the touch screen optionally correspond to interacting with the keys of the second group keypad 952, and predefined tapping or sweeping actions on the left side (e.g. 984) of the touch screen
optionally correspond to interacting with the keys of the second group keypad 951. Optionally, in guessing which character to use for character positions for which a second group key was not actuated, preference is given to the letters. Alternatively, the letters and other symbols are given equal preference, depending on their rating in dictionary 132. In some embodiments of the invention, in order to select a letter for disambiguation, the user presses the screen on the right zone and responsive thereto the layout 952 is displayed. The user than performs a sweeping gesture corresponding to the desired letter. Similarly, when the user wants to enter a digit or symbol in the disambiguation, the user presses on the screen in the left zone and the key arrangement 951 is displayed to direct the sweeping gesture. Other display methods described herein may also be used as well as other display methods known in the art.
These embodiments are particularly useful when database 132 is adapted to learn new words frequently used by the user. Such words may be, for example, passwords, URL addresses, slang and unofficial SMS symbol talk, formulas, computer programming language expressions, etc. While in the first time these "words" are entered the user will in many cases need to enter the entire word twice, once with the first group keys and then with the second group keys (or their equivalents), the next time the same word is entered, there is a fair chance it will be guessed by processor 130.
The inclusion of all the digits on a single first group key makes it easier to remember which key is to be pressed for a digit. In other embodiments, however, the digits are distributed between the first group keys to increase the chances an intended number is identified.
When the embodiment of Fig. 10 is used with display of soft keys described above with reference to Fig. 3 C, soft keys may be displayed for all the letters and symbols on the pressed first group key. Alternatively, soft keys are displayed only for the non-letter characters and the user performs disambiguation of letters by sweeping gestures. Using first key combinations instead of second keys
Combinations of first group keys may be used as shortcuts for tasks which users may want to do in a simpler way then using mode keys and the second keys or their equivalents (e.g., sweeping gestures).
Optionally, pairs of first group keys pressed together are given meanings of tasks which are used relatively frequently. In some embodiments, pairs of first group keys have the functions of arrow keys which allow navigating the cursor around the display and/or navigating a correction point indicator around the display. In other embodiments, pairs of first group keys do not have any function.
In some embodiments of the invention, pairs of first group keys may be used to perform the functions hereinabove assigned to the second group keys. Accordingly, all the input tasks described above may be achieved with only six keys. Optionally, when a user presses one key and while it is held pressed he presses another key, the pressing of the two keys is considered a separate act than a short or long press on one of the keys. Accordingly, in these embodiments, processor 130 is adapted to identify three different patterns of actuations of first group keys:
1) a short press on a key - interpreted as a set of letters, a space or backspace
2) a long press on a key — interpreted as a mode change
3) pressing a key and while it is held pressed pressing a second key - interpreted as a second group key.
Using the four keys 201-204 provides 12 unique sequences of pressing one of the keys and then another of the keys while the previous is held pressed. These 12 unique sequences may be associated with the 12 keys of the second group keypad in any correlation. In some embodiments of the invention, a correlation which allows the user to intuitively correlate between the first key sequences and the second keys, is used.
In an exemplary embodiment of the invention, the correlation between the first key sequences and the second group keys is based on the direction from the first-group key that was pressed and held to the first-group key that was pressed subsequently. For example, pressing and holding key 201 (Fig. 3A) and subsequently pressing key 202 defines an arrow pointing to the right. Pressing and holding key 203 and subsequently pressing key 202 defines an arrow pointing to the corner in the upper right. Each arrow is optionally interpreted as corresponding to the second-group key of key arrangement 370 (Fig. 6) to which an arrow of that direction points from the center 378. Accordingly, pressing and holding key 202 and subsequently pressing key 204 before key 202 is released, refers to the key carrying the letters TUV. If processor 130 is in a letter mode, it will take as its input the letters TUV. If it is in a symbol mode it will take as its input the symbol or symbols associated with that key.
Using this correlation limits the second group of keys to only eight keys instead of 12 keys which are possible, but has the advantage of being intuitive to the user.
It may be desired to be able to enter 12 second group keys using the first group keys. In some embodiments of the invention, instead of using long presses on the first keys 201-204 to enter various symbol modes, long presses on keys 201-204 are associated with the functions of keys 305, 310, 311 and 312 (Fig. 3A), respectively, of the second key group.
In other embodiments, the six keys 201-206 (Fig. 3A) are used to generate arrows corresponding to all 12 keys of the known telephone keypad arrangement. The sequences of
keys (202,201), (204,203) and (206,205) generate a virtual left arrow which corresponds to key 304. The sequences (201,202), (203,204) and (205,206) correspond to key 306, the sequences (204, 202), (206, 204), (203,201) and (205,203) correspond to key 302 and the sequences (201,203), (203,205), (202,204) and (204,206) correspond to key 308. Sequences (201,204), (203, 206) correspond to key 309, sequences (203, 202) and (205, 204) correspond to key 303, sequences (202,203) and (204,205) correspond to key 307 and sequences (204,201) and (206,203) correspond to key 301. Sequence (201,206) corresponds to key 312, sequence (202,205) corresponds to key 310 and sequences (202,206) and (201,205) correspond to key 311. Optionally, sequences (205,201) and (206,201) which define a virtual long arrow upward correspond to key 305. The sequences (206,201) and (205,202) may be undefined or may be used for other tasks, such as entering symbol modes (instead of or in addition to long presses on the first keys), caps lock or a partial backspace which removes disambiguation signals.
The same principal of arrows defined by the order of pressing keys may be used with other arrangements of the first group keys. For example, with relation to keys 101-106 shown in Fig. 1, the key pair (104,101) optionally corresponds to key 301 and key pair (102,101) optionally corresponds to key 304. Although arrows in the directions of keys 310, 311 and 312 are not provided by this arrangement, other pairs may be used for these keys, such as (106,105) for key 311, as this is the longest arrow available, (106,103) for key 310 and (105,104) for key 312.
The above embodiments and methods may be combined with various other methods of data entry, such as any of the methods described in PCT publications WO01/131788, titled "Integrated Keypad System", WO03/007288 titled "Features to Enhance Data Entry Through a Small Data Entry Unit", WO04/095414 titled "System to Enhance Data Entry in Mobile and fixed Environment", WO05/122401 titled "System to Enhance Data Entry in Mobile and fixed Environment", WO07/114833 titled "Data Entry System", PCT application IB2007/004481, and PCT application IB2008/002263, the disclosures of all of which are incorporated herein by reference in their entirety.
As another example, when a user indicates a previously entered word, which was not completely disambiguated yet, the system may display for selection one or more words which may be used instead of the word guessed by processor 130.
Fig. 11 is a schematic illustration of a data entry device 760, in accordance with an exemplary embodiment of the invention. Device 360 includes in addition to screen 320, two touch pads 762 and 764 and two hard keys 205 and 206. Presses on touch pads 762 and 764 optionally serve as first group keys, while sweeping gestures on the pads optionally serve
instead of the second group keys. The sweeping gestures on touch pads 762 and 764 may be interpreted to have the same function or may have different functions, corresponding to different zones discussed above.
In view of touch pads 762 and 764, screen 320 need not be a touch screen and therefore may be made cheaper. In other embodiments, screen 320 is a touch sensitive screen and finger movements on screen 320 control a mouse pointer. Alternatively, mouse control is performed on one or both of touch pads 762 and 764 and sweeping gestures on screen 320 are interpreted as alternatives to second group keys.
In some embodiments of the invention, the number of keys provided included in a data entry device may be reduced by differentiating between different finger orientations when pressing keys. For example, the keys may be soft keys and in identifying pressing on the screen the area of the pressing finger is determined to identify whether the press was performed with the tip of the finger or the flat portion. Using such finger orientation identification allows, for example, utilizing touch pads 762 and 764 as single keys which are not identified by the area being pressed, but rather by one or more attributes of the pressing finger.
In some embodiments of the invention, a speech recognition system is added to the above described data entry systems or is used instead of the second group keys. For example, in order to enter a special character, the user may press (e.g. and-hold) the key corresponding to the group that includes the desired character and provide a predefined speech relating to the desired symbol such as speaking said symbol so the system recognizes said speech and selects the desired symbol among that group of symbols. Preferably, for better accuracy, symbols included in a single symbol group, do not have similar names which can be confused in speech recognition. Allowing the user to use either second group keys or speech signals, allows the user flexibility to accommodate to different environments (e.g. very noisy environments, in a meeting).
Fig. 12 is a schematic view of a notebook computer 810, in accordance with an exemplary embodiment of the invention. Notebook computer 810 comprises a keyboard 816 and a mouse pad 814. A sensor strip 812 on the front side of computer 810 identifies when the user's hands touch and/or lean on the sensor strip. In an embodiment of the invention, gestures on mouse pad 814 are related to only when the user touches sensor strip 812. This avoids cases in which inadvertent contact with mouse pad 814 interferes with the user's work.
It is noted that the first and second groups of keys may include substantially any suitable number of keys which may be hard or soft keys or combinations of hard and soft keys. The keys may be organized in various configurations and the characters and symbols may be assigned to
the keys in any suitable manner. The symbols of the system may be grouped in any number of symbol modes based of any (e.g. arbitrary) category. Optionally, the first group of keys has fewer keys than the second group, as mainly the first group of keys are intended to be used in entering text.
The term key is meant to include any device which identifies finger actuations including pressure sensors, thermal sensors, acceleration sensors, optical systems for tracking movements of the finger, finger caps and gloves with sensors. The sweeping gestures of embodiments of the invention including embodiments for dialing telephone numbers may be identified using various touch sensitive surfaces including internal or external touch screens and a mouse pad. Alternatively, sweeping gestures may be identified by an electronic stylus, acceleration sensors and/or other sensors for identifying user finger movements. The sensors may be mounted on a surface, on finger caps, on gloves and/or on any other suitable mount. The keys or touch screen may be included with processor 130 in the same housing or may be included partially or entirely in a separate unit connected through wires or wirelessly to the unit including processor 130.
According to one embodiment of the invention the sweeping gestures may be provided in the air and are detected by suitable sensors such as a camera and/or acceleration sensors.
In some embodiments of the invention, the data entry systems are adapted to provide synthesized voice feedback on the letters or symbols entered and/or the current symbol mode such that the user need not look at the screen while entering data.
While the above description relates to the Latin alphabet, the principles of the invention may be implemented on other alphabets.
The special characters on the second keypad may be assigned mainly to a same key so that the user may easily remember their location. If the second keypad is a standard telephone- type keypad said special characters may be assigned to the key to which the digit "1" is assigned.
The data entry device in accordance with any of the above described embodiments may be included in a mobile phone, a PDA, a computer or any other device. Conclusion
It will be appreciated that the above described methods may be varied in many ways, including, changing the specific elements used and their layout. It should also be appreciated that the above described description of methods and apparatus are to be interpreted as including apparatus for carrying out the methods and methods of using the apparatus. The present invention has been described using non-limiting detailed descriptions of embodiments thereof that are provided by way of example and are not intended to limit the scope of the invention.
Many specific implementation details may be used. The above embodiments may be implemented in hardware, software, firmware or combinations thereof.
It should be understood that features and/or steps described with respect to one embodiment may be used with other embodiments and that not all embodiments of the invention have all of the features and/or steps shown in a particular figure or described with respect to one of the embodiments. Variations of embodiments described will occur to persons of the art. Furthermore, the terms "comprise," "include," "have" and their conjugates, shall mean, when used in the claims, "including but not necessarily limited to."
It is noted that some of the above described embodiments may describe the best mode contemplated by the inventors and therefore may include structure, acts or details of structures and acts that may not be essential to the invention and which are described as examples. Structure and acts described herein are replaceable by equivalents which perform the same function, even if the structure or acts are different, as known in the art. Therefore, the scope of the invention is limited only by the elements and limitations as used in the claims.
Claims
1. A data entry system, comprising: a plurality of first keys; a plurality of second keys; a display; and a processor adapted to interpret a first type of user interaction with the first keys as entrance of one or more characters and to interpret a second type of interaction with the first keys as mode signals which change the meanings of at least three of the second keys.
2. A system according to claim 1, wherein the first type of user interaction comprises actuation for a short period and wherein the second type of user interaction comprises actuation for a longer period.
3. A system according to claim 1, wherein the second keys comprise soft keys.
4. A data entry system, comprising: a user input interface adapted to receive user signals in the form of directed vectors; and a processor adapted to interpret at least five different directed vectors received by the user input interface as corresponding to keys of the 12 key telephone keypad located in the direction of the vector from a start point.
5. A system according to claim 4, wherein the processor is adapted to interpret at least seven different directed vectors received by the user input interface as corresponding to keys of the 12 key telephone keypad.
6. A system according to claim 4, wherein the processor is adapted to interpret the directed vectors as corresponding to keys of the 12 key telephone keypad located in the direction of the vector from a center key of the keypad.
7. A system according to claim 4, wherein the user input interface comprises a touch screen and interprets sweeping gestures on the touch pad as vectors.
8. A system according to claim 7, wherein the input interface is adapted to interpret the direction of the sweeping of the gesture as a straight line from its start point to its ending point.
9. A system according to claim 7, wherein the input interface is adapted to interpret sweeping gestures on the screen which include curves as a plurality of separate vectors, each straight line segment corresponding separately to a key of the 12 key telephone keypad.
10. A system according to claim 4, wherein the user input interface comprises a plurality of keys and interprets pressing of key sequences as vectors in the direction from the first key in the sequence to the last key in the sequence.
11. A data entry system, comprising: a user input interface adapted to receive user signals corresponding ambiguously to letters of the alphabet and to receive a fixation signal; and a processor adapted to receive user signals corresponding ambiguously to letters for a plurality of character positions of a word and to provide guess letters for the character positions, wherein the processor is adapted to update its guesses of character positions responsive to receiving additional user signals corresponding ambiguously to letters for the same word, and wherein the processor does not change the letters of character positions for which the fixation signal was applied.
12. The system of claim 11, wherein the fixation signal is received responsive to simultaneous pressing of two keys.
13. The system of claim 11, wherein the fixation signal applies to a single character position each time it is pressed.
14. The system of claim 11, wherein the fixation signal applies to all the character positions in a current word, before a current cursor position.
15. The system of claim 11, wherein the fixation signal applies to a first ambiguous character position of the current word, regardless of a current cursor position.
16. A data entry system, comprising: a user input interface adapted to receive input signals corresponding to characters, including signals corresponding ambiguously to a plurality of characters; a screen; and a processor adapted to select for character positions for which an input signal corresponding ambiguously to a plurality of characters was received, a single character to represent the character position, and to display, on the screen, for each character position, a single character, in a manner which differentiates between character positions associated ambiguously with a plurality of characters and character positions associated with a single character.
17. The system of claim 16, wherein the processor displays characters in character positions associated ambiguously with a plurality of characters in a different color than characters in character positions associated with a single character.
18. The system of claim 16, wherein the processor displays adjacent character positions associated ambiguously with a plurality of characters, markings not displayed near character positions associated with a single character.
19. The system of claim 16, wherein the processor displays character positions associated ambiguously with a plurality of characters in a manner which associates the character position with a key of the user input interface which is used to generate the specific plurality of characters of the character position.
20. A data entry unit, comprising: a touch screen; and a processor adapted to interpret sweeping gestures on the touch screen as indicating one or more characters, according to a trajectory and starting point of the sweeping gesture, wherein the touch screen is considered to be divided into up to 10 zones each covering at least 10% of the area of the touch screen, and sweeping gestures of a specific trajectory starting anywhere in a zone are interpreted to correspond to the same one or more characters.
21. The unit of claim 20, wherein the touch screen is considered as divided into at most six zones.
22. The unit of claim 20, wherein the touch screen is considered divided into two zones.
23. The unit of claim 20, wherein the processor is adapted to interpret sweeping gestures in a first zone as matching one of a first group of directions and to interpret sweeping gestures in a second zone as matching one of a second group of directions, not the same as the first group of directions.
24. The unit of claim 23, wherein the processor is adapted to interpret sweeping gestures in a first zone as matching one of a first group of directions and to interpret sweeping gestures in a second zone as matching one of a second group of directions, wherein the first and second groups of directions do not include any common directions.
25. The unit of claim 20, wherein the processor is adapted to interpret sweeping gestures in all the zones as matching one of a predetermined group of directions common to all the zones.
26. The unit of claim 20, wherein responsive to a touch on the screen in a specific zone, the processor is adapted to display characters which may be input by sweeping gestures beginning at the touched point.
27. A data entry unit, comprising: a user input interface adapted to identify user movements; a screen; and a processor adapted to control reception of words and their display on the screen and to control a mouse pointer on the screen responsive to identified user movements when the processor is not in the middle of entering a word and to interpret identified user movements as referring to groups of one or more characters when the processor is in the middle of receiving a word.
28. The unit of claim 27, wherein the screen comprises a touch screen and the user input interface identifies the user movements on the touch screen.
29. The unit of claim 27, wherein the user input interface identifies movements of fingers in the air.
30. The unit of claim 27 wherein the processor is considered in the middle of receiving a word immediately after receiving an input signal corresponding to one or more letters and is considered not in the middle of receiving a word immediately after receiving a space signal, a return signal or a tab signal.
31. A telephone unit, comprising: a touch sensitive surface; and a controller adapted to identify sweeping gestures on the touch sensitive surface, to correlate the sweeping gestures with digits according to the direction of the gestures and to dial a telephone number form of a sequence of digits determined from sweeping gestures.
32. The telephone unit of claim 31, wherein the controller is adapted to identify the digits corresponding to sweeping gestures, without relation to their starting point on the surface.
33. The telephone unit of claim 31, wherein the controller is adapted to identify the digits corresponding to at least some of the sweeping gestures, as the digit on the key of the known 12 key telephone keypad in the direction of the sweeping gesture from the middle key corresponding to the digit 5 of the 12 key telephone keypad.
34. The telephone unit of claim 31 , wherein the controller is adapted to identify a tapping on the surface as the digit 5.
35. The telephone unit of claim 31, wherein the controller is adapted to associate the sweeping gestures with digits without relation to the length of the sweeping gestures except possibly for a single direction.
36. The telephone unit of claim 35, wherein the controller is adapted to identify a short downward sweeping gesture as the digit 8 and a longer downward sweeping gesture as the digit 0.
37. A data entry unit, comprising: a touch screen; and a processor which displays on the screen a keypad, continuously during data entry, wherein the keypad is displayed in a small form when not in use and when a key of the keypad is actuated is presented in a large form.
38. The unit of claim 37, wherein the small form is displayed at a corner of the screen and the large form is displayed in the middle of the screen.
39. A data entry unit, comprising: a touch screen; and a processor adapted to identify user tapings on the screen and to select signals to which they correspond based on the size of the tapped area on the screen and a zone in which the tapping was performed, wherein the zones used in selecting corresponding signals have at least three times the area of the thumb of an average adult.
40. The data entry unit of claim 39, wherein the zones used in selecting corresponding signals have an area of at least 10% of the touch screen.
41. The data entry unit of claim 39, wherein the processor differentiates between user tapings based on two zones: a right zone and a left zone.
42. The data entry unit of claim 39, wherein the processor differentiates between tapings by the tip of a finger and tapings by the flat area of the finger.
43. A data entry unit of a vehicle, comprising: at least one touch pad mounted on a steering wheel of the vehicle; and a processor adapted to identify user actuations with the touch pad and interpret the actuations as input characters provided by the user.
44. The data entry unit of claim 43, wherein the at least one touch pad comprises a first touch pad on the right side of the steering wheel and a second touch pad on the left side of the steering wheel.
45. The data entry unit of claim 43, wherein the at least one touch pad is included in a unit including also hard keys.
46. The data entry unit of claim 43, comprising a speech unit adapted to provide feedback to the user on characters input to the processor.
47. The data entry unit of claim 43, wherein the processor is adapted to identify taps of the user on different areas of the touch pad as different keys.
48. The data entry unit of claim 43, wherein the processor is adapted to identify sweeping gestures on the touch pad.
49. A data entry unit, comprising: a plurality of first keys including fewer than 10 keys, which together are associated with all the letters of the alphabet; a touch screen; and a processor adapted to associate character positions of input words with groups of characters responsive to first key actuations and to provide on the touch screen soft keys for each of the letters associated with the first character position of the current word which is associated ambiguously with a plurality of characters, regardless of which first key was pressed most recently.
50. The data entry unit of claim 49, wherein responsive to actuation of a soft key to associate the first character position of the current word which is associated ambiguously with a plurality of characters with the character of the actuated soft key and to automatically provide soft keys for the subsequent first character position of the current word which is associated ambiguously with a plurality of characters.
51. The data entry unit of claim 49, wherein a plurality of the first keys are associated with at least one non-alphanumeric symbol.
52. The data entry unit of claim 49, wherein each of two or more of the first keys is associated with a plurality of non-alphanumeric symbols.
53. A method of data entry, comprising: providing a device having first group keys and second group keys; receiving by the device a first type of interaction with a first group key; interpreting the first type of interaction with the first group key as a selection of one or more characters associated with the first group key; receiving by the device a second type of interaction with the first group key; and interpreting the second type of interaction with the first group key as a mode change of the interpretation of interactions with the second group keys.
Applications Claiming Priority (30)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13610408P | 2008-08-12 | 2008-08-12 | |
| US61/136,104 | 2008-08-12 | ||
| IL19350608 | 2008-08-17 | ||
| IL193506 | 2008-08-17 | ||
| IL19364408 | 2008-08-24 | ||
| IL193644 | 2008-08-24 | ||
| IL19374508 | 2008-08-28 | ||
| IL193745 | 2008-08-28 | ||
| IL194002 | 2008-09-09 | ||
| IL19400208 | 2008-09-09 | ||
| IL19470808 | 2008-10-12 | ||
| IL194708 | 2008-10-12 | ||
| IL19473108 | 2008-10-22 | ||
| IL194731 | 2008-10-22 | ||
| IL196898 | 2009-02-04 | ||
| IL196898A IL196898A0 (en) | 2009-02-04 | 2009-02-04 | Improved data entry systems |
| IL196933 | 2009-02-05 | ||
| IL196933A IL196933A0 (en) | 2009-02-05 | 2009-02-05 | Improved data entry systems |
| IL196969A IL196969A0 (en) | 2009-02-09 | 2009-02-09 | Improved data entry systems |
| IL196969 | 2009-02-09 | ||
| IL197861A IL197861A0 (en) | 2009-03-26 | 2009-03-26 | Improved data entry systems |
| IL197861 | 2009-03-26 | ||
| IL198068A IL198068A0 (en) | 2009-04-07 | 2009-04-07 | Improved data entry systems |
| IL198068 | 2009-04-07 | ||
| IL199258 | 2009-06-09 | ||
| IL19925809 | 2009-06-09 | ||
| IL199466 | 2009-06-21 | ||
| IL19946609 | 2009-06-21 | ||
| IL199947 | 2009-07-19 | ||
| IL199947A IL199947A0 (en) | 2009-07-19 | 2009-07-19 | Improved data entry systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2010018579A2 true WO2010018579A2 (en) | 2010-02-18 |
| WO2010018579A3 WO2010018579A3 (en) | 2010-05-20 |
Family
ID=41669413
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL2009/000794 Ceased WO2010018579A2 (en) | 2008-08-12 | 2009-08-12 | Improved data entry system |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2010018579A2 (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011130848A1 (en) * | 2010-04-20 | 2011-10-27 | Research In Motion Limited | Touch-sensitive display with variable repeat rate |
| EP2469384A1 (en) * | 2010-12-23 | 2012-06-27 | Research In Motion Limited | Portable electronic device and method of controlling same |
| RU2472207C1 (en) * | 2011-08-04 | 2013-01-10 | Павел Алексеевич Манахов | Method of inputting data using touch-sensitive surface, for example, touchpad or touch screen |
| WO2013036437A1 (en) * | 2011-09-08 | 2013-03-14 | Google Inc. | User gestures indicating rates of execution of functions |
| EP2570892A1 (en) * | 2011-09-15 | 2013-03-20 | Research In Motion Limited | Electronic device and method of character entry |
| US8547354B2 (en) | 2010-11-05 | 2013-10-01 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8587547B2 (en) | 2010-11-05 | 2013-11-19 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8621380B2 (en) | 2010-01-06 | 2013-12-31 | Apple Inc. | Apparatus and method for conditionally enabling or disabling soft buttons |
| EP2541385A3 (en) * | 2011-06-29 | 2014-02-19 | Sony Corporation | Information processing apparatus, information processing method, program and remote control system |
| WO2014070562A1 (en) * | 2012-10-30 | 2014-05-08 | Microsoft Corporation | Keyboard with gesture-redundant keys removed |
| US8730188B2 (en) | 2010-12-23 | 2014-05-20 | Blackberry Limited | Gesture input on a portable electronic device and method of controlling the same |
| US8782513B2 (en) | 2011-01-24 | 2014-07-15 | Apple Inc. | Device, method, and graphical user interface for navigating through an electronic document |
| US8842082B2 (en) | 2011-01-24 | 2014-09-23 | Apple Inc. | Device, method, and graphical user interface for navigating and annotating an electronic document |
| EP2798439A4 (en) * | 2011-12-29 | 2015-07-15 | Intel Corp | Methods and systems for typing |
| US9092132B2 (en) | 2011-01-24 | 2015-07-28 | Apple Inc. | Device, method, and graphical user interface with a dynamic gesture disambiguation threshold |
| US9342173B2 (en) | 2011-09-16 | 2016-05-17 | Zte Corporation | Method and device for implementing click and location operations on touch screen |
| US9940016B2 (en) | 2014-09-13 | 2018-04-10 | Microsoft Technology Licensing, Llc | Disambiguation of keyboard input |
| CN113272770A (en) * | 2018-11-13 | 2021-08-17 | 普利斯梅德实验室有限公司 | Method and apparatus for multi-factor authentication on capacitive area sensors |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7040822B2 (en) * | 2003-06-04 | 2006-05-09 | Hellermanntyton Corporation | Portable printing system |
| US20060132447A1 (en) * | 2004-12-16 | 2006-06-22 | Conrad Richard H | Method and apparatus for automatically transforming functions of computer keyboard keys and pointing devices by detection of hand location |
-
2009
- 2009-08-12 WO PCT/IL2009/000794 patent/WO2010018579A2/en not_active Ceased
Cited By (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9442654B2 (en) | 2010-01-06 | 2016-09-13 | Apple Inc. | Apparatus and method for conditionally enabling or disabling soft buttons |
| US8621380B2 (en) | 2010-01-06 | 2013-12-31 | Apple Inc. | Apparatus and method for conditionally enabling or disabling soft buttons |
| WO2011130848A1 (en) * | 2010-04-20 | 2011-10-27 | Research In Motion Limited | Touch-sensitive display with variable repeat rate |
| US11249636B2 (en) | 2010-04-20 | 2022-02-15 | Blackberry Limited | Portable electronic device having touch-sensitive display with variable repeat rate |
| GB2492297A (en) * | 2010-04-20 | 2012-12-26 | Research In Motion Ltd | Touch-sensitive display with variable repeat rate |
| US9285988B2 (en) | 2010-04-20 | 2016-03-15 | Blackberry Limited | Portable electronic device having touch-sensitive display with variable repeat rate |
| GB2492297B (en) * | 2010-04-20 | 2013-07-24 | Research In Motion Ltd | Portable electronic device having touch-sensitive display with variable repeat rate |
| US8593422B2 (en) | 2010-11-05 | 2013-11-26 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8754860B2 (en) | 2010-11-05 | 2014-06-17 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8587540B2 (en) | 2010-11-05 | 2013-11-19 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8547354B2 (en) | 2010-11-05 | 2013-10-01 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US9146673B2 (en) | 2010-11-05 | 2015-09-29 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8648823B2 (en) | 2010-11-05 | 2014-02-11 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US9141285B2 (en) | 2010-11-05 | 2015-09-22 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8659562B2 (en) | 2010-11-05 | 2014-02-25 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US9128614B2 (en) | 2010-11-05 | 2015-09-08 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8587547B2 (en) | 2010-11-05 | 2013-11-19 | Apple Inc. | Device, method, and graphical user interface for manipulating soft keyboards |
| US8730188B2 (en) | 2010-12-23 | 2014-05-20 | Blackberry Limited | Gesture input on a portable electronic device and method of controlling the same |
| EP2469384A1 (en) * | 2010-12-23 | 2012-06-27 | Research In Motion Limited | Portable electronic device and method of controlling same |
| US9436381B2 (en) | 2011-01-24 | 2016-09-06 | Apple Inc. | Device, method, and graphical user interface for navigating and annotating an electronic document |
| US8842082B2 (en) | 2011-01-24 | 2014-09-23 | Apple Inc. | Device, method, and graphical user interface for navigating and annotating an electronic document |
| US9092132B2 (en) | 2011-01-24 | 2015-07-28 | Apple Inc. | Device, method, and graphical user interface with a dynamic gesture disambiguation threshold |
| US10365819B2 (en) | 2011-01-24 | 2019-07-30 | Apple Inc. | Device, method, and graphical user interface for displaying a character input user interface |
| US10042549B2 (en) | 2011-01-24 | 2018-08-07 | Apple Inc. | Device, method, and graphical user interface with a dynamic gesture disambiguation threshold |
| US9671825B2 (en) | 2011-01-24 | 2017-06-06 | Apple Inc. | Device, method, and graphical user interface for navigating through an electronic document |
| US9552015B2 (en) | 2011-01-24 | 2017-01-24 | Apple Inc. | Device, method, and graphical user interface for navigating through an electronic document |
| US9250798B2 (en) | 2011-01-24 | 2016-02-02 | Apple Inc. | Device, method, and graphical user interface with a dynamic gesture disambiguation threshold |
| US9442516B2 (en) | 2011-01-24 | 2016-09-13 | Apple Inc. | Device, method, and graphical user interface for navigating through an electronic document |
| US8782513B2 (en) | 2011-01-24 | 2014-07-15 | Apple Inc. | Device, method, and graphical user interface for navigating through an electronic document |
| EP2541385A3 (en) * | 2011-06-29 | 2014-02-19 | Sony Corporation | Information processing apparatus, information processing method, program and remote control system |
| RU2472207C1 (en) * | 2011-08-04 | 2013-01-10 | Павел Алексеевич Манахов | Method of inputting data using touch-sensitive surface, for example, touchpad or touch screen |
| WO2013036437A1 (en) * | 2011-09-08 | 2013-03-14 | Google Inc. | User gestures indicating rates of execution of functions |
| EP2570892A1 (en) * | 2011-09-15 | 2013-03-20 | Research In Motion Limited | Electronic device and method of character entry |
| US9342173B2 (en) | 2011-09-16 | 2016-05-17 | Zte Corporation | Method and device for implementing click and location operations on touch screen |
| EP2798439A4 (en) * | 2011-12-29 | 2015-07-15 | Intel Corp | Methods and systems for typing |
| WO2014070562A1 (en) * | 2012-10-30 | 2014-05-08 | Microsoft Corporation | Keyboard with gesture-redundant keys removed |
| CN104823148A (en) * | 2012-10-30 | 2015-08-05 | 微软技术许可有限责任公司 | Keyboard with gesture-redundant keys removed |
| US9940016B2 (en) | 2014-09-13 | 2018-04-10 | Microsoft Technology Licensing, Llc | Disambiguation of keyboard input |
| US10983694B2 (en) | 2014-09-13 | 2021-04-20 | Microsoft Technology Licensing, Llc | Disambiguation of keyboard input |
| CN113272770A (en) * | 2018-11-13 | 2021-08-17 | 普利斯梅德实验室有限公司 | Method and apparatus for multi-factor authentication on capacitive area sensors |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010018579A3 (en) | 2010-05-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2010018579A2 (en) | Improved data entry system | |
| US9304602B2 (en) | System for capturing event provided from edge of touch screen | |
| US20110141027A1 (en) | Data entry system | |
| KR101636705B1 (en) | Method and apparatus for inputting letter in portable terminal having a touch screen | |
| US7170496B2 (en) | Zero-front-footprint compact input system | |
| KR100954594B1 (en) | Virtual keyboard input system using pointing device used in digital equipment | |
| EP2209646B1 (en) | Wireless handheld device able to accept text input and methods for inputting text on a wireless handheld device | |
| US20110291940A1 (en) | Data entry system | |
| US9104247B2 (en) | Virtual keypad input device | |
| US8797192B2 (en) | Virtual keypad input device | |
| US20170228123A1 (en) | Features ofa data entry system | |
| JP2008521112A (en) | Method and device for controlling and entering data | |
| JP2004355606A (en) | Information processing apparatus, information processing method, and program | |
| EP3472689B1 (en) | Accommodative user interface for handheld electronic devices | |
| CN102741784A (en) | Features of a data entry system | |
| WO2012015333A9 (en) | Device for typing and inputting symbols into portable communication means | |
| CN101501756A (en) | Hand-held thumb touch typable ASCII/Unicode keypad for a remote, mobile telephone or a PDA | |
| KR20100069089A (en) | Apparatus and method for inputting letters in device with touch screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09806530 Country of ref document: EP Kind code of ref document: A2 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 09806530 Country of ref document: EP Kind code of ref document: A2 |