[go: up one dir, main page]

WO2006030002A1 - Mobile device with adaptive user interface - Google Patents

Mobile device with adaptive user interface Download PDF

Info

Publication number
WO2006030002A1
WO2006030002A1 PCT/EP2005/054528 EP2005054528W WO2006030002A1 WO 2006030002 A1 WO2006030002 A1 WO 2006030002A1 EP 2005054528 W EP2005054528 W EP 2005054528W WO 2006030002 A1 WO2006030002 A1 WO 2006030002A1
Authority
WO
WIPO (PCT)
Prior art keywords
keys
user interface
control
control unit
portable device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2005/054528
Other languages
French (fr)
Inventor
Richard Nilsson
Johan SVENÉR
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Mobile Communications AB
Original Assignee
Sony Ericsson Mobile Communications AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP04106105A external-priority patent/EP1635544A1/en
Application filed by Sony Ericsson Mobile Communications AB filed Critical Sony Ericsson Mobile Communications AB
Publication of WO2006030002A1 publication Critical patent/WO2006030002A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/0206—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
    • H04M1/0208—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings characterized by the relative motions of the body parts
    • H04M1/0225—Rotatable telephones, i.e. the body parts pivoting to an open position around an axis perpendicular to the plane they define in closed position
    • H04M1/0231—Including a rotatable keypad body part
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/0206—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
    • H04M1/0208—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings characterized by the relative motions of the body parts
    • H04M1/0225—Rotatable telephones, i.e. the body parts pivoting to an open position around an axis perpendicular to the plane they define in closed position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/0206—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
    • H04M1/0241—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings using relative motion of the body parts to change the operational status of the telephone set, e.g. switching on/off, answering incoming call
    • H04M1/0243—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings using relative motion of the body parts to change the operational status of the telephone set, e.g. switching on/off, answering incoming call using the relative angle between housings
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/161—Indexing scheme relating to constructional details of the monitor
    • G06F2200/1614—Image rotation following screen orientation, e.g. switching from landscape to portrait mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera

Definitions

  • the present invention relates to a device with an adaptive user interface, and more particularly a combined mobile device including e.g. a telephone, a digital camera, and a handheld portable game device having a user interface with display and keys, wherein the function and arrangement of the display and the keys depends on the operation mode of the telephone.
  • a combined mobile device including e.g. a telephone, a digital camera, and a handheld portable game device having a user interface with display and keys, wherein the function and arrangement of the display and the keys depends on the operation mode of the telephone.
  • a mobile telephone which may be held in two different positions. What is shown on the display and the arrangement of the keys of the keypad depend on the current position of the device, the current use of the device or the setting selected by the user. The arrangement of the keys may be dependent of a position sensor detecting the force of gravity.
  • the device has a small display in landscape mode when held upright making it unsuitable for use as a camera or game device.
  • the device is not of foldable type having two parts that may be arranged at an angle relative to each other.
  • MMI MultiMedia Interface
  • the MMI paradigm When combining different product types into one device, the MMI paradigm typically will be a compromise between the traditional MMI paradigms of the integrated products. From a user experience perspective, the problem is how to get the industry standard ways of user interactions for the different integrated products. In other words, the problem is to combine different device categories such as a mobile phone, a digital camera, and a handheld portable game device into one product without compromising the traditional UI (User Interface) orientation and key placements for the individual device categories.
  • UI User Interface
  • the present invention solves this problem by providing an automatically adapting user interface.
  • This enables the MMI to have e.g. three different orientations.
  • the input keys are not dedicated to any of the modes; instead they are generally reused and assigned other/new meanings in combination with the rotation of the rest of the graphical UI.
  • the present invention provides a portable device combining different device categories with different operation modes each having different preferred user interface modes, comprising: a user interface comprising a keypad with a number of keys and a display.
  • a control unit arranged to control the user interface in dependence of a selected operation mode of the device.
  • the device comprises: an upper part and a lower part that can be folded together into a closed state and unfolded into opened states in which the upper part and the lower part are arranged at an angle relative to each other, the device being operable in both the closed and opened states; wherein said user interface comprises a keypad with a number of keys provided on one of the two parts and a display provided on the other of the two parts, possibly together with further keys, and said control unit is further arranged to control the user interface in dependence of the relative angle between the two parts.
  • control unit is further arranged to control the user interface in dependence of predetermined settings selected by a user.
  • the predetermined settings may include a general right-handed mode and a general left-handed mode.
  • control unit is arranged to control the orientation of an image object shown on the display.
  • control unit is arranged to control the assignment of key functions.
  • the control unit may be arranged to control illumination of keys.
  • the device may be a combined mobile phone, digital camera, and portable game device. Brief description of the drawings
  • Fig. IA is a schematic view of a mobile telephone of the jack knife type in a closed state rotated to be in used in a camera mode
  • Fig. IB is a schematic view of the telephone in fig. IA opened 180° held upright to be in used in a phone mode;
  • Fig. 1C is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a game mode;
  • Fig. 2 A is a schematic view of the telephone in fig. IA opened 90° held with the upper part upright and the lower part to the left;
  • Fig. 2B is a schematic view of the telephone in fig. IA opened 90° held with the upper part upright and the lower part to the right;
  • Fig. 2C is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a game mode for a left-handed user
  • Fig. 2D is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a game mode for a right-handed user;
  • Fig. 3 A is a schematic view of the telephone in fig. IA opened 90° held with the upper part horizontal and the lower part vertical to the right;
  • Fig. 3B is a schematic view of the telephone in fig. IA opened 90° held with the upper part horizontal and the lower part vertical to the left;
  • Fig. 3 C is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a camera mode for a left-handed user;
  • Fig. 3D is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a camera mode for a right-handed user.
  • the invention will be described with respect to a device such as a mobile phone, a digital camera, and a portable game device combined into one product, that does not compromise the traditional UI orientation and key placements of the individual device categories.
  • a typical mobile telephone 1 of the jack knife type is shown in figs. IA-C.
  • the device has two parts, an upper part 2 and a lower part 3 as seen by a user.
  • the upper part 2 of the device includes a display 4 and a navigation device such as joystick 5 for manoeuvring with the thumb, and/or direction keys 9.
  • the upper part 2 suitably also carries so-called A, B, C, D keys 6A-D and side keys 7 as well as volume keys 11.
  • the side keys 7 may alternatively be arranged on the lower part 3.
  • the lower part 3 which may be rotated at an angle relative to the upper part 2, includes a conventional keypad 8 with a number of alphanumeric keys, conventionally 0(ABC) -9(WXYZ), * and #.
  • the keypad 8 is used both for writing numbers and letters A-Z as well as other symbols.
  • the upper part 2 and the lower part 3 can be folded together into a closed state as shown in figures IA and 1C, and opened into states in which the two parts are arranged at an angle relative to each other. As shown in figure IB, the angle may be 180°.
  • the device is operable in both the closed and opened states. In this specification the term "closed" refers to the folded state of the device and not whether the device 1 is switched on or off.
  • the device 1 may be used in a phone mode as shown in figure IB. Then the device is opened 180° such that the device has the joystick 5 and direction keys 9 as well as the keypad 8 and other input keys in majority below the screen and can be operated with one hand only, the right or the left hand.
  • the device 1 may also be closed in the phone mode, e.g. when answering and terminating a call with the Yes and No keys (for instance the lower C and D keys 6C and 6D) provided on the upper part.
  • the device 1 may be used in a camera mode as shown in figure IA. Then the device is kept closed and only turned so that it resembles a digital camera. According to the industry standard a digital camera has the UI direction keys 9 to the right side of the screen, as it shall be possible to be used in combination with the shutter button with the same hand - the right hand for a right-handed user.
  • the device 1 may be used in a game mode as shown in figure 1C. Then the device is kept closed and only turned so that it resembles a game device.
  • a portable game device as well as regular game pads, has the directional keys 9, such as a joystick 5, placed to be used with the left hand (left thumb) and other game keys, such as the keys 6A and 6C, are placed so they are used with the right hand (right thumb) for a right-handed user - a two hand usage.
  • the display 4 is rotated in two different ways to fit the MMI orientation that suites the application context at hand.
  • the MMI is controlled so that it is always best adapted for the current situation.
  • the user may adjust the basic settings to a right- handed or left-handed preferred operation. This is normally done once only when setting the personal preferences of the device.
  • an operation mode such as phone, camera or gaming mode.
  • he also chooses to open the device a specific angle or to keep it closed.
  • the device adapts the orientation of the image and texts shown on the display 4, the assignment of functions to the various keys including the joystick 5, the keypad 8, the direction keys 9 and the keypad 8 with the numbers 0 -9, * and #, and other symbols.
  • the relative angle between the upper part 2 and the lower part 3 can be detected in various ways.
  • Angle detection means including for instance Hall- generators and magnets, mechanical interacting fingers and cam surfaces, or a rotary potentiometer with an angle-dependent impedance can be arranged in the rotary connection between the upper part 2 and lower part 3 to detect in principle any angle between 0° and 360°.
  • the angle detection means should be capable of detecting at least the four main positions closed, opened 90°, 180°, 270° (or 90° in the other direction).
  • Mechanical click stops are suitably arranged at these positions to assist the user to maintain the device in the currently desired position. The exact position should not be critical for the operation of the device. Suitable angle intervals can be defined around the four main positions.
  • Figs. 2 A to 3D illustrate alternative ways of using the device.
  • Figs. 2A to 2D illustrate the game mode. If the user is left-handed he can adjust the settings of the device to a left-handed arrangement. In this case, the user would prefer to play games with the device opened with the upper part 2 upright and the lower part 3 horizontal to the left as shown in fig. 2A. The lower part 3 is rotated 90 degrees relative to the upper part 2. The user selects the game mode by selecting an operation mode in a menu. When the device is opened and a game selected, the device automatically arranges the keys of the keypad 8 to a suitable arrangement with respect to the selected game. For instance some keys marked with arrows in fig 2A could be assigned the function of direction keys as a complement to the ordinary direction keys 9 and one key marked with c could be used as a cancel key.
  • an arrow key is dependent of the relative angle between the parts so that direction of the arrow on the key corresponds to the direction in the display 4. If some keys are used more often than others, they can be illuminated or highlighted by means of a controlled lighting arrangement, such as individual light emitting diodes at each key. Also, the image in the display 4 would be shown in the portrait mode. If the device is used by a right-handed user, the device is set in right-hand mode and the user would probably prefer to open the device as shown in fig. 2B. In this case the lower part is rotated 90° in the other direction corresponding to a relative angel of 270° with the upper part 2 upright and the lower part 3 horizontal to the right. If the game is the same one as in fig.
  • the arrangement of the keys would be set automatically to a corresponding arrangement.
  • the functions of the keys would reassigned so that the top left key c of fig. 2 A would have the same function as the top left key c of fig. 2B. It is of course appreciated that physically this is not the same key, but the two keys of figs. 2 A and 2B have been assigned the same function by means of logic included in a control unit of the device. The same reassignment is applied for the direction keys of the keypad 8.
  • Some games do not need any keys besides the joystick 5 or similar keys arranged on the upper part 3.
  • the device is kept closed while the user is playing the game. If the user is left-handed he can set the device so that he can play the game with the device held as shown in fig. 2C. I.e. he is operating the joystick 5 with the right hand and the keys 6A, 6B with the left hand, and the image shown on the display 4 has the correct orientation. This mode is dependent of the selection of the particular game.
  • Fig. 3A illustrates the open state with the device in camera mode (video mode or still picture mode as the case may be) in the left-handed mode.
  • the upper part is horizontal since the basic landscape orientation is preferred in a camera, and the lower part is vertical to the right.
  • character and symbol information 10 and other image objects inserted in the display such as shutter speed settings, zoom operation etc. will be shown with the right side up in dependence of the user settings. The character and symbol information will not change if the user temporarily turns the camera to take a picture in the upright portrait orientation.
  • the shutter control is suitably assigned to the upper side key 7.
  • Zoom functions may be assigned to the joystick 5 and some keys marked with + and - of the keypad 8, or dedicated +/- keys, for instance the volume keys 11.
  • Fig 3C illustrates the closed state with the device in the camera mode in the left-handed mode when the user selects no to use the lower part of the device.
  • Figs. 3B and 3D illustrate the preferred right-hand user modes in which the functions of the keys have been reassigned with respect to the left-hand versions.
  • the upper side key 7 for the shutter function and the + and - keys are not the same physical keys as in the left-handed mode in fig. 3 A.
  • the inserted character and symbol information has changed 10 with respect to the physical display 4 so that it will not be shown upside down. It is realized that many left-handed users would still prefer the right-handed modes, because they are already used to them. The invention just gives the user the option.
  • buttons and keys used for the specific application may be highlighted for illumination guidance.
  • the highlight function is also made dependent of the user settings to the right-hand or left-hand mode and the specific angle between the two parts of the device as well as on the operation mode.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephone Set Structure (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

The invention relates to a device (1) combining different device categories with different operation modes each having different preferred user interface modes comprising: a user interface comprising a keypad (8) with a number of keys and a display (4). In accordance with the invention, a control unit is arranged to control the user interface in dependence of a selected operation mode of the device such that different device categories are combined without compromising the traditional UI orientation and key placements for the individual device categories .

Description

MOBILE DEVICE WITH ADAPTIVE USER INTERFACE
Field of the invention
The present invention relates to a device with an adaptive user interface, and more particularly a combined mobile device including e.g. a telephone, a digital camera, and a handheld portable game device having a user interface with display and keys, wherein the function and arrangement of the display and the keys depends on the operation mode of the telephone.
State of the art
From document WO 00/79772 is known a mobile telephone which may be held in two different positions. What is shown on the display and the arrangement of the keys of the keypad depend on the current position of the device, the current use of the device or the setting selected by the user. The arrangement of the keys may be dependent of a position sensor detecting the force of gravity. The device has a small display in landscape mode when held upright making it unsuitable for use as a camera or game device. The device is not of foldable type having two parts that may be arranged at an angle relative to each other.
There are some mobile phones on the market that have combined two usage modes; their MMI (MultiMedia Interface) display may be rotated between an upright "portrait" mode and a horizontal "landscape" mode. The first is typically used when using it as a phone and the latter is e.g. used when reading/writing e- mails or during browsing.
When combining different product types into one device, the MMI paradigm typically will be a compromise between the traditional MMI paradigms of the integrated products. From a user experience perspective, the problem is how to get the industry standard ways of user interactions for the different integrated products. In other words, the problem is to combine different device categories such as a mobile phone, a digital camera, and a handheld portable game device into one product without compromising the traditional UI (User Interface) orientation and key placements for the individual device categories.
Summary of the invention
The present invention solves this problem by providing an automatically adapting user interface. This enables the MMI to have e.g. three different orientations. The input keys are not dedicated to any of the modes; instead they are generally reused and assigned other/new meanings in combination with the rotation of the rest of the graphical UI.
The present invention provides a portable device combining different device categories with different operation modes each having different preferred user interface modes, comprising: a user interface comprising a keypad with a number of keys and a display.
In accordance with the invention, a control unit arranged to control the user interface in dependence of a selected operation mode of the device.
In one embodiment the device comprises: an upper part and a lower part that can be folded together into a closed state and unfolded into opened states in which the upper part and the lower part are arranged at an angle relative to each other, the device being operable in both the closed and opened states; wherein said user interface comprises a keypad with a number of keys provided on one of the two parts and a display provided on the other of the two parts, possibly together with further keys, and said control unit is further arranged to control the user interface in dependence of the relative angle between the two parts.
Preferably, the control unit is further arranged to control the user interface in dependence of predetermined settings selected by a user.
The predetermined settings may include a general right-handed mode and a general left-handed mode.
Preferably, the control unit is arranged to control the orientation of an image object shown on the display. Preferably, the control unit is arranged to control the assignment of key functions.
The control unit may be arranged to control illumination of keys.
The device may be a combined mobile phone, digital camera, and portable game device. Brief description of the drawings
The invention will be described in detail below with reference to the accompanying drawings, in which:
Fig. IA is a schematic view of a mobile telephone of the jack knife type in a closed state rotated to be in used in a camera mode; Fig. IB is a schematic view of the telephone in fig. IA opened 180° held upright to be in used in a phone mode;
Fig. 1C is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a game mode;
Fig. 2 A is a schematic view of the telephone in fig. IA opened 90° held with the upper part upright and the lower part to the left;
Fig. 2B is a schematic view of the telephone in fig. IA opened 90° held with the upper part upright and the lower part to the right;
Fig. 2C is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a game mode for a left-handed user; Fig. 2D is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a game mode for a right-handed user;
Fig. 3 A is a schematic view of the telephone in fig. IA opened 90° held with the upper part horizontal and the lower part vertical to the right; Fig. 3B is a schematic view of the telephone in fig. IA opened 90° held with the upper part horizontal and the lower part vertical to the left;
Fig. 3 C is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a camera mode for a left-handed user;
Fig. 3D is a schematic view of the telephone in fig. IA in a closed state rotated to be in used in a camera mode for a right-handed user.
Detailed description of preferred embodiments
The invention will be described with respect to a device such as a mobile phone, a digital camera, and a portable game device combined into one product, that does not compromise the traditional UI orientation and key placements of the individual device categories.
The invention is described with reference to a mobile telephone of the jack knife type, but is also applicable to devices of other types with or without movable parts. A typical mobile telephone 1 of the jack knife type is shown in figs. IA-C. The device has two parts, an upper part 2 and a lower part 3 as seen by a user. The upper part 2 of the device includes a display 4 and a navigation device such as joystick 5 for manoeuvring with the thumb, and/or direction keys 9. The upper part 2 suitably also carries so-called A, B, C, D keys 6A-D and side keys 7 as well as volume keys 11. The side keys 7 may alternatively be arranged on the lower part 3. The lower part 3, which may be rotated at an angle relative to the upper part 2, includes a conventional keypad 8 with a number of alphanumeric keys, conventionally 0(ABC) -9(WXYZ), * and #. The keypad 8 is used both for writing numbers and letters A-Z as well as other symbols. The upper part 2 and the lower part 3 can be folded together into a closed state as shown in figures IA and 1C, and opened into states in which the two parts are arranged at an angle relative to each other. As shown in figure IB, the angle may be 180°. The device is operable in both the closed and opened states. In this specification the term "closed" refers to the folded state of the device and not whether the device 1 is switched on or off.
The device 1 may be used in a phone mode as shown in figure IB. Then the device is opened 180° such that the device has the joystick 5 and direction keys 9 as well as the keypad 8 and other input keys in majority below the screen and can be operated with one hand only, the right or the left hand. The device 1 may also be closed in the phone mode, e.g. when answering and terminating a call with the Yes and No keys (for instance the lower C and D keys 6C and 6D) provided on the upper part.
The device 1 may be used in a camera mode as shown in figure IA. Then the device is kept closed and only turned so that it resembles a digital camera. According to the industry standard a digital camera has the UI direction keys 9 to the right side of the screen, as it shall be possible to be used in combination with the shutter button with the same hand - the right hand for a right-handed user.
The device 1 may be used in a game mode as shown in figure 1C. Then the device is kept closed and only turned so that it resembles a game device. A portable game device, as well as regular game pads, has the directional keys 9, such as a joystick 5, placed to be used with the left hand (left thumb) and other game keys, such as the keys 6A and 6C, are placed so they are used with the right hand (right thumb) for a right-handed user - a two hand usage.
To support the different MMI modes described above, and to reuse the keys, the display 4 is rotated in two different ways to fit the MMI orientation that suites the application context at hand.
In the device of the invention, the MMI is controlled so that it is always best adapted for the current situation. The user may adjust the basic settings to a right- handed or left-handed preferred operation. This is normally done once only when setting the personal preferences of the device. When the user wants to use the device he selects an operation mode such as phone, camera or gaming mode. In this connection he also chooses to open the device a specific angle or to keep it closed. Then the device adapts the orientation of the image and texts shown on the display 4, the assignment of functions to the various keys including the joystick 5, the keypad 8, the direction keys 9 and the keypad 8 with the numbers 0 -9, * and #, and other symbols.
The relative angle between the upper part 2 and the lower part 3 can be detected in various ways. Angle detection means including for instance Hall- generators and magnets, mechanical interacting fingers and cam surfaces, or a rotary potentiometer with an angle-dependent impedance can be arranged in the rotary connection between the upper part 2 and lower part 3 to detect in principle any angle between 0° and 360°. The angle detection means should be capable of detecting at least the four main positions closed, opened 90°, 180°, 270° (or 90° in the other direction). Mechanical click stops are suitably arranged at these positions to assist the user to maintain the device in the currently desired position. The exact position should not be critical for the operation of the device. Suitable angle intervals can be defined around the four main positions.
Figs. 2 A to 3D illustrate alternative ways of using the device.
Figs. 2A to 2D illustrate the game mode. If the user is left-handed he can adjust the settings of the device to a left-handed arrangement. In this case, the user would prefer to play games with the device opened with the upper part 2 upright and the lower part 3 horizontal to the left as shown in fig. 2A. The lower part 3 is rotated 90 degrees relative to the upper part 2. The user selects the game mode by selecting an operation mode in a menu. When the device is opened and a game selected, the device automatically arranges the keys of the keypad 8 to a suitable arrangement with respect to the selected game. For instance some keys marked with arrows in fig 2A could be assigned the function of direction keys as a complement to the ordinary direction keys 9 and one key marked with c could be used as a cancel key. The function of an arrow key is dependent of the relative angle between the parts so that direction of the arrow on the key corresponds to the direction in the display 4. If some keys are used more often than others, they can be illuminated or highlighted by means of a controlled lighting arrangement, such as individual light emitting diodes at each key. Also, the image in the display 4 would be shown in the portrait mode. If the device is used by a right-handed user, the device is set in right-hand mode and the user would probably prefer to open the device as shown in fig. 2B. In this case the lower part is rotated 90° in the other direction corresponding to a relative angel of 270° with the upper part 2 upright and the lower part 3 horizontal to the right. If the game is the same one as in fig. 2 A, the arrangement of the keys would be set automatically to a corresponding arrangement. In other words, the functions of the keys would reassigned so that the top left key c of fig. 2 A would have the same function as the top left key c of fig. 2B. It is of course appreciated that physically this is not the same key, but the two keys of figs. 2 A and 2B have been assigned the same function by means of logic included in a control unit of the device. The same reassignment is applied for the direction keys of the keypad 8.
Some games do not need any keys besides the joystick 5 or similar keys arranged on the upper part 3. In this case, the device is kept closed while the user is playing the game. If the user is left-handed he can set the device so that he can play the game with the device held as shown in fig. 2C. I.e. he is operating the joystick 5 with the right hand and the keys 6A, 6B with the left hand, and the image shown on the display 4 has the correct orientation. This mode is dependent of the selection of the particular game.
If the user is right-handed, he would like to hold the device as shown in fig. 2D (and 1C) by setting the device in the right-handed mode. All the keys would be reassigned and the display 4 turned the right way automatically so that the position shown in fig. 2D would be correct and operation of the direction keys 9 would result in the correct functions relative to the displayed image.
Similarly figs. 3A to 3D illustrate the camera mode. Fig. 3A illustrates the open state with the device in camera mode (video mode or still picture mode as the case may be) in the left-handed mode. The upper part is horizontal since the basic landscape orientation is preferred in a camera, and the lower part is vertical to the right. Of course, in the camera mode the picture in the display will follow what is seen through the lens of the camera. However, character and symbol information 10 and other image objects inserted in the display such as shutter speed settings, zoom operation etc. will be shown with the right side up in dependence of the user settings. The character and symbol information will not change if the user temporarily turns the camera to take a picture in the upright portrait orientation. The shutter control is suitably assigned to the upper side key 7. Zoom functions may be assigned to the joystick 5 and some keys marked with + and - of the keypad 8, or dedicated +/- keys, for instance the volume keys 11.
Fig 3C illustrates the closed state with the device in the camera mode in the left-handed mode when the user selects no to use the lower part of the device.
Figs. 3B and 3D (and IA) illustrate the preferred right-hand user modes in which the functions of the keys have been reassigned with respect to the left-hand versions. As may be seen, the upper side key 7 for the shutter function and the + and - keys are not the same physical keys as in the left-handed mode in fig. 3 A. The inserted character and symbol information has changed 10 with respect to the physical display 4 so that it will not be shown upside down. It is realized that many left-handed users would still prefer the right-handed modes, because they are already used to them. The invention just gives the user the option.
In all the embodiments above, the buttons and keys used for the specific application may be highlighted for illumination guidance. The highlight function is also made dependent of the user settings to the right-hand or left-hand mode and the specific angle between the two parts of the device as well as on the operation mode.
The invention is implemented with a suitable combination of hardware and software as will be appreciated by a person skilled in the art. The scope of the invention is only limited by the claims below.

Claims

1. A portable device (1) combining different device categories with different operation modes each having different preferred user interface modes, comprising: a user interface comprising a keypad (8) with a number of keys and a display (4); characterised by a control unit arranged to control the user interface in dependence of a selected operation mode of the device.
2. A portable device (1) according to claim 1, further comprising: an upper part (2) and a lower part (3) that can be folded together into a closed state and unfolded into opened states in which the upper part (2) and the lower part (3) are arranged at an angle relative to each other, the device (1) being operable in both the closed and opened states; said user interface comprising a keypad (8) with a number of keys provided on one of the two parts and a display (4) provided on the other of the two parts, possibly together with further keys; wherein said control unit further is arranged to control the user interface in dependence of the relative angle between the two parts (2, 3).
3. A portable device according to claim 1 or 2, wherein the control unit is further arranged to control the user interface in dependence of predetermined settings selected by a user.
4. A portable device according to claim 3, wherein the predetermined settings include a general right-handed mode and a general left-handed mode.
5. A portable device according to claim 1, 2, 3 or 4, wherein the control unit is arranged to control the orientation of an image object (10) shown on the display.
6. A portable device according to claim 1, 2, 3, 4 or 5, wherein the control unit is arranged to control the assignment of key functions.
7. A portable device according to claim 6, wherein the control unit is arranged to control illumination of keys .
8. A portable device according to any one of the preceding claims, wherein the device (1) is a combined mobile phone, digital camera, and portable game device.
PCT/EP2005/054528 2004-09-13 2005-09-12 Mobile device with adaptive user interface Ceased WO2006030002A1 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
EP04104418 2004-09-13
EP04104418.1 2004-09-13
EP04106105.2 2004-11-26
EP04106105A EP1635544A1 (en) 2004-09-13 2004-11-26 Mobile device with adaptive user interface
US63537804P 2004-12-10 2004-12-10
US60/635,378 2004-12-10

Publications (1)

Publication Number Publication Date
WO2006030002A1 true WO2006030002A1 (en) 2006-03-23

Family

ID=35432697

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2005/054528 Ceased WO2006030002A1 (en) 2004-09-13 2005-09-12 Mobile device with adaptive user interface

Country Status (1)

Country Link
WO (1) WO2006030002A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1923777A1 (en) * 2006-11-16 2008-05-21 Samsung Electronics Co., Ltd. Key control apparatus of a portable terminal
EP2207330A1 (en) 2009-01-09 2010-07-14 Research In Motion Limited Method and apparatus to facilitate non-flush general navigation buttons for a clamshell handheld device
WO2010004549A3 (en) * 2008-06-16 2012-02-09 Cellerium Ltd. Dynamic mobile client
US8224310B2 (en) 2006-11-15 2012-07-17 Motorola Mobility, Inc. Method and system for managing an electronic device
US8508480B2 (en) 2009-01-09 2013-08-13 Research In Motion Limited Method and apparatus to facilitate non-flush general navigation buttons for a clamshell handheld device
EP2346230A4 (en) * 2008-10-27 2014-07-23 Nec Corp Mobile electronic device and display screen switching method
US10042655B2 (en) 2015-01-21 2018-08-07 Microsoft Technology Licensing, Llc. Adaptable user interface display
US10209849B2 (en) 2015-01-21 2019-02-19 Microsoft Technology Licensing, Llc Adaptive user interface pane objects
US10402034B2 (en) 2014-04-02 2019-09-03 Microsoft Technology Licensing, Llc Adaptive user interface pane manager

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001084269A2 (en) * 2000-04-28 2001-11-08 Motorola Inc. Self configuring multiple element portable electronic device
US20020102946A1 (en) * 2001-01-31 2002-08-01 Microsoft Corporation Modular two-body design for integration of mobile computing device features with a wireless communication device
US6538636B1 (en) * 1999-07-06 2003-03-25 Intel Corporation Apparatus and method for configuring a hand-held interactive device
EP1312999A2 (en) * 2001-11-09 2003-05-21 Nokia Corporation Multifunction mobile communications device with slidable display screen
WO2004062144A1 (en) * 2002-12-20 2004-07-22 Motorola Inc. Apparatus and method for electronic device control

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6538636B1 (en) * 1999-07-06 2003-03-25 Intel Corporation Apparatus and method for configuring a hand-held interactive device
WO2001084269A2 (en) * 2000-04-28 2001-11-08 Motorola Inc. Self configuring multiple element portable electronic device
US20020102946A1 (en) * 2001-01-31 2002-08-01 Microsoft Corporation Modular two-body design for integration of mobile computing device features with a wireless communication device
EP1312999A2 (en) * 2001-11-09 2003-05-21 Nokia Corporation Multifunction mobile communications device with slidable display screen
WO2004062144A1 (en) * 2002-12-20 2004-07-22 Motorola Inc. Apparatus and method for electronic device control

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8224310B2 (en) 2006-11-15 2012-07-17 Motorola Mobility, Inc. Method and system for managing an electronic device
EP1923777A1 (en) * 2006-11-16 2008-05-21 Samsung Electronics Co., Ltd. Key control apparatus of a portable terminal
US7948475B2 (en) 2006-11-16 2011-05-24 Samsung Electronics Co., Ltd. Key control apparatus of a portable terminal
WO2010004549A3 (en) * 2008-06-16 2012-02-09 Cellerium Ltd. Dynamic mobile client
EP2346230A4 (en) * 2008-10-27 2014-07-23 Nec Corp Mobile electronic device and display screen switching method
EP2207330A1 (en) 2009-01-09 2010-07-14 Research In Motion Limited Method and apparatus to facilitate non-flush general navigation buttons for a clamshell handheld device
US8508480B2 (en) 2009-01-09 2013-08-13 Research In Motion Limited Method and apparatus to facilitate non-flush general navigation buttons for a clamshell handheld device
US10402034B2 (en) 2014-04-02 2019-09-03 Microsoft Technology Licensing, Llc Adaptive user interface pane manager
US10042655B2 (en) 2015-01-21 2018-08-07 Microsoft Technology Licensing, Llc. Adaptable user interface display
US10209849B2 (en) 2015-01-21 2019-02-19 Microsoft Technology Licensing, Llc Adaptive user interface pane objects

Similar Documents

Publication Publication Date Title
US20090322690A1 (en) Screen display
US7447527B2 (en) Handheld electronic data processing device with multiple operation modes for different functions
US8046033B2 (en) Mobile terminal
JP4960062B2 (en) Portable terminal
US7791594B2 (en) Orientation based multiple mode mechanically vibrated touch screen display
CA2765913C (en) Method and apparatus for area-efficient graphical user interface
US7007242B2 (en) Graphical user interface for a mobile device
US8373660B2 (en) System and method for a portable multimedia client
US7023421B2 (en) Subscriber device with adaptable user interface and method thereof
US20080146298A1 (en) Portable electronic device and method for selecting operation mode thereof
US10628037B2 (en) Mobile device systems and methods
WO2011046208A1 (en) Mobile device
CN1647492A (en) Portable, foldable electronic device with telephone and camera functions
JP2009123241A (en) Personal digital assistant
US20100075726A1 (en) Portable terminal for multimedia
JP2009278411A (en) Portable device
JP2011090421A (en) Mobile equipment
WO2006030002A1 (en) Mobile device with adaptive user interface
US20070060216A1 (en) Portable communication apparatus
JP2011087168A (en) Mobile apparatus
JP2010130102A (en) Mobile electronic apparatus
JP2020005208A (en) Electronic apparatus, method of controlling electronic apparatus, program, and storage medium
CN101151876B (en) Portable information terminal device and function selection activation method used therein
KR20110055696A (en) Controllers, apparatus, methods, and computer readable storage media providing outputs for displaying information
CN101669351A (en) Rotary Portable Terminal

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase