HK1115492B - A hierarchical menu graphical user interface - Google Patents

Description

Hierarchical menu graphical user interface

The present application is a divisional application of application No. 97182232.8, filed on 1997, 12/15, entitled "hierarchical menu graphical user interface".

Technical Field

The invention relates to a menu driven graphical user display interface.

Background

Consumer electronics devices such as Digital Versatile Disk (DVD) players, combination personal computer and television devices (PC/TV systems), satellite receivers and internet compatible devices (e.g., NETPC) all contain a number of complex user interaction tasks. These tasks include initial device setup, operational function selection, programmable user preference selection, determining conditional access to programs, and user rights. Other tasks include, for example, operating an application, selecting audio/video features, selecting communication functions, and obtaining help or user instructions from a manual. One problem with these needs is the need to design a user interface for these devices that supports these complex user interaction tasks while providing a simple command interface suitable for the public.

This problem and its derivatives are solved by the system according to the invention.

Disclosure of Invention

A system including an on-screen user interface display generates a multi-level sequential menu display. The menu includes a current menu and a previous parent menu representing a selection path from the parent menu to the current menu. Menu selection items within the hierarchical menu display provide the user with at least one of a) display of the device control information, and b) control parameter data entry capabilities. The screen display is updated in response to user menu option selections.

Drawings

In the drawings:

FIG. 1 illustrates a Digital Versatile Disk (DVD) system providing an on-screen user interface display in the form of a set of user interactive hierarchical controls and information displays in accordance with the present invention.

FIG. 2 illustrates an on-screen user interface display indicating a highlighted navigation path through a three-level DVD operational menu in accordance with the present invention.

FIG. 3 illustrates an on-screen user interface display for entering an operational parameter (a password) within a hierarchical menu structure allowing user input in accordance with the present invention.

Figure 4 illustrates an on-screen user interface display showing an operational parameter (subtitle activation state) within a hierarchical menu structure in accordance with the present invention.

FIG. 5 illustrates a screen interface display depicting an automatic scrolling operation for maintaining on-screen user viewability of currently selectable menu options in a hierarchical menu structure in accordance with the present invention.

FIG. 6 illustrates an on-screen user interface display depicting the use of a hierarchical menu structure that provides guidance to a user as to operational instructions or types thereof that typically appear in a user's operating manual, in accordance with the present invention.

Fig. 7 illustrates an on-screen user interface display that allows a user to control the operation of a television via an operating parameter input within a hierarchical menu structure in accordance with the present invention.

FIG. 8 illustrates an on-screen user interface display that allows a user to perform sequential program playback via operational parameter entry within a hierarchical menu structure, in accordance with the present invention.

Fig. 9 illustrates an on-screen user interface display for ordering user adjustments to television picture characteristics via operating parameter inputs within a hierarchical menu structure, in accordance with the present invention.

FIG. 10 illustrates an on-screen user interface display that allows a user to adjust audio characteristics via operational parameter inputs within a hierarchical menu structure, in accordance with the present invention.

FIG. 11 illustrates an on-screen user interface display that allows a user to adjust adult content rating limits via operating parameter inputs within a hierarchical menu structure, in accordance with the present invention.

Detailed Description

The inventors have realized that a hierarchically ordered menu structure helps to provide a simple graphical user interface for user interaction operations of devices including consumer electronic devices such as DVD players. A hierarchically ordered menu structure also helps to provide a simple interface for user manipulation of applications running on a Personal Computer (PC) or other device.

The inventors have further recognized that significant advantages may be achieved by continuously displaying a hierarchical menu structure during user operation of a device or application. The ability of a user to navigate through multiple menus and operational tasks may be enhanced by maintaining visibility of the menu structure and screen during operation of the device or program. Such a menu system allows the user to recognize where he is in a complex multi-level menu structure and can easily advance and return within the structure. The hierarchical menu structure is automatically scrolled to maintain a currently active menu screen. In addition, not only the menu entry and exit points but also previously selected menu data items may be identified (e.g., by highlighting) so that the user can easily see the menu navigation path and the sequence of operations he has completed. Menu entry and exit points separated by one or more intervening menu data items may also be identified.

Each menu of the hierarchy includes one or more selectable data items that may display device control parameters or cause a user to input device control parameters. Also, the user interface includes the display and input of control parameters that support functions including, for example, device settings, device operation and adjustment, user preference selection, conditional access and user rights management, audio/video feature selection, communication function initiation, and user assistance or instructions. The interface may also be used to guide the user through a predetermined sequence of operations, such as adjustment of display brightness, contrast, etc. The interface may also be used in a program guide application to allow a user to navigate through, for example, program selections. The user may select a program topic (e.g., movie selected from selectable items, also including news, documentaries, sports, etc.) in a first menu, and then enter a subsequent menu for selecting a topic (e.g., comedy selected from selectable items, also including horror novels, science fiction, romance, etc.).

FIG. 1 shows a Digital Versatile Disk (DVD) system according to the present invention that provides an on-screen user display in the form of a set of user interactions, hierarchies, controls and information displays. The DVD system is capable of playing not only DVD discs but also audio CD discs. The decoder 100 reads data from the disk storage medium 10 via the interface 15 and writes data to the disk storage medium 10 via the interface 15 in response to user commands. A user inputs commands through the remote control unit 70 via the remote interface 65 and is processed by the controller 60. Decoder 100 also decodes MPEG compatible audio and video data for playback in audio unit 55 and video unit 50. MPEG (moving picture experts group) -compatible audio and video data are encoded according to an image encoding standard hereinafter referred to as the "MPEG standard". The MPEG standard consists of a system coding part (ISO/IEC13818-1, 10.6.1994) and a video coding part (ISO/IEC13818-2, 20.1.1995), hereinafter referred to as "MPEG system standard" and "MPEG video standard", respectively.

The interactive, hierarchical, control and information displays present at the unit 50 enable the functional display and device control parameter (including operational parameters) input of user operations of the DVD decoder 100. The hierarchical individual menus contain entries and displays of control parameters that support the functions of the decoder 100 including, for example, device setup, device operation and adjustment, user preference selection, conditional access and user rights management, audio/video feature selection, communication function initiation, and user assistance or instructions. Other menus are used to guide the user through a predetermined sequence of operations, such as adjustment of display brightness, contrast, etc.

Although the disclosed user interface system is described in the context of a system operating a consumer electronics device, this is merely illustrative. The principles of the present invention may be applied to user interface systems operating other, non-consumer electronic devices and operating applications on, for example, Personal Computers (PCs) or other devices. Furthermore, the principles of the present invention may be used in a user interface for non-MPEG compatible systems that process data such as telephone information, computer programs, Internet data, or other communications.

Considering the read mode operation of the (DVD) system of fig. 1, the resulting decoded data stream is supplied to a demultiplexer 20 by a procedure in which the interface unit 15 demodulates, deinterleaves, Reed-Solomon error corrects and descrambles data representing data from the storage medium 10. The user operates the DVD decoder 100 by selecting an option represented on a set of hierarchical menus displayed by the unit 50. The options are selected using commands entered by the remote control unit 70 via the remote interface 65. In this manner, the user selects a viewer program and initiates functions related to the setup, operation, and adjustment of the DVD system. The input commands are processed by a controller 60 which controls the operation of the components of the decoder 100 using a two-way data and control signal bus C. The controller 60 controls the functions of the various components within the decoder 100 by setting control register values within these components using the control bus C.

The packetized decoded data stream output by the interface 15 contains video and audio data representing, for example, a selected movie, and also sub-picture data. The sub-image data obtained from the storage medium 10 contains image portions related to the program stored in the storage medium, such as display commands, subtitles, contents menus, descriptive text, selectable menu options, or other data items. Packets containing video, audio and sub-picture data are identified from the decoded data stream at interface 15 by demultiplexer 20 using Packet Identifier (PID) values contained in their respective packet headers.

The demultiplexer 20 matches the PID of the incoming data packets from the data stream of the interface 15 with the PID value of the control register preloaded into the unit 20 by the controller 60. Demultiplexer 20 provides the video, audio and sub-picture data packets to MPEG video decoder 25, audio processor 35 and sub-picture processor 30, respectively. Decoder 25 decodes and decompresses the MPEG compatible packetized video data from unit 20 and provides a decompressor program representing the pixel data to NTSC encoder 45 through multiplexer 40. Similarly, audio processor 35 decodes the packetized audio data from unit 20 and provides the decoded and amplified audio data to device 55 for audio playback in synchronization with associated decompressed video data.

Processor 30 decodes and decompresses the sub-image data received from unit 20 to provide decompressed pixel map data to an On Screen Display (OSD) and graphics generator 37. Element 37 creates a set of interactive, hierarchical, control and information menu displays that appear at element 50. These menu displays include, for example, the displays shown in fig. 2-11, which enable the selection of functions and the entry of user-operated device operating parameters for the DVD decoder 100. A hierarchical menu display in the form of overlay pixel map data is generated by OSD generator 37 under the control of controller 60. The controller 60 displays the updated database using the menu of the support unit 50. The database links together a particular menu in the hierarchy with selectable menu option icons currently displayed in the menu of cell 50. Thus, controller 60 is capable of identifying and generating a next level menu for display on unit 50 in response to user selection of the current menu option icon.

The controller 60 executes preprogrammed instructions configured as an operating system customized for the operation of the DVD decoder 100. In the execution of the instructions, controller 60, in conjunction with unit 37, generates a hierarchical sequence of auto-scroll menus that are continuously displayed on unit 50 during user interaction with DVD device 100. The controller 60 together with the unit 37 automatically scrolls the displayed part of the continuous hierarchical menu structure not only in the horizontal direction but also in the vertical direction in order to maintain the currently active part of the menu structure on the screen of the unit 50. As the user passes through the menu, the currently activated and most recently selected menu scrolls horizontally to the left of the cell 50 display window where the previous menu is displayed to the right of the current menu.

When a certain function is activated, such as for example the user starting playing a movie, the controller 60 moves the menu structure displayed by the unit 50 away. However, when the selected function is completed, e.g., at the end of the movie, the controller 60, together with the unit 37, again generates a menu to be displayed at the unit 50 and returns the display user interface to the owned hierarchical menu structure. In addition, even when the menu structure is not displayed, for example, during movie playback, the controller 60 of the operating system continues to run within the hierarchical menu structure and keeps a record of the last selected menu option. Thus, when a function outside the menu structure is completed, such as the end of movie playback, the controller 60 can re-create the last selected menu and retain the position within the menu structure. Alternatively, the controller 60 of another embodiment may cause the decoder 100 operation to return to a different menu within the structure when a task is completed.

The ability of a user to navigate through multiple menus and operational tasks may be enhanced by maintaining visibility of the menu structure and the screen of the DVD decoder 100 during user interaction with the DVD system. The menu structure is continuously visible except for intervals that require full screen display during, for example, movie playback. Similarly, during operation of an application (e.g., a word processing program), similar advantages may be obtained by maintaining such a continuous visual menu, except, for example, for intervals that require full screen display during application operation. This feature allows the user to know where he is in a complex multi-level menu structure and to easily advance and retract within the structure. The transcoder 100 automatically scrolls through the hierarchical menu structure to maintain a currently active menu screen.

In addition, not only the menu entry and exit points but also previously selected menu data items may be identified (e.g., by dashed or dashed features or by highlighting, coloring, and shading including three-dimensional shading, or shading) so as to allow the user to easily see the menu navigation path and the sequence of operations he has completed. The user may navigate through the menu structure in a sequential manner from one menu to an adjacent menu, i.e. a previous or next menu as described later with reference to fig. 2-11. Random navigation jumps from a current menu to another non-adjacent menu are generally not allowed. However, such jumps are allowed under certain conditions, such as for example power supply interruptions or error conditions or fast steering or recovery purposes. In these cases, the user is allowed to initiate a return to the main or base menu when a particular command is initiated via remote unit 70.

The controller 60 scrolls the menu structure by determining the displayed portion of the menu structure in response to menu item selection and navigation commands, such as directional arrows or cursor commands that advance or rotate around the menu structure. The controller 60 selects a menu structure portion for display from predetermined and pre-stored settings of the hierarchical (tree structure) display menu. Provision is also made for the user to add not only new menus but also menu items to the menu structure by user function using a data input device such as the remote unit 70 or, for example, a keyboard (not shown). OSD generator 37 updates the corresponding OSD pixel map overlay data with pixel data representing the selected menu structure at the direction of controller 60.

The unit 37 linearly combines the sub-image pixel map data of the processor with the overlay pixel map data representing the OSD unit 37 selected for displaying the menu structure. The combined pixel map data is provided to the multiplexer 40. Controller 60 directs the combined pixel map menu data of unit 37 or the decompressed program description pixel data of decoder 25 to the pixel map memory buffer of NTSC encoder 45.

In another mode, both the combined pixel map menu data and the decompressed program data of unit 37 are directed to encoder 45 via multiplexer 40. In this mode, the data is combined at the pixel map memory buffer of unit 45 under the direction of controller 60 to form a composite display. The composite display contains not only video, e.g., movies, but also overlays of combined pixel map data to allow, for example, adjustment of display parameters when playing a movie.

In normal operation of the DVD system, the combined pixel map menu data for cell 37 is displayed at cell 50 without the video data (e.g., movie data) for cell 25. To this end, under control of unit 60, a multiplexer directs the combined pixel map menu data of unit 37 to the pixel map memory buffer of NTSC encoder 45 for storage.

Encoder 45 converts the combined pixel map menu data stored in its memory buffer to conventional luminance and chrominance components. Encoder 45 processes the luminance and chrominance components, as well as timing data provided by controller 60, in a conventional manner to form an NTSC signal that is displayed on an NTSC compatible image playback device 50, such as a television or video monitor. In another embodiment, encoder 45 provides RGB output for display through an RGB compatible playback device or a high definition television. Encoder 45 may be a conventional commercially available integrated circuit used for signal conversion and NTSC generation.

Fig. 2-11 illustrate exemplary user interface menus generated by unit 37 in conjunction with controller 60 and provided to a user by display unit 50 (fig. 1) in accordance with the present invention. The display menu shows the usability, simplicity and airworthiness advantages provided by the interface.

Figure 2 illustrates an on-screen user interface display showing a basic menu and a navigation path through a three-level DVD operation menu. In particular, FIG. 2 identifies a navigation path that the user has traversed from the base menu item 205, through the entry item 215 and the second menu item 210, and the menu items 220 and 235, to the items 240 of the third and currently active menus. In this example, the base menu includes options 200, 205, 245, 250, 255, 260, and 265. The user identifies the navigation path through items 200 and 240 by highlighting the user and the navigation path passes through the user entry of an orientation or cursor command on the underlying remote unit 70 (FIG. 1). The menu entry points are represented by items 215 and 220 (fig. 2). The menu exit point is represented by a highlighted navigation path from the previous menu (e.g., from item 210) to the entry point of the next menu (e.g., item 220). The entry and exit points and any intervening items of the respective menus are identified by the raised highlights. This makes it easy for the user to see the menu navigation path and the sequence of operations he has completed. In another embodiment, the entry and exit points of a particular menu may be identified (e.g., by highlighting) and the insert may be left un-highlighted and therefore not identified.

Fig. 3 shows a hierarchical menu display that allows a user to enter an operational parameter (password) within the menu structure. In this example, the user has navigated to menu item 335 via menu items 300 and 330. A menu item 335, a dialog box, enables the user to update the operating parameters of the decoder 100, in this case conditionally accessing data in the form of a password for one of the users.

Fig. 4 illustrates an on-screen user interface display showing an operational parameter (subtitle activation state) within a hierarchical menu structure in accordance with the present invention. In this example, the highlighted menu item and navigation path indicate that the user has navigated to menu item 415 via items 400 and 410. A menu item 415 indicates to the user the subtitle activation status and in this exemplary embodiment the menu item 415 indicates that the subtitle of the selected movie is displayed at the cell 50.

FIG. 5 illustrates a screen user interface display depicting an automatic scrolling operation for preserving visibility of a currently selected menu item within a hierarchical menu structure, in accordance with the present invention. In this example, the user has passed through the menu structure from menu level 1 to the currently activated menu level 4 via highlighted items 530, 510, 505, 540, 545, and 555. Controller 60, acting in conjunction with unit 37 (fig. 1), has automatically scrolled the displayed portion of the menu structure horizontally to have dialog box 555 (menu level 4) on the right side of the display screen and the previous menu (menu level 3) within screen area 500. As a result, the previously selected menu (levels 1 and 2) has been scrolled right to left and out of the user's line of sight, leaving display screen image 500. The display menu structure section includes a dialog box 555 (menu level 4) that allows the user to select a desired subtitle language. The user can easily identify and return to their highlighted navigation path during use and proceed through the menu structure with knowledge that the menu automatically scrolls to maintain the next visible menu selection and screen.

FIG. 6 illustrates an on-screen user interface display depicting the use of a hierarchical menu structure to provide a user with operating instructions or types of instructions that are frequently found in a user's operating manual, in accordance with the present invention. In this example, the user has navigated to menu item 610 via items 600- & 605. Menu item 610 gives user instructions regarding the use of menu selection item 605 (playlist).

Fig. 7 illustrates an on-screen user interface display that allows a user to control television operation via an operating parameter entry within a hierarchical menu structure in accordance with the present invention. In this example, the user has navigated to menu dialog 730 via menu item 700 and 725. Dialog 730 allows the user to adjust the operating time and date of the DVD system using remote unit 70 (fig. 1) to obtain the desired operating time and date.

FIG. 8 illustrates an on-screen user interface display that allows a user to sort playback programs via operational parameter entries within a hierarchical menu structure in accordance with the present invention. In this example, the DVD decoder 100 operates in a CD audio disc playback mode. In the menu structure of fig. 8 the user navigates via menu items 800 and 805 to a dialog box 810 for ordering the playing of an audio disc. For example, at exemplary item 810 the user orders the playback of CD audio discs 6, 12, and 8 (items 815, 820, and 825, respectively).

FIG. 9 illustrates an on-screen user interface display for ordering user adjustments to television image characteristics via an operating parameter entry within a hierarchical menu structure in accordance with the present invention. In this example, the user navigates the highlighted menu path via items 900 and 915. The ordering of the menu items within the menu structure is used to guide the user through a predetermined display characteristic to adjust the function sequence. For example, the user may be prompted or asked to perform sequential adjustments of contrast 910, brightness 915, chroma 925, sharpness 930, and automatic color selection 950 in the order in which they navigate within the menu structure. The user directly adjusts a parameter by icon selection or icon movement using a cursor input operating device such as remote unit 70 (fig. 1) or a keyboard. For example, the brightness is adjusted by moving the brightness setting band of item 915.

FIG. 10 illustrates an on-screen user interface display that allows a user to adjust audio characteristics via an operating parameter entry within a hierarchical menu structure in accordance with the present invention. In this example, the user navigates through highlight item 1000 and 1030 to dialog box 1035 for adjusting the central audio equalizer filter characteristics.

FIG. 11 illustrates an on-screen user interface display that allows a user to adjust adult content level definitions via an operating parameter entry within a hierarchical menu structure, in accordance with the present invention. In this example, the user navigates through highlight menu item 1100-1145 to dialog box 1150 for adjusting the level definition set for a selected family member (here, Charles). The definition is adjusted using the remote unit 70 (fig. 1) by movement of an icon within the dialog box 1150.

The principles of the present invention may be applied to user interface systems for operating other, non-consumer electronic devices so long as the device incorporates video display information provided to the user. Such devices include, for example, video processing equipment, computers and their peripherals, servers, communication devices and internet servers and equipment. In addition, the principles of the present invention may be applied to user interfaces used by operating systems and applications running on a Personal Computer (PC) or other device. These applications may include, for example, word processing, databases, and file management programs. In addition, many variations of the method and apparatus may be made in creating a user interface in accordance with the principles of the present invention. The resulting devices and methods are not limited to the principles described herein.

Claims (17)

1. A device (100) comprising a user interface for displaying and selecting device operating parameters, comprising:

display generating means (37, 60) for generating a display of hierarchical order settings of said menus represented in a merged display comprising windows in which parallel applications are launched via a control menu, said menus comprising a current menu and one preceding parent menu, said menus representing display navigation paths from said parent menu to said current menu and joining,

a) a menu item for displaying a first operating parameter of the device, an

b) A menu item for enabling a user to input an updated value of a second operating parameter of the device; and means (60; 100) for changing the operation of the device in response to the updated value.

2. The apparatus of claim 1, wherein

The means for changing the operation of the device in response to the updated value comprises at least one of:

a) means for updating a database relating a selectable menu option within a currently displayed menu to a menu to be displayed next, b) means for adjusting the characteristics of the displayed video, c) means for adjusting the program play or record, d) means for setting up the apparatus, e) means for updating conditional access data for the apparatus.

3. The apparatus of claim 1, wherein

The display generation device comprises

a) During the operation of the device by the user,

b) during the interactive operation of the application by the user,

c) providing a continuous visual display of the navigation path during at least one of the periods of user operation of the device other than application operating time.

4. The apparatus of claim 1, wherein

The menu provides a user interface for an application.

5. The apparatus of claim 1, wherein

The second operating parameter represents one of a) a password, b) user profile data, c) setting parameters of the device, d) program play or record data and e) conditional access data.

6. The apparatus of claim 5, wherein

The user profile data includes at least one of a) a language selection, b) a content rating, and c) a program content selection.

7. The apparatus of claim 1, wherein

The first operating parameter is one of a) program content information, b) program guide information, c) device operating parameters, and d) device operation manual information.

8. The apparatus of claim 1, wherein

Hierarchically ordering the current menu for guiding the user in a sequential selection of order sensitive functions.

9. A device (100) comprising a user interface, comprising:

display generating means (37, 60) for generating a display of a plurality of hierarchically ordered menus; and means (60) for accessing a database supporting said display update, wherein

The menus include a first menu, a second menu in front of the first menu and a third menu in front of the second menu, the display representing a navigation path from the third menu to the first menu and the navigation path indicating entry and exit points of the second menu, wherein

The entry and exit points are separated by at least one intervening menu item and the navigation path entry point is represented by an entry icon for a variable cell within the second menu, and the entry icon is adjacent to a menu item first selected by a user from a plurality of items in the second menu.

10. The apparatus of claim 9, wherein

The navigation path is identified by at least one of a) highlighting, b) coloring, c) shading, d) three-dimensional shading, e) cross hatching, and f) dashed lines.

11. The apparatus of claim 10, wherein

Highlighting the navigation path except for the at least one insertion menu item.

12. The apparatus of claim 9, wherein

The navigation path includes a plurality of sequentially arranged insertion menu items.

13. The apparatus of claim 9, wherein

The exit point of the navigation path is represented by a highlighted navigation path from the previous menu to the entry point of the next menu.

14. The apparatus of claim 9, wherein

The display generation device comprises

a) During the interactive operation of the device by the user,

b) during the interactive operation of an application by a user,

c) during the time the user operates the device other than the program play time,

d) providing a continuous visual display of the navigation path during at least one of the periods of user operation of the device other than application operating time.

15. The apparatus of claim 9, comprising

Means for automatically scrolling said display to leave said first menu visible to a user, said scrolling being performed in response to user menu item selection.

16. A method of generating a user interface for displaying and selecting operational parameters of a device, comprising:

generating a display of hierarchical order settings of the menus represented in a merged display including windows for launching parallel applications via a control menu, the menus including a current menu and one preceding parent menu, the menus representing display navigation paths from the parent menu to the current menu and joining,

a) a menu item for displaying a first operating parameter of the device, an

b) A menu item for enabling a user to input an updated value of a second operating parameter of the device; and

changing the device operation in response to the updated value.

17. A method of generating an on-screen user interface display, comprising:

generating a display of a plurality of hierarchically ordered menus, an

Accessing an updated database supporting display of the plurality of hierarchically ordered menus, wherein the menus include:

a first menu, a second menu in front of the first menu and a third menu in front of the second menu, the display of the plurality of hierarchically ordered menus representing a displayed navigation path from the third menu to the first menu and the navigation path indicating entry and exit points of the second menu, wherein

The entry and exit points are separated by at least one intervening menu item and the navigation path entry point is represented by an entry icon for a variable cell within the second menu, and the entry icon is adjacent to a menu item first selected by a user from a plurality of items in the second menu.