HK1028515B - System for collating data from multiple sources to form a composite program guide for display - Google Patents

Description

System for collating data from multiple sources to form a composite program guide for display

This is a formal application of provisional application serial No. 60/043,539 filed by r.j.logan et al on 14/4/1997.

The present invention relates to digital signal processing and, more particularly, to the acquisition, formation and processing of program guide information and program content data originating from a plurality of information sources, such as internet information sources, cable information sources, satellite information sources and terrestrial information sources.

Home entertainment systems combined with personal computer and television functions (PC/TV systems) are becoming increasingly common multi-information source and multi-purpose communication devices for user human interaction. Such systems are required to operate in different data formats between multiple locations in order to respond to a wide variety of applications requested by usersAnd (4) communication. For example, a PC/TV system may receive data from a satellite or terrestrial-based information source consisting of High Definition Television (HDTV) broadcasts, Multipoint Microwave Distribution System (MMDS) broadcasts, and Digital Video Broadcasts (DVB). The PC/TV system can also receive and transmit signals from and/or from devices such as Digital Video Disks (DVDs), CDROMs, VHSs, and Digital VHSs (DVHS) via telephone lines (e.g., the Internet) and coaxial lines (e.g., cable TVs)^TM) Remote and local sources of data for model players, PCs, and many other types of sources.

Problems arise in developing such a general purpose PC/TV entertainment system. In particular, problems arise in supporting communication between multiple data sources and in processing data from multiple sources. Yet another problem is that there is a need to design user interfaces for such systems to support complex user human-machine interaction tasks while providing a simple command interface suitable for the general public. For example, the PC/TV system user interface should allow the user to view selected programs and to perform functional operations such as e-mail, telephone, internet access, facsimile and videophone functions. Such applications require communication between the PC/TV unit and a variety of remote information sources, such as satellite service providers, and local information sources, such as DVD storage. In addition, the PC/TV needs to process and decode data of different data formats from different devices and display the received data to the user. These problems are handled subtly by the system according to the invention.

Prior art WO 97/13368 discloses a program guide processing system that involves retrieving program guide information from a data source on user command using a remote database. In addition, the prior art also includes USP 5,589,892, which discloses various program guide menus and features. The prior art further comprises WO-A-96/33572 which discloses A television system for sorting and merging program guide information.

The inventors have thus realized that for an interface operating using user functions such as e-mail, telephone, internet access, fax, home control and video phone functions, the program guide type of the user interface should be simple and easy. Providing a single user interface for user operation of multiple devices and associated functions also facilitates the use of program guides for these functions.

The present inventors have further recognized that it would be desirable for a video decoding system to be able to collate program guide information obtained from a variety of local and remote sources. In particular, the present inventors have recognized that information may be sorted into categories according to the following items for display: (a) assigned display attributes such as color, shading, or shape, (b) assigned data identifiers such as Packet Identifiers (PIDs), (c) hierarchical program content structures such as themes with subtitles (e.g., movies classified as comedy, horror, etc.), (d) equivalent mapping information that maps received grouped program categories to defined large groups of categories, and (e) features including source, function, and program guide entry content.

In a method of collating program guide information received from a first source, an optional program guide menu cursor is displayed. The classification of the program guide information items is arranged from the first source in accordance with the selection of the menu cursor by means of a display attribute which is assigned to the classification of the program guide information items and which is common to the classification and the menu cursor.

In one feature of the invention, the composite program map information includes a new data identification assigned to the program guide information entry, and the new data identification is used to retrieve the entry from the second source.

In another feature of the invention, the first code identifying the program category is converted to the second code according to the program category of the main group using an equal mapping information for the program category.

In the drawings:

fig. 1 shows a home entertainment decoder system according to the present invention for communicating with a plurality of information sources and for processing program guide information and program content data.

Fig. 2 illustrates an exemplary program guide display format according to the present invention.

Fig. 3 shows a data format according to the invention for packetizing internet data for transmission within an MPEG compatible data stream.

Fig. 4 shows a flow chart for receiving program guide information including user-selected options and processing the received information to form a program guide that supports user-selectable communication functions in accordance with the present invention.

Fig. 5 shows a flow chart of a process for forming a program guide in a video decoder from information received from a plurality of information sources according to the present invention.

Fig. 6 shows a flow diagram of a process for automatically requesting and categorizing program guide information from multiple information sources and forming a program guide for display in accordance with the present invention.

Fig. 7 shows a black and white representation of an exemplary color program guide display format in accordance with the present invention, showing menu options that allow a user to sort programs by information source and color attributes.

Fig. 8 shows a flow chart of a process for obtaining information by a video receiver user requested via a selection made on a displayed program guide in accordance with the present invention.

Fig. 9 shows a flow chart of a process for decoding incoming internet information and compressed video data and forming a composite video output for display in accordance with the present invention.

Fig. 1 shows a home entertainment decoder system according to the present invention for communicating with a plurality of information sources to obtain program guide information and program content data. The decoder system forms a program guide for display from information automatically obtained and sorted from a plurality of information sources. By selecting options from the displayed program guide, the user may initiate e-mail, telephone, internet access, fax and videophone functions. The decoder system adaptively decodes a data stream encoded into the MPEG standard that includes compressed program content data and internet data, e.g., as represented in hypertext markup language (HTML). The decoded data is formatted as a composite video image or as discrete video images for display.

The MPEG2 (moving picture experts group) image coding standard (hereinafter referred to as "MPEG" standard) includes a system coding part (ISO/IEC 13818-1, 10/6/1994) and a video coding part (ISO/IEC 13818-2, 20/1/1995), which are hereinafter referred to as "MPEG system standard" and "MPEG video standard", respectively.

Although the disclosed system is described in the context of a system for receiving MPEG compatible signals, it is exemplary only. The principles of the present invention may be applied to systems in which the type of transmission channel and communication protocol may vary, or in which the type of encoding may vary. Such systems may include, for example, non-MPEG compatible systems that contain other types of encoded data streams and other methods of communicating program guide information. Additionally, although the disclosed system is illustrated as processing broadcast programs, this is merely exemplary. The term "program" is used to denote any form of data, such as telephone messages, computer programs, internet data or other communications, and the like.

In summary, in the video receiver system of fig. 1, a carrier modulated with video data is received from a broadcast satellite via antenna 10 and processed by unit 15. The resulting digital output signal is demodulated by demodulator 20 and decoded and error corrected by decoder 30. In this exemplary embodiment, the demodulated and decoded output from unit 30 is in the form of an MPEG compatible transport stream containing MPEG compressed video data and internet data encoded into HTML. Video data encoded into the MPEG standard is in the form of a packetized datastream that typically includes data content for a number of program channels (e.g., content corresponding to cable television channels 1-125).

MPEG compatible transport stream providing response from remote control unit125, respectively, and a processor 25 for commands. Processor 25 is operatively coupled to a network including storage 90 and an internet data server 83 or internet connection service 87 (e.g., U.S. online^TM) To other data information sources. The program guide information is automatically obtained and sorted from the input transport stream and storage device 90 and the server 83 or connection service 87. The information obtained is data consolidated by processor 25 to form a program guide for display including selection options to allow the user to initiate, for example, e-mail, telephone, internet access, facsimile and videophone functions, and others. The program guide for display is also formed to include non-display information from a plurality of information sources for identifying and assembling the private data packets made up of programs selected for viewing or listening by the user. This information is used to recover the content of the selected program from a plurality of information sources.

Processor 25 adaptively decompresses the input compressed video data and decodes the HTML internet data to provide a formatted composite video image for display on unit 75. Processor 25 also provides encoded data output for storage on storage medium 105 via storage device 90 and provides encoded data to other devices (not shown for simplicity) via modem 80 and a telephone line.

The video receiver user initiates functions including e-mail, telephone, internet access, facsimile and video telephone functions and viewing and storing selected programs via selection of options from a displayed program guide. The user selects the displayed option with a cursor using the remote control unit 125. Commands from the remote control 125 are passed through the interface 120 to the controller 125 within the processor 25. The unit 115 controls the operation of the processor 25 unit and responds to commands from the remote control unit 125 using a bi-directional data and control signal bus C. The controller 115 controls the functions of the special purpose units in the processor 25 by setting control register values in these units with the control bus C. The processor 25 also supports the storage and retrieval of data from the storage medium 105 via the storage device 90. In this example, the storage device 90 is a DVD-type device and the medium 105 includes a set of multi-disk units containing multiple disks.

Considering fig. 1 in detail, a carrier wave modulated with video data received via antenna 10 is converted to digital form and processed by input processor 15. The processor 15 comprises a Radio Frequency (RF) tuner and an Intermediate Frequency (IF) mixer as well as an amplification stage for down-converting the input video signal to a lower frequency band. The processor 15 also includes an analog-to-digital converter for digitizing the down-converted signal to produce a signal suitable for further processing. The resulting digital output signal is demodulated by demodulator 20 and decoded and error corrected by decoder 30. The output from decoder 30 is further processed by unit 45 of processor 25.

The data provided to unit 45 is in the form of an MPEG compliant (compliant) packetized transport data stream as defined in MPEG systems standards part 2.4 and includes program guide information and data content for one or more program channels. Processor 25 receives input transport streams from transport stream and storage device 90 and internet data server 83 or internet connection service 87 (e.g., U.S. online^TM) Automatically obtain and sort program guide information. Individual packets that include special program channel content or program guide information are identified by their Packet Identifiers (PIDs) contained within the header information.

In response to control signal C unit 45 either selects a transport stream from unit 30 or retrieves a data stream from storage device 90 via storage interface 95 in playback mode. In normal non-playback operation, individual packets comprising program guide information are identified by unit 45 in the transport stream from unit 30 and assembled using PIDs predetermined and stored in an internal memory within controller 115. Unit 45 matches the PID of the incoming packets from decoder 30 in the transport stream with PID values preloaded by controller 115 in a control register within unit 45. Thus, satellite broadcast program guide (SPG) information packets in the transport stream are identified by unit 45 without the additional PID information. Controller 115 obtains the full SPG by accessing and assembling the SPG packets identified and obtained by unit 45.

PID information that enables controller 115 together with unit 45 to identify data packets comprising a dedicated program is referred to as a program or channel map. The program map associates PIDs with the individual packetized datastreams that make up a program and is part of the SPG. The SPG may also contain additional information, such as packet assembly information, which supports the recovery of program guide data from the incoming transport stream.

Controller 115 also configures unit 45 using control signal C to select data packets via interface 95 that are comprised of DVD Program Guide (DPG) information originating from DVD storage device 90. Unit 45 matches the PID of incoming packets in the packetized datastream from interface 95 with PID values preloaded in a control register within unit 45 by controller 115. Controller 115 obtains the full DPG by accessing and assembling the DPG packets identified and obtained by unit 45.

A similar process occurs in obtaining Internet Program Guide (IPG) information from an internet server 83 or from an internet connection service 87 via telephone line communication via modem 80. In obtaining the IPG, data identifiers similar or identical to the PIDs used in obtaining the SPG or DPG are matched with identifiers pre-loaded by the controller 115. The matching function may be performed within unit 80 or by controller 115. The process of obtaining program guide information is explained in greater detail in the description of fig. 4-6.

The SPG, DPG, and IPG information obtained by controller 115 is data combined by processor 25 to form a program guide for display that includes selection options that allow the user to initiate e-mail, telephone, internet access, facsimile, and videophone functions. In the merged data, the obtained SPG, DPG, and IPG information is classified into two levels of hierarchy called topic (the) and topic (topic), and redundant program guide information is deleted. For example, a theme may include categories such as movies, sports, weather, art, novels, news, and the like. Topics are categories within a topic, for example, a movie topic category may have topics including comedy, thrilling, horror, science fantasy, legends, adult entertainment, and the like. Different or additional levels may be used in classifying the obtained SPG, DPG and IPG information, including criteria such as viewer age fitness, age setting (e.g., modern or historical), critic's rate of view, etc.

Some problems occur in classifying SPG, DPG and IPG information. SPG, DPG, and IPG information originating from different information sources may classify programs by different topics and titles, and may use different classification levels. Moreover, to identify private data elements that include a particular program channel or guide content, the SPG, DPG, and IPG data may use contradictory redundant or incompatible PID or other data identifiers. The controller 115 generates a main group of topics and topics that map SPG, DPG, and IPG information to corresponding categories in the main group. For example, a main group may include a title-containing topic-theme of 'movie-drama' mapped to two: A) DPG title-topic of 'movie-comic'; and B) 'IPG topic-topic for movie-summary index' (index for web pages). In the classification guidance information, the controller 115 determines the topic and topic class of data in the SPG, DPG, and IPG from a predetermined topic-topic code. The SPG, DPG and IPG topic and title codes, along with equivalent mapping information for converting the code of one service provider to the code of another service provider, are obtained from the SPG or user-defined data input to the processor 25 or pre-stored in an internal memory in the controller 115. The controller 115 assembles the categorized SPG, DPG, and IPG groups according to the categories defined by the main group of topics and topics. The assembled and sorted SPG, DPG and IPG data is stored in internal memory by controller 115 for use in forming a composite program guide for display.

Controller 115 also forms MPEG compatible non-display information associated with the displayed composite program guide. The non-display information includes composite program map, conditional access, and network information. The non-display information is required to support the identification, assembly and decoding of packets that comprise the composite program guide and associated program content. The conditional access information controls access to the program based on the user entitlement. The network information defines physical network parameters such as satellite transmission channel frequencies and transponder channels.

Controller 115 forms composite program mapping information for the composite program guide that maps SPG, DPG, and IPG topics and titles to a main group of topics and titles. The composite program map also associates data identifiers (e.g., PID values) with the individual packetized datastreams that make up the programs listed in the composite program guide. The composite program map information may also include a dedicated indicator code to indicate that a particular program has been associated with the available internet web page information. In forming the composite program map information, the controller 115 reviews the SPG, DPG, and IPG information for data identifier omissions, redundancies, and inconsistencies. The controller 115 reassembles the existing data identifiers and creates new data identifiers as required to generate MPEG compatible program map information for both the categorized program guide information and the associated program content.

The controller 115 also forms MPEG compatible conditional access information and network information from the corresponding information received at the SPG, DPG and IPG. The conditional access information includes data such as an encryption code for controlling access to the program dependent on user authorization. The network information defines physical network parameters such as satellite transmission channel frequency, transponder channel and internet access parameters associated with the composite program guide for display. Composite program maps, conditional access and network information support the compilation, decoding and display of program content available from satellites, storage devices, internet server information sources and composite program guides.

The controller 115 also includes additional linking data in the non-displayed composite program map, conditional access, and network information. The additional link data supports user selectable functions such as e-mail, telephone, internet access, facsimile, video telephone, channel tuning, program recording and home control functions. The home control functions may support user controls such as starting air conditioning, heating, and burglar alarm operations. The additional linking data associates the access data with both the data identifier (e.g., PID) of the request data and with the user selectable menu options in the displayed composite program guide. The access data includes identification codes, communication protocol codes, conditional access codes, internet access and e-mail access, e.g. URL codes for web pages, and telephone and fax numbers. The access data enables the processor 25 to communicate with external devices.

To generate the composite program guide for display, the controller 115 retrieves the assembled categorized SPG, DPG, and IPG packet data previously stored in internal memory. Controller 115 converts the retrieved data into pixel data and formats the converted data for storage in a pixel representation memory map included in display processor 70. In addition, the controller 115 creates user selectable menu options in the form of pixel data that are mapped in conjunction with the pixel storage of the element 70 (user selection for e-mail, fax, etc.). Controller 115 stores the formatted SPG, DPG and IPG pixel data along with the option pixel data generated in the pixel map of unit 70 to form a composite program guide for display.

The composite program guide in combination with the SPG, DPG, IPG data, and user selectable options is formatted to be compatible with the link data in the non-displayed program guide information. For example, a user selectable option in the display guide (e.g., a telephone function) is associated with both the function access data (e.g., a telephone number) and a data identifier (e.g., a PID for the data group of sent and received telephone messages).

Display processor 70 converts the stored formatted program guide data into conventional luminance and chrominance components. The luminance and chrominance components plus timing data provided by controller 115 are processed by processor 70 in a conventional manner to form an NTSC signal for display on an NTSC-compatible image reproduction device 75 such as a television or video monitor. In another embodiment, the processor 70 may provide RGB output data for display via an RGB compatible rendering device or a high definition television.

Controller 115 and processor 55 together form an MPEG compatible data stream of compressed video and audio containing composite program guide and program content. Processor 55 separates system information including timing, error and synchronization information from the data stream from unit 45 and converts it for use by controller 115. The controller 115 uses the system information in the control processor 55 to provide resynchronized classified programs and composite program guide data with synchronization and error indication information for subsequent decompression of program content data by the decoder 65. The composite program guide data provided by processor 55 is combined with the SPG, DPG, IPG data and user selectable options in a manner compatible with the program map link information as previously described. The program content data provided by processor 55 is decompressed by MPEG decoder 65 to provide video pixel data and audio output data to processor 70. Display processor 70 processes the video pixel data and audio output data for rendering as previously described by unit 75.

Fig. 2 illustrates an exemplary display composite program guide. Menu feature 833-. Menu features 833 and 835 represent program channels that can be generated and displayed in accordance with highlighting of the corresponding menu feature using a user selection control, such as a remote control directed cursor. For example, if the user highlights feature 833, i.e., selects menu option 833, with the cursor, processor 25 tunes to television channel 107 (A)&E^TM) And displayed on unit 75 and uses the composite non-displayed program guide information to determine the functions that are active and associated with the tuning information (channel frequency, etc.). Similarly, if user highlights feature 837, processor 25 tunes receive radio frequency channel FM 13 for audio output on unit 75. Additional function specific menus become displayed providing additional user selection options based on the highlight feature 840 and 850, which correspond to e-mail, phone, fax and DVD recording/playing functions, respectively. Such function-specific menus may provide the user with the ability to edit, store, and delete access information, including, for example, telephone numbers, email addresses, credit card numbers, and additional conditional access data.

If the user highlights menu feature 860 and 870, then a particular functional task is initiated. For example, in accordance with user highlight feature 860, an additional menu is displayed prompting the user to be sent to the user via an Internet email address entry retrieved from the composite non-displayed program guide informationAn email message of Jogn Smith at his home. Similarly, in response to user highlight feature 865, controller 115 (FIG. 1) retrieves Jean's home phone number from internal memory using the composite non-displayed program guide information, for example. Also, via the modem 80, the controller 115 establishes telephone communication with Jean in his home by dialing the home phone number of Jean. In addition, according to the user highlight feature 870, e.g., movie' Star Wars^TM' playback from DVD unit 90 (FIG. 1). Using the composite non-displayed program guide information, communication between processor 25 and DVD unit 90 is established with access data retrieved from memory within controller 115.

Additionally, for example, the program guide may include one or more icons, such as icon 873 (FIG. 2) representing a family, that indicate whether Internet information, such as 'home page', is available for a particular program. In addition, icon 873 in FIG. 2 may change color, for example, from white to green, to indicate that Internet information is available for the particular program. Further, the icon 873 may be a pop-up icon, which appears as an indication that internet information is available for the particular program. For example, by highlighting a program, followed by a highlighting pop-up icon, the displayed program guide may be formed to enable a user to request internet information about the particular program. The home page icon, which appears when internet information is available, is also located within or near the program icon, such as icon 859. Also, by highlighting the home page icon, the home page icon may change color according to the information selected by the user.

Although internet information may be retrieved in fig. 2 based on highlighting a web page icon, such as icon 857, this is merely exemplary. Retrieval of the internet information may also be initiated in a variety of other ways. For example, by using icon 859, a highlight such as' Seinfeld^TM' followed by a highlighted internet icon 810, the user can retrieve available internet information related to the program.

Based on the user-selected composite program guide function, controller 115 (fig. 1) determines and applies access data associated with both the request and response operations contained in the selected function. The controller 115 determines access data required for request and response operations from the previously formed non-display composite program map, conditional access and network information.

Processor 25 obtains information, such as web page data, in response to a user request in a number of ways, including, for example:

A) in the first configuration, the processor 25 accesses web page data received from the decoder 30, which is continuously transmitted in the satellite broadcast;

B) in the second configuration, processor 25 obtains web page data received from decoder 30 transmitted in the satellite broadcast in response to an information request to the service provider via the telephone line; and

C) in a third configuration, processor 25 requests information and receives response information over the same communication link, e.g., a telephone link, to server 83.

First architecture of processor 25

In a first configuration, web page data selected by the user via the displayed program guide is continuously transmitted from decoder 30 in the transport data stream input to processor 25. In this configuration, the composite program map information contains a predetermined PID value for the requested web page. As a result, using the composite program map information, the requested web page data can be retrieved from the input transport stream without requiring the controller 115 to communicate with the service provider via the modem 80. In this configuration, the web information available to the user is limited to the specific information that the service provider continuously sends to the processor 25 using the dedicated transmission bandwidth. However, this architecture is simple and provides fast web page access (since web data may be stored locally in the encoder by the service provider), it also minimizes the service provider burden of data acquisition and eliminates the need for the processor 25 to pass web page request information to the service provider.

EncodingInto HTML^TMAnd Java^TMIs packaged and formatted by the service provider in an encoder to be combined into an MPEG transport data stream for transmission. Fig. 3 shows a data format according to the present invention for packetizing internet data for transmission within an MPEG compatible data stream. Sequence HTML^TM/Java^TMIs formed into non-compressed packets by the encoder, with auxiliary information and HTML (705- & 720 of figure 3)^TM/Java^TMThe data of (725). The auxiliary information includes PID values, packet count values, and a dedicated web page size (e.g., number of bytes or image pixel size). The auxiliary information may include: a flag indicating that the special transport packet contains web page information; a start code; a web page identification code; error correction codes and timing parameters suitable for synchronizing web page internet information with associated video or audio programs. The web page flag may be used to facilitate identification and separation of web page information from MPEG compressed video data. Also, one or more web page assistance data elements may be included in a user definable MPEG transport hierarchy (syntax) element, such as within a transport header, or it may be included in web page information in an MPEG transport data payload.

The responsive web page information, including the predetermined PID values, is combined by the service provider with the MPEG compatible transport data stream input to the processor 25 (fig. 1). The response channel predetermined PID value is also pre-stored in the internal memory of the controller 115 and combined with the composite program map information. Alternatively, the response data PID values and associated program map data may be encoded, for example, in the Channel Information Table (CIT) in a High Definition Television (HDTV) signal encoded in accordance with the Digital television standards for HDTV Transmission of April 121995 established by the american Advanced Television Systems Committee (ATSC). In this case, one or more specific predetermined program channels may be designated to transmit the web page response information. Also, for example, PID values of program channels may be transmitted in the CIT of the composite program map information.

The controller 115 obtains a predetermined PID value corresponding to the requested web page response information from the stored composite program map information and loads it into a control register within the unit 45. Unit 45 matches the PID value of the web page response data input packet in the transport data stream from decoder 30 with the PID value preloaded in the control register of unit 45. Packets having PID values matching the predetermined web response PID values are identified as web page response data and provided by unit 45 to a dedicated buffer in decoder 55. A dedicated buffer in transport decoder 55 holds the response data to be decoded by processor 60.

Processor 55 obtains system information including timing, error and synchronization information from the data stream from unit 45 and provides it to controller 115. Controller 115 uses the system information in the orientation processor 55 from the decoder 55 dedicated buffer to the HTML^TM/Java^TMThe processor 60 provides resynchronized web page response data. Processor 60 decodes HTML^TM/Java^TMEncodes the web response information and provides web page image representative pixel data for storage in memory in controller 115. Although the processor 60 is shown in fig. 1 as a discrete processor, it may also be implemented within the software of the controller 115. The processor 60 includes the processing functionality of a particular web browser, such as that included in the Netscape Navigator^TMJPEG decompression and Java decoding in the operation thereof.

In addition to the web page response data, program content data within the MPEG compatible transport stream from decoder 30, such as a television program channel selected for the user, is also decoded into pixel representative data by processor 25. To this end, controller 115 determines the PID value of the selected television channel program from the composite program map information and loads it into a control register in unit 45. Unit 45 matches the PID of the incoming packets of the selected television channel program data in the transport stream from decoder 30 with PID values preloaded in control registers of unit 45. Packets with PID values matching those of the programs of the predetermined selected television channel are identified by unit 45 and supplied to a dedicated application buffer in decoder 55.

As previously explained for the web page response data, processor 55 obtains system information including timing, error and synchronization information from the data packets from unit 45 and provides it to controller 115. Controller 115 uses the system information in the orientation processor 55 to provide resynchronized program channel content data from decoder 55 application buffer to MPEG decoder 65. To provide the video pixel data and audio output data to display processor 70, the MPEG compatible program channel content data is decompressed by MPEG decoder 65. The video pixel data from decoder 65 is stored in a pixel representation memory contained in display processor 70.

Controller 115 retrieves web page image pixel data from internal memory and formats it for storage as an overlay in pixel representation memory included in display processor 70. As such data combining the web page response data and the program channel content is formed and displayed in the pixel memory of processor 70. The relative proportions and sizes of the web page image and channel content image formed in the processor 70 pixel memory within the resulting composite image may be varied by the controller 115 in response to internal programming instructions or external instructions, such as user commands. The relative proportions may be varied so that the web page image or channel content image is available at a contribution between 0-100% of the resulting composite image.

To adjust the scale of the composite image obtained by the action of the web page data, the controller 115 scales the web page image pixel data by a conventional interpolation process. In addition, the data may be scaled by a discrete video processing integrated circuit operating in conjunction with the controller 115. The resulting scaled web page image is stored in processor 70 pixel memory by controller 115. The stored web page images represent overlapping images of the content image with respect to the program channel. To adjust the position of the web page image data in the composite image, the controller 115 determines an address corresponding to the desired storage location from the internal memory map data and stores the scaled web page image data in the desired storage location. As explained previously, display processor 70 converts the formatted composite image data into conventional luminance and chrominance components. Further, processor 70 processes the luminance and chrominance components in a conventional manner, along with timing data provided via controller 115, to form an NTSC signal that is displayed on NTSC-compatible image reproduction device 75.

Second architecture of processor 25

In a second configuration, processor 25 of FIG. 1 obtains web page data received from decoder 30 transmitted in a satellite broadcast in response to an information request to a service provider via a telephone line. Upon a user requesting web page data, such as by highlighting the web page icon 857 in fig. 2, the controller 115 (fig. 1) uses the request access data (telephone number, request web page identifier code (e.g., URL) and conditional access data) to establish communication with the satellite broadcast service provider.

Before establishing communication with the service provider, the controller 115 determines from the conditional access information whether access to the requested web page information is authorized. Authorization may be determined directly from the program guide conditional access information or directly from a user entitlement device in the processor 25, such as a smartcard (not shown for simplicity). If access is authorized, the controller 115 establishes telephone communication with the satellite broadcast service provider by dialing a telephone number via the modem 80 and transmitting the requested information, e.g., as a requested web page identifier code (e.g., URL), along with the user rights code. The service provider combines the requested web page information in a transport data stream that is sent via antenna 10, processor 20 and decoder 30 to processor 25. Controller 115 uses the response access data (PID of web page data, number of response program channels, and number of transponders) to identify and assemble web page packets in the transport stream as described in the first configuration for processor 25.

PID values responsive to web page information and corresponding program map information may be communicated between the service provider and the processor in a variety of ways and in a variety of data formats. For example, the PID values and program map information may be conveyed in non-MPEG data such as in MPEG user definable data elements or in vertical blanking intervals (overscan areas) such as broadcast television signals, depending on the uniqueness or customization requirements of the particular system. Also, the PID values assigned to the web information may be passed to the processor 25 with additional program guide information. Alternatively, the PID value to be used for the response data may be determined by the service provider from information from the processor 25.

Third architecture for processor 25

In a third configuration, processor 25 requests information and receives response information over the same communication link, e.g., a telephone link to server 83 or connection service 87 via modem 80. In this configuration, for example, controller 115 requests internet web page information via highlight icon 857 (fig. 2). The controller 115 (fig. 1) then uses the request access data (telephone number and URL code and conditional access data) to establish internet access and request web page data at the URL address via the modem 80 and the server 83. The controller 115 determines from the conditional access or smart card user entitlement information described with respect to the second configuration of the processor 25 whether the requested internet access is authorized. If authorized, for example, by dialing the telephone number using the modem 80 and sending the internet URL address code and user entitlement code, as previously described, the controller 115 establishes telephone communication with the service provider via the server 83. The controller 115 uses the response access data (including transmission control protocol/internet protocol (TCP/IP) identification data) determined from the composite program map information to identify and assemble a web page TCP/IP cluster containing the web page HTML and associated JAVA data (and other data such as JPEG, GIF, TIF type data) in the response data stream from the server 83.

TCP/IP packets are buffered in the modem 80 in response to the web page and provided to HTML under the command control of the controller 115^TMA processor 60. Processor 60 decodes HTML^TMAnd JAVA^TMEncodes the web response information and provides web page image representative pixel data for storage in memory within controller 115. Controller 115 retrieves the web page image pixel data from internal memory and formats it for storage in overlapping pixel representation memory contained in display processor 70 for rendering by unit 75 as described above in connection with the merged display of data. In this configuration, processor 25 uses the displayed program guideServer 83 supports all internet access. For example, based on user highlight icon 810, followed by icon 830 (FIG. 2), controller 115 (FIG. 1) performs web page browser functions and displays a custom web page browser or a network browser Navigator such as to obtain full Internet access^TMIs displayed on the standard browser.

Additionally, in a third configuration, processor 25 may support limited Internet services. In this case, access to the internet network via the server 83 is under the control of the service provider, allowing only indirect internet access. The service provider provides categorized web page information for display compatible with the displayed composite program guide. The service provider stores a limited number of web pages locally within server 83 that are accessible by processor 25 using composite program mapping information that provides an index to the available web pages and their corresponding predetermined PIDs. In addition, the service provider may change the selection of web pages obtained from server 83 and periodically provide the modified compatible additional program guide information to processor 25 via the satellite broadcast data stream.

The additional program guide information enables processor 25 to form a modified display guide and compatible program maps and other access information that enables the user to access the modified web information. By storing the web page internet information locally in server 83, the service provider maintains control over the internet content available to the user and is able to bill the user for the provided material. Moreover, the local storage of web page information in server 83 provides users with faster access to the information without the full delay associated with standard internet access. Furthermore, because only a limited amount of Internet information is requested and processor 25 need only communicate with a local server, such as server 83, the burden on processor 25 to transmit information requesting external devices is minimized. It should be noted that the modem 80 may also be a broadband communications modem such as a cable modem. In this case, processor 25 may decode, via modem 80, web page data and broadcast video program data for display from a cable program information source.

Controller 115 generates a display program guide by processing and formatting the received program guide information, which already includes user-selected menu options, using the method illustrated in fig. 4. For example, the process of FIG. 4 does not require that processor 25 form a user selection menu option and that processor 25 in the first configuration may use it. At step 205, with the start of step 200, processor 25 receives a transport data stream from decoder 30 that incorporates user selectable menu options for display as part of displaying a program guide. The user selectable options support user activation of communication functions such as email, telephone, internet access, fax, video phone, channel tuning, program recording, and home control functions.

The data received in step 205 also includes additional linking data in the program guide information. The additional link data includes program map, conditional access, and network information and associates the access data with displaying user selectable menu options in the program guide. The access data includes an identification code, a communication protocol code, a conditional access code, an internet access code such as a URL code for web pages and e-mail and telephone and fax numbers. The additional linking data enables the processor to assemble, decode and display program content and program guide information from the transport stream from decoder 30. The access data enables the processor 25 to communicate with external devices and includes different address representation codes corresponding to the addresses of different information sources. In step 210, controller 115 uses the predetermined link data PID values stored in the internal memory of direction processor 25 to identify and obtain link and access data from the received program guide information. At step 215, the obtained link data is assembled, formatted and stored in the internal memory by the controller 115. Also, in step 210, additional link data such as an internet address or an e-mail address or a phone number may be input by a user via an input device such as a remote control unit, and the additional data is synthesized to receive the link data through the controller 115.

The program guide information containing the user selectable options is formatted for display by controller 115 in conjunction with display processor 70 within processor 25 at step 220, as previously described in conjunction with fig. 1. At step 225, display processor 70 converts the stored and formatted program guide data into conventional luminance and chrominance components. The luminance and chrominance components, as well as timing data provided by controller 115, are processed by processor 70 for display on rendering device 75. The process of fig. 4 ends at step 230.

The controller 115 (fig. 1) uses the method illustrated in fig. 5 to generate a program guide at the video decoder from information received from a plurality of information sources. The formed guide supports user selectable communication functions such as internet access, e-mail, fax, etc. At step 305, following the start at step 300, controller 115 obtains Satellite Program Guide (SPG) information from the satellite broadcast transport stream received at decoder 30 via processor 25. At step 310, controller 115 obtains DVD Program Guide (DPG) information from storage device 90 via interface 95. Controller 115 obtains, classifies and formats the SPG and DPG by accessing and assembling respective data packets to generate SPG and DPG representative pixel data for storage as a composite program guide in the element 70 pixel map, as previously described in connection with fig. 1. The SPG and DPG information includes link and access data in the form of program maps, conditional access, and network information. In other configurations, processor 25 applies the principles enumerated herein to form a composite program guide that includes program guide information derived from information sources such as terrestrial broadcast information sources, cable broadcast information sources, computer information sources, radio frequency transmission information sources, and information sources accessed via telephone lines.

At step 315, controller 115 creates a user selectable menu option for display in the form of pixel data (for user selection for Internet access, e-mail, fax, etc.) in conjunction with the cell 70 pixel memory map. At step 315, controller 115 also creates menu options that may be determined by the user so that the user customizes his program guide including an icon to complete the particular user request function, e.g., an icon that the user may obtain access to a particular internet site or cause the display of all received messages. Controller 115 responds to commands entered via a data entry device, such as a remote control unit or keyboard, in creating user definable menu options according to programmed instructions.

At step 320, the controller 115 reviews the omission and contradiction of data identifiers (e.g., PIDs) for the SPG and DPG information. At step 325, the controller 115 reprograms the existing data identifiers and assigns new data identifiers as required to generate compatible program map information for the categorized program guide information and associated program content. At step 330, controller 115 forms a composite program map, conditional access, and network information for the composite program guide in the manner described in connection with fig. 1.

Forming the composite program map enables processor 25 to perform communication functions selectable via the composite program guide. To this end, the composite program map associates communication function PIDs and menu options (e.g., web pages, e-mail, fax icons) with different address representations corresponding to the addresses of different information sources. Controller 115 also incorporates user input data into the composite program map, conditional access, and network information at step 330. The data may include items such as email addresses, telephone/fax numbers, internet web page link addresses, credit card numbers, and the like. The user enters this data into the processor 25 via a device such as a remote control or keyboard. At step 335, controller 115 formats the SPG and DPG pixel data and the menu option pixel data in the element 70 pixel map created at step 315 to form a composite program guide for display.

The composite program guide information containing the user selectable menu options is formatted for display at step 340 and output at step 345 as previously described in connection with fig. 1. The process of fig. 5 ends at step 350.

Controller 115 (fig. 1) uses the process of fig. 6 to automatically obtain and sort program guide information from a plurality of information sources to form a composite program guide for display. At step 405, controller 115 obtains and stores Satellite Program Guide (SPG) information from the satellite broadcast transport stream received by processor 25 from decoder 30, beginning at step 400. At step 415, controller 115 automatically initiates communication with DVD storage device 90 (FIG. 1) via interface 95. The communication is initiated upon powering up of the processor 25 in response to pre-stored hardware configuration information attached to the processor 25 defining the peripheral devices and associated communication protocols. This information may be included in the received program guide information or may be stored in processor 25 at the time of manufacture or may be determined locally by processor 25 or may be determined by a combination of these methods. The local determination of the hardware configuration by the processor 25 may be accomplished by a peripheral interrogation initiated by the controller 115 or by user data entry of hardware configuration data.

In another embodiment, the communication may be initiated automatically based on conditions such as, for example, A) a user command selected via a program guide option, B) peripheral interrogation initiated by the puller 115 on a periodic or intermittent basis, or C) detection by the processor 25 of a new or changed electrical connection to a peripheral device such as the DVD device 90.

Controller 115 initiates communication with DVD unit 90 via interface 95 using the communication protocol code, identification code, authorization code, and conditional access code retrieved from the access data of the received program guide information. At step 420, controller 115 controls processor 25 to obtain and assemble DVD Program Guide (DPG) information from DVD storage device 90 via interface 95 in the manner previously described in connection with fig. 1. At step 425, the controller 115 classifies the SPG and DPG information by mapping the SPG and DPG information to topics and topics in the corresponding topic and topic categories in the main group, as also described in connection with FIG. 1. Further, at step 425, the controller 115 classifies the SPG and DPG information according to the information sources and assigns different color attributes to programs and program icons from different information sources. In addition, the controller 115 creates menu options that allow the user to sort by information source and color.

Fig. 7 shows a black and white representation of a color program guide display format in accordance with the present invention, showing menu options created by controller 115 that allow a user to sort programs according to information source and color attributes. The source icons 905 and 925 are associated with off-air broadcasts, cable, radio, satellite, and storage (e.g., the DVD information source 90 of fig. 1), respectively. Source icons 930-950 are associated with email, phone, video phone, fax, and Internet function sources, respectively. For example, upon the user illuminating the information source icon 905, a program guide is displayed showing the off-air programming and associated icons. Similarly, for example, upon the user illuminating the information source icon 930, a program guide is displayed, an email icon is presented, through which the user can activate menus for initiating composing and sending email messages and reading and deleting received messages.

Icon 900 is a "rainbow" class icon that represents the spectrum (spectrum) of discrete color blocks represented by the gray shading in the black and white program guide description of fig. 7. The color selection of the icon 900 may be alternately configured in a continuous spectrum of colors or in a range of color selections of a single or several discrete color blocks. Based on the particular color in user highlight icon 900, the program from the information source having the attribute of that particular color is displayed. For example, assume that controller 115 assigns a purple color to DVD information source device 90 at step 425 and then, based on the purple color in user highlight icon 900, the movies available from DVD device 90 are displayed as program guides. In addition, the color classification theme may be used to identify programs based on other criteria that are not sources of information. For example, color may be used as an attribute that identifies a program by topic or theme, in which case, for example, the display of available movies for viewing from all information sources may be identified by the red color in the highlight icon 900. In addition, the program guide data may be classified by attributes rather than colors. For example, programs from different information sources may have attributes marked with different types of shading or different icon shading and geometry.

Continuing with the process of fig. 6, at step 430, controller 115 forms a composite program guide for display from the categorized SPG and DPG information in a manner similar to that described in connection with fig. 1. Controller 115 also creates for display, at step 425, the relevant user selectable menu options including user selectable program guide options based on the information source and color. The created menu options are synthesized by controller 115 into a composite program guide for display at step 430 as illustrated in fig. 7. At step 435, the controller 115 formats the composite program guide information for display, as previously described in connection with fig. 1. The process of fig. 6 ends at step 440.

Controller 115 (fig. 1) uses the process of fig. 8 to obtain web page information requested by the video receiver user through selections made by options on the displayed program guide. At step 505, the controller 115 retrieves access data in the form of a telephone number and an internet URL code from memory, for example, in response to a user selection of a web page made via the displayed program guide, as at the beginning of step 500. Access data associated with a particular user selection is determined from a program guide database using program mapping information linking all data associated with a particular program or program guide function.

At step 515, controller 115 controls processor 25 to establish the requested communication link with server 83 by dialing the retrieved telephone number using modem 80. In addition, at step 515, processor 25 encodes and transmits additional access data, such as an internet URL code, using the protocol required for communication over the requested communication link. The required protocol is determined from the program mapping information. At step 520, controller 115 controls processor 25 to receive and decode input signals received over the response communication link. At steps 525 and 530, controller 115 controls processor 25 to identify and retrieve responsive web page information from the input signal. At steps 525 and 530, processor 25 uses a different method of retrieving response data from the input signal. The method selected depends on whether the response communication link is the same link used for the web page data request. The method for identifying and retrieving response data is similar to that previously described in connection with the three structures of processor 25. At step 525, the controller 115 applies a suitable structural method to identify responsive web page data in the input signal. To this end, controller 115 uses a data identifier that is determined from identifying program mapping information that associates the identifier with the user program guide selection. At step 535, the controller 115 formats the response web page information for display, and the process of FIG. 8 ends at step 540.

Controller 115 (fig. 1) uses the process of fig. 9 for decoding incoming internet information and compressed video data to form a composite video output for display. Following the start of step 600, the controller 115 determines a packet identifier from the program map information for the internet data and compressed image data requested by the user at step 605. At step 607, controller 115 determines from the conditional access or smart card user entitlement information whether access to the compressed video data and the requested internet data is authorized, as previously described in connection with the third configuration of processor 25.

If access is authorized, controller 115 identifies a web page TCP/IP packet containing web page data in the response data stream from server 83 at step 610. Similarly, if access is authorized, controller 115 identifies compressed video data packets containing the user-selected video program in the input transport stream from decoder 30 to processor 25 at step 616. In a similar manner as described in connection with fig. 1, the controller 115 identifies web pages and compressed video data packets.

At step 617, if encrypted, controller 115 controls processor 25 (fig. 1) to decrypt the internet or compressed video data. Using HTML^TMProcessor 60, controller 115 controls processor 25 to decode the identified internet web page data at step 620. Using the MPEG decoder 65, the controller 115 controls the processor 25 to decompress the identified compressed video data at step 625. At step 630, the resulting decoded web page data and decompressed video data are data consolidated, formatted and displayed on unit 75 using display processor 70 under the control of controller 115. The process of fig. 9 ends at step 640.

The structure of fig. 1 is not exclusive. Other structures that accomplish the same objectives may be obtained in accordance with the principles of the present invention. Moreover, the functions of the elements of the processor 25 of FIG. 1 and the process steps of FIGS. 4-6, 8, and 9 may be implemented in whole or in part in the programming instructions of a microprocessor. In addition, the principles of the present invention are applicable to any form of MPEG or non-MPEG compatible electronic program guide. Moreover, the principles of the present invention are applicable to communications in accordance with any form of communications link, including communications via cable, infrared, radio frequency, microwave, and via computer networks. Additionally, it should be noted that the formation of the composite program guide described herein may be implemented from a location remote from the video receiver and accessed through the receiver via a communications network.

Claims (9)

1. A method for collating program guide information in a video decoder system receiving program guide information from a first source, comprising the steps of:

a) displaying a selectable program guide menu cursor;

b) sorting program guide information items from the first source by sorting display attributes according to selection of the menu cursor, the display attributes being assigned to the sorting of program guide information items and the display attributes being common to the sorting and the menu cursor; and

c) and displaying the sorted program guide information items.

2. The method of claim 1, wherein:

the display attribute represents at least one of: (a) color, (b) shading, and (c) geometry.

3. The method of claim 1, wherein in the finishing step:

the classification of the program guide information entries includes entries relating to at least one of:

(a) a particular source, (b) a particular function, (c) particular program content.

4. A process according to claim 3, wherein in the finishing step:

the classification of the program guide information entry includes an entry associated with the particular function, and the included entry includes an entry associated with at least one of: (a) email, (b) fax, (c) telephone, and (d) video telephone.

5. A process according to claim 3, wherein in the finishing step:

the classification of the program guide information entry includes an entry associated with the particular function, and the included entry includes an entry relating to at least one of (a) a program topic and (b) a program topic.

6. The method of claim 1, further comprising the steps of:

assigning a plurality of display attributes to a corresponding plurality of categories of program guide information items, an

The classification of the program guide information items is arranged hierarchically.

7. The method of claim 1, further comprising the steps of:

receiving program guide information from a second source;

assigning display attributes from the first source and the second source to categories of program guide information items; and

sorting the program guide information items from the first source and the second source by display attributes according to the selection of the menu cursor.

8. The method of claim 1, further comprising the steps of:

program map information is formed for associating the display attributes with the programs listed in the program guide information entry.

9. The method of claim 1, further comprising the steps of:

program mapping information is formed for associating the display attribute with the displayed selectable program guide menu cursor.