HK1082112B - Method and apparatus for processing a markup document in a interactive mode - Google Patents

Description

Method and apparatus for processing markup document in interactive mode

Technical Field

The present invention relates to an information storage medium including device aspect ratio information of a markup document, and a method and apparatus for playing back Audio and Video (AV) data in an interactive mode using the markup document.

Background

Generally, a markup document is written in a markup language such as hypertext markup language (HTML), etc. The markup document can be recorded on or played back from, for example, a Digital Versatile Disc (DVD) via a Personal Computer (PC). Such DVDs are commercially available. Among these DVDs, interactive DVDs support an interactive mode to show markup document-based AV content. Typically, content recorded on an interactive DVD can be played back in two modes. One of the two modes is a video mode, and the content is displayed in the video mode from a general DVD. Another mode is an interactive mode, and contents are displayed through a display window defined by a markup document. For example, in the case where the user selects the interactive mode, the web browser of the personal computer displays a markup document recorded on an interactive DVD, and a display window defined by the markup document displays content selected by the user. In other words, AV pictures are obtained from AV data, and markup pictures are obtained from a markup document. An AV picture can be embedded in the markup picture to display an interactive picture in an interactive mode.

For example, in the case where the contents correspond to a movie made of AV data, the movie made of AV data may be represented in an AV picture, and various types of additional information, such as a script, a plot, a photograph of an actor or actress, and the like, may be displayed in a markup picture. The additional information may include a variety of source files, such as image files, text files, animation files, and the like.

Fig. 1A, 1B, 1C, and 1D show picture types displayed on a display device during playback from a conventional DVD. In particular, FIG. 1A shows a picture having a 4: 3 aspect ratio. Fig. 1B shows a 4: 3 mailbox (lettox) screen in which a blank marked with a slant line appears at the upper and lower portions thereof in the case where a 16: 9 source screen is displayed on a 4: 3 screen of a display device, and fig. 1C shows a 4: 3 pan-scan (pan-scan) screen overcoming the disadvantage of size reduction of actual content in the 4: 3 mailbox screen. In other words, the relatively insignificant side portions of the 16: 9 source picture are cut away to display the remaining source picture as a 4: 3 picture. That is, only a portion of the source screen is displayed to the user in a 4: 3 mailbox screen, and the cut-out portion is not displayed to the user. The quality of the 4: 3 panning scan picture depends on how to determine the portion to be cut out, i.e., the user skill. FIG. 1D shows a 16: 9 picture.

In the conventional art, the interactive screen is fixedly displayed as one of the screens of fig. 1A, 1B, 1C and 1D. In this case, the markup document recorded on the interactive DVD is displayed on a display device having a screen with an aspect ratio not suitable for the markup document, and a part of data, for example, text, graphics, etc., in the markup picture can be distorted.

Fig. 2A and 2B show an example of a markup document produced as a 16: 9 source picture displayed on a 4: 3 mailbox picture as a modified form. FIG. 2A shows an example where a 16: 9 source picture is displayed on a 16: 9 screen, and FIG. 2B shows an example where a 16: 9 source picture is displayed as a 4: 3 mailbox picture. As shown in fig. 2B, the size of the AV picture is reduced, however, a markup picture including text, graphics, and the like written in HTML is displayed as it is. Thus, a portion of text, graphics, etc. may cover a blank portion of the 4: 3 mailbox area and may not be displayed to the user.

Disclosure of Invention

Accordingly, an aspect of the present invention provides an information storage medium including device aspect ratio information of a markup document, and a method and apparatus for displaying an interactive picture using the device aspect ratio information.

Additional aspects and/or advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

To achieve the foregoing and/or other aspects of the present invention, there is provided an information storage medium including video data and a markup document for playing back the video data in an interactive mode, wherein the markup document includes device-aspect-ratio information to display the markup document with reference to the information.

The device-aspect-ratio information may be information on an aspect ratio of a target display device that wants to display the markup document in the interactive mode. The device screen aspect ratio information may be provided according to the design of a markup document producer.

The device-aspect-ratio information may be indication information for converting a source markup picture, which is obtained from a markup document, into a markup picture of a predetermined aspect ratio.

To achieve the foregoing and/or other aspects of the present invention, there is provided a method of displaying an interactive picture using a markup document and Audio Video (AV) data, the method including: obtaining screen aspect ratio information of a device corresponding to the markup document; obtaining a markup picture from a markup document according to device aspect ratio information; an AV picture is obtained from AV data and an interactive picture including a combination of the AV picture and a markup picture is displayed.

The device aspect ratio information may be included in the markup document.

The obtaining of the device-aspect-ratio information may include reading information about an aspect ratio of a target display device that wants to display the markup document in the interactive mode.

The obtaining of the device-aspect-ratio information may include analyzing device-aspect-ratio information written in the markup document using an attribute of a tag (tag).

The obtaining of the markup picture may include converting a source markup picture, which is obtained from the markup document, into a markup picture of a predetermined screen aspect ratio according to the device-aspect-ratio information.

The obtaining of the markup picture may include measuring the source markup picture to output a markup picture corresponding to the device-aspect-ratio information, so that the target device substantially displays the markup document in response to information about the screen aspect ratio of the target device different from the screen-aspect-ratio information.

To achieve the above and/or other aspects of the present invention, there is provided a method of processing a markup document in an interactive mode, the method including: determining whether device aspect ratio information is included in the markup document, the device aspect ratio information being data including information on an aspect ratio of a target display device that wants to display the markup document in an interactive mode; and processing the markup document according to the device-aspect-ratio information in response to the device-aspect-ratio information included in the markup document.

The processing of the markup document may include converting a source markup picture obtained from the markup document according to the device-aspect-ratio information to respond to the screen-aspect-ratio information of a target device displaying the markup document, which is different from the device-aspect-ratio information, and outputting the source markup picture as it is to respond to the screen-aspect-ratio information of the target device corresponding to the device-aspect-ratio information.

To achieve the above and/or other aspects of the present invention, there is provided a method of processing a source markup picture of a markup document and a source Audio Video (AV) picture of AV data in an interactive mode, the method including: obtaining AV picture type selection information; determining whether device-aspect-ratio information is included in a markup document; converting the source AV picture and outputting the source markup picture as it is in response to device-aspect-ratio information not included in the markup document according to the AV picture type selection information; and converts the source AV picture and the source markup picture according to the AV picture type selection information and the device aspect ratio information, respectively, in response to the device aspect ratio information included in the markup document.

To achieve the above and/or other aspects of the present invention, there is provided an apparatus for processing Audio and Video (AV) data in an interactive mode using a markup document, comprising: an AV playback engine and an enhanced audio and video (ENAV) engine. The AV playback engine decodes AV data to output AV pictures. The ENAV engine interprets the markup document to obtain a source markup picture, converts the source markup picture into a markup picture, combines the markup picture and the AV picture, and outputs an interactive picture including the markup picture and the AV picture.

The ENAV engine may read device-aspect-ratio information included in the markup document and obtain a markup picture based on the device-aspect-ratio information.

The ENAV engine may obtain device-aspect-ratio information about an aspect ratio of a screen of a target display device that wants to display the markup document in the interactive mode.

The ENAV engine may analyze device aspect ratio information written in the markup document using the attribute of the tag.

The ENAV engine may convert the source markup picture into a markup picture having a predetermined aspect ratio according to device aspect ratio information of the markup document.

To achieve the above and/or other aspects of the present invention, there is provided an apparatus for processing a markup document in an interactive mode, comprising: a controller for outputting a markup picture of a markup document and a video picture of audio video data in an interactive mode; and a markup converter for converting the markup picture according to device-aspect-ratio information corresponding to the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device intended to display the markup document.

The markup converter may measure the markup picture according to the device-aspect-ratio information in response to the screen-aspect-ratio information of a target device displaying the markup document different from the device-aspect-ratio information, and output the markup picture as it is in response to the screen-aspect-ratio information of the target device corresponding to the device-aspect-ratio information.

To achieve the above and/or other aspects of the present invention, there is provided a computer-readable medium encoded with operating instructions for implementing a method of displaying an interactive picture by using a markup document and Audio Video (AV) data, the method comprising: obtaining device-aspect-ratio information corresponding to the markup document; obtaining a markup picture from a markup document according to device-aspect-ratio information; obtaining an AV picture from the AV data, and displaying an interactive picture including the combined AV picture and markup picture.

To achieve the above and/or other aspects of the present invention, there is provided a computer-readable medium encoded with operating instructions for implementing a method of processing a markup document in an interactive mode, the method comprising: determining whether device-aspect-ratio information is included in the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display apparatus that wants to display the markup document in an interactive mode; the markup document is processed according to the device-aspect-ratio information in response to the device-aspect-ratio information included in the markup document.

To achieve the above and/or other aspects of the present invention, there is provided a method of using a markup document in a computer system to process Audio Video (AV) data in an interactive mode, the method comprising: controlling an AV playback engine to obtain a video picture of AV data; and controlling an enhanced audio and video (ENAV) engine to convert a markup picture of the markup document according to device-aspect-ratio information corresponding to the markup document, the device-aspect-ratio information being information including an aspect ratio of a target display device that wants to display the markup document in an interactive mode.

Drawings

FIGS. 1A, 1B, 1C and 1D are views showing types of pictures displayed on a display device during playback from a conventional interactive DVD;

FIG. 2A is a view showing a markup document produced as a 16: 9 source picture;

FIG. 2B is a view showing an example in which the markup document of FIG. 2A is displayed as a 4: 3 mailbox screen as a modified form;

FIG. 3 is a diagram of a playback system according to an embodiment of the present invention;

fig. 4 is a block diagram illustrating a volume space of the optical disc 100 of fig. 3;

fig. 5 is a root diagram illustrating a directory structure of the optical disc 100 according to an embodiment of the present invention;

fig. 6 is a block diagram of the playback apparatus 200 of fig. 3;

fig. 7 is a detailed block diagram of the AV playback engine 2 and the enhanced AV (enav) engine 3 of fig. 6;

FIG. 8 shows a block diagram of the operation of the tag converter 31 of FIG. 7;

FIG. 9 illustrates a flowchart of a method of converting a source markup picture according to device aspect ratio information according to an embodiment of the present invention;

fig. 10 shows a flowchart representing a method of converting a source markup picture and a source video picture according to an embodiment of the present invention.

Detailed Description

Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below in order to explain the present invention by referring to the figures.

The "markup document" is data recorded to support an interactive mode. Markup documents relate to: for example, a markup document written in markup language and/or script code, a script code file and a program file linked to the markup document or otherwise provided, and a source file such as an audio file, an animation file, an image file, or a source file linked to and displayed by the markup document. In other words, the markup document serves as an application program required to play back the AV data in the interactive mode and as additional content provided with the AV data.

Fig. 3 shows a playback system according to an embodiment of the present invention. The playback system includes a playback apparatus 200, a display apparatus, for example, a Television (TV) monitor 300, and a remote controller 400. The remote control 400 may be used as a user input device. The information storage medium, for example, the optical disc 100, supports the interactive mode. According to an embodiment of the present invention, an information storage medium includes: a markup document including device-aspect-ratio information. The device aspect ratio information is used to display the markup document.

The remote controller 400 receives a control command from a user and transmits the control command to the playback apparatus 200. The playback apparatus 200 plays back AV data recorded on the optical disc 100 in an interactive mode. That is, in the case where the optical disc 100 is loaded in a DVD drive and the user selects an interactive mode, the playback apparatus 200 plays back AV data from the optical disc 100 and transmits the AV data to the TV monitor 300. The TV monitor 300 displays a markup picture obtained from a markup document together with an AV picture obtained from AV data. "interactive picture" refers to a combination of an AV picture and a markup picture.

The "interactive mode" refers to a mode in which an AV picture is displayed in a display window defined by a markup document. In other words, the interactive mode refers to a mode in which an AV picture is embedded in a markup picture to be displayed as an interactive picture. Here, the AV picture refers to DVD video data recorded on the optical disc 100, played back by the playback apparatus 200, and displayed on the TV monitor 300. The markup picture refers to a markup document recorded on the optical disc 100, interpreted and executed by the playback apparatus 200, and displayed on the TV monitor 300. "video mode" refers to a mode in which AV data is played back according to the DVD-video standard. In other words, the video mode refers to a mode in which only AV pictures obtained from AV data playback are displayed. According to an embodiment of the present invention, the playback apparatus 200 supports an interactive mode and a video mode, and can obtain AV data and/or interactive data via a network such as the internet.

The playback apparatus 200 outputs the markup picture as it is or converts the markup picture according to the apparatus aspect ratio information of the markup document. For example, the device-aspect-ratio information refers to information on an aspect ratio of a display device that wants to display a markup document in an interactive mode. The pictures before being converted refer to source markup pictures and/or source AV pictures, and the pictures which are finally displayed to the user, converted or not, are referred to as markup pictures and/or AV pictures. According to an aspect of the present invention, the playback apparatus 200 checks the screen aspect ratio of the target apparatus, i.e., the actual screen aspect ratio of the TV monitor 300, and even if the actual screen aspect ratio of the TV monitor 300 is different from the apparatus screen aspect ratio information in the markup document, the playback apparatus 200 measures and outputs the markup picture so as to be suitable/corresponding to the apparatus screen aspect ratio information.

According to an embodiment of the present invention, in a case where a source markup picture is intended to be prescribed for display on a display device having a screen width to height ratio of 16: 9, a markup document includes device screen width to height ratio information corresponding to 16: 9 according to, for example, the design of a markup document content producer. In this case, when the actual display device has an actual screen width-to-height ratio of 16: 9, the markup document is displayed as it is. In the case where the actual display device has an actual screen width-to-height ratio, for example, 4: 3, the source markup picture is converted to fit the actual display of 4: 3 according to the device screen width-to-height ratio information corresponding to 16: 9.

The user can set display information in the playback apparatus 200 through the controller 400 or an On Screen Display (OSD) menu. The display information includes: AV picture type selection information to select a type of AV picture to be displayed to a user in a video mode or an interactive mode. In an embodiment of the present invention, the displayable types of the frames include a 4: 3 frame, a 16: 9 frame, a 4: 3 mailbox frame, and a 4: 3 panning scan frame.

Fig. 4 illustrates a volume space of the optical disc 100 of fig. 3 according to an embodiment of the present invention. The volume space includes: volume and file structure area, DVD video data area, interactive data area, and other data areas. Information on volumes and files is recorded in the volume and file structure area, and AV data recorded in the DVD-video format, for example, a video title is included in the DVD-video data area. The interactive data area includes a markup document file in support of an interactive mode.

The DVD-video data area may further include: ifo for controlling playback of the entire set of VIDEO titles recorded on the optical disc 100; control information VTS _01_0.IFO for controlling playback of a first set of video titles; and AV data VTS _01_0.VOB, VTS _01_1.VOB,. and VTS _01_ n. The AV data VTS _01_0.VOB, VTS _01_1.VOB,. and VTS _01_ n. VOB refer to a video title, i.e., a video object VOB. Each video object VOB comprises a video object unit VOBU in which navigation packs, video packs, and audio packs are packed. The detailed structure of the video object VOB is described in the DVD video standard (DVD video for read-only storage disc 1.0).

The interactive data area stores a plurality of markup document files. In other words, the interactive data area stores a start-up file that is first read in response to a selected interactive mode, a markup document corresponding to a selected video title, and the like. As described above, according to an aspect of the present invention, interactive data is written in a plurality of markup document files. As described above, the markup document file refers to: markup documents, script code files, program files, style sheets defining styles of the markup documents, and source files linked to and displayed through the markup documents, for example, audio files, animation files, image files, and the like.

Fig. 5 illustrates a directory structure of the optical disc 100 according to an embodiment of the present invention. Referring to fig. 5, the root directory includes: a DVD-VIDEO directory VIDEO _ TS, and an ENAV directory DVD-ENAV in which interactive data is recorded to support an interactive mode. Although not explained in detail, the root directory may further include other directories and other files.

The DVD VIDEO directory VIDEO _ TS stores control information (VIDEO _ TS. IFO and VTS _01_0.IFO), AV data (VTS _01_0.VOB, VTS _01_1.VOB,. and VTS _01_ n. VOB), and the like. The ENAV directory DVD-ENAV stores startup files (start.

Fig. 6 illustrates the playback device 200 of fig. 3 according to an embodiment of the present invention. The playback apparatus 200 includes a reader 1, an AV playback engine 2, and an ENAV engine 3. The reader 1 reads AV data, i.e., DVD-video data and a markup document, from the optical disc 100 according to a control signal output by the ENAV engine 3.

The AV playback engine 2 plays back the read AV data. According to the embodiment of the present embodiment, in the case where AV data is recorded as DVD-video data, the AV playback engine 2 can be implemented as a DVD-video playback engine that plays back DVD-video data. Specifically, the AV playback engine 2 converts the AV picture with reference to AV picture type selection information set in the playback apparatus 200.

The ENAV engine 3 interprets and executes the markup document to play back the DVD-video data recorded on the optical disc 100 in an interactive mode. The ENAV engine 3 mixes and outputs the DVD video data stream and the interpreted markup document from the AV playback engine 2. The TV monitor 300 then displays the markup picture embedded with the AV picture. Although not shown, the ENAV engine 3 may include a plurality of plug-ins for helping to open files of various formats included in or linked to the markup document. For example, the ENAV engine 3 may call a Windows multimedia player to play AV data that can be displayed only in the Windows multimedia player. The ENAV engine 3 may also be connected to a network to obtain necessary information such as ENAV files and the like.

Specifically, the ENAV engine 3 reads the device-aspect-ratio information in the markup document, and converts the source markup picture or outputs the source markup picture as it is with reference to the device-aspect-ratio information. The ENAV engine 3 checks the actual screen aspect ratio of the TV monitor 300, i.e., the target screen aspect ratio information, and in the case where the screen aspect ratio information is different from the target screen aspect ratio information, the ENAV engine 3 measures and outputs the markup picture so as to correspond to the device screen aspect ratio information.

The AV playback engine 2 communicates with the ENAV engine 3 via an Application Program Interface (API). For example, the AV playback engine 2 notifies the engine 3 of its status in response to a request of the ENAV engine 3, and sends a "trigger" to the ENAV engine 3. For example, in the case where a war field of the movie star wars is displayed in the AV picture in the interactive mode, the ENAV engine 3 is notified by the trigger, and before or after the war field is displayed, a test corresponding to the war field is to be displayed in the interactive mode.

Fig. 7 illustrates the AV playback engine 2 and ENAV engine 3 of fig. 6 according to an embodiment of the present invention. The AV playback engine 2 includes a video switcher 21, and the ENAV engine 3 includes a markup switcher 31 and a video position and picture size controller 32.

The name of the source video picture is derived from the feature that only video data, not audio data, can be perceived by the user's visual organs. The user can sufficiently view the source video picture as an AV picture. The source sprite is obtained from the sprite data. The sub-picture data is defined according to the DVD-video standard. The source markup picture is obtained from a markup document.

The video converter 21 converts the source video picture into a video picture according to AV picture type selection information set by the user. In the case where the source video picture fits/corresponds to the AV picture type selection information, the video switcher 21 may output the source video picture as it is. Here, the source video picture is obtained by decoding AV data. The source sprite is added to the video picture.

The markup converter 31 converts a source markup picture into a markup picture according to device aspect ratio information of a markup document. In the case where the device aspect ratio information corresponds to the target device screen aspect ratio information, the video switcher 31 may output the source markup document picture as it is. When the device-aspect-ratio information is different from the target-aspect-ratio information, the markup converter 31 measures the source markup picture and outputs the markup picture based on the device-aspect-ratio information.

The video position and picture size controller 32 combines the markup picture and the video picture to output an interactive picture. Specifically, the video position and picture size controller 32 refers to the indication information to adjust the position and size of the AV picture to embed the AV picture in the markup picture. For example, the indication information is recorded in the markup document and provides an indication on the position and size of a video to be displayed.

Fig. 8 illustrates the operation of the flag converter 31 of fig. 7 according to an embodiment of the present invention. Referring to FIG. 8, a source markup picture has a screen width to height ratio of 1: 1, and a markup converter 31 converts the source markup picture into a markup picture having a screen width to height ratio of 4: 3 or 16: 9 with reference to device screen width to height information in a markup document. When the source markup picture has a screen width to height ratio of 4: 3 or 16: 9, the markup converter 31 converts the source markup picture into a markup picture having a screen width to height ratio of 16: 9 or 4: 3 with reference to the device screen width to height information.

When the device-aspect-ratio information is different from the target-aspect-ratio information, the markup converter 31 measures the source markup picture and outputs a markup picture suitable for the device-aspect-ratio information.

According to an embodiment of the present invention, the mark converter 31 may operate as follows. When the markup document includes device aspect ratio information for a 4: 3 ratio and the target display device, for example, the TV monitor 300, is a 4: 3 TV monitor, the source markup picture is output as it is. When the target display device is not a 4: 3 TV monitor, but is, for example, a 16: 9 TV monitor, the source markup picture is measured, and thus its output on the TV monitor has a 4: 3 screen width-to-height ratio.

According to another embodiment of the present invention, the markup document includes device-aspect-ratio information for a 16: 9 ratio, and the target display device, for example, the TV monitor 300 is a 16: 9 TV monitor, and the source markup picture is output as it is. Where the target display device is not a 16: 9 TV monitor, but is, for example, a 4: 3 TV monitor, the source markup picture can be measured so its output can have a 16: 9 screen aspect ratio on the TV monitor, for example, in a mailbox-based output setting.

In the present embodiment, although the display device, for example, the TV monitor 300 is described as a display device having a screen width aspect ratio of 4: 3 or 16: 9 and the device screen width aspect ratio information object in the markup document is a display device having a screen width aspect ratio of 4: 3 or 16: 9, it should be understood that the screen width aspect ratio may vary. Accordingly, the present invention is not limited to the above-described screen aspect ratios and may be applied to other screen aspect ratios without departing from the spirit and scope of the present invention.

Fig. 9 illustrates a method of converting a source markup picture according to an embodiment of the present invention. In operation 901, the ENAV engine 3 analyzes a markup document. In operation 902, the ENAV engine 3 determines whether device-aspect-ratio information is written in the markup document. In the case where the device-aspect-ratio information is written in the markup document, the ENAV engine 3 converts the source markup picture into a markup picture of an aspect ratio corresponding to the device-aspect-ratio information in operation 903.

Fig. 10 illustrates a method of converting a source markup picture and a source video picture according to another embodiment of the present invention. In operation 1001, the playback apparatus 200 reads AV picture type selection information of display information set by, for example, a user. In operation 1002, the playback device 200 searches for a markup document for device aspect ratio information. In operation 1003, the playback device 200 determines whether device aspect ratio information is written in a markup document. In the case where the device-aspect-ratio information is written in the markup document, the playback device 200 converts the source AV picture and the source markup picture based on the AV picture type selection information and the device-aspect-ratio information in operation 1004. In the case where the device-aspect-ratio information is not written in the markup document, the playback device 200 converts only the source AV picture based on the AV picture type selection information and outputs the source markup picture as it is in operation 1005.

An example of a markup document including device-aspect-ratio information is represented as follows:

<？xml version＝″1.0″encoding＝″UTF-8″？><！DOCTYPE html PUBLIC-//DVD/DTD XHTML DVD-HTML 1.0//EN″″http://www.dvdforum.org/enav/dvdhtml-1-0.dtd″><html><head><title>4x3PAGE</title><meta name＝″bestlook″content＝″4:3″/><script language＝″ecmascript″><！[CDATA[function onload_handler()

{idplayer.play()；idplayer.enableVideoTransform(0)；//if 0，disable video transformation，while if 1，enable video transformation.}]]></script></head><body id＝″docbody″onload＝″onload_handler()″><object style＝″position；absolute；left:150px；top:100px；width:370px；height:250px″data＝″dvd:video_ts″id＝″idplayer″/></body></html>

as shown in the above example, the markup document is inserted by using the tag < meta name ═ bestlook "content ═ aspect ratio" > device aspect ratio information. In the above example, an interactive screen may be displayed according to the design of the content producer by writing information on the aspect ratio of the target display device into the markup document.

Further examples of markup documents including device aspect ratio information are described below.

<？xml version＝″1.0″encoding＝″UTF-8″？><！DOCTYPE html PUBLIC-//DVD/DTD XHTML DVD-HTML1.0//EN″″http://www.dvdforum.org/enav/dvdhtml-1-0.dtd″><html><head><title>4x3PAGE</title><meta name＝″bestloo″ content＝″R720x480，A4x3″/><script language＝″ecmascript″><！[CDATA[

function onload_handler(){idplayer.play()；idplayer.enableVideoTransform(0)；//if 0，disable first video transformation，while if 1，enable first videotransformation.}]]></script></head><body id＝″docbody″onload＝″onload_handler()″><object style＝″position:absolute；left:150px；top:100px；width:370px；height:250px″data＝″dvd:video_ts″id＝″idplayer″/></body></html>

As shown in the above example, according to the embodiment of the present invention, in addition to the device-aspect-ratio information, a markup document is inserted by using the tag < meta name ═ bestlook "content ═ resolution information" > resolution information. In this case, the playback apparatus 200 displays the markup document according to resolution information provided by the design of the content producer.

Although the display apparatus has been described with respect to a TV monitor, the information storage medium has been described with respect to a DVD, it is to be understood that the present invention is not limited thereto. For example, other known or unknown storage media may include markup documents that include device aspect ratio information within the scope of the present invention. Further, although the display system has been described with respect to a playback apparatus, it should be understood that the present invention is applicable to, for example, a system having a playback apparatus that reproduces and/or records data with respect to an information storage medium.

It will be appreciated that systems employing the present invention also include permanent or removable memory such as magnetic or optical disks, RAM, ROM, and carrier wave media, etc., on which the processes and data structures of the present invention may be stored and distributed. Operations may also be distributed via, for example, downloads over a network such as the internet.

Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Industrial applicability

As described above, according to the present invention, information on the screen aspect ratio of the screen of the target display device can be written in the markup document. Referring to this information, the source markup picture can be converted into a markup picture.

According to an aspect of the present invention, an interactive picture including a markup document according to a design of a content producer is displayed in an interactive mode without distortion in position and size.

Claims (26)

1. A method of displaying an interactive picture using a markup document and audio-video data, the method comprising:

obtaining device-aspect-ratio information corresponding to the markup document;

obtaining a markup picture from a markup document such that the markup picture is suitable for a screen aspect ratio of a target display device, according to device screen aspect ratio information and screen aspect ratio information of the target display device;

obtaining an audio video picture from the audio video data; and

an interactive picture comprising a combination of an audio-visual picture and a markup picture is displayed.

2. The method of claim 1, wherein the obtaining of device aspect ratio information comprises: information on a screen aspect ratio of a target display device that wants to display a markup document in an interactive mode is read.

3. The method of claim 1, wherein the obtaining of device aspect ratio information comprises: information on a screen aspect ratio of a target display device that wants to display a markup document in an interactive mode according to a design of a markup document maker is read.

4. The method of claim 1, wherein the obtaining of device aspect ratio information comprises: the aspect ratio information written in the markup document by using the attribute of the tag is analyzed.

5. The method of claim 1, wherein the obtaining of the markup picture comprises: the source markup picture is converted into a markup picture having a predetermined screen aspect ratio according to the device screen aspect ratio information, and the source markup picture is obtained from the markup document.

6. The method of claim 1, wherein the obtaining of the markup picture comprises: the source markup picture is converted into a markup picture having a screen width aspect ratio of 4: 3 or 16: 9 according to the device screen width aspect ratio information, and the source markup picture is obtained from the markup document.

7. The method of claim 1, wherein the obtaining of the markup picture comprises: the source markup picture is converted to output a markup picture corresponding to the device-aspect-ratio information, such that the target display device displays the markup document and the source markup picture obtained from the markup document in response to the screen-aspect-ratio information of the target display device different from the device-aspect-ratio information.

8. The method of claim 7, wherein the target display device is a television monitor.

9. The method of claim 1, wherein the device aspect ratio information is included in a markup document.

10. The method of claim 1, wherein the displaying of the interactive screens further comprises: embedded information included in the markup document is obtained to combine the audio video picture and the markup picture.

11. The method of claim 1, wherein the obtaining of device aspect ratio information comprises: information on a screen aspect ratio of a target display device that wants to display a markup document and information on a resolution of the markup document are read, and the information on the screen aspect ratio and the information on the resolution are written in the markup document by using an attribute of a tag.

12. A method of processing a markup document in an interactive mode, the method comprising:

determining whether device aspect ratio information is included in the markup document, the device aspect ratio information being data including information on an aspect ratio of a target display device that wants to display the markup document in an interactive mode; and

the markup document is processed according to the device-screen-aspect-ratio information in response to the device-screen-aspect-ratio information included in the markup document,

wherein the processing of the markup document includes:

converting a source markup picture obtained from a markup document according to the device-aspect-ratio information in response to information about an aspect ratio of a target display device displaying the markup document, which is different from the device-aspect-ratio information; and

the source markup picture is output as it is in response to the screen aspect ratio information of the target display device corresponding to the device screen aspect ratio information.

13. A method of processing a source markup picture of a markup document and a source audio video picture of audio video data in an interactive mode, the method comprising:

obtaining audio and video picture type selection information;

determining whether device-aspect-ratio information is included in a markup document;

converting the source audio video picture according to the audio video picture type selection information and outputting the source markup picture as it is in response to the device aspect ratio information not included in the markup document; and

the source audio video picture and the source markup picture are converted according to the audio video picture type selection information and the device aspect ratio information, respectively, in response to the device aspect ratio information included in the markup document.

14. An apparatus for processing audio and/or video data in an interactive mode using a markup document, comprising:

an audio video playback engine to decode audio video data to output audio video pictures; and

an enhanced audio video engine interprets a markup document to obtain a source markup picture, converts the source markup picture into a markup picture according to device aspect ratio information contained in the markup document and a screen aspect ratio of a target display device such that the markup picture is suitable for actual display of the screen aspect ratio of the target display device, combines the markup picture and an audio video picture, and outputs an interactive picture including the markup picture and the audio video picture.

15. The apparatus of claim 14, wherein the enhanced audio video engine reads device-aspect-ratio information included in the markup document and obtains the markup picture according to the device-aspect-ratio information.

16. The apparatus of claim 14, wherein the enhanced audio video engine obtains device aspect ratio information, i.e., information of an aspect ratio of a screen of a target display device intended to display the markup document in the interactive mode.

17. The apparatus of claim 14, wherein the enhanced audio video engine obtains device-aspect-ratio information, which is information of an aspect ratio of a screen of a target display device intended to display the markup document in an interactive mode according to a design of a markup document producer.

18. The apparatus of claim 14, wherein the enhanced audio video engine analyzes device aspect ratio information written in the markup document by using the attribute of the tag.

19. The apparatus of claim 14, wherein the enhanced audio video engine converts the source markup picture into a markup picture of a predetermined aspect ratio according to the aspect ratio information of the markup document.

20. The apparatus of claim 14, wherein the enhanced audio video engine converts the source markup picture into a markup picture having an aspect ratio of 4: 3 or 16: 9 according to the aspect ratio information of the markup document.

21. The apparatus of claim 14, wherein the enhanced audio video engine scales the source markup picture to output a markup picture corresponding to device aspect ratio information of the markup document, the target display device basically displays the markup document in response to the screen aspect ratio information of the target display device different from the device aspect ratio information, and the device aspect ratio information is data regarding information including a screen aspect ratio of a target display device intending to display the markup document in the interactive mode.

22. An apparatus for processing a markup document in an interactive mode, comprising:

a controller outputting a markup picture of a markup document and a video picture of audio and/or video data in an interactive mode; and

and a markup converter converting the markup picture according to device-aspect-ratio information corresponding to the markup document, the device-aspect-ratio information being data including information on an aspect ratio of a target display device that wants to display the markup document.

23. The apparatus of claim 22, wherein the controller embeds the video picture in the markup picture according to embedding information of the markup document.

24. The apparatus of claim 22, wherein the device-aspect-ratio information is included in a markup document.

25. The apparatus of claim 22, wherein the markup converter scales the markup picture according to the device-aspect-ratio information in response to the screen-aspect-ratio information of a target display device displaying the markup document, which is different from the device-aspect-ratio information, and outputs the markup picture as it is in response to the information of the screen aspect ratio of the target display device corresponding to the device-aspect-ratio information.

26. A method for processing audio-visual data in an interactive mode by using a markup document in a computer system, the method comprising:

controlling an audio video playback engine to obtain video pictures of audio video data; and

controlling the enhanced audio video engine to convert the markup picture of the markup document according to device aspect ratio information corresponding to the markup document, the device aspect ratio information being data including aspect ratio information about a target display device intended to display the markup document in an interactive mode,

wherein in response to information about a screen aspect ratio of a target display device displaying the markup document different from the device screen aspect ratio information, the markup picture is scaled according to the device screen aspect ratio information when the markup picture is transformed; the markup picture is output as it is in response to information of the screen aspect ratio of the target display device corresponding to the device screen aspect ratio information.