CN103905811A - Information processing device, information processing method, and program - Google Patents

Abstract

The present invention relates to an information processing device, an information processing method, and a program, whereby playback of PG and TextST images can be controlled from a BD-J application. There are defined a mono PG/TextST stream of a PG/TextST image that is a mono image serving as a 2D image, a stereo PG/TextST stream of a PG/TextST image that is a stereo image serving as a 3D image, and a PG/TextST stream for offset of a PG/TextST image that is a mono image to be used fro generating a stereo image along with an offset value for giving disparity to the mono image, as a PG/TextST stream of a PG/TextST image. An stream selecting API selects a mono PG/TextST stream, a stereo PG/TextST stream, or a PG/TextST stream for offset. The present invention may be applied to a BD player configured to play a BD, or the like.

Description

Information processing device, information processing method and program

The present invention is a divisional application of the following invention patent application: application number: 201080001701.7, application date: March 24, 2010, invention name: information processing equipment, information processing method and program.

technical field

The present invention relates to an information processing device, an information processing method, and a program, and more particularly, to an information processing device, an information processing method, and a program that can be used to appropriately play content such as a 3D (three-dimensional) image from a recording medium.

Background technique

For example, two-dimensional (2D) image content is the mainstream of content such as movies, but recently, three-dimensional (3D) image (graphic) content enabling stereoscopic viewing has attracted attention.

There are various methods for a display method of a 3D image (hereinafter also referred to as a stereoscopic image), but no matter which method is used, the data amount of the 3D image is larger than that of the 2D image.

In addition, the contents of high-resolution images such as movies may have a large size, and in order to record such a large amount of image contents in the form of 3D images with a large amount of data, it is necessary to provide a large-capacity recording medium.

Examples of such large-capacity recording media include Blu-Ray (registered trademark) discs (hereinafter also referred to as BDs), such as BD (Blu-Ray (registered trademark))-ROM (read only memory), and the like.

In BD, BD-J (BD Java (registered trademark)) can be processed, and according to BD-J, a high-interactivity function (PTL1) can be provided.

reference list

patent documents

PTL1: International Publication No. 2005/052940

Contents of the invention

technical problem

By the way, in the current BD standard, how to record or play back 3D image content has not been specified yet.

However, leaving the author who performs the authoring of the 3D image content to decide how to record or play the 3D image content may result in the 3D image content being unsuitable for playback.

The present invention has been made in consideration of the above-mentioned problems, and enables appropriate playback of 3D image content from a recording medium such as BD.

solution to the problem

According to an aspect of the present disclosure, there is provided an information processing device in which a video plane configured to store a video image corresponds to a storage area of images corresponding to two screens, the storage area arranges an L area and an R area, wherein The L area is a storage area for storing images for the left eye corresponding to one screen, and the R area is a storage area for storing images for the right eye corresponding to one screen; wherein, the configuration of the video plane is for the corresponding The overall definition of the video plane of the image storage area of the two screens; wherein, as the video mode of the mode for playing the video image, it defines: a stereoscopic video mode, which is used when the video image is used as In the case of a stereoscopic image of a 3D image, the image for the left eye and the image for the right eye constituting the stereoscopic image are respectively stored in the L area and the R area of the video plane, and flattened a stereoscopic video mode for storing, when the video image is the stereoscopic image, one of the left-eye image and the right-eye image constituting the stereoscopic image in the video plane. In both the L area and the R area, wherein, as a PG stream as a PG (Presentation Graphics) image, a stereoscopic PG stream is defined as a PG stream of the PG image as a stereoscopic image serving as a 3D image, and a PG stream for offset, which is a PG stream that is the PG image serving as a non-stereoscopic image serving as a 2D image to be used to generate a stereoscopic image in combination with an offset value for adding to the non-stereoscopic image The stereoscopic image is endowed with parallax data; the information processing device includes: a stream selection API (application programming interface), which is used to perform the selection of the stereoscopic PG stream or the offset PG stream; wherein, in the When the video mode is the flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the offset PG stream is also optional; wherein, when the video mode is the In the case of the flattened stereoscopic video mode and in the case of the video mode being the stereoscopic video mode, the stereoscopic PG stream is also optional; wherein, when the video mode is the flattened stereoscopic video mode In the case of , when the PG stream for offset is selected, the offset value is set to 0, and the monaural image corresponding to the PG stream for offset is played.

According to another aspect of the present disclosure, there is provided an information processing method, wherein a video plane configured to store a video image is a storage area corresponding to images of two screens, the storage area arranges an L area and an R area, wherein The L area is a storage area for storing images for the left eye corresponding to one screen, and the R area is a storage area for storing images for the right eye corresponding to one screen; wherein, the configuration of the video plane is for the corresponding The overall definition of the video plane of the image storage area of the two screens; wherein, as the video mode of the mode for playing the video image, it defines: a stereoscopic video mode, which is used when the video image is used as In the case of a stereoscopic image of a 3D image, the image for the left eye and the image for the right eye constituting the stereoscopic image are respectively stored in the L area and the R area of the video plane, and flattened a stereoscopic video mode for storing, when the video image is the stereoscopic image, one of the left-eye image and the right-eye image constituting the stereoscopic image in the video plane. In both the L area and the R area, wherein, as a PG stream as a PG (Presentation Graphics) image, a stereoscopic PG stream is defined as a PG stream of the PG image as a stereoscopic image serving as a 3D image, and a PG stream for offset, which is a PG stream that is the PG image serving as a non-stereoscopic image serving as a 2D image to be used to generate a stereoscopic image in combination with an offset value for adding to the non-stereoscopic image The stereoscopic image is endowed with parallax data; the information processing method includes the steps of: using a stream selection API (Application Programming Interface) to perform selection of the stereoscopic PG stream or the offset PG stream to select the stereoscopic PG stream or the PG stream for the offset; wherein, even if the video mode is a flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the PG stream for the offset is Optional; wherein, when the video mode is the flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the stereoscopic PG stream is also optional; wherein, In the case where the video mode is the flattened stereoscopic video mode, when the offset PG stream is selected, the offset value is set to 0, and is the same as the offset PG stream The corresponding non-stereoscopic image is played.

According to another aspect of the present disclosure, there is provided a program in which a video plane configured to store a video image is a storage area corresponding to images of two screens, the storage area arranges an L area and an R area, wherein the L area is a storage area for storing images for the left eye corresponding to one screen, and area R is a storage area for storing images for the right eye corresponding to one screen; wherein, the configuration of the video plane is for two The overall definition of the video plane of the image storage area of the screen; wherein, as the video mode for playing the video image mode, it defines: stereoscopic video mode, for when the video image is used as a 3D image In the case of a stereoscopic image, the image for the left eye and the image for the right eye constituting the stereoscopic image are respectively stored in the L area and the R area of the video plane, and the stereoscopic video is flattened. mode for storing one of the image for the left eye and the image for the right eye constituting the stereoscopic image in the L of the video plane when the video image is the stereoscopic image region and the R region in which, as a PG stream as a PG (Presentation Graphics) image, a stereoscopic PG stream is defined as a PG stream of the PG image as a stereoscopic image serving as a 3D image, and a partial diverting a PG stream which is the PG stream as the PG image serving as a non-stereoscopic image of a 2D image to be used in combination with an offset value for generating a stereoscopic image to the non-stereoscopic image Data that gives disparity; wherein, the program is a stream selection API (Application Programming Interface) for performing selection of the stereoscopic PG stream or the offset PG stream; wherein, in the video mode, the In the case of a flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the offset PG stream is also optional; wherein, when the video mode is the flattened stereoscopic video mode and in the case where the video mode is the stereoscopic video mode, the stereoscopic PG stream is also optional; wherein, in the case where the video mode is the flattened stereoscopic video mode, when When the offset PG stream is selected, the offset value is set to 0, and the monaural image corresponding to the offset PG stream is played.

An information processing device or a program according to an aspect of the present invention is an information processing device or a program causing a computer to function as an information processing device in which a video plane configured to store video images is a storage area in which The L area and the R area are image storage areas of two image sizes, wherein the L area is an image storage area of one image size for storing an image for the left eye, and the R area is an image storage area of one image size for storing an image for the right eye. image storage area; wherein, the configuration of the video plane is defined for the entirety of the video plane as an image storage area of two image sizes; wherein, the video mode, which is a mode for playing video images, defines the following five modes : Non-stereoscopic video mode for storing a non-stereoscopic image in one of the storage areas of the L area and the R area of the video plane in the case that the video image is a non-stereoscopic image as a 2D (two-dimensional) image; dual non-stereoscopic Stereoscopic video mode for storing non-stereoscopic images in both the L area and R area of the video plane in case the video image is a non-stereoscopic image; stereoscopic video mode for storing a stereoscopic image as a 3D image In the case of , the image for the left eye and the image for the right eye constituting the stereoscopic image are respectively stored in the L area and the R area of the video plane; the flattened stereoscopic video mode is used to store the one of the images for the left eye and the images for the right eye constituting the stereoscopic image is stored in both the L area and the R area of the video plane; One of the image for the left eye and the image for the right eye of the stereoscopic image is stored in one storage area of the L area and the R area of the video plane; among them, as a PG stream of a PG (presentation graphics) image, it is defined: a non-stereoscopic PG stream , which is a PG stream of a PG image serving as a non-stereoscopic image of a 2D image; a stereoscopic PG stream, which is a PG stream of a PG image serving as a stereoscopic image of a 3D image; and a PG stream for offset, which is a PG stream to be used Combined with the offset value to generate the PG stream of the PG image of the non-stereoscopic image of the stereoscopic image, the offset value is the data used to give parallax to the non-stereoscopic image; wherein, as the text subtitle stream of the subtitle image, it defines: non-stereoscopic A text subtitle stream which is a text subtitle stream of a text subtitle image serving as a non-stereoscopic image of a 2D image; a stereoscopic text subtitle stream which is a text subtitle stream of a text subtitle image serving as a stereoscopic image of a 3D image; a text subtitle stream which is a text subtitle stream which is a text subtitle image to be used for generating a non-stereoscopic image of a stereoscopic image in combination with an offset value which is data for imparting parallax to the non-stereoscopic image; the information processing apparatus or the program includes: a stream selection API (Application Programming Interface) for performing selection of a non-stereoscopic PG stream, a stereoscopic PG stream or a PG stream for offset, and a non-stereoscopic text subtitle stream, a stereoscopic text subtitle stream or an offset Selection of streams with text subtitles; among them, even if the video mode is monaural video mode, forced non-stereoscopic video mode , flattened stereoscopic video mode, dual non-stereoscopic video mode, and stereoscopic video mode, the PG stream for offset is also optional; wherein, even if the video mode is non-stereoscopic video mode, forced non-stereoscopic In the case of any one of video mode, flattened stereo video mode, dual non-stereo video mode and stereo video mode, the stereo PG stream is also optional; where the video mode is non-stereo video mode, forced non-stereo video mode, flattened stereoscopic video mode, or dual non-stereoscopic video mode, when the PG stream for offset is selected, the offset value is set to 0, and the non-stereoscopic image corresponding to the PG stream for offset is Play; Wherein, in the case where the video mode is a non-stereoscopic video mode or a forced non-stereoscopic video mode, when a stereoscopic PG stream is selected, between the left-eye image and the right-eye image that constitute a stereoscopic image corresponding to the stereoscopic PG stream One is played; wherein, in the case where the video mode is a flattened stereoscopic video mode or a dual non-stereoscopic video mode, when a stereoscopic PG stream is selected, if there is a stream number with the same stream number as the selected stereoscopic PG stream (the stream number is number assigned to it), the offset value is set to 0, and the monaural image corresponding to the offset PG stream is played; wherein, even if the video mode is the monaural video mode , forced non-stereoscopic video mode, flattened stereoscopic video mode, double non-stereoscopic video mode, and stereoscopic video mode, the text subtitle stream for offset is also optional; wherein, even if the video mode is non-stereoscopic In the case of any one of stereoscopic video mode, forced non-stereoscopic video mode, flattened stereoscopic video mode, double non-stereoscopic video mode and stereoscopic video mode, the stereoscopic PG stream is also optional; where the video mode is non-stereoscopic In the case of video mode, forced non-stereoscopic video mode, flattened stereoscopic video mode, or dual non-stereoscopic video mode, when the text subtitle stream for offset is selected, the offset value is set to 0, and is the same as the PG for offset The non-stereoscopic image corresponding to the flow is played; Wherein, under the situation that the video mode is a non-stereoscopic video mode or a forced non-stereoscopic video mode, when the stereoscopic text subtitle stream is selected, constitute the stereoscopic image corresponding to the stereoscopic text subtitle stream One of the image for the left eye and the image for the right eye is played; wherein, in the case where the video mode is a flattened stereoscopic video mode or a double non-stereoscopic video mode, when the stereoscopic text subtitle stream is selected, if there is a stream with the If the number is the same number of offset text subtitle streams as the stream number of the selected stereoscopic text subtitle stream, the offset value is set to 0, and the non-stereoscopic image corresponding to the offset text subtitle stream is play.

An information processing method according to an aspect of the present invention is an information processing method in which a video plane configured to store a video image is a storage area in which two image sizes of an L area and an R area are arranged side by side The image storage area, wherein the L area is an image storage area of the size of one image for storing the image for the left eye, and the R area is an image storage area of the size of one image for storing the image for the right eye; wherein, the configuration of the video plane It is defined for the whole of the video plane as an image storage area of two image sizes; among them, the video mode as a mode for playing video images defines the following five modes: Non-stereoscopic video mode, used for playing video images In the case of a non-stereoscopic image as a 2D (two-dimensional) image, the non-stereoscopic image is stored in one of the storage areas of the L area and the R area of the video plane; the dual non-stereoscopic video mode is used when the video image is a non-stereoscopic In the case of an image, non-stereoscopic images are stored in both the L area and the R area of the video plane; the stereoscopic video mode is used to store the left eye that constitutes the stereoscopic image when the video image is a stereoscopic image as a 3D image The image for the right eye and the image for the right eye are respectively stored in the L region and the R region of the video plane; the flattened stereoscopic video mode is used to convert the image for the left eye and the right eye that constitute the stereoscopic image when the video image is a stereoscopic image One of the images is stored in both the L area and the R area of the video plane; and a forced non-stereoscopic video mode for combining the images for the left eye and the images for the right eye constituting the stereoscopic image when the video image is a stereoscopic image. One of the images is stored in one storage area of the L area and the R area of the video plane; among them, as a PG stream of a PG (Presentation Graphics) image, a non-stereoscopic PG stream is defined as a non-stereoscopic image serving as a 2D image the PG stream of the PG image; the stereo PG stream, which is the PG stream of the PG image serving as the stereo image of the 3D image; and the PG stream for offset, which is the non The PG stream of the PG image of the stereoscopic image, the offset value is the data used to give the parallax to the non-stereoscopic image; wherein, as the text subtitle stream of the subtitle image, it defines: the non-stereoscopic text subtitle stream, which is used as a 2D image A text subtitle stream of a text subtitle image of a non-stereoscopic image; a stereoscopic text subtitle stream, which is a text subtitle stream of a text subtitle image of a stereoscopic image serving as a 3D image; and an offset text subtitle stream, which is a text subtitle stream to be used for combining Offset value is used to generate the text subtitle stream of the text subtitle image of the non-stereoscopic image of the stereoscopic image, and the offset value is used to give the data of disparity to the non-stereoscopic image; the information processing method comprises the following steps: Stream selection API (Application Programming Interface) for selection of PG stream, stereoscopic PG stream or offset with PG stream and selection of non-stereoscopic text subtitle stream, stereoscopic text subtitle stream or offset with text subtitle stream for stereoscopic PG stream Selection of PG stream for offset or offset and selection of non-stereoscopic text subtitle stream, stereoscopic text subtitle stream or text subtitle stream for offset wherein, even if the video mode is any one of the non-stereoscopic video mode, the forced non-stereoscopic video mode, the flattened stereoscopic video mode, the dual non-stereoscopic video mode, and the stereoscopic video mode, the offset PG stream is Optional; wherein, even if the video mode is any of the non-stereoscopic video mode, the forced non-stereoscopic video mode, the flattened stereoscopic video mode, the dual non-stereoscopic video mode, and the stereoscopic video mode, the stereoscopic PG stream is Optional; wherein, in case the video mode is a non-stereoscopic video mode, a forced non-stereoscopic video mode, a flattened stereoscopic video mode or a dual non-stereoscopic video mode, when the offset is selected with a PG stream, the offset value is set to Set to 0, and the non-stereoscopic image corresponding to the offset PG stream is played; wherein, when the video mode is a non-stereoscopic video mode or forced non-stereoscopic video mode, when the stereoscopic PG stream is selected, the composition and stereoscopic One of the left-eye image and the right-eye image of the stereoscopic image corresponding to the PG stream is played; wherein, when the video mode is a flattened stereoscopic video mode or a dual non-stereoscopic video mode, when the stereoscopic PG stream is selected , if there is a PG stream for offset with the same stream number (the stream number is the number assigned to it) as the selected stereoscopic PG stream, the offset value is set to 0, and the same as the PG stream for offset The corresponding non-stereoscopic image is played; wherein, even if the video mode is any one of the non-stereoscopic video mode, the forced non-stereoscopic video mode, the flattened stereoscopic video mode, the dual non-stereoscopic video mode, and the stereoscopic video mode, The text subtitle stream for offset is also optional; wherein, even if the video mode is any one of the non-stereoscopic video mode, forced non-stereoscopic video mode, flattened case, stereoscopic PG stream is also optional; wherein, in the case of video mode is monaural video mode, forced non-stereoscopic video mode, flattened stereoscopic video mode or dual non-stereoscopic video mode When selected, the offset value is set to 0, and the non-stereoscopic image corresponding to the offset PG stream is played; wherein, when the video mode is a non-stereoscopic video mode or a forced non-stereoscopic video mode, when the stereoscopic text When the subtitle stream was selected, one of the left-eye image and the right-eye image that constituted the stereoscopic image corresponding to the stereoscopic text subtitle stream was played; In this case, when the stereoscopic text subtitle stream is selected, if there is a text subtitle stream whose stream number is the same as the stream number of the selected stereoscopic text subtitle stream, the offset value is set to 0, and the monaural image corresponding to the text subtitle stream for this offset is played.

According to the above aspect of the present invention, the video plane configured to store video images is a storage area in which two picture-sized image storage areas of an L area and an R area are arranged side by side, wherein the L area is used for An image storage area of one image size for storing an image for the left eye, an R area is an image storage area of one image size for storing an image for the right eye, and the configuration of the video plane is for an image storage area of the size of two images The ensemble definition of the video plane.

In addition, as a video mode as a mode for playing video images, the following five modes are defined: Monaural video mode, which is used to convert a non-stereoscopic Images are stored in one of the storage areas of the L and R regions of the video plane; dual non-stereoscopic video mode for storing non-stereoscopic images in the L and R regions of the video plane if the video image is a non-stereoscopic image Among the two; the stereoscopic video mode is used to store the image for the left eye and the image for the right eye constituting the stereoscopic image in the L area and the R area of the video plane, respectively, when the video image is a stereoscopic image as a 3D image ; A flattened stereoscopic video mode for storing one of the images for the left eye and the images for the right eye constituting the stereoscopic image in both the L region and the R region of the video plane when the video image is a stereoscopic image; and The forced non-stereoscopic video mode is used to store one of the left-eye image and the right-eye image constituting the stereoscopic image in one storage area of the L area and the R area of the video plane when the video image is a stereoscopic image.

Furthermore, as a PG stream as a PG (Presentation Graphics) image, a non-stereoscopic PG stream which is a PG stream which is a PG image serving as a a PG stream of a PG image of an image; and a PG stream for offset, which is a PG stream of a PG image of a non-stereoscopic image to be used in conjunction with offset values for generating a stereoscopic image The data to assign parallax to.

In addition, as a text subtitle stream of a subtitle image, a mono-stereoscopic text subtitle stream is defined as a text subtitle stream of a non-stereoscopic image serving as a 2D image; a stereoscopic text subtitle stream is a text subtitle stream serving as a 3D image; the text subtitle stream of the text subtitle image of the stereoscopic image; and the text subtitle stream for offset, which is the text subtitle stream of the text subtitle image of the non-stereoscopic image to be used in conjunction with the offset value to generate the stereoscopic image, the offset value being Data used to impart parallax to non-stereoscopic images.

Then, the stream selection API (Application Programming Interface) performs selection of a non-stereoscopic PG stream, a stereoscopic PG stream, or a PG stream for offset, and a selection of a non-stereoscopic text subtitle stream, a stereoscopic text subtitle stream, or a text subtitle stream for offset .

Here, the PG stream for offset is optional even when the video mode is any one of the non-stereoscopic video mode, the forced non-stereoscopic video mode, the flattened stereoscopic video mode, the dual non-stereoscopic video mode, and the stereoscopic video mode. Yes, and the stereoscopic PG stream is selectable even if the video mode is any one of the non-stereoscopic video mode, the forced non-stereoscopic video mode, the flattened stereoscopic video mode, the dual non-stereoscopic video mode, and the stereoscopic video mode .

However, in the case that the video mode is a non-stereoscopic video mode, a forced non-stereoscopic video mode, a flattened stereoscopic video mode, or a dual non-stereoscopic video mode, when the offset-use PG stream is selected, the offset value is set to 0, And the non-stereoscopic image corresponding to the PG stream for offset is played.

In addition, when the video mode is a non-stereoscopic video mode or a forced non-stereoscopic video mode, when a stereoscopic PG stream is selected, one of the left-eye image and the right-eye image constituting the stereoscopic image corresponding to the stereoscopic PG stream is selected. play.

Also, in the case where the video mode is flattened stereoscopic video mode or dual non-stereoscopic video mode, when a stereoscopic PG stream is selected, if there is a number), the offset value is set to 0, and the monaural image corresponding to the offset PG stream is played.

In addition, even when the video mode is any one of the non-stereoscopic video mode, the forced non-stereoscopic video mode, the flattened stereoscopic video mode, the dual non-stereoscopic video mode, and the stereoscopic video mode, the text subtitle stream for offset is also possible. Optional, and stereoscopic PG stream is optional even if the video mode is any of Monaural, Forced Mono, Flattened Stereo, Dual Mono, and Stereo of.

However, in the case that the video mode is a non-stereoscopic video mode, a forced non-stereoscopic video mode, a flattened stereoscopic video mode, or a dual non-stereoscopic video mode, when the text subtitle stream for offset is selected, the offset value is set to 0 , and a monaural image corresponding to the PG stream for offset is played.

In addition, when the video mode is a non-stereoscopic video mode or a forced non-stereoscopic video mode, when the stereoscopic text subtitle stream is selected, the left-eye image and the right-eye image constituting the stereoscopic image corresponding to the stereoscopic text subtitle stream One is played.

In addition, in the case where the video mode is flattened stereoscopic video mode or dual non-stereoscopic video mode, when a stereoscopic text subtitle stream is selected, if there is a stream number that is the same as that of the selected stereoscopic text subtitle stream number of the offset text subtitle stream, the offset value is set to 0, and the non-stereoscopic image corresponding to the offset text subtitle stream is played.

The information processing device may be an independent device, or may be an internal block constituting a device.

In addition, the program may be provided by being transmitted via a transmission medium, or provided by being recorded in a recording medium.

Advantageous effect of the present invention

According to the present invention, 3D image content can be properly played.

Description of drawings

FIG. 1 is a diagram for describing an outline of the BDMV format.

FIG. 2 is a diagram for describing a management format of a BD file.

Fig. 3 is a block diagram showing a configuration example of hardware of a BD player.

FIG. 4 is a diagram for describing an outline of 3D image processing by a 3D-compatible player.

FIG. 5 is a diagram for describing the drawing of a graphic 3D image on the graphics plane 11 by a BD-J application.

FIG. 6 is a diagram showing a graphics mode in which a BD-J application that draws a graphics 3D image on the graphics plane 11 plays graphics images.

Fig. 7 is a block diagram showing an example of a functional configuration of a 3D-compatible player.

FIG. 8 is a diagram showing a video mode in which video images are played, serving as one of the configurations.

FIG. 9 is a diagram showing a background mode that plays a background image, serving as one of the configurations.

FIG. 10 is a diagram showing the relationship among the Graphics Plane 11 , the PG Plane 12 , the Video Plane 13 , and the Background Plane 14 as device planes.

FIG. 11 is a diagram showing an image frame (resolution) and color depth serving as one of the configurations.

FIG. 12 is a diagram for describing a method of rendering a 3D image using a second rendering method in the case of 3D image mismatch.

Fig. 13 is a diagram for describing a device plane.

Fig. 14 is a diagram showing bit fields provided within a BD-J object file for specifying a configuration.

FIG. 15 is a diagram showing default prescribed values of initial_video_mode, initial_graphics_mode, and initial_background_mode.

FIG. 16 is a diagram showing combinations of resolutions (image frames) of video+PG, BD-J graphics, and background for playback other than KEEP_RESOLUTION playback.

FIG. 17 is a diagram showing combinations of resolutions (image frames) of video+PG, BD-J graphics, and background for playback other than KEEP_RESOLUTION playback.

Fig. 18 is a diagram illustrating an example of change processing of configuration.

FIG. 19 is a diagram illustrating predetermined initial values of a graphics mode and a background mode.

FIG. 20 is a diagram showing graphics and background patterns to be played in the case of playing a 3D image (stereoscopic image) of 1920×2160 pixels.

FIG. 21 is a diagram for describing a change in resolution (image frame) serving as a configuration due to a call of an API by a BD-J application.

FIG. 22 is a diagram for describing a change of a graphics mode.

FIG. 23 is a diagram illustrating a change of a graphics mode from a stereoscopic graphics mode to an offset graphics mode.

FIG. 24 is a diagram for describing a change of a background mode.

FIG. 25 is a diagram for describing a change of a video mode.

Fig. 26 is a block diagram showing an example of a functional configuration of a 3D-compatible player.

FIG. 27 is a diagram showing selectable PG playback mode and TextST playback mode in each video mode.

Fig. 28 is a block diagram showing an example of a functional configuration of a 3D-compatible player.

FIG. 29 is a diagram for describing processing of a 3D-compatible player with respect to PG.

FIG. 30 is a diagram for describing switching between playback of a 3D image and playback of a 2D image in a 3D-compatible player.

FIG. 31 is a diagram for describing the setting of the position and size of the video by the author and the correction of the position and size of the video by the 3D compatible player.

Fig. 32 is a block diagram showing an example of a functional configuration of a 3D-compatible player.

FIG. 33 is a diagram showing a graphics plane 11 of 1920×2160 pixels.

Fig. 34 is a block diagram showing an example of a functional configuration of a 3D-compatible player.

Fig. 35 is a flowchart for describing graphics processing by the 3D-compatible player.

Fig. 36 is a flowchart for describing graphics processing by the 3D-compatible player.

Fig. 37 is a flowchart for describing graphics processing by the 3D-compatible player.

FIG. 38 is a diagram showing an example of a GUI drawn on the graphics plane 11.

FIG. 39 is a diagram illustrating a first focus method and a second focus method.

Fig. 40 is a flowchart for describing focus management of a 3D compatible player.

FIG. 41 is a diagram showing a position on a display screen from which a 3D image of a cursor can be viewed and a position of the cursor on the graphics plane 11. Referring to FIG.

FIG. 42 is a diagram for describing matching between an image for a left eye and an image for a right eye of graphics.

Fig. 43 is a block diagram showing an example of a functional configuration of a 3D-compatible player.

FIG. 44 is a diagram showing an image spanning the L graphics plane 11L and the R graphics plane 11R.

FIG. 45 is a diagram illustrating drawing of an image for the left eye for animation and drawing of an image for the right eye for animation.

Fig. 46 is a block diagram showing an example of a functional configuration of a 3D-compatible player.

FIG. 47 is a diagram showing the definition of an extension API of Image Frame Accurate Animation.

FIG. 48 is a diagram showing the definition of an extension API of Sync Frame Accurate Animation.

Figure 49 is a diagram showing sample code for image frame accurate animation.

Figure 50 is a diagram showing sample code for image frame accurate animation.

FIG. 51 is a diagram showing sample code for a synchronized frame-accurate animation.

Figure 52 is a diagram showing sample code for a synchronized frame accurate animation.

label list

10 logical plane

11 graphics plane

11L Graphic plane

11R R graphic plane

12 PG plane

12L L-PG plane

12R R-PG Plane

13 video plane

13L L video plane

13R R video plane

14 background plane

14L L background plane

14R R background plane

15 mixer

21 logic screen

101 bus

102 CPUs

103 ROM

104 RAM

105 hard drives

106 output unit

107 input unit

108 communication unit

109 drives

110 input/output interface

111 Removable recording media

201L, 201R, 202L, 202R buffer

211 rear buffer

211L, 211R, 212 front buffer

212L, 212R buffer

213 front buffer

213L, 213R buffer

231 image buffer

232L, 232R pixel transmission equipment

241 graphics memory

242L, 242R pixel transmission equipment

Detailed ways

A case where an embodiment of the present invention is applied to a BD will be described below.

BD's management structure

First, for the current BD, AV (Audio/Video) data, such as content such as recorded in a BD-ROM as a read-only BD, specified in "Blu-ray Disc Read-Only FormatVer1.0part3Audio Visual Specifications" will be described etc. (hereinafter also referred to as "BDMV format").

For example, a bit stream encoded by an encoding method such as MPEG (Moving Picture Experts Group) video, MPEG audio, etc. and multiplexed according to the MPEG2 system is called a clip AV stream (or AV stream). The clip AV stream is recorded in the BD as a file by a file system defined in "Blu-ray Disc Read-Only Format part 2" which is one of the standards on the BD. A file of a clip AV stream is called a clip AV stream file (or AV stream file).

A clip AV stream file is a management unit on a file system, and information necessary for playback of (a clip AV stream of) a clip AV stream file and the like are recorded in a BD in the form of a database. This database is specified in "Blu-ray Disc Read-Only Format part3" which is one of the BD standards.

FIG. 1 is a diagram for describing an outline of the BDMV format.

The BDMV format consists of four layers.

The lowest layer is a layer to which a clip AV stream belongs, and will also be referred to as a clip layer hereinafter as appropriate.

A layer one layer higher than the clip layer is a layer to which a playlist (Movie PlayList) for specifying a playback position for a clip AV stream belongs, and will also be referred to as a playlist layer hereinafter.

A layer higher than the playlist layer is a layer to which a Movie Object (Movie Object) etc. constituted by a command for specifying a playback order for a playlist belongs, and will also be referred to as an object layer below.

A layer higher than the object layer (the highest layer) is a layer to which an index table for managing titles and the like to be stored in the BD belongs, and will also be referred to as an index layer hereinafter.

The clip layer, playlist layer, object layer, and index layer will be further described.

Clip AV stream, clip information (Clip Information), etc. belong to the clip layer.

The clip AV stream is a stream in which video data, audio data, and the like serving as content data are converted into TS (MPEG2TS (Transport Stream)) format.

Clip information (Clip Information) is information about the clip AV stream, and is recorded in the BD in the form of a file.

Note that the clip AV stream includes graphics streams such as subtitles, menus, etc. as necessary.

A stream of subtitles (graphics) is called a PG (Presentation Graphics) stream, and a stream of menus (graphics) is called an interactive graphics (IG (Interactive Graphics)) stream.

Also, a collection of a clip AV stream file and a file (clip information file) of corresponding clip information (clip information on the clip AV stream of the clip AV stream file) is called a clip (Clip).

A clip is a single object composed of a clip AV stream and clip information.

When laying out content corresponding to clip AV streams constituting a clip on the time axis, a plurality of positions including the first and last positions (time points) are set as access points. In principle, the access point is specified by the playlist (PlayList) of the upper layer with a time stamp.

The clip information constituting the clip includes the address (logical address) of the location of the clip AV stream indicated by the access point specified by the time stamp in the playlist.

Playlist (Movie PlayList) belongs to the playlist layer.

The playlist is composed of the AV stream file to be played and the playback item (PlayItem) including the playback start point (IN point) and playback end point (OUT point) for specifying the playback position of the AV stream file constituted.

Thus, a playlist is constituted by a group of playitems.

Now, playback of a PlayItem means playback of the section of the clip AV stream specified by the IN point and OUT point included in the PlayItem.

Movie objects (Movie Object) and BD-J objects (Blue-ray Disc Java (registered trademark) objects) belong to the object layer.

A movie object includes terminal information associating an HDMV (High Definition Movie) navigation command program (navigation command) with the movie object.

A navigation command is a command for controlling playback of a playlist. The terminal information includes information for allowing a user's interactive operation with a BD player for playing a BD. In the BD player, user operations such as calling of menus, title searches, and the like are controlled based on terminal information.

The BD-J object is a Java (registered trademark) program, and can provide a user with more advanced (more complex) interactive functions than navigation commands.

Index table (Index table) belongs to the index layer.

The index table is the highest level table for defining the title of the BD-ROM disc.

The entries (fields) of the index table correspond to titles, and a link is provided from each entry to the object (movie object or BD-J object) of the title (HDMV title or BD-J title) corresponding to the entry.

FIG. 2 is a diagram for describing a management structure of a BD file prescribed by "Blu-ray Disc Read-Only Format Part3".

In BD, files are managed using a directory structure in a hierarchical manner.

Now, in Figure 2, a file under a directory (including a directory) refers to the files immediately under the directory, and a file included in a directory refers to the files immediately under the directory and the so-called subreddits of the directory. files in the directory.

The highest hierarchical directory of a BD is the root directory.

There are a directory "BDMV" and a directory "CERTIFICATE" immediately under the root directory.

Information (files) related to copyright is stored in the directory "CERTIFICATE".

Files in the BDMV format described in FIG. 1 are stored in the directory "BDMV".

Two files "index.bdmv" and "MovieObject.bdmv" are stored next to the directory "BDMV". Note that files (excluding directories) other than "index.bdmv" and "MovieObject.bdmv" cannot be stored immediately under the directory "BDMV".

The file "index.bdmv" includes the index table described in Fig. 1, serving as information related to the menu for playing the BD.

For example, the BD player plays an initial menu (screen) including content items such as playing all contents of the BD, playing only a specific chapter, performing playback repeatedly, or displaying a predetermined menu based on the file "index.bdmv".

Also, a Movie Object (Movie Object) to be run when each item is selected can be set to the file "index. Movie Object command set to file "index.bdmv".

The file "MovieObject.bdmv" is a file including information of Movie Object. A MovieObject includes commands for controlling playback of a PlayList recorded in a BD, and for example, a BD player plays content recorded in a BD by selecting one of the Movie Objects recorded in the BD and executing it ( title).

Directly under the directory "BDMV" are provided directories "PLAYLIST", "CLIPINF", "STREAM", "AUXDATA", "META", "BDJO", "JAR", and "BACKUP".

A database of playlists is stored in the directory "PLAYLIST". Specifically, the playlist file "xxxxx.mpls" is stored in the directory "PLAYLIST". A file name composed of a 5-digit number "xxxxx" and an extension "mpls" is used as the file name of the playlist file "xxxxx.mpls".

The database of clips is stored in the directory "CLIPINF". Specifically, a clip information file "xxxxx.clip" about each clip AV stream file is stored in the directory "CLIPINF". A file name composed of a 5-digit number "xxxxx" and an extension "clpi" is used as the file name of the clip information file "xxxxx.clpi".

The clip AV stream file "xxxxx.m2ts" is stored in the directory "STREAM". The TS is stored in the clip AV stream file "xxxxx.m2ts". A file name composed of a 5-digit number "xxxxx" and an extension "m2ts" is used as the file name of the clip AV stream file "xxxxx.m2ts".

Note that a matching file name other than the extension is used as the file name of the clip information file "xxxxx.clip" and the clip AV stream file "xxxxx.m2ts" constituting a given clip. Thus, the clip information file "xxxxx.clip" and the clip AV stream file "xxxxx.m2ts" constituting a given clip can be easily specified.

Sound files, font files, font index files, bitmap files, etc. for menu display are stored in the directory "AUXDATA".

In FIG. 2, the file "sound.bdmv" and files with the extension "otf" are stored in the directory "AUXDATA".

Predetermined sound data (audio data) is stored in the file "sound.bdmv". This "sound.bdmv" is fixedly used as the file name of the file "sound.bdmv".

Font data for display of subtitles, BD-J objects (applications), and the like is stored in a file with an extension "otf". A 5-digit number is used as a portion other than the extension of the file name of a file having the extension "otf".

Metadata files are stored in the directory "META". BD-J object files are stored in the directories "BDJO" and "JAR". Backups of files recorded in the BD are stored in the directory "BACKUP".

Example hardware configuration of a BD player

Fig. 3 is a block diagram showing an example of a hardware configuration of a BD player for playing a BD.

The BD player in FIG. 3 is configured to perform playback of a BD in which 3D image content is recorded.

A processor (computer) such as a CPU (Central Processing Unit) 102 and the like is embedded in the BD player. The input/output interface 110 is connected to the CPU 102 via the bus 101 .

When a command is input by the user operating the input unit 107 or the like via the input/output interface 110 , the CPU 102 executes a program stored in a ROM (Read Only Memory) 103 according to the command. Alternatively, the CPU 102 loads the program recorded in the hard disk 105 or the disc 100 mounted on the drive 109 into the RAM (Random Access Memory) 104 and executes the program.

Accordingly, the CPU 102 executes various types of processing described below. Then, for example, the CPU 102 outputs its processing result from the output unit 106 via the input/output interface 110 as necessary, or transmits it from the communication unit 108 , or further records it in the hard disk 105 , or the like.

Note that the input unit 107 is constituted by a keyboard, a mouse, a microphone, and the like. In addition, the output unit 106 is constituted by an LCD (Liquid Crystal Display), a speaker, and the like. The communication unit 108 is constituted by a network card or the like.

Now, the program executed by the CPU 102 may be recorded in advance in the hard disk 105 or the ROM 103 serving as a recording medium embedded in the BD player.

Alternatively, the program may be stored (recorded) in a removable recording medium such as the disc 100 or the like. Such a removable recording medium can be provided in the form of so-called packaged software. Here, examples of the removable recording medium include a flexible disk, a CD-ROM (Compact Disk Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disk), a magnetic disk, and a semiconductor memory.

Note that, in addition to installing the program from such a removable recording medium into the BD player, the program may also be downloaded to the BD player via a communication network or a broadcast network or the like to be installed into the built-in hard disk 105 . Specifically, for example, the program may be wirelessly transmitted from a download site to the BD player via an artificial satellite for digital satellite broadcasting, or may be transmitted through a cable via a network such as a LAN (Local Area Network), the Internet, or the like. to the BD player.

In FIG. 3 , a disc 100 is, for example, a BD in which 3D image content is recorded in a manner of maintaining compatibility with a BD to be played at a conventional player.

Thus, the disc 100 can be played on a conventional player, and can also be played on a BD player in FIG. Compatible Player").

Now, conventional players are BD players that can play BDs in which 2D image content is recorded, but cannot play 3D image content.

With conventional players, 2D image content can be played from the disc 100, but 3D image content cannot be played.

On the other hand, with the BD player in FIG. 3 as a 3D compatible player, not only 2D image content but also 3D image content can be played from the disc 100 .

In the BD player in FIG. 3 , when the disc 100 as a BD disc is mounted on the drive 109 , the CPU 102 performs playback of the disc 100 by controlling the drive 109 .

Description of BD-J application

A BD-J application (BD-J title) (BD-J object) is recorded in the disc 100 ( FIG. 3 ) as one of the 3D image contents.

In the BD player as a 3D compatible player in FIG. 3 , CPU 102 runs a Java (registered trademark) virtual machine, and on this Java (registered trademark) virtual machine, a BD-J application is executed.

FIG. 4 is a diagram for describing an outline of 3D image processing (outline of BD-J stereoscopic graphics) by a 3D-compatible player.

The 3D compatible player renders 3D images on the logical plane 10 , the PG plane 12 or the video plane 13 . Note that the entities of the logical plane 10, the PG plane 12, and the video plane 13 are, for example, partial storage areas in the RAM 104 in FIG. 3 .

Examples of a 3D image rendered by a 3D-compatible player include BD-J graphics, PG (Presentation Graphics), TextST (Text subtitle), video, and background specified in the BD standard.

Now, in Figure 4, the graphic 3D image (stereographic source) is composed of: an image for the left eye (L (left) field of view) as an image to be viewed by the left eye, and an image to be viewed by the right eye Image for the right eye (R (right) viewport).

The PG3D image (stereoscopic PG source), video 3D image (stereoscopic video source), and background 3D image (stereoscopic background source) are also composed of left-eye images and right-eye images.

Note that the image for the left eye and the image for the right eye constituting the video 3D image or the like can be encoded with, for example, H.264 AVC (Advanced Video Coding)/MVC (Multi-View Video Coding) or the like.

Now, in H.264AVC/MVC, an image stream called "Basic View" (BaseView) and an image stream called "Dependent View" (Dependent View) are defined.

For the base view, predictive encoding using another stream as a reference image is not allowed, but for dependent views, predictive encoding using the base view as a reference image is allowed. For example, among the image for the left eye and the image for the right eye, the image for the left eye may be regarded as the primary view, and the image for the right eye may be regarded as the subordinate view.

The 3D compatible player draws the 3D image drawn on the logical plane 10 on the graphics plane 11 or the background plane 14 .

The graphics plane 11 is composed of an L graphics plane (L (left) graphics plane) 11L for storing images for the left eye and an R graphics plane (R (right) graphics plane) 11R for storing images for the right eye.

Images for the left eye constituting a graphics 3D image drawn on the logical plane 10 are drawn on the L graphics plane 11L, and images for the right eye are drawn on the R graphics plane 11R.

Here, the L graphics plane 11L is an image storage area (L area) as large as one image for storing an image for L (left) to be observed by the left eye (image for left eye). Also, the R graphics plane 11R is an image storage area (R area) as large as one image for storing an image for R (right) to be observed by the right eye (image for right eye)

The entities of the L graphics plane 11L and the R graphics plane 11R, that is, the entity of the graphics plane 11 , are part of the storage area in the RAM 104 in FIG. 3 that is separated from the logic plane 10 .

The PG plane 12, video plane 13, and background plane 14 are also configured similarly.

The PG plane 12 is composed of an L-PG plane (L (left) PG plane) 12L for storing images for the left eye and an R-PG plane (R (right) PG plane) 12R for storing images for the right eye.

The 3D-compatible player draws images for the left eye constituting the PG 3D image on the L-PG plane 12L, and draws images for the right eye on the R-PG plane 12R.

The video plane 13 is composed of an L video plane (L (left) video plane) 13L for storing images for the left eye and an R video plane (R (right) video plane) 13R for storing images for the right eye.

The 3D-compatible player draws an image for the left eye constituting a video 3D image on the L video plane 13L, and draws an image for the right eye on the R video plane 13R.

The background plane 14 is composed of an L background plane (L (left) background plane) 14L for storing images for the left eye and an R background plane (R (right) background plane) 14R for storing images for the right eye.

The image for the left eye constituting the background 3D image drawn on the logical plane 10 is drawn on the L background plane 14L, and the image for the right eye is drawn on the R background plane 14R.

The image for the left eye and the image for the right eye drawn (recorded) on the graphics plane 11 , the PG plane 12 , the video plane 13 , and the background plane 14 are supplied to the mixer 15 .

The mixer 15 mixes the graphics left-eye image from the graphics plane 11, the PG left-eye image from the PG plane 12, the video left-eye image from the video plane 13, and the background left-eye image from the background plane 14 ( blend) (synthesis) to output an image for the left eye that is a result of the synthesis.

Also, the mixer 15 combines the graphics right-eye image from the graphics plane 11, the PG right-eye image from the PG plane 12, the video right-eye image from the video plane 13, and the background right-eye image from the background plane 14. Blending and compositing to output an image for the right eye as a result of the compositing.

The left-eye image output from the mixer 15 is supplied to a display not shown in the figure as a display output for the left side (L (left) display output). And, the image for the right eye output by the mixer 15 is supplied to a display not shown in the figure as a display output for the right side (R (right) display output).

A 3D image is displayed by alternately or simultaneously displaying the image for the left eye and the image for the right eye from the mixer 15 using a display not shown in the figure.

Among the graphics plane 11 , PG plane 12 , video plane 13 , and background plane 14 , the BD-J application can perform rendering of images on the graphics plane 11 and the background plane 14 .

Now, in this embodiment, let us assume that a BD-J application can only access the logical plane 10, and that a BD-J application cannot directly access the graphics plane 11 and the background plane 14.

Therefore, a BD-J application can only render images on the logical plane 10 , but cannot directly render images on the graphics plane 11 and the background plane 14 . Therefore, a BD-J application indirectly draws an image on the graphics plane 11 or the background plane 14 by drawing the image on the logical plane 10 .

However, below, for convenience of description, the image rendering of the graphics plane 11 or the background plane 14 by the BD-J application via the logical plane 10 will be simply described as the image rendering of the graphics plane 11 or the background plane 14 .

Note that a 3D-compatible player may be configured not to include the logical plane 10 . In this case, the BD-J application directly draws an image on the graphics plane 11 or the background plane 14 .

In addition to drawing images on the graphics plane 11 and the background plane 14, the BD-J application can perform playback control of video and PG, such as control of scaling or position (display position) of video and PG, and the like.

Note that BD-J applications handle Video and PG as a set (collectively). In other words, the BD-J application does not distinguish (cannot distinguish) video and PG.

BD-J application's rendering of graphic images

FIG. 5 is a diagram for describing rendering of a graphics 3D image by a BD-J application on the graphics plane 11 (stereoscopic graphics plane).

The first rendering method and the second rendering method may be used as the 3D image rendering method.

A in FIG. 5 is a diagram for describing the first rendering method.

In the first rendering method, the author of the BD-J application performs rendering on a stereoscopic plane.

Specifically, in the first drawing method, the data of the graphic 3D image is composed of the data of the image for the left eye and the data of the image for the right eye, and the BD-J application draws the image for the left eye and the data of the image for the right eye on the logical plane 10. with images.

Then, the image for the left eye and the image for the right eye drawn on the logical plane 10 are drawn on the graphics plane 11 without change. Specifically, the image for the left eye drawn on the logical plane 10 is drawn on the L graphics plane 11L without change, and the image for the right eye drawn on the logical plane 10 is drawn on the R graphics plane without change. 11R on.

B in FIG. 5 is a diagram for describing the second drawing method.

In the second rendering method, the author of the BD-J application performs rendering on a mono plane. In addition, the author also provides the offset value (graphics plane offset value). The 3D compatible player generates a stereoscopic plane from the non-stereoscopic plane based on the offset value.

That is to say, in the second drawing method, the data of the 3D image is composed of the data of the original image serving as a so-called source for generating the 3D image, and the data for generating the left image from the original image by applying parallax to the original image. The parallax data of the eye image and the right eye image.

The BD-J application draws original images on the logical plane 10 . The 3D-compatible player draws an image for the left eye and an image for the right eye generated by applying parallax to the original image drawn on the logical plane 10 on the L graphics plane 11L and the R graphics plane 11R, respectively.

Now, if we assume that the data of disparity is an offset value (offset), the number of pixels to be shifted in the horizontal direction (x direction) from the position of the original image can be used as the offset value.

For the L graphics plane 11L, the original image drawn on the logical plane 10 is drawn at a position shifted in the horizontal direction by the offset value, where the direction from left to right is a positive direction. That is, an image obtained as a result of shifting the position of the original image drawn on the logical plane 10 in the horizontal direction by the offset value is drawn on the L graphics plane 11L as an image for the left eye.

For the R graphics plane 11R, the original image drawn on the logical plane 10 is drawn at a position shifted in the horizontal direction by the offset value, where the right-to-left direction is a positive direction. That is, an image obtained as a result of shifting the position of the original image drawn on the logical plane 10 in the horizontal direction by the offset value is drawn on the R graphics plane 11R as an image for the right eye.

Note that the original image drawn on the logical plane 10 is shifted horizontally and drawn on the L graphics plane 11L, so that areas (pixels) where drawing is not performed appear in areas to be drawn (positions in the horizontal direction are not within the area in which the delineation is performed without shifting). An area of the L graphics plane 11L in which rendering of an original image is not performed is rendered in a transparent color. The same is true for the R graphics plane 11R.

Now, in the case where the offset value is positive, the 3D image displayed with the image for the left eye and the image for the right eye appears to float upward toward the near side in the depth direction perpendicular to the display screen of the display not shown. out. On the other hand, in the case where the offset value is negative, the 3D image displayed with the image for the left eye and the image for the right eye appears to be concave toward the depth side in the depth direction.

FIG. 6 is a diagram showing a graphics mode in which a BD-J application draws a graphics 3D image on the graphics plane 11 to reproduce the graphics image.

Let us stipulate that, for the Reference Decoder Model (Reference Decoder Model), a 3D-compatible player always includes two planes (L Graphics Plane 11L and R Graphics Plane 11R), and a BD-J application performs rendering to Logical Plane 10 .

Then, finally, the image for the left eye of the graphics drawn on the L graphics plane 11L (L graphics plane) is mixed with the image for the left eye of the video (and PG) drawn on the L video plane 13L (L video plane) . Also, the right-eye image of graphics drawn on the R graphics plane 11R (R graphics plane) is mixed with the right-eye image of video drawn on the R video plane 13R (R video plane).

A in FIG. 6 shows the mono-logical-plane+offset value mode, which is a mode Mode#1 in the graphics mode (hereinafter also referred to as "offset graphics mode").

In offset graphics mode, the BD-J application renders a non-stereoscopic image as a graphic 2D image on the logical plane 10 . In addition, the BD-J application gives an offset value to the 3D compatible player.

The 3D-compatible player generates a stereoscopic image as a graphic 3D image from the non-stereoscopic image drawn on the logical plane 10 and the offset value given from the BD-J application. In addition, the BD player draws (stores) the left-eye image constituting the stereoscopic image on the L graphics plane 11L (L area), and also draws (stores) the left-eye image constituting the stereoscopic image on the R graphics plane 11R (R area). Image for the right eye.

Then, the mixer 15 blends the graphics left-eye image drawn (stored) on the L graphics plane 11L with the video (and PG) left-eye image drawn on the L video plane 13L, and outputs the blended result. In addition, the mixer 15 blends the graphics right-eye image drawn on the R graphics plane 11R with the video right-eye image drawn on the R video plane 13R, and outputs the blended result.

B in FIG. 6 shows the stereo-logical-plane mode, which is a mode Mode#2 in the graphics mode (hereinafter also referred to as "stereoscopic graphics mode").

In the stereoscopic graphics mode, the BD-J application draws left-eye images and right-eye images constituting a stereoscopic image as a graphics 3D image on the logical plane 10 .

The 3D-compatible player draws the left-eye image drawn on the logical plane 10 on the L graphics plane 11L, and also draws the right-eye image drawn on the logical plane 10 on the R graphics plane 11R.

Then, the mixer 15 blends the graphics image for left eye drawn on the L graphics plane 11L with the video image for left eye drawn on the L video plane 13L, and outputs the blended result. In addition, the mixer 15 blends the graphics right-eye image drawn on the R graphics plane 11R with the video right-eye image drawn on the R video plane 13R, and outputs the blended result.

C in FIG. 6 shows a forced-mono-logical-plane mode, which is a mode Mode#3 among graphics modes (hereinafter also referred to as "forced non-stereo graphics mode").

In the forced non-stereoscopic graphics mode, the BD-J application renders a stereoscopic image as a graphical 3D image on the logical plane 10 .

The 3D compatible player draws one of the L graphics image and the R graphics image of the stereoscopic image drawn on the logical plane 10 on one of the L graphics plane 11L and the R graphics plane 11R, for example only on the L graphics plane 11L, For example, only the L graphic image is drawn.

Then, the mixer 15 blends the graphics non-stereoscopic image drawn on the L graphics plane 11L with the video image drawn on the L video plane 13L, and outputs the blended result.

D in FIG. 6 shows a flattened-stereo-logical-plane mode, which is a mode Mode#4 among graphics modes (hereinafter also referred to as “flattened stereoscopic graphics mode”). In the flattened stereoscopic graphics mode, the BD-J application draws left-eye images and right-eye images constituting a stereoscopic image as a graphics 3D image on the logical plane 10 .

The 3D-compatible player draws either the image for the left eye or the image for the right eye drawn on the logical plane 10 on both the L graphics plane 14L and the R graphics plane 14R, for example, draws only the image for the left eye, and Additional images for the right eye are discarded.

Then, the graphics left-eye image drawn on the L graphics plane 14L is supplied to the mixer 15 , and the graphics left-eye image drawn on the graphics plane 14R is also supplied to the mixer 15 (as a right-eye image).

E in FIG. 6 shows the mono-logical-plane mode, which is a mode Mode#5 in the graphics mode (hereinafter also referred to as "non-stereoscopic graphics mode").

In the non-stereoscopic graphics mode, the BD-J application renders a non-stereoscopic image as a graphical 2D image on the logical plane 10 .

The 3D-compatible player draws a non-stereoscopic image drawn on the logical plane 10 on one of the L graphics plane 11L and the R graphics plane 11R, for example, only on the L graphics plane 11L.

Then, the mixer 15 blends the graphics non-stereoscopic image drawn on the L graphics plane 11L with the video image drawn on the L video plane 13L, and outputs the blended result.

Setting and obtaining the offset value

In a 3D compatible player, an offset value can be applied to the graphics plane 11 and the PG plane 12 .

Here, an offset value (data for providing disparity to a graphics image) to be applied to the graphics plane 11 will also be referred to as a Graphics plane offset value. In addition, an offset value (data for providing parallax to a PG image) to be applied to the PG plane 12 will also be referred to as a PG plane offset value.

For the setting/obtaining of the graphics plane offset value, an API dedicated to read/write of the offset value such as the following is defined so that the dedicated API can perform the setting/obtaining of the graphics plane offset value.

org.bluray.ui.3D

public void setOffset(int offset)

The default value is 0.

public int getOffset()

The default value is 0.

Note that the setOffset() method is a method for storing (setting) a graphics plane offset value in an internal storage area which is a storage area set inside the BD player, and getOffset() is a method for A method of obtaining the graphics plane offset value stored in the internal storage area of the BD player.

In addition, the BD player has a PSR (Player Setting Register, player setting register) for storing information related to BD playback, and the graphics plane offset value and the PG plane offset value are reserved for the traditional PSR Players, for example, may be stored in PSR#21.

Here, the entity of the internal storage area and the PSR is a partial storage area of the RAM 104 or the hard disk 105 in FIG. 3 .

By the way, in the current BD standard (BD-ROM standard), writing from a BD-J application to a PSR of a BD player is prohibited.

Allowing the BD player in Fig. 3 as a 3D compatible player to perform writing into the PSR from a BD-J application would result in having to modify the current BD standard on a large scale.

Thus, in 3D-compatible players, writing in the PSR is enabled indirectly by defining the offset value as a General Preference.

Specifically, the 3D-compatible player includes a general preference API (Application Programming Interface) for storing information related to BD playback with an offset value as one of the BD-compliant general preferences (General Preference). PSR #21 of information performs reading/writing of an offset value which is data for providing parallax to graphics or PG images conforming to the BD standard.

Here, PSR#21 is mapped to the general preference in Appendix L of Part 3-2 of the BD standard, and its value can be set or obtained by the org.dvb.user.GeneralPreference API.

The general preference name (General Preferencename) for the general preference API to access the PSR can be defined as follows.

In particular, a general preference name for the graphics plane offset value may be defined as "graphics offset", for example. In addition, a general preference name for the PG plane offset value may be defined as "subtitle offset", for example.

Now, let's assume that the default values for both the "graphics offset" general preference and the "subtitle offset" general preference are, for example, 0.

In addition, for the setting/obtaining of the graphics plane offset value, a dedicated API such as the following is defined so that the setting/obtaining of the graphics plane offset value can be performed.

org.bluray.ui.3D

public void setOffset(int offset)

The default value is 0.

public int getOffset()

The default value is 0.

Note that setOffset() is a method for storing a graphics plane offset value in an internal storage area (eg, PSR here), and getOffset() is a method for obtaining a graphics plane offset value stored in an internal storage area of a BD player. method of transfer.

FIG. 7 is a diagram illustrating the BD player in FIG. 3 as a 3D-compatible player for performing reading/writing of offset values for graphics and PGs (hereinafter including TextST unless otherwise specified) conforming to the BD standard. A block diagram of an example of a functional configuration.

Specifically, A in FIG. 7 is a block diagram showing an example of a functional configuration of the BD player in FIG. 3 as a 3D-compatible player including an API dedicated to reading/writing of offset values using It is used to read/write the offset value of graphics and PG conforming to the BD standard to the internal storage area of the 3D compatible player.

In the 3D-compatible player in A in Fig. 7, the BD-J application requests an API (general preference API) dedicated to read/write of offset values to read/write (set or get) offset values. transfer value.

In response to a request from a BD-J application, an API dedicated to read/write of an offset value sets an offset value (graphics plane offset value, PG plane offset value) to the internal storage of a 3D-compatible player area, or get the offset value from the internal storage area of the 3D compatible player and return it to the BD-J application.

Note that, in A in Fig. 7, the Playback Control Engine (Playback Control Engine) performs control to draw on the logical plane from the BD-J application based on the offset value set to the internal storage area of the 3D-compatible player. The image (original image) on 10 generates (plays) the image for the right eye and the image for the left eye.

As described above, the API dedicated to reading/writing of offset values is defined, and the API dedicated to reading/writing of offset values responds to a request from a BD-J application to a 3D-compatible player. The internal storage area performs reading/writing of the offset value which is data for providing parallax to graphics and PG images conforming to the BD standard, so that the offset value for providing parallax to images can be changed from BD- J applies to set or get indirectly.

B in FIG. 7 is a diagram showing the read/write of an offset value to PSR#21 as one of the general preferences for including graphics conforming to the BD standard and the offset value of the PG. A block diagram of a functional configuration example of a BD player in FIG. 3 of a 3D compatible player of the general preference API.

In the 3D-compatible player in B in FIG. 7 , the BD-J application requests the general preference API to read/write (set or get) the offset value.

Specifically, in the case that the offset value to be read/written is a graphics plane offset value, the BD-J application calls the general preference API, where the general preference name (General Preferencename) is "graphics offset".

Also, in the case where the offset value to be read/written is a PG plane offset value, the BD-J application calls the general preference API, where the general preference name is "subtitle offset".

In response to a request from the BD-J application, the general preference API sets the offset value to PSR#21 of the PSR (Player Setting Register), or obtains the offset value from PSR#21 and returns it to the BD -J apply.

Note that in B in Fig. 7, the playback control engine (Playback Control Engine) executes the image (original image) drawn on the logical plane 10 from the BD-J application according to the offset value set to PSR#21 Controls to generate (play) images for left eye and images for right eye.

As described above, the general preference API takes an offset value (which is data that gives parallax to BD-compliant graphics and PG images) as one of the BD-compliant general preferences according to a request from a BD-J application. PSR#21 storing information related to playback of BD performs reading/writing of offset values, so that offset values giving parallax to images can be indirectly set or obtained from the BD-J application.

configuration

FIG. 8 is a diagram showing a video mode for playing video images as one of configurations of the video plane 13 .

A in FIG. 8 shows a mono-video mode (hereinafter also referred to as "non-stereoscopic video mode"), which is a mode Mode#1 among video modes.

In the non-stereoscopic video mode, the 3D compatible player draws (stores) as a video 2D image on one of the L video plane 13L (L area) and the R video plane 13R (R area), for example only on the L video plane 13L non-stereoscopic images.

Then, only the video monaural image drawn (stored) on the L video plane 13L is supplied to the mixer 15 .

B in FIG. 8 shows a dual-mono-video mode (hereinafter also referred to as "dual non-stereoscopic video mode"), which is a mode Mode#2 among video modes.

In dual monaural video mode, the 3D-compatible player draws (stores) a monaural image (as a left-eye image) as a video 2D image on the L video plane 13L (L area), and also draws (stores) a monaural image (as an image for the left eye) on the L video plane 13L ( R region) to draw (store) the non-stereoscopic image (as an image for the right eye).

Then, the video non-stereoscopic image drawn (stored) on the L video plane 13L and the video non-stereoscopic image drawn (stored) on the R video plane 13R are supplied to the mixer 15 .

C in FIG. 8 shows a stereo-video mode (hereinafter also referred to as “stereoscopic video mode”), which is Mode#3 among the video modes.

In the stereoscopic video mode, the 3D compatible player draws an image for the left eye constituting a stereoscopic image as a video 3D image on the L video plane 13L, and also draws an image for the right eye constituting the stereoscopic image on the R video plane 13R.

Then, both the video image for left eye drawn (stored) on the L video plane 13L and the video image for right eye drawn (stored) on the R video plane 13R are supplied to the mixer 15 .

D in FIG. 8 shows a flattened-stereo-video mode (hereinafter also referred to as “flattened stereoscopic video mode”), which is Mode#4 among the video modes.

In the flattened stereoscopic video mode, the 3D-compatible player draws one of the image for the left eye and the image for the right eye (for example, only the image for the left eye) constituting the stereoscopic image as the video 3D image on the L video plane 13L and R video on both planes 13R and discard the additional right-eye image.

Then, the video image for left eye drawn (stored) on the L video plane 13L is supplied to the mixer 15, and the video image for left eye drawn on the R video plane 13R is also supplied to the mixer 15 (as the right eye with images).

E in FIG. 8 shows a forced-mono-video mode (hereinafter also referred to as "forced non-stereoscopic video mode"), which is Mode#5 among the video modes.

In the forced non-stereoscopic video mode, the 3D-compatible player draws an image for the left eye constituting a stereoscopic image as a video 3D image on one of the L video plane 13L and the R video plane 13R, for example, only on the L video plane 13L. and one of the images for the right eye, for example, only the image for the left eye is drawn, and the other image for the right eye is discarded.

Then, only the video image for left eye drawn (stored) on the L video plane 13L is supplied to the mixer 15 .

FIG. 9 is a diagram showing a background mode for playing a background image as one of configurations of the background plane 14 .

A in FIG. 9 shows a dual-mono-background mode (hereinafter also referred to as "dual mono-background mode"), which is Mode#1 among the background modes.

In the dual non-stereoscopic background mode, the BD-J application draws a non-stereoscopic image, which is a 2D image in the background mode, on the logical plane 10 as an image for the left eye and an image for the right eye.

Then, the 3D-compatible player draws (stores) the image for the left eye drawn on the logical plane 10 on the L background plane 14L (L area), and also draws (stores) on the R background plane 14R (R area). ) is an image for the right eye drawn on the logical plane 10 .

Both the background image for the left eye drawn (stored) on the L background plane 14L and the background image for the right eye drawn on the R background plane 14R are supplied to the mixer 15 .

B in FIG. 9 shows a stereo-background mode (hereinafter also referred to as “stereo background mode”), which is Mode#2 among the background modes.

In the stereoscopic background mode, the BD-J application draws a left-eye image and a right-eye image constituting a stereoscopic image as a background 3D image on the logical plane 10 .

Then, the 3D-compatible player draws the image for the left eye drawn on the logical plane 10 on the L background plane 14L, and also draws the image for the right eye drawn on the logical plane 10 on the R background plane 14R.

Both the background image for the left eye drawn on the L background plane 14L and the background image for the right eye drawn on the R background plane 14R are supplied to the mixer 15 .

C in FIG. 9 shows a flattened-stereo-background mode (hereinafter also referred to as “flattened stereo background mode”), which is Mode#3 among the background modes.

In the flattened stereoscopic background mode, the BD-J application draws a left-eye image and a right-eye image constituting a stereoscopic image as a background 3D image on the logical plane 10 .

Then, the 3D-compatible player draws one of the left-eye image and the right-eye image (for example, only the left-eye image) drawn on the logical plane 10 on both the L background plane 14L and the R background plane 14R, and Additional images for the right eye are discarded.

The background image for left eye drawn on the L background plane 14L is supplied to the mixer 15 , and the background image for left eye drawn on the R background plane 14R is also supplied to the mixer 15 (as the image for right eye).

D in FIG. 9 shows the mono-background mode (hereinafter also referred to as "non-stereoscopic background mode"), which is Mode#4 among the background modes.

In the non-stereoscopic background mode, the BD-J application draws a non-stereoscopic image as a background 2D image on the logical plane 10 .

Then, the 3D compatible player draws the non-stereoscopic image drawn on the logical plane 10 on one of the L background plane 14L and the R background plane 14R, for example only on the L background plane 14L.

The background non-stereoscopic image drawn on the L background plane 14L is supplied to the mixer 15 .

E in FIG. 9 shows a forced-mono-background mode (hereinafter also referred to as “forced mono-background mode”), which is Mode#5 among the background modes.

In the forced non-stereoscopic background mode, the BD-J application draws a left-eye image and a right-eye image constituting a stereoscopic image as a background 3D image on the logical plane 10 .

Then, the 3D-compatible player draws one of the left-eye image and the right-eye image drawn on the logical plane 10 on one of the L background plane 14L and the R background plane 14R, for example, only on the L background plane 14L, For example, only the image for the left eye is drawn, and the other image for the right eye is discarded.

The background left-eye image drawn on the L background plane 14L is supplied to the mixer 15 .

Now, let us assume that the graphics plane 11 storing graphics, the video plane 13 storing video (and the PG plane 12 storing PG), and the background plane 14 storing background shown in FIG. 4 are also collectively referred to as a device plane.

In the BD player as a 3D compatible player in Figure 3, the configuration of the device plane is defined to be represented by the following four attributes: (1) resolution and color depth, (2) video mode (Video mode), (3) Graphics mode (BD-J Graphics mode), and (4) Background mode (Background mode).

FIG. 10 shows the relationship among the Graphics Plane 11, the PG Plane 12, the Video Plane 13, and the Background Plane 14 which are device planes.

The graphics plane 11 is composed of an L graphics plane 11L serving as an L area serving as a storage area for storing left-eye images, and an R graphics plane 11R serving as an R area serving as a storage area for storing right-eye images. Then, in the graphics plane 11, an L graphics plane 11L and an R graphics plane 11R are arranged side by side.

Specifically, in FIG. 10 , the L graphics plane 11L and the R graphics plane 11R are vertically arranged side by side in a form in which the L graphics plane 11L as the L area is arranged on the upper side, and the R graphics plane as the R area 11R is arranged on the lower side, thereby constituting a graphics plane 11 .

The other device planes, namely the PG plane 12, the video plane 13 and the background plane 14, are also structured in the same way as the graphics plane 11.

The images drawn on the graphics plane 11, PG plane 12, video plane 13, and background plane 14 are superimposed (blended) in order from the near side on the graphics plane 11, PG plane 12, video plane 13, and background plane 14, and as The image of the L area and the image of the R area obtained as a result are alternately drawn (stored) on the logical screen 21 in which the display screen of the display is abstracted.

Here, the substance of the logical screen 21 is a partial storage area of the RAM 104 .

In addition, the device plane is composed of storage areas in which L area and R area each of which is an image storage area of one image size are vertically arranged, and thus is an image storage area of two image sizes, but the logical screen 21 is one The image storage area for the image size.

For a 3D image, the configuration of the device plane is defined for the entirety of the device plane as an image storage area of two image sizes.

FIG. 11 shows (1) image frame (resolution, Resolution) and color depth (color-depth) as one configuration of the device plane.

In FIG. 11 , the image frame (the number of horizontal pixels of the device plane × the number of vertical pixels) (resolution) and the color depth of five lines from the top indicate the image frame and color depth of the 3D image, and the remaining five lines (from the bottom The image frame and color depth of five rows of ) indicate the image frame and color depth of the 2D image.

In the case of a 2D image with a size of one image as an image with a size of one image, a 3D image is composed of an image for a left eye and an image for a right eye, thereby being an image with a size of two images. In addition, all device planes are storage areas in which the L area and the R area, which are image storage areas of one image size, are vertically aligned, so that an image frame of a 3D image to be stored in such a device plane has A size obtained by doubling the number of pixels in the vertical direction of an image frame (2D image having the same size as the image for the left eye (or the image for the right eye)).

Note that in the current BD standard, for 2D images, the image frames of the graphics (image) stored in the graphics plane 11, and the image frames of the background (image) stored in the background plane 14 are the same as those stored in the video plane 13. The image frames of the video (image) are substantially matched.

However, for 2D images, in the case where the image frame of the video to be stored in the video plane 13 is 1920×1080 pixels, the image frame of the background to be stored in the background plane 14 is the same as the image frame of the video to be stored in the video plane 13 The same image frame is 1920×1080 pixels, but the image frame of the graphics to be stored in the graphics plane 11 may be obtained by dividing the width and length of the image frame of the video to be stored in the video plane 13 by 2 960×540 pixels (the fourth row from the bottom in FIG. 11 ) (hereinafter, referred to as “mismatch situation of 2D image”).

In this case, after doubling the width and length of graphics of 960 x 540 pixels to be stored in the graphics plane 11, its size is the same as the image frame of 1920 x 1080 pixels to be stored in the video plane 13. After the pixels are matched, the graphic is displayed.

For 3D images, there may also be cases corresponding to mismatch cases of 2D images (hereinafter also referred to as “mismatch cases of 3D images”).

For the case of mismatching of 3D images, when the image frame of the video to be stored in the video plane 13 is 1920×2160 pixels, the image frame of the background to be stored in the background plane 14 is the same as that to be stored in the video plane 13 The image frame of the video is the same as 1920×2160 pixels, but the image frame of the graphics to be stored in the graphics plane 11 may be obtained by dividing the width and length of the image frame of the video to be stored in the video plane 13 by 2 respectively. The resulting 960×1080 pixels (third row from the top in Figure 11).

Even in the case of mismatching of 3D images, the size is equal to 1920×2160 pixels as an image frame of video to be stored in video plane 13 by doubling the width and length of graphics of 960×1080 pixels each. After matching, display the graphic's.

FIG. 12 is a diagram for describing a method of rendering a 3D image using the second rendering method (B in FIG. 5 ) in the case of a mismatch of the 3D image.

In the second rendering method (such as described in B in FIG. 5 ), an original image serving as a source for generating a 3D image is rendered on the logical plane 10, and then the original image is shifted in the horizontal direction by The left-eye image and right-eye image generated by offsetting the values are drawn on the graphics plane 11 .

Now, the second drawing method can also be described as a method in which two images obtained by horizontally shifting the upper half and the lower half of a vertically longer image according to the offset value are used as the left eye An image for the right eye and an image for the right eye are drawn on the graphics plane 11 in which two images of an original image and a copy of the original image are vertically arranged in this vertically long image.

In the second rendering method, in the case of a mismatch of the 3D image, the 960× An image for left eye and an image for right eye of 540 pixels are drawn on the graphics plane 11, and then after doubling the width and length of the image for left eye and the image for right eye of the graphics plane 11, obtained as a result thereof The image for the left eye and the image for the right eye are images whose shift amount in the horizontal direction is twice the offset value.

Therefore, in this case, the position in the depth direction of the 3D image displayed by the image for the left eye and the image for the right eye is different from the position expected by the author.

Therefore, in the case of a mismatch of the 3D image, if the 3D image is rendered using the second rendering method, an image obtained by doubling each of the width and length of the original image serving as a source for generating the 3D image needs to be rendered in on the logical plane 10 , and an image for left eye and an image for right eye to be generated subsequently by shifting the image drawn on the logical plane 10 in the horizontal direction by the offset value need to be drawn on the graphics plane 11 .

Therefore, the position in the depth direction of the 3D image displayed using the image for the left eye and the image for the right eye is the position expected by the author.

Fig. 13 is a diagram for describing a device plane.

In the current BD standard, an image storage area of one image size is assumed to be a logical screen 21, and it is not assumed that an image for the left eye (Left/Left-eye) and an image for the right eye (Right/Right-eye) are drawn alternately On the logical screen 21 which is an image storage area of the one image size.

In addition, in the current BD standard, it is assumed that there is a one-to-one relationship between the configuration of the device plane and the logical screen 21 . Under this assumption, for 3D image processing, two separate logical screens, a logical screen for drawing an image for the left eye and a logical screen for drawing an image for the right eye, need to be provided as the logical screen 21 .

Therefore, in the BD player as a 3D compatible player in FIG. 3, the device configuration for L/R is defined with one image by doubling the definition of the resolution in the vertical direction. A rendering model is defined where the logical screen itself is conventionally considered as an image and the output for L/R is simultaneously rendered on it.

That is, the BD player in FIG. 3 includes device planes (graphics plane 11 , video plane 13 (PG plane 12 ), and background plane 14 ) that store graphics, video, or background images conforming to the BD standard.

The device plane is where two image-sized image storage areas such as the L area (one-image-sized image storage area that stores an image for the left eye) and the R area (one-image-sized image storage area that stores an image for the right eye) are side by side The storage area arranged, and the configuration of the device plane is defined for the entirety of the device plane as an image storage area of two image sizes.

Then, the image for the left eye and the image for the right eye stored in the device plane are alternately drawn on the logical screen 21 , for example.

Thus, a logical screen storing an image for the left eye (image for L) and a logical screen storing an image for the right eye (image for R) do not have to be provided separately.

Video Mode, Graphics Mode, and Background Mode

The configuration can be specified (set) by providing a bit field for specifying the configuration within the BD-J object (Object) file.

Fig. 14 shows bit fields to be provided within a BD-J object file to specify a configuration.

Four fields of initial_configuration_id, initial_graphics_mode, initial_video_mode, and initial_background_mode may be provided within the BD-J object file to specify a configuration.

initial_configuration_id is a field for specifying (1) image frame and color depth. If we assume that the value taken by initial_configuration_id is a configuration id, the following values can be defined as configuration ids.

HD_1920_1080=1

HD_1280_720=2

SD_720_576=3

SD_720_480=4

QHD_960_540=5

HD_1920_2160=6

HD_1280_1440=7

SD_720_1152=8

SD_720_960=9

QHD_960_1080=10

Note that HD_1920_1080 indicates the image frame and color depth at the sixth row from the top in Figure 11, HD_1280_720 indicates the image frame and color depth at the eighth row from the top in Figure 11, and SD_720_576 indicates the tenth row from the top in Figure 11 The image frame and color depth at the row, SD_720_480 indicates the image frame and color depth at the ninth row from the top in Figure 11, QHD_960_540 indicates the image frame and color depth at the seventh row from the top in Figure 11, HD_1920_2160 indicates the image The image frame and color depth at the first row from the top in Figure 11, HD_1280_1440 indicates the image frame and color depth at the second row from the top in Figure 11, and SD_720_1152 indicates the image frame and color depth at the fifth row from the top in Figure 11 Color depth, SD_720_960 indicates the image frame and color depth at the fourth row from the top in FIG. 11 , and QHD_960_1080 indicates the image frame and color depth at the third row from the top in FIG. 11 .

initial_graphics_mode is a field for specifying (3) graphics mode.

Now, there are a total of five modes as the graphics mode (BD-J Graphics mode), that is, the offset graphics mode (offset), the stereo graphics mode (stereo), the non-stereo graphics mode (non-stereo (traditional) playback mode)), forced non-stereoscopic graphics mode (Forced non-stereoscopic (legacy playback mode)), and flattened stereoscopic graphics mode (flattened stereo).

Let us assume the following value is defined as initial_graphics_mode for specifying the graphics mode.

GRAPHICS_MONO_VIEW=22

GRAPHICS_STEREO_VIEW=23

GRAPHICS_PLANE_OFFSET=24

GRAPHICS_DUAL_MONO_VIEW=25

GRAPHICS_FORCED_MONO_VIEW=26

Note that GRAPHICS_MONO_VIEW indicates a non-stereoscopic graphics mode, GRAPHICS_STEREO_VIEW indicates a stereoscopic graphics mode, GRAPHICS_PLANE_OFFSET indicates an offset graphics mode, GRAPHICS_DUAL_MONO_VIEW indicates a flattened stereographics mode, and GRAPHICS_FORCED_MONO_VIEW indicates a forced non-stereoscopic graphics mode.

Also, in the case where initial_configuration_id is set to any one of 1, 2, 3, 4, and 5, initial_graphics_mode is ignored.

initial_video_mode is a field for specifying (2) video mode.

Now, there are a total of five modes as the video mode (Video mode), namely the dual non-stereoscopic video mode (dual non-stereoscopic), stereoscopic video mode (stereoscopic), flattened stereoscopic video mode (flattened stereoscopic) described in Figure 8 , non-stereoscopic video mode (monostereo (legacy playback mode)), and forced non-stereoscopic video mode (forced non-stereoscopic).

Let us assume the following value is defined as initial_video_mode for specifying video mode.

VIDEO_MONO_VIEW=27

VIDEO_STEREO_VIEW=28

VIDEO_FLATTENED_STEREO_VIEW=29

VIDEO_DUAL_MONO_VIEW=30

VIDEO_FORCED_MONO_VIEW=31

Note that VIDEO_MONO_VIEW indicates a non-stereoscopic video mode, VIDEO_STEREO_VIEW indicates a stereoscopic video mode, VIDEO_FLATTENED_STEREO_VIEW indicates a flattened stereoscopic video mode, VIDEO_DUAL_MONO_VIEW indicates a dual monaural video mode, and VIDEO_FORCED_MONO_VIEW indicates a forced non-stereoscopic video mode.

Also, in case initial_configuration_id is set to one of 1, 2, 3, 4, and 5, initial_video_mode is ignored.

initial_background_mode is a field for designating (4) a background mode.

Now, there are a total of five modes as the background mode (Backgroud mode), that is, the double non-stereoscopic background mode (double non-stereoscopic), stereoscopic background mode (stereoscopic), flattened stereoscopic background mode (flattened stereoscopic) described in Figure 9 , non-stereoscopic background mode (monostereo (legacy playback mode)), and forced non-stereoscopic background mode (forced non-stereoscopic).

Let us assume the following value is defined as initial_background_mode for specifying the background mode.

BACKGROUND_MONO_VIEW=17

BACKGROUND_STEREO_VIEW=18

BACKGROUND_FLATTENED_STEREO_VIEW=19

BACKGROUND_DUAL_MONO_VIEW=20

BACKGROUND_FORCED_MONO_VIEW=21

Note that Background_MONO_VIEW represents a non-stereoscopic background mode, Background_STEREO_VIEW represents a stereoscopic background mode, Background_FLATTENED_STEREO_VIEW represents a flattened stereoscopic background mode, Background_DUAL_MONO_VIEW represents a dual non-stereoscopic background mode, and Background_FORCED_MONO_VIEW represents a forced non-stereoscopic background mode.

Also, in the case where initial_configuration_id is set to one of 1, 2, 3, 4, and 5, initial_background_mode is ignored.

Now, for a BD-J object file, it is possible to adopt a specification in which, among initial_configuration_id, initial_graphics_mode, initial_video_mode, and initial_background_mode, only initial_configuration_id is specified.

For a BD-J object file, when only the initial_configuration_id is specified, it is necessary to provide default specified values of initial_video_mode, initial_graphics_mode, and initial_background_mode.

FIG. 15 shows default prescribed values of initial_video_mode, initial_graphics_mode, and initial_background_mode.

Note that STEREO_VIEW of the video mode (initial_video_mode) represents the above-mentioned VIDEO_STEREO_VIEW or VIDEO_FLATTENED_STEREO_VIEW, and MONO_VIEW represents the above-mentioned VIDEO_MONO_VIEW or VIDEO_DUAL_MONO_VIEW.

In addition, STEREO_VIEW of the graphics mode (initial_graphics_mode) represents the above-mentioned GRAPHICS_STEREO_VIEW or GRAPHICS_PLANE_OFFSET, and MONO_VIEW represents the above-mentioned GRAPHICS_MONO_VIEW or GRAPHICS_DUAL_MONO_VIEW.

Also, STEREO_VIEW of the background mode (initial_background_mode) represents the above-mentioned Background_STEREO_VIEW or BACKGROUND_FLATTENED_STEREO_VIEW, and MONO_VIEW represents the above-mentioned Background_MONO_VIEW or Background_DUAL_MONO_VIEW.

configuration changes

Next, changes in configuration will be described.

The configuration can be changed at the timing when automatic reset is performed when a BD-J Title is started or PlayList is played (dynamic change), or when an API call by a BD-J application is performed (dynamic change).

Unlike conventional playback of monaural video+mono graphics, change of plane configuration is available even during playback of AV.

That is, in a 3D-compatible player, it is possible to change the configuration while playing an AV stream (video).

Similar to Mono-view, in playback other than KEEP_RESOLUTION playback, 3D-compatible players perform configuration change processing so that image frames are aligned (so that video/background is aligned with image frames of graphics when starting a BD-J title, Align the graphics/background with the image frame of the video during PlayList playback, or align the image frame of the plane set by the API with the image frame of the plane not set other than the plane when the BD-J application calls the API frame alignment). Also, error handling when configuration changes are up to the 3D compatible player.

KEEP_RESOLUTION replay is now a replay mode for compositing SD (Standard Definition) video and HD (High Definition) graphics with HD backgrounds, and there is composite 1920×1080 pixel graphics, 720×480 pixel video The case of +PG and a background of 1920×1080 pixels, and the case of compositing graphics of 1920×1080 pixels, video of 720×576 pixels +PG and a background of 1920×1080 pixels. Note that regardless of the HD image, reproduction of an image of 1280×720 pixels is not included in KEEP_RESOLUTION playback.

16 and 17 show combinations of resolutions (image frames) of video+PG, BD-J graphics, and background for playback other than KEEP_RESOLUTION playback. Note that FIG. 17 is a continuation of FIG. 16 .

Fig. 18 shows an example of configuration change processing.

A in FIG. 18 shows an example of the processing of the 3D-compatible player in the case where the configuration (video mode) of graphics (graphics plane 11 ) is changed from STEREO_VIEW to MONO_VIEW.

For example, in a 3D compatible player, in the case where the video mode is STEREO_VIEW, graphics are drawn on the L graphics plane 11L and the R graphics plane 11R constituting the graphics plane 11 of 1920×2160 pixels, let us assume that without resetting The video mode is changed from STEREO_VIEW to MONO_VIEW in the case of graphics plane 11 (serving as a storage area for graphics plane 11).

In this case, in the 3D-compatible player, only images stored (drawn) on one of the L graphics plane 11L and the R graphics plane 11R constituting the graphics plane 11 (for example, the L graphics plane 11L) are provided to the logical screen 21 and displayed, while the image stored in the other R graphics plane 11R is discarded.

Note that in this case, the 3D-compatible player can forcibly end (playback of images) with an error.

B in FIG. 18 shows an example of processing by a 3D-compatible player in a case where the video mode is changed from MONO_VIEW to STEREO_VIEW.

For example, in a 3D compatible player, in the case where the video mode is MONO_VIEW, graphics are drawn only on the L graphics plane 11L constituting the graphics plane 11 of 1920×1080 pixels, let us assume that the graphics plane 11 is not reset In case the video mode is changed from MONO_VIEW to STEREO_VIEW.

In this case, in the 3D compatible player, the graphics drawn on the L graphics plane 11L are copied to the R graphics plane 11R, the graphics drawn on the L graphics plane 11L are provided to the logical screen 21 as images for the left eye, And the graphics copied to the R graphics plane 11R are also supplied to the logical screen 21 as images for the right eye.

Note that in this case, the 3D-compatible player can forcibly end (playback of images) with an error.

Configuration changes when launching BD-J titles

The following three rules #1-1, #1-2, and #1-3 are applied in principle to configuration changes at the time of starting a BD-J title.

Specifically, rule #1-1 is the rule that in a configuration (of the device plane), the resolutions (image frames) of the three images of graphics, video, and background must always be the same resolution.

Rule #1-2 is a rule that, in the case of performing PlayList playback other than KEEP_RESOLUTION playback, in the configuration, the resolution (image frame) of the three images of graphics, video and background must match the resolution of the video rate alignment.

Rule #1-3 is a rule that, in a configuration, where the graphics are QHD graphics, the resolution doubled in the vertical direction and doubled in the horizontal direction is regarded as the resolution of the configuration.

Note that the value of each of video mode, graphics mode, and background mode is determined according to the default value specification of initial_configuration_id of the BD-J object file (determining video mode, graphics mode, and background mode).

In addition, when the autostart_first_PlayList_flag of the BD-J object file is set to 1b, the change of the arrangement of the video plane does not follow the default value, but follows the automatic reset (dynamic change) rule at the time of PlayList playback.

Configuration change (dynamic change) when executing PlayList-playback-time automatic reset

The following three rules #2-1, #2-2, and #2-3 are applied in principle to a configuration change at the time of automatic reset upon execution of PlayList playback.

Specifically, rule #2-1 is the rule that in a configuration (of the device plane), the resolutions (image frames) of the three images of graphics, video, and background must always be the same resolution.

Rule #2-2 is a rule that, in the case of performing PlayList playback other than KEEP_RESOLUTION playback, in the configuration, the resolution (image frame) of the three images of graphics, video, and background must match the resolution of the video rate alignment.

Rule #2-3 is a rule that, in a configuration, where the graphics are QHD graphics, the resolution doubled in the vertical direction and doubled in the horizontal direction is regarded as the resolution of the configuration.

At the start of PlayList's playback, the video plane configuration is automatically aligned with the PlayList's Video property.

In the case of configuring automatic alignment with the video attribute of the PlayList, the current BD standard stipulates that the graphics plane and the background plane are automatically aligned with the attributes of the video plane as a necessary function on the BD player side. However, in a 3D-compatible player, when switching from a stereoscopic PlayList (a Playlist for playing 3D images) to a non-stereoscopic PlayList (a Playlist for playing 2D , the modes of graphics and background (graphic mode and background mode) are set to predetermined initial values.

Fig. 19 shows predetermined initial values of the graphic mode and the background mode.

FIG. 20 shows graphics and background images to be played in the case of playing a 3D image (stereoscopic image) of 1920×2160 pixels.

A 1920x2160 pixel 3D image is played as graphics, and a 1920x2160 pixel 3D image is played as background.

Configuration changes (dynamic changes) when performing API calls made by BD-J applications

The following three rules #3-1, #3-2, and #3-3 are applied in principle to configuration changes when API calls by BD-J applications are performed.

Specifically, rule #3-1 is the rule that in a configuration (of the device plane), the resolutions (image frames) of the three images of graphics, video, and background must always be the same resolution.

Rule #3-2 is a rule that, in configurations, in the case of PlayList playback other than KEEP_RESOLUTION playback, the resolution (image frame) of the three images of graphics, video, and background must match the resolution of the video rate alignment.

Rule #3-3 is a rule that, in a configuration, in a case where the graphics are QHD graphics, the resolution doubled in the vertical direction and doubled in the horizontal direction is regarded as the resolution of the configuration.

Fig. 21 is a diagram for changing the resolution (image frame) serving as a configuration according to an API call made by a BD-J application.

3D compatible BD playback in case the resolution of the graphic 3D image has been changed according to the API call during playback of the graphic 3D image (stereoscopic G), video 3D image (stereoscopic V) and background 3D image (stereoscopic B) The processor automatically changes the resolution of the video 3D image and the background 3D image according to the above rules #3-1, #3-2 and #3-3.

In addition, during playback of a graphics 3D image (Stereo G), a video 3D image (Stereo V) and a background 3D image (Stereo B), in case the resolution of the background 3D image has been changed according to the API call, the 3D compatible The BD player automatically changes the resolution of the graphics 3D image and the video 3D image according to the above-mentioned rules #3-1, #3-2, and #3-3.

In addition, during playback of graphics 3D images (stereoscopic G), video 3D images (stereoscopic V) and background 3D images (stereoscopic B), in case the resolution of video 3D images has been changed according to API calls, 3D compatible The BD player automatically changes the resolution of the graphic 3D image and the background 3D image according to the above-mentioned rules #3-1, #3-2, and #3-3.

Mode change of plane configuration (graphics mode, video mode and background mode change)

The 3D-compatible player can seamlessly perform a change (switching) of a graphics mode between a stereoscopic graphics mode (Stereoscopic Graphics) and an offset graphics mode (Offset Graphics).

FIG. 22 is a diagram for describing a change of a graphics mode.

A in Figure 22 shows a situation where a graphics 3D image (planar offset gfx(graphics)), a video (and PG) 3D image (stereoscopic video+PG) and a background in offset graphics mode During playback of 3D images (stereoscopic background), the graphics mode was changed from offset graphics mode to stereoscopic graphics mode.

In this case, playback of graphics 3D images (planar offset gfx), video (and PG) 3D images (stereoscopic video+PG), and background 3D images (stereoscopic background) in offset graphics mode to stereoscopic graphics is performed Switching of playback of graphic 3D images (stereoscopic gfx (graphics)), video (and PG) 3D images (stereoscopic video+PG), and background 3D images (stereoscopic background) in the mode, and the switching can be performed seamlessly .

Inverse switching, i.e. playback from graphics 3D image (stereo gfx), video (and PG) 3D image (stereo video+PG) and background 3D image (stereo background) in stereo graphics mode to graphics in offset graphics mode Switching of playback of 3D images (plane shift gfx), video (and PG) 3D images (stereoscopic video+PG), and background 3D images (stereoscopic background) can also be performed seamlessly.

B in Figure 22 shows a situation where a graphics 3D image (stereoscopic gfx), a video (and PG) 3D image (stereoscopic video+PG) and a background 2D image (mono-background ) during playback, the graphics mode was changed from stereoscopic graphics mode to offset graphics mode.

In this case, playback of graphics 3D images (stereoscopic gfx), video (and PG) 3D images (stereoscopic video+PG), and background 2D images (non-stereoscopic background) from stereoscopic graphics mode to offset graphics mode is performed Switching of playback of graphical 3D images (plane offset gfx), video (and PG) 3D images (stereoscopic video+PG) and background 2D images (non-stereoscopic background) in , and the switching can be performed seamlessly.

Inverse switching, i.e. replay of graphics 3D images (planar offset gfx), video (and PG) 3D images (stereoscopic video+PG) and background 2D images (non-stereoscopic background) in offset graphics mode to stereoscopic graphics mode Switching of playback of graphical 3D images (stereoscopic gfx), video (and PG) 3D images (stereoscopic video+PG), and background 2D images (mono-stereoscopic background) in .

Fig. 23 shows a change of graphics mode from stereoscopic graphics mode to offset graphics mode.

Video (L/R (left/right) video) and background (L/R (left/right) Right) Replay of background) continues.

On the other hand, for graphics, the playback object is switched from a graphics 3D image in stereo graphics mode (stereo gfx) to a graphics 3D image in offset graphics mode (planar offset gfx).

Implementation of the switching method of this playback object depends on individual 3D compatible players. However, it is necessary to prevent occurrence of so-called black-out and interruption of AV (video) playback when switching playback objects.

Note that a black screen may occur in cases where changing the graphics mode also changes the resolution.

Next, the 3D-compatible player can seamlessly perform background mode change (switching) between the stereoscopic background mode (stereoscopic background) and the non-stereoscopic background mode (monostereoscopic background).

FIG. 24 is a diagram for describing a change of a background mode.

A in Figure 24 shows a situation where a graphics 3D image (stereoscopic gfx), a video (and PG) 3D image (stereoscopic video+PG), and a background 3D image (stereoscopic background) in stereoscopic background mode During playback of , the background mode was changed from anaglyph mode to non-stereoscopic mode.

In this case, playback from graphic 3D image (stereoscopic gfx), video (and PG) 3D image (stereoscopic video+PG), and background 3D image (stereoscopic background) in stereoscopic background mode to graphic 3D image (stereoscopic gfx), video (and PG) 3D images (stereoscopic video + PG), and playback of background 2D images (monostereoscopic background) in the monoscopic mode, and the switching can be performed seamlessly.

Inverse switching can also be performed seamlessly.

B in Figure 24 shows a situation where a background 2D image in a graphics 3D image (plane offset gfx), a video (and PG) 3D image (stereoscopic video+PG) and a non-stereoscopic background mode ( The background mode was changed from mono-stereoscopic mode to anaglyph mode during playback of non-stereoscopic background.

In this case, playback is performed from graphics 3D images (plane offset gfx), video (and PG) 3D images (stereoscopic video+PG), and background 2D images (non-stereoscopic background) in non-stereoscopic mode to graphics Switching of playback of 3D image (plane offset gfx), video (and PG) 3D image (stereoscopic video+PG), and background 3D image (stereoscopic background) in stereoscopic background mode, and the switching can be performed seamlessly .

Inverse switching can also be performed seamlessly.

Next, 3D-compatible players can seamlessly perform video mode changes between stereoscopic video mode (stereoscopic video), flattened stereoscopic video mode (flattened stereoscopic video), and dual non-stereoscopic video mode (dual non-stereoscopic video) (toggle).

FIG. 25 is a diagram for describing a change of a video mode.

A in FIG. 25 is a diagram for describing a change of a video mode in a case where a graphics 3D image (stereoscopic gfx), a background 3D image (stereoscopic background), and a video image are played.

In case the video mode is stereoscopic video mode, and video (and PG) 3D images (stereoscopic video+PG) in stereoscopic video mode are being played, when the video mode is changed from stereoscopic video mode to flattened stereoscopic video mode , the video image is switched from a video (and PG) 3D image in stereoscopic video mode (stereoscopic video+PG) to a video (and PG) 3D image in flattened stereoscopic video mode (flattened video+PG), and the switching can be executed seamlessly.

Inverse switching can also be performed seamlessly.

Also, in case the video mode is flattened stereoscopic video mode, and video (and PG) 3D images (flattened video+PG) in flattened stereoscopic video mode are being played, when the video mode is changed from flattened stereoscopic video When changing mode to dual non-stereoscopic video mode, the video image is switched from video (and PG) 3D image in flattened stereoscopic video mode (flattened video+PG) to video (and PG) 3D in dual non-stereoscopic video mode image (dual monaural video + PG), and the switching can be performed seamlessly.

Inverse switching can also be performed seamlessly.

B in FIG. 25 is a diagram for describing a change in video mode in a case where a graphics 3D image (plane offset gfx), a background 2D image (monoscopic background), and a video image are played.

In the case where the video mode is dual monaural video mode, and the video (and PG) 3D image (dual monaural video+PG) in dual monaural video mode is being played, when the video mode is changed from dual monaural video mode When changing to flattened stereoscopic video mode, the video image is switched from video (and PG) 3D image in dual video mode (dual non-stereoscopic video+PG) to video (and PG) 3D image in flattened stereoscopic video mode ( flatten video+PG), and this switching can be performed seamlessly.

Inverse switching can also be performed seamlessly.

Also, in case the video mode is flattened stereoscopic video mode, and video (and PG) 3D images (flattened video+PG) in flattened stereoscopic video mode are being played, when the video mode is changed from flattened stereoscopic video When the mode is changed to stereoscopic video mode, the video image is switched from flattened video (and PG) 3D image in stereoscopic video mode (flattened video+PG) to video (and PG) 3D image in stereoscopic video mode (stereoscopic video +PG), and the switching can be performed seamlessly.

Inverse switching can also be performed seamlessly.

3D compatible player for changing configuration

In the current BD standard, configuration is specified using resolution (image frame) and color depth. Therefore, a change in configuration means a change in resolution. However, when the resolution is changed, playback is temporarily stopped, and the display screen becomes a black screen state.

On the other hand, for example, a non-stereoscopic logical plane+offset value playback mode of the graphics plane, etc. may be specified as a configuration of 1920×1080/32bpp, but this may be due to, for example, Switching to a stereo logical plane etc. results in a black screen.

Therefore, in 3D-compatible players, plane configurations are unified as double-sided definitions (configurations of 1920×2160 pixels, 1280×1440 pixels, (960×1080 pixels), 720×960 pixels, or 720×1152 pixels), and except Properties other than resolution/color depth are defined as mode values. Thus, in the case of changing only the mode without changing the resolution, it is possible to change the configuration without bringing the display screen into a black state. In addition, similar to conventional players, configuration changes can be performed by calling configuration preference setting APIs.

FIG. 26 is a block diagram showing an example of a functional configuration of the BD player in FIG. 3 as such a 3D-compatible player.

In the 3D-compatible player in FIG. 26 , the configuration of a device plane that is a storage area in which L areas (which are one for storing images for the left eye) are arranged side by side is defined for the entirety of the device plane. image-sized image storage area) and the R area (which is an image-sized image storage area that stores an image for the right eye), two image-sized image storage areas.

In addition, five modes of a non-stereo graphics mode, a stereo graphics mode, an offset graphics mode, a forced non-stereo graphics mode, and a flattened stereo graphics mode are defined as graphics modes. In addition, five modes of a monaural video mode, a dual monaural video mode, a stereoscopic video mode, a forced monaural video mode, and a flattened stereoscopic video mode are defined as video modes. In addition, five modes of a non-stereoscopic background mode, a double non-stereoscopic background mode, a stereoscopic background mode, a forced non-stereoscopic background mode, and a flattened stereoscopic background mode are defined as background modes.

In addition, the configuration of the device plane includes (2) video mode, (3) graphics mode, and (4) background mode in addition to (1) image frame (resolution) and color depth, and (2) video mode, (3 ) graphics mode and (4) background mode setting (change) can be performed by configuration mode setting API.

In the 3D-compatible player in FIG. 26 , in the case of changing the video mode, graphics mode, or background mode, the BD-J application calls the configuration mode setting API, and requests the change to the video mode, graphics mode, or background mode ( set up).

The configuration mode setting API directly or indirectly controls one of the presentation engine (Presentation Engine), video decoder (video decoder) and display processor (Display processor) according to the request from the BD-J application, thereby changing ( Settings) Video Mode, Graphics Mode or Background Mode.

On the other hand, in the case of changing the image frame (resolution) and color depth, the BD-J application calls the resolution setting API to request changing (setting) the resolution and the like.

The resolution setting API changes (sets) the image frame (resolution) and color depth by directly or indirectly controlling a required one of the rendering engine, video decoder, and display processor according to a request from the BD-J application.

Note that in FIG. 26, the presentation engine (Presentation Engine) provides the decoding function and presentation function of audio, video, and HDMV graphics to the playback control engine (Playback Control Engine), not shown, for controlling playback of BDs ( Presentation functions).

Also, in FIG. 26 , a video encoder (Video decoder) performs decoding of an image. In addition, a display processor (Display processor) is used to superimpose each of the graphics plane, video (video + PG) plane, and background plane and then output the image obtained by the superposition to the BD player connected to the Display hardware.

As described above, the configuration of the device plane is defined for the whole of the device plane as an image storage area of two image sizes, and the graphics mode, etc. are included in the configuration of the device plane, with resolution (image frame) and color deep phase separation. Then, the 3D compatible player sets the graphics mode and the like according to the call to the configuration mode setting API. Thus, graphics modes and the like can be changed without changing the resolution.

Switching of PG/text subtitle configuration

Video+PG/TextST (Text subtitle, text subtitle) is processed from the BD-J application collectively (indiscriminately). In addition, the BD-J application cannot control the PG plane 12 alone, but can control the position or zoom (size) of the video. Note that in the current BD standard, PG/TextST is to be aligned with the video in the case of performing control of the position or scaling of the video from a BD-J application.

Thus, in the case of performing scaling control on video, the PG plane offset value is scaled with the scaling ratio (enlargement ratio or reduction ratio) for scaling the video.

On the other hand, for PG (including textST), it is desirable to allow 3D-compatible players to set the mode (1-plane (legacy playback)) for playing PG images as A mode of PG image (2 planes) for stereoscopic images of 3D images, and a mode of PG for playing back 3D images using images for left eye and images for right eye (with parallax) generated from 2D images and offset values ( 1 plane + offset), as the playback mode for playing PG.

Therefore, in a 3D compatible player, PG plane control (1 plane (legacy playback)) and configuration switching between 1 plane+offset and 2 plane are performed indirectly by selecting a PG stream.

Therefore, for HDMV PG, a non-stereoscopic PG stream (a PG stream that is a PG image serving as a non-stereoscopic image of a 2D image), a stereoscopic PG stream (a PG stream that is a PG stream that is a PG image serving as a stereoscopic image serving as a 3D image), and a A PG stream (a PG stream that is a PG image that is a non-stereoscopic image for generating a stereoscopic image) (for example, a stream that includes a PG image that is a non-stereoscopic image and an offset value) is obtained in combination with an offset value that imparts parallax to a non-stereoscopic image. Defined as a PG stream of PG images conforming to the BD standard.

Also, for HDMV PG, Monaural 1 stream (legacy content) mode, L/R2 stream mode, and 1 stream+plane offset mode are defined as PG playback modes for playing PG images.

Now, when the PG playback mode is the mono-stereo 1-stream mode, 2D PG images are played back using the mono-stereo PG stream.

When the PG playback mode is the L/R2 stream mode, 3D PG images are played back by playing the left-eye image and the right-eye image using the stereoscopic PG stream.

When the PG playback mode is the 1-stream+plane offset mode, by generating an image for the left eye and an image for the right eye using the PG stream for offset based on the offset value and playing the image for the left eye and the image for the right eye, to play 3D PG images.

In addition, for HDMV TextST, a non-stereoscopic TextST stream (a TextST stream that is a TextST image serving as a non-stereoscopic image of a 2D image), a stereoscopic TextST stream (a TextST stream that is a TextST image serving as a stereoscopic image of a 3D image), and a TextST stream for offset A stream (a TextST stream that is a TextST image that is a non-stereoscopic image for generating a stereoscopic image) (for example, a stream that includes a TextST image that is a non-stereoscopic image and an offset value) is defined in conjunction with an offset value that imparts parallax to a non-stereoscopic image A TextST stream for a TextST image conforming to the BD standard.

Also, for HDMV TextST, Mono-stereo 1 stream (legacy content) mode, L/R2 stream mode, and 1 stream+plane offset mode are defined as TextST playback modes for playing TextST images.

Now, when the TextST playback mode is the mono-stereo 1 stream mode, a 2D TextST image is played back using the mono-stereo TextST stream.

In the case where the TextST playback mode is the L/R2 stream mode, the 3D TextST image is played by using the stereoscopic TextST stream to play the image for the left eye and the image for the right eye.

When the TextST playback mode is 1 stream+plane offset mode, an image for left eye and an image for right eye are generated by using the TextST stream for offset based on the offset value and the image for left eye and the image for right eye are played back , to play the 3D TextST image.

In the 3D compatible player, the configuration of PG/TextST can be switched (set) through the API for selecting a stream.

Fig. 27 shows the PG playback mode and TextST playback mode that can be used to select each video mode.

For HDMV PG, even if the video mode (configuration) is Monaural Video Mode (Mono), Flattened Stereo Video Mode (Flat Stereoscopic) and stereoscopic video mode (stereoscopic), 1 stream + planar offset mode (non-stereoscopic + offset) can also be selected (PG stream for offset).

Therefore, even when the video mode is any of monaural video mode, flattened stereo video mode, dual mono video mode, forced monaural video mode, and stereo video mode, the PG stream for offset can be selected.

Also, for HDMV PG, even if the video mode is flattened stereo video mode (flattened stereo), dual non-stereo video mode (dual non-stereo), forced non-stereo video mode (forced non-stereo) and stereo video mode (stereo) In either case, L/R2 streaming mode (stereoscopic) can also be selected (stereoscopic PG streaming).

Thus, even in the case where the video mode is any one of the flattened stereo video mode, dual monaural video mode, forced non-stereo video mode, and stereo video mode, a stereoscopic PG stream can be selected.

However, in cases where the video mode is non-stereoscopic video mode (monostereo), flattened stereoscopic video mode (flattened stereo), forced non-stereoscopic video mode (forced non-stereoscopic), or dual non-stereoscopic video mode (dual non-stereoscopic), When a PG stream for offset (mono + offset) is selected, the non-stereoscopic image of the PG stream for offset is played while ignoring the offset value (by setting the offset value to 0).

In addition, when the video mode is non-stereoscopic video mode (non-stereoscopic) or forced non-stereoscopic video mode (forced non-stereoscopic), when stereoscopic PG streams (stereoscopic) are selected, only stereo One of the left-eye image and right-eye image of the image, for example, only the left-eye image (L PG stream) is played.

Also, in the case where the video mode is flattened stereoscopic video mode or dual non-stereoscopic video mode, when a stereoscopic PG stream is selected, if there is an offset where the stream number matches the stream number to be assigned to the selected stereoscopic PG stream With PG streams (recorded in BD), instead of the selected stereoscopic PG streams, non-stereoscopic images of offset PG streams having the same stream number as these stereoscopic PG streams are played while ignoring the offset value.

On the other hand, for HDMV TextST, even if the video mode (configuration) is Monaural Video Mode (Mono), Flattened Stereo Video Mode (Flattened Stereo), Forced In the case of any of the modes (dual non-stereoscopic), you can also select the 1 stream + plane offset mode (monostereo + offset) (text subtitle stream for offset).

Therefore, when the video mode is one of the non-stereoscopic video mode, flattened stereoscopic video mode, forced non-stereoscopic video mode, and dual non-stereoscopic video mode, the TextST stream for offset (text subtitle stream for offset) can be selected .

In addition, for HDMV TextST, even when the video mode is flattened stereo video mode (flattened stereo), dual non-stereo video mode (dual non-stereo), forced non-stereo video mode (forced non-stereo), and stereo video mode (stereo) In either case, L/R2 streaming mode (Stereo) can also be selected (stereoscopic text subtitle stream).

Thus, in the case where the video mode is any one of flattened stereoscopic video mode, dual monaural video mode, forced monoscopic video mode, and stereoscopic video mode, a stereoscopic TextST stream (stereoscopic text subtitle stream) can be selected.

However, in cases where the video mode is non-stereoscopic video mode (monostereo), flattened stereoscopic video mode (flattened stereo), forced non-stereoscopic video mode (forced non-stereoscopic), or dual non-stereoscopic video mode (dual non-stereoscopic), When the TextST stream for offset (mono + offset) is selected, play the non-stereo image of the TextST stream for offset while ignoring the offset value.

Also, in the case where the video mode is non-stereoscopic video mode (monostereo) or forced non-stereoscopic video mode (forced non-stereoscopic), when stereoscopic TextST streams (stereoscopic) are selected, only the stereoscopic One of the left-eye image and right-eye image of the image, for example, only the left-eye image (L TextST stream) is played.

Also, in the case where the video mode is flattened stereoscopic video mode or dual non-stereoscopic video mode, when a stereoscopic TextST stream is selected, if there is an offset where the stream number matches the stream number to be assigned to the selected stereoscopic TextST stream When the TextST stream is used, instead of the selected TextST stream, the non-stereoscopic image of the TextST stream for offset having the same stream number as these stereoscopic TextST streams is played while ignoring the offset value.

FIG. 28 is a block diagram showing a functional configuration example of the BD player in FIG. 3 as a 3D-compatible player for performing playback of PG or TextST images as described above.

In Fig. 28, the 3D compatible player consists of BD-J application, PG/TextST stream selection API, video control API, PG selection engine (playback control function), TextST selection engine (playback control function), video control engine ( Playback control function), playback control engine (PlaybackControl Engine), presentation engine (Presentation Engine) and so on.

The processing of the 3D-compatible player in FIG. 28 will be described with reference to FIG. 29 by taking the processing related to PG as an example.

The BD-J application calls the PG/TextST stream selection API to request selection of a PG stream. The PG/TextST stream selection API selects a PG stream requested from a BD-J application.

That is, as described in FIG. 27 , in a case where PG streams requested from a BD-J application can be selected for the current video mode, the PG/TextST stream selection API controls the PG selection engine to select these PG streams.

The PG selection engine selects PG streams from the PG streams recorded in the disc 100 (FIG. 3) as BD according to the control of the PG/TextST stream selection API, and supplies these PG streams to the stereoscopic PG not shown in FIG. 28 decoder or a non-stereo PG decoder.

Now, in case the PG streams selected by the PG selection engine are stereoscopic PG streams, these stereoscopic PG streams are supplied to the stereoscopic PG decoder.

Also, when the PG stream selected by the PG selection engine is an offset PG stream, these offset PG streams are supplied to the mono-stereo PG decoder.

The stereoscopic PG decoder decodes the PG stream supplied from the PG selection engine into a left-eye image and a right-eye image constituting a stereoscopic image, and draws the left-eye image and the right-eye image on the L- PG plane 12L and R-PG plane 12R.

On the other hand, the monaural PG decoder decodes the offset PG stream supplied from the PG selection engine into a monaural image, and draws it on the logical plane 10 .

The PG generation API uses an offset value (for example, an offset value included in the PG stream for offset, an offset value stored in the internal storage area of a 3D-compatible player, or PSR#21) to draw on the logical plane 10 A left-eye image and a right-eye image are generated from the non-stereoscopic image. Then, the PG generation API renders the image for the left eye and the image for the right eye on the L-PG plane 12L and the R-PG plane 12R of the PG plane 12 , respectively.

Note that in a 3D-compatible BD player, as described in Fig. 27, depending on the combination between the current video mode and the PG stream selected by the PG selection engine (PG playback mode), it is possible to play a For example, only one of the left-eye image and the right-eye image of the corresponding stereoscopic image is played, or only the non-stereoscopic image corresponding to the offset PG stream can be played while ignoring the offset value.

As described above, in a 3D compatible player, a non-stereoscopic PG stream (a PG stream that is a PG image serving as a non-stereoscopic image of a 2D image), a stereoscopic PG stream (a PG stream that is a PG image that is a stereoscopic image serving as a 3D image) , and PG stream for offset (PG stream as PG image for generating non-stereoscopic image of stereoscopic image) is defined as PG of PG image conforming to BD standard in combination with offset value which is data for giving parallax to non-stereoscopic image flow. Then, the PG/TextST stream selection API selects a monaural PG stream, a stereoscopic PG stream, or an offset PG stream according to a request from a BD-J application.

Thus, playback of PG images (configuration of PG) can be indirectly controlled from the BD-J application.

Switch between playback of 3D images and playback of 2D images

FIG. 30 is a diagram for describing switching between playback of a 3D image and playback of a 2D image at a 3D-compatible player.

In FIG. 30, first, the operation mode of the 3D-compatible player is a 3D playback mode for playing 3D images.

Then, the graphics mode is a stereo graphics mode (stereo gfx(graphics)), the video mode is a stereo video mode (stereo video), and the background mode is a non-stereoscopic background mode (non-stereoscopic background).

Then, the graphics mode is changed to offset graphics mode (planar offset gfx), and the video mode is changed to dual monaural video mode (dual monaural video).

In addition, subsequently, in FIG. 30 , the operation mode is changed from the 3D playback mode to the 2D playback mode (legacy playback mode) for playing 2D images in the same manner as the legacy player.

According to the operation mode change, the graphics mode is changed from offset graphics mode (flat offset gfx) to non-stereoscopic graphics mode (mono-stereoscopic gfx). Also, the video mode is changed from a dual monaural video mode (dual monaural video) to a monaural video mode (monoscopic video). Note that the background mode is still a non-stereoscopic background mode (non-stereoscopic background).

Then, in FIG. 30, the operation mode is changed from the 2D playback mode to the 3D playback mode again.

According to the change of the operation mode, the graphics mode is changed from the non-stereo graphics mode (mono-stereo gfx) to the stereo graphics mode (stereo-gfx). Furthermore, the video mode is changed from a non-stereoscopic video mode (mono-stereoscopic video) to a flattened stereoscopic video mode (flattened stereoscopic video). Note that the background mode is still a non-stereoscopic background mode (non-stereoscopic background).

In FIG. 30 , subsequently, the background mode is changed from the non-stereoscopic background mode (mono-stereoscopic background) to the stereoscopic background mode (stereoscopic background).

In FIG. 30 , for example, in the case where the operation mode is changed from the 3D playback mode to the 2D playback mode, the display screen may be blacked out when accompanying the change in resolution (image frame).

Pixel coordinate system for video

JMF (Java(registered trademark) Media Framework) controls such as "javax.tv.media.AWTVideoSizeControl", "org.dvb.media.BackgroundVideoPRsentationControl", etc. can be used to control the position and size of the video from the BD-J application. control.

Note that the author of the BD-J application does not use the coordinates on the plane (video plane 13) but the display coordinates to set the position and size of the video.

In addition, the 3D-compatible player must perform correction on the position and size of each of the image for the left eye (L video source) and the image for the right eye (R video source).

For example, for a video plane 13 of 1920x2160 pixels, the display coordinate system is a coordinate system with a size of 1920x1080 pixels, half of which in the vertical direction. In this case, the author must set the position and size of the video, for example, as follows.

RctangL src=new RctangL(0,0,1920,1080);

RctangL dest = new RctangL(100,100,960,540);

AWTVideoSizeControl videoSizeControl=(AWTVideoSizeControl)player.getControl("javax.tv.media.AWTVideoSizeControl");

videoSizeControl. setSize(new AWTVideoSize(src,dest)).

FIG. 31 is a diagram for describing the setting of the position and size of the video by the author and the correction of the position and size of the video by the 3D compatible player.

The author sets the position and size of the image for the left eye of the video. In FIG. 31 , the position and size of the image for the left eye of the video are set to a display coordinate system with a size of 1920×1080 pixels.

The 3D-compatible player sets the position and size of the image for the left eye with respect to the video of the display coordinate system to the L video plane 13L of the video plane 13 without change.

Furthermore, the 3D compatible player applies the setting of the position and size of the video of the L video plane 13L to the R video plane 13R without change.

Thus, in the author's opinion, in the case where the position and size of a video are set to the L video plane 13L, the same position and size as that of the video are also set to the R video plane 13R.

Now, for video, no depth information is provided externally. Thus, the arrangement for providing the offset is not only wasteful, but may also result in output that was not intended by the video producer.

That is, although the video producer should make the video image so as to display the intended 3D image.

Thus, in the 3D-compatible player, for example, when executing information such as an image drawn on the video plane 13 based on information provided from the outside (such as an offset value stored in PSR #21 ( FIG. 7 ), etc.), When processing such as shifting the position of images (images for left eye and images for right eye), images that were not intended by the video creator may appear.

Therefore, in a 3D-compatible player, the L/R video plane is defined on this configuration, but restrictions are provided to allow authors of BD-J applications to handle only the L video plane. That is, the 3D compatible player must also apply the API call of L video scaling/L video positioning by the BD-J application to R video scaling/R video positioning.

Note that in the case of scaling the video with the size according to the size of the set video, as described in "Switching of PG/text subtitle configuration", the scaling ratio (magnification ratio or reduction ratio ) to scale the PG plane offset value, but also scale the graphics plane offset value with the video scaling ratio in the same way.

FIG. 32 is a block diagram showing a functional configuration example of the BD player in FIG. 3 as a 3D-compatible player for performing position setting (correction) and size setting (scaling) of video as described above.

The 3D compatible player in FIG. 32 includes an API for L for setting the size and position of an image to be stored in the L video plane 13L (L area), and an API for setting the size and position of an image to be stored in the R video plane 13R (R area). area) the size and position of the image in the R API. Then, one of the API for L and the API for R sets the same size and position as the size and position of the image set by the other API.

That is, in the 3D compatible player in FIG. 32 , the video decoder (Videodecoder) decodes the video, and supplies the left-eye image and the right-eye image of the video obtained as a result to the API for L and the R Use the API.

API for L consists of L video scaling (L (left) video scaling) API and L video positioning (L (left) positioning) API, and is called by a request for setting the position and size of video from the BD-J application , sets the position and size of the image for the left eye from the video decoder.

That is, the L video scaling API performs scaling to control the size of the image for the left eye from the video decoder to obtain a size according to a request from the BD-J application, and supplies it to the L video positioning API.

The L video positioning API controls the position of the image for the left eye from the L video scaling API to obtain the position according to the request from the BD-J application, and draws the image for the left eye obtained as a result thereof on the L video plane 13L (put The image for the left eye from the L video scaling API is drawn at the position on the L video plane 13L according to the request from the BD-J application).

In addition, the L video scaling API calls the R video scaling API described below to perform the same request as that from the BD-J application. Also, the L video positioning API calls the R video positioning API described below to perform the same request as the request from the BD-J application.

In addition, the L video scaling API provides the scaling ratio (magnification ratio or reduction ratio) S when scaling the video image (image for the left eye) to the PG generation API and the graphics generation API in response to a call to a video size setting request.

The API for R consists of the R video scaling (R (right) video scaling) API and the R video positioning (R (right) positioning) API, and is set according to the setting request for the position and size of the video from the API for L. The position and size of the image for the right eye from the video decoder.

That is, the R video scaling API controls the size of the image for the right eye from the video decoder to obtain the size according to the request from the L video scaling API, and supplies it to the R video positioning API.

The R video positioning API controls the position of the image for the right eye from the R video scaling API to obtain the position according to the request from the L video positioning API, and draws the image for the right eye obtained as a result thereof on the R video plane 13R.

As described above, the L-use API for setting the size and position of an image to be stored in the L video plane 13L (L area) and the API for setting the image to be stored in the R video plane 13R (R area) Of the R APIs for the size and position of the image, one of the APIs, for example, the R API, sets the same size and position of the image as the other API, the L API, according to the request from the BD-J application. size and position.

Thus, for the video plane 13 in which video images conforming to the BD standard are stored, the author is allowed to handle only the L video plane 13L which is one of the L video plane 13L (L area) and the R video plane 13R (R area), so that Prevents video images from being displayed that were not intended by the video creator.

In the 3D-compatible player, the processing described in Fig. 29 is also executed for PG.

However, in the PG generation API, the PG plane offset value (for example, the offset value included in the PG stream for offset, the internal storage area of the 3D-compatible player, or the PSR offset value stored in #21) (the PG plane offset value is multiplied by the scaling ratio S).

Then, in the PG generation API, a left-eye image and a right-eye image are generated from the non-stereoscopic image drawn on the logical plane 10 using the scaled PG plane offset value.

In addition, in the 3D-compatible player, the configuration mode change API selects an image in a graphics mode according to a request from a BD-J application from among graphics images recorded in the disc 100 ( FIG. 3 ) as a BD, and draws it on Graphics Plane 11.

That is, when the video mode is, for example, stereoscopic graphics mode, left-eye images and right-eye images that are graphics of stereoscopic images are drawn on L graphics plane 11L and R graphics plane 11R of graphics plane 11 , respectively.

Also, in the case where the video mode is, for example, an offset graphics mode, an image of graphics as a non-stereoscopic image is drawn on the logical plane 10, and the graphics generation API scales the graphics plane using the scaling ratio S from the L video scaling API An offset value (for example, an offset value stored in a 3D-compatible player's internal storage area or in PSR#21).

Then, the graphics generation API uses the scaled graphics plane offset value to generate a left-eye image and a right-eye image from the non-stereoscopic image drawn on the logical plane 10, and draws these images on the L graphics planes 11L and R Graphics Plane 11R.

Pixel coordinate system for graphics

A valid pixel coordinate system for a stereographic configuration (a configuration for displaying a graphic 3D image) is one of the following.

(0,0)-(1920,2160)

(0,0)-(1280,1440)

(0,0)-(720,960)

(0,0)-(720,1152)

(0,0)-(960,1080)

The top-half is assigned to the L graphics viewport, and the bottom-half is assigned to the R graphics viewport.

Fig. 33 shows a graphics plane 11 of 1920x2160 pixels.

The image drawn on the L graphics plane 11L which is the storage area (upper half) on the upper side of the graphics plane 11 is an image for the left eye observed by the left eye (L (left) graphics view area), and drawn on the An image on the R graphics plane 11R, which is a storage area (lower half) on the lower side of the graphics plane 11 , is an image for the right eye observed by the right eye (R (right) graphics view).

In FIG. 33 , one container (root container) and two components (Component) that are children of the container are drawn on the graphics plane 11 .

The coordinates of a component are expressed by relative coordinates based on the container serving as the parent of the component.

Note that in a 3D compatible player, it is not necessary to set a protective buffer area on the edge of the graphics plane 11 .

In addition, a 3D-compatible player must implement an arrangement for suppressing a mismatch between the L view and the R view.

Currently, a BD player as a conventional player has no mechanism for detecting completion of rendering by a BD-J application and transferring it to a monitor after completion. In the case of L and R video outputs, an output mismatch may occur between L graphics and R graphics.

Therefore, in the 3D compatible player, a certain type of API call is defined as a signal indicating the completion of rendering by the BD-J application. On the contrary, if the BD-J application does not call the corresponding rendering completion notification API, nothing is output on the screen. Authors must resort to using this technique.

That is, after an image (image for the left eye) is drawn on the L graphics plane 11L, before the image drawing on the R graphics plane 11R is completed, the content drawn on the graphics plane 11 is displayed on the display screen as the left eye image. When using the image for the right eye and the image for the right eye, the image for the left eye and the image for the right eye are mismatched images that cannot be regarded as 3D images (in this case, the rendering of the image for the right eye is defective), thus, this leads to to eliminate the discomfort of the user looking at the image on the display screen.

Therefore, in order to prevent the user from feeling uncomfortable, the 3D-compatible player has a function for suppressing the mismatch between the image for the left eye and the image for the right eye, that is, preventing the image for the left eye and the image for the right eye from being in a mismatch state. A function in which an image is displayed on a display screen so as to be able to be viewed as a 3D image.

Specifically, after finishing drawing both the image for the left eye and the image for the right eye of the graphics plane 11 , the 3D compatible player outputs the image for the left eye and the image for the right eye to display them.

Thus, the 3D-compatible player needs to recognize that rendering of both the image for the left eye and the image for the right eye of the graphics plane 11 has been completed.

directly draw the model

In direct rendering, the 3D-compatible player does not have a technique for distinguishing whether or not the operation of issuing a rendering command for rendering a graphic image from the BD-J application has been completed.

Specifically, in the case where the BD-J application has issued drawing commands #1, #2, etc. up to #N, and the operation of drawing an image to the graphics plane 11 has been performed in accordance with the drawing commands #1 to #N, thereafter The 3D-compatible player cannot recognize whether the drawing command is still issued, that is, whether the drawing command issued by the BD-J application has been completed.

Therefore, in the case of performing image drawing to the graphics plane 11 by a drawing command, the author of the BD-J application is obliged to recognize the need for ensuring the The call will return processing to the BD-J application's rendering integrity assurance API as a signal to the 3D compatible player.

Alternatively, in the case of executing image rendering to the graphics plane 11 by a rendering command, the author of the BD-J application is obliged to recognize the call to the rendering completion notification API for notifying that image rendering to the graphics plane 11 has been completed, to As a signal given to 3D compatible players.

Alternatively, in the case of performing image rendering to the graphics plane 11 by a rendering command, the author of the BD-J application is obliged to recognize the call to the rendering start notification API for notifying the start of image rendering to the graphics plane 11, and subsequently A call to the rendering completion notification API for notifying that image rendering to the graphics plane 11 has been completed, as a signal given to the 3D compatible player.

In this case, the 3D-compatible player can call the drawing completeness guarantee API, call the drawing completion notification API, or call the drawing start notification API and then call the drawing completion notification API by the BD-J application. It is recognized that image rendering to the graphics plane 11 has been completed, that is, the issuance of the rendering command has been completed. Then, as a result thereof, the image for the left eye and the image for the right eye can be displayed in a matched state (so as to be able to be regarded as a 3D image).

Here, a dedicated API that takes a drawing command sequence as a parameter can be defined as a drawing integrity guarantee API.

Now, for example, the java.awt.Toolkit#sync() method can be used as the rendering completion notification API. In this case, in the 3D-compatible player, as long as the call to the java.awt.Toolkit#sync() method is not performed, the image drawn on the graphics plane 11 is not output, and thus, the image drawn on the graphics plane 11 The image of is not displayed on the display screen.

In addition, for example, a predetermined method of Java (registered trademark) or a dedicated API may be defined as the drawing start notification API.

Note that graphics frames may include dropped frames when calls to the java.awt.Toolkit#sync() method are executed multiple times during a frame (during 1 video frame). Thus, calls to the java.awt.Toolkit#sync() method are not allowed to be executed consecutively multiple times or with little rendering in between.

redraw model

In the AWT (Abstract Windowing toolkit) drawing model, the repaint() method that serves as the root container that forms part of the graphic image calls the update() method that supplies each component that forms part of the graphic image.

Then, in the AWT drawing model, the drawing process of the graphics image can be completely controlled (full control) at the 3D-compatible player, and thus the 3D-compatible player can recognize that the drawing of the graphics plane 11 has been completed.

Thus, realization of a 3D-compatible player can be performed such that the image for left eye and the image for right eye in a matching state are displayed even without performing a call to the above-described rendering completion notification API.

34 is a diagram illustrating the BD in FIG. 3 as a 3D-compatible player for recognizing that issuance of a rendering command has been completed by forcibly calling the rendering completeness guarantee API or calling the rendering completion notification API and then calling the rendering start notification API. A block diagram of a functional configuration example of the player.

Now, let us assume that the BD-J application executes a call to the rendering completion notification API in a case where image rendering to the graphics plane 11 has been completed.

The 3D-compatible player includes buffers 201L and 201R serving as the graphics plane 11 and buffers 202L and 202R.

Note that in FIG. 34 , the buffers 201L and 202L correspond to the L graphics plane 11L, and the buffers 201R and 202R correspond to the R graphics plane 11R.

In addition, the set of buffers 201L and 201R and the set of buffers 202L and 202R alternately serve as back buffers (hidden buffers) and front buffers.

Here, the back buffer is a buffer in which the BD-J application performs rendering of a graphic image, and the front buffer is a buffer that stores images to be displayed on the display screen (logical screen 21) while image rendering is performed in the back buffer buffer.

A in FIG. 34 shows the 3D-compatible player in a state where the set of buffers 201L and 201R is a back buffer and the set of buffers 202L and 202R is a front buffer.

In A in FIG. 34 , rendering of graphics images (images for the left eye and images for the right eye) by the BD-J application is performed on the buffers 201L and 201R serving as the back buffer, and is stored in the buffer serving as the front buffer. The images (the image for the left eye and the image for the right eye) in the devices 202L and 202R are output to the display screen as output.

The BD-J application calls the rendering completion notification API after completion of rendering of graphics images to the buffers 201L and 201R serving as back buffers.

After executing the call to the rendering completion notification API, the 3D compatible player starts outputting the image stored in the back buffer to the display screen instead of the front buffer.

That is, B in FIG. 34 shows the 3D-compatible player immediately after the call to the rendering completion notification API is performed.

After executing the call to the rendering completion notification API, the 3D compatible player starts outputting the images stored in the buffers 201L and 201R serving as the back buffer to the display screen as a reference to the images stored in the buffers 202L and 201R serving as the front buffer. Replacement of images in 202R.

Furthermore, the 3D-compatible player copies the images stored in the buffers 201L and 201R serving as back buffers to the buffers 202L and 202R serving as front buffers.

Then, the 3D compatible player switches the back buffer and the front buffer.

Specifically, the 3D-compatible player sets the buffers 201L and 201R serving as the back buffer as the front buffer, and sets the buffers 202L and 202R serving as the front buffer as the back buffer.

That is, C in FIG. 34 shows the 3D-compatible player in a state where the set of buffers 201L and 201R is a front buffer and the set of buffers 202L and 202R is a back buffer.

The BD-J application starts drawing graphics images to buffers 202L and 202R serving as back buffers, and then repeats the same process.

FIG. 35 is a flowchart for describing graphics processing performed by the 3D-compatible player in FIG. 34 in the case where the BD-J application calls the rendering integrity assurance API.

In step S11, the 3D-compatible player determines whether or not the call to the rendering integrity assurance API has been executed from the BD-J application, and in the case of judging that the call to the rendering integrity assurance API has not been executed, the 3D-compatible player returns Go to step S11.

In addition, if it is determined in step S11 that a call to the rendering integrity assurance API has been executed, the 3D compatible player proceeds to step S12, sequentially executes the rendering command sequence serving as a parameter of the rendering integrity assurance API, and uses the The resulting graphic image is drawn on the back buffer, and the graphic image stored in the front buffer is also output to the display screen (output for display).

Then, after the rendering of the back buffer is completed, the 3D-compatible player outputs the graphics image stored in the back buffer to the display screen as a replacement for the front buffer (output for display) in step S13.

Then, in step S14, the 3D compatible player copies the graphics image stored in the back buffer to the front buffer.

Then, in step S15, the 3D-compatible player switches the back buffer and the front buffer, returns to step S11, and repeats the same process.

As described above, in the 3D compatible player, when a call to the rendering integrity guarantee API for ensuring the integrity of rendering of a graphics image is executed from the BD-J application for the graphics plane 11 (which is the back buffer) In this case, the image drawn on the graphics plane 11 is output for display.

Thus, in the 3D-compatible player, after the BD-J application waits for the drawing of the graphics image to be completed, the image drawn on the graphics plane 11 can be displayed, so that the image for the left eye and the image for the right eye in a mismatch state can be prevented. The user image is displayed on the display screen.

FIG. 36 is a flowchart for describing graphics processing performed by the 3D-compatible player in FIG. 34 in the case where the BD-J application calls the rendering completion notification API.

The 3D-compatible player waits for a rendering command to be issued from the BD-J application, and executes the rendering command in step S21.

Then, in step S22, the 3D compatible player renders the graphics image obtained as a result of running the rendering command in the back buffer, and also outputs the graphics image stored in the front buffer to the display screen (output for show).

Then, in step S23, the 3D-compatible player determines whether or not a call to the rendering completion notification API has been performed from the BD-J application.

If it is determined in step S23 that the call to the rendering completion notification API has not been performed, the 3D compatible player waits for a rendering command to be issued from the BD-J application, and returns to step S21, and then repeats the same process.

In addition, if it is determined in step S23 that the call to the rendering completion notification API has been executed, the 3D compatible player proceeds to step S24, and outputs the graphic image stored in the back buffer to the display screen as a reference to the front buffer. Replace (output for display).

Then, in step S25, the 3D compatible player copies the graphic image stored in the back buffer to the front buffer.

Then, in step S26, the 3D-compatible player switches the back buffer and front buffer, waits for a rendering command from the BD-J application, and returns to step S21, and then repeats the same process.

As described above, in the 3D-compatible player, when a call to the rendering completion notification API for notifying that graphics image rendering to the graphics plane 11 (serving as a back buffer) has been completed is performed from the BD-J application, Images drawn on the graphics plane 11 are output for display.

Thus, after the BD-J application notifies that the drawing of the graphics image has been completed, the image drawn on the graphics plane 11 can be displayed, so that the image for left eye and the image for right eye in a mismatch state can be prevented. The image is displayed on the display screen.

FIG. 37 is a flowchart for describing graphics processing by the 3D-compatible player in FIG. 34 in a case where a BD-J application executes a call to the rendering start notification API and a subsequent call to the rendering completion notification API.

In step S31, the 3D-compatible player determines whether the call to the rendering start notification API has been executed from the BD-J application, and returns to step S31 if it is determined that the call to the rendering start notification API has not been executed.

Also, if it is determined in step S31 that readout of the rendering start API has been performed, the 3D-compatible player waits for the BD-J application to issue a rendering command, proceeds to step S32, and executes the rendering command.

Then, in step S33, the 3D-compatible player determines whether or not a call to the rendering completion notification API has been performed from the BD-J application.

If it is determined in step S33 that the call to the rendering completion notification API has not been performed, the 3D compatible player waits for a rendering command to be issued from the BD-J application, and returns to step S32, and then repeats the same process.

In addition, if it is determined in step S33 that the call to the rendering completion notification API has been executed, the 3D-compatible player proceeds to step S34, renders the graphics image obtained as a result of the execution of the rendering command on the back buffer, and also renders the Graphics images stored in the front buffer are output to the display screen (output for display).

Then, in step S35, the 3D-compatible player outputs the graphic image stored in the back buffer to the display screen as a replacement for the front buffer (output for display).

Then, in step S36, the 3D compatible player copies the graphics image stored in the back buffer to the front buffer.

Then, in step S37, the 3D compatible player switches the back buffer and the front buffer, returns to step S31, and repeats the same process.

As described above, in the 3D-compatible player, after the call of the drawing start notification API for starting drawing of the graphics image to the graphics plane 11 (serving as the back buffer) and the call for the notification API are executed from the BD-J application In the case of a subsequent call of the rendering completion notification API that rendering of the graphics image to the graphics plane 11 (serving as a back buffer) has completed, the image drawn on the graphics plane 11 is output for display.

Therefore, in the case where the notification that the drawing of the graphics image by the BD-J application has been completed is performed, the image drawn on the graphics plane 11 can be displayed, thereby preventing the left-eye image and the right-eye image from being in a mismatch state. The ophthalmic image is displayed on the display screen.

The pixel coordinate system used for the background

A valid pixel coordinate system for a stereoscopic background configuration (a configuration for displaying a background 3D image) is one of the following.

(0,0)-(1920,2160)

(0,0)-(1280,1440)

(0,0)-(720,960)

(0,0)-(720,1152)

The top-half is assigned to the L background view, and the bottom-half is assigned to the R background view.

Note that the format (content format) of the background image is one of Monochrome (Single-color), JPEG (JFIF), and MPEG2 trickle-feed (drip-feed), and in the case of the format is MPEG2 trickle-feed, the background image Must be an SD image (SD video only).

In addition, a JPEG (JFIF) image of 1920×2160 pixels, 1280×1440 pixels, 720×960 pixels, or 720×1152 pixels can be used as the background image.

focus management

For example, in the case where a widget-based GUI (Graphical User Interface) or the like is used as a graphic image, in a conventional player, multiple components constituting the GUI as children of a single container cannot simultaneously have focus.

Also, in conventional players, multiple root containers constituting the GUI cannot be active (in focus) at the same time.

Here, a container is a component (part) of a graphic image, and can have a parent (upper layer) and a child (lower layer). A container with no parent but only children is called the root container.

Components are a kind of container and can have parents but not children.

In the case where a GUI serving as a graphic image is a 3D image, for each of the left-eye image and right-eye image constituting the 3D image, the corresponding container must be focused, and its focus needs to be shifted in the same manner. (equally) executed.

Specifically, if, among the image for left eye and the image for right eye, a certain container constituting one of these images is in focus, but a container constituting the other image corresponding to the container is not in focus, it will make A user who views a 3D image displayed using such a left-eye image and a right-eye image feels uncomfortable.

Thus, in order to prevent the user from feeling uncomfortable, the 3D-compatible player performs focus management so that there is the same focus transition at the container of the image for the left eye and the container of the image for the right eye.

Fig. 38 shows an example of a GUI drawn on the graphics plane 11.

The GUI in FIG. 38 is constituted by every two corresponding components #1, #2, and #3 constituting a root container and children of the root container.

Note that in FIG. 38, components #1, #2, and #3 drawn on the L graphics plane 11L constitute an image for the left eye, and components #1, #2, and #3 drawn on the R graphics plane 11R constitute a right-eye image. Eye image.

For example, when the component #i of the image for the left eye is focused, the component #i which is the corresponding component of the image for the right eye must also be focused.

To make widget state transition/management symmetrical between L and R, 3D compatible players satisfy this by having both containers or components focused at the same time. Therefore, an instance of a container or component needs to have a flag indicating whether it holds focus in order to be able to be managed. Additionally, the third focus request must be failed. That is, the number of focused containers or components is limited to 0 or 2.

Focus methods for bringing two corresponding containers (components) of the left-eye image and the right-eye image into focus include a first focus method and a second focus method.

FIG. 39 shows a first focus method and a second focus method.

A in Figure 39 shows the first focus method (1 root container across the L/R graphics plane).

The first focus method makes the two correspondences of a container (component) on the L graphics plane 11L and a container (component) on the R graphics plane 11R that act as children of a container (root container) spanning the L graphics plane 11L and the R graphics plane 11R The container is focused at the same time.

B in FIG. 39 shows the second focus method (2 containers (one for the L graphics plane and the other for the R graphics plane)).

In the second focus method, a root container is drawn on each of the L graphics plane 11L and the R graphics plane 11R, and both root containers are simultaneously activated (focused on).

FIG. 40 is a flowchart for describing focus management of the BD player in FIG. 3 as a 3D-compatible player that makes two corresponding containers (components) of an image for left eye and an image for right eye have focus.

Now, let us assume that a container (component) constituting a GUI to be drawn on the graphics plane 11 has a focus flag indicating whether the corresponding container (component) is focused.

After the focus is requested, in step S51, the 3D-compatible player sets a variable i for counting the number of containers to 0 serving as an initial value.

Then, in step S52, the 3D compatible player determines whether two components are already in focus among the components (containers) that are children of the container c(i) on the graphics plane 11 based on the focus flag of each component state (hereinafter also referred to as the focus holding component).

If it is determined in step S52 that there are no two focus-holding components among the components serving as children of the container c(i), the 3D-compatible player proceeds to step S53 and makes the two corresponding components have the requested focus. Further, in step S53, the 3D-compatible player sets a value indicating that focus is held to the focus flag of each of the two components brought into focus, and proceeds to step S54.

On the other hand, if it is determined in step S52 that there are two focus-holding components among the components serving as children of container c(i), the 3D compatible player skips step S53, proceeds to step S54, and increments the variable i 1, and proceed to step S55.

In step S55 , the 3D compatible player determines whether the variable i is smaller than the number N of containers on the graphics plane 11 . If it is determined in step S55 that the variable i is smaller than the number N of containers on the graphics plane 11, the 3D-compatible player returns to step S22, and repeats the same processing.

Also, if it is determined in step S55 that the variable i is not smaller than the number N of containers on the graphics plane 11, the process ends.

As described above, when two containers are not focused for the focus request, the 3D-compatible player combines the container on the L graphics plane 11L (L area) storing the image for the left eye with the container corresponding to the container storing the right image. The container on the R graphics plane 11R (R region) of the ophthalmic image changes into a focused state.

Thus, for example, among the containers constituting the 3D image widget, the transition of focus can be set in the same manner between the container for the image for the left eye and the container for the image for the right eye.

Handling of mouse events

In the case of stereoscopic graphics, the two-dimensional coordinates of the mouse cursor on the screen may differ from those on the L and R graphics planes. Thus, a BD-J application needs to perform coordinate conversion when describing mouse event-dependent processing, but the offset value used for coordinate conversion is different for each implementation of a BD player, and thus is unknown.

Specifically, FIG. 41 shows the position on the display screen where the 3D image of the cursor of the pointing device (such as a mouse, etc.) is seen and the position of the cursor on the graphics plane 11 .

The cursor is displayed by a BD player, but in a 3D compatible player, it is desirable to display the 3D image of the cursor (so as to be able to be viewed) at a position closer to the graphic 3D image (the 3D image to be played from the disc 100).

On the other hand, in the case of displaying a cursor using a 3D image, the cursor of the image for the left eye on the logic screen 21 is at a position (x+Δx, y) relative to the position of the 3D image where the cursor can be seen on the display screen. The position (x, y) is shifted by a certain offset value Δx, and the cursor of the image for the right eye on the logic screen 21 is also at the position (x-Δx, y), which is relative to the position where the cursor can be seen on the display screen The position (x, y) of the 3D image is shifted by a certain offset value Δx.

Here, the position in the depth direction of the 3D image of the cursor is changed according to the certain offset value Δx.

In a 3D compatible player, if a 3D image of a cursor is displayed at a closer position than a graphic 3D image, a value max-depth representing the closest position in the depth direction (z direction) of the graphic 3D image is necessary. However, in a 3D-compatible player, it is difficult to calculate the value max-depth from a graphic 3D image.

Therefore, for example, the value max-depth is pre-recorded in the disc 100 ( FIG. 3 ) as a BD, and the 3D compatible player can set (store) the value max-depth to the PSR ( FIG. 7 ) (for example, PSR #twenty one).

In this case, the 3D-compatible player (or a display that displays a 3D image output by the 3D-compatible player) can refer to the value max-depth stored in the PSR, obtain the The near side displays the offset value Δx of the cursor. The 3D image of the cursor can then be displayed at a closer location than the graphical 3D image.

Note that the OSD (On Screen Display) displayed by the 3D compatible player can also be displayed at a position closer to the graphical 3D image in the same way as the cursor.

In addition, a value min-depth representing the position on the deepest side in the depth direction of a 3D image to be played back from the disc 100 as a BD is pre-recorded in the disc 100 ( FIG. 3 ) as a BD together with a value max-depth so that the value The max-depth and value min-depth can be set to the PSR (Figure 7).

As described above, in the 3D compatible player, the value max-depth etc. representing the closest position in the depth direction of the 3D image recorded in the disc 100 as the BD is set to the PSR so that the cursor and the OSD can be viewed Displayed on the closer side than the 3D image to be played from the BD.

Incidentally, the 3D-compatible player can arbitrarily set the offset value Δx for displaying the 3D image of the cursor. In addition, the offset value Δx does not have to be constant, and can be changed (set) for each frame, for example.

Therefore, when the position (x, y) of the display screen is adopted as the position of the cursor when a 3D-compatible player issues an event with the cursor position as a parameter to the BD-J application, the BD-J application must have the position of the display screen ( x,y) performs a coordinate transformation to obtain the cursor position (x+Δx,y) (or (x–Δx,y)) on the graphics plane 11 .

However, in order to perform coordinate conversion on the position (x, y) of the display screen, BD-J applications need to recognize the offset value Δx, but it is difficult for BD-J applications to recognize the offset that can be arbitrarily set by 3D-compatible players worth it.

Therefore, the coordinate system of mouse events is limited to the L graphics plane. The BD player is obliged to use the coordinates on the L graphics plane as the two-dimensional position information when the mouse event is issued.

Specifically, in a 3D-compatible player, for example, the 3D image of the cursor of a pointing device such as a mouse is composed of an image for the left eye and an image for the right eye, but the 3D image of the cursor is displayed on the L graphics of the graphics plane 11. A position on one of the plane 11L (L region) and the R graphics plane 11R (R region), for example, the L graphics plane 11L (L region), is used as the cursor position when issuing an event with the cursor position as a parameter.

Therefore, the BD-J application can know (recognize) the position on the L graphics plane 11L as the cursor position of the 3D image, and thus, the author of the BD-J application can use this position on the L graphics plane 11L as the cursor position to The cursor position is used as a parameter to describe the processing of the event (mouse event, etc.).

drawing operation

A 3D compatible player must ensure a match between the L viewport and the R viewport. Specifically, the 3D-compatible player must ensure that the left-eye and right-eye images of graphics are drawn to the graphics plane 11 in a matched state (so as to be able to be seen as 3D images), and then displayed on the display screen.

Initialization (resetting) of the graphics plane 11 is similarly performed. Specifically, in the case of initializing one of the L graphics plane 11L and the R graphics plane 11R of the graphics plane 11, the other must also be initialized.

However, it is the responsibility of the author of the BD-J application to make a meaningful match between the L view and the R view (author responsibility), i.e., the control of the image content between the left-eye image and the right-eye image of the graphic. match.

FIG. 42 is a diagram for describing matching between an image for the left eye and an image for the right image of graphics.

A in FIG. 42 shows the image for the left eye and the image for the right eye of the graphics drawn in the matching state.

In A in FIG. 42 , the rendering of the image for the left eye on the L graphics plane 11L and the rendering of the image for the right eye on the R graphics plane 11R have already been completed, so that after the rendering is completed, the 3D-compatible player must display the image on the display screen. An image for the left eye and an image for the right eye are displayed on the screen.

Note that the rendering integrity assurance API described with reference to FIG. 35 takes a rendering command sequence as a parameter, but the rendering command sequence as a parameter of this rendering integrity assurance API must be in a matching state for rendering (so that it can be viewed as a 3D image) According to the rendering command sequence of the image for the left eye and the image for the right eye, and according to this rendering integrity guarantee API, the image for the left eye and the image for the right eye are guaranteed to render graphics in a matching state.

B in FIG. 42 shows the image for the left eye and the image for the right eye of the graphics in the mismatch state.

In B in FIG. 42 , the rendering of the image for the left eye on the L graphics plane 11L has been completed, but the rendering of the image for the right eye on the R graphics plane 11R has not yet been completed.

It is not necessary for the 3D-compatible player to display the image for the left eye and the image for the right eye in the state of B in FIG. 42 on the display screen.

For example, by employing a triple buffer at a 3D-compatible player, a match between left-eye and right-eye images of graphics can be ensured.

Fig. 43 is a block diagram showing an example of a functional configuration of the BD player in Fig. 3 as a 3D-compatible player employing triple buffering.

This 3D-compatible player includes a back buffer (hidden buffer) 211 serving as the graphics plane 11 , and front buffers 212 and 213 .

The rear buffer 211 is composed of buffers 211L and 211R. The front buffer 212 is composed of buffers 212L and 212R, and the front buffer 213 is composed of buffers 213L and 213R.

Note that in FIG. 43 , buffers 211L, 212L, and 213L correspond to the L graphics plane 11L, and store images for the left eye. The buffers 211R, 212R, and 213R correspond to the R graphics plane 11R, and store images for the right eye.

The BD-J application issues a rendering command, and 3D images (images for left eye and image for right eye) of graphics as a result of executing the rendering command are rendered on the back buffer 211 .

On the other hand, the front buffers 212 and 213 are alternately selected, and the image for the left eye and the image for the right eye stored in the selected one of the buffers (hereinafter referred to as the selected buffer) are displayed on the display screen. (provided to the display processor).

After the rendering of the image for the left eye and the image for the right eye in the back buffer 211 is completed, the image for the left eye and the image for the right eye stored (drawn) in the back buffer 211 are copied to the front buffer 212 and the image for the right eye. The unselected one of 213.

Selection switching for alternately selecting the front buffers 212 and 213 as the selected buffer is VBI (Vertical Blanking Interval, vertical blanking interval) is run regularly to prevent tearing artifacts from occurring.

frame accurate animation

FAA (Frame Accuarte Animation, Frame Accurate Animation) includes Image Frame Accurate Animation (Image Frame Accurate Animation) and Synchronous Frame Accurate Animation (Sync Frame Accurate Animation). Image for eye and image for right eye (in order to achieve L/R synchronization), it is desirable to perform drawing and use of image for left eye for animation even for any of image frame accurate animation and synchronized frame accurate animation, respectively Drawing of images for the right eye of animations (to manipulate animations in two places at the same time).

That is, in traditional players, animations are only manipulated in one place. In the case of using images or buffers to span L and R, animation operations can be performed in both places in a pseudo fashion, but due to performance requirements on the part of the BD player, insufficient animation frame rates are output.

FIG. 44 is a diagram for describing animation with images spanning L and R. FIG.

In FIG. 44 , a single image of w×(h+1080) pixels is drawn in a manner spanning the L graphics plane 11L and the R graphics plane 11R of the graphics plane 11 of 1920×2160 pixels.

In FIG. 44, among the images of w×(h+1080) pixels, the part (central part) other than the upper w×h pixel image and the lower w×h pixel image is filled with transparent pixels (transparent color ), so that the upper w×h pixel image can be regarded as a left-eye image for animation, and the lower w×h pixel image can be regarded as a right-eye image for animation.

That is, the central portion of the single image in FIG. 44 is filled with a transparent color, so that the appearance when viewing the single image can be set so that w×h pixel images are drawn on the L graphics plane 11L and the R graphics plane 11R. state at the same location. Thereby, 3D image animation can be realized in which the w×h pixel image on the L graphics plane 11L and the w×h pixel image on the R graphics plane 11R are synchronously operated.

However, in FIG. 44 , although the image for the left eye and the image for the right eye used for animation are w×h pixel images, drawing of a single image of huge w×(h+1080) pixels needs to be performed.

As a result, depending on the performance of the BD player, it may take time to render an image, and it may be difficult to display 3D image animation at a sufficient frame rate.

Therefore, in the 3D-compatible player, rendering of an image for the left eye for animation and rendering of an image for the right eye for animation are performed separately.

FIG. 45 is a diagram illustrating drawing of an image for the left eye for animation and drawing of an image for the right eye for animation.

In the 3D-compatible player, images for the left eye used for animation are drawn on the L graphics plane 11L (L area). Also, in the 3D-compatible player, separately from the drawing of the image for the left eye for animation on the L graphics plane 11L (L area), the image for the right eye for animation is drawn on the R graphics plane 11R ( R region).

Thereby, drawing of the image for the left eye and the image for the right eye for animation can be quickly performed, and as a result, animation of a 3D image can be displayed at a sufficient frame rate.

FIG. 46 is a diagram showing a 3D compatible player for respectively performing rendering of an image for the left eye for animation on the L graphics plane 11L and rendering of an image for the right eye for animation on the R graphics plane 11R. A block diagram of an example of a functional configuration of a BD player in FIG. 3 .

A in FIG. 46 shows a configuration example of a 3D-compatible player for rendering animation in the form of image frame-accurate animation.

The image buffer 231 is a buffer serving as a cache memory for a BD-J application to load and save resources from the disc 100 ( FIG. 3 ) which is a BD, and stores a list of images for the left eye (image list for L) used for animation. ) and a list of images for the right eye used for animation (list of images for R).

The pixel transfer device 232L sequentially reads out images for the left eye for animation from the image buffer 231 in units of pixels to draw them on the L graphics plane 11L.

The pixel transfer device 232R sequentially reads out images for the right eye for animation from the image buffer 231 in units of pixels to draw them on the R graphics plane 11R.

B in FIG. 46 shows a configuration example of a 3D-compatible player for rendering animation in the form of synchronized frame-accurate animation.

The graphics memory 241 is a work memory of a 3D-compatible player, and consists of a buffer for storing left-eye images for animation (image buffer for L) and a buffer for storing right-eye images for animation (image buffer for R). buffer) constitutes.

The pixel transfer device 242L sequentially reads out images for the left eye for animation from the graphics memory 241 in units of pixels to draw them on the L graphics plane 11L.

The pixel transfer device 242R sequentially reads out images for the right eye for animation from the graphics memory 241 in units of pixels to draw them on the R graphics plane 11R.

Now, the definition of the extended API for image frame accurate animation is shown in FIG. 47 .

In addition, the definition of the extended API for synchronous frame-accurate animation is shown in FIG. 48 .

Additionally, sample code for image frame accurate animation is shown in Figures 49 and 50. Note that FIG. 50 is a continuation of FIG. 49 .

Additionally, sample code for synchronous frame-accurate animation is shown in Figures 51 and 52. Note that FIG. 52 is a continuation of FIG. 51 .

Now, embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be performed without departing from the gist of the present invention.

That is to say, in this embodiment, in the BD player in FIG. 3 which is a 3D-compatible player, processing is performed with the 3D image content or Java (registered trademark) application recorded in the disc 100 as a target, as The 3D image content or Java (registered trademark) application of the processing target at the 3D compatible player is from a data providing device other than a recording medium such as the disc 100, specifically, for example, from an object carousel (object disc) which is a digital broadcasting application. carousel) or data carousel provided to the 3D-compatible player, and the 3D-compatible player can perform processing with the 3D image content or Java (registered trademark) application supplied from the object carousel or data carousel as an object.

Claims (3)

1. An information processing apparatus, wherein a video plane configured to store video images corresponds to a storage area of images corresponding to two screens, the storage area arranges an L area and an R area, wherein the L area is for storing A storage area corresponding to a left-eye image of one screen, and the R area is a storage area for storing a right-eye image corresponding to one screen; Wherein, the configuration of the video plane is defined for the entirety of the video plane corresponding to the storage area of images of two screens; Wherein, the video mode as the mode for playing the video image defines: a stereoscopic video mode for storing the image for the left eye and the image for the right eye constituting the stereoscopic image in the video plane when the video image is a stereoscopic image as a 3D image the L region and the R region, a flattened stereoscopic video mode for storing one of the image for the left eye and the image for the right eye constituting the stereoscopic image in the video plane when the video image is the stereoscopic image In both the L region and the R region, Among them, the PG stream as a PG (rendering graphics) image defines: a stereoscopic PG stream which is a PG stream of the PG image which is a stereoscopic image serving as a 3D image, and a PG stream for offset, which is a PG stream that is the PG image serving as a non-stereoscopic image serving as a 2D image to be used in conjunction with offset values for generating a stereoscopic image to generate a stereoscopic image The data to which the image is given parallax; The information processing equipment includes: a stream selection API (application programming interface) for performing selection of the stereoscopic PG stream or the offset PG stream; Wherein, when the video mode is the flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the offset PG stream is optional; Wherein, when the video mode is the flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the stereoscopic PG stream is optional; Wherein, in the case where the video mode is the flattened stereoscopic video mode, when the offset PG stream is selected, the offset value is set to 0, and is related to the offset PG stream The non-stereoscopic images corresponding to the stream are played. 2. An information processing method, wherein the video plane configured to store video images is a storage area corresponding to images of two screens, the storage area arranges an L area and an R area, wherein the L area is for storing the corresponding A storage area for images for the left eye of one screen, the R area is a storage area for storing images for the right eye corresponding to one screen; Wherein, the configuration of the video plane is defined for the entirety of the video plane corresponding to the storage area of images of two screens; Wherein, the video mode as the mode for playing the video image defines: a stereoscopic video mode for storing the image for the left eye and the image for the right eye constituting the stereoscopic image in the video plane when the video image is a stereoscopic image as a 3D image the L region and the R region, a flattened stereoscopic video mode for storing one of the image for the left eye and the image for the right eye constituting the stereoscopic image in the video plane when the video image is the stereoscopic image In both the L region and the R region, Among them, the PG stream as a PG (rendering graphics) image defines: a stereoscopic PG stream which is a PG stream of the PG image which is a stereoscopic image serving as a 3D image, and a PG stream for offset, which is a PG stream that is the PG image serving as a non-stereoscopic image serving as a 2D image to be used in conjunction with offset values for generating a stereoscopic image to generate a stereoscopic image The data to which the image is given parallax; The information processing method includes the following steps: selecting the stereoscopic PG stream or the offset PG stream by using a stream selection API (application programming interface); Wherein, the offset PG stream is selectable even if the video mode is a flattened stereoscopic video mode and if the video mode is the stereoscopic video mode; Wherein, when the video mode is the flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the stereoscopic PG stream is optional; Wherein, in the case where the video mode is the flattened stereoscopic video mode, when the offset PG stream is selected, the offset value is set to 0, and is related to the offset PG stream The non-stereoscopic images corresponding to the stream are played. 3. A program wherein a video plane configured to store video images is a storage area corresponding to images of two screens, the storage area arranges an L area and an R area, wherein the L area is for storing images corresponding to one A storage area for images for the left eye of the screen, and the R area is a storage area for storing images for the right eye corresponding to one screen; Wherein, the configuration of the video plane is defined for the entirety of the video plane corresponding to the storage area of images of two screens; Wherein, the video mode as the mode for playing the video image defines: a stereoscopic video mode for storing the image for the left eye and the image for the right eye constituting the stereoscopic image in the video plane when the video image is a stereoscopic image as a 3D image the L region and the R region, a flattened stereoscopic video mode for storing one of the image for the left eye and the image for the right eye constituting the stereoscopic image in the video plane when the video image is the stereoscopic image In both the L region and the R region, Among them, the PG stream as a PG (rendering graphics) image defines: a stereoscopic PG stream which is a PG stream of the PG image which is a stereoscopic image serving as a 3D image, and a PG stream for offset, which is a PG stream that is the PG image serving as a non-stereoscopic image serving as a 2D image to be used in conjunction with offset values for generating a stereoscopic image to generate a stereoscopic image The data to which the image is given parallax; Wherein, the program is a stream selection API (Application Programming Interface), which is used to select the stereoscopic PG stream or the offset PG stream; Wherein, when the video mode is the flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the offset PG stream is optional; Wherein, when the video mode is the flattened stereoscopic video mode and when the video mode is the stereoscopic video mode, the stereoscopic PG stream is optional; Wherein, in the case where the video mode is the flattened stereoscopic video mode, when the offset PG stream is selected, the offset value is set to 0, and is related to the offset PG stream The non-stereoscopic images corresponding to the stream are played.

Images