JP2011258153A - Stereoscopic vision image formation device, stereoscopic vision image formation method, control program, and readable storage medium - Google Patents

Abstract

An object of the present invention is to obtain an accurate stereoscopic effect at the same time without requiring a high capability for a three-dimensional graphic processing mechanism.
A stereoscopic image generation circuit as a parallax image generation function for generating a plurality of stereoscopic image data (right-eye image data and left-eye image data) from a single image, and a computer comprising a GPU For the CG generation circuit 7 as a graphic generation unit, the image from one viewpoint generated by the GPU and the depth information (Z buffer value) for each pixel calculated in the process of the 3D CG generation process of the GPU The stereoscopic image generation circuit 11 performs control to generate a plurality of images for stereoscopic viewing, passing to the stereoscopic image generation circuit 11 as an image generation function.
[Selection] Figure 1

Description

  The present invention relates to a stereoscopic image generating apparatus that generates a three-dimensional computer graphic for stereoscopic vision, a stereoscopic image generating method using the same, and a computer for executing the steps of the stereoscopic image generating method. The present invention relates to a control program and a computer-readable readable storage medium storing the control program.

In this type of conventional stereoscopic image generation system, stereoscopic vision is realized by presenting the video for the right eye and the left eye separately to the right eye and the left eye, respectively. It is a mechanism that makes you feel like a three-dimensional. In the case of actual shooting, these right-eye viewpoint and left-eye viewpoint videos can be created, for example, by photographing a subject object at the same time from two viewpoints at a certain distance corresponding to the interval between the right eye and the left eye.
When creating images for the right-eye and left-eye viewpoints using a computer, the three-dimensional space configured in the computer is viewed from two viewpoints simulating the right-eye and left-eye viewpoints, and the results are converted into computer graphics (rendering). ).

  On the other hand, a mechanism for generating right-eye and left-eye images suitable for stereoscopic viewing from a single image has been invented by paying attention to the characteristics of pixels constituting the image. For example, Patent Document 1 discloses a stereoscopic image creation method that calculates a depth value from color components of each pixel of an original image and generates a right-eye video and a left-eye video from the depth value, respectively. Yes. This is shown in FIG.

  FIG. 4 is a block diagram illustrating a hardware configuration example of a conventional stereoscopic image forming apparatus disclosed in Patent Document 1.

  As shown in FIG. 4, a CPU (central processing unit) 101 as a control unit controls the operation of each unit of a conventional stereoscopic image forming apparatus 100 and executes various processes such as a stereoscopic image data creation process. . A ROM (Read Only Memory) 102 stores a program executed at the time of starting up, reference data, and the like. A RAM (Random Access Memory) 103 is for realizing a work area of the CPU 101 and the like.

  The character generator 104 generates graphic character display data (font data). The clock circuit 105 outputs the current time. The interface 106 is for connecting the stereoscopic image forming apparatus 100 to the Internet INET. The transmission control unit 107 exchanges data with a terminal device connected to the Internet INET via the interface 106.

  The magnetic disk device 108 is a storage device that stores various types of processing executed by the stereoscopic image forming apparatus 100 and program data such as an operating system, and stores various types of data created by various types of processing. The CD-ROM drive 109 is for reading image data stored in the CD-ROM 110. The display unit 111 is, for example, a CRT or LCD, and displays an image on the display screen under the control of the display control unit 112.

  The keyboard 113 is a full-key keyboard, and the user inputs instruction contents using the keyboard 113. The screen instruction device 114 is an input device such as a touch panel, and the user can input various instruction contents by pressing the touch panel. The input control unit 115 captures each instruction content input from the keyboard 113 and the screen instruction device 114. The data is output to the CPU 101.

  The CPU 101, ROM 102, RAM 103, character generator 104, clock circuit 105, transmission control unit 107, magnetic disk device 108, CD-ROM drive 109, display control unit 112, and input control unit 115 are connected to an internal bus 116. Yes. Data exchange between these various elements is performed via the internal bus 116.

  In creating the stereoscopic image data, the CPU 101 executes a stereoscopic image display application in the ROM 102, for example.

  Thereby, in the stereoscopic image forming apparatus 100, as shown in FIG. 5, first, the graphic processing unit GPU, which is a three-dimensional graphic processing mechanism, converts a single three-dimensional CG (computer graphic) data into a three-dimensional CG. Generate an image. Next, the parallax image generation function calculates a depth value (Z value) based on the grayscale value of the three-dimensional CG image generated by the graphic processing unit GPU. The Z value is subjected to reverse determination processing, smoothing processing, distribution correction processing, local correction processing, and the like. The parallax is determined based on the obtained Z value, and the process of moving each pixel by an amount corresponding to the determined parallax generates stereoscopic image data of the parallax images of the left-eye image and the right-eye image. .

International Publication No. 2004/019621 Pamphlet

  However, in the conventional stereoscopic image forming apparatus 100 disclosed in Patent Document 1, when generating 3D image data suitable for stereoscopic viewing from one piece of 3D CG data, the parallax image generating function is: Since the graphics processing unit GPU generates a depth value (Z value) based on the grayscale value of the 3D image, the depth value (Z value) generated by the parallax image generation function is the 3D CG data. Sometimes did not match the expected depth value. As a result, an accurate stereoscopic effect cannot be obtained when the stereoscopic image is presented to both human eyes. In addition, it is impossible to individually handle depth values in a computer graphic area (for example, a character area) and a non-graphic area (for example, a background area) in one image.

  In addition, as shown in FIG. 6, when the graphics processing unit GPU generates a right-eye two-dimensional CG image and a left-eye two-dimensional CG image for stereoscopic viewing from three-dimensional CG data, It is necessary to generate graphics from the viewpoint of each left eye. In order to create a set of stereoscopic images (right-eye image and left-eye image), the graphics processing unit GPU needs to perform three-dimensional graphics processing twice. For real-time display, when it is necessary to generate a complex three-dimensional graphic into a two-dimensional graphic in real time, the graphic processing unit GPU has to require high processing power.

  The present invention solves the above-described conventional problems, and does not require a high capability for a three-dimensional graphic processing mechanism, and at the same time, a stereoscopic image generation apparatus capable of obtaining an accurate stereoscopic effect and a stereoscopic vision using the same An object of the present invention is to provide an image generation method, a control program for causing a computer to execute each step of the stereoscopic image generation method, and a computer-readable readable storage medium storing the control program.

  The stereoscopic image generation apparatus of the present invention generates each pixel data of a computer graphic image from one viewpoint from computer graphic generation data in a data storage unit, and the depth associated with each pixel of the computer graphic image A stereoscopic image generation apparatus comprising a computer graphic generation unit for obtaining a value, and a stereoscopic image generation unit that generates a plurality of stereoscopic image data using the pixel data and the depth value, The pixel data and the depth value generated by the computer graphic generation unit are temporarily stored in the data storage unit, and then the pixel data and the depth value are transferred to the stereoscopic image generation unit when generating a stereoscopic image. Thus, the above-described object is achieved.

  Preferably, in the stereoscopic image generating apparatus of the present invention, the depth value of the computer graphic generation data matches the depth value of the plurality of stereoscopic image data generated by the stereoscopic image generation unit. ing.

  Still preferably, in a stereoscopic image generating apparatus according to the present invention, the control unit generates graphic data transfer means for transferring computer graphic generation data in the data storage unit to the computer graphic generation unit, and the computer graphic generation unit generates the control unit. Pixel data / depth value transfer means for writing each pixel data of the computer graphic image and a depth value associated with each pixel of the computer graphic image to the data storage unit, and storing the data at the start of stereoscopic image generation Stereoscopic image generation control means for transferring the pixel data and the depth value in the unit to the stereoscopic image generation unit.

  Further preferably, the data storage unit in the stereoscopic image generation apparatus of the present invention includes a first data storage unit that stores computer graphic generation data including one viewpoint data and a plurality of three-dimensional coordinate data, and the computer graphic. A second data storage unit capable of storing each pixel data of the image and a depth value associated with each pixel;

  Further preferably, the computer graphic generation unit in the stereoscopic image generation apparatus of the present invention includes a pixel data conversion unit that converts computer graphic generation data stored in the data storage unit into pixel data of a computer graphic image; A depth value calculation unit for calculating a depth value for each pixel of the computer graphic image from the computer graphic generation data.

  Further preferably, the plurality of image data in the stereoscopic image generating apparatus of the present invention is parallax image data including right-eye image data and left-eye image data.

  Still preferably, in a stereoscopic image generation apparatus according to the present invention, the second data storage unit stores a depth value presence / absence flag indicating the presence / absence of the depth value, and the stereoscopic image generation unit performs processing. For each pixel, if it is determined that there is the depth value based on the information on the presence / absence flag of the depth value, use the depth value, and if it is determined that there is no depth value, include the pixel A depth value calculated based on information obtained from one or more pixels is used.

  Further preferably, the stereoscopic image generation unit in the stereoscopic image generation apparatus of the present invention reads out one or more pixels from the pixel data and generates a new depth value, and the depth A depth value presence / absence detecting unit that outputs the depth value when the value presence / absence flag is “present” and outputs the new depth value when the depth value presence / absence flag is “none”; A left-eye and right-eye image generation unit configured to generate a left-eye image and a right-eye image for stereoscopic viewing based on a depth value from the depth value presence / absence detection unit;

  Further preferably, the pixel data conversion unit and the depth value calculation unit in the stereoscopic image generation apparatus of the present invention are configured by a graphic processing unit.

  Further, preferably, the second data storage unit in the stereoscopic image generation apparatus of the present invention is realized by dividing and using a holding area in one data holding mechanism.

  In the stereoscopic image generation method of the present invention, the control unit instructs the computer graphic generation unit to start drawing an image, and the control unit generates the computer graphic generation data in the data storage unit. And the computer graphic generation unit generates each pixel data of the computer graphic image from one viewpoint from the computer graphic generation data, and the depth associated with each pixel of the computer graphic image A computer graphic generation step for obtaining a value, a step for controlling the control unit to write the pixel data and the depth value in a predetermined area of the data storage unit, and the control unit at the time of generating a stereoscopic image, Each image stored in the data storage Transferring the data and the depth value to a stereoscopic image generating unit; and a stereoscopic image generating step in which the stereoscopic image generating unit generates a plurality of image data for stereoscopic viewing using the pixel data and the depth value. With this, the above-mentioned object is achieved.

  Preferably, in the stereoscopic image generation method of the present invention, the depth value of the computer graphic generation data matches the depth value of the plurality of stereoscopic image data generated by the stereoscopic image generation unit. ing.

  Further preferably, in the computer graphic generation step in the stereoscopic image generation method of the present invention, the pixel data conversion unit converts the computer graphic generation data stored in the data storage unit into each pixel data of the computer graphic image. The pixel data conversion step, and the depth value calculation unit includes a depth value calculation step of calculating a depth value for each pixel of the computer graphic image from the computer graphic generation data.

  Further preferably, in the stereoscopic image generation step of the stereoscopic image generation method of the present invention, for each pixel to be processed, based on information on a depth value presence / absence flag indicating the presence / absence of the depth value, the depth When it is determined that there is a value, the depth value is used. When it is determined that there is no depth value, a depth value calculated based on information obtained from one or more pixels including the pixel is used.

  Further preferably, the stereoscopic image generation step in the stereoscopic image generation method of the present invention is such that the depth value generation unit reads out one or more pixels from the pixel data and generates a new depth value. And the depth value presence / absence detection unit outputs the depth value when the presence / absence flag of the depth value is “present”, and the new depth when the presence / absence flag of the depth value is “none”. A depth value presence / absence detection step for outputting a value, and a left eye and right eye image generation unit that generates a left eye and a right eye image for stereoscopic viewing based on a depth value from the depth value presence / absence detection unit Steps.

  The control program according to the present invention describes a processing procedure for causing a computer to execute each step of the stereoscopic image generation method according to the present invention, thereby achieving the above object.

  The readable storage medium of the present invention is a computer-readable storage medium storing the control program of the present invention, thereby achieving the above object.

  With the above configuration, the operation of the present invention will be described below.

  In the present invention, after each pixel data and depth value generated by the computer graphic generation unit is temporarily stored in the data storage unit, each pixel data and its depth value are transferred to the stereoscopic image generation unit when generating a stereoscopic image. And a stereoscopic image generation unit that generates a plurality of image data for stereoscopic viewing using each of the pixel data and the depth value. In this case, the depth value of the computer graphic generation data matches the depth value in the plurality of stereoscopic image data generated by the stereoscopic image generation unit.

  Accordingly, the stereoscopic image generation unit uses a plurality of stereoscopic image generation units (for the right eye and the left eye) using each pixel data and depth value generated from the three-dimensional graphic data (computer graphic generation data) in the computer graphic generation unit. Since image data is generated, a stereoscopic image generation unit as a three-dimensional graphic processing mechanism does not require high ability, and an accurate stereoscopic effect can be obtained at the same time.

  In addition, even when a three-dimensional computer graphic in an image and other images are mixed, it is possible to generate a stereoscopic video with a more accurate stereoscopic effect.

  As described above, according to the present invention, the stereoscopic image generation unit uses the pixel data and the depth value generated from the three-dimensional graphic data (computer graphic generation data) in the computer graphic generation unit. Therefore, it is possible to obtain an accurate stereoscopic effect at the same time without requiring a high capability for the stereoscopic image generation unit as a three-dimensional graphic processing mechanism.

  In addition, even when a three-dimensional computer graphic in an image and other images are mixed, it is possible to generate a stereoscopic video with a more accurate stereoscopic effect.

It is a block diagram which shows the principal part hardware structural example in Embodiment 1 of the image generation system for stereoscopic vision which concerns on this invention. FIG. 3 is a block diagram illustrating a configuration example of a stereoscopic image generation circuit in FIG. 1 as Embodiment 2 of the stereoscopic image generation system according to the present invention. In the stereoscopic image forming apparatus of the present invention, after the graphic processing unit generates the 3D CG image data from one viewpoint, the 3D CG image for the right eye for stereoscopic viewing and the tertiary for the left eye based on the CG image and depth information. It is an operation | movement process diagram in the case of producing | generating an original CG image. FIG. 10 is a block diagram illustrating a hardware configuration example of a conventional stereoscopic image forming apparatus disclosed in Patent Document 1. FIG. 5 is an operation process diagram for explaining the operation of the conventional stereoscopic image forming apparatus of FIG. 4. FIG. 11 is an operation process diagram when a graphics processing unit generates a right-eye three-dimensional CG image and a left-eye three-dimensional CG image for stereoscopic vision in a conventional stereoscopic image forming apparatus.

  Embodiments 1 and 2 of the stereoscopic image forming system of the present invention will be described below in detail with reference to the drawings.

(Embodiment 1)
FIG. 1 is a block diagram illustrating an exemplary hardware configuration of a main part in the first embodiment of the stereoscopic image generation system according to the present invention.

  In FIG. 1, the stereoscopic image generation system 20 of the first embodiment displays the stereoscopic image generation device 1 of the present embodiment and the stereoscopic image data generated by the stereoscopic image generation device 1 on a display screen. And a display unit 21 for displaying.

  The stereoscopic image generation apparatus 1 of the present embodiment includes a memory 2 that stores data and work memory, a CG generation circuit 7, a CPU 10 (central processing unit) as a control unit that performs overall control, A visual image generation circuit 11, an image output unit 12, and an operation unit 13 are provided. These memory 2, CG generation circuit 7, CPU 10, stereoscopic image generation circuit 11, and operation unit 13 are connected to the bus 14. Has been.

  The memory 2 is a storage unit (RAM) that functions as a work memory that stores data for each control by the CPU 10 by reading a control program and its data from a ROM (not shown) at startup. In the storage area of the memory 2 as the first data storage unit, computer graphic generation data (three-dimensional graphic data 3) including one viewpoint data and a plurality of three-dimensional coordinate data is stored, and a control program of program code 6 and Store the data. In addition, each pixel data 4 (RGB data) of computer graphic image data generated by the CG generation circuit 7 and a depth value 5 associated with each pixel are stored in a storage area as a second data storage unit of the memory 2. .

  The CG generation circuit 7 includes a pixel calculation circuit 8 as a data conversion unit that converts computer graphic generation data (three-dimensional graphic data 3) in the memory 2 into pixel data of a computer graphic image, and computer graphic generation in the memory 2 It has a depth calculation circuit 9 as a depth value calculation unit for calculating a depth value for each pixel of a computer graphic image from data (three-dimensional graphic data 3).

  That is, the CG generation circuit 7 reads out the three-dimensional graphic data 3 (computer graphic generation data) in the memory 2 based on the graphic data transfer command from the CPU 10 and uses the pixel calculation circuit 8 to perform the computer from one viewpoint. Each pixel data 4 of the graphic image (visualized two-dimensional image) is generated, and each pixel data 4 is written in the second data storage unit of the memory 2. Further, the CG generation circuit 7 uses the depth calculation circuit 9 to generate a depth value associated with each pixel of the computer graphic image, and stores the depth value 5 (depth value generation result) associated with each pixel in the memory 2. To the second data storage unit. Further, the CG generation circuit 7 notifies the CPU 10 of the completion of drawing. As a result of the drawing completion notification, each pixel data of the three-dimensional graphic image viewed from one viewpoint is stored in the storage area (memory 2) of the pixel data 4. Also, the depth value corresponding to each pixel stored in the pixel data 4 is stored in the storage area of the depth value 5 (memory 2).

  The CPU 10 reads out the program code stored in the memory 2, controls data reading and data writing in the memory 2 based on the control program of the program code, and controls the CG generation circuit 7 and the stereoscopic image generation circuit 11. To do.

  That is, the CPU 10 instructs the CG generation circuit 7 to start drawing an image based on the control program of the program code stored in the first data storage unit of the memory 2, and the 3D graphic data 3 stored in the memory 2. The graphic data transfer means 10A for transferring (computer graphic generation data) to the CG generation circuit 7 and the CG generation circuit 7 calculate one viewpoint position based on the read three-dimensional graphic data 3 (computer graphic generation data). The pixel data / depth value transfer means 10B for writing each pixel data of the computer graphic image and the depth value associated with each pixel of the computer graphic image to each predetermined storage area of the memory 2, and drawing from the CG generation circuit 7 After the CPU 10 receives the completion notification, The pixel data 4 and the depth value 5 stored in the memory 2 are transferred to the stereoscopic image generation circuit 11, the stereoscopic image generation circuit 11 is instructed to start the stereoscopic image generation, and the pixel data 4 and the depth value 5 are used. Each function of the stereoscopic image generation control means 10C for generating a stereoscopic image (parallax image) is executed.

  The stereoscopic image generation circuit 11 reads out each pixel data 4 and the depth value 5 from the memory 2, generates a right-eye image and a left-eye image (parallax image) for stereoscopic viewing from each pixel data according to the depth value 5, and generates them Each parallax image thus output is output to the image output circuit 12.

  The image output circuit 12 converts the right-eye image and the left-eye image into electrical signals, and outputs the two images to the display unit 21 as signals in a format suitable for the display device.

  The operation unit 13 is a keyboard, a mouse, a touch panel, and a pen input device for issuing an input command to the CPU 10, and an input device that receives and inputs via a communication network (for example, the Internet or an intranet).

  The ROM is a computer-readable readable recording medium in which a control program and its data are stored, although not shown here. Specifically, in addition to a hard disk, a ROM is a formable optical disk, a magneto-optical disk, It may be composed of a magnetic disk and an IC memory. This control program and its data are stored in the ROM, but this control program and its data may be downloaded to the ROM 4 from another readable recording medium or via wireless, wired or the Internet.

  The operation of the stereoscopic image generating apparatus 1 having the above configuration will be described.

  First, a stereoscopic image generation command from the operation unit 13 is input to the CPU 10, and the CPU 10 reads out the program code stored in the memory 2, and based on the program code control program and its data, the CG generation circuit 7. Is instructed to start image drawing.

  Next, the CPU 10 transfers the three-dimensional graphic data 3 (computer graphic generation data) stored in the memory 2 by the graphic data transfer means 10A to the CG generation circuit 7 based on the control program of the program code.

  Subsequently, the CPU 10 uses the CG generation circuit 7 to generate one viewpoint position from the 3D graphic data 3 (computer graphic generation data) read by the pixel data / depth value transfer means 10B based on the control program of the program code. Control is performed so that each pixel data and depth value calculated in the above are written in each predetermined storage area of the memory 2.

  Further, after the CPU 10 receives the drawing completion notification from the CG generation circuit 7, the CPU 10 generates each pixel data 4 stored in the memory 2 by the stereoscopic image generation control means 10C based on the control program of the program code. And the depth value 5 are transferred to the stereoscopic image generation circuit 11 and the stereoscopic image generation circuit 11 is instructed to start generating a stereoscopic image, and a stereoscopic image is generated using the pixel data 4 and the depth value 5.

  As described above, in the stereoscopic image generation method according to the first embodiment, the CPU 10 instructs the CG generation circuit 7 serving as a computer graphic generation unit to start drawing an image, and the CPU 10 serves as a data storage unit. Transferring the three-dimensional graphic data 3 (computer graphic generation data) in the memory 2 to the CG generation circuit 7, and the CG generation circuit 7 from the three-dimensional graphic data 3 (computer graphic generation data) in one viewpoint. A computer graphic generation step of generating each pixel data of the computer graphic image and obtaining a depth value associated with each pixel of the computer graphic image, and each pixel data and depth value generated by the CPU 10 in the CG generation circuit 7 In a predetermined area of the memory 2 A step of controlling the writing so that each pixel data and a depth value stored in the memory 2 are transferred to the stereoscopic image generating circuit 11 when generating a stereoscopic image, and a stereoscopic image generating circuit. 11 includes a stereoscopic image generation step for generating a plurality of stereoscopic image data (right-eye image data and left-eye image data) using each pixel data and depth value. This is repeated for each frame to generate a moving image and display it on the display screen of the display unit 21.

  As described above, in the first embodiment, as illustrated in FIG. 3, as a parallax image generation function for generating a plurality of stereoscopic image data (right-eye image data and left-eye image data) from a single image. For a stereoscopic image generation circuit 11 and a CG generation circuit 7 as a computer graphic generation unit made of a GPU, each image calculated from a single viewpoint generated by the GPU and each of the three-dimensional CG generation processing of the GPU are calculated. The depth information (Z buffer value) for the pixel is passed to the stereoscopic image generation circuit 11 as a parallax image generation function, and the stereoscopic image generation circuit 11 performs control to generate a plurality of images for stereoscopic viewing. At this time, conventionally, the parallax image generation function is generated by the graphics processing unit GPU and calculates the depth value (Z value) based on the grayscale value of the three-dimensional image. However, in the first embodiment, the depth value of the three-dimensional graphic data 3 (computer graphic generation data) and the generation of the parallax image are not matched with the expected depth value of the three-dimensional CG data. Since the depth values in the plurality of stereoscopic image data (right-eye image data and left-eye image data) generated by the stereoscopic image generation circuit 11 as a function match each other with the same depth value, the stereoscopic image is more A three-dimensional effect with an accurate depth value can be obtained.

  Therefore, according to the first embodiment, the stereoscopic image generation circuit 11 uses the pixel data and the depth value generated from the three-dimensional graphic data 3 (computer graphic generation data) in the CG generation circuit 7 for stereoscopic viewing. In order to generate a plurality of image data (for right eye and left eye), the stereoscopic image generation circuit 11 as a three-dimensional graphic processing mechanism does not require high ability as in the conventional case, and an accurate stereoscopic effect is provided as a stereoscopic image. Obtainable.

(Embodiment 2)
In the second embodiment, in addition to an image that has a depth value in one image (image of one frame) (part of the three-dimensional graphic data 3) and an image that does not have a depth value (such as a background image) A case where moving images are also assumed) will be described.

  FIG. 2 is a block diagram showing a configuration example of the stereoscopic image generation circuit 11 of FIG. 1 as Embodiment 2 of the stereoscopic image generation system according to the present invention.

  The configuration of FIG. 1 is also used in the second embodiment. That is, in FIG. 1, the stereoscopic image generation system 20A of the second embodiment displays the stereoscopic image generation device 1A of the present embodiment and the stereoscopic image data generated by the stereoscopic image generation device 1A. And a display unit 21 displayed on the screen. The stereoscopic image generation apparatus 1A according to the second embodiment includes a memory 2 in which data and work memory are stored, a CG generation circuit 7, and a CPU 10 (central processing unit) as a control unit that performs overall control. A stereoscopic image generation circuit 11D, an image output unit 12, and an operation unit 13 are provided. The memory 2, the CG generation circuit 7, the CPU 10, the stereoscopic image generation circuit 11D, and the operation unit 13 are connected to the bus 14. It is connected.

  In FIG. 2, the stereoscopic image generation circuit 11D according to the second embodiment outputs a depth value 5 when the presence / absence flag 5A of the depth value 5 is “present”, and the presence / absence flag 5A of the depth value 5 is “none”. ”, A depth value presence / absence detection circuit 11A that outputs a depth value from the depth value generation circuit 11B, a depth value generation circuit 11B that reads one or more pixels from the pixel data 4 and generates a depth value, and a depth A left-eye / right-eye image generation circuit 11C that generates a left-eye / right-eye image for stereoscopic viewing based on the depth value from the value presence / absence detection circuit 11A. In the first embodiment, the depth value presence / absence detection circuit 11A and the depth value generation circuit 11B are not provided.

  In other words, the stereoscopic image generation circuit 11D according to the second embodiment, for each pixel to be processed, based on the information on the presence / absence flag 5A indicating the presence / absence of a depth value, A depth value calculated based on information obtained from one or more pixels including the processing pixel is used instead of the depth value 5, and if the processing pixel has a depth value, the depth value 5 is used to A plurality of parallax image data for stereoscopic viewing is generated from the pixel data.

  Here, the operation of the stereoscopic image generation circuit 11D of FIG. 2 will be described.

First, the depth value generation circuit 11B reads one or more pixels from the pixel data 4, generates a depth value, and outputs the depth value to the depth value existence determination circuit 11A.
Next, the depth value presence / absence detection circuit 11A receives one depth value read from the depth value 5 and an output from the depth value generation circuit 11B. If there is a presence / absence flag 5A in the depth value, and the depth value presence / absence detection circuit 11A detects that there is a depth value from the presence / absence flag 5A, the depth value read from the depth value 5 is the left-eye / right-eye image. Output to the generation circuit 11C. The depth value presence / absence detection circuit 11A outputs the depth value from the depth value generation circuit 11B when it is detected from the presence / absence flag 5A that the depth value does not exist in the depth value.
Thereafter, the right-eye / left-eye image generation circuit 11C receives the depth value from the depth value presence / absence detection circuit 11A, reads each pixel data from the pixel data 4, and generates a right-eye image and a left-eye image for stereoscopic viewing.

  As described above, also in the second embodiment, as shown in FIG. 3, a plurality of stereoscopic image data (right-eye image data and left-eye image data) are generated from one image (one frame image). With respect to the stereoscopic image generation circuit 11D as a parallax image generation function and the CG generation circuit 7 as a computer graphic generation unit including a GPU, each pixel data of an image (two-dimensional image) from one viewpoint generated by the GPU, and , The depth information (Z buffer value) for each pixel calculated in the process of 2D image generation processing from 3D CG data of the GPU is passed to the stereoscopic image generation circuit 11D as a parallax image generation function to The image generation circuit 11D performs control to generate a plurality of parallax images for stereoscopic viewing.

  Therefore, according to the second embodiment, the CG generation circuit 7 uses the depth value calculated when generating each pixel data of the visualized two-dimensional image from one piece of the three-dimensional computer graphic data 3. By passing to a stereoscopic image generation circuit 11D as a parallax image generation function for generating a plurality of parallax image data (right-eye image data and left-eye image data) for stereoscopic viewing from one image (one frame image), The visual image generation circuit 11D reduces the generation processing by the CG generation circuit 7 that generates each pixel data of the visualized two-dimensional image from the three-dimensional computer graphic data 3, while reducing the three-dimensional graphic data 3 (computer graphic generation). Data) and a plurality of stereoscopic image data (for the right eye) generated by the stereoscopic image generation circuit 11D. By matching the depth values in the image data and the image data for the left eye), it is possible to construct a stereoscopic image generation mechanism for generating an image for accurate stereoscopic. Further, in this case, in particular, even when the three-dimensional computer graphic data 3 in the image and the other image (for example, background image) are mixed in one frame image, more accurate stereoscopic effect for stereoscopic viewing is provided. Video can be generated.

  Although not particularly described in the first and second embodiments, each pixel data of a computer graphic image from one viewpoint is generated from the three-dimensional graphic data 3 in the memory 2 and the tertiary in the memory 2 is generated. A CG generation circuit 7 for obtaining a depth value associated with each pixel of the computer graphic image from the original graphic data 3, and a stereoscopic image generation for generating a plurality of stereoscopic image data using each pixel data and the depth value A stereoscopic image generation apparatus 1 or 1A having a circuit 11, and after each pixel data and depth value generated by the CG generation circuit 7 are temporarily stored in the memory 2, a stereoscopic image is generated when the stereoscopic image is generated. By having a CPU 10 that controls the generation circuit 11 to transfer each pixel data and depth value, a three-dimensional graphic Does not require a high capacity sense mechanism, it is possible to achieve the object of the present invention which can simultaneously obtain an accurate three-dimensional effect.

  In the first and second embodiments, the control unit 10 (CPU), for example, transfers each pixel data and depth value stored in the data storage unit to the stereoscopic image generation unit when generating the stereoscopic image. However, the present invention is not limited to this, and the control unit is not limited to the control unit 10 (CPU), but the control unit of the CG generation circuit 7 as a computer graphic generation unit or the stereoscopic image generation circuit 11 as a stereoscopic image generation unit or An 11D control unit may be included. In short, the operation of the control unit may be performed by the control unit 10 (CPU), and the operation of the control unit may be performed by the control unit of the CG generation circuit 7 as a computer graphic generation unit. The operation of this control unit may be performed by the control unit of the stereoscopic image generation circuit 11 or 11D as the stereoscopic image generation unit. That is, at least one of the control unit 10 (CPU), the computer graphic generation unit, and the stereoscopic image generation unit performs, for example, each pixel data and depth stored in the data storage unit when generating a stereoscopic image. The value may be controlled to be transferred to a stereoscopic image generation unit (stereoscopic image generation mechanism).

  As mentioned above, although this invention was illustrated using preferable Embodiment 1, 2 of this invention, this invention should not be limited and limited to this Embodiment 1,2. It is understood that the scope of the present invention should be construed only by the claims. It is understood that those skilled in the art can implement an equivalent range based on the description of the present invention and the common general technical knowledge, from the description of specific preferred embodiments 1 and 2 of the present invention. Patents, patent applications, and documents cited herein should be incorporated by reference in their entirety, as if the contents themselves were specifically described herein. Understood.

  The present invention relates to a stereoscopic image generating apparatus that generates a three-dimensional computer graphic for stereoscopic vision, a stereoscopic image generating method using the same, and a computer for executing the steps of the stereoscopic image generating method. In the field of a control program and a computer-readable storage medium storing the control program, a 3D graphic data (computer graphic generation data) is generated from three-dimensional graphic data (computer graphic generation data) by a computer graphic generation unit. Since the visual image generation unit generates a plurality of image data (for right eye and left eye) for stereoscopic viewing, the stereoscopic image generation unit as a three-dimensional graphic processing mechanism does not require high capability, and at the same time, accurate stereoscopic effect Can be obtained.

1, 1A Stereoscopic image generation device 2 Memory (data storage unit)
3 Three-dimensional graphic data (computer graphic generation data)
4 Pixel data 5 Depth value (depth information)
5A presence / absence flag 6 program code (control program and its data)
7 CG generation circuit (computer graphic generation unit)
8 pixel calculation circuit 9 depth calculation circuit 10 CPU (control unit)
10A Graphic data transfer means 10B Pixel data / depth value transfer means 10C Stereoscopic image generation control means 11, 11D Stereoscopic image generation circuit (stereoscopic image generation unit)
11A Depth value presence / absence detection circuit 11B Depth value generation circuit 11C Left eye / right eye image generation circuit 12 Image output unit 13 Operation unit 14 Bus 20, 20A Stereoscopic image generation system 21 Display unit

Claims (17)

A computer graphic generation unit that generates pixel data of a computer graphic image at a single viewpoint from computer graphic generation data in the data storage unit, and calculates a depth value associated with each pixel of the computer graphic image;
A stereoscopic image generation apparatus including a stereoscopic image generation unit that generates a plurality of stereoscopic image data using the pixel data and the depth value;
After the pixel data and the depth value generated by the computer graphic generation unit are temporarily stored in the data storage unit, the stereoscopic image generation unit receives the pixel data and the depth value when generating a stereoscopic image. A stereoscopic image generation apparatus having a control unit that controls to transfer.   The stereoscopic image generation apparatus according to claim 1, wherein a depth value of the computer graphic generation data matches a depth value in a plurality of stereoscopic image data generated by the stereoscopic image generation unit. The controller is
Graphic data transfer means for transferring computer graphic generation data in the data storage unit to the computer graphic generation unit;
Pixel data / depth value transfer means for writing each pixel data of the computer graphic image generated by the computer graphic generation unit and a depth value associated with each pixel of the computer graphic image to the data storage unit;
The stereoscopic image generation apparatus according to claim 1, further comprising: a stereoscopic image generation control unit that transfers the pixel data and the depth value in the data storage unit to the stereoscopic image generation unit at the start of stereoscopic image generation. . The data storage unit
A first data storage unit for storing computer graphic generation data including one viewpoint data and a plurality of three-dimensional coordinate data;
The stereoscopic image generating apparatus according to claim 1, further comprising: a second data storage unit capable of storing each pixel data of the computer graphic image and a depth value associated with each pixel. The computer graphic generation unit
A pixel data conversion unit that converts computer graphic generation data stored in the data storage unit into pixel data of a computer graphic image;
The stereoscopic image generation apparatus according to claim 1, further comprising a depth value calculation unit that calculates a depth value for each pixel of the computer graphic image from the computer graphic generation data.   The stereoscopic image generation apparatus according to claim 1, wherein the plurality of pieces of image data are parallax image data including right-eye image data and left-eye image data.   The second data storage unit stores a depth value presence / absence flag indicating the presence / absence of the depth value, and the stereoscopic image generation unit stores information on the depth value presence / absence flag for each pixel to be processed. Based on the information obtained from one or more pixels including the pixel when the depth value is determined to be present, and when the depth value is determined to be absent. The stereoscopic image generating apparatus according to claim 4, wherein a depth value is used.   The stereoscopic image generation unit reads out one or more pixels from the pixel data and generates a new depth value, and the depth value when the presence / absence flag of the depth value is “present” A depth value presence / absence detecting unit that outputs a new depth value when the depth value presence / absence flag is “none”, and a depth based on the depth value from the depth value presence / absence detecting unit. The stereoscopic image generation apparatus according to claim 1, further comprising: a left eye and a right eye image generation unit configured to generate a left eye and a right eye image for viewing.   The stereoscopic image generation apparatus according to claim 5, wherein the pixel data conversion unit and the depth value calculation unit are configured by a graphic processing unit.   The stereoscopic image generation apparatus according to claim 4, wherein the second data storage unit is realized by dividing and using a holding area in one data holding mechanism. A step in which the control unit instructs the computer graphic generation unit to start drawing an image;
Transferring the computer graphic generation data in the data storage unit to the computer graphic generation unit;
A computer graphic generation step in which the computer graphic generation unit generates each pixel data of a computer graphic image from one viewpoint from the computer graphic generation data and obtains a depth value associated with each pixel of the computer graphic image When,
Controlling the control unit to write the pixel data and the depth value in predetermined areas of the data storage unit,
The control unit controlling to transfer each pixel data and depth value stored in the data storage unit to the stereoscopic image generation unit when generating the stereoscopic image;
A stereoscopic image generation method, wherein the stereoscopic image generation unit includes a stereoscopic image generation step of generating a plurality of stereoscopic image data using the pixel data and the depth value.   The stereoscopic image generation method according to claim 11, wherein a depth value of the computer graphic generation data matches a depth value in a plurality of stereoscopic image data generated by the stereoscopic image generation unit. The computer graphic generation step includes:
A pixel data conversion unit that converts the computer graphic generation data stored in the data storage unit into pixel data of a computer graphic image;
The stereoscopic image generation method according to claim 11, wherein the depth value calculation unit includes a depth value calculation step of calculating a depth value for each pixel of the computer graphic image from the computer graphic generation data.   In the stereoscopic image generation step, when it is determined that there is the depth value for each pixel to be processed based on the information of the depth value presence / absence flag indicating the presence / absence of the depth value, the depth value is used. The stereoscopic image generation method according to claim 11, wherein when it is determined that there is no depth value, a depth value calculated based on information obtained from one or more pixels including the pixel is used.   The stereoscopic image generation step includes a depth value generation step in which a depth value generation unit reads one or more pixels from the pixel data to generate a new depth value, and a depth value presence / absence detection unit includes the depth value A depth value presence / absence detection step that outputs the depth value when the presence / absence flag of the depth value is “present” and outputs the new depth value when the presence / absence flag of the depth value is “none”; The stereoscopic image according to claim 11, wherein the right-eye image generating unit includes a left-eye and right-eye image generating step of generating a left-eye and right-eye image for stereoscopic viewing based on the depth value from the depth value presence / absence detecting unit. Generation method.   A control program in which a processing procedure for causing a computer to execute each step of the stereoscopic image generation method according to any one of claims 11 to 15 is described.   A computer-readable readable storage medium in which the control program according to claim 16 is stored.

Images