JPH07250349A - Method for generating three-dimension video image from two-dimension video image - Google Patents

Abstract

PURPOSE:To generate a three-dimension video image not providing a sense of displeasure to a viewer at a scene change by generating a video image for one eye from an original 2-dimension video image, generating the video image for the other eye at a frame preceding or succeeding by a prescribed frame number as a still image. CONSTITUTION:A CPU controls a switch SW and an original two-dimension image via the switch SW is outputted as a left eye video image L. Simultaneously the original two-dimension image read from a frame memory MC by a memory control circuit MC is deviated by a required frame number in a leading direction or the like to form a still video image and the resulting image is outputted as a right eye use video image. Thus, a frame image of other scene is not mixed respectively in scenes A, B and a background moving in the horizontal direction to the right or the like is retracted to the depth and it is prevented that one side video image is left unchanged at of the scenes A, B and then the original three-dimension image not providing a sense of displeasure to a viewer is generated.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for generating a three-dimensional image from an original two-dimensional image output from a VTR, a video camera or the like, or transmitted by CATV or TV broadcasting.

[0002]

2. Description of the Related Art Most of the 3D image software used in the 2D display system, which has been recently talked about, is most specially created for the 3D display system, and generally uses two cameras. Capture the right eye image and the left eye image,
By displaying these imaged and recorded images on one display substantially at the same time, and letting the double-viewed right-eye image and left-eye image enter the respective eyes of the viewer, The viewer is made to recognize a three-dimensional image.

However, there are many two-dimensional video software in the world, and if these two-dimensional software can be converted into three-dimensional, the time, time and cost for producing new three-dimensional video software can be reduced. You can do it.

By the way, conventionally, when converting a two-dimensional image into a three-dimensional image, for example, a method of converting the recorded two-dimensional image by frame delay is known. This is because if the original two-dimensional image is used as a left-eye image and a right-eye image having a frame-delayed image with respect to the left-eye image is created, parallax between the two images is generated. It is known that if the images are displayed on the screen substantially at the same time, it is possible to project three-dimensional image software of the same degree as the left and right images captured by the two cameras described above.

[0005]

However, in the method of generating a 2D image from a 2D image by the frame shifting method described above, a frame delay is caused when the image of the image currently displayed changes to a completely different scene. In the image for the right eye that was taken, it moves to the next scene,
In the left-eye image, the image of the previous scene remains the same, and there is a phenomenon that the two images do not match on the screen, causing a strange image at the scene break.

The present invention has been made in view of the above problems of the prior art, and it is an object of the present invention to minimize the mismatching of the images for the left and right eyes at the break of a scene.

[0007]

According to the present invention, an image for one eye is created from an original two-dimensional image, and the image for the other eye is delayed from the image for one eye by a predetermined number of frames. A method for generating a three-dimensional image from a two-dimensional image created by a moving frame or an advanced frame, wherein a scene is composed of a series of highly related frames, and at the break of each scene, a scene for the other eye is created. The video is a still video by repeating the image of the same frame.

Further, before and after the break, the image for the other eye is the still image, and the break of the scene is a three-dimensional image scene and a three-dimensional image scene. Between the two-dimensional video scenes and the three-dimensional video scenes.

[0009]

With the above structure, an image which does not cause discomfort to the viewer is displayed at the transition from a two-dimensional image to a three-dimensional image or from a scene of a certain three-dimensional image to a scene of another three-dimensional image. Is possible.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a method for generating a 3D image from a 2D image according to the present invention will be described in detail below with reference to the drawings.

[Case between 3D Video and 3D Video] FIGS. 1 and 2 show frame correspondence diagrams when a scene A of 3D video and a scene B of 3D video are cut. Figure 1
Shows the case where the right-eye image is advanced by 4 frames with respect to the left-eye image, and FIG. 2 shows the case where the right-eye image is delayed by 4 frames with respect to the left-eye image.

First, in FIG. 1, the background moving to the right in the horizontal direction is retracted from the screen, so that in the scene A, the images for the left eye are ... Frames 5, 6, 7, 8,
9 and 10, the right-eye video image is displayed in the frame 9 which is four frames ahead of the left-eye video image frame 5, but from the next frame 6 of the left-eye video image. The frame 10 is repeatedly displayed as the right-eye image up to the frame 10 of the break of the scene, and the still image is displayed as the right-eye image during this period.

In the scene B, the left-eye image is also displayed in the order of frames 11 to 15 ..., and correspondingly, the right-eye image is displayed in the order of frames 15 to 19 ... With a frame difference of 4. Be done.

Next, in FIG. 2, the background moving to the left in the horizontal direction is retracted from the screen, so that in the scene A, the image for the left eye is ... Frames 7, 8, 9, 10 at the same time.
While the image for the right eye is frame 3,
It is projected while maintaining a frame difference of -4, 5, 6, and -4.

On the other hand, in the scene B, the left-eye image is projected as 11, 12, 13, 14, and 15 from the scene break, while the right-eye image is continuously and repeatedly displayed in the frame 11. And the video for the left eye is frame 16
.., the right-eye image is displayed as frame 12 ... While maintaining the frame difference of -4.

In this way, at the break between the scenes of the three-dimensional video and the three-dimensional video, the still video of the right-eye video is projected before or after the break of the scene depending on the moving direction of the object to be popped out.

[Case between 2D Video and 3D Video] FIG. 3 shows a frame correspondence diagram in the case of a scene A of 3D video and a scene B of 2D video. Scene A in FIG. 3 shows a case where the right-eye image is advanced by 4 frames with respect to the left-eye image.

First, in FIG. 3, the background moving to the right in the horizontal direction is retracted from the screen, so that in the scene A, the image for the left eye is ... Frames 5, 6, 7, 8 at the same time.
9 and 10, the right-eye video image is displayed in the frame 9 which is four frames ahead of the left-eye video image frame 5, but from the next frame 6 of the left-eye video image. The frame 10 is repeatedly displayed as the right-eye image up to the frame 10 of the break of the scene, and the still image is displayed as the right-eye image during this period.

In scene B, the left-eye image is also displayed in the order of frames 11 to 15 ..., and correspondingly, the right-eye image is also displayed in the order of frames 11 to 15 ... As a result, a two-dimensional image can be obtained.

Next, FIG. 4 shows a frame correspondence diagram in the case of a break between a scene A of a two-dimensional image and a screen B of a three-dimensional image. Scene B in FIG. 4 shows a case where the right-eye image is delayed by 4 frames from the left-eye image.

First, in scene A, the left-eye image is displayed in the order of frames 5-10, and correspondingly, the right-eye image is also displayed in the frames 5-10 in order of frame difference 0.
The two-dimensional image is obtained by displaying the image.

Next, in order to make the background moving leftward in the horizontal direction recede from the screen, the image for the left eye at the same time in the scene B ... Frames 11, 12, 13, 14, 1
5, 16, ..., On the other hand, in the right-eye image, the frame 11 is continuously and repeatedly displayed. When the left-eye image becomes the frames 16 ..., The right-eye image is displayed as the frames 12 ... While maintaining the frame difference of -4.

As described above, at the break between the two-dimensional video image and the three-dimensional video image, the still video image for the right eye is projected before or after the break of the scene depending on the moving direction of the object to be projected.

FIG. 5 is a block diagram showing a hardware configuration for realizing the method according to each of the above embodiments. The original two-dimensional image input in the figure enters the switch SW as it is, and becomes the video signal for the left eye.

One original two-dimensional image is taken into the frame memory FM, and the image data of the frame delayed (advanced) by a predetermined frame by the frame shift amount data of the central processing unit CPU is input to the switch SW. . At this time, since it is necessary to project the same frame data repeatedly when the scene is broken, the memory control circuit MC repeatedly selects the same frame from the frame memory FM.

Each data input to the switch SW is switched and output by the switch SW to obtain a desired left-eye image signal and right-eye image signal.

[0027]

As described above, according to the present invention, the image for one eye is changed to the still image at the scene break between the two-dimensional image and the three-dimensional image or between the three-dimensional images. It is possible to prevent an unnatural stereoscopic image or a flat image from being displayed in the frames that form one scene without being mixed with the frames of the other scenes, and to expect that an image that is easy on the eyes of the viewer is always displayed on the screen.

[Brief description of drawings]

FIG. 1 is a diagram showing frame correspondence (frame difference 4) before and after a scene break between 3D images.

[Fig. 2] Fig. 2 is a diagram illustrating frame correspondence (frame difference -4) before and after a scene break between 3D images.

FIG. 3 is a diagram showing frame correspondence (frame difference 4) before and after a break in a scene between a 3D image and a 2D image.

FIG. 4 is a diagram showing frame correspondence (frame difference-4) before and after a break in a scene between a 2D image and a 3D image.

FIG. 5 is a simplified block diagram of a hardware configuration for implementing the method of the present invention.

Claims (4)

[Claims] 1. An image for one eye is created from an original two-dimensional image, and an image for the other eye is created by a frame delayed or advanced by a predetermined number of frames from the image for the one eye. A method of generating a 3D image from a 2D image as described above, wherein a scene is composed of a series of highly related frames, and at the break of each scene, the image for the other eye is composed of the same frame. It is characterized by making a still image by repeating an image.
A method for generating a 3D image from a 3D image. 2. The method for generating a three-dimensional image from a two-dimensional image according to claim 1, wherein the image for the other eye is used as the still image before and after the break. 3. The break of the scene is a break between a scene of a 3D image and a scene of a 3D image.
Alternatively, a method for generating a 3D image from the 2D image described in 2. 4. The break of the scene is a break between a 2D image scene and a 3D image scene.
Alternatively, a method for generating a 3D image from the 2D image described in 2.