JP2012010302A - Image display device and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem that a high-quality three-dimensional image can not be obtained due to an occlusion when the three-dimensional image is created from an image and a depth image of a subject.SOLUTION: A plurality of images are used between which there is a parallax. At least one object image of the images is magnified so as to hide an occlusion due to the parallax between the object images. A three-dimensional image is displayed with using the plurality of images after the expansion.

Description

  The present invention relates to an image display device and an image display method for displaying a stereoscopic image.

  A stereoscopic image is recognized by viewing two images having parallax with the left and right eyes. For example, the two images have polarization directions orthogonal to each other and use glasses that guide polarized lights orthogonal to each other to the left and right eyes. Two methods for creating a stereoscopic image have been proposed. In the first method, the subject is photographed from two directions corresponding to the left and right eyes. The second method creates a stereoscopic image using a normal subject image and a subject distance image. A method using this distance image is called DIBR (Depth Image Based Rendering).

  In order to obtain a normal subject image and a subject distance image at the same time, a method using a compound eye camera as shown in FIG. 5 has been proposed (for example, Patent Document 1). In FIG. 5, the compound-eye camera has four single lenses 501, 502, 503, and 504, and four imaging areas 505, 506, 507, and 508 corresponding to these one-to-one. Four single lenses 501, 502, 503, and 504 are installed in a grid on substantially the same plane, and four imaging areas 505, 506, 507, and 508 are also installed in a grid on substantially the same plane. Yes. The optical axes 509, 510, 511, and 512 of the single lenses 501, 502, 503, and 504 are disposed so as to pass near the centers of the respective imaging regions 505, 506, 507, and 508.

  The single lens 501 and the imaging region 505 photograph a red image, the single lens 502 and the imaging region 506 photograph a first green image, the single lens 503 and the imaging region 507 photograph a second green image, and a single lens 504 and the imaging region 508 capture a blue image. A subject image can be obtained by combining red, green, and blue images, and the distance between the subject can be obtained by triangulation by comparing the first green image and the second green image. It has been demonstrated that accurate distance measurement is possible even with a small lens spacing.

  An example of the subject image and the subject distance image will be described with reference to FIGS. FIG. 6 is a plan view when a subject is photographed with a compound eye camera. A snowman 602 is created in front of the hut 601 and photographed using the compound eye camera 603. FIG. 7 is a subject image viewed from the compound-eye camera 603. A snowman can be seen in front of the hut, but mountains and trees can be seen in the distance. FIG. 8 is a distance image of the subject, in which a near subject is white and a far subject is black. A stereoscopic image is created using the subject image (FIG. 7) and the subject distance image (FIG. 8).

  It is also possible to recognize the contour of the subject using only a normal subject image, and to infer the subject distance from the perspective size and direction of the subject or the perspective of the subject shape. In this method, a distance image of a subject is not required, and a distance image can be created even with a photograph taken in the past.

  Japanese Patent No. 4071793

  To recognize a stereoscopic image, it is necessary to create a subject image viewed with the left eye and the right eye. FIG. 9 is a plan view when the subject is viewed with the left and right eyes. In FIG. 9, the same components as those in FIG. The direction seen by the right eye 604 and the direction seen by the left eye 605 are different and have parallax. 10 is an image viewed with the right eye 604, and FIG. 11 is an image viewed with the left eye 605. As can be seen from FIGS. 10 and 11, the image viewed with the right eye 604 and the left eye 605 includes a portion that is not included in the image data of FIG. 7. These invisible parts are called occlusion. Occlusion is an image that exists in an image viewed from one direction but does not exist in an image viewed from the other direction. Occlusions are black portions such as 1001 in FIG. 10 and 1101 in FIG. 11. This occlusion degrades the image quality.

  An object of the present invention is to solve the conventional problems, and to provide an image display device and an image display method for displaying a stereoscopic image without occlusion.

  The image display device and the image display method of the present invention use a plurality of images having parallax with each other, and cover at least one object image in the plurality of images to cover the occlusion due to the parallax of the object image. And a stereoscopic image is displayed using the plurality of images after the enlargement. Thus, it is possible to provide an image display device and an image display method for displaying a stereoscopic image without occlusion.

  According to the image display device and the image display method of the present invention, a high-quality stereoscopic image can be obtained by covering the occlusion.

  Viewed with right eye expanded in parallax direction   Figure viewed with left eye enlarged in parallax direction   Figure viewed with the right eye enlarged in a direction perpendicular to the parallax direction   Figure viewed with the left eye enlarged in the direction perpendicular to the parallax direction   Configuration of compound eye camera   Top view when shooting a subject with a compound eye camera   Subject image   Distance image of the subject   Top view when viewing subject with left and right eyes   Diagram showing occlusion viewed with the right eye   Diagram showing occlusion viewed with the left eye

Embodiments of the present invention will be described below with reference to the accompanying drawings.
FIG. 1 is an enlarged view of a snowman image so as to cover the occlusion 1001 of FIG. 10 viewed with the right eye, and FIG. 2 covers the occlusion 1101 of FIG. 11 viewed with the left eye. It is the figure which expanded the image of the snowman. These FIG. 1 and FIG. 2 are images having parallax, and a stereoscopic image can be recognized by seeing these images with the right eye and the left eye.

  Although the above-described enlargement method is arbitrary, an easy enlargement method is to enlarge in the direction of parallax, and FIGS. 1 and 2 are examples thereof. Therefore, the snowman is enlarged only in the horizontal direction and is a little uncomfortable. Therefore, if the figures enlarged in the direction of parallax as shown in FIGS. 1 and 2 are further enlarged in the vertical direction, that is, in the direction orthogonal to the parallax, the distance is slightly longer, but the overall discomfort is reduced. Examples thereof are shown in FIGS.

  If the enlargement ratio orthogonal to the parallax direction is too large, the sense of incongruity increases. Therefore, it is preferable to make the enlargement ratio in the parallax direction larger than the enlargement ratio orthogonal to the parallax direction.

  An example is shown in which a stereoscopic image is created using a subject image and a subject distance image. However, when creating a stereoscopic image, occlusion often occurs regardless of the creation method, and the image display apparatus and the image display method of the present invention are also effective in these cases.

  The embodiments disclosed above are merely examples of the present invention, and the present invention is not construed as being limited by these embodiments. The scope of the present invention is defined by the terms of the claims, rather than the embodiments described above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  The field of application of the image display device and the image evaluation method of the present invention is not particularly limited, but a high-quality stereoscopic image can be obtained, which is useful for stereoscopic television, stereoscopic movies, stereoscopic photographs, and the like.

501 Single lens 502 Single lens 503 Single lens 504 Single lens 505 Imaging region 506 Imaging region 507 Imaging region 508 Imaging region 601 Hut 602 Snowman 603 Compound eye camera 604 Right eye 605 Left eye 1001 Occlusion 1101 Occlusion

Claims (8)

  Using a plurality of images having parallax with each other, enlarging at least one object image in the plurality of images so as to cover the occlusion due to the parallax of the object image, and the plurality of images after the enlargement An image display device that displays a stereoscopic image by using the.   The image display device according to claim 1, wherein the enlargement is performed in a direction of the parallax.   The image display apparatus according to claim 2, wherein the plurality of enlarged images are enlarged in a direction perpendicular to the direction of the parallax.   The image display device according to claim 3, wherein an enlargement ratio in the parallax direction is larger than an enlargement ratio in a direction perpendicular to the parallax direction.   Using a plurality of images having parallax with each other, enlarging at least one object image in the plurality of images so as to cover the occlusion due to the parallax of the object image, and the plurality of images after the enlargement Display method for displaying a three-dimensional image using an image.   The image display method according to claim 5, wherein the enlargement is performed in the direction of the parallax.   The image display method according to claim 6, wherein the plurality of enlarged images are enlarged in a direction perpendicular to the direction of the parallax.   The image display method according to claim 7, wherein an enlargement ratio in the parallax direction is larger than an enlargement ratio in a direction perpendicular to the parallax direction.

Images