JP2011035590A - Multiscreen image display device - Google Patents

Abstract

Kind Code: A1 In a multi-screen video display device, various videos with different shooting conditions are displayed so that they can be observed with good quality with high immersive feeling and immersive feeling. Display so that quality can be observed.
Whether to adjust an angle between video display units during observation by comparing information indicating a camera shooting angle during video shooting with information indicating a display screen angle between a plurality of video display units. And determining the determination result to the user.
[Selection] Figure 2

Description

  The present invention relates to a video display device, and more particularly, to a video display device with a high sense of presence and immersiveness that can obtain a wide viewing angle video.

  A so-called large screen display and large screen projector are examples of video display devices that enhance the sense of reality. The display size of the video is closely related to the psychological effect when viewing the video, and when viewing the video at a predetermined distance from the screen or screen, as the screen size increases, that is, as the angle of view increases, It has the property of improving evaluation. Accordingly, the enlargement of the screen of the video display device is an important element for improving the sense of reality as well as the high definition of the video display.

  In order to increase the screen size of the video display device, a liquid crystal display panel or a plasma display panel itself is enlarged, a projector that projects a large screen on a large screen, a plurality of relatively small display panels, screens, and projectors. There is a type that increases the total screen size by connecting or linking multiple or multiple units. This multi-screen type can be said to be effective as one of the methods for increasing the screen size of the video display device in consideration of the manufacturing cost of the device including the panel and the ease of installation and transportation.

  As such a multi-screen type display device, there is a wide viewing angle display device disclosed in Patent Document 1. This is based on a configuration in which a left side screen and a right side screen are arranged so as to be continuous on both the left and right sides of the front screen, and a lower surface screen is arranged on the lower side of the front screen. Output. At this time, by arranging the screens so as to form a predetermined angle, it is possible to obtain a wide viewing angle when viewing the video.

  Further, in the above document, in order to obtain an optimal image on the screen having the predetermined angle, the angle formed between the cameras for each screen is set to match the angle between the screens when shooting a live-action image. A live-action video recording system is also disclosed.

Japanese Patent Laid-Open No. 10-233982

  However, when shooting a live-action video, the camera placement angle depends on the video range that you want to shoot, the video range that you can shoot, such as whether the image is landscape-oriented or human-centered, or the angle of view of the camera. Therefore, it is not always appropriate to determine the camera arrangement angle in accordance with the display device. If the camera angle at the time of shooting and the screen angle at the time of observation are not consistent, the positional relationship between the viewpoint (camera) and the subject at the time of shooting, the viewpoint (observer's eyes) at the time of observation and the position of the subject Since a difference occurs in the relationship, the observed image is distorted or uncomfortable. This point will be described below with reference to FIGS.

  For example, three cameras with a shooting angle of view of 60 ° are used, and as shown in FIG. 6, the cameras 601 and 602 and the adjacent cameras 602 and 603 are arranged at the shooting viewpoint P0 so that the angles formed by the shooting directions are 60 °. Assume that images for the left side / front side / right side are respectively captured. The overall shooting angle of view by the three cameras is 180 °. It is assumed that the six subjects 604a to 604f to be photographed are at equal positions from the point P0. When the image shot in this way is observed from a point P1 which is the front position of each screen, using a three-sided screen with a screen angle of 120 ° formed by the display surface as shown in FIG. 7 according to the shooting angle. The relative positional / angular relationship with each subject is similar to that at the time of shooting, and as a result, an optimal image without distortion is obtained that reproduces the arrangement at the time of shooting over the entire image.

  Next, a case is assumed where the same image is observed on a three-plane screen having a screen angle of 135 ° formed by the display surface as shown in FIG. This screen configuration is the same as that disclosed in Patent Document 1. In this case, since the angle between the screens is different from that in FIG. 7, the relationship between the position and the angle of each displayed subject and the time of shooting is broken. That is, the arrangement of each subject cannot be reproduced as it was taken, and even if it can be observed without a sense of incongruity in units of screens, it causes distortion when viewed as a whole image and causes a sense of incongruity.

  Further, regarding the viewing angle of view, the configuration of FIG. 7 is 180 degrees, which is the same as that at the time of shooting, but the configuration of FIG. 8 is narrowed to 135 degrees, so there is a demerit that the realism and power of the entire image is reduced. Arise. In consideration of this, as shown in FIG. 9, a method of matching the angle of view with the time of shooting by changing the observation position while having the same screen configuration as in FIG. 8 can be considered, but in this case, the arrangement of each subject is shot. The point that cannot be reproduced on time is the same as in FIG. 8, and in addition, since the observation angle with respect to the left and right screens changes, there is a possibility that the distortion of the entire image and the feeling of discomfort may be further increased.

  In the above description, for the sake of simplicity, the case of monocular video shooting, that is, an example in which there is one camera for each screen is described, but the same applies to the case of stereoscopic video shooting. A problem peculiar to stereoscopic images is caused. Hereinafter, this point will be described. In the case of stereoscopic video shooting, two cameras are arranged in parallel for each screen, and a set of two videos having binocular parallax is shot with a set of two cameras. In such a case, the position / angle relationship between the viewpoint and the subject reflects the intention of the video producer for the stereoscopic video, and directly affects the quality of the stereoscopic video at the time of observation.

  That is, as shown in FIG. 7, if the observation position P1 and the position / angle relationship of each subject are similar to those at the time of shooting, a good image reproducing the stereoscopic effect of each subject can be obtained. As shown above, when the above-mentioned positional / angular relationship breaks down, the observed stereoscopic video has a quality as a stereoscopic video in which an area that should be seen cannot be seen or an area that should not be seen can be seen. It ’s bad, and it ’s a video with a strong sense of discomfort.

  In the above description, the configuration of the display device in which three screens are arranged in the horizontal direction has been described. However, the same problem occurs in a configuration in which screens are arranged in the vertical direction. For example, consider a two-sided display device in which a lower screen is arranged so as to be continuous with the lower side of the front screen, and the lower screen has an angle in the front direction with respect to the display surface of the front screen. In this case, a pair of cameras for the front screen and the bottom screen are used to shoot images, but when the angle between the cameras and the angle between the screens are different, the observed image is different from the subject at the time of shooting. The positional / angular relationship cannot be reproduced, resulting in image distortion, inconsistency in the stereoscopic effect, and a sense of incongruity associated therewith.

  As described above, when the camera layout at the time of video shooting differs from the screen layout at the time of observation, the positional relationship between the viewpoint (camera) and the subject at the time of shooting, the viewpoint (observer's eyes) at the time of observation and the position of the subject Since a difference occurs in the relationship, the observed image is distorted or uncomfortable. In particular, when photographing and observing a stereoscopic image having binocular parallax, the influence is strong enough to reduce the quality of the stereoscopic image itself. As the difference between the camera angle at the time of photographing and the screen angle at the time of observation becomes larger, the influence on the quality of the observed image becomes larger.

  An object of the present invention is to solve the above problems. In other words, in a multi-screen video display device, various images with different shooting conditions are displayed so that they can be observed with good quality with a high sense of presence and immersive feeling, particularly with respect to images shot as stereoscopic images. It is intended to be displayed so that it can be observed.

In order to solve the above problems, the multi-screen video display device of the present invention comprises the following means.
(1) A multi-screen video display device comprising a plurality of video display means, wherein the angle formed by the display surface between the video display means is variable,
Data separation means for separating multiplexed data including video information into encoded video data and attached information about the video;
Video decoding means for decoding the encoded video data and generating displayable video data;
Shooting condition extraction means for extracting shooting conditions including the shooting angle of the camera at the time of video shooting from the attached information;
Video output means for outputting the decoded video data corresponding to the plurality of video display means;
Display condition detection means for detecting an angle formed by each display surface between the plurality of video display means;
An adjustment determination unit that determines whether adjustment is necessary and an amount of adjustment necessary for an angle formed by each display surface between the plurality of video display units, based on the shooting conditions and the display conditions;
Adjustment state output means for outputting information indicating whether the adjustment is necessary or necessary adjustment amount;
Is provided.

  (2) The plurality of video display means includes a first video display means, a second video display means arranged continuously or adjacent to the left side surface of the first video display means, and a first video display. And third image display means arranged continuously or adjacent to the right side surface of the means.

  (3) The plurality of video display means includes first video display means and second video display means arranged continuously or adjacent to the lower surface of the first video display means. Is.

(4) The plurality of video display means are configured to display a stereoscopic video having binocular parallax.
(5) As another configuration, a multi-screen video display device comprising a plurality of video display means, wherein an angle formed between display surfaces between the video display means is variable,
Data separation means for separating multiplexed data including video information into encoded video data and attached information about the video;
Video decoding means for decoding the encoded video data and generating displayable video data;
Shooting condition extraction means for extracting shooting conditions including the shooting angle of the camera at the time of video shooting from the attached information;
Video output means for outputting the decoded video data corresponding to the plurality of video display means;
Display condition detection means for detecting an angle formed by each display surface between the plurality of video display means;
An adjustment determination unit that determines whether adjustment is necessary and an amount of adjustment necessary for an angle formed by each display surface between the plurality of video display units, based on the shooting conditions and the display conditions;
Display condition adjusting means for adjusting the angle formed by each display surface between the video display means according to the necessary adjustment amount;
Is provided.

  With the multi-screen video display device of the present invention, various videos with different camera arrangements at the time of shooting can be viewed under optimal viewing conditions. In particular, when viewing a stereoscopic image, it is possible to obtain a high-definition image that does not impair the stereoscopic effect intended by the video producer, and the sense of presence and immersion.

It is a general-view figure which shows the apparatus structure of the 1st Embodiment of this invention. It is a block diagram which shows the function structure of the 1st Embodiment of this invention. It is a figure which shows the example of a display of the status display part in the 1st Embodiment of this invention. It is a general-view figure which shows the apparatus structure of the 2nd Embodiment of this invention. It is a block diagram which shows the function structure of the 4th Embodiment of this invention. It is a conceptual diagram which shows an example of the imaging | photography conditions of the image | video by a several camera. It is a conceptual diagram which shows an example (example consistent with imaging | photography conditions) of the observation conditions of the image | video by multiple screens. It is a conceptual diagram which shows an example (example which does not correspond with imaging | photography conditions) of the observation conditions of the image | video by multiple screens. It is a conceptual diagram which shows an example (example which does not correspond with imaging | photography conditions) of the observation conditions of the image | video by multiple screens.

Hereinafter, the best mode for carrying out the present invention will be described in detail with reference to the drawings.
Example 1
FIG. 1 shows an overview of an embodiment of the multi-screen video display device of the present invention.
FIG. 1A is a view of the apparatus as viewed from the ceiling, and FIG. 1B is a view of the apparatus as viewed from the front and slightly obliquely above. As shown in the figure, the multi-screen video display device is arranged so that the screens 101a to 101c are adjacent to each other in the left-right direction in order, and the adjacent screens are fixed to be variable in angle by hinge portions 102a and 102b. As indicated by the arrows, the movable ranges are 0 degrees to 90 degrees with respect to each of the angles θ1 and θ2 of the screens 101a and 101c with respect to the central screen 101b. The angle between the screens is detected by an angle sensor installed around the hinge portion or behind each screen. In addition, as illustrated in FIG. 1B, the display portion 103 is different from the screen.

  Next, FIG. 2 is a block diagram showing a functional configuration of the multi-screen video display device. As illustrated, the multi-screen video display device of the present invention includes a data separation unit 201, a video decoding unit 202, a video condition extraction unit 203, a video output unit 204, video display units 205a to 205c, a display condition detection unit 206, and display adjustment. A determination unit 207 and a status display unit 208 are included. Hereinafter, the operation of each component will be described.

  First, multiplexed data including photographed video information is recorded or transmitted and input to the multi-screen video display device via a storage medium or a communication line. The data separator 201 receives this multiplexed data and separates it into encoded video data and attached information. The encoded video data is transmitted to the video decoding unit 202, and the attached information is transmitted to the shooting condition extraction unit 203. The video decoding unit 202 decodes the encoded video data according to a corresponding decoding method, and outputs the decoded video data to the video output unit 204 as displayable video data. This video data includes a plurality of videos taken by a plurality of cameras at the time of video shooting. The video output unit 204 distributes and outputs the plurality of videos to the corresponding video display units 205a to 205c. The video display units 205a to 205c correspond to the screens 101a to 101c in the example of FIG.

  The video display units 205a to 205c each display the input video. On the other hand, the shooting condition extraction unit 203 extracts shooting conditions including the camera arrangement angle at the time of shooting from the attached information, and outputs them to the display adjustment determination unit 207. In addition, the display condition detection unit 206 detects each screen angle between the video display units 205a and 205b and between 205b and 205c, and outputs the screen angle to the display adjustment determination unit 207 as a display condition. The display adjustment determination unit 207 determines whether or not the video display units 205 a to 205 c need to be adjusted and the amount of adjustment from the input shooting conditions and display conditions, and outputs the determination result to the state display unit 208. The status display unit 208 displays the input determination result as visible information using characters, graphics, or the like. The status display unit 208 corresponds to the display unit 103 in the example of FIG.

Here, the operations of the display condition detection unit 206 and the display adjustment determination unit 207 will be described in detail. In FIG. 1, the display condition detection unit detects an angle θ1 between the screens 101a and 101b and an angle θ2 between the screens 101b and 101c with an angle sensor, and outputs them to the display adjustment determination unit 207. The angle θ (θ1, θ2) between the screens detected by the angle sensor is an angle having a relationship of θ = 180−θ ′, where θ ′ is an angle formed by the display surface of the screen. Here, θ ′ indicates an angle on the minor angle side among the angles formed by the display surface. That is, it means an angle that rises to the near side from the arrangement surface of the front screen (screen 101b in the example of FIG. 1).
The display adjustment determination unit 207 compares the input θ1 and θ2 with the angles α1 and α2 between the imaging cameras separately input from the imaging condition extraction unit 203 (see FIG. 6), and calculates the difference as the necessary adjustment amount Δθ1. , Δθ2 is calculated. More specifically, the angles α1 and α2 between the photographing cameras indicate angles formed between the optical axes of the cameras. Here, when Δθ1 and Δθ2 are zero, it is determined that adjustment is not necessary, and when any value is present, it is determined that adjustment is necessary.

  The necessity of adjustment and the determination result of the necessary adjustment amount obtained in this way are displayed on the state display unit 208 after being made visible information as characters and symbols. FIG. 3 shows a display example of the status display unit. 3A and 3B, thick lines indicate the current screen angles, that is, positions corresponding to θ1 and θ2, and Δ marks indicate the angular positions of α1 and α2, which are adjustment targets. While confirming this display, the user adjusts the angle of each screen, and when both angles finally match, changes the color of the Δ mark to notify the user that the adjustment is complete. Although the screen angle adjusting means is not shown, it may be configured to manually move the screen directly, or may be configured to change the screen angle through electrical / mechanical control by a dial or a handle operation. In addition to changing the color of the △ mark, the means for notifying the user that adjustment has been completed changes the color of the entire screen, blinks the display content, lights an indicator lamp separately, or chimes. You may notify by sound signals, such as.

  Further, in the above example, the configuration including the state display unit 208 that displays the determination result of the display adjustment is shown, but the state display unit 208 may not be provided. In that case, the same information as in FIG. 3 may be displayed on the video display units 205a to 205c so as to be superimposed on the video. Alternatively, it may be displayed by an indicator using a light emitting device such as an LED instead of being displayed as an image. For example, the configuration may be such that three elements are used and each of the LEDs is lit or blinked when the necessary adjustment amount is positive / zero / negative. Alternatively, the visible information may not be displayed at all and may be notified by sound. For example, if the angle is too wide, it will sound “beep” if the angle is too narrow, and “peep” if the angle is no longer necessary. Good.

  In the above-described embodiment, the video ancillary information including the shooting conditions is separated from the multiplexed data by the data separation unit, but may be directly input to the shooting condition extraction unit 203. At this time, the camera angle at the time of shooting, which is the output of the shooting condition extraction unit 203, may be directly specified by the user, or an input unit for this purpose may be provided separately.

  Although the embodiment of the present invention has been described above, the image display unit of the present invention may be an image display system including a liquid crystal panel, a plasma panel, or the like, or an image display including a projector and a screen. It may be a system and does not depend on its display method or device configuration.

(Example 2)
Next, a second embodiment of the multi-screen video display device of the present invention will be described. The second embodiment is an example of a configuration including two video display units including three in the first embodiment. Other components are the same as those in the first embodiment, but the arrangement of the video display units is adjacent in the left-right direction in the first embodiment, whereas in the second embodiment, the arrangement is vertical (vertical direction). The biggest difference is that the configuration is adjacent to.

FIG. 4 shows an overview of the second embodiment of the multi-screen video display device of the present invention.
4A is a diagram of the device viewed from the side, and FIG. 4B is a diagram of the device viewed from the front and slightly obliquely above. As shown in the figure, the screens 401 a to 401 b are arranged so as to be adjacent to each other in the vertical direction, and the angle between the screens is fixed by a hinge portion 402. In the variable range, as indicated by the dotted arrow, the angle θ3 of the screen 401b with respect to the front screen 401a is 0 to 90 degrees. The angle between the screens is detected by an angle sensor installed around the hinge portion or behind each screen. Note that although not illustrated, a display portion equivalent to the display portion 103 illustrated in FIG. 1B may be provided.

With respect to the multi-screen video display device of the present embodiment, a block diagram showing a functional configuration and description of the operation are omitted. The configuration is basically the same as that shown in FIG. 2, and the difference is only the number and arrangement of the video display units as described above. That is, in this embodiment as well, as in the first embodiment, the screen angle adjustment necessity is determined based on the detection of the angle between the video display units and the separately input shooting conditions, and the determination result is obtained. Notify the user.
With the above configuration, as in the first embodiment, it is possible to match the shooting conditions and the display conditions, and it is possible to observe a video of good quality.

(Example 3)
Next, a third embodiment of the multi-screen video display device of the present invention will be described. The third embodiment is characterized in that each video display unit has a stereoscopic video display function having binocular parallax.

  In the case of providing a stereoscopic video display function, the multi-screen video display device of the present invention has a video decoding unit 202 having a function of decoding a set of video data having binocular parallax, and the video output unit 203 performs decoding. The video display units 205a to 205c have a function of outputting each of the video data to the corresponding video display units 205a to 205c, and the video display units 205a to 205c display the transmitted set of videos separately for the left-eye video and the right-eye video. It has a function to do. In the present invention, the stereoscopic image display method is not limited to a specific method, but a display method using a parallax barrier, a display method using a lenticular, a display method using an electronic shutter (glasses), a polarizing film (glasses). Any method can be applied as long as it is intended for a stereoscopic image having binocular parallax, such as a display method that uses the.

  The above description has been described with reference to the first embodiment, but the same applies to the second embodiment. In any case, when using an image display unit capable of stereoscopic display, as described above, the influence on the image quality is greater when the shooting conditions and the observation conditions are different. This makes it possible to display and observe a stereoscopic image of good quality.

Example 4
Next, a fourth embodiment of the multi-screen video display device of the present invention will be described. The fourth embodiment is characterized by comprising display condition adjusting means having a function of automatically adjusting the screen angle between the video display units.

FIG. 5 is a block diagram showing a functional configuration of the multi-screen video display apparatus according to the fourth embodiment. As shown in the figure, the multi-screen video display apparatus of the present invention has a state display unit 208 eliminated and a display condition adjustment unit 508 newly added as compared with the functional configuration of FIG.
Here, the operation of the display condition adjustment unit 508 will be described in detail with reference to FIG. 5 and FIG. 1 showing the device configuration of the first embodiment.

  The display condition adjustment unit 508 includes a rotary actuator and its control unit, and the actuator is installed in the hinges 102a and 102b shown in FIG. The control unit controls the rotary actuator while referring to the detection result of the angle sensor included in the display condition detection unit 508, and automatically adjusts the angle between the screens until the adjustment amount determined by the display adjustment determination unit 207 is reached. To be adjusted. By having such a configuration, the user can save time and effort to change the angle of the screen while confirming the necessity of adjustment and the amount of adjustment, and can easily match the shooting conditions with the observation conditions. It enables the user to observe the video.

In the above, four embodiment regarding this invention was described.
In the above description, an example in which the number of screens as the image display means is 3 to 2 has been shown. However, the number of screens is not limited to this, and the screen may be configured to exceed three. However, in addition to the configuration of only the vertical direction, the horizontal direction and the vertical direction may be mixed. In any case, between adjacent screens, there is a hinge portion that makes the screen angle variable and an angle sensor that detects the angle, and information indicating the detected angle and the inter-camera angle for each screen at the time of video shooting. And the multi-screen video display device of the present invention can be configured by providing means for determining the optimum screen angle.

  In addition, a status display unit 208 that outputs information indicating whether or not an adjustment is required regarding the angle formed by the display surface of the screen as the video display means, or a display that adjusts the angle formed by each display surface of the screen according to the necessary adjustment amount The condition adjustment unit 508 may be combined. In this case, by displaying the necessary adjustment amount, the user can know the necessary adjustment amount, and the user can obtain optimum video quality without having to manually adjust the angle of the screen.

101a to 101c ... Video display unit, 102a, 102b ... Hinge unit, 103 ... Status display unit, 201 ... Data separation unit, 202 ... Video decoding unit, 203 ... Shooting condition extraction unit, 204 ... Video output unit, 205a-205c ... Image display unit, 206 ... display condition detection unit, 207 ... display adjustment determination unit, 208 ... status display unit.

Claims (5)

In a multi-screen video display device comprising a plurality of video display means, and the angle formed by the display surface between the video display means is variable,
Data separation means for separating multiplexed data including video information into encoded video data and attached information about the video;
Video decoding means for decoding the encoded video data and generating displayable video data;
Shooting condition extraction means for extracting shooting conditions including the shooting angle of the camera at the time of video shooting from the attached information;
Video output means for outputting the decoded video data corresponding to the plurality of video display means;
Display condition detection means for detecting an angle formed by each display surface between the plurality of video display means;
An adjustment determination unit that determines whether adjustment is necessary and an amount of adjustment necessary for an angle formed by each display surface between the plurality of video display units, based on the shooting conditions and the display conditions;
A multi-screen video display device comprising: adjustment state output means for outputting information indicating whether or not adjustment is necessary or a necessary adjustment amount.   The plurality of video display means include a first video display means, a second video display means arranged continuously or adjacent to a left side surface of the first video display means, and a right side of the first video display means. The multi-screen image display device according to claim 1, further comprising third image display means arranged continuously or adjacent to the surface.   The plurality of video display means includes first video display means and second video display means arranged continuously or adjacent to the lower surface of the first video display means. The multi-screen video display device according to claim 1.   The multi-screen video display device according to claim 1, wherein the plurality of video display units are configured to display a stereoscopic video having binocular parallax. In a multi-screen video display device comprising a plurality of video display means, the angle formed by the display surface between the video display means is variable,
Data separation means for separating multiplexed data including video information into encoded video data and attached information about the video;
Video decoding means for decoding the encoded video data and generating displayable video data;
Shooting condition extraction means for extracting shooting conditions including the shooting angle of the camera at the time of video shooting from the attached information;
Video output means for outputting the decoded video data corresponding to the plurality of video display means;
Display condition detection means for detecting an angle formed by each display surface between the plurality of video display means;
An adjustment determination unit that determines whether adjustment is necessary and an amount of adjustment necessary for an angle formed by each display surface between the plurality of video display units, based on the shooting conditions and the display conditions;
A multi-screen video display device comprising: display condition adjusting means for adjusting an angle formed by each display surface between the video display means according to the necessary adjustment amount.

Images