TWI444661B - Display device and control method of display device - Google Patents

Description

Display device and control method thereof

The present invention relates to a display device capable of viewing a video and a control method of the display device.

In general, it is necessary to view a stereoscopic video system by two video pairs for one of the right eye and one for the left eye. In the method of presenting a stereoscopic image, for example, a method of using polarized glasses or a method of using a parallax barrier or a lenticular lens without using glasses is proposed. In the former method, a view image (or an aberration image) is seen using glasses based on mutually different polarization states between the right eye and the left eye. In the latter method, a parallax barrier or a lenticular lens is used to direct a specified view image of a plurality of view images to a viewer. The stereoscopic display device using one of the parallax barriers is configured such that the video formed by the light having passed through the aperture (transmission unit) of the parallax barrier is a different view image for the right eye and the left eye.

Although the stereoscopic display device has an advantage in that a stereoscopic viewing system is possible without using special glasses, it has the following problems. As mentioned above, the view images (views 1, 2, 3, 4, 1, 2, 3, 4, ... in Fig. 1) are periodically arranged in pixels on a liquid crystal display. For this reason, an anti-stereoscopic region appears at the boundary of the respective period or at the boundary of the four video data periods (view 4 and view 1). In the anti-stereoscopic region, one view video to be entered into the right eye is directed to the left eye, and one view video to be entered into the left eye is directed to the right eye. In the anti-stereoscopic region, an anti-stereoscopic phenomenon occurs. That is, a viewer perceives a stereoscopic video image that is flipped in front and behind or an unnatural mixture of the front and back of the stereoscopic video image. This phenomenon gives the viewer an unnatural feeling.

Attempts have been made to eliminate as much as possible a viewer's discomfort against the anti-stereo (for example, refer to JP 2000-47139A). In the method of JP 2000-47139A, detecting a position of a viewer, and changing a pattern shape of one of the mask patterns corresponding to one of the optical modulators of the parallax barrier based on the position information, thereby reducing the viewer's opposite The three-dimensional is not comfortable.

However, in the method of JP 2000-47139 A, a device such as a high-precision detecting device and a high-precision optical modulator is necessary. Therefore, this method is very expensive in terms of maintenance and cost. Furthermore, in principle, anti-stereoscopic effects occur in the autostereoscopic display. Therefore, it is difficult to completely solve the problem caused by the anti-stereo. Therefore, one of the practical solutions to this problem is to minimize the discomfort of the anti-stereoscopic without using special devices. In addition, when one of the stereoscopic video discrepancies is large in a positive stereoscopic region and an anti-stereoscopic region, a viewer may suffer from fatigue accumulation depending on the stereoscopic advancement level from a display surface. Fatigue is quite different between women and men, between children and adults, or similar situations.

In view of the foregoing, it is desirable to provide a display device and a stereoscopic display device control method which are novel and improved, and which can reduce fatigue and discomfort by aberration adjustment when viewing a stereoscopic video.

According to an embodiment of the present invention, a display device includes: a display unit that periodically configures and displays a plurality of images; and a light separation unit that is disposed in front of and separated from a pixel plane of the display unit Light and the display unit, the display device comprises: an aberration extraction unit that extracts aberration distribution information between the view images; a parameter calculation unit that calculates a displacement amount based on the aberration distribution information; a displacement processing unit, Performing a displacement process on at least one of the view images based on the calculated displacement amount; and a mapping processing unit reconfiguring the at least one shifted processed view image on the display unit.

The parameter calculation unit may calculate, as the displacement amount, an average value of the aberrations of the respective pixels included in one of the screens of the display unit based on the aberration distribution information.

The parameter calculation unit may calculate an aberration value based on the aberration distribution information as a displacement amount, and the number of pixels of the image that is perceived to be located in front of the display unit is substantially equal to the image that is perceived to be behind the display unit. The number of pixels.

The parameter calculation unit may calculate a value obtained by weighting the calculated displacement amount according to an area of an object in the view image as a displacement amount.

The display device may further include: a detecting unit that detects position information of the observer based on facial recognition of an observer; the parameter calculating unit calculates the displacement amount based on the aberration distribution information and the position information of the observer.

When it is determined that the at least one observer is located in an anti-stereoscopic region, the parameter calculation unit may calculate the displacement amount from the detected position information of the observer.

The display device may further include: a detecting unit that detects attribute information of the observer based on facial recognition of an observer; the parameter calculating unit calculates the displacement amount based on the aberration distribution information and the attribute information of the observer.

The parameter calculation unit may determine a phase of a virtual view image to be generated based on the calculated displacement amount.

When the calculated displacement amount is equal to or greater than a predetermined value, the parameter calculation unit may determine the phase to be generated of the virtual view image, such that one image for the right eye is interpolated in the shifted view image by interpolation The virtual view image is generated between one of the images for the left eye.

The parameter calculation unit may determine the phase to be generated of a virtual view image based on the position information of the observer.

According to another embodiment of the present invention, a display device includes: a light source; a display unit that periodically configures and displays a plurality of view images; and a light splitting unit disposed on the display unit and the display unit Separating the light source from the light source, the display device comprises: an aberration extraction unit that extracts aberration distribution information between the image views; and a parameter calculation unit that calculates a displacement amount based on the extracted aberration distribution information a displacement processing unit that performs displacement processing on at least one of the view images based on the calculated displacement amount; and a mapping processing unit that reconfigures the shifted view image.

According to another embodiment of the present invention, a display device includes: a display unit that periodically configures and displays a plurality of view images; and a detecting unit that detects position information of an observer; a calculation unit that calculates a displacement amount based on the position information; and a displacement processing unit that performs displacement processing on at least one of the view images based on the calculated displacement amount.

According to another embodiment of the present invention, there is provided a display unit that periodically configures and displays a plurality of view images, a detecting unit that detects attribute information of an observer, and a parameter calculating unit that is based on the The attribute information calculates a displacement amount; and a displacement processing unit that performs displacement processing on at least one of the view images based on the calculated displacement amount.

According to another embodiment of the present invention, there is provided a control method for a display device, the display device comprising: a display unit configured to periodically display and display a plurality of images; and a light separating unit disposed in the display unit a pixel plane front and separate the light from the display unit, the control method includes: extracting aberration distribution information between the image views; calculating a displacement amount based on the aberration distribution information; and calculating the displacement image based on the calculated displacement amount Performing at least one of the displacement processing; and reconfiguring the displaced processed view image on the display unit.

As described above, according to an embodiment of the present invention, fatigue or discomfort caused by viewing a video can be alleviated by aberration adjustment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It is to be noted that the same reference numerals are used to refer to the structural elements of the substantially the same function and structure, and the repeated description of the structural elements is omitted.

Embodiments of the invention will be described in the following order:

<First Embodiment> [Schematic Structure of Stereoscopic Display Device] (anti-stereo) (aberration) [Functional structure of stereoscopic display device] [Operation of Stereoscopic Display Device] (overall operation) (operation of parameter calculation unit) <Second embodiment> [Functional structure of stereoscopic display device] [Operation of Stereoscopic Display Device] (operation of parameter calculation unit)

A stereoscopic display device according to the first embodiment and the second embodiment will be described below. The following description is based on the assumption that the stereoscopic display device according to each embodiment is an autostereoscopic display device. A feature of a plurality of view images of a stereoscopic video displayed on the autostereoscopic display device is analyzed, and displacement processing is performed on the image views based on the features, thereby reducing fatigue and discomfort during stereoscopic viewing. The autostereoscopic display device in each embodiment to be described below includes: a display unit that periodically configures and displays a plurality of view images; and a light splitting unit that separates the light from the display unit. When the display unit is a self-light-emitting panel, it is not necessary to have a light source. When the display unit requires a liquid crystal panel or the like of a light source, the optical separation unit may be located between the light source and the liquid crystal panel.

<First Embodiment> [Schematic Structure of Stereoscopic Display Device]

First, a schematic structure of one of the stereoscopic display devices according to the first embodiment of the present invention will be described with reference to FIG. 1 is a top plan view of a stereoscopic display device using a parallax barrier. 1 is a diagram showing pixels in a horizontal direction of a liquid crystal display of an autostereoscopic display device 100 on the page of FIG. 1. In Figure 1 In the case where one of the display units 100a has four viewpoints, the four view images are vertically divided on the page of FIG. 1 and periodically arranged in respective pixel positions of the display unit 100a. Light from a light source (not shown) is supplied to the display unit 100a, and one of the apertures has a parallax barrier 110 placed in front of the display unit 100a such that the view images 1 to 4 are spatially separated from each other. With this configuration, one image for the right eye and one image for the left eye can be seen by the right eye and the left eye, respectively. Note that replacing the parallax barrier 110 with a lenticular lens also allows for separate video for the right eye and the left eye without glasses. A mechanism that separates light from the display unit 100a, such as the parallax barrier or the lenticular lens, is also referred to as a light separation unit.

In this case, the parallax barrier 110 has the same period as the image. If a view video for the left eye is directed to the left eye and a view video for the right eye is directed to the right eye in a correct manner, a correct stereoscopic image can be seen. Referring to Figure 1, since one view 2 enters the left eye and one view 3 enters the right eye, a correct video can be seen.

(anti-stereo)

As described above, the autostereoscopic display device has an advantage in that it can be stereoscopically viewed without the need for special glasses. However, as described above, since a plurality of view images are periodically arranged in respective pixels of the stereoscopic display 100a, there is an anti-stereoscopic region at the boundary between the periods, and one of the right eyes is entered in the anti-stereoscopic region. The view video is directed to the left eye and into the left eye one view video is directed to the right eye. For example, since the view images are periodically arranged like 1, 2, 3, 4, 1, 2, 3, 4, ... in FIG. 1, the boundaries of the four video data periods (view 4 and view 1) Acting as the anti-stereoscopic region (where one view of the right eye is directed to the left eye and one of the left eye views is directed to the right eye). In the anti-stereoscopic region, an anti-stereoscopic phenomenon occurs. That is, a viewer perceives a stereoscopic video image that is front and back flipped or looks unnaturally mixed. This phenomenon gives the viewer an unnatural feeling and discomfort.

[aberration]

The relationship between a stereoscopic video and an aberration will be described using FIG. As described above, a light separation unit composed of an aberration element such as a parallax barrier or a lenticular lens is used to guide one view image for the right eye and one view image for the left eye to the right eye and the left eye, respectively. . In this embodiment, the parallax barrier 110 is placed in front of one of the pixel planes of the display unit 100a of the stereoscopic display device 100. Since the viewer sees a video through the parallax barrier 100, in the positive stereo region, only one image of the right eye enters the right eye, and only one image of the left eye enters the left eye. A video seen by the right eye in this way is different from a video system seen by the left eye. A video displayed on the display unit 100a is thereby stereoscopic.

Referring to FIG. 2, a view image that is directed to the left eye at a particular time t is indicated by a point A, while a view image that is directed to the right eye at that particular time t is indicated by a point B. Furthermore, at another time t' is directed to the left eye one of the view images is indicated by a point A', while at the other time t' is directed to the right eye one of the view images is indicated by a point B'. One of the differences (Xb-Xa) from the coordinate Xa of the point A to the coordinate Xb of the point B on the X-axis is one of the aberrations d at time t. A difference (Xb'-Xa') from the coordinate Xa' of the point A' to the coordinate Xb' of the point B' on the x-axis is one of the aberrations d' at the time t'.

The larger the aberration d (or d'), the more an image appears to lag behind an actual display surface or the image appears to be ahead of the actual display surface. The aberration d has a symbol, and the image appears to be located in front of or behind the actual display surface based on the difference in the symbol. When scanning is performed from left to right on the X-axis as shown on the page of FIG. 2, the aberration d (=Xb-Xa) at time t has a positive sign. In this case, one of the images obtained by this scan appears to lag behind the display surface. On the other hand, the aberration d' (= Xb' - Xa') at time t' has a minus sign. In this case, one of the images obtained by this scan appears to be ahead of the display surface. Thus, by adjusting the aberration to reconstruct a state of a stereoscopic image in a direction perpendicular to one of the display surfaces, it is possible to change the angle at which a stereoscopic image appears to be ahead or behind the display surface.

Particularly in the anti-stereoscopic region, an anti-stereoscopic phenomenon occurs in which the viewer perceives a stereoscopic image, the front surface of which is inverted or appears to be unnaturally mixed. This anti-stereo gives the viewer an unnatural feeling and discomfort. This inverse stereoscopic effect occurs in principle in an autostereoscopic display device. Therefore, it is difficult to completely solve the problem caused by the anti-stereo. Thus, this embodiment proposes a method in which the discomfort caused by the inverse stereo is reduced by adjusting the aberration to change the angle at which a stereoscopic image appears to be ahead or behind the actual display surface. A specific function and a specific operation of the stereoscopic display device 100 according to this embodiment will be described in detail.

A video signal can represent a stereoscopic image (consisting of two view images) or N view images of not less than two view images. Or, one can be seen as a screen. In the following description, for the sake of brief description, it is assumed that an input signal represents a stereoscopic image (two view images).

[Functional structure of stereoscopic display device]

One of the functional configurations of the stereoscopic display device according to this embodiment will be described with reference to a functional block diagram of FIG. The stereoscopic display device 100 in this embodiment includes an aberration extraction unit 120, a position and distance detection unit 130, a parameter calculation unit 140, a displacement processing unit 150, a virtual view image generation unit 160, and a mapping process. Unit 170.

The aberration extraction unit 120 performs a matching point search between a plurality of view images periodically arranged in respective pixels of the display unit 100a, detects one aberration d of each pixel included in a screen, and generates an inter-view Aberration distribution information. A block matching method, a DP matching method or the like can be pointed out as a method of detecting the aberration d. However, the method of detecting the aberration d is not limited to the above-mentioned method. Any of the known aberration detection methods can be utilized. For example, the aberration d can be extracted using the DP matching method disclosed in Japanese Patent No. 4069885. As described above using FIG. 2, when the coordinates of the left image of a stereoscopic image are used as a reference, one of the aberrations between the pixels that are perceived to be in front of the display surface is negative, and is perceived to be behind the display surface. One of the aberration symbols between pixels is positive.

The position and distance detecting unit 130 uses a camera 200 to detect whether a viewer is located in a positive solid area. The camera 200 is placed at a position such as an upper portion of the autostereoscopic display 100a where the viewer's face can be easily detected. Note that although two or more cameras are generally required for distance measurement, it is possible to acquire distance information using only one camera by using object recognition technology.

The position and distance detecting unit 130 detects a viewer's face (executing face recognition) from the image data captured by the camera 200, and pre-checks an average face size on an image associated with a visual distance, and will be relative to The average face size of the visual distance is recorded in a database 210 or a memory (not shown). Comparing the size of the detected viewer's face with the data in the database 210 or the memory to read the distance data corresponding to the detected viewer's face. The position information of the viewer and the distance information from the display unit 100a to the viewer can be obtained. Since the mounting position of the camera 200 is fixed, the relative position information of the viewer relative to the display unit 100a can also be obtained from the position coordinate information of the viewer's face on the image. The database 210 or the memory may be included in the stereoscopic display device 100 or may be held outside the stereoscopic display device 100.

In the case of the stereoscopic display device 100 of this embodiment, the positions of the anti-stereoscopic region and the stereoscopic region are known in advance. Therefore, it is possible to detect whether the viewer is located in the positive stereo region based on the information of the detected position of the viewer. The larger the number of viewpoints or the angle of view of one of the viewpoints, the larger the area of the positive stereo region. Therefore, highly accurate viewer position detection is not necessary.

Based on the aberration distribution information between the views generated by the aberration extraction unit 120 and the viewer position information detected by the position and distance detecting unit 130, the parameter calculation unit 140 outputs a displacement amount parameter and a generated phase. . The parameter calculation unit 140 may calculate the displacement amount based on the aberration distribution information between the views generated by the aberration extraction unit 120 and may determine the phase of the generation of a virtual view image based on the position information of the viewer.

For example, when the viewer is located in the anti-stereoscopic region, the parameter calculation unit 140 may calculate an average value of the aberration values of the respective pixels included in the screen of the display unit 100a as the displacement based on the aberration distribution information. the amount. Alternatively, the parameter calculation unit 140 may calculate an aberration value based on the aberration distribution histogram as the displacement amount, and the area of the image (the number of pixels) located in front of and behind the display unit 100a is perceived by the aberration value. Generally equal.

The degree of discomfort caused by the inverse stereo depends on the magnitude of the aberration and the area of each object within the image. In the case where an object is substantially advanced in the display unit 100a by the perception, when the object has a small area, the discomfort caused by the reverse stereo is small. On the other hand, in the case where an object is perceived to be slightly ahead of the display unit 100a, when the object has a large area, the discomfort caused by the reverse stereo can be very large. Therefore, using a displacement amount obtained by adding the area of the object to an aberration value, an adjustment can be made to reduce the absolute value of the aberration value when the area of the object is added. That is, the parameter calculation unit 140 may obtain one value obtained by weighting the calculated displacement amount according to the area of the object in the view images as one displacement amount for the displacement processing. As mentioned above, by considering the area of an object, the discomfort and fatigue of a viewer caused by the inverse stereo can be further reduced.

On the other hand, in this embodiment, when the viewer is in the positive stereoscopic region, the viewer has no discomfort caused by the reverse stereo. Therefore, in principle, a zero displacement is output. However, if there is an aberration distribution, the average of the aberration distributions is sometimes zero. In this case, when it is detected based on the position information of the viewer that the viewer is in the anti-stereoscopic region, a generated phase interval is reduced, so that one of the image values of the virtual view video to be generated is reduced. Thereby reducing the discomfort caused by the reverse stereo.

When there are a plurality of viewers, it can be determined whether at least one of the viewers is located in the inverse stereo region. The discomfort caused by the inverse stereo can be reduced by the same method as mentioned above.

Based on the amount of displacement calculated by the parameter calculation unit 140, the displacement processing unit 150 reconstructs and outputs a plurality of view images and an aberration map. Each of the new view images is created only by adding an offset value corresponding to one of the displacement amounts to the coordinates of the original image. Therefore, the absolute value d of the aberration i can be controlled by one of the dynamic ranges of the maintained aberration distribution. Furthermore, it is not necessary to obtain a new aberration map (or an aberration ii distribution). Since the calculation can be performed using a previously calculated aberration map, it is not necessary to perform the aberration extraction again.

An overview of one of the displacement processes will be shown in Figures 4A and 4B. 4A shows one of the displacement amount systems 10, and FIG. 4B shows one of the displacement amount systems-10. In the displacement processing, the entirety of each view image is moved in the horizontal direction based on the displacement amount obtained by the parameter calculation unit 140. Displacement processing is also performed on the aberration map in a similar manner. The magnitude of the aberration data is corrected based on the displacement amount.

Specifically, when an object is perceived to be in front of the display surface, one of the left image (L image) of the object moves to the right side, and one of the right image (R image) of the object moves to the left side, thereby moving the object The whole image. When the displacement amount is 10 in Fig. 4A, for example, the displacement amount is positive. Thus, the image is produced by moving the left image to the right by 5 pixels and the right image to the left by -5 pixels, such that the object that is perceived to be behind the display surface is perceived to be in front of the display surface. The magnitude of the aberration data D'(y, x) based on the left image is obtained by adding -10 to the immediately preceding aberration data D(y, x).

Conversely, when the object is perceived to be behind the display surface, one of the left image (L image) of the object moves to the left side, and one of the right image (R image) of the object moves to the right side, thereby moving the image of the object The whole. When the displacement amount is -10 in Fig. 4B, for example, the displacement amount is negative. Thus, an image is produced by moving the left image to the left by 5 pixels and the right image to the right by -5 pixels, such that the object perceived to be in front of the display surface is perceived to be behind the display surface. The magnitude of the aberration data D'(y, x) based on the left image is obtained by adding +10 to the immediately preceding aberration data D(y, x).

A black band is produced at one end of the image during the displacement process. Therefore, when the amount of displacement is extremely large, the processing procedure can be carried out using a preset value.

The virtual view image generating unit 160 generates a virtual view image using the view images and an aberration distribution information obtained by the displacement process. When an input image is a stereo image (consisting of two view images) and the number of viewpoints of the display unit 100a is 4, the two view images are shortened. A schematic diagram of one of the phases produced by the camera for generating one of two virtual view images from the stereoscopic image in this case will be shown in Figures 5A and 5B.

In the case of the interpolation shown in FIG. 5A, when the position of the left image in the input image is set to 0 and the position of the right image in the input image is set to 1, the phase generated is 1/3. The virtual view images are generated at positions of 2/3 to obtain equal aberration distribution between the four views. Similarly, in the case of the extrapolation shown in FIG. 5B, when the position of the left image in the input image is set to 0 and the position of the right image in the input image is set to 1, the phase is generated according to A virtual view image is generated at the positions of -1 and 2 to obtain an equal aberration distribution between the four views. Although there is no limitation on the method of generating a virtual view image, the method described in Japanese Patent No. 4069885 can be utilized.

The mapping processing unit 170 reconfigures the data of the view image generated on the display unit 100a according to the barrier period and the resolution of the stereoscopic display device 100. For example, in the case of the display unit 100a shown in FIG. 1, when the resolution of the display unit 100a is the same as the resolution of each view image and when the number of viewpoints is 4, the resolution of each viewpoint is It is 1/4 in the horizontal direction.

[Operation of Stereoscopic Display Device] (overall operation)

Next, the overall operation of one of the stereoscopic display devices according to this embodiment will be described below with reference to one of the processing flows shown in FIG. Referring to Fig. 6, when the processing procedure is started, the aberration extracting unit 120 extracts the aberration distribution (aberration) between the view images for the right eye and the left eye (S605).

Then, the position and distance calculation unit 130 detects the position of a viewer photographed by the camera 200 (S610). Then, based on the aberration distribution information and the position information of the viewer, the parameter calculation unit 140 determines a displacement amount (S615). Then, the displacement processing unit 150 reconstructs the view image and the aberration map based on the displacement amount and outputs the reconstructed view image and the aberration map (S620: Displacement Processing).

Then, using the view images and the aberration distribution information obtained by the displacement processing, the virtual view image generation unit 160 generates a virtual view image (S625). Next, the mapping processing unit 170 reconfigures the data on the generated view image according to the barrier period and the resolution of the stereoscopic display device 100 (S630), thereby completing the processing procedure.

(operation of parameter calculation unit)

Now, one of the specific processing programs executed by the parameter calculation unit 140 in S615 will be described with reference to one of the processing flows in FIG. When the processing routine in Fig. 7 is started, the parameter calculation unit 140 performs displacement initialization as parameter initialization, and sets a generated phase based on the image of the content.

Then, the parameter calculation unit 140 obtains one of the content (image) aberration histograms (S710). Next, the parameter calculation unit 140 obtains one of the dynamic range DR of the aberration distribution or one of the minimum value min and a maximum value max of the aberration distribution (refer to FIGS. 4A and 4B) to determine the target for the target Whether the displayed content has an aberration (S715). Then, the parameter calculation unit 140 determines whether the dynamic range DR is 0 (S720). When the dynamic range DR is 0, the target content does not have aberrations. Therefore, the processing is terminated immediately.

On the other hand, when the dynamic range DR is not 0, the parameter calculation unit 140 determines that the target content has an aberration and thus an anti-stereoscopic can occur. The operation then proceeds to S725. Here, it is determined whether or not the target content has an aberration based on whether or not the dynamic range DR is 0. However, when the dynamic range DR is not less than a predetermined threshold, it may be determined that the target content has an aberration, and when the dynamic range DR is less than the predetermined threshold, it may be determined that the target content does not have an aberration.

It is known in advance which position relative to the position of the stereoscopic display device belongs to the inverse stereoscopic region. Therefore, the parameter calculation unit 140 can determine whether the viewer is located in the anti-stereoscopic region freely from the face position of the viewer detected by the camera 200. When it is determined that no viewer is located in the inverse stereo region, it means that all viewers view the image in the positive stereo region. Therefore, it is determined that it is not necessary to implement this processing procedure, so that the processing procedure is immediately ended.

On the other hand, when it is determined that an even number of viewers are located in the inverse stereoscopic region, the parameter calculation unit 140 determines the displacement amount (S730). As an example, one of the aberration cumulative frequencies having about half of the aberrations can be judged as the amount of displacement. The parameter calculation unit 140 can determine the average value of the distribution aberrations as the displacement amount. Alternatively, the parameter calculation unit 140 determines a displacement amount in which the target image is perceived to be equal in area (the number of pixels) in front of and behind the display unit 100a as the displacement amount.

Then, it is determined whether or not the displacement amount is 0 (S735). When it is determined that the displacement amount is not 0, the processing routine is immediately ended without limiting the phase of the generation of a virtual view image. When the displacement amount is 0, the parameter calculation unit 140 limits the phase of the generation of the virtual view image such that the virtual view image is generated by interpolation (0.0 to 1.0). Then, end this process. This restriction is imposed for the following reasons. That is, when the phase of the virtual view image is determined such that the virtual view image is generated by the extrapolation shown in FIG. 5B, the virtual view image is generated outside the input view image. Therefore, the deviation of the image is increased more. Therefore, the discomfort of the image can be increased. On the other hand, when the phase of the virtual view image is determined such that the virtual view image is generated by the interpolation shown in FIG. 5A, the virtual view image is generated inside the input view image. Therefore, the deviation of the image is reduced more, so that the discomfort to the image is reduced. Therefore, when the displacement amount is 0, the phase of the virtual view image is limited such that the virtual view image is generated by interpolation, thereby reducing discomfort to the image. When the phase of the generation of the virtual view image is determined based on the calculated displacement amount, the parameter calculation unit 140 makes a determination based on whether or not the displacement amount in S735 is 0. The configuration may also be such that when the amount of displacement is equal to or greater than a predetermined value, the phase of the virtual view image is determined such that the virtual view image is generated between the inputs L and R by interpolation.

As described above, according to the embodiment, based on the calculated aberration information, an image is generated in which the image is adjusted (by displacement processing) to appear as an absolute value of the displacement amount in front of and behind the display unit 100a. , to maintain the dynamic range of the aberration between views. The absolute value of the aberration value of an original view image is subtracted from the absolute value of the aberration value of each view image generated by the displacement processing. Therefore, the discomfort of the anti-stereoscopic region can be reduced more than in the original view image.

The phase generated in the virtual view image generation is controlled based on the aberration information of the view image and the viewer position information. Therefore, it is possible to provide a stereoscopic image in which the discomfort caused by the reverse stereoscopic is reduced.

<Second embodiment>

In the first embodiment, a displacement amount is adjusted only when at least one viewer is located in the anti-stereoscopic region, thereby reducing the discomfort to the opposite stereo. In contrast, in the second embodiment, even when a viewer is located in the positive stereoscopic region or a plurality of viewers are located in both the anti-stereoscopic region and the positive stereoscopic region, adjusting a displacement amount reduces the viewer Fatigue. Particularly in this embodiment, an aberration is adjusted in consideration of a fatigue accumulation of a viewer when an aberration value is increased and a large individual difference between a male and a female, an adult and a child, or the like. Then, a stereoscopic image is reconstructed based on the adjustment of the aberration. A stereoscopic display device according to this embodiment will be described in detail.

[Functional structure of stereoscopic display device]

The functional configuration of one of the stereoscopic display devices 100 according to this embodiment is substantially the same as the functional configuration of the stereoscopic display device 100 according to the first embodiment. Therefore, a basic description will be omitted. The database 210 in this embodiment holds attribute information. Before viewing a stereoscopic video, the position and distance detecting unit 130 records a viewer's attribute information in the database 210 according to an instruction of a remote controller based on a remote controller or the like. Specifically, the position and distance detecting unit 130 causes the viewer to move to a position where the camera 200 can capture the viewer's image, and performs face recognition through the operation of the viewer's remote controller, and correlates the face recognition. One of the results and the viewer's identification information and aberration information are used for the records in the database 210. As an example, the viewer can supply the viewer's name and one of the aberration information settings through the operation of the remote controller or the like. Priority is also recorded when a plurality of viewers are recorded.

For example, assume that the faces of three people (they are a father, a mother, and a child) have been identified as the result of facial recognition. In this case, the location and distance detecting unit 130 is associated with the identification information of the father's face and the father's name, the aberration information (above the allowed level of an aberration), and the priority are stored in the data. Library 210. An example of the viewer's name, aberration information, and priority attribute information of the viewer. Similarly, the property information of the mother and the child is also stored in the database 210.

When viewing a stereoscopic video, the position and distance detecting unit 130 detects the attribute information of the viewer by recognizing a viewer's face. The parameter calculation unit 140 determines a displacement amount based on the aberration distribution information and the attribute information. When determining the displacement amount, the position and distance detecting unit 130 should obtain the attribute information by face recognition, and does not need the position information of the viewer.

[Operation of Stereoscopic Display Device]

The overall operation of one of the stereoscopic display devices according to this embodiment is the same as the overall operation of the stereoscopic display device of the first embodiment shown in FIG. Therefore, the description of the overall operation will be omitted, and only one operation of the parameter calculation unit 140 will be described with reference to one of the processing flows in FIG.

(operation of parameter calculation unit)

The processing in S705 to S720 is the same as the processing in the first embodiment. That is, the parameter calculation unit 140 performs displacement initialization and sets a generated phase (S705), obtains an aberration histogram of the content (S710), obtains one dynamic range of an aberration distribution (S715), and determines whether the dynamic range DR is It is 0 (S720). When the dynamic range DR is 0, the content used for display by the target does not have aberrations. Then, end this process immediately.

On the other hand, when the dynamic range DR is not 0, the parameter calculation unit 140 determines a displacement amount based on the aberration distribution information and the attribute information (S805). For example, when the priority of the child is the highest among the attribute information detected from the database 210 with respect to the faces of the father, the mother, and the child, the parameter calculation unit 140 is based on the aberration information associated with the child and The aberration distribution determines the amount of displacement.

The processing in S735 to S740 is the same as the processing in the first embodiment. That is, when the displacement amount is 0, the parameter calculation unit 140 limits the phase of generation of a virtual view image so that the virtual view image is generated by interpolation (0.0 to 1.0), thereby ending the processing procedure. When the displacement is not 0, the processing is terminated immediately.

As described above, according to this embodiment, the adjustment is made based on the attribute information. In this way, in this embodiment, aberration adjustment is made based on one of the highest priority persons in order to reduce the fatigue of the person with the highest priority. With this configuration, taking into account a viewer's priority can reduce the viewer's fatigue. However, the attribute information for aberration adjustment is not necessarily limited to the priority, and the aberration can be adjusted using one of the attribute information.

According to the first and second embodiments, there is provided a stereoscopic image from which the discomfort caused by the anti-stereoscopic and the fatigue which can be observed in the positive stereoscopic region when viewing the stereoscopic image are subtracted from the stereoscopic image.

One of each unit of the functional block according to each embodiment is executed by a dedicated control device or a CPU (not shown). A program for implementing each of the processes described above is pre-stored in ROM or non-volatile memory (both not shown), and the CPU reads and executes each program from the memory, thereby The function of each unit of the stereoscopic display device is implemented.

In the embodiments described above, the operations of the respective units are related to each other and the correlation with each other can be replaced with a series of operations. Thereby, an embodiment of the stereoscopic display device can be converted into an embodiment of a control method of the stereoscopic display device.

It will be appreciated by those skilled in the art that various modifications, combinations, sub-combinations and changes can be made depending on the design requirements and other factors, as long as they are within the scope of the accompanying claims and their equivalents.

Although the position of a viewer or the distance from the display unit to the viewer is calculated using the image processing in the above embodiment, the present invention is not limited to this method. As an example, infrared ray or the like can be used to obtain location information and distance information. Any method can be used as long as the distance from the display plane to the viewer can be obtained.

Further, in the above-mentioned embodiment, although the lenticular lens or the parallax barrier control is guided to one view video of the right eye and guided to one view video of the left eye, any other mechanism may be used as long as the naked eye is available Watch a stereo video.

It should be noted that in this specification, the steps shown in the flowcharts include not only the processing performed in the time series order described therein, but also the processing performed in parallel or separately without necessarily processing in time series. Furthermore, depending on the circumstances, the steps of the sequential order processing may be performed in a different sequence as appropriate.

The present application contains the subject matter related to the subject matter disclosed in Japanese Priority Patent Application No. JP2010-143866, filed on Jun.

100. . . Autostereoscopic display device

100a. . . Display unit / stereo display

110. . . Parallax barrier

120. . . Aberration extraction unit

130. . . Position and distance detection unit

140. . . Parameter calculation unit

150. . . Displacement processing unit

160. . . Virtual view image generation unit

170. . . Mapping processing unit

200. . . camera

210. . . database

1 is a schematic structural view showing one of stereoscopic display devices using a parallax barrier according to first and second embodiments of the present invention;

2 is a conceptual diagram for explaining the relationship between an aberration value and a stereoscopic image;

3 is a functional configuration diagram of a stereoscopic display device according to the first and second embodiments;

4A is a diagram for explaining displacement processing according to the first and second embodiments (moving an image such that the image appears to be located in front of a display surface);

4B is a diagram for explaining the displacement processing according to the first and second embodiments (moving an image such that the image appears to be behind the display surface);

5A is a diagram for explaining one of phases generated by one of virtual view image generation according to the first and second embodiments (by interpolation);

Figure 5B is a diagram for explaining one of the phases generated by one of the virtual view image generations (by extrapolation) according to the first and second embodiments;

6 is a view showing one of processing flows of a stereoscopic display device according to the first and second embodiments;

7 is a diagram showing a process flow of one of the parameter calculation units according to the first embodiment; and

Fig. 8 is a view showing a flow of processing of one of the parameter calculation units according to the second embodiment.

100. . . Autostereoscopic display device

100a. . . Display unit

120. . . Display extraction unit

130. . . Position and distance detection unit

140. . . Parameter calculation unit

150. . . Displacement processing unit

160. . . Virtual view image generation unit

170. . . Mapping processing unit

200. . . camera

210. . . database

Claims (25)

A display device comprising: a display unit configured to periodically display and display a plurality of images; and a light separating unit disposed in front of a pixel plane of the display unit and separating light from the display unit, the display device The method includes: an aberration extraction unit configured to extract the aberration distribution information between the view images; a parameter calculation unit configured to calculate a displacement amount based on the aberration distribution information; a displacement processing unit Configuring to perform displacement processing on at least one of the view images based on the calculated amount of displacement; and a mapping processing unit configured to reconfigure the shifted processed view image on the display unit, wherein the parameter The calculation unit calculates, as the displacement amount, an average value of the aberrations of the respective pixels included in one of the screens of the display unit based on the aberration distribution information. The display device of claim 1, wherein the parameter calculation unit obtains one of the values obtained by weighting the amount of displacement based on an area of an object in the view image as the amount of displacement. The display device of claim 1, further comprising: a detecting unit configured to detect position information of the observer based on facial recognition of an observer; the parameter calculating unit configured to be based on The aberration distribution information and The position information of the observer calculates the displacement amount. The display device of claim 3, wherein when it is determined that the at least one observer is located in an anti-stereoscopic region, the parameter calculation unit calculates the displacement amount from the detected position information of the observer. The display device of claim 1, further comprising: a detecting unit configured to detect attribute information of the observer based on facial recognition of an observer; the parameter calculating unit configured to be based on the The aberration distribution information and the attribute information of the observer calculate the displacement amount. The display device of claim 1, wherein the parameter calculation unit determines a phase to be generated of one of the virtual view images based on the calculated displacement amount. The display device of claim 6, wherein when the calculated displacement amount is equal to or greater than a predetermined value, the parameter calculation unit determines the phase to be generated of the virtual view image such that the interpolated view image is interpolated The virtual view image is generated between one of the images of the right eye and one of the images for the left eye. The display device of claim 7, wherein the parameter calculation unit determines the phase to be generated of a virtual view image based on position information of one of the observers. A display device includes: a display unit that periodically configures and displays a plurality of images; and a light separation unit that is disposed in front of one of the pixel planes of the display unit and separates the light from the display unit, the display The apparatus includes: an aberration extraction unit configured to extract aberration distribution information between view images; a parameter calculation unit configured to calculate a displacement amount based on the aberration distribution information; a displacement processing unit, Configuring to perform displacement processing on at least one of the view images based on the calculated amount of displacement; and a mapping processing unit configured to reconfigure the shifted processed view image on the display unit, wherein the The parameter calculation unit is configured to calculate an aberration value based on the aberration distribution information, and the amount of pixels by which the image is located in front of the display unit is substantially equal to the perceived presence in the display The number of pixels in the image behind the unit. A display device comprising: a light source; a display unit configured to periodically display and display a plurality of view images; and a light splitting unit disposed between the display unit and the light source and separating the light from the light source, The display device includes: an aberration extraction unit configured to extract aberration distribution information between the image views; a parameter calculation unit configured to calculate a displacement amount based on the extracted aberration distribution information; a displacement processing unit configured to perform displacement processing on at least one of the view images based on the calculated amount of displacement; and a mapping processing unit configured to reconfigure the shifted processing The view image, wherein the parameter calculation unit calculates an average value of the aberrations of the respective pixels included in one of the display units based on the aberration distribution information as the displacement amount. The display device of claim 10, wherein the parameter calculation unit obtains one of the values obtained by weighting the calculated displacement amount based on an area of an object in the view image as the displacement amount. The display device of claim 10, further comprising: a detecting unit configured to detect position information of the one of the observers based on an observer's facial recognition; the parameter calculating unit configured to be based on The aberration distribution information and the position information of the observer calculate the displacement amount. The display device of claim 12, wherein when it is determined that the at least one observer is located in an anti-stereoscopic region, the parameter calculation unit calculates the displacement amount from the detected position information of the observer. The display device of claim 10, further comprising: a detecting unit configured to detect attribute information of the observer based on facial recognition of an observer; the parameter calculating unit configured to be based on the The aberration distribution information and the attribute information of the observer calculate the displacement amount. The display device of claim 10, wherein the parameter calculation unit determines a virtual view image based on the calculated displacement amount Like one of the phases to be generated. The display device of claim 15, wherein when the calculated displacement amount is equal to or greater than a predetermined value, the parameter calculation unit determines the phase to be generated of the virtual view image so as to be interpolated in the shifted view image by interpolation The virtual view image is generated between one of the images of the right eye and one of the images for the left eye. The display device of claim 16, wherein the parameter calculation unit determines the phase to be generated of a virtual view image based on position information of one of the observers. A display device includes: a display unit configured to periodically configure and display a plurality of view images; a detection unit configured to detect an observer position information; a parameter calculation unit, It is configured to calculate a displacement amount based on the position information; and a displacement processing unit configured to perform displacement processing on at least one of the view images based on the calculated displacement amount, wherein the parameter calculation unit is based on the The aberration distribution information calculates an average value of the aberrations of the respective pixels included in one of the display units as the displacement amount. The display device of claim 18, wherein the parameter calculation unit determines a phase to be generated of one of the virtual view images based on the calculated displacement amount. The display device of claim 19, wherein When the calculated displacement amount is equal to or greater than a predetermined value, the parameter calculation unit determines the phase to be generated of the virtual view image, such that one image for the right eye is interpolated by the displacement processed view image The virtual view image is generated between one of the images of the left eye. The display device of claim 20, wherein the parameter calculation unit determines the phase to be generated of a virtual view image based on position information of one of the observers. A display device includes: a display unit configured to periodically configure and display a plurality of view images; a detecting unit configured to detect an attribute information of an observer; a parameter calculating unit, It is configured to calculate a displacement amount based on the attribute information; and a displacement processing unit configured to perform displacement processing on at least one of the view images based on the calculated displacement amount, wherein the parameter calculation unit is based on the The aberration distribution information calculates an average value of the aberrations of the respective pixels included in one of the display units as the displacement amount. The display device of claim 22, wherein when the calculated displacement amount is equal to or greater than a predetermined value, the parameter calculation unit determines the phase to be generated of the virtual view image such that the interpolated view image is interpolated The virtual view image is generated between one of the images of the right eye and one of the images for the left eye. The display device of claim 23, wherein the parameter calculation unit is based on the view One of the viewers' position information determines the phase to be generated of a virtual view image. A control device for controlling a display device, the display device comprising: a display unit configured to periodically display and display a plurality of images; and a light separating unit disposed in front of a pixel plane of the display unit and illuminating the display unit Separately, the control method includes: extracting aberration distribution information between the image views; calculating a displacement amount based on the aberration distribution information; performing displacement processing on at least one of the image views based on the calculated displacement amount; The displacement processed view image on the display unit is configured, wherein the parameter calculation unit calculates an average value of the aberrations of the respective pixels included in one of the display units as the displacement amount based on the aberration distribution information.