CN106817511A - A kind of image compensation method for tracking mode auto-stereoscopic display - Google Patents

Abstract

The invention provides an image compensation method for a tracking autostereoscopic display. The main technical solution is to realize the change of the best viewpoint position through the movement of pixels in the tracking autostereoscopic display, so as to reduce or even eliminate crosstalk. The image compensation method of the present invention provides six pixel arrangement modes of stereoscopic parallax images for different positions of the user in front of the stereoscopic display. The specific implementation method includes: the index search module pre-stores the arrangement patterns suitable for users in different viewing positions, and the dynamic adjustment module searches the index search module for the corresponding arrangement pattern according to the user position transmitted by the eye tracking module, and adjusts to the arrangement pattern. The remarkable beneficial effect of the present invention is to realize continuous optimal stereoscopic visual experience in autostereoscopic display.

Description

An Image Compensation Method for Tracking Autostereoscopic Display

technical field

The invention relates to a tracking autostereoscopic display, in particular to an image compensation method for the tracking autostereoscopic display, and belongs to the technical field of information display.

Background technique

Stereoscopic display technology research has undergone long-term development and has achieved fruitful results, such as 3D stereoscopic glasses, helmet-mounted displays, etc., which are widely used now, but their shortcomings are also obvious. Users need to wear glasses with lenses such as color filters or polarizers. It is inconvenient for users who already wear myopia glasses.

Then the autostereoscopic display technology came into being. At present, the more mature autostereoscopic display technology is the parallax barrier type. Its advantage is that multiple users can watch the stereoscopic images with naked eyes in a large range at the same time. Its disadvantage is that its best viewpoint is A series of fixed points are not continuous. When the position of the user's eyes moves out of the best viewpoint, the stereoscopic image viewed will have serious crosstalk, and even the left and right eye views will be reversed.

Therefore, in recent years, a tracking autostereoscopic display method for a single user has been developed to address the above problems. On the basis of the traditional parallax barrier autostereoscopic, a human eye spatial position coordinate capture module is added. When the viewing point is out of view, the display will change some units accordingly to compensate the image with crosstalk viewed by the user, thereby reducing the crosstalk and allowing the user to watch the stereoscopic image more freely. As shown in Figure 1, when the user 1 is in front of the grating type autostereoscopic display 2 to watch the stereoscopic image, the camera 3 will collect the user's facial image in real time, and transmit the user's facial information to the human eye tracking module 4 through the video transmission line, and then the module The extracted human eye position information will be sent to the dynamic adjustment module. The dynamic adjustment module 5 uses dynamic adjustment technology according to the human eye position information to make the current viewpoint of the display move according to the human eye position, thereby reducing the crosstalk of the stereoscopic image viewed by the user. , to achieve the purpose of improving the stereoscopic image display effect.

Contents of the invention

The object of the present invention is to compensate the image with crosstalk seen by the user using the dynamic adjustment technology according to the position information of the human eyes for the dynamic adjustment module 5 mentioned in the background technology. The present invention proposes a tracking autostereoscopic Display image compensation method.

The technical solution of the present invention is: in the tracking type autostereoscopic display, the change of the best viewpoint position is realized through the movement of pixels, so as to reduce or even eliminate the crosstalk during the user's moving process.

According to one aspect of the present invention, a kind of image compensation method for tracking type autostereoscopic display is provided, comprising the following steps:

The dynamic adjustment module processes the stereoscopic parallax images according to the spatial position information of the user obtained by the human eye tracking module, and adjusts the stereoscopic parallax images in different modes according to different positions of the user.

According to a preferred embodiment of the present invention, the step of processing the stereoscopic parallax images by the dynamic adjustment module includes readjusting the periodic arrangement of pixels of the left and right stereoscopic parallax images.

According to a preferred embodiment of the present invention, an index search module is also included, which is used to store the corresponding relationship between the user spatial position information and the periodic arrangement of pixels of the left and right stereoscopic parallax images.

According to a preferred embodiment of the present invention, the dynamic adjustment module adjusts the stereoscopic parallax image according to the corresponding relationship of the periodic arrangement of pixels of the left and right stereoscopic parallax images corresponding to the current user spatial position information searched in the index search module.

According to a preferred embodiment of the present invention, the adjustment of the stereoscopic parallax image by the dynamic adjustment module may be realized by a hardware circuit or by a software circuit.

Compared with the prior art, the method provided by the present invention compares the user's spatial position information with the information stored in the index search module to find out the arrangement of stereoscopic parallax images suitable for the user at the current location, and then adjust the stereoscopic parallax through the dynamic adjustment module The image is arranged in such a way that a suitable parallax image is projected to a space position suitable for the user. This method enables the user to obtain a continuous optimal stereoscopic visual experience at different viewing positions.

Description of drawings

Readers will have a clearer understanding of various aspects of the present invention after reading the detailed description of the present invention with reference to the accompanying drawings.

Wherein, FIG. 1 shows a schematic diagram of an overall realization of a tracking autostereoscopic display.

FIG. 2 is a schematic diagram of six modes of stereoscopic image compensation methods in the dynamic adjustment module shown in FIG. 1 .

FIG. 3 is a schematic diagram of mode 1 of the six modes of the image compensation method shown in FIG. 2 .

FIG. 4 is a schematic diagram of mode 2 of the six modes of the image compensation method shown in FIG. 2 .

FIG. 5 is a schematic diagram of mode 3 of the six modes of the image compensation method shown in FIG. 2 .

FIG. 6 is a schematic diagram of mode 4 of the six modes of the image compensation method shown in FIG. 2 .

FIG. 7 is a schematic diagram of mode 5 of the six modes of the image compensation method shown in FIG. 2 .

FIG. 8 is a schematic diagram of mode 6 of the six modes of the image compensation method shown in FIG. 2 .

detailed description

In order to make the technical content disclosed in this application more detailed and complete, please refer to the accompanying drawings and the following specific implementation examples of the present invention. However, those skilled in the art should understand that the implementation examples provided below are not intended to limit the scope of the present invention.

As shown in FIG. 1 , FIG. 1 is a schematic diagram of an overall realization of a tracking autostereoscopic display. When the user 1 is located in front of the grating type autostereoscopic display 2 to watch the stereoscopic image, the camera 3 will collect the user's facial image in real time, and transmit the user's facial information to the human eye tracking module 4 through the video transmission line, and then the human eye position extracted by the module The information will be sent to the dynamic adjustment module 5. The dynamic adjustment module uses dynamic adjustment technology according to the position information of the human eyes to make the position of the current viewpoint of the display move according to the position of the human eyes, thereby reducing the crosstalk of the stereoscopic image viewed by the user and improving the display of the stereoscopic image. purpose of the effect.

Wherein dynamic adjustment module 5 is the implementation carrier of the present invention, can be realized by hardware circuit, such as based on FPGA field programmable gate array video image signal data is adjusted in real time; It can also be realized by software programming, such as based on OpenCV open source computer vision library The video image signal data is adjusted in real time.

Further, please refer to FIG. 2 , which is a schematic diagram of six modes of stereoscopic image compensation methods in the dynamic adjustment module shown in FIG. 1 . In the figure, PI (Pupil Interval) represents the interpupillary distance between the user's left eye and right eye (usually 65mm), and WS (Window Size) represents the distance between two adjacent image frames in space. In the figure, L is a pixel of the left viewpoint, and R is a pixel of the right viewpoint. The image pixels of the two viewpoints are arranged according to the rules shown in Fig. 2 . Taking mode 1 as an example, the periodic arrangement of stereoscopic parallax images is as follows:

Taking the resolution of the stereoscopic parallax image as 1920*1080, and the resolutions of the left and right viewpoint images as 1920*1080 as an example, then the 0, 1, 3, 4, ..., 1917, 1918 columns of the stereoscopic parallax image (a total of 1280 columns) pixel values correspond to the 0, 1, 3, 4, ..., 1917, 1918 columns (a total of 1280 columns) from the left view image, and the 2, 5, ..., The pixel values of the 1919 columns (640 columns in total) correspond one-to-one to the 2nd, 5th, ..., 1919th columns (640 columns in total) of the right view image respectively.

At this time, the user's left eye is located in the left-viewpoint image frame interval, and the right eye is located in the right-viewpoint image frame interval, so the user can watch a good stereoscopic effect. When the user moves to the right at a distance of WS/2, both eyes can only see the image from the left viewpoint, which is a flat image. When the user continues to move to the right for a distance of WS/2, the left eye sees the right viewpoint image, and the right eye sees the left viewpoint image. At this time, the views of the left and right eyes are reversed, which will produce false stereoscopic vision. Therefore, when the dynamic adjustment module 5 in FIG. 1 detects that the user position information transmitted by the eye tracking module 4 has moved, it will adjust the pixel arrangement of the stereoscopic parallax image, so as to realize the change of the best viewpoint position. Fig. 2 lists the pixel arrangement patterns of six stereoscopic parallax images corresponding to the continuous rightward movement of the user's position. The six modes are described below.

Please refer to FIG. 3 . FIG. 3 is a schematic diagram of mode 1 of the six modes of the image compensation method shown in FIG. 2 . The role of the slit grating is to realize the spatial separation of left and right viewpoint images. At this time, the regularity of the pixel arrangement period is LLR. A good three-dimensional effect can be seen even when the user moves within a spatial distance of WS/4 in both left and right directions. Note that the nine "WS/2" horizontal scales at the bottom of Figure 3 keep their relative positions fixed in Figures 3-8. When the user moves to the right for a distance of WS/2, both eyes see images from the left viewpoint. Therefore, at this time, it is necessary to adjust the left-viewpoint image seen by the right eye to the right-viewpoint image. That is, at this time, the regularity of the pixel arrangement cycle needs to be switched from LLR to RLR.

Please refer to FIG. 4 . FIG. 4 is a schematic diagram of mode 2 of the six modes of the image compensation method shown in FIG. 2 . At this time, the regularity of the pixel arrangement period is RLR. A good three-dimensional effect can be seen even when the user moves within a spatial distance of WS/4 in both left and right directions. When the user moves to the right for a distance of WS/2, both eyes see images from the right viewpoint. Therefore, at this time, it is necessary to adjust the right viewpoint image seen by the left eye to the left viewpoint image. That is, at this time, the regularity of the pixel arrangement period needs to be switched from RLR to RLL.

Please refer to FIG. 5 . FIG. 5 is a schematic diagram of mode 3 of the six modes of the image compensation method shown in FIG. 2 . At this time, the regularity of the pixel arrangement period is RLL. A good three-dimensional effect can be seen even when the user moves within a spatial distance of WS/4 in both left and right directions. When the user moves to the right for a distance of WS/2, both eyes see images from the left viewpoint. Therefore, at this time, it is necessary to adjust the left-viewpoint image seen by the right eye to the right-viewpoint image. That is, at this time, the pixel arrangement cycle rule needs to be switched from RLL to RRL.

Please refer to FIG. 6 . FIG. 6 is a schematic diagram of mode 4 of the six modes of the image compensation method shown in FIG. 2 . At this time, the regularity of the pixel arrangement cycle is RRL. A good three-dimensional effect can be seen even when the user moves within a spatial distance of WS/4 in both left and right directions. When the user moves to the right for a distance of WS/2, both eyes see images from the right viewpoint. Therefore, at this time, it is necessary to adjust the right viewpoint image seen by the left eye to the left viewpoint image. That is, at this time, the regularity of the pixel arrangement cycle needs to be switched from RRL to LRL.

Please refer to FIG. 7 . FIG. 7 is a schematic diagram of mode 5 of the six modes of the image compensation method shown in FIG. 2 . At this time, the regularity of the pixel arrangement cycle is LRL. A good three-dimensional effect can be seen even when the user moves within a spatial distance of WS/4 in both left and right directions. When the user moves to the right for a distance of WS/2, both eyes see images from the left viewpoint. Therefore, at this time, it is necessary to adjust the left-viewpoint image seen by the right eye to the right-viewpoint image. That is to say, at this time, the regularity of the pixel arrangement cycle needs to be switched from LRL to LRR.

Please refer to FIG. 8 . FIG. 8 is a schematic diagram of mode 8 of the six modes of the image compensation method shown in FIG. 2 . At this time, the regularity of pixel arrangement cycle is LRR. A good three-dimensional effect can be seen even when the user moves within a spatial distance of WS/4 in both left and right directions. When the user moves to the right for a distance of WS/2, both eyes see images from the right viewpoint. Therefore, at this time, it is necessary to adjust the right viewpoint image seen by the left eye to the left viewpoint image. That is, at this time, the regularity of the pixel arrangement cycle needs to be switched from LRR to LLR.

Through the above-mentioned analysis and design, according to different positions of the user, a continuous optimal stereoscopic visual experience can be realized by adjusting the pixel arrangement of the stereoscopic parallax image.

Furthermore, the user's actual viewing position suitable for different pixel arrangement methods of stereoscopic parallax images may be determined in advance through experiments. The actual viewing position of the user here can be characterized as the coordinate value of the user's eye position in the frame image collected by the camera. And store such information in the index lookup module 6 . For example, it can be in the form of a corresponding table, and the corresponding pixel arrangement of the stereoscopic parallax image corresponding to the viewing position of the user can be found by searching the corresponding table through the index search module 6, so as to adjust to this arrangement through the dynamic adjustment module 5. So that users get continuous optimal stereoscopic visual experience.

Although the present invention has been disclosed above with preferred embodiments, it is not intended to limit the present invention. Those skilled in the art of the present invention may make various changes and modifications without departing from the scope of the spirit of the present invention. Therefore, the scope of protection of the present invention should be defined by the claims.

Claims (7)

1. a kind of image compensation method for tracking mode auto-stereoscopic display, it is characterised in that the image compensation method bag Include following steps：

Obtain the spatial positional information of user；

User's space positional information according to obtaining is processed stereopsis difference image；

Stereoscopic parallax image after display processing, so that the user of current location sees stereo-picture.

2. the image compensation method for tracking mode auto-stereoscopic display according to claim 1, it is characterised in that institute Stating the step of processing stereopsis difference image includes adjusting left and right stereoscopic parallax image pixel periodic arrangement again Entire row is arranged.

3. the image compensation method for tracking mode auto-stereoscopic display according to claim 2, it is characterised in that institute State left and right stereoscopic parallax image pixel periodic arrangement and have 6 kinds of patterns, respectively LLR, RLR, RLL, RRL, LRL, LRR, its Middle L is left view pixel, and R is right view pixel.

4. the image compensation method for tracking mode auto-stereoscopic display according to claim 2, it is characterised in that also Correspondence including the user's space positional information to prestoring and left and right stereoscopic parallax image pixel periodic arrangement mode is closed The step of system contrasts.

5. the image compensation method for tracking mode auto-stereoscopic display according to claim 2, it is characterised in that institute Stating is carried out readjusting arrangement, and its method of adjustment can be realized by hardware circuit, it is also possible to realized by software programming.

6. the image compensation method for tracking mode auto-stereoscopic display according to claim 5, it is characterised in that institute State hardware circuit and realize it being that real-time adjustment is carried out to video signal data based on FPGA field programmable gate arrays.

7. the image compensation method for tracking mode auto-stereoscopic display according to claim 5, it is characterised in that institute State software programming and realize it being that real-time adjustment is carried out to video signal data based on OpenCV computer vision storehouses of increasing income.