TWI393430B - Pixel data transforming method and apparatus for 3d display - Google Patents

Description

Method and device for converting pixel data of stereo display

The present invention relates to a stereoscopic (3D) display, and more particularly to a pixel data conversion method and apparatus for a multi-view autostereoscopic display apparatus.

Stereoscopic (3D) TV is the main direction of future development of displays. 3D TVs include 3D displays and 3D movies. In terms of software, there are 3D movies to be acquired and played. When playing, it is necessary to combine the characteristics of 3D displays to make multi-view synthesis. At present, multiple perspectives include from two perspectives to nine perspectives. In the case where a naked-eye 3D display plays a 3D movie, there is a problem that the text image display is not good. If the subtitles are directly recorded on the film in the conventional way, the subtitle color may be incorrect or appear rainbow-like due to the parallax barrier or lenticular screen of the 3D display, or even use Someone can't see some of the thin lines in the text.

The invention provides a pixel data conversion method and device for a stereoscopic display, which can correctly display the text color on the stereoscopic display or prevent the subtitle from appearing like a rainbow phenomenon.

The embodiment of the invention provides a pixel data conversion method for a stereoscopic display, comprising: obtaining a color value of the first original pixel [a, b, c]; and replacing the first original pixel with the first pixel array. The first side of the first pixel array has three edge pixels whose color values are [a, b, c], [x, b, c], [x, x, c], respectively. A second side has three corresponding edge pixels, and the color values are [x, x, x], [a, x, x], [a, b, x], and the above x is a preset value. .

The embodiment of the invention provides a computer program product for pixel data conversion of a stereoscopic display. When the computer is loaded into the computer program and executed, the above pixel data conversion method can be completed.

The embodiment of the invention provides a stereoscopic video data processing device, which comprises a stereoscopic video processor, a word processor and a superposition unit. The stereoscopic video processor provides a stereoscopic video picture. The word processor converts the original text to extended text. The superimposing units are respectively coupled to the stereoscopic video processor and the word processor to superimpose the extended text on the stereoscopic video picture. The method for converting the original text of the aforementioned word processor includes the above pixel data conversion method.

Based on the above, the embodiment of the present invention replaces each pixel of the original text with a corresponding pixel array to solve the problem that the character display effect is poor on the naked-eye multi-view stereoscopic display. The embodiment of the present invention does not adopt the switching of 2D/3D, so the optical structure of the stereoscopic display is not required to be changed, and the complicated switching control circuit is also omitted. Embodiments of the present invention use special pixel arrangements and combinations to enable the viewing of normal color text strokes from every viewing angle.

The above described features and advantages of the present invention will be more apparent from the following description.

There are two main types of multi-view naked-eye stereoscopic displays, which use a parallax barrier or a lenticular screen to block or refract sub-pixel light in different directions. So that one third of the original pixel can be seen from a certain angle of view. When a text line with a pixel as a minimum unit is displayed, the user sees one of the red, blue, and green sub-pixels in one pixel, thereby causing a color error or a rainbow-like phenomenon. Text lines are only one pixel wide, which is common in Chinese characters, especially horizontal strokes. Lateral strokes are sometimes invisible because of the perspective.

When displaying text on a naked-eye 3D screen, because of the characteristics of the 3D screen, the conventional technology can display poorly when displaying text, including insufficient resolution, color error, and the like. When playing a 3D movie on a naked-eye 3D screen, the display of the subtitles is not clear enough. Therefore, the following embodiment proposes a method to enhance the text display effect on the naked-eye 3D screen.

1 is a functional block diagram of a stereoscopic video material processing apparatus 100 in accordance with the present invention. Referring to FIG. 1 , the stereoscopic video data processing device 100 includes a stereoscopic video processor 110 , a word processor 120 , and a superposition unit 130 . The stereoscopic video processor 110 receives and processes the 3D movie to provide a stereoscopic video picture to the superimposing unit 130. Here, the stereoscopic video processor 110 can use an algorithm to process the 3D movie. This algorithm for processing 3D movies should be well known to those skilled in the art and will not be described here.

The word processor 120 converts the subtitle (original text) corresponding to the aforementioned 3D movie into an extended text, and then outputs the extended text to the superimposing unit 130. The stacking unit 130 is coupled to the stereoscopic video processor 110 and the word processor 120 respectively. The superimposing unit 130 superimposes the extended text provided by the word processor 120 on the stereoscopic video image output by the stereoscopic video processor 110, and then transmits the superimposed image image to the stereoscopic display 200. The stereoscopic display 200 can be a parallax barrier element type display, or a microlens array type display, or other type of stereoscopic display.

The pixel data conversion method adopted by the above word processor 120 is as follows. 2 is a diagram showing a pixel data conversion method of a stereoscopic display according to an embodiment of the invention. Referring to FIG. 2, the word processor 120 first proceeds to step S210 to obtain the original text. This original text is made up of multiple original pixels. This embodiment does not limit the technique of obtaining the original text in step S210. For example, step S210 may utilize a font render within word processor 120 to process a bitmap or vector word. The binary data (for dot matrix words) or the equation (for vector words) is converted into original text of two-dimensional pixel arrangement by a font renderer. This original text is usually monochrome and has different shades (brightness values) at the edges.

First, referring to FIG. 3A to FIG. 3C, FIG. 3A to FIG. 3C are schematic diagrams illustrating the conversion of the original text into the extended text by the word processor 120 in FIG. 1 according to an embodiment of the present invention. Two of the original pixels 310 and 320 of the original text are depicted here, as shown in FIG. 3A. Other original pixels in the original text can be analogized with reference to the description of FIGS. 3A to 3C, and thus will not be described herein.

The color values of the two original pixels 310 and 320 in FIG. 3A are [a, b, c] and [e, f, g], respectively. In the present embodiment, the aforementioned [a, b, c] indicates that the red value, the green value, and the blue value of the original pixel 310 are a, b, and c, respectively, but such an example should not limit the application scope of the embodiment. For example, in other embodiments, the aforementioned [a, b, c] may also be expressed as [green value, red value, blue value], or expressed as [blue value, red value, green value], or expressed as Other color values.

The word processor 120 then proceeds to step S220 to replace each original pixel with a corresponding pixel array. Taking FIG. 3B as an example, the original pixel 310 is replaced with a 3*2 pixel array 330, and the original pixel and 320 are replaced with another 3*2 pixel array 340. In the present embodiment, it is assumed that the tilt of the parallax barrier element in the stereoscopic display 200 is -3, so the original pixel is replaced by a row array of 3 rows. However, such an example should not limit the application range of the embodiment. . For example, in other embodiments, if the tilt of the parallax barrier element in the stereoscopic display 200 is +6 or -6, step S220 may replace the original pixel with a 6-row array of pixels.

In addition, in the present embodiment, the stereoscopic display 200 is assumed to be a 2-view display, and thus the original pixel is replaced by a column array of 2 columns. However, such an example should not limit the application range of the embodiment. . For example, in other embodiments, if the stereoscopic display 200 has two viewing angles and three viewing angles, the original pixels can be replaced by two columns of pixel arrays. If the stereoscopic display 200 is a 4-view, 5-view or 6-view display, the original pixels can be replaced by a 3-column pixel array. If the stereoscopic display 200 is a 7-view, 8-view or 9-view display, the original pixels can be replaced by a 4-column pixel array. If the stereoscopic display 200 is a 16-18 viewing angle display, the original pixels can be replaced by a 7-column pixel array.

Referring to FIG. 2, the word processor 120 proceeds to step S230 to obtain the color value of each original pixel in the original text. For example, the [red value, green value, blue value] of the original pixel 310 in FIG. 3A is [a, b, c], and the [red value, green value, blue value] of the original pixel 320 is [e, f]. , g]. Step S230 sets the color value of the corresponding pixel array according to the color value of the original pixel. As shown in FIG. 3B, the first side (eg, the left side) of the pixel array 330 has three edge pixels whose color values are [a, b, c], [x, b, c] and [x, x, respectively. , c]. The second side of the pixel array 330 (for example, the right side) has three corresponding edge pixels, and the color values are [x, x, x], [a, x, x], [a, b, x], respectively. . The above x is a preset value, which can be any real number. In this embodiment, the preset value x is 0. In another embodiment, the first side is a right side of the pixel array 330, and the second side is a left side of the pixel array 330; or the first side and the second side may be a pixel array Upper side and lower side.

The color values of the pixels on the left side of the pixel array 330 shown in FIG. 3B are sequentially [a, b, c], [0, b, c] and [0, 0, c] from top to bottom, but the order should not be This is limited. For example, in another embodiment, the color values of the pixels on the left side of the pixel array 330 are sequentially [0, 0, c], [0, b, c] and [a, b, c], or It is [0, b, c], [0, 0, c] and [a, b, c], or other configuration order from top to bottom. The color value of the pixel on the left side of the pixel array 330 is complementary to the color value of the pixel on the right side. That is to say, after the color value of the pixel on the left side is added to the color value of the pixel on the right side, the result is approximated to the color value of the original pixel 310. For example, as shown in FIG. 3B, the color value of the first edge pixel on the left side of the pixel array 330 is [a, b, c], and the color value of the first edge pixel on the right side should be [0, 0, 0], then the two The color values of the edge pixels are added to be equal to the color values [a, b, c] of the original pixel 310.

In step S230, the color values of the corresponding pixel arrays are set according to the color values of the other original pixels in the original text. For the operation process, reference may be made to the description of the pixel array 330, and therefore no further details are provided. For example, the [red value, green value, blue value] of the original pixel 320 is [e, f, g], so the color values of the three edge pixels of the first side (eg, the left side) of the pixel array 340 are respectively [ e, f, g], [0, f, g] and [0, 0, g], and the color values of the three edge pixels of the second side (for example, the right side) are [0, 0, 0], respectively [e, 0, 0], [e, f, 0].

Then, the word processor 120 proceeds to step S240 to superimpose the edge pixels on the adjacent side of the first pixel array 330 and the second pixel array 340. The color value of the superimposed pixel is the sum of the color values of the first two edge pixels. If the color values of two adjacent edge pixels are [x, x, x] and [e, f, g], respectively, the color values of the superimposed pixels are [x+e, x+f, x+g ]. Taking FIG. 3B as an example, the edge pixel color values of the adjacent pixel side of the first pixel array 330 are [0, 0, 0], [a, 0, 0], [a, b, 0], respectively, and the second pixel. The color values of the edge pixels on the adjacent side of the array 340 are [e, f, g], [0, f, g], [0, 0, g], respectively, and the new pixels of the two columns of edge pixels are superimposed. The column color values are [e, f, g], [a, f, g], [a, b, g], respectively, as shown in Fig. 3C.

FIG. 4A is a schematic diagram illustrating the conventional technique of displaying original text on the stereoscopic display 200. The stereoscopic display 200 has a parallax barrier element 410 and a display panel. The display panel has a plurality of pixels, and each pixel is composed of a plurality of sub-pixels of different colors (shown by a dotted circle and a solid circle in FIG. 4A). The pixels formed by the sub-pixels a, b, and c in FIG. 4A represent the original pixel 310 shown in FIG. 3A, and the pixels formed by the sub-pixels e, f, g represent the original pixel 320 shown in FIG. 3A. The parallax barrier element 410 can block light from a portion of the sub-pixels. It is assumed that the sub-pixels a and e are red sub-pixels, the sub-pixels b and f are green sub-pixels, and the sub-pixels c and g are blue sub-pixels. As can be clearly seen from Fig. 4A, the observer can only see the green sub-pixels b and f, causing the original pixels 310 and 320 to have the wrong color. The technology of the multi-view stereo display will reduce the resolution in both horizontal and vertical directions. Therefore, when the display font is relatively small (the stroke width is as small as three pixels), the font cannot be seen from some perspectives. Some of the strokes in the question.

FIG. 4B is a schematic diagram illustrating that each pixel of FIG. 3C is displayed on the stereoscopic display 200. The original pixels 310 and 320 are expanded into a pixel array as shown in FIG. 3C, and the pixel array is displayed on the stereoscopic display 200, and the color values of the respective sub-pixels are arranged as shown in FIG. 4B. As can be clearly seen from FIG. 4B, the color values [a, b, c] of the original pixel 310 and the color values [e, f, g] of the original pixel 320 can be correctly displayed on the stereoscopic display 200 without It is shielded by the parallax barrier element 410.

In the above embodiment, it is assumed that the inclination of the parallax barrier element in the stereoscopic display 200 is -3, that is, the nip of the parallax barrier element 410 is inclined from the upper left to the lower right. If the inclination of the parallax barrier element in the stereoscopic display 200 is +3, that is, the nip of the parallax barrier element 410 is inclined from the upper right to the lower left, the color value configuration shown in FIG. 3B can be adjusted correspondingly. For example, FIG. 5 is a schematic diagram illustrating the conversion of the original text into extended text by the word processor 120 in accordance with another embodiment of the present invention. The conversion process shown in FIG. 5 is similar to the conversion process shown in FIGS. 3A to 3C, and therefore will not be described again. The difference between the two is that the color values of the three edge pixels on the left side of the pixel array 330 in FIG. 5 are [0, 0, 0], [a, 0, 0], [a, b, 0], respectively, and the right side. The color values of the three edge pixels are [a, b, c], [0, b, c] and [0, 0, c], respectively.

In addition, in the embodiment shown in FIGS. 3A to 3C, it is assumed that the stereoscopic display 200 is a two-view display. If the stereoscopic display 200 is a 9-view display, the size of the pixel array shown in FIG. 3B can be adjusted accordingly. For example, in the pixel array 330 (or 340), there may be a plurality of intermediate pixels between the first side (eg, the left side) and the second side (eg, the right side), and the number of columns of the intermediate pixels may be according to the stereoscopic display. The number of views of 200 is determined.

FIG. 6 is a schematic diagram showing the conversion of the original text into extended text by the word processor 120 according to still another embodiment of the present invention. The conversion process shown in FIG. 6 is similar to the conversion process shown in FIGS. 3A to 3C, and therefore will not be described again. The difference between the two is that the pixel arrays 330 and 340 in FIG. 6 are 3*4 pixel arrays. That is, in the pixel array 330 (or 340) shown in FIG. 6, there are two columns of intermediate pixels between the left side and the right side. The 3*4 pixel array 330 (or 340) shown in FIG. 6 can be applied to the stereoscopic display 200 of 7 to 9 viewing angles. The color values of these intermediate pixels are the same as the corresponding original pixels. For example, the color values of the two columns of pixels in the middle of the pixel array 330 are the same as the color values [a, b, c] of the original pixel 310, and the color values of the pixels in the middle two columns of the pixel array 340 are the same as the color values of the original pixel 320 [e, f, g].

In summary, the technology of the multi-view stereoscopic display will reduce the resolution in both the horizontal and vertical directions. This embodiment solves this problem by increasing the number of unit pixels of the display font. If the solution in the horizontal direction and the vertical direction is reduced to 1/n, then the font unit pixel needs to be n times in the horizontal direction and the vertical direction to ensure that each stroke can be seen in every angle. Regardless of whether the technique used in the multi-view naked-eye stereoscopic display device is a parallax barrier element or a microlens array, the present embodiment can achieve a better text display effect without changing the optical structure design of the stereoscopic display device.

The pixel data conversion method described in the above embodiments can also be implemented in the form of a computer program product under certain application requirements, and the computer can be read by the storage medium to store the computer program, or the network medium can be used to spread the same. Computer program product. When the computer is loaded into the computer program and executed, the above pixel data conversion method can be completed.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

100‧‧‧3D video data processing device

110‧‧‧3D video processor

120‧‧‧ word processor

130‧‧‧Overlay unit

200‧‧‧ Stereo display

310, 320‧‧‧ raw pixels

330, 340‧‧‧ pixel array

410‧‧‧Disparity Barrier Components

S210~S240‧‧‧ steps of pixel data conversion method

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a block diagram showing the functional blocks of a stereoscopic video material processing apparatus in accordance with the present invention.

2 is a diagram showing a pixel data conversion method of a stereoscopic display according to an embodiment of the invention.

3A-3C are schematic diagrams showing the conversion of the original text into extended text by the word processor of FIG. 1 according to an embodiment of the invention.

4A is a schematic view showing a conventional technique of displaying original text on a stereoscopic display.

4B is a schematic view showing that each pixel in FIG. 3C is displayed on a stereoscopic display.

FIG. 5 is a schematic diagram showing a word processor converting original text into extended text according to another embodiment of the present invention.

FIG. 6 is a schematic diagram showing a word processor converting original text into extended text according to still another embodiment of the present invention.

310, 320. . . Original pixel

330, 340. . . Pixel array

Claims (25)

A pixel data conversion method for a stereoscopic display, comprising: obtaining a color value of a first original pixel [a, b, c]; and replacing the first original pixel with a first pixel array by a word processor, wherein the The first side of one of the first pixel arrays has three edge pixels whose color values are [a, b, c], [x, b, c], [x, x, c], respectively. One of the second sides has corresponding three edge pixels, and the color values are [x, x, x], [a, x, x], [a, b, x], respectively, and x is a preset The second side is a non-adjacent side of the first side. The pixel data conversion method of the stereoscopic display of claim 1, wherein the preset value x is 0. The pixel data conversion method of the stereoscopic display of claim 1, wherein the color value [a, b, c] is [red value, green value, blue value]. The pixel data conversion method of the stereoscopic display of claim 1, wherein the first side is a left side of the first pixel array, and the second side is a right side of the first pixel array. The pixel data conversion method of the stereoscopic display of claim 1, wherein the first side is a right side of the first pixel array, and the second side is a left side of the first pixel array. The pixel data conversion method of the stereoscopic display of claim 1, wherein the first side and the second side have a plurality of intermediate pixels. The pixel data conversion method of the stereoscopic display of claim 6, wherein the color values of the intermediate pixels are [a, b, c]. The pixel data conversion method of the stereoscopic display of claim 1, further comprising: obtaining a color value of a second original pixel, wherein the second original pixel is adjacent to the first original pixel; and the second original pixel Substituting a second pixel array; and superposing edge pixels on the adjacent side of the first pixel array and the second pixel array, wherein the color values of the superimposed pixels are the first two superimposed The sum of the color values of the edge pixels. The pixel data conversion method of the stereoscopic display device of claim 8, wherein the second pixel array is obtained according to a gradient value of the parallax barrier element of the stereoscopic display. The pixel data conversion method of the stereoscopic display of claim 1, wherein the first pixel array is obtained according to a slope value of the parallax barrier element of the stereoscopic display. The pixel data conversion method of the stereoscopic display of claim 8, wherein the second pixel array is obtained according to a multi-view value of the stereoscopic display. The pixel data conversion method of the stereoscopic display of claim 1, wherein the first pixel array is obtained according to a multi-view value of the stereoscopic display. A computer program product for converting pixel data of a stereoscopic display, after the computer is loaded into the computer program and executed, the method described in claim 1 can be completed. A stereoscopic video processing device includes: a stereoscopic video processor for providing a stereoscopic video image; and a word processor for converting an original text into an extended text, the conversion method comprising: obtaining the original text The color value of an original pixel is [a, b, c], and the first original pixel is replaced by a first pixel array, and the first side of the first pixel array has three edge pixels, and the color values thereof are respectively [a, b, c], [x, b, c], [x, x, c], the second side of the first pixel array has corresponding three edge pixels, and the color values thereof are respectively [x, x, x], [a, x, x], [a, b, x], wherein x is a predetermined value, and the second side is a non-adjacent side of the first side; A stacking unit is coupled to the stereoscopic video processor and the word processor, so that the extended text is superimposed on the stereoscopic video frame. The stereoscopic video data processing device of claim 14, wherein the preset value x is zero. The stereoscopic video data processing device of claim 14, wherein the color value [a, b, c] is [red value, green value, blue value]. The stereoscopic data processing device of claim 14, wherein the first side is a left side of the first pixel array, and the second side is a right side of the first pixel array. The stereoscopic data processing device of claim 14, wherein the first side is a right side of the first pixel array, and the second side is a left side of the first pixel array. The stereoscopic video data processing device of claim 14, wherein the first side and the second side have a plurality of intermediate pixels. The stereoscopic video data processing device of claim 19, wherein the intermediate pixels have color values of [a, b, c]. The stereoscopic data processing device of claim 14, wherein the word processor further obtains a color value of a second original pixel in the original text, wherein the second original pixel is adjacent to the first original pixel; The second original pixel is replaced by a second pixel array; and the edge pixels of the adjacent pixel array and the second pixel array are overlapped, wherein the color value of the superimposed pixel is The sum of the color values of the first two edge pixels of the overlay. The stereoscopic video data processing device of claim 21, wherein the second pixel array is obtained according to a tilt value of the parallax barrier element of the stereoscopic display. The stereoscopic video data processing device of claim 14, wherein the first pixel array is obtained according to a tilt value of the parallax barrier element of the stereoscopic display. The stereoscopic video data processing device of claim 21, wherein the second pixel array is obtained according to a value of a viewing angle of the stereoscopic display. The stereoscopic video data processing device of claim 14, wherein the first pixel array is obtained according to a value of a viewing angle of the stereoscopic display.