TWI794948B - Light field near-eye display device and method of light field near-eye display - Google Patents

Abstract

A light field near-eye display device and a light field near-eye display method are provided. The light field near-eye display device includes a processor, a display panel, and a lens module. The processor calculates a new ray tracing data according to a current eye relief, a preset eye relief data, and a preset ray tracing data, and adjusts a preset image data according to the new ray tracing data to generate an adjusted image data. The display panel is coupled to the processor and emits an image beam according to the adjusted image data. The lens module includes a micro lens array and is arranged between the display panel and a pupil. The image beam is incident on the pupil through the lens module and displays a light field image.

Description

Light field near-eye display device and light field near-eye display method

The present invention relates to a display technology, and in particular to a light field near-eye display device and a light field near-eye display method.

Light Field Near-Eye Display (LFNED) is currently one of the display technologies that can solve Vergence-Accommodation Conflict (VAC), and it can be divided into two types of architectures: spatial multiplexing and temporal multiplexing. Time multiplexing is to use micro-electromechanical system (Micro-Electromechanical System, MEMS) components to change the position of the virtual image and adjust the clarity of the front and back scenes. Spatial multiplexing uses an array lens to project the corresponding parallax image on the panel, for example, placing a lens array on an Organic Light-Emitting Diode (OLED) display to generate a light field image.

For light field near-eye displays, the relative relationship between the left and right eyeballs and the optical system is the main system parameter. In traditional light field near-eye displays, the system parameters are fixed values and rely on system tolerances to provide tolerance errors for the left and right eyeballs, where the system parameters can include, for example, the inter pupil distance (Inter Pupillary Distance, IPD), eye movement range (Eye Box ) and eye relief. Among them, the exit pupil distance is set as a system design in the traditional light field near-eye display, which cannot be adjusted digitally. Furthermore, traditional light field near-eye displays use mechanical movement to adjust optical variables, resulting in changes in the exit pupil distance. However, since the mechanical adjustment is, for example, the relative position change of the optical-mechanical structure or the adjustment of active elements (such as liquid or liquid crystal and other material characteristic elements), the complexity of the body structure will be increased or the image quality will be degraded.

The "Prior Art" section is only used to help understand the content of the present invention, so the content disclosed in the "Prior Art" section may contain some prior art that does not constitute the prior art that is known by those with ordinary skill in the art. The content disclosed in the "Prior Art" paragraph does not mean that the content or the problems to be solved by one or more embodiments of the present invention have been known or recognized by those with ordinary knowledge in the technical field before the application of the present invention.

The invention provides a light field near-eye display device, which allows users to watch light field images with good image quality.

Other purposes and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

To achieve one or part or all of the above objectives or other objectives, an embodiment of the present invention provides a light field near-eye display device including a processor, a display panel and a lens module. The processor calculates new ray tracing data according to the current exit pupil distance, preset exit pupil distance data and preset ray tracing data, and adjusts the preset image data according to the new ray tracing data to generate adjusted image data. The display panel is coupled to the processor and emits image light beams according to the adjusted image data. The lens module includes a microlens array and is arranged between the display panel and the pupil. The image beam enters the pupil through the lens module and displays the light field image.

In an embodiment of the present invention, the aforementioned preset exit pupil distance data includes a first preset exit pupil distance. The default ray tracing data includes the first default exit pupil position coordinates. The processor calculates the current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance and the first preset exit pupil position coordinates.

In an embodiment of the present invention, the aforementioned preset exit pupil distance data further includes a second preset exit pupil distance. The preset ray tracing data also includes the second preset exit pupil position coordinates, the first preset ray vector and the second preset ray vector. The processor calculates the current ray vector of the new ray tracing data according to the current exit pupil position coordinates, the first preset exit pupil position coordinates, the second preset exit pupil position coordinates, the first preset ray vector and the second preset ray vector .

In an embodiment of the present invention, the above-mentioned processor is based on the current exit pupil position coordinates, the first preset exit pupil position coordinates, the second preset exit pupil position coordinates, the first preset ray vector and the second preset ray The vector is interpolated to obtain the current ray vector.

In an embodiment of the present invention, the first preset exit pupil distance and the second preset exit pupil distance are respectively the minimum exit pupil distance and the maximum exit pupil distance.

In an embodiment of the present invention, the above-mentioned current exit pupil distance is the distance between the current eye movement range corresponding to the pupil and the microlens array. The current exit pupil position coordinates are located in the current eye movement range. The first preset exit pupil distance corresponds to the distance between the first preset eye movement range and the microlens array. The first preset exit pupil position coordinates are located in the first preset eye movement range. The second preset exit pupil distance corresponds to the distance between the second preset eye movement range and the microlens array. The second preset exit pupil position coordinates are located in the second preset eye movement range.

In an embodiment of the present invention, the number of the above-mentioned first preset exit pupil position coordinates is multiple. The processor calculates a plurality of current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance and the plurality of first preset exit pupil position coordinates respectively. The processor respectively according to a plurality of current exit pupil position coordinates, a plurality of first preset exit pupil position coordinates, a plurality of second preset exit pupil position coordinates, a plurality of first preset Let the ray vector and the plurality of second preset ray vectors calculate a plurality of current ray vectors between the plurality of microlenses and the plurality of current exit pupil position coordinates in the current eye movement range.

In an embodiment of the present invention, the above-mentioned processor adjusts the multiple sub-image contents in the preset image data according to the multiple current light vectors respectively corresponding to the multiple micro-lenses, so that the multiple sub-image contents of the multiple sub-image contents The image light beams respectively pass through a plurality of micro lenses to form a plurality of sub light field image units. A light field image is formed by a plurality of sub light field image units.

In an embodiment of the present invention, the above-mentioned light field image is displayed within the focus range of the pupil.

In an embodiment of the present invention, the above-mentioned light field near-eye display device further includes a distance sensor. The distance sensor is coupled to the processor. The processor obtains the current exit pupil distance for the pupil through the distance sensor.

In order to achieve one or part or all of the above objectives or other objectives, an embodiment of the present invention proposes a light field near-eye display method including the following steps: calculate according to the current exit pupil distance, preset exit pupil distance data and preset ray tracing data new ray tracing data; adjusting preset image data according to the new ray tracing data to generate adjusted image data; emitting an image beam by a display panel according to the adjusted image data; and passing the image beam through a microlens array The lens module injects into the pupil and displays the light field image.

In an embodiment of the present invention, the aforementioned preset exit pupil distance data includes a first preset exit pupil distance, and the preset ray tracing data includes first preset exit pupil position coordinates. The step of calculating the new ray tracing data includes: calculating the current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance and the first preset exit pupil position coordinates.

In an embodiment of the present invention, the aforementioned preset exit pupil distance data further includes a second preset exit pupil distance. The preset ray tracing data also includes the second preset exit pupil position coordinates, the first preset ray vector and the second preset ray vector. The step of calculating new ray tracing data also includes: calculating according to the current exit pupil position coordinates, the first preset exit pupil position coordinates, the second preset exit pupil position coordinates, the first preset ray vector and the second preset ray vector The current ray vector for the new raytrace data.

In an embodiment of the present invention, the above step of calculating the current ray vector of the new ray tracing data includes: according to the current exit pupil position coordinates, the first preset exit pupil position coordinates, the second preset exit pupil position coordinates, Interpolation is performed on the first preset light vector and the second preset light vector to obtain the current light vector.

In an embodiment of the present invention, the first preset exit pupil distance and the second preset exit pupil distance are respectively the minimum exit pupil distance and the maximum exit pupil distance.

In an embodiment of the present invention, the above-mentioned current exit pupil distance is the distance between the current eye movement range corresponding to the pupil and the microlens array. The current exit pupil position coordinates are located in the current eye movement range. The first preset exit pupil distance corresponds to the distance between the first preset eye movement range and the microlens array. The first preset exit pupil position coordinates are located in the first preset eye movement range. The second preset exit pupil distance corresponds to the distance between the second preset eye movement range and the microlens array. The second preset exit pupil position coordinates are located in the second preset eye movement range.

In an embodiment of the present invention, the number of the above-mentioned first preset exit pupil position coordinates is multiple. The step of calculating the new ray tracing data further includes: calculating a plurality of current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance and the plurality of first preset exit pupil position coordinates respectively and respectively according to a plurality of current exit pupil position coordinates, a plurality of first preset exit pupil position coordinates, a plurality of second preset exit pupil position coordinates, a plurality of first preset exit pupil position coordinates corresponding to a plurality of microlenses of the microlens array Let the ray vector and the plurality of second preset ray vectors calculate a plurality of current ray vectors between the plurality of microlenses and the plurality of current exit pupil position coordinates in the current eye movement range.

In an embodiment of the present invention, the above-mentioned step of adjusting the preset image data according to the new ray tracing data includes: adjusting a plurality of the preset image data according to a plurality of current ray vectors respectively corresponding to a plurality of microlenses. Sub image content. The step of displaying the light field image includes: forming a plurality of sub light field image units through a plurality of microlenses through a plurality of image light beams of the plurality of sub image contents. And a plurality of light field image sub-units form a light field image.

In an embodiment of the present invention, the above-mentioned light field image is displayed within the focus range of the pupil.

In an embodiment of the present invention, the above-mentioned light field near-eye display method further includes: obtaining the current exit pupil distance for the pupil by a distance sensor.

Based on the above, the light field near-eye display device and the light field near-eye display method of the present invention can automatically adjust the image data according to the current exit pupil distance, so that the display panel can emit corresponding image beams according to the adjusted image data to provide Light field images with good image quality.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.

The aforementioned and other technical contents, features and effects of the present invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the drawings. The directional terms mentioned in the following embodiments, such as: up, down, left, right, front or back, etc., are only directions referring to the attached drawings. Accordingly, the directional terms are used to illustrate and not to limit the invention.

FIG. 1 is a schematic circuit diagram of a light field near-eye display device according to an embodiment of the present invention. Referring to FIG. 1 , a light field near-eye display device 100 includes a processor 110 , a display panel 120 and a storage device 130 . The processor 110 is coupled to the display panel 120 and the storage device 130 . In this embodiment, the processor 110 can generate the image according to the original image data and system parameters, for example, according to the preset binocular pupillary distance, preset eye movement range, preset exit pupil distance, preset ray tracing data and other related data. video material. The processor 110 can drive the display panel 120 according to the image data, so that the display panel 120 can emit corresponding image beams to the pupils of the user through displaying image content to display light field images. In this embodiment, the light field near-eye display device 100 is, for example, a head-mounted display (Head-Mounted Display, HMD), but the present invention is not limited thereto.

In this embodiment, the processor 110 may include a central processing unit (Central Processing Unit, CPU) with related control functions, driving functions, and image data calculation functions, or other programmable general-purpose or special-purpose microprocessors (Microprocessor), Digital Signal Processor (Digital Signal Processor, DSP), Image Processor (Image Processing Unit, IPU), Graphics Processing Unit (Graphics Processing Unit, GPU), Programmable Controller, Special Application Integrated Circuit ( Application Specific Integrated Circuits (ASIC), Programmable Logic Device (Programmable Logic Device, PLD), other similar control devices or a combination of these devices. In this embodiment, the storage device 130 can be a memory, and can be used to store related image data, system parameters, image processing modules, and algorithms related to parameter calculations, etc., for the processor 110 to access and execute Of.

In this embodiment, the display panel 120 can be a liquid crystal display (Liquid Crystal Display, LCD) panel, an organic light emitting diode display panel, a micro light emitting diode display panel or other suitable displays, and the processor 110 can The data is used to drive the display panel 120 to display the corresponding image frame. Moreover, the display panel 120 emits corresponding image light beams to display the light field image for displaying the corresponding image frame. In this embodiment, the processor 110 can correspondingly adjust the image data according to the current exit pupil distance, so that after the content of the image displayed on the display panel 120 is adjusted, the light field image can be displayed within the focusing range of the user's pupil.

FIG. 2 is a schematic structural diagram of a light field near-eye display device according to an embodiment of the present invention. Referring to FIG. 1 and FIG. 2 , in this embodiment, the light field near-eye display device 100 may be disposed in front of the user's field of vision. The light field near-eye display device 100 may further include a lens module 140 . The user's eyes (pupil 201 ) can face the display panel 120 and the lens module 140 in the direction Z. The display panel 120 and the lens module 140 may be, for example, parallel to a plane formed by extending the direction X and the direction Y respectively. The lens module 140 may include a microlens array 141 , and the microlens array 141 may include a plurality of microlenses 141_1 - 141_N arranged in an array, wherein N is a positive integer. The microlenses 141_1˜141_N can be extended and arranged in the direction X and the direction Y respectively. The lens module 140 may also include other lens elements. In this embodiment, the first lens 142 and the second lens 143 are taken as examples. In other embodiments, the image quality and effect to be presented by the visible light field near-eye display device 100 to adjust the number or shape of other lens elements.

In this embodiment, the lens module 140 is disposed between the display panel 120 and the pupil 201 , wherein the image beam generated by the display panel 120 can enter the pupil 201 through the lens module 140 to display a light field image. It is worth noting that the result of the light field image viewed by the user from the pupil 201 (the imaging result on the user's retina) can be like a virtual image equivalently imaged on the distant virtual imaging plane S1, and its The equivalent optical path of the image beam can be shown in FIG. 2 .

In this embodiment, from the perspective of the user, the user's pupil 201 can receive the image emitted by the sub-display area corresponding to the sub-image content 121_1 of the display panel 120 through the microlens 141_1 within the eye movement range 202 light beam, so as to observe the sub-virtual image 151_1 as equivalently imaged on the distant virtual imaging plane S1. Similarly, the user's pupil 201 can receive the image light beams emitted by the sub-display areas corresponding to the sub-image content 121_2, 121_3 of the display panel 120 through the microlenses 141_2, 141_3 in the eye movement range 202, so as to observe The sub-virtual images 151_2 and 151_3 are equivalently imaged on the distant virtual imaging plane S1. In this regard, the positions and overlapping relationships of the multiple sub-images displayed on the display panel 120 of this embodiment can be determined according to the ray tracing data, so that the user can watch the light field image with the three-dimensional object image.

It is worth noting that, from the equivalent optical path relationship of the image light beam shown in FIG. When the pupil distance Di is different from the preset exit pupil distance, the plurality of image light beams emitted by the display panel 120 are incident on the pupil 201 through the microlenses 141_1~141_N to the exit pupils corresponding to the plurality of ray trajectories on the eye movement range 202 The position will change, thereby affecting the image content of the light field image displayed on the user's pupil 201 . Therefore, in this embodiment, the processor 110 can automatically adjust the corresponding multiple sub-image contents displayed on the display panel 120 according to the current exit pupil distance Di, so that the multiple image beams emitted to the user's pupil 201 The displayed light field image can be displayed within the focus range of the pupil 201 .

FIG. 3 is a flowchart of a light field near-eye display method according to an embodiment of the present invention. Referring to FIG. 1 to FIG. 3 , the light field near-eye display device 100 of this embodiment may implement a light field near-eye display method including the following steps S310 - S340 to provide a good light field image display effect. It should be noted that, in this embodiment, the light field near-eye display device 100 may further include a distance sensor or an input device, wherein the distance sensor or the input device may be coupled to the processor 110 . The distance sensor can automatically sense the user to obtain the current exit pupil distance for the pupil 201 and provide the current exit pupil distance to the processor 110 . The input device can input the current exit pupil distance manually by the user or other external electronic devices, and provide it to the processor 110 . In this embodiment, the storage device 130 of the light-field near-eye display device 100 may pre-store preset exit pupil distance data and preset ray tracing data, and the processor 110 of the light-field near-eye display device 100 may, for example, use the aforementioned distance The sensor or input device obtains the current exit pupil distance Di.

In step S310, the processor 110 may calculate new ray tracing data according to the current exit pupil distance Di, the preset exit pupil distance data and the preset ray tracing data. In step S320, the processor 110 may adjust the default image data according to the new ray tracing data to generate adjusted image data. In step S330 , the light field near-eye display device 100 can emit image light beams according to the adjusted image data through the display panel 120 . In step S340 , the image beam may enter the pupil 201 through the lens module 140 including the microlens array 141 and display the light field image. Therefore, the light field near-eye display device 100 of this embodiment and the light field near-eye display method of this embodiment executed by the light field near-eye display device 100 can automatically adjust the image data according to the current exit pupil distance Di, so as to display images suitable for the current exit pupil distance Di. The light field image of the pupil distance Di. Moreover, the manner of calculating the new ray tracing data in step S310 will be described in detail in the following embodiments in FIG. 4 and FIG. 5 .

Fig. 4 is a schematic diagram of optical paths with different exit pupil distances according to an embodiment of the present invention. Referring to FIG. 1 , FIG. 2 and FIG. 4 , the storage device 120 of this embodiment can store preset exit pupil distance data and preset ray tracing data in advance. The preset exit pupil distance data may include the first preset exit pupil distance De between the first eye movement range (eye box) E1 and the microlens array 141, or the distance between the second eye movement range E2 and the microlens array 141. The second preset exit pupil distance De+ΔDe, wherein the distance ΔDe is the distance between the first eye movement range E1 and the second eye movement range E2. It should be noted that the first preset exit pupil distance De and the second preset exit pupil distance De+ΔDe may respectively be the minimum exit pupil distance and the maximum exit pupil distance for the light field near-eye display device 100 to effectively display. There is a distance Dg between the microlens array 141 and the display surface PS of the display panel 120 . The preset ray tracing data may include a plurality of first preset exit pupil position coordinates of a plurality of spatial coordinate points in the first eye movement range E1, or a plurality of coordinate points of a plurality of coordinate points in the second eye movement range E2 A plurality of second preset exit pupil position coordinates. The first preset exit pupil distance De corresponds to a plurality of first preset exit pupil position coordinates and a plurality of first preset light vectors. The second preset exit pupil distance De+ΔDe corresponds to a plurality of second preset exit pupil position coordinates and a plurality of second preset light vectors.

……………公式(1) In this embodiment, the processor 110 may, for example, calculate a plurality of current exit pupil position coordinates of a plurality of exit pupil positions in the current eye movement range EA based on the following formula (1), wherein the parameters Pi, Pa, and Pb are respectively is the exit pupil position coordinates (spatial coordinates).

……………Formula 1)

Take the exit pupil position coordinates Pa1 (xa, ya, za), Pi1 (xi, yi, zi), Pb1 (xb, yb, zb) as an example, where the exit pupil position coordinates Pa1(xa, ya, za), Pi1(xi, yi, zi), Pb1(xb, yb, zb) are respectively in the first eye movement range E1, the current eye movement range EA and the corresponding exit pupil position on the second eye movement range E2. In this regard, the exit pupil position coordinates Pa1 (xa, ya, za) and the exit pupil position coordinates Pb1 (xb, yb, zb) are preset exit pupil distance data (known parameters), and the first preset exit pupil distance De And the second preset exit pupil distance De+ΔDe is a known parameter. In this way, when the processor 110 obtains the current exit pupil distance De+ΔDi (that is, the current exit pupil distance Di=De+ΔDi), the processor 110 can calculate the current exit pupil distance according to the aforementioned formula (1). Pupil position coordinates Pi1(xi,yi,zi). The distance ΔDi is the distance between the first eye movement range E1 and the current eye movement range EA. Therefore, by analogy, the processor 110 can calculate the current exit pupil distance De+ΔDi, the first preset exit pupil distance De, and a plurality of first preset exit pupil position coordinates in the first eye movement range E1 respectively. A plurality of current exit pupil position coordinates (new ray tracing data) in the current eye movement range EA, or according to the current exit pupil distance, the second preset exit pupil distance, and a plurality of first exit pupil distances in the second eye movement range E2 2. Calculating a plurality of current exit pupil position coordinates (new ray tracing data) in the current eye movement range EA, so as to effectively create new ray tracing data for subsequent image data adjustment.

Next, the preset ray tracing data can also include a plurality of first pupil positions (spatial coordinate points) corresponding to the respective lens centers of the plurality of microlenses 141_1~141_N to the plurality of exit pupil positions (multiple spatial coordinate points) in the first eye movement range E1. A preset ray vector, and a plurality of second preset rays respectively corresponding to multiple exit pupil positions (multiple spatial coordinate points) in the second eye movement range E2 from the respective lens centers of the plurality of microlenses 141_1~141_N vector. In this embodiment, the processor 110 may obtain multiple current exit pupil position coordinates, multiple first preset exit pupil position coordinates, and multiple second preset exit pupil position coordinates in the current eye movement range EA obtained previously. , a plurality of first preset ray vectors and a plurality of second preset ray vectors to calculate a plurality of current ray vectors in the new ray tracing data. For this, the processor 110 may, for example, perform an interpolation calculation to obtain a plurality of current light vectors. In an embodiment, the aforementioned interpolation calculation may be, for example, a calculation method using an interpolation method or an extrapolation method, but the present invention is not limited thereto.

為從一個微透鏡的透鏡中心至對應的第一預設出瞳位置的第一預設光線向量，並且參數

為從一個微透鏡的透鏡中心至對應得第二預設出瞳位置的第二預設光線向量。

……………公式(2) The processor 110 can calculate the current ray vector based on the following formula (2), wherein the parameter h1 is the distance value between a current exit pupil position coordinate and the corresponding first preset exit pupil position coordinate, and the parameter h2 is a current exit pupil position coordinate. The distance value between the pupil position coordinates and the corresponding second preset exit pupil position coordinates. parameter

is the first preset ray vector from the lens center of a microlens to the corresponding first preset exit pupil position, and the parameter

is a second preset ray vector from the lens center of a microlens to the corresponding second preset exit pupil position.

…………Formula (2)

例如以

來表示，參數

例如以

來表示。出瞳位置座標Pa1(xa,ya,za)以及出瞳位置座標Pb1(xb,yb,zb)為預設出瞳距離資料(已知參數)，並且預設光線向量

與預設光線向量

分別為從一個微透鏡的透鏡中心的位置座標Pm1(xm,ym,zm)至出瞳位置座標Pa1(xa,ya,za)以及出瞳位置座標Pb1(xb,yb,zb)的預設光線向量(已知參數)。如此一來，處理器110可根據前述的預設光線向量

、預設光線向量

、參數h1、參數h2以及公式(2)來計算從一個微透鏡的透鏡中心的位置座標Pm1(xm,ym,zm)至出瞳位置座標Pi1(xi,yi,zi)的當前光線向量

。 In detail, refer to FIG. 5 , which is a schematic diagram of vector difference calculation according to an embodiment of the present invention. It is worth noting that the formula (2) represents the calculation of individual microlenses. For the multiple microlenses 141_1~141_N in the microlens array 141, the relevant parameters of each microlens need to be substituted into the formula (2 ), and Figure 5 takes one of the microlenses as an example, and takes the exit pupil position coordinates Pa1(xa, ya, za), Pi1(xi,yi,zi), Pb1(xb,yb,zb) as an example, and the parameters in formula (2)

For example with

to represent that the parameter

For example with

To represent. Exit pupil position coordinates Pa1(xa, ya, za) and exit pupil position coordinates Pb1(xb, yb, zb) are the preset exit pupil distance data (known parameters), and the preset light vector

with preset light vector

are the preset rays from the position coordinate Pm1 (xm, ym, zm) of the lens center of a microlens to the exit pupil position coordinate Pa1 (xa, ya, za) and the exit pupil position coordinate Pb1 (xb, yb, zb) respectively vector (known parameters). In this way, the processor 110 can

, preset light vector

, parameter h1, parameter h2 and formula (2) to calculate the current ray vector from the position coordinate Pm1(xm,ym,zm) of the lens center of a microlens to the exit pupil position coordinate Pi1(xi,yi,zi)

.

Therefore, by analogy, the processor 110 can respectively according to the multiple current exit pupil position coordinates in the current eye movement range EA, the multiple first preset exit pupil position coordinates in the first eye movement range E1, A plurality of second preset exit pupil position coordinates in the eye movement range E2, a plurality of first preset ray vectors corresponding to a plurality of microlenses 140_1~140_N of the microlens array 140, and a plurality of second preset ray vectors Calculate a plurality of current ray vectors from the plurality of microlenses 140_1 to 140_N respectively to the plurality of current exit pupil position coordinates in the current eye movement range EA. Moreover, the processor 110 can adjust the multiple sub-image contents in the preset image data according to the multiple current light vectors respectively corresponding to the multiple micro-lenses 140_1~140_N, so that the multiple image light beams corresponding to the multiple sub-image contents respectively A plurality of sub light field image units are formed through the plurality of microlenses 140_1˜140_N, and the plurality of sub light field image units form a light field image.

For example, as shown in Figure 4, the first eye movement range E1, the current eye movement range EA, and the second eye movement range E2 corresponding to the exit pupil distances De, De+ΔDi, and De+ΔDe can all pass through the center The microlens 141_1 of the microlens 141_1 receives the sub-image content 401 displayed by the display panel 120, that is, for the microlens 141_1 in the center, the first eye movement corresponding to the exit pupil distance De, De+ΔDi, De+ΔDe The positions of the sub-image content 401 received by the area E1 , the current eye movement area EA and the second eye movement area E2 basically do not change. However, for other microlenses that are not located at the central position, when the exit pupil distance changes, the position of the sub-image content received by the corresponding eye movement range will also change accordingly. For example, in the following, for the microlens 141_2, the exit pupil distance De+ΔDe (corresponding to the second eye movement range E2) is changed to the current exit pupil distance De+ΔDi (corresponding to the current eye movement range EA) to further explain. First, when the light field near-eye display device 100 displays a light field image based on the image data of the second eye movement range E2 corresponding to the exit pupil distance De+ΔDe, for example, the image emitted by the sub image content 402 displayed on the display panel 120 The light beam can enter the second eye movement range E2 located at the exit pupil distance De+ΔDe through the microlens 141_2 . Next, when the distance between the pupil and the microlens 141_2 changes to the current exit pupil distance De+ΔDi, the processor 110 can convert the sub-image content 402 originally displayed on the display panel 120 to The position is adjusted to the position of the sub-image content 403, so that the image light beam emitted by the sub-image content 403 displayed on the display panel 120 after adjustment can enter the current eye movement range at the current exit pupil distance De+ΔDi via the microlens 141_2 EA (i.e. the pupil of the current user). In addition, it should be noted that both the sub-image content 402 and the sub-image content 403 are displayed on the display surface PS of the display panel 120, and the positions of the sub-image content 402 and the sub-image content 403 shown in FIG. The position change result on the face PS.

In summary, the light field near-eye display device and the light field near-eye display method of the present invention can automatically adjust the image data according to the user's current exit pupil distance, and the image content provided by the display panel in the light field near-eye display device is The display panel can emit corresponding image beams according to the adjusted image data, so that the image beams can be correctly incident on the pupil of the user, so that the light field image can be displayed within the focus range of the pupil, so that the user can Light field images with good image quality were viewed.

But the above-mentioned person is only preferred embodiment of the present invention, when can not limit the scope of the present invention implementation with this, promptly all the simple equivalent changes and modifications that are done according to the patent scope of the present invention and the content of the description of the invention, All still belong to the scope that the patent of the present invention covers. In addition, any embodiment or scope of claims of the present invention does not need to achieve all the objectives or advantages or features disclosed in the present invention. In addition, the abstract and the title are only used to assist in the search of patent documents, and are not used to limit the scope of rights of the present invention. In addition, terms such as "first" and "second" mentioned in this specification or the scope of the patent application are only used to name elements (elements) or to distinguish different embodiments or ranges, and are not used to limit the number of elements. upper or lower limit.

、

、

:光線向量 S1:虛擬成像平面 S310、S320、S330、S340:步驟 PS:顯示面。 100: light field near-eye display device 110: processor 120: display panel 121_1, 121_2, 121_3, 401, 402, 403: sub-image content 130: storage device 140: lens module 141: microlens array 141_1~141_N: microlens 142: first lens 143: second lens 151_1, 151_2, 151_3: sub-virtual image 201: pupil 202, E1, E2, EA: eye movement range X, Y, Z: direction De, Di: exit pupil distance ΔDe, ΔDi , Dg: distance h1, h2: parameters Pa1 (xa, ya, za), Pb1 (xb, yb, zb), Pi1 (xi, yi, zi), Pm1 (xm, ym, zm): position coordinates

,

,

: light vector S1: virtual imaging plane S310, S320, S330, S340: step PS: display surface.

FIG. 1 is a schematic circuit diagram of a light field near-eye display device according to an embodiment of the present invention. FIG. 2 is a schematic structural diagram of a light field near-eye display device according to an embodiment of the present invention. FIG. 3 is a flowchart of a light field near-eye display method according to an embodiment of the present invention. Fig. 4 is a schematic diagram of optical paths with different exit pupil distances according to an embodiment of the present invention. FIG. 5 is a schematic diagram of vector difference calculation according to an embodiment of the present invention.

S310, S320, S330, S340: steps

Claims (18)

A light field near-eye display device, comprising: a processor for calculating a new ray tracing data according to a current exit pupil distance, a preset exit pupil distance data and a preset ray tracing data, and according to the new ray The tracing data adjusts a preset image data to generate adjusted image data, wherein the preset exit pupil distance data includes a first preset exit pupil distance, and the preset ray tracing data includes a first preset exit pupil position coordinates, the processor calculates a current exit pupil position coordinates of the new ray tracing data according to the current exit pupil distance, the first preset exit pupil distance and the first preset exit pupil position coordinates; a display panel, coupled to the processor, and used to emit an image beam according to the adjusted image data; and a lens module, including a microlens array, and arranged between the display panel and a pupil, wherein the image beam passes through The lens module enters the pupil and displays a light field image. The light field near-eye display device as described in Claim 1, wherein the preset exit pupil distance data also includes a second preset exit pupil distance, and the preset ray tracing data also includes a second preset exit pupil position coordinates , a first preset ray vector and a second preset ray vector, wherein the processor according to the current exit pupil position coordinates, the first preset exit pupil position coordinates, the second preset exit pupil position coordinates, the The first default ray vector and the second default ray vector calculate a current ray vector of the new ray tracing data. The light field near-eye display device as claimed in claim 2, wherein the processor is based on the current exit pupil position coordinates, the first preset exit pupil position coordinates, the second preset exit pupil position coordinates, the first preset An interpolation calculation is performed on the light vector and the second preset light vector to obtain the current light vector. The light field near-eye display device according to Claim 2, wherein the first preset exit pupil distance and the second preset exit pupil distance are a minimum exit pupil distance and a maximum exit pupil distance, respectively. The light field near-eye display device according to claim 2, wherein the current exit pupil distance is the distance between a current eye movement range corresponding to the pupil and the microlens array, and the current exit pupil position coordinates are located at the current In the eye movement range, the first preset exit pupil distance corresponds to the distance between a first preset eye movement range and the microlens array, and the first preset exit pupil position coordinates are located at the first preset Set the eye movement range, wherein the second preset exit pupil distance corresponds to the distance between a second preset eye movement range and the microlens array, and the second preset exit pupil position coordinates are located in the second Preset eye movement range. The light field near-eye display device as described in Claim 1, wherein the number of the first preset exit pupil position coordinates is multiple, and the processor respectively according to the current exit pupil distance, the first preset exit pupil distance and the Some first preset exit pupil position coordinates calculate a plurality of current exit pupil position coordinates of the new ray tracing data, and the processor respectively according to these current exit pupil position coordinates, these first preset exit pupil position coordinates, A plurality of second preset exit pupil position coordinates, a plurality of microlenses corresponding to the microlens array The first preset ray vector and the plurality of second preset ray vectors calculate a plurality of current ray vectors between the microlenses and the current exit pupil position coordinates in the current eye movement range. The light field near-eye display device as described in claim 6, wherein the processor adjusts the content of a plurality of sub-images in the preset image data according to the current light vectors respectively corresponding to the microlenses, so that the sub-images A plurality of image light beams of the image content respectively pass through the microlenses to form a plurality of sub light field image units, and the sub light field image units form the light field image. The light field near-eye display device as claimed in claim 1, wherein the light field image is displayed within a focus range of the pupil. The light field near-eye display device according to claim 1 further includes: a distance sensor coupled to the processor, wherein the processor obtains the current exit pupil distance for the pupil through the distance sensor. A light field near-eye display method, comprising: calculating a new ray tracing data according to a current exit pupil distance, a preset exit pupil distance data and a preset ray tracing data, wherein the preset exit pupil distance data includes a first The preset exit pupil distance, and the preset ray tracing data includes a first preset exit pupil position coordinate, calculated according to the current exit pupil distance, the first preset exit pupil distance and the first preset exit pupil position coordinate a current exit pupil position coordinate of the new ray tracing data; adjusting a preset image data according to the new ray tracing data to generate an adjusted image data; A display panel emits an image light beam according to the adjusted image data; and makes the image light beam enter a pupil through a lens module including a microlens array and display a light field image. The light field near-eye display method as described in Claim 10, wherein the preset exit pupil distance data further includes a second preset exit pupil distance, and the preset ray tracing data further includes a second preset exit pupil position coordinates , a first preset ray vector and a second preset ray vector, wherein the step of calculating the new ray tracing data further includes: according to the current exit pupil position coordinates, the first preset exit pupil position coordinates, the The second preset exit pupil position coordinates, the first preset ray vector and the second preset ray vector calculate a current ray vector of the new ray tracing data. The light field near-eye display method as described in claim 11, wherein the step of calculating the current ray vector of the new ray tracing data includes: according to the current exit pupil position coordinates, the first preset exit pupil position coordinates, the The second preset exit pupil position coordinates, the first preset light vector and the second preset light vector perform an interpolation calculation to obtain the current light vector. The light field near-eye display method according to claim 11, wherein the first preset exit pupil distance and the second preset exit pupil distance are respectively a minimum exit pupil distance and a maximum exit pupil distance. The light field near-eye display method according to claim 11, wherein the current exit pupil distance is the distance between a current eye movement range corresponding to the pupil and the microlens array, and the current exit pupil position coordinates are located at the current In the eye movement range, the first preset exit pupil distance corresponds to the distance between a first preset eye movement range and the microlens array, and the first preset exit pupil position coordinates are located at the first preset Set the eye movement range, wherein the second preset exit pupil distance corresponds to the distance between a second preset eye movement range and the microlens array, and the second preset exit pupil position coordinates are located in the second Preset eye movement range. The light field near-eye display method according to claim 10, wherein the number of the first preset exit pupil position coordinates is multiple, and the step of calculating the new ray tracing data further includes: respectively according to the current exit pupil distance , the first preset exit pupil distance and the first preset exit pupil position coordinates to calculate a plurality of current exit pupil position coordinates of the new ray tracing data; and respectively according to the current exit pupil position coordinates, the first exit pupil position coordinates A preset exit pupil position coordinate, a plurality of second preset exit pupil position coordinates, a plurality of first preset ray vectors corresponding to a plurality of microlenses of the microlens array and a plurality of second preset ray vectors are calculated from The microlenses are respectively to a plurality of current light vectors between the current exit pupil position coordinates in the current eye movement range. The light field near-eye display method as described in claim 15, wherein the step of adjusting the preset image data according to the new ray tracing data includes: According to the current light vectors respectively corresponding to the microlenses, a plurality of sub-image contents in the preset image data are adjusted, wherein the step of displaying the light field image includes: using the plurality of images of the sub-image contents The light beams respectively pass through the microlenses to form a plurality of sub-light field image units, and the sub-light field image units form the light field image. The light field near-eye display method according to claim 10, wherein the light field image is displayed within a focus range of the pupil. The light field near-eye display method according to claim 10 further includes: obtaining the current exit pupil distance for the pupil by the distance sensor.

Images