TWI786525B - Device of generating 3d light-field image - Google Patents

Abstract

A device is provided to generate a three-dimensional (3D) real image. A display panel is divided into several sub-areas for emitting scenes. Through a projecting lens-array unit, the scenes enter a fusion lens unit to form a real image of light field at a position beyond common barrier. Through an eyepiece unit, the image is emitted to human eye. Thus, the present invention provides a device for near-eye viewing, which reduces existing human-eye vergence accommodation conflict (VAC) in most augmented reality and mixed reality devices. Therein, the display of near-eye light field is a process of light-field reproduction, which merges the scenes and reduces aberration.

Description

light field generator

The present invention is related to a light field generating device, especially for near-eye viewing to reduce Most of the augmented reality (AR) and mixed reality (Mixed reality, MR) devices are less than the existing human eye astigmatism adaptation conflict (Vergence accommodation conflict, VAC) light field generation device.

In recent years, virtual reality such as Google Glasses, Vive and Oculus Rift (Virtual reality, VR), augmented reality (Augmented reality, AR) or mixed reality (Mixed reality, MR) devices are all based on the principle of stereo vision to generate a three-dimensional (Three-dimensionality, 3D) feeling. For popularity, one of the reasons why this is difficult to do is that due to the distance between the monitors, the eye distance is too short to make the human eye comfortable for long-term viewing. Also, since the accommodation does not change with the natural divergence of the eyes, this leads to the well-known fusion conflict known as Vergence accommodation conflict (VAC) which can make viewers feel nauseous after prolonged use of the device.

The applicant of this case once proposed a US patent US 2020/0166734 Al as a head-mounted display device and its near-eye light field display device. The near-eye light field display device is equipped with a double telecentric lens group to greatly improve the image quality of the near-eye light field display device; The dimensions of human factors engineering for VR and AR. Another US patent US 7620309 B2 is a plenoptic camera, which obtains a four-dimensional light field by inserting a micro-lens array (Micro-lens array) between the main lens and the photosensitive element. The microlens array placed in front of the photosensitive element can separate the traveling paths of the light rays before they gather on the photosensitive element. If there is no such microlens array, each light in the light field will be collected on the photosensitive element to display an image; however, the summing will cause the angle information in the light field to be lost during the sampling process of the camera.

In view of the development of visual devices such as VR projectors and industrial 4.0 human-machine interfaces, artificial eyes The application of extended reality multi-field of view display has just begun to be developed, and the market scale is just starting; in order to enhance the application of light field imaging on the retina in AR and VR; to make the integrated display information on the retina of the eye to further enhance the quality of image simulation , in order to realize the practicality and popularization of light field vision. Therefore it is necessary to develop a set of inventions that can solve the related VAC problems and the technical shortcomings of the prior art.

The main purpose of the present invention is to overcome the above-mentioned problems encountered in the prior art and provide Provided is a light field generating device that regards near-eye light field display as a light field reproduction process, which fuses images output by the light field generating device and reduces aberrations.

In order to achieve the above purpose, the present invention is a light field generating device, which is suitable for near vision Field display, which includes: a display panel, which will be divided into several sub-areas, and each sub-area will display the light field information of each field angle; an array projection lens group, which will be divided into several sub-areas for display The scene emitted on the panel passes through the array type projection lens group behind the position of the common diaphragm; and a fusion lens group displays the light passing through the array type projection lens group on an imaging plane to form A three-dimensional light field real image; the light field real image generated by the above-mentioned light field generating device will send the image into the pupil of the eye through an eyepiece group, so that the image projected by the light field generating device will be projected on the retina and be perceived as being caused by Sent from a nearly infinite image.

In the above-mentioned embodiments of the present invention, any sub-region on the display panel, the displayed shadow An image is formed on an imaging plane.

In the above embodiments of the present invention, the images displayed in all sub-regions on the display panel, will be imaged on the imaging plane and coincide with each other.

In the above-mentioned embodiments of the present invention, the images displayed in all sub-regions on the display panel are When they are the same, their images on the imaging plane coincide with each other and are similar to each other.

In the above-mentioned embodiments of the present invention, the fusion lens group is a focusing lens system, and the array type The projection lens group is a collimating lens array, the collimating lens array is composed of arrayed collimating lenses, each collimating lens is composed of several lens groups, and the number of the collimating lenses is the same as the number of sub-regions of the display panel numbers are associated.

In the above-mentioned embodiments of the present invention, the distance between the display panel and the collimating lens array The distance between the collimating lens array and the focusing lens system is related to the focal length of the collimating lens array and the focal length of the focusing lens system.

In the above-mentioned embodiments of the present invention, the combination of the array type projection lens group and the fusion lens The F value (f-number) is between 2 and 10.

Please refer to "Fig. 1 to Fig. 7", which are respectively the light field generating device of the present invention The schematic diagram of the structure of the light field generating device of the present invention, the optical path schematic diagram of the light field generating device of the present invention, the MTF diagram of the light field generating device of the present invention, the third-order aberration diagram of the light field generating device of the present invention, the schematic diagram of the application structure of the light field generating device of the present invention in VR, this A schematic diagram of the application of the light field generating device of the present invention in VR, and a schematic diagram of the application architecture of the light field generating device of the present invention in AR. As shown in the figure: the present invention is a light field generating device 1, which is composed of a display panel 11, an array projection lens group 12 and a fusion lens group 13, for displaying light on an imaging plane 14. . The scene from the display panel 11 which is divided into several sub-regions passes through the array type projection lens group 12, after the position of the common diaphragm, and then enters the fusion lens group 13 to form a three-dimensional light field real image; thus The image is sent to the eye through the eyepiece set.

In order to verify the design and check the quality of the light field perceived by the user, the present invention The proposed light field generating device 1 is implemented in the design software CodeV, and the simulation results are checked. The light field generating device 1 designed by the present invention is shown in Figure 1, and the chief rays of all field angles coincide on the imaging plane 14, as shown in Figure 2. In the simulation, the present invention adopts several eye models, and simulates the deformation of the eyepiece group by adjusting the parameters in the eye models for refocusing. In order to check the clarity of the displayed light field, the present invention analyzes the modulation transfer function (modulation transfer function, MTF) of the device shown in Fig. 3 . According to studies of human visual perception using letters as test patterns, the human eye's visual acuity for letters is 5 arc minutes.

In this experiment, the diameter of the eyeball is about 17 millimeters (mm), and the 5 arc minutes on the retina The image size is about 25 micrometers (μm). Therefore, at least 20 cycles/mm (cycles/mm) are required to parse the letters. As shown in Figure 3, at 20 cycles/mm, the design of the present invention can achieve 30% in MTF. Therefore, the displayed light field effect is clear, the effect of far and near is good, and the depth of field is deep.

In addition, the third-order aberration analysis results are shown in Figure 4. By comparing this device with a stand-alone The third-order aberration of the eye model, it can be seen that the eyepiece group reduces the aberration of the light field generating device to a level similar to that of the original eye model, and only distortion exists in various viewing angles. It is also found from Figure 4 that due to the curvature of the retina, the degree of deformation is relatively high, and deformation is actually an important effect of light fusion; in other words, the present invention can achieve a good effect.

The following examples are only examples for understanding the details and connotation of the present invention, but not for limitation The patent scope of the present invention.

In a specific embodiment, the present invention proposes a light field suitable for near-eye light field display Generating device 1, the light field lens of the light field generating device 1 is an eyepiece group 2, and its structure is shown in Figures 5 and 6.

The light field generating device 1 mentioned above includes the display panel 11, the array projection display The lens group 12 and the fusion lens group 13, the display panel 11 is divided into several sub-regions, and the array projection display lens group 12 can be a collimating lens array, and the collimating lens array is composed of an array collimating lens 121 , the number of collimating lenses 121 is associated with the number of sub-regions of the display panel 11, and each collimating lens 121 is composed of several lens groups, and the fusion lens group 13 can be a focusing lens system. Wherein, the distance between the display panel 11 and the collimating lens array, the distance between the collimating lens array and the focusing lens system are related to the focal length of the collimating lens array and the focal length of the focusing lens system ; The F value (f-number) formed by the array type projection lens group and the fusion lens is between 2 and 10.

When used in augmented reality (Augmented reality, AR) and mixed reality (Mixed reality) reality, MR), the light field is projected by the light field generating device 1, and after passing through the eyepiece group 2, the collimated near-eye light field is presented to the eyes of a user; wherein, the light field generating device 1 Each sub-area of the display panel 11 will display the light field information of each field angle, and the collimator lens 121 of the array type projection lens group 12 will collimate the light emitted from the display panel 11 into parallel light. The group 13 converges the light passing through the array projection lens group 12 on an imaging plane 14 . In this embodiment, for any sub-region on the display panel 11, the displayed image will be imaged on an imaging plane 14; and coincide with each other; when the images displayed in all sub-regions on the display panel 11 are the same, the images on the imaging plane 14 overlap and are similar to each other; the display panel 11 can also be a laser beam scanner .

The light beam emitted by the above-mentioned light field generating device 1 passes through a set of lenses 21 After forming the eyepiece group 2, it will enter the pupil of the eye 3, and the image projected by the light field generating device 1 will be projected The shadow is cast on the retina and is perceived as emanating from an image nearly infinitely far away.

The light field generating device 1 mentioned in the present invention, in addition to the VR application frame shown in the fifth figure above, In addition to the structure, it can also be the application structure in AR as shown in Fig. 7. In Figure 7, the present invention proposes a multiple display device to demonstrate the light field generating device 1 for near-eye AR, which is suitable for near-eye light field display. The light field lens of the light field generating device 1 is the eyepiece group 2. The purpose of this embodiment is to use a 45-degree dichroic flat glass 4 to reduce the aberration of on-axis and off-axis light.

In this way, the present invention designs a device for near-eye viewing to reduce most stereoscopic VR devices. An existing light field generating device for human astigmatism adaptation conflict (Vergence accommodation conflict, VAC). The design regards the near-eye light field display as a light field reproduction process, which fuses the images output by the light field generating device and reduces the aberration. By using an eye model, the 3D perception of the generated light field can be verified. The proposed light field generation device has been verified with a focus-tunable camera, and its function is proved to be free from the problem of VAC, enabling AR to be realized.

In summary, the present invention is a light field generating device, which can effectively improve various The disadvantage is that the relay lens module is used to reproduce the light field for the near-eye VR display device, and the eyepiece group of the light field generating device is specially designed to fuse the light field captured by the camera array, and at the same time minimize the aberration of the off-axis and off-axis rays, And this device has been verified by a focal length adjustable camera, and it is proved that its function can avoid the problem of human eye astigmatism adaptation conflict (Vergence accommodation conflict, VAC), so that augmented reality (Augmented reality, AR) can be realized, and then this Inventions that are more advanced, more practical, and more in line with the needs of users have indeed met the requirements for an invention patent application, and a patent application should be filed in accordance with the law.

However, what is described above is only a preferred embodiment of the present invention, and should not be limited thereto. The scope of implementation of the present invention; therefore, all simple equivalent changes and modifications made according to the patent scope of the present invention and the content of the description of the invention should still fall within the scope covered by the patent of the present invention.

1: Light field generating device 11: Display panel 12: Array projection lens group 121: Collimating lens 13: Fusion lens group 14: Imaging plane 2: Eyepiece group 21: Lens 3: eyes 4: Two-way dichroic flat glass

Figure 1 is a schematic diagram of the structure of the light field generating device of the present invention. Figure 2 is a schematic diagram of the light path of the light field generating device of the present invention. Figure 3 is a schematic diagram of the MTF of the light field generating device of the present invention. Figure 4 is a schematic diagram of the third-order aberration of the light field generating device of the present invention. Figure 5 is a schematic diagram of the VR application architecture of the light field generating device of the present invention. Figure 6 is a schematic diagram of the application of the light field generating device of the present invention in VR. Figure 7 is a schematic diagram of the application architecture of the light field generating device of the present invention in AR.

1: Light field generating device

11: Display panel

12: Array projection lens group

121: Collimating lens

13: Fusion lens group

14: Imaging plane

Claims (14)

A light field generating device is suitable for near-eye light field display, which includes: a display panel, which will be divided into several sub-regions, and each sub-region will display light field information of each field angle; an array projection display A mirror group, which divides the image emitted on the display panel into several sub-areas, passes through the array type projection lens group, behind the position of the common diaphragm; and a fusion lens group, passes through the array type projection lens group The light of the group is displayed on an imaging plane to form a three-dimensional light field real image; the light field real image generated by the above-mentioned light field generating device will send the image into the pupil of the eye through an eyepiece group, so that the light field projected by the light field generating device The image is projected onto the retina and is perceived as emanating from a nearly infinite image. According to the light field generating device described in item 1 of the scope of the patent application, the displayed image of any sub-region on the display panel will be imaged on the imaging plane. According to the light field generating device described in item 2 of the scope of application, the images displayed in all sub-regions on the display panel will be imaged on the imaging plane and overlap with each other. According to the light field generating device described in item 3 of the scope of the patent application, when the images displayed in all the sub-regions on the display panel are the same, the images on the imaging plane are overlapped and approximate to each other. According to the light field generating device described in item 1 of the patent scope of the application, the fusion lens group is a focusing lens system, the array type projection lens group is a collimator lens array, and the collimator lens array is composed of an array type collimator lens Composition, each collimating lens is composed of several lens groups, and the number of the collimating lens is associated with the number of sub-regions of the display panel. According to the light field generating device described in item 5 of the patent scope of the application, wherein the display surface The distance between the plate and the collimating lens array, the distance between the collimating lens array and the focusing lens system are related to the focal length of the collimating lens array and the focal length of the focusing lens system. The light field generating device as described in item 1 of the scope of the patent application, wherein the F-number (f-number) of the combination of the array type projection lens group and the fusion lens is between 2 and 10. A light field generating device is suitable for near-eye light field display, which includes: a laser beam scanner, the scanning area of the laser beam scanner is divided into several sub-areas, and each sub-area will display each field angle Light field information; an array type projection lens group, which separates the image emitted by the laser beam scanner into several sub-areas, through the array type projection lens group, behind the position of the common diaphragm; and a fusion mirror The group displays the light passing through the array projection lens group on an imaging plane to form a three-dimensional real image of the light field; the real image of the light field generated by the above-mentioned light field generating device will send the image to the eyes through an eyepiece group The pupil, so that the image projected by the light field generating device will be projected on the retina and be perceived as being emitted by an image nearly infinitely far away. According to the light field generating device described in claim 8 of the patent application, any sub-area in the scanning area of the laser beam scanner will be imaged on the imaging plane. According to the light field generating device described in claim 9 of the scope of the patent application, the images displayed in all sub-areas on the scanning area of the laser beam scanner will be imaged on the imaging plane and overlap with each other. According to the light field generating device described in item 10 of the patent scope of the application, when the images displayed in all sub-areas on the scanning area of the laser beam scanner are the same, the images on the imaging plane overlap each other and are similar to each other. According to the light field generating device described in item 8 of the patent scope of the application, the fusion lens group is a focusing lens system, the array type projection lens group is a collimating lens array, and the collimating lens array is composed of an array The collimating lens is composed of columns, and each collimating lens is composed of several lens groups, and the number of the collimating lens is associated with the number of sub-regions of the laser beam scanner. According to the light field generating device described in item 12 of the patent scope of the application, the distance between the laser beam scanner and the collimating lens array, and the distance between the collimating lens array and the focusing lens system are: It is associated with the focal length of the collimating lens array and the focal length of the focusing lens system. The light field generating device as described in item 8 of the scope of the patent application, wherein the F value of the combination of the array projection lens group and the fusion lens is between 2 and 10.

Images