TWI727511B - Near-eye displaying and image capturing head mounted device - Google Patents

Abstract

A near-eye displaying and image capturing head mounted device is described. The near-eye displaying and image capturing head mounted device includes an imaging unit. The imaging unit is disposed on a glasses. The imaging unit includes a display, an optical mirror set, and a video camera. The display is disposed at a side of a temple of a spectacles frame of the glasses, and is configured to project image light beams. The optical mirror set is disposed at a side of the display, and is configured to guide the image light beams to at least one lens of the glasses. The video camera is disposed in front of the at least one lens, and is configured to perform a near-eye image capturing operation on a user of the glasses.

Description

Near-eye display and imaging head-mounted device

The present invention relates to a wearable electronic device, and particularly relates to a near-eye display and image capturing head-mounted device.

At present, most of the near-eye display devices are installed on the user's glasses frame, and the near-eye display device is located in the field of view of at least one pupil of the user to improve the viewing comfort. However, this near-eye display device cannot perform near-eye imaging of the wearer.

Another type of head-mounted display device is to place a camera on the front of the head-mounted display device to achieve the effect of switching scenes. After the user wears the head-mounted display device, the user can switch to display the external scene at any time, thereby avoiding the problem of equipment wear caused by frequently taking the device when switching scenes. However, such a head-mounted display device can only photograph the area in front of the user, and cannot take near-eye images of the wearer.

There is also a head-mounted display device in which the side surface of the optical waveguide element is attached to the lens surface of the glasses to enhance the structural strength and avoid the fragmentation of the projection display device. However, this type of head-mounted display device cannot adjust its position on the frame, and also cannot perform near-eye imaging of the wearer.

Therefore, one object of the present invention is to provide a near-eye display and image capturing head-mounted device, the display device of which is arranged on the side of the glasses frame, and the image beam formed by the display device on the side of the glasses frame is formed by an optical lens group. It is transmitted to the field of vision of at least one pupil of the user, so that the user can see the image displayed by the display device and the actual environment image at the same time, achieving the integration of virtual and real images.

Another object of the present invention is to provide a near-eye display and imaging head-mounted device, the camera of which is set in front of the user’s glasses, and can perform near-eye imaging of the user. Therefore, the near-eye display and imaging head-mounted device has It can perform body identification functions such as iris recognition and eye tracking for users, so that remote authentication can be performed to improve information security management and control. In addition, the use of a camera with iris recognition function and a display device to display the exam questions can not only certify the exam personnel to avoid the drawbacks of the exam, but also improve the convenience of remote exams and reduce the planning of exam occasions. Manpower expenses with invigilators.

Another object of the present invention is to provide a near-eye display and image capturing head-mounted device, the camera of which can choose different types of photography modes, and is matched with a suitable image recognition method, so that it can perform fundus photography, eyeball examination, and Eyeball perception detection, color blindness detection, eyeball observation, lens curvature change and lens focus shooting, and human eye detection such as zooming pupils. Therefore, the near-eye display and imaging head-mounted device can be used in general clinics or medical stations to check for early eye problems, helping patients to detect and prevent eye diseases early.

According to the above objective of the present invention, a near-eye display and image capturing head-mounted device is provided. The near-eye display and imaging head-mounted device includes an imaging unit. The imaging unit is arranged on the glasses. The imaging unit includes a display device, an optical lens group, and a camera. The display device is arranged beside the temples of the glasses frame, and is configured to project image beams. The optical lens group is arranged on one side of the display device and configured to guide the image beam to at least one lens of the glasses. The camera is arranged in front of at least one lens and is configured to perform near-eye image capturing operations for the user of the glasses.

According to an embodiment of the present invention, the above-mentioned optical lens assembly includes a first reflecting mirror and a second reflecting mirror. The first reflecting mirror is arranged in front of the display device. The second reflecting mirror is arranged on one side of the first reflecting mirror. The first reflector is configured to reflect the image beam projected by the display device to the second reflector, and the second reflector is configured to reflect the image beam to at least one lens.

According to an embodiment of the present invention, the above-mentioned optical lens group further includes a first lens and a second lens. The first lens is arranged between the display device and the first reflection mirror, and is configured to collimate the image beam projected by the display device toward the first reflection mirror. The second lens is arranged between the second reflector and the at least one lens, and is configured to focus the image beam.

According to an embodiment of the present invention, the above-mentioned first lens and second lens are both aspherical lenses.

According to an embodiment of the present invention, the above-mentioned first reflector is an aspherical reflector.

According to an embodiment of the present invention, the above-mentioned second reflector is a flat reflector and has optical characteristics of semi-transmissive and semi-reflective.

According to an embodiment of the present invention, the above-mentioned second mirror is interposed between the camera and at least one lens, and the camera can perform near-eye imaging operations through the second mirror.

According to an embodiment of the present invention, the above-mentioned display device is an organic light-emitting diode (OLED) display device or a liquid crystal display device.

According to an embodiment of the present invention, the aforementioned camera is an iris camera configured to perform iris recognition and/or eye tracking of the user's eyes.

According to an embodiment of the present invention, the above-mentioned near-eye display and image capturing head-mounted device further includes a connector, the connector is detachably disposed on the temples of the frame, and the connector is configured to connect the imaging unit to the frame of the frame. On the mirror foot.

100‧‧‧ Near-eye display and imaging head-mounted device

110‧‧‧Imaging unit

112‧‧‧Display device

114‧‧‧Optical lens group

114a‧‧‧First reflector

114a’‧‧‧Reflecting surface

114b‧‧‧Second mirror

114c‧‧‧First lens

114d‧‧‧Second lens

116‧‧‧Camera

118‧‧‧Shell

120‧‧‧Connector

200‧‧‧Glasses

210‧‧‧Frame

212‧‧‧Mirror feet

214‧‧‧Frame

220‧‧‧Lens

E‧‧‧Eyes

L‧‧‧Image beam

In order to make the above and other objectives, features, advantages and embodiments of the present invention more comprehensible, the description of the accompanying drawings is as follows:

[Fig. 1] is a schematic diagram showing a near-eye display and imaging head-mounted device installed on glasses according to an embodiment of the present invention;

[Fig. 2] is a schematic diagram of a near-eye display and image capturing head-mounted device according to an embodiment of the present invention; and

[Fig. 3] is a schematic diagram of the light path of a near-eye display and image capturing head-mounted device according to an embodiment of the present invention.

Regarding the "first", "second", etc. used in this text, it does not particularly mean the order or the sequence, but only to distinguish the elements or operations described in the same technical terms.

Please refer to FIGS. 1 and 2, which respectively illustrate a schematic diagram of a near-eye display and imaging head-mounted device mounted on glasses according to an embodiment of the present invention, and a near-eye display and image capture device according to an embodiment of the present invention. A schematic diagram of the device for taking an image of the headset. The near-eye display and image capturing head-mounted device 100 of this embodiment can be installed on the user's glasses 200 to realize a head-mounted type. Generally speaking, the glasses 200 include a frame 210 and two lenses 220, wherein the frame 210 includes two temples 212 and two frames 214. The two temples 212 can be respectively mounted on the two ears of the user, and the two spectacle frames 214 can respectively accommodate the two lenses 220.

The near-eye display and imaging head-mounted device 100 may mainly include at least one imaging unit 110. For example, as shown in FIGS. 1 and 2, the near-eye display and imaging head-mounted device 100 includes an imaging unit 110, and the imaging unit 110 is disposed on the right side of the frame 210 of the glasses 200. In other examples, the near-eye display and imaging head-mounted device 100 may include two imaging units 110, and the two imaging units 110 may be respectively disposed on the left and right sides of the frame 210 of the glasses 200.

In some embodiments, each imaging unit 110 may include a display device 112, an optical lens group 114, and a camera 116. As shown in FIG. 1, a housing 118 can be used to integrate the display device 112, the optical lens group 114, and the camera 116 together for convenient use. The display device 112 can be set in Next to the temple 212 of the frame 210 of the glasses 200. Please also refer to FIG. 3, which is a schematic diagram of the light path of a near-eye display and imaging head-mounted device according to an embodiment of the present invention. The display device 112 is configured to project an image light beam L. The image beam L projected by the display device 112 may depend on the actual application requirements of the near-eye display and imaging head-mounted device 100. For example, the image light beam L may be a virtual image light beam, an image light beam required for human eye detection, or an image light beam for examination questions, and so on. In some exemplary examples, the display device 112 may be an organic light emitting diode display device or a liquid crystal display device. In addition, the display device 112 may be a display with a resolution of HD or higher to provide excellent display quality.

The optical lens group 114 is arranged on one side of the display device 112. For example, as shown in FIG. 2, the optical lens group 114 is disposed on the front side of the display device 112, so that the display device 112 can directly project the image beam L toward the optical lens group 114. The optical lens group 114 is configured to guide the image beam L projected by the display device 112 to a lens 220 of the glasses 200, as shown in FIG. 3. In other examples, the optical lens group 114 can guide the image beam L projected by the display device 112 to the two lenses 220 of the glasses 200 so that the two eyes of the user can simultaneously view the image formed by the image beam L.

In the example of FIG. 2, since the display device 112 is arranged beside the lens 212 of the frame 210, the optical lens group 114 must be used to guide the image beam L projected by the display device 112 to at least one lens 220 of the glasses 200 , To facilitate the user's eyes E to see. The optical lens group 114 may, for example, include a combination of several mirrors, or a combination of several mirrors and lenses. In some examples, the optical lens group 114 includes a first mirror 114a and a second mirror 114a. 114b. The first reflecting mirror 114a may be arranged in front of the display device 112, and the second reflecting mirror 114b may be arranged on one side of the first reflecting mirror 114a. The first reflecting mirror 114a is configured to deflect the image beam L projected by the display device 112 toward it and reflect it to the second reflecting mirror 114b. The second mirror 114b is configured to redirect the image light beam L reflected by the first mirror 114a and reflect it to the lens 220 of the glasses 200. In some exemplary examples, the first reflecting mirror 114a may have a concave arc-shaped reflecting surface 114a', but the reflecting surface 114a' is an aspherical surface, that is, the first reflecting mirror 114a is an aspherical reflecting mirror. In this way, the first mirror 114a can also amplify the image light beam L. The second mirror 114b can be a flat mirror and has optical characteristics of half-transmission and half-reflection. For example, the second reflecting mirror 114b can be arranged directly in front of the lens 220, and the first reflecting mirror 114a and the second reflecting mirror 114b can be arranged at the same level, and the second reflecting mirror 114b can be inclined at an angle with respect to this level. , For example, 45 degrees, so that the image light beam L can be reflected to the lens 220 smoothly. Thereby, the user's eyes E can see the image light beam L projected by the display device 112 and the actual environment image around the user.

Please continue to refer to FIGS. 2 and 3. In some examples, the optical lens group 114 may further optionally include a first lens 114 c and a second lens 114 d. The first lens 114c may be disposed in front of the display device 112 and between the display device 112 and the first mirror 114a. The first lens 114c is configured to collimate the image light beam L projected by the display device 112 toward the first mirror 114a. The second lens 114d is disposed between the second mirror 114b and the lens 220 of the glasses 200. The second lens 114d is configured to focus the image beam L reflected by the second mirror 114b. In some exemplary examples, both the first lens 114c and the second lens 114d are aspheric lenses.

Since the first reflector 114a can amplify the image beam L projected by the display device 112, it is not necessary to use a larger-sized display device 112 to provide the image required by the user, thereby enabling lightweight and miniaturized near-eye display and Take an image of the headset 100.

Please continue to refer to FIGS. 2 and 3, the camera 116 is disposed in front of the lens 220 of the glasses 200 and also in front of the second mirror 114b. The camera 116 is configured to perform a near-eye image capturing operation on the eyes E of the user of the glasses 200. In some exemplary examples, the second mirror 114b is between the camera 116 and the lens 220, and the camera 116 can perform a near-eye imaging operation on the eye E through the second mirror 114b, that is, the light source emitted by the camera 116 can penetrate The second mirror 114b and the second lens 114d can receive the image light from the eye E through the second mirror 114b.

The camera 116 can select different types of photography modes according to actual usage requirements. For example, the camera 116 can be an iris camera, and can perform iris recognition and/or eye tracking of the user's eyes, thereby performing remote authentication and improving security control. In such an example, the near-eye display and image capturing head-mounted device 100 can be applied to examination occasions, in which the camera 116 can be used to identify the examinee's iris to identify the examinee's identity, and then the display device 112 can be used to pass The optical lens group 114 displays the test questions corresponding to the tester. Such an application can not only certify test personnel to avoid the drawbacks of the test, but also improve the convenience of remote test, and greatly reduce the labor cost of planning test occasions and invigilators.

In other examples, the camera 116 can be a fundus photography inspection instrument, so the near-eye display and imaging head-mounted device 100 can be used directly Perform fundus photography and examination of the eye E of the patient. Traditionally, retinal examination is an indirect fundus examination with mydriasis. The process takes at least 30 minutes to 1 hour. Mydriatics can cause blurred vision and photophobia, making the subject unable to drive or work. When the near-eye display and imaging head-mounted device 100 is used for fundus photography and inspection, it can be completed in 5 minutes without dripping mydriatics, which not only reduces the discomfort of the subject’s eyes, but also greatly shortens the inspection time. .

In some other examples, combining the near-eye display function and the eyeball photography function of the near-eye display and imaging head-mounted device 100, and through a series of color-weak image designs, it can directly detect the human eye's response to various colors, thereby enabling detailed Analyze the level of human eye color weakness.

Therefore, by selecting different types of cameras 116 and corresponding image recognition and detection methods, the near-eye display and imaging head-mounted device 100 can perform fundus photography, eyeball inspection, eyeball perception detection, color blindness detection, eyeball observation, and lens for the user. The curvature change and lens focus shooting, and human eye detection such as zooming pupils.

Please continue to refer to FIGS. 1 and 2, the near-eye display and imaging head-mounted device 100 may optionally include a connector 120. In some examples, the connecting member 120 is detachably disposed on the temple 212 of the frame 210. The connecting member 120 can be combined with the mirror foot 212 and the imaging unit 110, so the imaging unit 110 can be joined to the mirror foot 212 of the frame 210 by using the connecting member 120. In some exemplary examples, the imaging unit 110 can be rotated by adjusting the connecting member 120, and the position of the imaging unit 110 on the frame 210 can be adjusted to facilitate the user to adjust the display and image capturing positions.

It can be seen from the above-mentioned embodiments that one of the advantages of the present invention is that the display device of the near-eye display and imaging head-mounted device of the present invention is arranged on the side of the glasses frame, and the optical lens group is used to place the display device on the side of the frame. The image beam formed by the edge is transmitted to the field of vision of at least one pupil of the user, so that the user can see the image displayed by the display device and the actual environment image at the same time, achieving the visual effect of integrating virtual and real images.

It can be seen from the above-mentioned embodiments that another advantage of the present invention is that because the camera of the near-eye display and imaging head-mounted device of the present invention is set in front of the user’s glasses, it can perform near-eye imaging of the user, so the near-eye display The imaging head-mounted device has the functions of iris recognition and eye tracking for the user, which can perform remote authentication and improve information security management and control. In addition, the camera can be used to authenticate users such as iris recognition, and then the test questions can be displayed by the display device. This not only can authenticate the test personnel to avoid the drawbacks of the test, but also enhance the convenience of the remote test. It can reduce the labor cost of planning examination occasions and invigilators.

It can be seen from the above-mentioned embodiments that another advantage of the present invention is that the camera of the near-eye display and imaging head-mounted device of the present invention can select different types of photography modes according to actual needs, and match the appropriate image recognition method. It can perform fundus photography, eyeball inspection, eyeball perception detection, color blindness detection, eyeball observation, lens curvature change and lens focus shooting, and zoom pupil and other human eye detection. Therefore, the near-eye display and imaging head-mounted device can be used in general clinics or medical stations to check for early eye problems, helping patients to detect and prevent eye diseases early.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in this technical field can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be subject to those defined by the attached patent scope.

100‧‧‧ Near-eye display and imaging head-mounted device

110‧‧‧Imaging unit

112‧‧‧Display device

114‧‧‧Optical lens group

114a‧‧‧First reflector

114a’‧‧‧Reflecting surface

114b‧‧‧Second mirror

114c‧‧‧First lens

114d‧‧‧Second lens

116‧‧‧Camera

120‧‧‧Connector

200‧‧‧Glasses

210‧‧‧Frame

212‧‧‧Mirror feet

214‧‧‧Frame

220‧‧‧Lens

E‧‧‧Eyes

L‧‧‧Image beam

Claims (10)

A near-eye display and image capturing head-mounted device, comprising: an imaging unit, arranged on a pair of glasses, wherein the imaging unit comprises: a display device, arranged next to a temple of a frame of the glasses, and configured to project An image beam; an optical lens group arranged on one side of the display device and configured to guide the image beam to at least one lens of the glasses; and a camera arranged in front of the at least one lens and arranged to match A user of the glasses performs a near-eye image capturing operation, wherein the camera is further configured to emit a light source to penetrate the optical lens group and receive image light from one of the eyes of the user through the optical lens group. For example, the near-eye display and imaging head-mounted device of the first item of the scope of patent application, wherein the optical lens group includes: a first reflector arranged in front of one of the display devices; and a second reflector arranged on the first One side of a reflector, wherein the first reflector is configured to reflect the image beam projected by the display device to the second reflector, and the second reflector is configured to reflect the image beam to the at least one lens . For example, the near-eye display and imaging head-mounted device of the second item of the scope of patent application, wherein the optical lens group further includes: a first lens arranged between the display device and the first reflecting mirror and configured to collimate the The image beam projected by the display device toward the first reflector; and A second lens is arranged between the second reflector and the at least one lens, and is configured to focus the image beam. For example, in the near-eye display and imaging head-mounted device of the third item of the scope of patent application, each of the first lens and the second lens is an aspheric lens. For example, the near-eye display and image capturing head-mounted device of item 3 of the scope of patent application, wherein the first reflector is an aspherical reflector. For example, the near-eye display and imaging head-mounted device of the third item of the scope of patent application, wherein the second mirror is a flat mirror and has optical characteristics of half-transmission and half-reflection. For example, the near-eye display and imaging head-mounted device of the second scope of the patent application, wherein the second mirror is between the camera and the at least one lens, and the camera can perform the near-eye imaging through the second mirror operating. For example, the near-eye display and image capturing head-mounted device in the first item of the scope of patent application, wherein the display device is an organic light-emitting diode display device or a liquid crystal display device. For example, the near-eye display and imaging head-mounted device of the first item of the scope of patent application, wherein the camera is an iris camera configured to perform iris recognition and/or eye tracking of the user's eyes. For example, the near-eye display and imaging head-mounted device of item 1 of the scope of patent application further includes a connecting piece detachably arranged on the temples of the frame, wherein the connecting piece is configured to connect the imaging unit to the On the foot of the frame.

Images