TWI868472B - Image sensing device and head-mounted display - Google Patents

Abstract

An image sensing device including a frame body, a lens group, a position adjuster, a plurality of antenna elements and an image sensing element is provided. The frame body has an accommodating space. The lens group is arranged in the accommodating space. The position adjuster is connected between the lens group and the frame to make the lens group move in the accommodating space. A plurality of antenna elements are disposed on the second side of the lens group to provide sensing beams to the target area. The image sensing element is disposed on the second side of the lens group for sensing the reflected light beam of the target area. In addition, a head-mounted display device is also provided.

Description

Image sensing device and head mounted display device

The present invention relates to an electronic device, and in particular to an image sensing device and a head-mounted display device.

As the technology industry develops, the types, functions and usage of electronic devices are becoming more and more diverse, and wearable electronic devices that can be directly worn on the user's body have also emerged. There are many types of head-mounted electronic devices, such as eye mask-type head-mounted electronic devices. After the user wears this type of electronic device, in addition to being able to see three-dimensional images, the images will also change as the user's head turns, providing the user with a more immersive experience.

However, in the current design of head-mounted electronic devices, the modules with various functions in the structure have resulted in the volume of the head-mounted electronic devices remaining high. In addition, the current development also has the problem that the coverage range of the radar beam or the diversity characteristics of the radar beam are limited by the limited number of antenna array elements, and the problem that the image and radar sensors need to be configured at the same time at a specific position on the head-mounted electronic device.

The present invention provides an image sensing device and a head mounted display device, which can integrate an antenna and an image sensing element into a single module to form an optimal sensing position and increase different beam directions.

The present invention provides an image sensing device, including a frame, a lens group, a position adjuster, a plurality of antenna elements and an image sensing element. The frame has a storage space. The lens group is arranged in the storage space. The position adjuster is connected between the lens group and the frame to enable the lens group to move in the storage space. The plurality of antenna elements are arranged on the second side of the lens group to provide a sensing beam to a target area. The image sensing element is arranged on the second side of the lens group to sense a reflected beam of the target area.

The present invention further provides a head-mounted display device, including an image sensing device and a display. The image sensing device includes a frame, a lens group, a position adjuster, a plurality of antenna elements and an image sensing element. The frame has a storage space. The lens group is disposed in the storage space. The position adjuster is connected between the lens group and the frame to enable the lens group to move in the storage space. A plurality of antenna elements are disposed on the second side of the lens group to provide a sensing beam to a target area. The image sensing element is disposed on the second side of the lens group to sense a reflected light beam of the target area. The display is electrically connected to the image sensing device.

Based on the above, in the image sensing device and head-mounted display device of the present invention, the image sensing device includes a frame, a lens group, a position adjuster, a plurality of antenna elements and an image sensing element. The position adjuster is connected between the lens group and the frame to enable the lens group to move in the accommodating space. The sensing beams provided by the plurality of antenna elements are transmitted through the lens group to the target area to form a scanning beam, and the reflected light beam reflected by the target area is transmitted through the lens group to the image sensing element. Therefore, by configuring the plurality of antenna elements adjacent to the lens group, the reflected light beam provided by the target area and the sensing beams provided by the plurality of antenna elements can share the lens group, and then can be integrated into a single module to form an optimal sensing position, while saving the device volume. In addition, by configuring a position adjuster to move the lens set, an optical vibration-proof effect can be provided and different beam directions can be added to the scanning beam.

In order to make the above features and advantages of the present invention more clearly understood, embodiments are specifically cited below and described in detail with reference to the accompanying drawings.

FIG1 is a schematic diagram of a head-mounted display device of an embodiment of the present invention. Please refer to FIG1. An embodiment of the present invention provides a head-mounted display device 50, which allows a user 10 to wear and experience the effects of virtual reality, augmented reality or mixed reality. In this embodiment, the head-mounted display device 50 includes an image sensing device 100 and a display 200. The image sensing device 100 is used to sense the target area 20, and the display 200 is electrically connected to the image sensing device 100 to generate an image screen according to the sensing result of the image sensing device 100.

FIG2 is a schematic diagram of an image sensing device of the head-mounted display device of FIG1 . FIG3A and FIG3B are schematic diagrams of the image sensing device of FIG2 in different states, respectively. Please refer to FIG1 , FIG2 and FIG3A simultaneously. In this embodiment, the image sensing device 100 includes a frame 110, a lens assembly 120, a position adjuster 130, a plurality of antenna elements 140 and an image sensing element 150. The frame 110 has a containing space E, and the lens assembly 120 is disposed in the containing space E. The frame 110 is connected to other structures of the head-mounted display device 50, such as a housing. The lens assembly 120 includes an optical axis I and a plurality of lens elements 122 arranged along the optical axis I. For example, the lens assembly 120 includes a combination of one or more optical lenses with refractive power, such as various combinations of non-planar lenses such as biconcave lenses, biconvex lenses, concave-convex lenses, convex-concave lenses, plano-convex lenses, and plano-concave lenses. In this embodiment, a plurality of lens elements 122 are arranged along the optical axis I, as shown in FIG. 3A . The image sensing element 150 is disposed on the second side A2 of the lens assembly 120 and can be used to sense the reflected light beam L1 of the target area 20, thereby optically imaging the facial features of the target area 20 of the user 10. Specifically, the reflected light beam L1 emitted by the target area 20 is transmitted from the first side A1 to the second side A2 through the lens assembly 120 to the image sensing element 150 , wherein the direction of the second side A2 is opposite to the direction of the first side A1 .

Please refer to Figures 1, 2 and 3B. A plurality of antenna elements 140 are disposed on the second side A2 of the lens assembly 120 to provide a sensing beam L2 to the target area 20 to form a scanning beam B with a specific direction. Specifically, the sensing beam L2 provided by the antenna element 140 is transmitted from the second side A2 to the first side A1 through the lens assembly 120 to the target area 20, wherein the direction of the second side A2 is opposite to the direction of the first side A1. In the present embodiment, the plurality of antenna elements 140 are configured in four numbers, for example, and the orthographic projections of the plurality of antenna elements 140 on the reference plane F surround the orthographic projection of the lens assembly 120 on the reference plane F, wherein the extension direction of the reference plane F is perpendicular to the extension direction of the optical axis I, and the orthographic projections of the plurality of antenna elements 140 are evenly distributed around the orthographic projection of the lens assembly 120, but the present invention is not limited thereto. In the present embodiment, the sensing beams L2 respectively provided by the plurality of antenna elements 140 can be transmitted to different surface areas of the target area 20 (i.e., the area illuminated by the scanning beam B, as shown in FIG. 1 ) through the optical effect of the lens assembly 120. In other words, the image sensing device 100 of this embodiment configures multiple antenna elements 140 adjacent to the lens group 120, so that the reflected light beam L1 provided by the target area 20 and the sensing beam L2 provided by the multiple antenna elements 140 can share the lens group 120, thereby integrating the antenna element 140 and the image sensing element 150 into a single module to form a better sensing position, while saving the device volume.

FIG4 is a schematic diagram of the lens group of the image sensing device of an embodiment of the present invention when it moves. Please refer to FIG1, FIG2 and FIG4. The position adjuster 130 is connected between the lens group 120 and the frame 110, and the lens group 120 is suitable for moving in the accommodating space E through the position adjuster 130. For example, in this embodiment, the position adjuster 130 includes a plurality of elastic members 132, which are respectively connected between the frame 110 and the lens group 120. The plurality of elastic members 132 are used to provide a shock-absorbing function for the lens group 120, which can reduce the vibration of the lens group 120. This embodiment can further improve the optical precision of the image sensing device 100 through the shock-absorbing function provided by the position adjuster 130. In addition, in this embodiment, the image sensing device 100 further includes a micro-electromechanical system (not shown), which is electrically connected to the position adjuster 130. The micro-electromechanical system controls the position adjuster 130 to move the position of the lens assembly 120 in the accommodation space E. In other words, in this embodiment, in addition to providing a passive shock-absorbing function for the lens assembly 120, the position adjuster 130 can also actively move the position of the lens assembly 120 through the control of the micro-electromechanical system.

It is worth mentioning that the sensing beam L2 provided by the antenna element 140 can change its beam direction by moving the lens assembly 120 in the accommodation space E. As shown in FIG. 4 , when the position of the lens assembly 120 is unchanged, the antenna element 140 provides a scanning beam B in one beam direction. When the position of the lens assembly 120 is changed to position 120_1, the antenna element 140 provides a scanning beam B1 in another beam direction. When the position of the lens assembly 120 is changed to position 120_2, the antenna element 140 provides a scanning beam B2 in a third different beam direction. In this way, the beam direction of the scanning beam B can be further adjusted by moving the position of the lens assembly 120, thereby generating scanning beams B, B1, and B2 with different beam directions, thereby improving the sensing effect by switching the scanning beams B, B1, and B2 with different beam directions.

FIG5 is a timing diagram of an image sensing device according to an embodiment of the present invention switching between the first mode and the second mode in a timing sequence. Please refer to FIG1, FIG4 and FIG5. In one embodiment, the image sensing device 100 can switch the movement state of the lens group 120 in a timing sequence. Specifically, the image sensing device 100 switches between the first mode and the second mode in a timing sequence, and in the first mode, the image sensing device 100 activates a plurality of antenna elements 140, and also activates a micro-electromechanical system to move the lens group 120. Therefore, in the first mode, the sensing beam L2 changes the beam direction through the movement of the lens group 120 in the accommodating space E, thereby changing the beam direction and the irradiation range of the scanning beam B on the target area 20. In the second mode, the image sensing device 100 activates the image sensing element 150 to collect visible light. In other words, when the image sensing device 100 is switched to the first mode, the image sensing element 150 is turned off and the antenna element 140 and the micro-electromechanical system are activated. At this time, the lens group 120 is actively moved and has the projected scanning beam B to perform the radar scanning function C1. When the image sensing device 100 is switched to the second mode, the image sensing element 150 is activated and the antenna element 140 and the micro-electromechanical system are turned off. At this time, the lens group 120 is non-actively moved and has the shock-absorbing function C2. In this way, the effect of switching the radar scanning function C1 and the shock-absorbing function C2 at any time can be achieved by continuously switching and activating different elements. In addition, when executing the radar scanning function C1, since the MEMS continuously moves the lens set 120 to different positions, the direction and phase of the scanning beam B can also be gradually changed at any time, thereby improving the diversity of the scanning beam B, as shown in FIG5 .

In summary, in the image sensing device and head-mounted display device of the present invention, the image sensing device includes a frame, a lens group, a position adjuster, a plurality of antenna elements and an image sensing element. The position adjuster is connected between the lens group and the frame to enable the lens group to move in the accommodating space. The sensing beams provided by the plurality of antenna elements are transmitted through the lens group to the target area to form a scanning beam, and the reflected light beam reflected by the target area is transmitted through the lens group to the image sensing element. Therefore, by configuring the plurality of antenna elements adjacent to the lens group, the reflected light beam provided by the target area and the sensing beams provided by the plurality of antenna elements can share the lens group, and then can be integrated into a single module to form an optimal sensing position, while saving the device volume. In addition, by configuring a position adjuster to move the lens set, an optical vibration-proof effect can be provided and different beam directions can be added to the scanning beam.

Although the present invention has been disclosed as above by the embodiments, they are not intended to limit the present invention. Any person with ordinary knowledge in the relevant technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be defined by the scope of the attached patent application.

10: User 20: Target area 50: Head mounted display device 100: Image sensing device 110: Frame 120: Lens assembly 120_1, 120_2: Position 122: Lens element 130: Position adjuster 132: Elastic element 140: Antenna element 150: Image sensing element 200: Display A1: First side A2: Second side B, B1, B2: Scanning beam C1: Radar scanning function C2: Shock absorption function E: Accommodation space F: Reference plane I: Optical axis L1: Reflection beam L2: Sensing beam

FIG. 1 is a schematic diagram of a head-mounted display device of an embodiment of the present invention. FIG. 2 is a schematic diagram of an image sensing device of the head-mounted display device of FIG. 1 . FIG. 3A and FIG. 3B are schematic diagrams of the image sensing device of FIG. 2 in different states, respectively. FIG. 4 is a schematic diagram of the lens group of the image sensing device of an embodiment of the present invention when moving. FIG. 5 is a timing schematic diagram of the image sensing device of an embodiment of the present invention switching to the first mode and the second mode in a timing sequence.

10: User

20: Target area

50: Head-mounted display device

100: Image sensing device

200: Display

B: Scanning beam

Claims (20)

An image sensing device comprises: a frame having a storage space; a lens group disposed in the storage space; a position adjuster connected between the lens group and the frame to move the lens group in the storage space; a plurality of antenna elements disposed on the second side of the lens group to provide a sensing beam to a target area; and an image sensing element disposed on the second side of the lens group to sense the reflected beam of the target area. An image sensing device as described in claim 1, wherein the lens assembly includes an optical axis and a plurality of lens elements arranged along the optical axis. An image sensing device as described in claim 2, wherein the multiple lens elements are arranged along the optical axis. An image sensing device as described in claim 1, wherein the position adjuster includes a plurality of elastic members respectively connected between the frame and the lens assembly. The image sensing device as described in claim 4 further comprises: A micro-electromechanical system electrically connected to the position adjuster for controlling the position adjuster to move the position of the lens assembly in the accommodation space. An image sensing device as described in claim 5, wherein the image sensing device switches between a first mode and a second mode in a timing sequence, wherein in the first mode, the image sensing device activates the multiple antenna elements, and in the second mode, the image sensing device activates the image sensing element. An image sensing device as described in claim 6, wherein in the first mode, the image sensing device also activates the micro-electromechanical system to control the position adjuster to move the lens assembly. An image sensing device as described in claim 1, wherein the sensing beam is moved in the accommodation space by the lens assembly to change the beam direction and the irradiation range on the target area. An image sensing device as described in claim 1, wherein the orthographic projections of the multiple antenna elements on the reference plane surround the orthographic projection of the lens group on the reference plane, the lens group includes an optical axis, and the extension direction of the reference plane is perpendicular to the extension direction of the optical axis. An image sensing device as described in claim 1, wherein the sensing beams provided by the multiple antenna elements are respectively transmitted to different surface areas of the target area. A head-mounted display device comprises: An image sensing device comprises: A frame having a storage space; A lens group disposed in the storage space; A position adjuster connected between the lens group and the frame to move the lens group in the storage space; A plurality of antenna elements disposed on the second side of the lens group to provide a sensing beam to a target area; An image sensing element disposed on the second side of the lens group to sense a reflected beam of the target area; and A display electrically connected to the image sensing device. A head-mounted display device as described in claim 11, wherein the lens group includes an optical axis and a plurality of lens elements arranged along the optical axis. A head-mounted display device as described in claim 12, wherein the multiple lens elements are arranged along the optical axis. A head-mounted display device as described in claim 11, wherein the position adjuster includes a plurality of elastic members respectively connected between the frame and the lens group. A head-mounted display device as described in claim 14, wherein the image sensing device further includes a micro-electromechanical system electrically connected to the position adjuster for controlling the position adjuster to move the position of the lens group in the accommodating space. A head-mounted display device as described in claim 15, wherein the image sensing device switches between a first mode and a second mode in a timing sequence, wherein in the first mode, the image sensing device activates the multiple antenna elements, and in the second mode, the image sensing device activates the image sensing element. A head-mounted display device as described in claim 16, wherein in the first mode, the image sensing device also activates the micro-electromechanical system to control the position adjuster to move the lens group. A head-mounted display device as described in claim 11, wherein the sensing beam moves through the lens group in the accommodation space to change the beam direction and the irradiation range on the target area. A head-mounted display device as described in claim 11, wherein the orthographic projections of the multiple antenna elements on the reference plane surround the orthographic projection of the lens group on the reference plane, the lens group includes an optical axis, and the extension direction of the reference plane is perpendicular to the extension direction of the optical axis. A head-mounted display device as described in claim 11, wherein the sensing beams provided by the multiple antenna elements are respectively transmitted to different surface areas of the target area.

Images