TW201809799A - Head-mounted display device and binocular vision image calibrating method of the same - Google Patents

Abstract

Disclosed is a head-mounted display device including: a head-mount display having a left lens, a right lens, a left display screen and a right display screen; a lens position adjusting element of which a first lever is connected to the left lens and the right lens and is configured to be triggered to respectively move the left lens and the right lens laterally with respect to the respective left and right eyes of a user; and a disparity adjusting element provided with a second lever and a disparity adjusting unit which is in signal connection with the left display screen, the right display screen and the second lever, and is configured to adjust an imaging angle and a relative position of the left and right images respectively on the left and right display screens corresponding to the preset visual angle of the user in response to triggering of the second lever.

Description

Head-mounted display device and binocular vision image positioning method for head-mounted display device

The invention relates to a head-mounted display device, in particular to a head-mounted display device and a binocular visual image positioning method for the head-mounted display device.

A head-mounted display is a display device worn by a user on a head, and includes a lens and a display screen placed in front of the eyes of the user. The head-mounted display includes a monocular head-mounted display and a binocular head-mounted display. The monocular head-mounted display includes a set of lenses and a display screen arranged in front of the left or right eye. The binocular head-mounted display is on the left. A set of lenses and a display screen are set in front of the eye and the right eye to produce a stereoscopic visual effect. Many users of binocular head-mounted displays experience dizziness when using the display. One of the reasons is that the interpupillary distance (IPD) of the display is not adjusted properly. When normal people look at an object, the two visual axes (Visual Axis) passing through the center of the pupils of the two eyes and orthogonal to the retina are parallel to each other. If the interpupillary distance value is not adjusted properly, the two visual axes are not parallel when the user looks at the object , It is similar to the phenomenon of convergence or divergence of the perspective of the strabismus patient. This phenomenon of convergence or divergence of the perspective causes the user to feel dizzy. Therefore, the conventional binocular head-mounted display includes a device capable of adjusting the distance between the left and right lenses, so that the left and right eye axes passing through the left and right lens centers and the left and right pupil centers of the user are parallel to each other.

Another cause of dizziness when a user uses a binocular head-mounted display is that the binocular aberration is not properly adjusted when the user's viewing angle changes. When the angle of the eyes of the user changes, different aberrations will be generated on the retina. However, the conventional binocular head-mounted display does not provide a method for adjusting the aberration according to the change of the user's line of sight, resulting in wearing When a user with a binocular head-mounted display changes the viewing angle of both eyes, the brain automatically adjusts the aberration mechanism in response to the change in aberration, causing dizziness.

In addition, when the left and right eyes of a human are used alone, there will be a difference in the imaging position in the vertical direction, and the user of the binocular head-mounted display is designed so that the left eye cannot see the image of the right eye display screen and the right eye cannot When seeing the image of the left-eye display screen, that is, when wearing a binocular head-mounted display, the positional difference in the vertical direction of the visual image of the two eyes persists. However, the conventional binocular head-mounted display does not provide adjustments corresponding to the difference in imaging position in the vertical direction, so that when the user wears the binocular head-mounted display, the brain continuously controls the eye muscles to position the left and right eyes. Make up-and-down adjustments to try to align the eyes. Such an automatic adjustment mechanism of the brain and eye muscles can also cause dizziness to the user, and even cause spatial disorientation due to the inability to determine the correct horizontal line, causing the body to skew or even fall. .

Therefore, the conventional binocular head-mounted display often causes users to experience dizziness and spatial disorientation, which reduces the use comfort.

In view of the above, an object of the present invention is to provide a head-mounted display device and a binocular visual image positioning method for the head-mounted display device. The head-mounted display device and the binocular visual image positioning method for the head-mounted display device can be adapted to The user's binocular angle of view changes to make appropriate image adjustments to solve the problems of the conventional technology.

The technical means adopted by the present invention to solve the problems of the conventional technology is to provide a head-mounted display device, comprising: a head-mounted display having a left lens and a right lens, and corresponding ones of the left lens and the right lens A left display screen and a right display screen; a lens position adjusting member including a first lever connected to the left lens and the right lens, and the first lever is set to make the left lens and The right lens is laterally displaced individually to the left and right eyes of a user, so that a first visual axis passing through the center of the left lens and the pupil of the left eye of the user, and passing through the center of the right lens and the right of the user A second visual axis at the center of the pupil of the eye is mutually parallel, and the first visual axis and the second visual axis are orthogonal to the left display screen and the right display screen, respectively; and an aberration adjusting member having a first Two levers and an aberration adjustment unit, the aberration adjustment unit signals are connected to the left display screen and the right display screen, and the aberration adjustment unit is connected to the second lever, the aberration adjustment unit is configured Because Adjusting the imaging angle and relative of a left-eye image and a right-eye image generated on the left display screen and the right display screen according to the change of the binocular angle of view of a preset user when the second lever is moved position.

According to an embodiment of the present invention, a head-mounted display device is provided. The head-mounted display device further includes an image vertical position adjusting member having a third lever 30 connected to the aberration adjusting unit. The difference adjustment unit is configured to correspondingly adjust the relative positions in the vertical direction of the left-eye image and the right-eye image in response to the movement of the third lever.

According to an embodiment of the present invention, a head-mounted display device is provided, wherein the aberration adjustment unit has a coordinate conversion element, and the coordinate conversion element performs a coordinate conversion operation according to a preset user's binocular angle change. An adjusted left-eye image and an adjusted right-eye image are generated.

According to an embodiment of the present invention, a head-mounted display device is provided, wherein the left-eye display screen and the right-eye display screen are liquid crystal displays.

According to an embodiment of the present invention, a binocular visual image positioning method for a head-mounted display device is provided, which is applied to a head-mounted display device. The head-mounted display device includes a head-mounted display and is connected to the head-mounted display. A lens position adjustment member and an aberration adjustment member of the wearable display. The binocular vision image positioning method includes the following steps: a lens position adjustment step corresponding to a first lever of a user for the lens position adjustment member To adjust the relative positions of a left lens and a right lens of the head-mounted display and the positions of the user's eyes so that a first through the center of the left lens and the center of the left eye pupil of the user The visual axis is parallel to a second visual axis passing through the center of the right lens and the center of the pupil of the right eye of the user, and the first visual axis and the second visual axis are respectively orthogonal to one corresponding to the left lens A left display screen and a right display screen corresponding to one of the right lenses; and an aberration adjustment step corresponding to the user's movement of a second lever of the aberration adjustment member, A predetermined viewing angle changes the user's eyes to adjust to generate the left and right display screen displaying a left-eye image on the screen and a right-eye image and the relative angular position of the form image.

According to an embodiment of the present invention, a binocular visual image positioning method for a head-mounted display device is provided. The method further includes an image vertical position adjustment step corresponding to a third lever of a user for the aberration adjustment member. The relative positions of the left-eye image and the right-eye image in the vertical direction are adjusted correspondingly.

According to an embodiment of the present invention, a binocular visual image positioning method for a head-mounted display device is provided. The aberration adjustment step uses a left eye image center point and a right eye image center point as calibration points. Corresponding to the adjustment of the angle and relative position of the left-eye image and the right-eye image corresponding to the adjustment of the second lever by a user referring to the calibration point, the left-eye image and the right-eye image are generated. A stereo image at the center point of the eye image is zero aberration.

According to an embodiment of the present invention, a binocular visual image positioning method for a head-mounted display device is provided, wherein the aberration adjustment unit adjusts the image generated on the left display screen and the right display screen according to a standard conversion method. The image angle and relative position of the left-eye image and the right-eye image.

According to the technical means adopted by the present invention, the head-mounted display of the present invention is adjusted to be generated on the left display screen and the right display screen in response to a change in the preset binocular angle of view corresponding to the user's movement of the second lever. The angles and relative positions of the left-eye image and the right-eye image on the upper side reduce the phenomenon of dizziness caused by the change in the viewing angle of the user's eyes. In addition, the head-mounted display of the present invention can adjust the relative position of the left-eye image and the right-eye image in the vertical direction, thereby the head-mounted display device of the present invention additionally compensates for the left and right eye visual images in the vertical direction. The effect of position differences.

Embodiments of the present invention will be described below with reference to Figs. 1a to 2b. This description is not intended to limit the embodiment of the present invention, but is an example of the embodiment of the present invention.

As shown in FIG. 1 a, a head-mounted display device 100 according to a first embodiment of the present invention includes a head-mounted display 50, a lens position adjustment member 10, and an aberration adjustment member 20. The head mounted display 50 has a left lens and a right lens (not shown in the figure), and a left display screen and a right display screen (not shown in the figure) corresponding to one of the left lens and the right lens. The lens position adjusting member 10 includes a first lever connected to the left lens and the right lens, and the first lever is set to make the left lens and the right lens individually relative to a user when being adjusted. The left and right eyes are laterally displaced so that a first visual axis passing through the center of the left lens and the pupil center of the left eye of the user and a second visual axis passing through the center of the right lens and the pupil center of the right eye of the user To be parallel to each other, the first viewing axis and the second viewing axis are orthogonal to the left display screen and the right display screen, respectively. The aberration adjustment member 20 has a second lever and an aberration adjustment unit (not shown). The aberration adjustment unit signals are connected to the left display screen and the right display screen, and the aberration adjustment unit is connected. On the second lever, the aberration adjustment unit is configured to adjust to generate a left and right display screen corresponding to a preset user's binocular viewing angle change in response to the movement of the second lever. An image angle and a relative position of an upper left eye image and a right eye image.

In detail, the left lens and the right lens are disposed directly in front of the eyes of the user, and the left display screen and the right display screen are disposed on the left and right along the first viewing axis and the second viewing axis. In front of the lens. Please refer to FIG. 1a, where the two dotted circles are the positions of the left and right lenses in the head-mounted display device 100.

FIG. 1b is a schematic diagram showing changes in left and right eye images on the left and right display screens before and after the first lever of the lens position adjusting member 10 is adjusted according to the first embodiment of the present invention. By moving the first lever, the left and right lenses can approach or move away from each other. In the figure, the left and right lenses approach each other under the control of the first lever. Image I1 is the image before the lens position adjustment. I2 is the image after the lens position is adjusted.

FIG. 1c is a schematic diagram showing changes in the left and right eye images on the left and right display screens before and after the second lever of the aberration adjusting member 20 according to the first embodiment of the present invention is subjected to the adjustment, where image I3 is The image before aberration adjustment, image I4 is the image after aberration adjustment. In detail, the aberration adjustment member stores a set of preset user perspective changes and a set of aberration adjusted images corresponding to the preset user perspective changes. When the user's eyes of the binocular head-mounted display device change the viewing angle, the user can select from the set of aberration-adjusted images to the user by adjusting the second lever of the aberration adjustment member 20. Zero aberration image. Figure 1c shows the adjustments made when the user's viewing angle increases when looking at the same object. Image I4 is an image with a larger angle of view relative to image I3, that is, image I3 is looking at the object from a greater distance and image I4 is Look at the object from a closer distance.

As shown in FIG. 2a, the head-mounted display device 200 according to the second embodiment of the present invention further includes an image vertical position adjusting member 30 having a third lever connected to the aberration adjusting unit, and the aberration The adjustment unit is configured to correspondingly adjust a relative position in the vertical direction of a left-eye image and a right-eye image in response to the movement of the third lever.

Please refer to Figure 2b. FIG. 2b is a schematic diagram showing changes in the left and right eye images before and after the third lever of the image vertical position adjusting member 30 according to the second embodiment of the present invention is received, where image I5 is before the image vertical position adjustment Image, image I6 is the image after the vertical position of the image is adjusted. More precisely, the image vertical position adjusting member 30 adjusts the positions of the left and right eye images in the vertical direction to be consistent.

According to the head-mounted display device 100 of the present invention, the aberration adjustment unit 20 has a coordinate conversion element (not shown in the figure), and the coordinate conversion element performs a coordinate conversion operation according to the preset user's binocular viewing angle change. An adjusted left-eye image and an adjusted right-eye image are generated. In detail, the coordinate conversion component uses a 3D drawing application program interface OpenGL to perform coordinate conversion using a matrix. The parameters used include the positions of the left and right eyes, the directions of the left and right eyes based on the angle between the eyes, and the gaze. Target transformation methods such as translation, rotation, zoom in and zoom out, and gaze target coordinates established by the gaze target system. After the coordinate transformation is obtained, the coordinates of the gaze target under the coordinate system of the user's eyes are obtained. Finally, the coordinate conversion element performs a perspective projection transformation on the coordinates of the gaze target under the coordinate system of the user's eyes. ), That is, project coordinate data in a three-dimensional space onto a two-dimensional plane, and obtain the adjusted left-eye image and the adjusted right-eye image.

In the head-mounted display device 100 according to the present invention, the left-eye display screen and the right-eye display screen are liquid crystal displays.

FIG. 3 is a flowchart showing a binocular visual image positioning method of a head-mounted display device according to an embodiment of the present invention. The method is applied to a head-mounted display device, and the head-mounted display device includes a head A wearable display, and a lens position adjustment member and an aberration adjustment member connected to the head-mounted display. The binocular vision image positioning method includes the following steps: a lens position adjustment step S100 according to a user's need for the lens The movement of a first lever of the position adjustment member adjusts the relative positions of a left lens and a right lens of the head-mounted display and the positions relative to the eyes of the user so that the left lens center and the use A first visual axis of the pupil center of the left eye and a second visual axis passing through the right lens center and the right eye pupil center of the user are parallel to each other, and the first visual axis and the second visual axis are respectively positive A left display screen corresponding to one of the left lenses and a right display screen corresponding to one of the right lenses; and an aberration adjustment step S200, corresponding to the user's adjustment structure for the aberration. A second lever of the camera, and adjust the imaging angles of a left-eye image and a right-eye image generated on the left display screen and the right display screen in response to changes in the angle of view of the eyes of a preset user and relative position.

The steps in the binocular visual image positioning method of the head-mounted display device of the present invention are not limited to the above-mentioned order. In other embodiments, the order of S100 and S200 can be reversed.

FIG. 4 is a flowchart illustrating a binocular visual image positioning method of a head-mounted display device according to another embodiment of the present invention, wherein an aberration adjustment step in the binocular visual image positioning method is S210, respectively. A center point of the left eye image and a center point of the right eye image are calibration points, and a left eye image and a right eye image are adjusted correspondingly when a user refers to the calibration point and moves a second lever. The angle and relative position make a stereo image generated at the center point of the left-eye image and the center point of the right-eye image a zero aberration. In this embodiment, the binocular vision image positioning method further includes an image vertical position adjustment step S300, corresponding to adjusting a third lever of the aberration adjustment member by the user to adjust the left-eye image and the corresponding image. The relative position of the right eye image in the vertical direction. In other embodiments, the order of S100, S210, and S300 can be reversed.

According to the binocular vision image positioning method of the present invention, the aberration adjustment unit adjusts the image angles of the left-eye image and the right-eye image generated on the left display screen and the right display screen according to a standard conversion method and relative position.

According to the binocular vision image positioning method of the present invention, the aberration adjustment step uses a left-eye image center point and a right-eye image center point as calibration points, respectively. The movement of the two levers correspondingly adjusts the image angle and relative position of the left-eye image and the right-eye image, so that a stereo image generated at the center point of the left-eye image and the center point of the right-eye image is zero aberration. In more detail, the aberration adjustment step uses the center points of the left and right eye images as calibration points, allowing the user to focus on the center of the image and select a zero aberration image when the second lever is moved, shortening the calibration time .

In the binocular vision image positioning method of the present invention, the aberration adjustment unit adjusts the image angles of the left-eye image and the right-eye image generated on the left display screen and the right display screen according to a standard conversion method and relative position.

Through the above-mentioned technical means, the head-mounted display device 100 of the present invention uses the aberration adjustment unit 20 to adjust and generate the left display screen in response to a change in the preset binocular angle of view corresponding to a user's movement of the second lever. The image angle and relative position of a left-eye image and a right-eye image on the right and right display screens reduce the phenomenon of dizziness caused by changes in the viewing angle of the eyes of the user. By setting the third lever of the aberration adjusting member 30, the head-mounted display device 100 of the present invention can correspondingly adjust the left-eye image and the right eye in response to a user's movement of the third lever. The relative position in the vertical direction of the image makes the head-mounted display device 100 of the present invention additionally have the effect of making up for the difference in the position of the left and right eye visual images in the vertical direction.

The above descriptions and descriptions are merely illustrations of the preferred embodiments of the present invention. Those with ordinary knowledge of this technology may make other modifications based on the scope of the patent application defined below and the above description, but these modifications should still be made. It is the spirit of the present invention and is within the scope of the present invention.

100, 200‧‧‧ head-mounted display device
10‧‧‧ lens position adjustment member
20‧‧‧ Aberration adjustment member
30‧‧‧Image vertical position adjustment member
50‧‧‧ HMD image I1, image I2‧‧‧ image image I3, image I4‧‧‧ image image I5, image I6‧‧‧ image
S100, S200, S210, S300 ‧‧‧ steps

[Fig. 1a] is a schematic diagram showing a head-mounted display device according to the first embodiment of the present invention; [Fig. 1b] is a diagram showing the head-mounted display device according to the first embodiment of the present invention on the first Left and right display diagrams of left and right eye images on the screen before and after the lever is moved; [Fig. 1c] is a view showing that the head-mounted display device according to the first embodiment of the present invention undergoes movement on the second lever Front and back, left and right display diagrams of left and right eye image changes on the screen; [Fig. 2a] is a diagram showing a head-mounted display device according to a second embodiment of the present invention; [Fig. 2b] is a display basis The head-mounted display device according to the second embodiment of the present invention is a schematic diagram of left and right eye image changes on the left and right display screens before and after the third lever is moved; [Figure 3] is implemented according to one of the present invention A flowchart of a binocular vision image positioning method for an example head-mounted display device; [FIG. 4] is a flowchart of a binocular vision image positioning method for a head-mounted display device according to another embodiment of the present invention.

100‧‧‧ Head-mounted display device

10‧‧‧ lens position adjustment member

20‧‧‧ Aberration adjustment member

50‧‧‧ head-mounted display

Claims (8)

A head-mounted display device includes: a head-mounted display having a left lens and a right lens, and a left display screen and a right display screen corresponding to one of the left lens and the right lens; a lens position adjusting member, It includes a first lever connected to the left lens and the right lens, and the first lever is set to make the left lens and the right lens individually relative to a left eye and a right eye of a user when being adjusted. Lateral displacement so that a first visual axis passing through the center of the left lens and the pupil of the left eye of the user and a second visual axis passing through the center of the right lens and the pupil of the right eye of the user are parallel to each other, and The first viewing axis and the second viewing axis are orthogonal to the left display screen and the right display screen, respectively; and an aberration adjustment member having a second lever and an aberration adjustment unit, the aberration adjustment unit The signal is connected to the left display screen and the right display screen, and the aberration adjustment unit is connected to the second lever. The aberration adjustment unit is configured to correspond to a preset according to the movement of the second lever. Of users Adjust viewing angle to generate the left and right display screen displaying a left-eye image on the screen and a right-eye image and the relative angular position of the form image. For example, the head-mounted display device of the first patent application scope further includes an image vertical position adjustment member having a third lever connected to the aberration adjustment unit. The aberration adjustment unit is configured to correspond to the aberration adjustment unit. The movement of the third lever correspondingly adjusts the relative positions in the vertical direction of the left-eye image and the right-eye image. For example, the head-mounted display device of the first patent application scope, wherein the aberration adjustment unit has a coordinate conversion element, and the coordinate conversion element performs an coordinate conversion operation according to the preset user's binocular perspective change to generate an adjustment. Rear left eye image and an adjusted right eye image. For example, the head-mounted display device of the first patent application scope, wherein the left-eye display screen and the right-eye display screen are liquid crystal displays. A binocular vision image positioning method for a head-mounted display device is applied to a head-mounted display device. The head-mounted display device includes a head-mounted display and a lens position adjusting member connected to the head-mounted display. An aberration adjusting member, and the binocular vision image positioning method includes the following steps: A lens position adjusting step, in response to a user's movement of a first lever of the lens position adjusting member, adjusting the position of the head-mounted display The relative position of a left lens and a right lens and the position with respect to the eyes of the user, so that a first visual axis passing through the center of the left lens and the pupil center of the left eye and passing through the right lens center and the A second visual axis of the right pupil center of the user is parallel to each other, and the first visual axis and the second visual axis are respectively orthogonal to a left display screen corresponding to one of the left lenses and a left display screen corresponding to the right lens. A right display screen; and an aberration adjustment step, corresponding to a user's movement of a second lever of the aberration adjustment member, corresponding to a preset binocular vision of the user Adjusted to produce the change in the display screen left and right eye image displayed on a screen and a right-eye image and the relative angular position of the form image. For example, the binocular vision image positioning method for a head-mounted display device under the scope of patent application No. 5 further includes an image vertical position adjustment step, which is performed when a user moves a third lever of the aberration adjustment member. The relative positions in the vertical direction of the left-eye image and the right-eye image are adjusted correspondingly. For example, a binocular vision image positioning method for a head-mounted display device under the scope of patent application No. 5, wherein the aberration adjustment step uses a left-eye image center point and a right-eye image center point as calibration points, respectively. The user refers to the calibration point and adjusts the imaging angle and relative position of the left-eye image and the right-eye image correspondingly to the movement of the second lever, so that the left-eye image and the right-eye image center are generated. A stereo image of a point is zero aberration. For example, a binocular vision image positioning method for a head-mounted display device under the scope of application for patent No. 5, wherein the aberration adjustment unit adjusts the left eye generated on the left display screen and the right display screen according to a standard conversion method. The image angle and relative position of the image and the right-eye image.