CN203433192U - Head mounted display HMD - Google Patents

Abstract

The utility model discloses a head mounted display HMD. The HMD comprises a lens rack, a display system and a control system, wherein the display system comprises a micro image display, a curved surface prism, a compensation prism and a pixel level visual permeability rate adjustable display screen, wherein the curved surface prism is a free curved surface prism with three optical surfaces, and viewed from a viewer, the compensation prism is arranged on the outer side of the curved surface prism and optically cemented with the curved surface prism; the micro image display is used for displaying computer generated images CGI, and the pixel level visual permeability rate adjustable display screen is arranged on the outer side of the compensation prism and used for controlling the proportion of the external scene light ray into the eyes. The special optical system structure of the HMD makes the exit pupil diameter large and makes the distortion small. The visual permeability rate can be controlled in the pixel level, the requirements of users for HMD comfort degree, definition or the like are met to the maximum extent, the eye fatigue due to using the HMD is lightened, and the availability of the HMD is greatly improved.

Description

A head-mounted display device HMD

technical field

The utility model relates to the field of wearable computing head-mounted display equipment, in particular to a head-mounted display device HMD. the

Background technique

Head-mounted display (HMD, Head mounted display), also known as head-up display (HUD, Head up display), is a device that includes at least one micro-display device (image source system), corresponding optical system, and support structure (support system). Near-eye display device. See-through HMD has its special human-computer interaction characteristics, can be combined with augmented reality technology, and is widely used in scientific research, military, industry, games, video, education, simulation and other fields. The optical system plays a key role in the HMD. If the optical system cannot correct the phase difference and distortion of the system well, the user will see distorted and unclear images. In the prior art, the effect of distortion correction is average. In addition, in different lighting environments, whether the see-through rate is appropriate also directly determines the user's experience of the HMD (the see-through rate describes the see-through effect of the see-through HMD). Existing see-through HMDs usually use transflective film technology or liquid crystal light valves to control the transmissive rate. The optical parameters of the transflective film are fixed. It is determined that it cannot be adjusted automatically. In other words, we cannot make a 50/50 coating, which not only achieves 50% transmittance and 50% reflectance, but also achieves 60% transmittance and 40% reflectance. However, the liquid crystal layer of the crystal light valve is a large pixel as a whole, so the adjustment of the transmittance by the liquid crystal light valve is based on the area unit of the liquid crystal panel of the light valve, which cannot achieve the adjustment of the pixel-level transmittance. the

Utility model content

The purpose of the utility model is to provide a head-mounted display device HMD, which solves the defects of the existing HMD optical system and the adjustment of the see-through rate, and realizes the adjustment of the see-through rate at the pixel level. the

In order to achieve the purpose of the above utility model, the utility model provides a head-mounted display device HMD, including a frame, a display system and a control system, and the display system includes a miniature image display, a curved prism, a compensation prism and a pixel-level viewing rate Adjustable display screen, the curved prism is a free-form prism with three optical surfaces, viewed from the side of the observer, the compensation prism is located outside the curved prism, and the compensation prism and the curved prism are optically glued together; pixel-level visual transmittance is adjustable display The screen is located outside the compensating prism; the miniature image display is used to display computer-generated image CGI images, and the pixel-level see-through ratio adjustable display is used to control the proportion of the light from the external scene entering the human eye. The light emitted by the miniature image display first passes through the curved surface The first surface of the prism is transmitted into the curved prism, then totally reflected on the inside of the second surface, then reflected by the third surface, and finally transmitted through the second surface again into the human eye. The third surface of the curved prism is coated with half Anti-semi-permeable film; the light from the external scene is first transmitted through the pixel-level adjustable display screen, and then transmitted through the second surface of the compensation prism into the compensation mirror, and then through the first surface of the compensation prism, the third surface of the curved prism and the second surface of the compensation prism. The surface enters the human eye. the

Preferably, the surface types of the first surface and the second surface of the compensation prism are respectively the same as those of the second surface and the third surface of the curved prism. the

Preferably, the surface types of the three optical surfaces of the curved prism satisfy the following conditional equations:

$\begin{array}{c}\mathrm{<span\; class="notranslate">\; z</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; x</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; C</span>}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; )</span>}{\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; +</span>\sqrt{\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; -</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; k</span>}<span\; class="notranslate">\; )</span>{\mathrm{<span\; class="notranslate">\; C</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; )</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 4</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 6</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="2"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 8</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; <figure-callout\; id="10"\; label="c"\; filenames="DEST\_PATH\_HDA0000416773740000011.png"\; state="\{\{state\}\}">c</figure-callout></span>}}_{\mathrm{<span\; class="notranslate">\; 10</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="3"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 3</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 11</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 13</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="2"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 15</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="4"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 17</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 19</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="2"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; twenty\; one</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="5"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 5</span>}}\\ <span\; class="notranslate">\; +</span><span\; class="notranslate">\; .</span><span\; class="notranslate">\; .</span><span\; class="notranslate">\; .</span>\end{array}$

Where C is the radius of curvature of the surface, and _cj is the polynomial coefficient.

Preferably, the control system includes a storage module, a control processor, a display module circuit and peripheral circuits, wherein: the display module circuit includes a graphics processor, and the graphics processor outputs two-way video signals, and one way provides CGI images for the miniature image display, The other channel provides an image signal for controlling the viewing rate for the display screen with adjustable viewing rate at the pixel level; the peripheral circuit includes an external communication interface for interacting with the head-mounted display device, and the external communication interface includes Wi-Fi, One or more of Bluetooth, GPS, GPRS, USB. the

Preferably, the HMD also includes a photosensitive device for sensing ambient light intensity, the photosensitive device sends the light intensity information to the graphics processor through the control processor, and the graphics processor displays the adjustable pixel-level see-through rate according to the light intensity information The entire area of the screen is adjusted for the transmittance, and the mapping relationship between the light intensity and the transmittance is preset in the control system. the

Preferably, the graphics processor adjusts the transmittance of the corresponding area of the display screen with adjustable pixel-level transmittance according to the detected illuminated area of the miniature image display. the

Preferably, the graphics processor adjusts the see-through rate of the corresponding area of the pixel-level see-through rate-adjustable display screen according to the presentation area information of the virtual information extracted from the application program on the micro-image display. the

Preferably, the graphics processor adjusts the see-through rate of the area corresponding to the pixel-level see-through rate-adjustable display screen according to one or more of user voice, gesture, and touch instructions. the

Preferably, the pixel-level adjustable display screen is a transparent monochrome LCD display or a transparent monochrome OLED display. the

Preferably, the micro image display is one of LCD display, OLED display and LCoS display. the

Compared with the prior art, the utility model has the following beneficial effects:

The HMD of the embodiment of the utility model, on the one hand, adopts free-form surface prisms with three optical surfaces combined with compensating prisms, so that the optical system of the entire HMD has a large exit pupil diameter and small distortion; Using the display screen to adjust the see-through rate of the HMD can meet the user's needs for the comfort and clarity of the HMD to the greatest extent, reduce the fatigue caused to the eyes when the HMD is used, and greatly improve the usability of the HMD. the

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are only some embodiments of the utility model. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without paying creative labor:

Fig. 1 is a schematic structural view of a head-mounted display device HMD according to an embodiment of the present invention;

Fig. 2 is a schematic structural diagram of a display system in a head-mounted display device according to an embodiment of the present invention;

Fig. 3a is the MTF curve of the display system in the head-mounted display device of the embodiment of the present utility model;

Fig. 3b is the distortion curve of the display system in the head-mounted display device of the embodiment of the present utility model;

Fig. 4 is a schematic structural diagram of a control system in a head-mounted display device according to an embodiment of the present invention;

Fig. 5 is a schematic flow chart of a method for adjusting the perspective ratio of a head-mounted display device according to an embodiment of the present invention;

Figure 6a is a schematic diagram of the effect of emphasizing the adjustment of the see-through ratio when the ambient light is weak in the embodiment of the present utility model;

Figure 6b is a schematic diagram of the effect of emphasizing the viewing transmittance when the ambient light is strong in the embodiment of the present utility model;

Figure 7a is a schematic diagram of the CGI display area of the utility model embodiment;

Figure 7b is a schematic diagram of the effect of adjusting the perspective rate according to the CGI display area of Figure 5a according to the embodiment of the present utility model;

Figure 8a is a schematic diagram of the AR display area of the embodiment of the utility model;

Figure 8b is a schematic diagram of the effect of adjusting the perspective rate according to the AR display area in Figure 6a according to the embodiment of the present utility model;

Marks in the figure: 1-miniature image display, 2-the first surface of the curved prism, 3-the second surface of the curved prism, 4-the third surface of the curved prism, 5-the first surface of the compensation prism, 6-the first surface of the compensation prism Surface, 7-pixel level view rate adjustable display, 10-frame, 20-display system. the

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. example. Based on the embodiments of the present utility model, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of the present utility model. the

The HMD described in the embodiment of the present invention can be a monocular HMD or a binocular HMD. When it is monocular, there is only one set of display systems, and for binocular, there are two sets of display systems. The apparent transmittance described in the embodiment of the utility model is the transmittance, and if the apparent transmittance is high, the reflectance is low. the

Referring to FIG. 1 , it is a schematic structural diagram of a head-mounted display device HMD according to an embodiment of the present invention, including a frame 10, a display system 20 and a control system (the control system is not shown in FIG. 1 ). In the case of HMD, there are two identical display systems. The structural diagram of each display system can be seen in FIG. In Fig. 2, 8 is the exit pupil, i.e. the position of the human eye; the curved prism is a free-form surface prism with three optical surfaces, from the image source to the direction of the observer, followed by the first surface 2, the second surface 3, the second surface Three surfaces 4, wherein the third surface 4 is coated with a semi-reflective and semi-transparent film; the compensation prism includes two optical surfaces, respectively optical surfaces 5 and 6, 5 is also called the first surface of the compensation prism, and 6 is also called the first surface of the compensation prism The second surface of the compensation prism, the first surface 5 and the second surface 6 of the compensation prism are respectively the same as the second surface 3 and the third surface 4 of the curved prism (that is, the surface 5 is the same as the surface 3, and the surface 6 Same as the 4-sided type). Viewed from the side of the observer, the compensation prism is located outside the curved prism, and the compensation prism and the curved prism are optically glued together; the pixel-level visible transmittance adjustable display screen 7 is located outside the compensation prism, and is used to control the proportion of external scene light entering the human eye; the miniature An image display 1 is located outside the first surface 2 of the curved prism for displaying computer generated images (CGI images). Fig. 2 shows that the actual optical path of the system is divided into two paths, which are respectively: 1) the light emitted by the miniature image display 1 first passes through the first surface 2 of the curved prism and enters the curved prism, and then total reflection occurs on the inner side of the second surface 3 , then reflected by the third surface 4, and finally transmitted through the second surface 3 to enter the human eye; The compensating mirror then enters the human eye through the first surface 5 of the compensating prism, the third surface 4 and the second surface 3 of the curved prism. the

In the embodiment of the utility model, the surface shapes of the three optical surfaces of the curved prism satisfy the following conditional equations:

$\begin{array}{c}\mathrm{<span\; class="notranslate">\; z</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; x</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; C</span>}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; )</span>}{\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; +</span>\sqrt{\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; -</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; k</span>}<span\; class="notranslate">\; )</span>{\mathrm{<span\; class="notranslate">\; C</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; )</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 4</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 6</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="2"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 8</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; <figure-callout\; id="10"\; label="c"\; filenames="DEST\_PATH\_HDA0000416773740000011.png"\; state="\{\{state\}\}">c</figure-callout></span>}}_{\mathrm{<span\; class="notranslate">\; 10</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="3"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 3</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 11</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 13</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="2"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 15</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="4"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}\\ <span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 17</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 19</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="2"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; twenty\; one</span>}}{\mathrm{<span\; class="notranslate">\; the\; <figure-callout\; id="5"\; label="y"\; filenames="DEST\_PATH\_HDA0000416773740000012.png"\; state="\{\{state\}\}">y</figure-callout></span>}}^{\mathrm{<span\; class="notranslate">\; 5</span>}}\\ <span\; class="notranslate">\; +</span><span\; class="notranslate">\; .</span><span\; class="notranslate">\; .</span><span\; class="notranslate">\; .</span>\end{array}$

Among them, C is the radius of curvature of the curved surface, and _cj is the coefficient of the polynomial. When designing, the polynomial should be selected reasonably to control the free-form surface into a plane symmetrical surface.

Preferably, the optical system in the embodiment of the present utility model is designed to the following optical characteristics: the diagonal length of the miniature image display 1 is 0.61 inches, and the resolution is 800*600; The angular field of view is 52 degrees, the exit pupil distance is 22mm, and the linear distance between the exit surface of the curved prism (surface 3 in Figure 2) and the exit pupil 8 is 22mm, and the exit pupil diameter is 8mm. The distance between the microdisplay 1 and the curved prism The linear distance between them is 5mm. According to this scheme, the central field of view transfer function value in this embodiment is greater than 0.3 at 30 lp/mm, and the peripheral field of view is greater than 0.1 at 30 lp/mm. The MTF curve is shown in Figure 3a, and the distortion curve is shown in Figure 3b. Show. the

In the embodiment of the present utility model, the pixel-level adjustable display screen 7 can be a transparent monochrome LCD display, a transparent monochrome OLED display, etc., which can be controlled in units of pixels. On-screen display. The micro-image display 1 can be an LCD display, and can also be a commonly used micro-display such as an OLED display, LCoS (Liquid Crystal on Silicon, liquid crystal on silicon) display. the

LCD display (Liquid Crystal Display, liquid crystal display), liquid crystal, a liquid chemical substance, is the same as metal in a magnetic field. When affected by an external electric field, its molecules will produce a precise and ordered arrangement. If the arrangement of molecules is properly controlled, liquid crystal molecules can control the transmittance of light. In an LCD display, liquid crystal droplets are contained in a fine cell structure, and one or more cells form a pixel on the screen. When the electrodes in the LCD generate an electric field, the liquid crystal molecules will be twisted, so that the light passing through it will be refracted regularly, and the transmittance can be controlled. Since each pixel of the LCD display screen can be individually controlled, the utility model can use a monochromatic transparent LCD to control the see-through rate to realize pixel-level see-through rate control. The OLED display (Organic Light-Emitting Diode, organic laser display) can adjust the gray value of each pixel in units of pixels. The larger the gray value, the lower the transmittance. the

Referring to FIG. 4 , it is a schematic structural diagram of a control system in a head-mounted display device according to an embodiment of the present invention. The control system includes a storage module, a control processor, a display module circuit and peripheral circuits. The storage module is system storage, which stores the control program and data of the entire HMD; the control processor is equivalent to the computer CPU, and various data processing tasks are completed in this module; the display module circuit includes a graphics processor, and the graphics processor passes two The video output interface outputs two video signals, one of which provides CGI images for the miniature image display, and the other provides image signals for controlling the viewing ratio of the display screen with adjustable viewing ratio at the pixel level; the peripheral circuit includes an external communication interface for To interact with the head-mounted display device, the external communication interface includes one or more of Wi-Fi, Bluetooth, GPS, GPRS, and USB. the

Embodiments of the present utility model can adjust the see-through rate of the HMD according to one or more of the following conditions:

1) The ambient light intensity of the HMD;

2) The display area of the computer-generated image CGI;

3) In augmented reality AR technology, areas that need to be enhanced. the

In order to control the see-through rate with the ambient light intensity, it is necessary to install a photosensitive device (photosensitive sensor) for sensing the ambient light intensity on the surface of the head-mounted reality device of the embodiment of the utility model, and the photosensitive device submits the light intensity information to the control processor After processing the current light intensity information, the control processor sends the control command to the graphics controller, and the graphics processor adjusts the transmittance of the entire area of the pixel-level adjustable transmittance display screen according to the light intensity information. In the embodiment of the present utility model, the mapping relationship between the light intensity and the see-through rate needs to be set in advance in the control system of the HMD. The mapping relationship is that the stronger the ambient light intensity is, the lower the see-through rate is. The specific value is not limited here. It can be set arbitrarily according to the needs. As shown in Figure 6a, it is a schematic diagram of the effect of emphasizing the adjustment of the see-through rate when the ambient light is weak when the utility model is implemented. The CGI display effect of the micro-display screen; Figure 6b is a schematic diagram of the effect of emphasizing the adjustment of the see-through rate in the embodiment of the present invention when the ambient light is strong. When the ambient light is strong, the adjustable display of the pixel-level see-through rate can be appropriately reduced The see-through rate of the screen can be improved to improve the CGI display effect of the micro-display screen. the

Because in the actual application process, the CGI image does not necessarily occupy the entire display screen, and sometimes the CGI image only occupies a small part of the display screen, as shown in Figure 7a. Therefore, in order to improve the display effect, it is necessary to reduce the pixel-level see-through ratio The see-through ratio of the display area that overlaps with the CGI image on the display screen can be adjusted. The implementation method is: the graphics processor adjusts the see-through rate of the corresponding area of the display screen with adjustable pixel-level see-through ratio according to the detected illuminated area of the micro-image display, as shown in Figure 7a, the CGI image is displayed on the micro-image display Figure 7b shows a schematic diagram of the reduction of the corresponding area on the pixel-level see-through rate-adjustable display screen. the

Among the HMD applications, the most anticipated is the augmented reality AR technology, which is to superimpose virtual information on the real scene. In the augmented reality application scenario, in order to highlight the information displayed in the augmented reality, the see-through rate of the related area can be reduced. . The implementation method is as follows: the graphics processor adjusts the see-through rate of the area corresponding to the pixel-level see-through rate-adjustable display screen according to the presentation area information of the virtual information extracted from the application program on the micro-image display. Referring to FIG. 8a, FIG. 8a shows the virtual information presented on the miniature image display, and FIG. 8b shows a schematic diagram of the reduction of the see-through rate of the area corresponding to the virtual information on the display screen with adjustable pixel-level see-through rate. the

The above three methods for adjusting the see-through ratio can be used separately or in combination, see FIG. 5 , which is an embodiment of the combination of the above three methods. After receiving the ambient light intensity signal sent by the photosensitive sensor, the HMD control system judges whether the ambient light intensity changes. If the ambient light intensity changes, the pixel is adjusted according to the corresponding relationship between the ambient light intensity and the see-through rate stored in the system. The see-through rate of the entire screen area of the adjustable display screen (as shown in Figure 6a, 6b), if there is no change, continue to detect whether the ambient light intensity changes. After the see-through rate of the entire screen is adjusted according to the light intensity signal, check whether the micro-image display displays a CGI image. If so, adjust the see-through rate of the corresponding area on the pixel-level see-through rate adjustable display screen according to the area where the CGI is located. (as shown in Figures 7a and 7b), the see-through rate is to further reduce the see-through rate on the basis of the see-through rate of the entire screen. After adjusting the see-through rate of the area where the CGI is located, detect whether there is augmented reality information in the CGI image, and if so, adjust the see-through rate of the AR area (as shown in Figures 8a and 8b), which is the same as the see-through rate in the CGI area On the basis of further reducing the perspective rate. the

The above methods describe the method of adaptively adjusting the see-through rate. Users can also directly manually control the switch, see-through ratio, and area of the see-through rate through voice or gesture commands, so as to meet the needs of users in various environments. need. The implementation method is: the graphics processor adjusts the see-through rate of the area corresponding to the pixel-level see-through rate-adjustable display screen according to the user's voice, gesture, touch command, and the like. the

The HMD of the embodiment of the utility model, on the one hand, adopts free-form surface prisms with three optical surfaces combined with compensating prisms, so that the exit pupil diameter of the optical system of the entire HMD is large and the distortion is small; Using the display screen to adjust the see-through rate of the HMD can meet the user's needs for the comfort and clarity of the HMD to the greatest extent, reduce the fatigue caused to the eyes when the HMD is used, and greatly improve the usability of the HMD. the

All features disclosed in this specification, or steps in all methods or processes disclosed, may be combined in any manner, except for mutually exclusive features and/or steps. the

Any feature disclosed in this specification (including any appended claims, abstract and drawings), unless expressly stated otherwise, may be replaced by alternative features which are equivalent or serve a similar purpose. That is, unless expressly stated otherwise, each feature is one example only of a series of equivalent or similar features. the

The utility model is not limited to the aforementioned specific embodiments. The utility model extends to any new feature or any new combination disclosed in this specification, as well as the steps of any new method or process or any new combination disclosed. the

Claims (10)

1. A head-mounted display device HMD, comprising a spectacle frame, a display system and a control system, characterized in that the display system comprises a miniature image display, a curved prism, a compensating prism and a pixel-level adjustable display screen, so The curved prism is a free-form prism with three optical surfaces. Viewed from the side of the observer, the compensation prism is located outside the curved prism, and the compensation prism is optically bonded to the curved prism; the pixel-level adjustable display screen is located outside the compensation prism; The micro-image display is used to display computer-generated image CGI images, and the pixel-level perspective-adjustable display screen is used to control the proportion of external scene light entering the human eye; The light emitted by the miniature image display first passes through the first surface of the curved prism and enters the curved prism, then undergoes total reflection on the inside of the second surface, is reflected by the third surface, and finally enters the human eye through the second surface again. The third surface of the curved prism is coated with a semi-reflective and semi-transparent film; The external scene light is first transmitted through the pixel-level adjustable transmittance display screen, then transmitted through the second surface of the compensation prism into the compensation mirror, and then enters the human eye through the first surface of the compensation prism, the third surface and the second surface of the curved prism. 2 . The head-mounted display device HMD according to claim 1 , wherein the surface types of the first surface and the second surface of the compensation prism are respectively the same as those of the second surface and the third surface of the curved prism. 3. The head-mounted display device HMD as claimed in claim 2, wherein the surface shapes of the three optical surfaces of the curved prism satisfy the following conditional equations: $\mathrm{<span\; class="notranslate">\; z</span>}<span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; x</span>}<span\; class="notranslate">\; ,</span>\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; )</span><span\; class="notranslate">\; =</span>\frac{\mathrm{<span\; class="notranslate">\; C</span>}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; )</span>}{\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; +</span>\sqrt{\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; -</span><span\; class="notranslate">\; (</span>\mathrm{<span\; class="notranslate">\; 1</span>}<span\; class="notranslate">\; +</span>\mathrm{<span\; class="notranslate">\; k</span>}<span\; class="notranslate">\; )</span>{\mathrm{<span\; class="notranslate">\; C</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; (</span>{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; )</span>}}$ $<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 4</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 6</span>}}{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}$ $<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 8</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 10</span>}}{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 3</span>}}$ $<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 11</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 13</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 15</span>}}{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}$ $<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 17</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 4</span>}}\mathrm{<span\; class="notranslate">\; the\; y</span>}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; 19</span>}}{\mathrm{<span\; class="notranslate">\; x</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 2</span>}}<span\; class="notranslate">\; +</span>{\mathrm{<span\; class="notranslate">\; c</span>}}_{\mathrm{<span\; class="notranslate">\; twenty\; one</span>}}{\mathrm{<span\; class="notranslate">\; the\; y</span>}}^{\mathrm{<span\; class="notranslate">\; 5</span>}}$ $<span\; class="notranslate">\; +</span><span\; class="notranslate">\; \&Center\; Dot;</span><span\; class="notranslate">\; \&Center\; Dot;</span><span\; class="notranslate">\; \&Center\; Dot;</span>$ Where C is the radius of curvature of the surface, and _cj is the polynomial coefficient. 4. The head-mounted display device HMD according to any one of claims 1 to 3, wherein the control system includes a storage module, a control processor, a display module circuit and a peripheral circuit, wherein: The display module circuit includes a graphics processor, and the graphics processor outputs two video signals, one of which provides CGI images for the miniature image display, and the other provides image signals for controlling the viewing ratio of the display screen with adjustable viewing ratio at the pixel level; The peripheral circuit includes an external communication interface for interacting with the head-mounted display device, and the external communication interface includes one or more of Wi-Fi, Bluetooth, GPS, GPRS, and USB. 5. The head-mounted display device HMD as claimed in claim 4, wherein the HMD further comprises a photosensitive device for sensing ambient light intensity, and the photosensitive device sends the light intensity information to the graphics processor through the control processor, The graphics processor adjusts the transmittance of the entire area of the pixel-level adjustable display screen according to the light intensity information, and the mapping relationship between the light intensity and the transmittance is preset in the control system. 6. The head-mounted display device HMD as claimed in claim 4, wherein the graphics processor adjusts the viewing angle of the corresponding area of the pixel-level adjustable display screen according to the detected illuminated area of the miniature image display. transmittance. 7. The head-mounted display device (HMD) as claimed in claim 4, wherein the graphic processor adjusts the adjustable pixel-level see-through ratio according to the presentation area information of the virtual information extracted from the application program on the miniature image display. The see-through ratio of the area corresponding to the display. 8. The head-mounted display device (HMD) according to claim 4, wherein the graphics processor adjusts the pixel-level see-through rate-adjustable display screen corresponding to one or more of user voice, gesture, and touch commands. The see-through of the area. 9. The head-mounted display device HMD according to any one of claims 1 to 3, wherein the pixel-level adjustable display screen is a transparent monochrome LCD display or a transparent monochrome OLED display . 10. The head-mounted display device HMD according to any one of claims 1 to 3, wherein the miniature image display is one of an LCD display, an OLED display, and an LCoS display.

Images