TW201937238A - Improvements in or relating to virtual and augmented reality headsets - Google Patents

Abstract

A virtual or augmented reality headset (10) comprising two lens groups (100) for imaging two side-by-side 2-dimensional images displayed on a display (1) within the headset to form a virtual stereographic 3-dimensional image; each lens group comprising a primary lens (70), a first adjustable lens (200) for correcting a spherical refractory error in a user's distance vision and a second adjustable lens (300) for correcting astigmatism, the primary lens and first and second adjustable lenses within each lens group being in mutual optical alignment on a respective optical axis (z). Suitably, the first adjustable lens comprises a cubic surface-type adjustable lens (e.g. an Alvarez lens) comprising two superposed lens elements having mutually cooperating cubic or higher order surfaces that are slidable relative to one other along an x-axis of the first adjustable lens, while the second adjustable lens is rotatable about the z-axis and comprises a cubic surface-type in which two similarly superposed lens elements are slidable relative to one other along an y-axis of the second adjustable lens.

Description

Improvements in virtual and augmented reality headsets or improvements to the headset

The present invention relates to virtual and augmented reality headsets, and more particularly to two two-dimensional images displayed side by side in a headset to form a user through a pair of main objective lenses for magnifying images Virtual and augmented reality headsets for viewing stereoscopic 3D images. The image can be a still image (such as a photo) or a moving image (such as an image).

A virtual reality (VR) headset provides a virtual reality experience for the wearer. VR headsets are widely used in computer games, but these VR headsets are also used in other applications, including simulators, trainers, and newsletters. Augmented Reality (AR) headsets provide a real-time direct or indirect view of the physical real-world environment in which elements are enhanced (or supplemented) by computer-generated sensory inputs such as sound, image, graphics, or GPS data. The present invention relates to a virtual and augmented reality headset in which a 3D stereoscopic image is displayed within the virtual and augmented reality headset, either alone or superimposed on a view of a real world environment.

Known virtual and augmented reality headsets typically include an outer casing that is worn over the eyes of the user's face. Displaying a stereoscopic three-dimensional image in the headset, the stereoscopic three-dimensional image comprising two side-by-side 2D images, the two side-by-side 2D images forming a virtual when the user views the two side-by-side 2D images 3D image. A pair of main lenses are provided within the headset for imaging the stereo. Typically, an elastic or adjustable headband is provided to attach the outer casing to the user's head for hands-free use.

Some virtual and augmented reality headsets include one or more integrated displays for side-by-side display of two images that make up a 3D image. Other headsets, known as mobile virtual reality headsets, are designed to receive a mobile device including its own display such that the display of the mobile device faces the user's eyes when installed. The mobile device that can be a mobile phone can be easily removed from the housing after use.

In general, known virtual and augmented reality headsets provide a limited degree of focus on images displayed on the integrated display or display screen of the mobile device, as appropriate. For example, in a mobile virtual reality headset, the main lens is typically fixedly secured within the housing, but the mobile device is mounted on a portion of the housing that is disposed parallel to the optical axis of the main lens and Moving back and forth relative to the user perpendicular to the plane of the screen. However, the degree of focus provided by this is quite limited. In addition, it is not possible to adjust the focus of each eye separately. The prescription for adjusting the user's cylinder or astigmatism axis is not specified.

Therefore, in general, if the user needs his or her glasses for vision correction, the outer casing of the virtual augmented reality headset includes sufficient space in front of the user's eyes to accommodate the user. glasses. This is disadvantageous because it increases the size of the housing and limits the proximity of the display to the user's face. Especially in the case of a mobile VR headset, the removable mobile device can be quite heavy, and positioning it at a certain distance from the user's face can result in considerable impact on the user's face. This may be uncomfortable with the rotational force (although a foam pad or the like is typically provided around the rear end of the headset that is in contact with the user's face).

It would be desirable to have an improved virtual or augmented reality headset with a smaller form factor, especially a display (eg, a display of a mobile device) that is closer to the user's binocular positioning.

Another problem with virtual reality and augmented reality headphones is that even when displaying a three-dimensional image, the actual distance between the display and the user's eyes is constant. In real life, when a person sees an object farther than infinity, his or her eyes can adjust the object to focus and gather the object, reducing the interpupillary distance between the eyes. This combination of physiological responses called "regulating reflexes" sends important sensory cues to the brain to help understand the image and identify the distance to the particular object being viewed. In the absence of such physiological reactions, some users of virtual or augmented reality headsets experience some nausea or disorientation because they sense three-dimensional maps of various objects at different virtual distances. Like but their eye adjustments remain the same.

Therefore, when using virtual or augmented reality headsets, it is also desirable to improve this feeling of nausea and/or disorientation.

According to a first aspect of the present invention, there is thus provided a virtual or augmented reality headset comprising two lens groups for pairing Two side-by-side two-dimensional images displayed on a display within the headset are imaged to form a virtual stereoscopic three-dimensional image, each lens set including a main lens and at least one selectively adjustable having at least one variable optical characteristic lens. Suitably, each lens group may include a main lens, a first tunable lens for correcting spherical ametropia in the user's distance vision, and a second tunable lens for correcting astigmatism and astigmatism, each lens The main lens, the first tunable lens and the second tunable lens in the group are optically aligned with each other on respective optical axes. Thus the first tunable lens can have a selectively variable focusing capability (ie, a variable spherical sphere). The second tunable lens can have a columnar refractive power that is selectively variable. The second tunable lens is also selectively rotatable about its optical axis to adjust the astigmatic axis of the second tunable lens. In some embodiments, the second tunable lens of the at least one lens group can also have a selectively variable focusing capability to supplement or modify the focusing power of the first tunable lens.

In some embodiments, the headset can be a virtual reality (VR) headset in which only the three-dimensional image displayed on the display is visible. A virtual reality headset can incorporate one or more integrated displays. Alternatively, the virtual reality headset can be a mobile VR headset that is arranged to receive a mobile device with its own display, such that the mobile device can be easily removed from the headset, and when the mobile device is installed The mobile device is arranged such that its display faces the user's eyes.

In another embodiment, the headset can be an augmented reality (AR) headset in which the three-dimensional image is superimposed on a real-world image viewed through the headset.

In its broadest sense, the variable optical properties of at least one tunable lens mean a variable refractive power including the focusing power of the lens (spherical power) or the cylindrical refractive power ( Astigmatism), a variable astigmatic axis or a position that is variable in a direction transverse to the optical axis. In accordance with the present invention, at least one adjustable lens can be arranged to modify the vision of a user of the headset.

Preferably, the at least one adjustable lens can be configured to correct the user's vision. For example, the tunable lens can have a variable degree of spherical power, a cylindrical degree, and/or an astigmatic axis, and can be selectively adjusted to correct a prescription for the user's spherical and/or astigmatic light. However, in accordance with some embodiments of the present invention, at least one adjustable lens may alternatively or additionally be used to modify the user's vision based on images displayed within the headset. Therefore, "modifying the user's vision" as used herein means not only correcting the user's vision according to, for example, the eye prescription of the user's eye distance, pupil distance, astigmatism, etc., but also manipulating the manipulation as described in more detail below. The user's vision causes the user's eyes to be adjusted and/or gathered in response to how the user views the image on the display.

Advantageously, each lens group includes a first tunable lens for correcting the spherical power component of the user's far vision and a second tunable lens for correcting astigmatism (ie, the cylindrical power component and the astigmatic axial component). The optical properties of the first tunable lens may include one or more minor components in addition to the spherical power. The optical properties of the second tunable lens may include one or more minor components in addition to the cylindrical power. However, it should be understood that in some embodiments of the invention, the first tunable lens is used to correct the primary spherical power component of the user's distance vision. The second adjustable lens system is mainly used to correct astigmatism.

However, in certain alternative embodiments of the invention, the second tunable lens within each lens group may also provide a variable degree of spherical power. Preferably, the first tunable lens is independently adjustable, but in some embodiments, the first tunable lens can be connected for adjustment; preferably, the same adjustment is made simultaneously. A second tunable lens that provides a small amount of spherical power adjustment can thus allow for minor differences in the spherical power between the eyes of the user.

Suitably, the distance between the lens group and the display within the headset can be fixed. In some embodiments, the position of the lens group within the headset can be fixed, but in other embodiments, the lens group can be moved laterally in a direction parallel to the inter-boring axis between the user's eyes. Thus, the lens group can move laterally in a direction parallel to the plane of the display.

The tunable lens included in the headset of the present invention can be any suitable tunable lens known to those of ordinary skill in the art. Suitably, each lens group comprises at least one cubic surface type tunable lens comprising two superimposed lens elements having cooperating cubic or higher order surfaces, The equal surfaces may slide relative to each other in a plane perpendicular to the optical axis of the lens to change the refractive power of the lens. For example, each lens group can include at least one Alvarez lens as disclosed in U.S. Patent No. 3,305,294, the disclosure of which is incorporated herein by reference. Other suitable cubic tunable lenses having cubic and higher order surfaces are disclosed in U.S. Patent Nos. 3,583,790, U.S. Patent No. 7,338, 159, U.S. Patent No. 7,717, 552, U.S. Patent No. 5,644,374, and WO 2013/ 030 603 This is incorporated herein by reference.

Thus, the cubic surfaces of the lens elements can be shaped to provide variable sphericity correction when they are displaced relative to each other along the x-axis of the tunable lens, and/or when they are along the tunable lens elements relative to each other A variable cylindrical degree correction is provided when the axis is shifted, and the x-axis and the y-axis form a three-dimensional Cartesian coordinate system having a z-axis parallel to the optical axis of the tunable lens. Suitably, each lens element may have a first cubic or higher order surface of the type described above and a second opposing surface that is a standard rotating surface. In some embodiments, the second surface of each lens element can be planar.

Suitably, each lens group comprises a first cubic surface type lens, wherein the lens elements are slidable relative to one another in a direction parallel to the x-axis to correct the user's (primary) spherical distance vision. Naturally, in some embodiments, the x-axis of the first cubic surface lens may be oriented at an appropriate acute angle of about 60-80° with respect to the inter-boring axis extending between the sets of lenses. Thus, the x-axis of the first cubic surface lens can be disposed generally parallel to the adjacent side of the user's nose. It should be understood that the arrangement of the first cubic surface type lenses of the two lens groups is a mirror image of each other such that the x-axis of the first lens of one of the lens groups is at an angle of 45-80° with respect to the inter-pupil axis Orientation, the x-axis of the first lens of the other lens group 100 is oriented at an angle of -45 to -80 with respect to the inter-paraxial axis. This allows the lens group to be positioned close to the user's face while still maintaining a large relative movement between the two lens elements of the first cubic surface lens. It will be understood that if the x-axis is oriented substantially parallel to the inter-pupillary axis, the lens element travel will be limited by the user's nose in one direction and the wearer's field of view in the other direction, or the first tunable lens must be located. The front of the nose.

Optionally, in some embodiments, the first tunable lens of each lens group may comprise a variable focus capability liquid lens comprising an expandable film having an optical surface, wherein the focus of the liquid lens The ability is related to the curvature of the membrane. Suitable variable focus capability liquid lenses are disclosed in U.S. Patent No. 1,269,422, WO 99/061,940 A1, U.S. Patent No. 2,576,581, U.S. Patent No. 3,617,718, U.S. Patent No. 3,614,215, WO 2014/118546 A1, WO 2014/199180 A1, and WO 2017/055787 A2. The content of which is incorporated herein by reference.

In some embodiments, the refractive power (focusing ability) of the first tunable lens can vary over a range of up to about ± 15 degrees of power, preferably -15 to + 10 degrees of power. Suitably, the focusing power of the first tunable lens may be in the range of -8 to +6 degrees or -6 to +4 degrees.

Advantageously, in some embodiments, each lens group comprises a second cubic surface lens mounted for rotation about an axis parallel to the z-axis of the lens within the headset, The lens elements of the two lenses slide relative to each other in a direction parallel to the y-axis of the second cubic surface type lens to correct astigmatism.

In some embodiments, the columnar refractive power of the second cubic surface lens can vary up to about +8 to -8 degrees. Suitably, the columnar refractive power of the second cubic surface lens may be in the range of +4 to -4 degrees or +2 to -2 degrees, wherein the sign change of the columnar degree is equivalent to the astigmatism of 90 degrees. Axis.

Preferably, each lens group may include a rotation control actuator associated with the second cubic surface lens to adjust the axis of the second tunable lens. Each of the second cubic surface lenses may be arranged to rotate up to 90° about the optical axis.

Each lens group can include a respective slide control actuator associated with the or each cube surface lens for controlling the relative placement of the lens elements to adjust the refractive power of the lens.

In a particular aspect of the invention, each lens group can be mounted within the headset for translational movement in a direction parallel to the inter-boring axis extending between the two lens groups. Suitably, the main lens and the at least one adjustable lens within each lens group are mounted as a group to move together. Thus, the lens group can be mounted for translational movement in a direction parallel to the plane of the display. A corresponding pitch control actuator can be associated with each lens group to adjust the pupil spacing between the lens groups. In an alternate embodiment, the position of the primary lens can be fixed and only one or more of the adjustable lenses can be moved as described.

Suitably, the pupil spacing between the lens groups can be adjusted in the range of 50-76 mm. In some embodiments, the pupil spacing between the lens groups can be adjusted in the range of 52-72 mm or 54-70 mm.

In a particular aspect of the invention, the virtual or augmented reality headset further includes at least one eye tracker.

As described in more detail below, the output signal from the eye tracker can be used to calculate the user's line of sight by which the gaze point on the image displayed by the user within the headset can be determined. The virtual distance data associated with the image material used to create the image within the headset may include virtual distance values for a plurality of points or regions within the image (encoded as parallax in the stereo image) The object vertex distance (z distance) can be determined by the virtual distance values. The object vertex distance can be used to adjust at least one adjustable lens to modify the user's vision in a manner related to the distance of the object apex of the gaze point on the image. For example, the dioptric power of the first tunable lens can be adjusted in inverse relationship to the apex distance of the object to effectively view the image from a shorter virtual object distance. As a result, as compared to when the user is viewing a nearer point within the image having a smaller object vertex distance, when he or she is viewing a far point within the image having a larger object vertex distance, the first The lens has a large refractive index. In this way, the user's eyes are forced to adjust in response to the virtual distance of the portion of the image that the user is looking at.

In some embodiments as described below, at least one adjustable lens within each group can be arranged to correct his or her vision according to the user's prescription. Thus, the adjustment of the focusing ability of the first tunable lens relative to the virtual distance of the portion of the image that the user is viewing may include an adjustment from the user's prescription. In other words, at least one adjustable lens in each lens group can be set to correct the user's distance vision, and the refractive index of the first lens can be adjusted when the user is viewing an object closer than infinity. The negative refractive power is relative to the user's distance vision.

Thus, in accordance with a second aspect of the present invention, there is provided a software or firmware for controlling a virtual or augmented reality headset according to a first aspect of the present invention, the software or firmware comprising an includeable process The computer code executed by the computer and the memory to control the computer to receive the user's ophthalmic prescription data in the memory, the ophthalmic prescription data encoding at least the user's spherical degree correction for the distance, and transmitting the control signal to the sliding The actuator is controlled to adjust the relative arrangement of the lens elements of each of the first cubic lenticular lenses to adjust the focusing ability of the first tunable lens in accordance with the user's prescription.

Preferably, each of the first cubic surface type lenses can be adjusted independently of the other, but as described above, in some embodiments, the adjustment of the first adjustable lens can be connected, so that the lenses together Adjusted.

The computer can be connected to the separate computer of the headset of the present invention either wirelessly or via a suitable cable. Alternatively, as described above, the computer can be, for example, a mobile device as a mobile device that is received in the headset to display an image within the headset using the mobile device's own display screen.

In addition to the processor and memory, the computer can also include storage means for permanent storage of data as is known in the art. Suitably, the software or firmware can be executed by a computer to obtain the user's prescription data from the storage device. Alternatively, the software or firmware may be executed by a computer to prompt the user to enter their prescription information.

The software according to the present invention can be stored in a storage device of a computer and copied into the memory while the software is running. Alternatively, in a virtual or augmented reality headset of the present invention including its own onboard computer, the firmware of the present invention can be stored in suitable non-volatile memory within the headset.

It will be appreciated that in the headset according to the invention, the lens group can be positioned closer to the front of the user's eyes than in the case of conventional glasses for correcting the user's vision. Thus, adjusting the first cubic surface lens according to the user's prescription may include an additional offset to account for the user's eye position or vertex distance when wearing the headset. The offset can be entered using the prescription data, or the offset can be stored from the one-time calibration when the user first wears and adjusts the headset. In some embodiments, the vertex distance can be automatically obtained from an eye tracker device of the type described above that can be mounted within the headset.

In some embodiments, the user's ophthalmic prescription data may further include one or more of: lens-to-user fit data, such as, for example, pupil spacing, columnar power, astigmatism axis, and lens apex distance, The age and presbyopia, and the software can be executed by the processor to transmit control signals to the interpupillary control actuator associated with each lens group, the sliding associated with the first tunable lens and/or the second tunable lens Controlling an actuator and/or a rotation control actuator associated with the second tunable lens to adjust separation of the lens group, spherical refractive power of the first lens, and/or cylindrical refraction of the second tunable lens Rate and / or astigmatism axis to correct the user's vision according to their prescription.

Preferably, the software or firmware can be executed by a computer to control the computer to receive the astigmatic axis and column correction of the user for astigmatism in the memory, and to transmit a control signal to the controller to operate the rotation control actuator and A slide control actuator for the second cubic surface lens to adjust the orientation and refractive power of the second adjustable lens to conform to the user's prescription.

In a third aspect of the invention, a virtual or augmented reality software or firmware for operating a computer including a processor, a memory and a storage is provided to control the virtual aspect of the first aspect of the invention Or augment the operation of the real-world headset, the software or firmware includes executable code and data; the data includes image data encoding a stereoscopic image for display in the headset, and the virtual distance data includes Virtual distance values of virtual distances (the virtual distance values are from users of multiple points or regions within the image) and adjustment data (the adjustment data includes adjustment and/or vergence values); executable code may be processor Executing to retrieve image data from the storage and use the image data to generate a display signal for the display in the headset to display the image; transmit the display signal to the display; receive the eye from the headset The tracker represents the line of sight data of the user's line of sight; calculates the gaze point of the user on the displayed image from the received line of sight data; retrieves the virtual distance data and the use point from the storage Calculating the gaze point and the virtual distance data to determine the virtual distance between the user and the user's fixation point; retrieving the adjustment data from the storage and finding the adjustment and/or the vergence value corresponding to the virtual distance of the user's fixation point Generating and transmitting a control signal to the pitch control actuator according to the determined vergence value to adjust a distance between the lens groups on the inter-boring axis, and/or generating and transmitting a control signal according to the determined adjustment value A slide control actuator to the first cubic surface type lens to adjust the refractive power of the first lens.

When performing the virtual or augmented reality software or firmware of the third aspect of the present invention, the software or firmware thus controls the operation of the virtual or augmented reality headset according to the present invention, such that The virtual distance of the person to modify the user's vision to the point of gaze on the image he or she displays in the headset. In this way, as described above, when viewing an image portion having a virtual distance closer than infinity, the user's eyes can be forced to adjust and/or gather.

It should be understood that, in part, the virtual distance of the user's gaze point on his or her image will depend on the apex distance of the user. As described above, the vertex distance can be automatically obtained from the eye tracker. Once the vertex distance is measured, the vertex distance can be saved in the computer's memory during use of the software and/or stored in the memory for future use. The vertex distance can be adjusted when determining the virtual distance from the user to the user's gaze point on the image.

In some embodiments, the virtual reality software or firmware may be executed in conjunction with (or in combination with) the prescription setting software or firmware in accordance with the second aspect of the present invention. Therefore, when the user wears the headset to adjust at least one adjustable lens according to the prescription of the user, the setting software or firmware can be performed. In particular, the first tunable lens can be adjusted according to the user's distance prescription. When the second adjustable lens is present, the second adjustable lens can be adjusted according to the user's columnar degree and astigmatic axis prescription. The distance between the lens groups can be adjusted according to the user's interpupillary distance. During the use of the headset, when the user views the portion of the stereoscopic 3D image that is closer to infinity and causes the user's eyes to scatter, the distance between the lens groups can be reduced as described above. . When the user views the portion of the stereoscopic 3D image that is closer than infinity to cause the user's binocular adjustment, the focusing ability of the first tunable lens can be reduced as described above. In the case where the user's prescription information includes the user's age and/or presbyopia data, the first adjustable of the image portion at the virtual distance may be disabled or limited for the image portion of the virtual distance due to insufficient adjustment of the presbyopia. Adjustment of the lens.

In some embodiments, the software or firmware may be performed by a mobile device (eg, a mobile phone) having a display that may be adapted to virtual or augment a real-world headset to display two stereoscopic three-dimensional images. Side by side 2D images.

Accordingly, the present invention provides a virtual or augmented reality headset that is used in addition to a conventional pair for imaging a stereoscopic image displayed within a headset. Also included in the main lens is at least one adjustable lens for each eye. The adjustable lens can be adjusted to modify the user's vision (especially for vision correction) to avoid having to use the glasses in the headset. This makes the form factor of the headset more compact and more comfortable than previous virtual/amplified reality headsets. The tunable lens can also be dynamically controlled when the user views different portions of the stereoscopic image having different distances from the user's virtual distance. In this way, even if the distance between the user's eyes and the display remains fixed, the user is forced to adjust while viewing different parts of the image. This can help overcome some of the nausea experienced by users of previous virtual/amplified reality headsets.

In a preferred embodiment, the second adjustable lens associated with each eye allows for adjustment of the columnar power and/or astigmatic axis to further improve the user experience and image quality. The two lens groups can be mounted to translate within the headset in a direction parallel to the image plane (ie, parallel to the axis between the two lens groups) to allow the lens group to move closer or more far. Thus, the lens group can be disposed at a lay length corresponding to the user's interpupillary distance, and in some embodiments, when the user views different portions of the image at different distances from the user's virtual distance, Adjust the distance between the lens groups. In particular, when the user views a portion of the image at a virtual distance shorter than the user, the lens groups can be moved closer together; for example, to maintain the optical center of the lens group and when it is being viewed The alignment between the eyes that are scattered when the object is near.

1 shows a mobile virtual reality headset 10 worn by a user in accordance with one embodiment of the present invention. Although this embodiment relates to a mobile virtual reality headset designed to receive a mobile device including a display, the present invention is equally applicable to virtual and augmented reality headsets with integrated displays.

The mobile virtual reality headset 10 of the present embodiment includes a housing 12 having a front end 14, a rear end 15, a left side 16, a right side 17, a top 18, and a bottom 19. The outer casing 12 is assembled from a plurality of components including a side wall 20 extending around the outer casing 12 and having a front end 22 and a rear end 23, a peripheral rear extension 30, and a detachable front cover 40. As shown in Figure 1, the elastic headband 39 is attached to the side wall 20 at the right side 16 and the left side 17 of the outer casing 12 to secure the headset 10 above the eyes of the user's head for hands-free use. Alternatively, an adjustable headband can be used.

The rear extension 30 is fitted in the rear end 23 of the side wall 20, and as best seen in Figures 1 and 2, the rear extension 30 extends around the rear end 23 of the side wall 20, the rear end 23 comprising a plastically shaped receiving The area of the user's nose (not shown). The rear end 15 of the outer casing 12 including the rear end 23 of the side wall 20 and the rear extension 30 is shaped to match the general contour of the user's face, while the rear extension 30 is provided with a foam strip or other for the user. The cushioning material 35 is comfortable for the face (especially when the headband 39 is tightened around the user's head).

The front cover 40 is detachably secured to the molded insert 50 that fits into the front end 22 of the side wall 20. As best seen in Fig. 3, the insert 50 has a front surface 51 that defines a shallow, forwardly facing recess 52 that is shaped and sized to receive a type as shown in Fig. 4. A rectangular mobile device 1 displaying the screen 2. The front cover 40 may also have a concave rear surface such that the rear surface of the front cover 40 and the front surface 51 of the insert 50 form a recess for receiving the mobile device 1 when the front cover 40 is assembled to the insert 50. . A forwardly projecting configuration 53 is provided for engaging one or more mating configurations formed on the front cover 40 to attach the front cover 40 to the insert 50.

The base connector 55 is mounted on a cylindrical block 56 that is hinged to the insert 50 at its right side, while a manually operated button 58 is mounted to the left to connect the base of the corresponding mobile device 1 The device 3 is docked to the headset 10, the display screen 2 of the mobile device 1 is facing rear as shown in FIG. 4, and the mobile device 1 is fixed to the insert 50. Unlike some known mobile virtual reality headsets, the insert 50 cannot move relative to the outer casing 12. As described below, the dock connector 55 is arranged to connect the mobile device 1 to various onboard electronic components of the headset 10. As is known in the art, for example, the headset 10 is equipped with a manually operable controller that a plurality of users can access from outside the housing 12. In particular, the housing 12 is provided with a tracking board 24 (see FIG. 1), volume control (not shown for clarity), and a back button (also not shown). The headset 10 further includes a proximity sensor 25 (see FIG. 5) facing the user's face, an eye tracker 26, one or more motion tracking sensors 27, a charging port (also not shown), and a USB. Connector (also not shown).

The various component portions of the outer casing 12 including the side walls 20, the rear extensions 30, and the front cover 40 are formed of an opaque material to prevent ambient light from entering the outer casing 12 through the assembly portions. Similarly, the rear extension 30 and the foam strip 35 act to prevent light from entering the outer casing 12 through the rear end 15 by forming a snug fit with the user's face.

As best shown in FIG. 3, the insert 50 is also formed from an opaque material and is shaped to define a pair of spaced apart apertures 60. The apertures 60 are arranged to ensure that each eye of the user can only see a respective one of the two side-by-side 2D images displayed on the display of the mobile device 1. The front surface 51 of the insert 50 is juxtaposed and the insert 50 can be formed by a unitary spacer 62 between the two holes 60 to block light from one of the images from penetrating into the other hole 60. An insert 50 is formed around each of the apertures 60 in a generally cylindrical inner surface 64 having a diameter of about 50 mm and extending rearwardly from the front surface 51 through the insert 50.

A biconvex main lens 70 is disposed behind each aperture 60 to image the side-by-side image displayed on the display to form a 3D stereoscopic image. The main lenses 70 have the same refractive power as each other. The actual refractive power of the lens will depend on the distance between the display and the lens 70, but the lens 70 may suitably have a refractive power of about 35 degrees.

As schematically illustrated in Figure 5, each main lens 70 is part of a respective lens group 100, which further includes two tunable lenses 200 and 300 in accordance with the present invention, as described in more detail below. Each lens group 100 is associated with a respective one of the user's eyes E to view a respective one of the side-by-side 2D images displayed on the display 2 of the mobile device 1 as described above to form a virtual 3D stereo image. The position of each lens group 100 between the front end 14 and the rear end 15 of the outer casing 12 is fixed. However, as described in more detail below, each lens group 100 is mounted within the outer casing 12 for translational movement on a horizontal axis H between the right side 16 and the left side 17 of the outer casing 12. When the headset 10 is worn, the horizontal axis H is oriented substantially parallel to the inter-boring axis extending between the user's right and left eyes. The lens group 100 can be conveniently mounted to the inner surface of the side wall 20, but in the present embodiment, as shown in FIGS. 5 and 6, the lens group 100 is mounted to the rear surface of the insert 50 behind the hole 60 (not shown). Out). Within each lens group 100, the tunable lenses 200 and 300 are disposed behind the respective main lens 70. However, in other embodiments, the tunable lenses 200 and 300 can be located in front of their respective main lenses 70.

As described in more detail below, each lens group 100 thus includes two adjustable lenses 200 and 300 for modifying the user's vision. "Modification" means not only that the adjustable lenses 200 and 300 can correct the user's vision, but also control the user's viewing of the stereoscopic image to compensate for the fact that the distance between the user's eyes and the display is constant. The first tunable lens 200 of each lens group 100 is provided to modify the primary spherical power component of the user's vision, while the second tunable lens 300 is provided to primarily modify the cylindrical power and astigmatic axial components. In the present embodiment, the first adjustable lens 200 is located behind the second adjustable lens 300 and closer to the eyes E of the user. However, in other embodiments, and more generally, the first tunable lens 200 and the second tunable lens 300 may be arranged in either order after the other.

In this embodiment, each of the first adjustable lens 200 and the second adjustable lens 300 of each lens group 100 is a stereoscopic surface type adjustable lens, and the stereoscopic surface type adjustable lens includes, as shown in FIG. 9A. And best shown in Figure 9B, two superimposed lens elements 201, 202 and 301, 302. The lens elements 201, 202 and 301, 302 of each lens 200, 300 have interfitting cubic surfaces that are plastically shaped such that the lens refraction when the lens elements are moved relative to one another in a plane perpendicular to the optical axis of the lens Rate changes.

In other embodiments of the invention, one or both of the tunable lenses 200 and 300 (especially configured to correct the user's spherical focusing capability for distance vision as detailed below) The first tunable lens 200) employs different types of tunable lenses (eg, fluid lenses).

In the present embodiment, the lens elements 201, 202 and 301, 302 of each of the cubic tunable lenses 200 and 300 have polished front and rear surfaces, and as shown in FIG. 6, each of the lens elements 201, 202 And the optical thickness t of 301, 302 in a direction parallel to the optical axis z is defined by the formula (I) as: (I) where D is a constant representing a 稜鏡 coefficient that is removed to minimize the thickness of the lens and is zero; E is a constant representing the thickness of the lens element at the optical axis z ; x and y are centered on the optical axis and located a coordinate on a Cartesian coordinate system on a plane perpendicular thereto; and A is a constant indicating a rate of change of the refractive power of the lens relative to the movement of the lens element in the x direction, the constant being for the lens elements 201, 202 and 301, 302 One is positive and negative for the other lens elements 202, 201 and 302, 301. One face of each of the lens elements 201, 202 and 301, 302 is planar, but in other embodiments of the invention, one face of each lens element can be a standard rotating surface.

Although the lens elements 202, 201 and 302, 301 of the present embodiment are defined by the above formula (I), other cubic tunable lenses having a cubic and higher order surface suitable for use in accordance with the present invention are provided by U.S. Patent No. 3,305,294, U.S. No. 3,583,790, U.S. Patent No. 7,338,159, U.S. Patent No. 7,717,552, U.S. Patent No. 5,644,374, the disclosure of which is incorporated herein by reference.

Each lens group 100 thus includes a main lens 70, and a first cubic tunable lens 200 and a second cubic tunable lens 300 and are mounted within the outer casing 12 to be as shown by the arrow A in FIG. Illustrated, laterally moving side by side on the horizontal axis H between the left side 16 and the right side 17 of the outer casing 12 to adjust the lay length (PD) between the lens groups 100. As shown in FIG. 21, separate actuators 503 and 504 are associated with each lens group 100 to move the lens group 100 independently of each other under the control of the respective control units 501 and 502. Separate control units 501 and 502 are associated with each of the left and right side lens groups 100. The lay length can be adjusted in the range of 50-76 mm, but different embodiments can have different ranges of PD adjustments, such as 52-72 mm or 54-70 mm.

7 and 8 schematically illustrate the right lens group 100 in more detail. The arrangement of the left lens group 100 is similar to the arrangement of the right lens group 100, but in a mirror image manner. The anatomy of the entire right and left reference frames corresponds to the user's right and left eyes.

As shown in FIGS. 7 and 8, the first tunable lens 200 and the second tunable lens 300 of the right lens group 100 are mounted on the optical axis z behind the corresponding main lens 70. The lens elements 201 and 202 of the first cubic tunable lens 200 are mounted to slide parallel to the x-axis of the lens 200 relative to each other to adjust the primary spherical power of the lens 200.

As best shown in FIG 12A, the first lens 200 is attached to the adjustable x-axis, the x-axis with respect to the horizontal axis H acute angle θ of about 75 ° orientation. In other embodiments, an angle θ in the range of 60-80° can be used. The lens group 100 can be positioned within the outer casing 12 such that the lens groups are disposed adjacent the region of the extension 30 that is shaped to receive the user's nose. At least the first cube-shaped lens 200 can be positioned near the user's nose when the headset is worn, and can accommodate the lens elements 201 and 202 by orienting the first lens 200 at an acute angle θ with respect to the horizontal axis H. The portion that is actually relatively moved without colliding with the user's nose or shaped to receive the outer casing 12 of the user's nose. It should be understood that since the lens is hidden within the outer casing 12 of the headset 10, aesthetic considerations resulting from such acute angular orientation of the first lens 200 do not occur.

In light of the foregoing, it will be understood that the relative movement of the lens elements 201 and 202 of the first tunable lens 200 parallel to the x-axis causes adjustment of the primary spherical power of the lens 200 as shown in Figures 13A-13C. In the present embodiment, the first tunable lens 200 can have a spherical power ratio range of about -8 to +6 degrees, but in some embodiments a wider or narrower range can be used, for example, -15 to +10 degrees or -6 to +4 degrees. Generally, the first tunable lens 200 may have a spherical dioptric power range of ±10 degrees or up to ±15 degrees.

Any suitable mechanism, schematically indicated by item 210 in Figures 7 and 9, can be provided to adjust the relative arrangement of lens elements 201 and 202 of first tunable lens 200. As shown in Fig. 12A, in the present embodiment, each of the lens elements 201 and 202 is assembled with internally threaded projections 203 and 204 having threads opposite to each other. The projections 203 and 204 are mounted on a mandrel 205 having spaced apart threaded portions 207 and 208 that also have opposing threads that are configured to engage the respective projections 203 and 204. Rotation of the mandrel 205 on its axis thus causes the lens elements 201 and 202 to be displaced relative to one another in the same and opposite directions on the x-axis. Such a mechanism is disclosed in U.S. Patent No. 2008/0030678 A1, the disclosure of which is incorporated herein by reference. An actuator 506 as a prime mover is mounted at one end of the mandrel 205 to rotate the mandrel 205 under the control of the control unit 502. A corresponding actuator 505 is associated with the first tunable lens 200 of the left lens group 100.

As shown in FIGS. 7 and 8, the second tunable lens 300 of each lens group 100 is mounted between the first tunable lens 200 and the main lens 70. Unlike the first tunable lens 200, as shown in FIGS. 14A to 14C, the second tunable lens 30 is mounted to rotate about the optical axis z. As shown in FIGS. 15A to 15C, the lens elements 301 and 302 of the second tunable lens 300 are also mounted to slide relative to each other in a direction parallel to the y-axis of the second lens 300. According to the above formula (I), it will be understood that shifting the lens elements 301 and 302 of the second lens 300 relative to each other along the y-axis causes adjustment of the main columnar refractive power of the second lens 300. The rotation of the second lens 300 about the z-axis allows adjustment of the axis of the lens 300. In combination, the second lens 300 is rotated and adjusted by the relative movement of the lens elements 300 and 301 parallel to the y-axis to primarily allow for the modification of the columnar power and astigmatic axis of the user's vision (including correcting astigmatism).

In the present embodiment, the second tunable lens 300 can have a range of columnar refractive power of about +4 to -4 degrees, but like the first tunable lens 200, in some embodiments, more can be used. A wide or narrow range, such as +8 to -8 degrees or +2 to -2 degrees. The second tunable lens 300 can or can be rotated about an optical axis of 90 to provide a full range of astigmatic prescriptions for different users.

In the present embodiment, the lens elements 301 and 302 of the second tunable lens 300 cannot be displaced relative to each other parallel to the x-axis of the second lens 300. However, it is contemplated that in other embodiments, some relative sliding of the lens elements 301 and 302 of the second tunable lens 300 on the x-axis may be permitted under the control of a suitable further actuation mechanism to allow for use. The spherical components of the right and left eyes of the person are independently corrected. In this embodiment, the second tunable lens 300 may have a variable spherical power ranging from 0 to 2 degrees or 0-1 degrees in addition to its variable cylindrical power component and astigmatic axial component.

For the first tunable lens 200, any suitable mechanism schematically represented by item 310 in Figure 9B can be provided for the relative movement of lens elements 301 and 302 on the y-axis as described above. In the present embodiment, as shown in FIG. 12B, each of the lens elements 301 and 302 is assembled with internally threaded projections 303 and 304, and a mandrel 305 and threaded projection provided with two longitudinally spaced apart threaded portions 307 and 308. 303 and 304 are joined. The projections 303 and 304 and the threaded portions 307 and 308 are formed with opposing threads such that rotation of the mandrel 305 causes relative movement of the lens elements 301 and 302 parallel to the y-axis, across the z-axis. Actuator 508 is mounted to one end of mandrel 305 to cause rotation of mandrel 305 under the control of control unit 502. The mirrored left second adjustable lens 300 is similarly provided with a corresponding actuator 507 under the control of the corresponding control unit 501.

Similarly, any suitable mechanism for controlling the rotation of the second tunable lens 300 about the optical axis z can be provided. In the present embodiment, as shown in FIGS. 11 and 12B, one of the lens elements 301 and 302 is assembled with a gear profile 315 having a series of teeth 316, and the second lens 300 is mounted within the outer casing 12 such that the gear profile 315 engages pinion gear 320. The teeth 316 of the gear profile 315 are arranged along a curved arc, and the pinion gear 320 is drivably coupled to the actuator 510 to rotate the third lens 300 about the z-axis under the control of the control unit 502. A corresponding actuator 509 is provided to rotate the left second adjustable lens 300 under the control of the control unit 501.

As schematically shown in Fig. 16, in addition to a pair of main lenses 70 for imaging two side-by-side 2D images displayed on the display 2 of the device 1 to form a stereoscopic 3D image, the A tunable lens 200 and a second tunable lens 300 can change the visual acuity of the user by adjusting the spherical power (first tunable lens 200) and the columnar power and the astigmatic axis (second tunable lens 300). The two lens groups 100 can be moved closer or further to change the user's interpupillary distance. The actuators 503 to 510 of the left and right lens groups 70 are controlled under the control of the control units 501 and 502. Referring to Figure 21, control units 501 and 502 are coupled to a processor 520 mounted on a small PCB that is fixedly secured within housing 12. The processor 520 is also coupled to the memory unit 521 and the base connector 55 on the insert 50 for interaction with the mobile device 1, the tracking board 24, and other user operable controls on the headset 10, proximity sensing. The device 25, the eye tracker 26 and the motion tracking sensor 27 communicate.

In particular, the first tunable lens 200 of each lens group 100 can be adjusted by actuators 505 and 506 under the control of control units 501 and 502 to provide the most recent equivalent for correcting the user's distance vision. Sphere (NES). For users who also have astigmatism, actuators 507, 508, 509, and 510 can be used to adjust the second tunable lens 300 of each lens group 100 to correct the columnar power and astigmatic axis. Actuators 503 and 504 can be used to adjust the interpupillary distance between lens groups 100. In the present embodiment, each of the first tunable lenses 200 is independently adjusted to allow for different vision corrections for each eye. However, in some embodiments, the first tunable lens 200 of the two lens groups 100 can be adjusted together to provide the same degree of sphericity correction in both eyes, and the lens elements 301 and 302 can be disposed as described above. Additional independent adjustments to one or both of the second tunable lenses 300 are made to slide relative to each other parallel to the x-axis and the y-axis. In this manner, the first tunable lens 200 can be operated to, for example, perform an average vision correction on the spherical power between the two eyes, and the second tunable lens 300 can be used to perform the difference in the spherical power between the two eyes. The small final adjustment is 300.

Advantageously, the prescription setting software for adjusting the first and second adjustable lenses 200 and 300 according to the present invention may be stored in the storage device 4 or the memory unit 5 of the mobile device 1, which may be processed by the mobile device 1. The processor 6 executes to transmit commands to the control units 501 and 502 to operate the actuators 503 to 510 when the mobile device 1 is connected to the base connector 55 of the headset 10 via its base connector 3. In the current embodiment, the prescription setting software includes executable machine code for displaying a prompt to the user on the display 2 of the mobile device 1 to input his or her ophthalmic prescription, the ophthalmic prescription including at least the user's distance The spherical power is corrected and optionally includes fitting data for the wearer's lens, such as the interpupillary distance, the cylindrical degree, the astigmatic axis and the lens apex distance, the age and/or the presbyopia. The software also includes code for allowing the user to store his or her prescription data in the storage device 4 of the mobile device 1 to prevent the user from having to re-enter the data when he or she uses the headset 10 again. The prescription data is stored on the mobile device 1 associated with the user account in a manner well known to those of ordinary skill in the art, such that different users can store their own prescription data on the mobile device 1.

Figure 17 is a flow diagram of setting up the headset 10 in a user prescription in accordance with the present invention. After the mobile device 1 is docked with the cradle connector 55 on the headset 10, the electronic components of the headset 10 receive power from the mobile device 1 (1001), and the headset is activated. After the prescription setting software is executed in the processor 6 of the mobile device 1 (for example, by opening an application on the mobile device), the electronic components of the headset 10 communicate with the mobile device 1 (1002), and from the storage device 4 The user's personal ophthalmic prescription data is retrieved and loaded into the memory 5 (1004). If the user's prescription data is not found in the storage device 4, the user is prompted to enter his or her prescription data. The processor 6 executes the setup software using the user's prescription data to send an instruction to the onboard processor 520 of the headset 10 to instruct the control units 501 and 502 to operate the actuators 501-310 to be based on the user's prescription. The position of the lens group 100 on the horizontal axis H and the settings of the first and second adjustable lenses 200 and 300 of each lens group 100 are adjusted (1005). It should be understood that the lens assembly 100 will typically be located further away from the user's eye E than a pair of glasses, and therefore some offset from the user's prescription is required to correct the adjustment of the first and second lenses 200 and 300 to the user.

Accordingly, the setting software of the present invention may include a code for prompting the user to input a measurement result of his or her binocular position when the prescription material is input, and may be based on the user's prescription information and his or her eyes. The position is used to calculate the necessary offset of the first and second lenses 200 and 300. Alternatively, the setting software may include a short calibration routine. When the new user first uses the headset 10, the short calibration routine is executed to fine tune the first and second distances of the user's eyes from the lens group 100. Lenses 200 and 300. Next, the calibration data can be stored in the storage device 4 as user profile information for the profile, so the user does not have to recalibrate the headset 10 each time he or she uses the headset 10.

In a variation of the invention in which the headset according to the invention comprises one or more integrated displays (instead of receiving mobile devices), the software can be connected to the headset wirelessly or via a cable (eg USB) Run on a separate computer (not shown). When the setting software is executed, the setting software may prompt the user to log in the details (1002A), and after receiving the correct login credentials, operate the processor of the separate computer to retrieve the user's ophthalmic prescription data from the storage device, the storage The device is integrated with or connected to a separate computer and calculates the necessary adjustments to the lens set 100 based on the user's prescription data.

Therefore, according to the present invention, the lens group 100 can be set according to the user's vision under the control of the soft body. As a result, when using the headset of the present invention, the user does not need to wear glasses to correct ametropia, and the headset does not need to include sufficient space to accommodate the user's glasses. This can bring many advantages in terms of the quality of the image viewed by the user, and additionally allows the headset to be designed to have a smaller form factor than previous virtual and augmented reality headsets. Such prior virtual and augmented reality headsets require a certain minimum distance from the user's face to accommodate the glasses of the user in need of glasses to correct vision. By using a headset that does not protrude far from the user's face, the rotational force exerted by the headset on the user's face caused by the weight of the headset can be reduced, so that the head Wearing headphones is more comfortable to wear. .

As described above, the headset 10 of the present embodiment includes an eye tracker 26 that allows the headset 10 of the present invention to operate in a manner consistent with certain aspects of the present invention to reduce or eliminate The feeling of nausea or other discomfort associated with viewing a 3D stereoscopic image (as described below). However, other embodiments may omit the eye tracker and related additional features described below.

Any suitable eye tracker 26 that measures the user's gaze point can be used, but in this embodiment, an image-based eye tracker is used in which infrared/near-infrared non-collimated light is used to establish corneal reflection, and The vector between the pupil center and the corneal reflection is used to calculate the point of interest in the surface or gaze direction. The eye tracker 26 can be mounted within the housing 12 at any convenient location that allows the user's one eye to have a clear line of sight. In the present embodiment, the monocular tracker 26 is used to measure the line of sight of the user's left eye. However, it will be understood that in other embodiments, the right eye may be measured, or two eye trackers may be employed, one eye tracker being associated with one eye.

Virtual reality software known in the art for operating a mobile virtual reality headset equipped with a mobile device (e.g., as mobile device 1 in this embodiment) typically consists of executable code and data. As mentioned above, mobile devices typically include a processor, a memory, a memory, and a display. The software is stored in the storage and acquires at least a temporary copy of the executable code and loads it into the memory while the software is running. The data includes image data encoding a 3D stereoscopic image for display within the headset, and the code is executable by the processor to retrieve image data from the storage and use the image material to generate a display signal for wearing on the headset The image is displayed on the display inside the headset. The image material may include information for displaying a static stereoscopic image on the display, but in some embodiments, may include information for displaying the moving stereoscopic image. For example, the image material may include a movie file or a 3D game. Dynamically updating the image displayed on the display in response to the user's head motion measured using a motion tracking sensor 27 (eg, a gyroscope, an accelerometer, and a structured light system) in the headset or mobile device To simulate the user looking around the 3D scene. Such virtual reality software is known in the art and need not be described in more detail herein.

According to the invention, the software of the embodiment further comprises virtual distance data as part of the image data. For example, the virtual distance data can be encoded as parallax data between two images of the stereoscopic image. The virtual distance data includes a virtual distance value from a virtual distance of the user's eye E of a plurality of points or regions within the image to be displayed. The data further includes adjustment data including adjustment values and vergence values corresponding to the virtual distance. When the software is running, the virtual distance data and the adjustment data are retrieved from the storage device 4 and loaded into the memory 5 for quick access by the processor 6.

The display signal generated by the processor 6 causes the display 2 to display two side-by-side 2D images that are imaged together by the respective lens groups 100 in the headset, as is known in the art. A virtual 3D stereoscopic image is usually formed in a manner known to the skilled person. The user views the 3D stereoscopic image through the lens group 100, and when moving his or his head to look around the virtual scene included in the image, the image is updated to change as the user moves.

It should be understood that in a typical virtual 3D scene, even if the actual distance of the display from the user is constant and fixed, some portions of the image will be farther away from the user than others. As shown in FIG. 19 and FIG. 20, when viewing a real 3D scene, the user's eyes are adapted according to the distance of the portion of the scene that the user is watching. In particular, when viewing a near object, the user's interpupillary distance is reduced (the user's eyes are scattered) and the adjustment is increased. When viewing a virtual 3D scene, the user's eyes will not naturally adjust, which may cause some people to feel sick (gather-adjustment conflict). In some aspects, the present invention seeks to overcome this problem by adjusting the position and refractive power of the lens group 100 in response to a user's line of sight measured using the eye tracker 26, although as described above, may be implemented The present invention of the first and second adjustable lenses 200 and 300 corrects the user's prescription in a virtual or augmented reality headset without such additional features.

As shown in FIG. 21, the processor 520 in the headset 10 is arranged to receive signals from the eye tracker 26 and to transmit data encoding the user's line of sight to the mobile device 1 via the dock connector 55. As shown in the flow chart of FIG. 18, this step is represented by the component symbol 2001. The executable code includes an algorithm known in the art for calculating a gaze point of a user on a display image from line of sight data 2002. Next, the virtual distance value for the image portion corresponding to the user's fixation point is searched for in the virtual distance data stored in the memory 5. Using the acquired virtual distance value, the corresponding adjustment and vergence values are obtained from the adjustment data in the memory 5. The processor then uses the obtained adjustment and vergence values to transmit instructions to the processor 520 of the headset 10 to instruct the control units 501 and 502 to send control signals to the actuators 503, 504, 505, and 506 to The position of the right and left lens groups 100 on the horizontal axis H and the spherical refractive power of the first tunable lens 200 are controlled in accordance with the obtained adjustment and dispersion values.

In particular, actuators 503 and 504 are operated by control units 501 and 502 to adjust the interpupillary distance between individual lens groups 100 to match the convergence distance corresponding to the virtual distance value of the user's fixation point in the displayed image. Degree value. Similarly, the actuators 505 and 506 operated by the control units 501 and 502 adjust the first tunable lens 200 such that the spherical refracting power of the first lens 200 and the virtual distance corresponding to the gaze point of the user on the image The adjusted values of the values match. In this manner, the lens group 100 of the headset of the present embodiment is adjusted to force the user to adapt in response to his or her gaze point. When the user views the near point in the virtual 3D image, the lens groups 100 are moved closer together using the actuators 503 and 504, thereby allowing the eyes of the user to gather. When the user views a farther point, the lens group 100 is removed. When the user sees the near point, the first tunable lens 100 is adjusted using the actuators 505 and 506 to shift the lens elements 202 and 203 of each of the first lenses 100 in a direction parallel to the x-axis of the lens 200. In order to reduce the spherical power of the lens 100, the user is more strongly adjusted to view the image in the focus. Similarly, when the user views a farther point, the actuators 505 and 506 are operated to increase the refractive power of the first tunable lens 200 in accordance with the user's distance vision.

The virtual reality software of the present invention can be integrated with the prescription setting software to dynamically adjust the first and second adjustable lenses 200 and 300 with respect to the normal prescription of the user. Therefore, when the user views the far point in the 3D virtual image on the display 2, the lens group 100 is adjusted to match the prescription of the user's pupil distance, spherical power, column power, and astigmatism axis. When the user views a closer point within the virtual image as determined from the line of sight of the user measured by the eye tracker 26, the lens group 100 is adjusted under the control of the software to adjust the distance between the lens groups 100. And the degree of adjustment provided by the first tunable lens 200 (and optionally the second tunable lens 300 as described above) to force the user's eyes to adjust in the same manner as when viewing a real 3D scene naturally And gathering.

As shown in FIG. 16, the virtual reality headset 10 of the present embodiment is capable of providing various modifications to the user's vision. As described above, the first tunable lens 200 can be selectively adjusted to correct the user's spherical power prescription as indicated by block (a) of FIG. As shown in block (b), the second adjustable lens 300 can also be adjusted to correct the user's columnar degree and astigmatic axis. If the user does not need distance correction, the astigmatism and astigmatism axes are corrected only as shown in block (e).

Additionally, the lens set 100 of the headset 10 can be adjusted to dynamically modify the user's vision based on the virtual distance of the portion of the virtual 3D stereoscopic image viewed by the user within the headset. Specifically, when the gaze point of the user is located at a portion of the image that is closer to the virtual distance of the user, the lens group 100 can be moved closer together as shown in block (j) of FIG. 16 The interpupillary distance between the lens groups 100 is adjusted more recently. The pupil distance between the lens groups 100 can also be adjusted in the same manner to fit the user. In addition, when a closer virtual object is viewed by reducing the refractive power of the first tunable lens 200 as shown in block (h), the user's eyes can be adjusted. Box (i) indicates the combination of the lay length and the adjustment adjustment.

If the user needs vision correction in addition to the forced adjustment when viewing the near portion of the virtual image, the first and second adjustable lenses 200 and 300 can be adjusted accordingly. As shown in block (f), the first and second adjustable lenses 200 and 300 can be controlled to correct the user's columnar degree and astigmatic axis with a virtual distance corresponding to the portion of the image the user is viewing. Adjustment. In one variation, as shown in block (g), only the interpupillary distance and the columnar degree/astigmatism axis are adjusted. For a user who needs distance correction and has astigmatism, the first and second adjustable lenses 200 and 300 can be adjusted to correct the columnar degree and the astigmatic axis, and can be corrected by the user's distance and corresponding to the distance user. The adjustment of the virtual distance of the portion of the image being viewed calculates the net spherical power provided by the first tunable lens 200. When looking at a close object, the lay length may also decrease as shown in block (d).

The headset 10 and the software of the present embodiment have been described with reference to virtual reality headsets and virtual reality software, but those of ordinary skill in the art will appreciate that the present invention can be embodied in a similar manner in virtual 3D. An augmented reality headset that overlays the image on a real-world image viewed through an opening in a transparent screen or headset.

1‧‧‧ mobile device

2‧‧‧Display screen

3‧‧‧Base connector

4‧‧‧Storage device

5‧‧‧ memory unit

6‧‧‧ processor

10‧‧‧ headphones

12‧‧‧ Shell

14‧‧‧ front end

15‧‧‧ Backend

16‧‧‧left side

17‧‧‧right

18‧‧‧ top

19‧‧‧ bottom

20‧‧‧ side wall

22‧‧‧ front end

23‧‧‧ Backend

24‧‧‧ Tracking board

25‧‧‧ proximity sensor

26‧‧‧ Eye Tracker

27‧‧‧Motion tracking sensor

30‧‧‧After the extension of the perimeter

35‧‧‧ cushioning material

39‧‧‧Flexible headband

40‧‧‧ front cover

50‧‧‧Molded inserts

51‧‧‧ front surface

52‧‧‧ recess

53‧‧‧Structure

55‧‧‧Base connector

56‧‧‧ cylindrical block

58‧‧‧ button

60‧‧‧ holes

62‧‧‧ integral partition

64‧‧‧ inner surface

70‧‧‧ main lens

100‧‧‧ lens group

200‧‧‧First adjustable lens

201‧‧‧ lens elements

202‧‧‧ lens elements

203‧‧‧ Protrusion

204‧‧‧ Protrusion

205‧‧‧ mandrel

207‧‧‧Threaded part

208‧‧‧Threaded part

210‧‧‧Project

300‧‧‧Second adjustable lens

301‧‧‧ lens elements

302‧‧‧ lens elements

303‧‧‧ Protrusion

304‧‧‧ Protrusion

305‧‧‧ mandrel

307‧‧‧Threaded part

308‧‧‧Threaded part

310‧‧‧Project

315‧‧‧ Gear profile

316‧‧ teeth

320‧‧‧ pinion

501‧‧‧Control unit

502‧‧‧Control unit

503‧‧‧Actuator

504‧‧‧Actuator

505‧‧‧Actuator

506‧‧‧Actuator

507‧‧ ‧ actuator

508‧‧‧ actuator

509‧‧‧Actuator

510‧‧‧ actuator

520‧‧‧ processor

521‧‧‧ memory unit

1001‧‧‧Steps

1002‧‧‧Steps

1002A‧‧‧Steps

1004‧‧‧Steps

1005‧‧‧Steps

2001‧‧‧Steps

2002‧‧ Sight data

The following is a description of additional figures referring to the embodiments of the invention, by way of example only.

In the additional schema:

Figure 1 shows a virtual reality headset worn by a user.

Figure 2 is a perspective front elevational view from above and to the left of the headset of Figure 1.

3 is a perspective front elevational view from the left side of the headset of FIGS. 1 and 2, the perspective front view showing an insert for a mobile phone or other handheld mobile device including a display screen.

4 is another perspective front elevational view from the left side of the headset shown in the previous figures, showing the mobile phone in a partially docked position.

Figure 5 is a schematic plan view of the virtual reality headset of Figures 1 through 4 showing a pair of lens groups in accordance with the present invention.

Figure 6 is a schematic side elevational view of the headset of Figure 5 worn on the user's face.

7 is a schematic plan view of a right lens group of the headphones of FIGS. 1 to 6.

Fig. 8 is a schematic rear view as seen from above and to the right of the right lens group of Fig. 7.

Fig. 9A is a schematic rear view as seen from above and to the right of the first cubic lens forming a portion of the lens group shown in Figs. 7 and 8.

Fig. 9B is a schematic rear view as seen from above and to the right of the second cubic lens forming the portion of the lens group of Figs. 7 and 8.

Figure 10 is a plan view of the right lens group of Figures 9 and 10 showing the electronically controlled actuator for adjusting the first and second cube lenses.

Figure 11 is an isometric rear view as seen from the right side of the right lens group of Figure 10 .

Figure 12A is a rear elevational view of the first cubic lens of the right lens group of Figures 10 and 11.

Figure 12B is a rear elevational view of the second cube lens of the right lens group of Figures 10 and 11.

Figures 13A-13C illustrate the adjustment of the first cube-shaped lens of Figure 12A to modify the adjustment of the user.

14A to 14C illustrate the adjustment of the second cubic lens of Fig. 12B to correct the astigmatic axis of the user.

15A to 15C illustrate the adjustment of the second cubic lens of Fig. 12B to correct the columnar power of the user.

Figure 16 is a diagram showing the adjustments required by the first cube lens and the second cube lens of Figures 12A and 12B to correct the user's vision and/or change their adjustment or lay length (PD).

Figure 17 is a flow chart for adjusting the software of the lens in the headset according to the present invention in accordance with the prescription of the user.

18 is a flow diagram of a software for adjusting a lens within a headset in accordance with the present invention to modify a user's vision based on a point or region of a stereoscopic 3D image viewed within the headset.

19 and 20 schematically illustrate how the user's interpupillary distance varies depending on the distance of the object being viewed.

21 is a block diagram of the electronic components of the headset of FIGS. 1 through 15.

Domestic deposit information (please note according to the registration authority, date, number order) None Foreign deposit information (please note according to the country, organization, date, number order)

Claims (32)

A virtual or augmented reality headset comprising two lens groups for performing two side-by-side two-dimensional images displayed on a display within the headset Imaging to form a virtual stereoscopic three-dimensional image; each lens group includes a main lens, a first adjustable lens for correcting a spherical refractive error in a user's distance vision, and for correcting the cylindrical degree (cylinder) And a second tunable lens of the astigmatism axis, the main lens, the first tunable lens and the second tunable lens in each lens group are optically calibrated to each other on a respective optical axis. The virtual or augmented reality headset of claim 1, wherein the virtual or augmented reality headset is a virtual reality (VR) headset, the virtual reality (VR) In the headset, only the three-dimensional image displayed on the display is visible to the user. A virtual or augmented reality headset as claimed in claim 2, wherein the headset comprises one or more integrated displays. The virtual or augmented reality headset as claimed in claim 2, wherein the virtual or augmented reality headset is a mobile virtual reality headset, the mobile virtual reality headset The headset is arranged to receive a mobile device having its own display such that the mobile device is removable from the mobile virtual reality headset, and when the mobile device is installed, the mobile device is arranged such that Its display faces the eyes of the user. The virtual or augmented reality headset according to claim 1, wherein the virtual or augmented reality headset is an augmented reality headset, and the three-dimensional image in the augmented reality headset is Superimposed on an image of the real world viewed through the virtual or augmented reality headset. The virtual or augmented reality headset of claim 1, wherein the second tunable lens within the at least one lens group also has a variable spherical degree. The virtual or augmented reality headset of claim 6, wherein the first adjustable lens is connected to perform the same adjustment at the same time, and the at least one second adjustable lens allows correction of the user's eyes A small difference between the spherical degrees. The virtual or augmented reality headset of any one of claims 1 to 7, wherein the first tunable lens is independently adjustable. The virtual or augmented reality headset of claim 1 wherein the distance between the lens groups within the virtual or augmented reality headset and the display is fixed. The virtual or augmented reality headset of claim 1, wherein at least one of the groups of lenses is laterally slantable in a direction substantially parallel to an inter-boring axis between the eyes of the user Move to adjust the spacing between the lens groups based on the pupil spacing of the user. The virtual or augmented reality headset according to claim 1, wherein the first adjustable lens of each lens group comprises a first cubic surface type adjustable lens, the first cubic surface type adjustable lens Included are two superimposed lens elements having mutually cooperating cuboid or higher order surfaces that slide relative to one another along an x-axis of the first tunable lens, the x-axis being perpendicular to the optical axis, And the two superimposing lens elements are shaped to provide a variable spherical power according to the relative positions of the two superimposed lens elements along the x-axis to change the focusing ability of the first tunable lens. The virtual or augmented reality headset of claim 11, wherein the x-axis of the first tunable lens is suitably about 45- relative to an inter-boring axis extending between the groups of lenses. An acute angle orientation of 80°. A virtual or augmented reality headset as claimed in claim 11 wherein each lens group includes a respective first slide control actuator associated with the first tunable lens to control the lenses The relative arrangement of the elements along the x-axis of the first tunable lens to adjust the spherical power of the first tunable lens. The virtual or augmented reality headset of claim 11, wherein each lens element of the first tunable lens has a first cuboid or higher order surface of the type described above and is a standard rotating surface A second opposing surface, the second opposing surface is preferably planar. The virtual or augmented reality headset of claim 1, wherein the first tunable lens of each lens group comprises a variable focus capability liquid lens comprising an optical An expandable film of the surface, wherein the focusing power of the liquid lens is related to the curvature of the film. The virtual or augmented reality headset of claim 11, wherein the refractive power of the first tunable lens is variable up to about ±15D. The virtual or augmented reality headset of claim 1, wherein the second tunable lens of each lens group comprises a second cubic surface lens, the second cubic surface lens being mounted to Rotating within the virtual or augmented reality headset about the optical axis, the lens elements of the second lens being slidable relative to one another in a direction parallel to a y-axis of the second tunable lens, The y-axis of the second tunable lens is perpendicular to the optical axis, and the lens elements are shaped to provide a variable columnar degree to correct astigmatism based on the relative positions of the lens elements along the y-axis. The virtual or augmented reality headset of claim 17, wherein the cubic surfaces of the lens elements of the second tunable lens are plastically formed when the equal surface is adjustable along the second Providing a variable spherical power when an x-axis of the lens is displaced relative to each other, the x-axis and the y-axis of the second tunable lens forming a z-axis having a parallel to the optical axis of the tunable lens Three-dimensional Cartesian coordinate system. The virtual or augmented reality headset of claim 17, wherein each lens group comprises a corresponding one of the cubic surface type second tunable lens or each of the cubic surface type second tunable lenses A second sliding control actuator controls the relative arrangement of the lens elements along the y-axis of the second tunable lens to adjust the columnar refractive power of the second tunable lens. The virtual or augmented reality headset of claim 19, wherein each lens group further comprises a rotation control actuator associated with the second tunable lens to adjust the second tunable lens The axis. A virtual or augmented reality headset as claimed in claim 20, wherein each lens group includes a respective other slide control actuator associated with the second tunable lens to control the lenses The relative arrangement of the elements along the x-axis of the second tunable lens to adjust the spherical power of the second tunable lens. The virtual or augmented reality headset of claim 17, wherein each lens element of the second tunable lens has a first cuboid or higher order surface of the type described above and is a standard rotating surface a second opposing surface, the second opposing surface preferably being planar A virtual or augmented reality headset as claimed in claim 1, wherein each of the lens groups is mounted in the virtual or augmented reality headset to be parallel to the two One of the inter-pupil shafts extending between the lens groups translates upwardly. A virtual or augmented reality headset as claimed in claim 22, comprising a corresponding pupil distance control actuator associated with each of the lens groups to adjust the lens groups The distance between the two. The virtual or augmented reality headset of claim 1, wherein the virtual or augmented reality headset further comprises at least one eye tracking device. A software or firmware for controlling a virtual or augmented reality headset as claimed in any of the preceding claims, the software or firmware comprising machine code, when by a processor comprising a processor and a memory When the computer executes the machine code, the machine code controls the computer to receive a user's ophthalmic prescription data in the memory and output a control signal to adjust the first adjustable lens and the second adjustable according to the user's prescription. Adjust the lens. A software or firmware for controlling a virtual or augmented reality headset as claimed in claim 13, the software or firmware comprising machine code, when executed by a computer including a processor and a memory In the machine code, the machine code controls the computer to receive a user's ophthalmic prescription data in the memory, the ophthalmic prescription data encoding at least the user's spherical power component for the distance, and transmitting the control signal to the The first slide controls the actuator to adjust the relative position of the lens elements of each of the first tunable lenses in accordance with the prescription of the user to adjust the focusing ability of the first tunable lens. A software or firmware for controlling a virtual or augmented reality headset as claimed in claim 20, wherein the software or firmware is executed when a software or firmware is executed by a computer including a processor and a memory Or the firmware controlling the computer to receive a user's ophthalmic prescription data in the memory, the ophthalmic prescription data encoding at least the user's columnar power component and the astigmatic axis component, and transmitting the control signal to the adjustment for each The second sliding control actuators of the relative positions of the lens elements of the second adjustable lens and the rotation controls for respectively adjusting the angles of each of the second adjustable lenses in the headset An actuator to adjust a columnar refractive power and an astigmatic axis of the second adjustable lens according to the user prescription. The software or firmware as claimed in claim 27 or claim 28, wherein when the software or firmware is executed by the computer, the software or firmware obtains the user's prescription data from a storage device. The soft body or firmware described in claim 27 or claim 28, when the software or firmware is executed by the computer, the software or firmware prompts a user to input their prescription data. The software or firmware of claim 27, wherein the adjustment of the first tunable lens according to the user's spherical prescription includes an additional offset to account for the position of the user's eyes when the headset is worn. The software or firmware of claim 31, wherein the size of the spherical offset is received together with the prescription data in the memory, or the magnitude of the spherical offset is obtained from a calibration procedure.