CN117678965B - Vision detection method, head mounted display device and computer readable medium - Google Patents

Abstract

The embodiments of the present disclosure disclose a vision detection method, a head-mounted display device, and a computer-readable medium. A specific implementation of the method includes: in response to the head-mounted display device corresponding to the target diopter, performing a vision test operation; according to the first vision test result, providing a diopter adjustment prompt; in response to the completion of the diopter adjustment, performing an eye dynamic training operation; in response to the completion of the execution, providing a diopter adjustment prompt according to the target diopter; in response to the head-mounted display device corresponding to the target diopter, performing a vision test operation; displaying the first vision test result, the second vision test result, and the dynamic training accuracy. This implementation alleviates the loss of vision caused by blurred viewing during vision training, and the user's actual training effect can be known through vision training; in addition, when the eye dynamic training operation includes interactive dynamic training and playing videos that relieve visual fatigue, it can promote eye-brain coordination and improve the overall effect of visual fatigue relief.

Description

Vision detection method, head mounted display device and computer readable medium

Technical Field

Embodiments of the present disclosure relate to the technical field of head-mounted display devices, and in particular to a vision detection method, a head-mounted display device, and a computer-readable medium.

Background technique

Head-mounted display devices (such as AR glasses) can be used to form images in front of the eyes of the wearer to provide a strong visual experience. The optical display system of a head-mounted display device is usually composed of a micro display screen and optical elements. In general, the display system currently used in head-mounted display devices is a combination of various micro display screens and optical elements such as prisms, free-form surfaces, BirdBath, and optical waveguides. With the development and popularization of many head-mounted display devices, eye fatigue and decreased vision have become common phenomena. Compared with smartphones, head-mounted display devices have gradually become the preferred choice due to their strong visual experience. However, wearing head-mounted display devices for a long time still has the problem of eye fatigue and decreased vision, and users wearing head-mounted display devices need to undergo vision training. At present, when training users' vision, the usual method is to play video content used to exercise eye muscles to relieve eye fatigue.

However, when the above method is adopted, the following technical problems often occur: after the user has watched the content displayed in the head-mounted display device for a long time, the user is already in a blurred viewing state. If the user watches the video content again, it will further aggravate eye fatigue, thereby causing further deterioration of vision. Moreover, when the user follows the video content for vision training, it is impossible to know the user's actual training effect.

The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art.

Summary of the invention

The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

Some embodiments of the present disclosure propose a vision detection method based on a head-mounted display device, a head-mounted display device, and a computer-readable medium to solve one or more of the technical problems mentioned in the above background technology section.

In a first aspect, some embodiments of the present disclosure provide a vision detection method based on a head-mounted display device, the method comprising: providing a diopter adjustment prompt based on a target diopter and the diopter of the head-mounted display device; in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, performing a vision test operation corresponding to a target user, and obtaining a vision test result as a first vision test result, wherein the target user is a user wearing the head-mounted display device; based on the first vision test result, providing a diopter adjustment prompt to the target user, so that the target user adjusts the head according to the first vision test result. The refractive index of the wearable display device is as follows: in response to determining that the refractive index adjustment corresponding to the first vision test result is completed, executing the eye dynamic training operation corresponding to the target user to obtain the dynamic training accuracy rate; in response to determining that the eye dynamic training operation is completed, providing a refractive index adjustment prompt according to the target refractive index; in response to determining that the refractive index of the head-mounted display device corresponds to the target refractive index, executing the vision test operation corresponding to the target user to obtain the vision test result as the second vision test result; and displaying the first vision test result, the second vision test result and the dynamic training accuracy rate in the head-mounted display device.

Optionally, the head-mounted display device includes two display screens corresponding to the left eye and right eye of the user; and the above-mentioned execution of the vision test operation corresponding to the target user to obtain the vision test result includes: for each display screen in the head-mounted display device, according to a preset vision test information set, executing the vision test operation corresponding to the target eye of the target user to obtain the monocular vision test result corresponding to the target eye, wherein the vision test information in the vision test information set is used to be displayed in the above-mentioned display screen, and the above-mentioned target eye corresponds to the above-mentioned display screen; the two obtained monocular vision test results are determined as the vision test result.

Optionally, the head-mounted display device includes two display screens corresponding to the left eye and right eye of the user; and the vision test operation corresponding to the target user is performed, including: using the camera of the head-mounted display device to scan and model the current space to obtain a three-dimensional space model; determining the target point in the three-dimensional space model as an anchor point; projecting a pre-set vision test information set at the position of the anchor point in the three-dimensional space model; and generating a vision test result based on the target user's interactive operation information on the vision test information set.

Optionally, the above-mentioned execution of the eye dynamic training operation corresponding to the above-mentioned target user to obtain the dynamic training accuracy includes: determining the first first display object information in a preset first display object information sequence as the target first display object information, wherein the size information of each display object corresponding to the above-mentioned first display object information sequence is arranged in descending order; performing the following first dynamic training step according to the target first display object information: generating a preset number of first display objects according to the target first display object information, wherein each direction information of each generated first display object is random; determining a first current error number and a first total error number according to the direction selection information of the above-mentioned preset number of first display objects displayed by the above-mentioned target user and the above-mentioned each direction information; in response to determining that the above-mentioned first total error number does not meet the preset error number condition, and the target first display object information and the above-mentioned first current error number do not meet the preset end condition, updating the target first display object information according to the above-mentioned first current error number and the above-mentioned preset number, and performing the above-mentioned first dynamic training step again according to the updated target first display object information; generating a dynamic training accuracy according to each direction selection information corresponding to the above-mentioned target user and each direction information of each displayed display object.

Optionally, the above-mentioned execution of the following first dynamic training step also includes: in response to determining that the above-mentioned first total error number satisfies the above-mentioned preset error number condition, determining the first second display object information in the preset second display object information sequence as the target second display object information, wherein the display object size information corresponding to the above-mentioned second display object information sequence is arranged in descending order, and the display object size range corresponding to the above-mentioned second display object information sequence includes the display object size range corresponding to the above-mentioned first display object information sequence; according to the target second display object information, executing the following second dynamic training step: generating a second display object according to the target second display object information, wherein the direction information of the generated second display object is random; determining a second current error number and a second total error number according to the direction selection information of the above-mentioned second display object displayed corresponding to the above-mentioned target user and the direction information of the above-mentioned second display object; in response to determining that the second total error number does not satisfy the preset error number condition and the target second display object information does not satisfy the preset end condition, updating the target second display object information according to the second current error number, and executing the above-mentioned second dynamic training step again according to the updated target second display object information.

Optionally, the performing of the following second dynamic training step further includes: in response to determining that the second total number of errors meets a preset number of errors condition, determining the first third display object information in a preset third display object information sequence as the target third display object information, wherein the third display object information sequence corresponds to a first preset display path, and the display object size range corresponding to the third display object information sequence includes the display object size range corresponding to the first display object information sequence; performing the following third dynamic training step according to the target third display object information: generating a third display object according to the target third display object information, wherein the direction information and size information of the generated third display object are random; determining a third total number of errors according to the direction selection information of the third display object displayed corresponding to the target user and the direction information of the third display object; in response to determining that the third total number of errors does not meet the preset number of errors condition and the target third display object information does not meet the preset end condition, using the next third display object information of the target third display object information in the third display object information sequence as the target third display object information, and performing the above third dynamic training step again according to the updated target third display object information.

Optionally, the performing of the following third dynamic training step further includes: in response to determining that the third total number of errors meets a preset number of errors condition, determining the first fourth display object information in a preset fourth display object information sequence as the target fourth display object information, wherein the fourth display object information sequence corresponds to a second preset display path, the second preset display path is opposite to the path order of the first preset display path, and the display object size range corresponding to the fourth display object information sequence includes the display object size range corresponding to the first display object information sequence; performing the following fourth dynamic training step according to the target fourth display object information: generating a fourth display object according to the target fourth display object information, wherein the direction information and size information of the generated fourth display object are random; determining a fourth total number of errors according to the direction selection information of the fourth display object displayed corresponding to the target user and the direction information of the fourth display object; in response to determining that the fourth total number of errors does not meet the preset number of errors condition and the target fourth display object information does not meet the preset end condition, using the fourth display object information next to the target fourth display object information in the fourth display object information sequence as the target fourth display object information, and performing the above fourth dynamic training step again according to the updated target fourth display object information.

Optionally, the above-mentioned execution of the following fourth dynamic training step also includes: in response to determining that the fourth total error number meets the preset error number condition, executing the following fifth dynamic training step: generating a fifth display object within a preset display object size range, wherein the position information, direction information and size information of the generated fifth display object are random; determining the fifth total error number based on the direction selection information of the fifth display object displayed corresponding to the above-mentioned target user and the direction information of the fifth display object; in response to determining that the fifth total error number does not meet the preset error number condition and the number of generated fifth display objects is less than the preset number, executing the above-mentioned fifth dynamic training step again.

Optionally, the above-mentioned execution of the following fifth dynamic training step also includes: in response to determining that the fifth total number of errors meets a preset error number condition or the fifth dynamic training step is completed, playing video content in the above-mentioned head-mounted display device.

In a second aspect, some embodiments of the present disclosure provide a head-mounted display device, comprising: one or more processors; an optical display system, comprising at least one display screen and an optical element, for forming an image in front of the eyes of a user; a refractive index adjustment mechanism, for adjusting the user's refractive index corresponding to the image formed in each display screen; and a storage device, on which one or more programs are stored, and when the one or more programs are executed by one or more processors, the one or more processors implement the method described in any implementation manner of the above-mentioned first aspect.

In a third aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation manner of the above-mentioned first aspect is implemented.

The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the vision detection method based on the head-mounted display device of some embodiments of the present disclosure, the vision loss caused by blurred viewing during vision training is alleviated, and the real training effect of the user can be known through vision training. Specifically, the reason for further vision loss and the inability to know the real training effect of the user is that after watching the content displayed in the head-mounted display device for a long time, the user is already in a blurred viewing state. If the user watches the video content, it will further increase the eye fatigue, thereby causing further vision loss, and the user cannot know the real training effect of the user when following the video content for vision training. Based on this, the vision detection method based on the head-mounted display device of some embodiments of the present disclosure first performs a diopter adjustment prompt according to the target diopter and the diopter of the head-mounted display device. In this way, the user can be prompted to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, a vision test operation corresponding to the target user is performed, and a vision test result is obtained as the first vision test result. Among them, the target user is a user wearing the head-mounted display device. Thus, after the diopter of the head-mounted display device is adjusted to the target diopter, the vision test result of the user at the target diopter can be detected. Then, according to the first vision test result, the target user is prompted to adjust the diopter so that the target user adjusts the diopter of the head-mounted display device according to the first vision test result. Thus, the user can be prompted to adjust the diopter of the head-mounted display device to the diopter corresponding to the first vision test result. Secondly, in response to determining that the diopter adjustment corresponding to the first vision test result is completed, the eye dynamic training operation corresponding to the target user is performed to obtain the dynamic training accuracy. Thus, after the user adjusts the diopter of the head-mounted display device to the diopter corresponding to the first vision test result, the user can be trained for the eyes dynamically, and the accuracy of the eye dynamic training can be obtained. Then, in response to determining that the eye dynamic training operation is completed, the diopter adjustment prompt is performed according to the target diopter. Thus, the user can be prompted again to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, a vision test operation of the corresponding target user is performed to obtain a vision test result as a second vision test result. Thus, after the diopter of the head-mounted display device is adjusted to the target diopter, the vision test result of the user at the target diopter can be detected again. Finally, the first vision test result, the second vision test result and the dynamic training accuracy are displayed in the head-mounted display device. Thus, the user can know the vision test results before and after the dynamic eye training and the accuracy of the dynamic eye training. Also because during the dynamic eye training, the diopter of the head-mounted display device is adjusted according to the first vision test result of this detection, the user can clearly view the display content in the head-mounted display device after adjusting the diopter according to the first vision test result, and will not further increase eye fatigue, thereby alleviating the vision loss caused by blurred viewing during vision training, and the user's real training effect can be known through the dynamic training accuracy.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

FIG1 is a flow chart of some embodiments of a vision detection method based on a head mounted display device according to the present disclosure;

FIG2 is a schematic diagram of an interface of a display space of a vision detection method based on a head mounted display device according to some embodiments of the present disclosure;

3 is a schematic diagram of a detection result interface of a vision detection method based on a head mounted display device according to some embodiments of the present disclosure;

FIG4 is a flow chart of other embodiments of a vision detection method based on a head mounted display device according to the present disclosure;

5 is a schematic diagram of a first preset display path of a vision detection method based on a head mounted display device according to some embodiments of the present disclosure;

6 is a schematic diagram of a second preset display path of a vision detection method based on a head mounted display device according to some embodiments of the present disclosure;

FIG. 7 is a schematic diagram of the structure of a head-mounted display device suitable for implementing some embodiments of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other.

It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

With regard to the collection, storage, and use of user personal information (such as vision test results and dynamic training accuracy) involved in this disclosure, relevant organizations or individuals must fulfill obligations including conducting personal information security impact assessments, fulfilling the obligation to inform the personal information subject, and obtaining the authorization and consent of the personal information subject in advance before performing the corresponding operations.

The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

FIG1 shows a process 100 of some embodiments of a vision detection method based on a head mounted display device according to the present disclosure. The vision detection method based on a head mounted display device comprises the following steps:

Step 101, providing a diopter adjustment prompt according to the target diopter and the diopter of the head mounted display device.

In some embodiments, the execution subject (e.g., head-mounted display device) of the vision detection method based on the head-mounted display device may provide a diopter adjustment prompt according to the target diopter and the diopter of the head-mounted display device. The target diopter may be the diopter degree to which the head-mounted display device needs to be adjusted when testing naked eye vision. The target diopter may be 0 degrees. The head-mounted display device may be a display device for users to watch imaging content after wearing it. The head-mounted display device may be, but is not limited to, one of the following: AR glasses, MR glasses, and VR glasses. In practice, the execution subject may display vision test operation prompt information in the head-mounted display device in response to determining that the diopter of the head-mounted display device is the target diopter. For example, the vision test operation prompt information may be "The current diopter is 0, please press any key to enter the vision test". The execution subject may also display diopter adjustment prompt information corresponding to the target diopter in the head-mounted display device in response to determining that the current diopter of the head-mounted display device is not the target diopter. The above-mentioned diopter adjustment prompt information can be used to prompt the user to adjust the diopter. The above-mentioned diopter adjustment prompt information may include prompt text and prompt image. For example, the above-mentioned prompt text may be "Please adjust the vision adjustment knob to 0". The prompt image may be a image used to prompt the user how to adjust the diopter. For example, the prompt image may display a diagram of a knob for adjusting the diopter of a head-mounted display device and an adjustment direction description. Optionally, the above-mentioned execution entity may also display vision test operation prompt information in the above-mentioned head-mounted display device. For example, the above-mentioned vision test operation prompt information may be "Please press any key to enter the vision test".

Optionally, before step 101, the execution subject may also perform an eye protection mode description operation in response to determining that the mode of the head-mounted display device is the eye protection mode. In practice, after the user selects the eye protection application logo in the display space of the head-mounted display device, the head-mounted display device may enter the eye protection mode. The execution subject may display a welcome message and/or eye protection mode description information in the display space. Optionally, the execution subject may also play the corresponding audio while displaying the welcome message and/or the eye protection mode description information. Thus, the welcome message and/or the eye protection mode description information may be presented together in the form of UI and voice explanation. For example, the welcome message may be "Hello". The eye protection mode description information may be "The eye protection system helps relieve eye fatigue, let your eyes rest for 8 minutes". Optionally, the execution subject may also display the eye protection mode description information after displaying the welcome message for a preset time. Optionally, the execution subject may also automatically enter the subsequent operation after the audio corresponding to the eye protection mode description information is played, that is, execute step 101.

Step 102, in response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, performing a vision test operation corresponding to the target user, and obtaining a vision test result as a first vision test result.

In some embodiments, the execution subject may, in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, perform a vision test operation corresponding to the target user, and obtain a vision test result as a first vision test result. The target user is a user wearing the head-mounted display device. In practice, the execution subject may, in response to determining that the diopter of the head-mounted display device is the target diopter, determine that the diopter of the head-mounted display device corresponds to the target diopter. The execution subject may also, in response to detecting a key operation after displaying the vision test operation prompt information and/or the diopter adjustment prompt information, determine that the diopter of the head-mounted display device corresponds to the target diopter. The key operation may be a key operation acting on a communication-connected device. Here, the device may be a smart device, and a key may be configured on the smart device. It is understandable that the interactive operation mode between the user and the head-mounted display device may include but is not limited to at least one of the following modes: voice interaction, gesture interaction, head-controlled interaction, touch interaction, and key interaction.

In practice, the execution subject may, in response to determining that the diopter of the head mounted display device corresponds to the target diopter, execute a vision test task corresponding to the target user, and obtain a vision test result as the first vision test result. The vision test task may be a pre-set task for testing the user's vision. For example, the vision test task may be a vision test task based on a vision chart, and the user's vision may be determined based on the user's direction selection information for each indication element in the vision chart.

Optionally, the head-mounted display device includes two display screens corresponding to the left eye and right eye of the user.

In some optional implementations of some embodiments, the execution subject may perform a vision test operation corresponding to the target user through the following steps to obtain a vision test result:

The first step is to perform a vision test operation corresponding to the target eye of the target user according to a preset vision test information set for each display screen in the head-mounted display device, and obtain a monocular vision test result corresponding to the target eye. The vision test information set may be a vision chart for display in the head-mounted display device. Each vision test information may be a vision test element in the vision chart. For example, the vision test element may be "E". The vision test information in the vision test information set is used to be displayed in the display screen. The target eye corresponds to the display screen. Thus, the vision test information can be displayed in one display screen to test the vision of a single eye.

The second step is to determine the two obtained monocular vision test results as the vision test results, thereby obtaining the user's binocular vision test results.

In some optional implementations of some embodiments, the execution subject may perform the vision test operation corresponding to the target user through the following steps:

The first step is to use the camera of the head mounted display device to scan and model the current space to obtain a three-dimensional space model. In practice, the execution subject can use SLAM technology to build a three-dimensional space model.

In the second step, the target point in the three-dimensional space model is determined as an anchor point. The target point may correspond to a point on the wall in the current space. For example, the point on the wall may be a point for locating the upper left corner of the eye chart, which is in the upper left corner of the wall, so that the eye chart can be completely placed on the wall according to the point without exceeding the boundary of the wall. Here, there is no specific limitation on the specific setting of the anchor point. It is understandable that the target point may also be a placement position selected by the target user himself or selected according to the recommended plane. For example, the user may select a target point at any position in the three-dimensional space model, so that the information to be placed there (such as an eye chart) may be displayed with the real world as the background. For another example, the execution subject may display at least one recommended plane in the three-dimensional space model for the user to select a target point in the plane. Specifically, when the user selects a target point in the plane, he may follow the displayed guidance information to walk near the plane, and after clicking to confirm the placement, the information to be placed may be displayed in the three-dimensional space model.

The third step is to project the preset vision test information set at the position of the above anchor point in the above three-dimensional space model. The preset vision test information set can be a vision chart for display in a head mounted display device.

The fourth step is to generate a vision test result based on the target user's interactive operation information for the above vision test information set. The interactive operation information may include the direction information selected by the user for the displayed vision test information. In practice, the above execution entity can generate a vision test result based on the various direction information selected by the user and the correct direction information of the corresponding vision test information. In this way, the user's vision can be tested directly in the three-dimensional space environment of the head-mounted display device, without the need to place physical objects for testing, which simplifies the vision test operation.

Step 103: Prompt the target user to adjust the diopter according to the first vision test result, so that the target user adjusts the diopter of the head mounted display device according to the first vision test result.

In some embodiments, the execution entity may provide a diopter adjustment prompt to the target user based on the first vision test result, so that the target user adjusts the diopter of the head-mounted display device according to the first vision test result. In practice, the execution entity may display the diopter adjustment prompt information corresponding to the first vision test result in the head-mounted display device to prompt the target user to adjust the diopter of the head-mounted display device according to the first vision test result. The diopter adjustment prompt information corresponding to the first vision test result may include the first vision test result. For example, the diopter adjustment prompt information corresponding to the first vision test result may be "Please adjust the left eye vision adjustment knob to 425° and the right eye vision adjustment knob to 400°".

In some optional implementations of some embodiments, the execution subject may provide a diopter adjustment prompt to the target user according to the first vision test result:

The first step is to display the monocular vision test result of the left eye included in the first vision test result on the left side of the display space of the head-mounted display device.

In the second step, the monocular vision test result corresponding to the right eye included in the first vision test result is displayed on the right side of the display space of the head-mounted display device.

The third step is, in response to detecting the diopter adjustment operation of the target user, displaying the real-time diopter corresponding to the diopter adjustment operation in the display space. The real-time diopter is displayed on the side of the eye corresponding to the diopter adjustment operation in the display space. In practice, the execution subject may display the real-time diopter of the display screen corresponding to the left eye on the left side of the display control in response to detecting the diopter adjustment operation of the target user on the display screen corresponding to the left eye. The execution subject may display the real-time diopter of the display screen corresponding to the left eye on the right side of the display control in response to detecting the diopter adjustment operation of the target user on the display screen corresponding to the right eye. Thus, the user can view the currently adjusted diopter and the required adjusted diopter through the monocular vision test results and real-time diopter displayed on each side.

Optionally, the execution subject may also display a preset vision test chart and reference adjustment prompt information corresponding to the preset vision test chart in the display space. The preset vision test chart may be a partial vision test chart intercepted from a complete vision chart for users to refer to whether they can see clearly. For example, the preset vision test chart may be the second to fourth to last lines in the complete vision chart. The reference adjustment prompt information may be information used to prompt the user to use the preset vision test chart as a reference when adjusting the diopter. For example, the reference adjustment prompt information may be "adjust the knob so that both the left and right eyes can clearly see E". Optionally, the execution subject may also display eye dynamic training operation prompt information in the display space, which may be used to prompt the user how to operate to enter the eye dynamic training operation. For example, the eye dynamic training operation prompt information may be "after the diopter adjustment is completed, press the confirmation key to enter the eye dynamic training". As an example, the interface display content of the display space may refer to Figure 2. FIG2 shows the monocular vision test result 201 corresponding to the left eye, the monocular vision test result 202 corresponding to the right eye, the real-time refractive power 203 corresponding to the left eye, the real-time refractive power 204 corresponding to the right eye, a preset vision test chart 205, reference adjustment prompt information 206, eye dynamic training operation prompt information 207 and a refractive power adjustment prompt diagram 208.

Therefore, by displaying a preset vision test chart and reference adjustment prompt information, the user can adjust the refractive power of the head-mounted display device according to the first vision test result and the clarity of the vision test elements in the preset vision test chart, thereby ensuring that the display content in the head-mounted display device can be clearly viewed before entering the dynamic eye training operation.

Optionally, before step 104, the execution subject may also determine that the diopter adjustment corresponding to the first vision test result is completed in response to detecting a selection operation of a target button on the smart terminal. The target button may be any button or a confirmation button. It is understandable that the execution subject may also determine that the diopter adjustment corresponding to the first vision test result is completed through other interaction methods. Other interaction methods may include but are not limited to at least one of the following: voice interaction, gesture interaction, head control interaction, and touch interaction. Thus, user interaction operations may be coordinated through a communication-connected smart terminal.

Step 104, in response to determining that the diopter adjustment corresponding to the first vision test result is completed, performing an eye dynamic training operation corresponding to the target user to obtain a dynamic training accuracy rate.

In some embodiments, the execution subject may, in response to determining that the diopter adjustment corresponding to the first vision test result is completed, execute the eye dynamic training operation corresponding to the target user to obtain the dynamic training accuracy. In practice, the execution subject may, in response to detecting that the diopter adjustment of the head-mounted display device is adjusted to the first vision test result, determine that the diopter adjustment corresponding to the first vision test result is completed. The execution subject may also, in response to detecting a confirmation operation after prompting the target user to adjust the diopter according to the first vision test result, determine that the diopter adjustment corresponding to the first vision test result is completed. The confirmation operation may be a key operation acting on a confirmation button. For example, the confirmation operation may be a key operation acting on a confirmation button on a communication-connected smart device.

In practice, the above-mentioned execution subject may sequentially display each vision training information in a preset vision training information sequence in the head-mounted display device, and receive feedback information from the above-mentioned target user for each vision training information. Among them, the above-mentioned vision training information may be images of different styles. Here, the style may include but is not limited to at least one of the following: size, orientation, and position. The feedback information may be the orientation of the vision training information selected by the user. Then, the above-mentioned execution subject may determine the correctness of the vision training information selected by the user as the dynamic training accuracy. Optionally, the above-mentioned execution subject may also display video content in the above-mentioned head-mounted display device. The above-mentioned video content may be a video for relieving visual fatigue. For example, the above-mentioned eye training video may be a 3D video. It can be understood that the eye dynamic training operation may be an interactive eye dynamic training, or may include an interactive eye dynamic training and a video viewing eye dynamic training.

Step 105, in response to determining that the eye dynamic training operation is completed, providing a diopter adjustment prompt according to the target diopter.

In some embodiments, the execution subject may, in response to determining that the eye dynamic training operation is completed, provide a diopter adjustment prompt according to the target diopter. In practice, the specific implementation of providing a diopter adjustment prompt according to the target diopter may refer to step 101 and will not be described in detail here.

Step 106, in response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, performing a vision test operation corresponding to the target user, and obtaining a vision test result as a second vision test result.

In some embodiments, the execution subject may, in response to determining that the diopter of the head mounted display device corresponds to the target diopter, perform a vision test operation corresponding to the target user, and obtain a vision test result as the second vision test result. Here, the specific implementation method of performing the vision test operation corresponding to the target user can refer to step 102, which will not be repeated here.

Step 107: display the first vision test result, the second vision test result, and the dynamic training accuracy rate on the head mounted display device.

In some embodiments, the above-mentioned execution subject may display the above-mentioned first vision test result, the above-mentioned second vision test result and the above-mentioned dynamic training accuracy rate in the above-mentioned head-mounted display device. In practice, the above-mentioned execution subject may display the above-mentioned first vision test result, the above-mentioned second vision test result and the above-mentioned dynamic training accuracy rate in the display space of the above-mentioned head-mounted display device in sequence. Optionally, the above-mentioned execution subject may also display a prompt message of returning to the home page in the above-mentioned display space. For example, the above-mentioned prompt message of returning to the home page may be "Press any key to return to the home page". It should be noted that the operation method of returning to the home page may include but is not limited to at least one of the following: voice interaction, gesture interaction, head control interaction, touch interaction, and button interaction. As an example, the detection result interface of the display space displaying the first vision test result 301, the second vision test result 302 and the dynamic training accuracy rate 303 can refer to Figure 3.

The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the vision detection method based on the head-mounted display device of some embodiments of the present disclosure, the vision loss caused by blurred viewing during vision training is alleviated, and the real training effect of the user can be known through vision training. Specifically, the reason for further vision loss and the inability to know the real training effect of the user is that after watching the content displayed in the head-mounted display device for a long time, the user is already in a blurred viewing state. If the user watches the video content, it will further increase the eye fatigue, thereby causing further vision loss, and the user cannot know the real training effect of the user when following the video content for vision training. Based on this, the vision detection method based on the head-mounted display device of some embodiments of the present disclosure first performs a diopter adjustment prompt according to the target diopter and the diopter of the head-mounted display device. In this way, the user can be prompted to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, a vision test operation corresponding to the target user is performed, and a vision test result is obtained as the first vision test result. Among them, the target user is a user wearing the head-mounted display device. Thus, after the diopter of the head-mounted display device is adjusted to the target diopter, the vision test result of the user at the target diopter can be detected. Then, according to the first vision test result, the target user is prompted to adjust the diopter so that the target user adjusts the diopter of the head-mounted display device according to the first vision test result. Thus, the user can be prompted to adjust the diopter of the head-mounted display device to the diopter corresponding to the first vision test result. Secondly, in response to determining that the diopter adjustment corresponding to the first vision test result is completed, the eye dynamic training operation corresponding to the target user is performed to obtain the dynamic training accuracy. Thus, after the user adjusts the diopter of the head-mounted display device to the diopter corresponding to the first vision test result, the user can be trained for the eyes dynamically, and the accuracy of the eye dynamic training can be obtained. Then, in response to determining that the eye dynamic training operation is completed, the diopter adjustment prompt is performed according to the target diopter. Thus, the user can be prompted again to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, a vision test operation of the corresponding target user is performed to obtain a vision test result as a second vision test result. Thus, after the diopter of the head-mounted display device is adjusted to the target diopter, the vision test result of the user at the target diopter can be detected again. Finally, the first vision test result, the second vision test result and the dynamic training accuracy are displayed in the head-mounted display device. Thus, the user can know the vision test results before and after the dynamic eye training and the accuracy of the dynamic eye training. Also because during the dynamic eye training, the diopter of the head-mounted display device is adjusted according to the first vision test result of this detection, the user can clearly view the display content in the head-mounted display device after adjusting the diopter according to the first vision test result, and will not further increase eye fatigue, thereby alleviating the vision loss caused by blurred viewing during vision training, and the user's real training effect can be known through the dynamic training accuracy.

Further referring to FIG4 , it shows a process 400 of another embodiment of a vision detection method based on a head mounted display device. The process 400 of the vision detection method based on a head mounted display device comprises the following steps:

Step 401, providing a diopter adjustment prompt according to the target diopter and the diopter of the head mounted display device.

Step 402, in response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, performing a vision test operation corresponding to the target user, and obtaining a vision test result as a first vision test result.

Step 403: Prompt the target user to adjust the diopter according to the first vision test result, so that the target user adjusts the diopter of the head mounted display device according to the first vision test result.

In some embodiments, the specific implementation methods of steps 401-403 and the technical effects brought about can refer to steps 101-103 in the embodiments corresponding to FIG. 1, and will not be repeated here.

Step 404 , in response to determining that the diopter adjustment corresponding to the first vision test result is completed, determining the first first display object information in the preset first display object information sequence as the target first display object information.

In some embodiments, the execution subject of the vision detection method based on the head-mounted display device (for example, the head-mounted display device) can determine the first first display object information in the pre-set first display object information sequence as the target first display object information in response to determining that the diopter adjustment corresponding to the above-mentioned first vision test result is completed. Among them, the above-mentioned first display object information sequence can be various attribute information used to generate the display object. The first display object information may include but is not limited to: display object size information. The display object size information can characterize the size of the display object. The display object size information can be directly expressed in size or in a corresponding vision value. For example, the vision value can be a vision value in decimal form or a value in a 5-point system. The display object can be an object for the user to identify the direction. For example, the display object can be an "E" with a random direction. The display object size information corresponding to the above-mentioned first display object information sequence is arranged in descending order. For example, the first display object information sequence can include 5 first display object information.

Step 405: Execute the following first dynamic training step according to the target first display object information:

Step 4051: Generate a preset number of first display objects according to target first display object information.

In some embodiments, the execution subject may generate a preset number of first display objects according to the target first display object information. The direction information of each generated first display object is random. The direction information may be the orientation of the display object. For example, the direction information may be, but is not limited to, one of the following: left, right, up, down. In practice, the execution subject may generate a preset number of first display objects with random directions according to the display object size information corresponding to the target first display object information.

Step 4052: Determine a first current error number and a first total error number according to the direction selection information and each direction information corresponding to the preset number of first display objects displayed by the target user.

In some embodiments, the execution entity may determine the first current error number and the first total error number based on the direction selection information of the preset number of first display objects displayed by the target user and the above-mentioned respective direction information. The direction selection information may be the orientation of the displayed display object fed back by the target user after the interactive operation. Only one display object may be displayed at a time. In practice, for each of the preset number of first display objects, the execution entity may determine that the direction selection information corresponding to the first display object is different from the direction information corresponding to the first display object, and increment the first current error number by 1 and the first total error number by 1. The initial value of the first current error number may be 0, and the information of each target first display object is cleared to zero. The initial value of the first total error number may be 0, and it is incremented without being cleared to zero.

Optionally, before step 4052, the execution subject may further perform the following steps:

For each of the preset number of first display objects, the following steps are performed:

The first step is to display the first display object in a first preset display mode at a middle position of the display space of the head mounted display device. The middle position may be a visual center position. The first preset display mode may be a display mode that appears directly. In practice, the execution subject may display the first display object in a first preset display mode at a middle position of a pre-constructed three-dimensional space model.

The second step is to receive direction selection information fed back by the target user with respect to the first display object.

Optionally, the head-mounted display device includes a head-mounted display device body and a smart terminal. The head-mounted display device body can be a head-mounted device. The smart terminal can be but is not limited to at least one of the following: a mobile phone, a tablet, a touch panel, and a mobile host. The connection method between the head-mounted display device body and the smart terminal can be a wired connection method or a wireless connection method. It should be noted that the above wireless connection method can include but is not limited to 3G/4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods currently known or to be developed in the future.

In some optional implementations of some embodiments, the execution subject may receive the direction selection information fed back by the target user for the first display object through the following steps: in response to detecting a selection operation acting on a direction button on the smart terminal, determining the direction identifier corresponding to the selected direction button as the direction selection information corresponding to the first display object. The direction button may be a button with a direction indication. The direction buttons may include but are not limited to: a left button, a right button, an up button, and a down button. The smart terminal is communicatively connected to the head-mounted display device body. It is understandable that the user's operation of selecting a direction may also be through but is not limited to the following interaction methods: voice interaction, gesture interaction, head control interaction, and touch interaction.

Step 4053, in response to determining that the first total error number does not meet the preset error number condition, and the target first display object information and the first current error number do not meet the preset end condition, update the target first display object information according to the first current error number and the preset number, and execute the first dynamic training step again according to the updated target first display object information.

In some embodiments, the execution subject may update the target first display object information according to the first current error number and the preset number in response to determining that the first total error number does not meet the preset error number condition, and the target first display object information and the first current error number do not meet the preset end condition, and perform the first dynamic training step again according to the updated target first display object information. The preset error number condition may be greater than or equal to a preset value. For example, the preset value may be 5. The preset end condition may be that the target first display object information is not the last one in the first display object information sequence, and the first current error number is not 0. In practice, the execution subject may update the target first display object information according to the first current error number and the preset number by following the steps below:

In the first step, in response to determining that the first current number of errors is equal to the preset number, and it is not the first time to perform the first dynamic training step, the adjacent first display object information before the target first display object information in the first display object information sequence is determined as the updated target first display object information. Thus, when the user selects the wrong directions of the preset number of first display objects, a slightly larger first display object can be displayed next time.

In the second step, in response to determining that the first current number of errors is equal to the preset number and the first dynamic training step is performed for the first time, the target first display object information is retained unchanged. Thus, when the user selects the wrong direction of the preset number of first display objects for the first time, the first display object with the same size can be displayed next time, so that the user can adapt to the dynamic training.

In the third step, in response to determining that the first current number of errors is equal to a preset minimum value, the next first display object information of the target first display object information in the first display object information sequence is determined as the updated target first display object information. The preset minimum value may be 0. Thus, when the user selects the direction of a certain number of first display objects correctly, a slightly smaller first display object may be displayed next time.

Step 4: In response to determining that the first current error number is greater than the preset minimum value and less than the preset number, the target first display object information is retained unchanged. Optionally, the execution subject may also retain the target first display object information unchanged in response to determining that the first current error number is greater than or equal to half of the preset number. Thus, when there is a situation where the orientation is selected correctly or incorrectly, the first display object with the same size can be displayed next time, so that the displayed first display object can adapt to the user's visual ability.

Optionally, the first dynamic training step may further include the following steps:

The first step, in response to determining that the above-mentioned first total number of errors meets the above-mentioned preset number of errors condition, determines the first second display object information in the preset second display object information sequence as the target second display object information. Wherein, the above-mentioned second display object information sequence can be various attribute information used to generate the display object. The second display object information may include but is not limited to: display object size information. For example, the above-mentioned second display object information sequence may include 10 second display object information. The various display object size information corresponding to the above-mentioned second display object information sequence are arranged in descending order. The display object size range corresponding to the above-mentioned second display object information sequence includes the display object size range corresponding to the above-mentioned first display object information sequence. The display object size range can be the visual acuity value range corresponding to the display object. For example, the visual acuity value range corresponding to the above-mentioned first display object information sequence can be [0.1, 0.4]. The visual acuity value range corresponding to the above-mentioned second display object information sequence can be [0.1, 1.2].

The second step is to perform the following second dynamic training steps according to the target second display object information:

The first sub-step is to generate a second display object according to the target second display object information, wherein the direction information of the generated second display object is random. In practice, the execution subject may generate a second display object with a random direction according to the display object size information corresponding to the target second display object information.

The second sub-step is to determine the second current error number and the second total error number according to the direction selection information of the second display object displayed corresponding to the target user and the direction information of the second display object. In practice, the execution subject may determine the second current error number to be 1 and increment the second total error number by 1 in response to determining that the direction selection information of the second display object and the direction information of the second display object are different. The execution subject may determine the second current error number to be 0 in response to determining that the direction selection information of the second display object and the direction information of the second display object are the same. The initial value of the second total error number may be 0, which is incremented and not cleared.

Optionally, before the second sub-step, the execution subject may also display the second display object in a second preset display mode at a middle position of the display space of the head mounted display device. The middle position may be a visual center position. The second preset display mode may be a display mode that gradually appears from blur to clarity. In practice, the execution subject may display the second display object in a second preset display mode at a middle position of a pre-constructed three-dimensional space model. Then, the direction selection information fed back by the target user for the second display object may be received.

In the third sub-step, in response to determining that the second total number of errors does not meet the preset error number condition, and the target second display object information does not meet the preset end condition, the target second display object information is updated according to the second current error number, and the second dynamic training step is performed again according to the updated target second display object information. The preset end condition may be that the target second display object information is not the last one in the second display object information sequence. In practice, the execution subject may update the target second display object information according to the second current error number through the following steps:

First, in response to determining that the second current number of errors is 1 and it is not the first time that the second dynamic training step is performed, the adjacent second display object information before the target second display object information in the second display object information sequence is determined as the updated target second display object information. Thus, when the user selects the wrong direction of the second display object, a slightly larger second display object can be displayed next time.

Second, in response to determining that the second current number of errors is 1 and the second dynamic training step is performed for the first time, the target second display object information is retained unchanged. Thus, when the user selects the wrong direction of the second display object for the first time, the second display object with the same size can be displayed next time, so that the user can adapt to the dynamic training.

Third, in response to determining that the second current error number is equal to 0, the next second display object information of the target second display object information in the second display object information sequence is determined as the updated target second display object information. Thus, when the user selects the direction of the second display object correctly, a slightly smaller second display object can be displayed next time.

Optionally, the second dynamic training step may further include the following steps:

The first step is to determine, in response to determining that the second total number of errors meets the preset number of errors condition, the first third display object information in the preset third display object information sequence is determined as the target third display object information. Among them, the third display object information sequence can be used to generate various attribute information of the display object. The third display object information may include but is not limited to: display position information. The display position information can characterize the position of the display object in the display space. The third display object information sequence corresponds to the first preset display path. It can be understood that each third display object information in the third display object information sequence is arranged in the path order of the first preset display path. For example, the third display object information sequence may include 13 third display object information arranged in the path order. The first preset display path corresponding to the third display object information sequence can refer to Figure 5. The display object size range corresponding to the third display object information sequence includes the display object size range corresponding to the first display object information sequence. For example, the visual acuity value range corresponding to the third display object information sequence can be [0.1, 0.8].

The second step is to perform the following third dynamic training steps according to the target third display object information:

The first sub-step is to generate a third display object according to the target third display object information. The direction information and size information of the generated third display object are random. In practice, the execution subject may generate a third display object with random direction and size according to the display position information corresponding to the target third display object information. The display position of the third display object corresponds to the display position information.

The second sub-step is to determine the third total error number according to the direction selection information of the third display object displayed corresponding to the target user and the direction information of the third display object. In practice, the execution subject may increase the third total error number by 1 in response to determining that the direction selection information of the third display object and the direction information of the third display object are different. The initial value of the third total error number may be 0, and it is incremented without being cleared.

Optionally, before the second sub-step, the execution subject may also display the third display object in the display space of the head mounted display device in a first preset display mode. In practice, the execution subject may display the third display object in a pre-constructed three-dimensional space model in a first preset display mode. Then, the direction selection information fed back by the target user for the third display object may be received.

The third sub-step is, in response to determining that the third total number of errors does not meet the preset number of errors condition, and the target third display object information does not meet the preset end condition, taking the next third display object information of the target third display object information in the third display object information sequence as the target third display object information, and performing the third dynamic training step again according to the updated target third display object information. The preset end condition may be that the target third display object information is not the last one in the third display object information sequence. Thus, each display object can be displayed in sequence for the user to select a direction in a mode where the correctness of the current direction selection does not affect the position of the display object that appears next time.

Optionally, the third dynamic training step may further include the following steps:

In the first step, in response to determining that the third total number of errors meets the preset number of errors condition, the first fourth display object information in the preset fourth display object information sequence is determined as the target fourth display object information. The fourth display object information sequence may be various attribute information used to generate the display object. The fourth display object information may include, but is not limited to: display position information. The fourth display object information sequence corresponds to the second preset display path, and the path sequence of the second preset display path is opposite to that of the first preset display path. It can be understood that each fourth display object information in the fourth display object information sequence is arranged in the path sequence of the second preset display path opposite to the first preset display path. For example, the fourth display object information sequence may include 13 fourth display object information arranged in the path sequence of the second preset display path. The second preset display path corresponding to the fourth display object information sequence can refer to FIG. 6. The display object size range corresponding to the fourth display object information sequence includes the display object size range corresponding to the first display object information sequence. For example, the visual acuity value range corresponding to the fourth display object information sequence may be [0.1, 0.8].

The second step is to perform the following fourth dynamic training steps according to the target fourth display object information:

The first sub-step is to generate a fourth display object according to the target fourth display object information. The direction information and size information of the generated fourth display object are random. In practice, the execution subject may generate a fourth display object with random direction and size according to the display position information corresponding to the target fourth display object information. The display position of the fourth display object corresponds to the display position information.

The second sub-step is to determine the fourth total number of errors according to the direction selection information of the fourth display object displayed corresponding to the target user and the direction information of the fourth display object. In practice, the execution subject may increase the fourth total number of errors by 1 in response to determining that the direction selection information of the fourth display object and the direction information of the fourth display object are different. The initial value of the fourth total number of errors may be 0, which is incremented and not cleared.

Optionally, before the second sub-step, the execution subject may further display the fourth display object in the display space of the head mounted display device in a second preset display mode. In practice, the execution subject may display the fourth display object in the pre-constructed three-dimensional space model in the second preset display mode. Then, the direction selection information fed back by the target user for the fourth display object may be received.

The third sub-step is, in response to determining that the fourth total number of errors does not meet the preset error number condition, and the target fourth display object information does not meet the preset end condition, taking the fourth display object information next to the target fourth display object information in the fourth display object information sequence as the target fourth display object information, and executing the fourth dynamic training step again according to the updated target fourth display object information. The preset end condition may be that the target fourth display object information is not the last one in the fourth display object information sequence. Thus, the user can be trained for eye dynamics again in the reverse order.

Optionally, the fourth dynamic training step may further include the following steps:

In response to determining that the fourth total error number satisfies the preset error number condition, performing the following fifth dynamic training step:

The first step is to generate a fifth display object within a preset display object size range. The preset display object size range can be expressed as a visual acuity value range. For example, the preset display object size range can be [0.1, 0.8]. The position information, direction information and size information of the generated fifth display object are random. In practice, the above execution subject can generate a fifth display object with a random position, direction and size within the preset display object size range.

The second step is to determine the fifth total error number according to the direction selection information of the fifth display object displayed corresponding to the target user and the direction information of the fifth display object. In practice, the execution subject may increase the fifth total error number by 1 in response to determining that the direction selection information of the fifth display object and the direction information of the fifth display object are different. The initial value of the fifth total error number may be 0, which is incremented and not cleared.

Optionally, before the second step, the execution subject may also display the fifth display object in the display space of the head mounted display device in a third preset display mode. The third preset display mode may be a display mode that changes from blur to clarity or directly appears randomly. In practice, the execution subject may display the fifth display object in the pre-constructed three-dimensional space model in the third preset display mode. Then, the direction selection information fed back by the target user for the fifth display object may be received.

It should be noted that there is no limitation on the specific settings of the first preset display mode, the second preset display mode and the third preset display mode.

In the third step, in response to determining that the fifth total number of errors does not meet the preset error number condition, and the number of the generated fifth display objects is less than the preset number, the fifth dynamic training step is performed again. For example, the preset number may be 20. Thus, the user's eye dynamic training may be performed in a random pattern of direction, position, and size.

Optionally, the fifth dynamic training step may further include the following steps:

In response to determining that the fifth total number of errors meets the preset number of errors or the fifth dynamic training step is completed, the video content is played in the head-mounted display device. Among them, the video content can be a video for exercising the user's eye muscles to relieve visual fatigue. The video can be a 3D video. Preferably, the 3D video can have one or more objects moving in a 3D space to guide the movement of the user's ciliary muscles. Thus, after the interactive dynamic training is completed, the relatively relaxed video dynamic training can be continued. Also because the interactive eye dynamic training and the video viewing eye dynamic training involve identifying and tracking targets, they can help improve eye coordination and the ability to quickly adapt to moving targets. Through the two types of eye dynamic training, the range of eye movement can be expanded, and it can be used to reduce excessive tension of eye muscles, thereby improving comfort and improving vision. Therefore, when the eye dynamic training operation in this embodiment includes interactive eye dynamic training and playing a video with visual fatigue relief, it can promote eye-brain coordination and improve the effect of visual fatigue relief as a whole.

Step 406 , generating a dynamic training accuracy rate according to each direction selection information of the corresponding target user and each direction information of each displayed display object.

In some embodiments, the execution subject may generate a dynamic training accuracy rate according to the direction selection information corresponding to the target user and the direction information of the displayed display objects. In practice, the execution subject may determine that the eye dynamic training operation ends in response to determining that the first total number of errors does not meet the preset error number condition, and the target first display object information and the first current number of errors meet the preset end condition, and generate a dynamic training accuracy rate according to the direction selection information corresponding to the target user and the direction information of the displayed display objects. In practice, for each display object, the execution subject may compare the direction selection information and the direction information corresponding to the display object. Then, the number of each display object with the same corresponding direction selection information and direction information may be determined as the correct number. After that, the number of each display object displayed may be determined as the total amount. Finally, the ratio of the correct number to the total amount may be determined as the dynamic training accuracy rate. The dynamic training accuracy rate may be expressed as a percentage.

Optionally, the execution subject may also determine that the eye dynamic training operation ends in response to determining that the second total number of errors does not meet the preset error number condition, and the target second display object information meets the preset end condition. The execution subject may also determine that the eye dynamic training operation ends in response to determining that the third total number of errors does not meet the preset error number condition, and the target third display object information meets the preset end condition. The execution subject may also determine that the eye dynamic training operation ends in response to determining that the fourth total number of errors does not meet the preset error number condition, and the target fourth display object information meets the preset end condition. The execution subject may also determine that the eye dynamic training operation ends in response to determining that the fifth total number of errors does not meet the preset error number condition, and the target fifth display object information meets the preset end condition.

Optionally, the execution entity may also play video content in the head mounted display device in response to determining that the eye dynamic training operation is finished.

Optionally, the execution subject may also determine the number of each direction selection information selected by the target user as a total amount. Compared with the method of determining the number of each displayed display object as a total amount, the method of determining the number of each direction selection information selected by the target user as a total amount can eliminate the influence of the situation where the user does not select a direction when determining the dynamic training accuracy rate, thereby improving the accuracy of the determined dynamic training accuracy rate.

Step 407, in response to determining that the eye dynamic training operation is completed, providing a diopter adjustment prompt according to the target diopter.

Step 408, in response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, performing a vision test operation corresponding to the target user, and obtaining a vision test result as a second vision test result.

Step 409: Display the first vision test result, the second vision test result, and the dynamic training accuracy rate on the head mounted display device.

In some embodiments, the specific implementation methods and technical effects of steps 407-409 can refer to steps 105-107 in the embodiments corresponding to FIG. 1 , and will not be repeated here.

As can be seen from Figure 4, compared with the description of some embodiments corresponding to Figure 1, the process 400 of the vision detection method based on the head-mounted display device in some embodiments corresponding to Figure 4 embodies the steps of expanding the eye dynamic training operation. Therefore, the schemes described in these embodiments can adapt different eye dynamic training modes to the user according to the user's feedback, which can improve the personalized experience of eye dynamic training on the one hand, and enable the user to better exercise the eye muscle activity under the training of different eye dynamic training modes on the other hand, thereby achieving the effect of improving vision.

Referring to Fig. 7, a schematic diagram of a head mounted display device 700 suitable for implementing some embodiments of the present disclosure is shown. The head mounted display device shown in Fig. 7 is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG7 , the head mounted display device 700 may include a processing device 701 (e.g., a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 to a random access memory (RAM) 703. Various programs and data required for the operation of the head mounted display device 700 are also stored in the RAM 703. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input/output (I/O) interface 705 is also connected to the bus 704.

Typically, the following devices may be connected to the I/O interface 705: input devices 706 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; and communication devices 709. The communication device 709 may allow the head-mounted display device 700 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 7 shows a head-mounted display device 700 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively. Each box shown in FIG. 7 may represent one device, or may represent multiple devices as needed.

The head mounted display device may further include an optical display system. The optical display system includes at least one display screen and an optical element for forming an image in front of the user's eyes. The head mounted display device may further include a diopter adjustment mechanism for adjusting the user's diopter corresponding to the image formed on each display screen.

Optionally, the head-mounted display device may include a head-mounted display device body and a smart terminal, and the smart terminal is communicatively connected to the head-mounted display device body.

In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.

It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

The above-mentioned computer-readable medium may be included in the above-mentioned head-mounted display device; or it may exist independently without being assembled into the head-mounted display device. The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the head-mounted display device, the head-mounted display device: performs a diopter adjustment prompt according to the target diopter and the diopter of the head-mounted display device; in response to determining that the diopter of the above-mentioned head-mounted display device corresponds to the above-mentioned target diopter, performs a vision test operation corresponding to the target user, and obtains a vision test result as a first vision test result, wherein the above-mentioned target user is a user wearing the above-mentioned head-mounted display device; according to the above-mentioned first vision test result, performs a diopter adjustment prompt for the above-mentioned target user, so that the above-mentioned target user adjusts the vision according to the above-mentioned first vision test result. The refractive index of the head-mounted display device is adjusted according to the result; in response to determining that the refractive index adjustment corresponding to the first vision test result is completed, executing the eye dynamic training operation corresponding to the target user to obtain the dynamic training accuracy rate; in response to determining that the eye dynamic training operation is completed, providing a refractive index adjustment prompt according to the target refractive index; in response to determining that the refractive index of the head-mounted display device corresponds to the target refractive index, executing the vision test operation corresponding to the target user to obtain the vision test result as the second vision test result; displaying the first vision test result, the second vision test result and the dynamic training accuracy rate on the head-mounted display device.

Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.

Claims (12)

1. A vision testing method based on a head-mounted display device, comprising:

according to the target diopter and the diopter of the head-mounted display device, diopter adjustment prompt is carried out;

In response to determining that the diopter of the head-mounted display device corresponds to the target diopter, executing vision testing operation of a corresponding target user to obtain a vision testing result as a first vision testing result, wherein the target user is a user wearing the head-mounted display device;

according to the first vision test result, carrying out diopter adjustment prompt on the target user, so that the target user adjusts diopter of the head-mounted display device according to the first vision test result;

In response to determining that diopter adjustment corresponding to the first vision test result is completed, performing eye dynamic training operation corresponding to the target user to obtain dynamic training accuracy;

In response to determining that the eye dynamic training operation is completed, performing diopter adjustment prompt according to the target diopter;

in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, executing vision testing operation of a corresponding target user, and obtaining a vision testing result as a second vision testing result;

displaying the first vision test result, the second vision test result, and the dynamic training accuracy in the head-mounted display device.

2. The method of claim 1, wherein the head-mounted display device comprises two display screens corresponding to a left eye and a right eye of a user; and

The executing the vision testing operation of the corresponding target user to obtain the vision testing result comprises the following steps:

For each display screen in the head-mounted display device, performing vision testing operation of a target eye corresponding to the target user according to a preset vision testing information set to obtain a monocular vision testing result corresponding to the target eye, wherein vision testing information in the vision testing information set is used for being displayed in the display screen, and the target eye corresponds to the display screen;

The two obtained monocular vision test results were determined as vision test results.

3. The method of claim 1, wherein the head-mounted display device comprises two display screens corresponding to a left eye and a right eye of a user; and

The performing vision testing operation of the corresponding target user includes:

Scanning and modeling a current space by using a camera of the head-mounted display device to obtain a three-dimensional space model;

determining a target point in the three-dimensional space model as an anchor point;

Putting a preset vision testing information set at the anchor point position in the three-dimensional space model;

And generating a vision testing result according to the interactive operation information of the target user on the vision testing information set.

4. The method of claim 1, wherein the performing the eye dynamic training operation corresponding to the target user results in a dynamic training accuracy, comprising:

Determining first display object information in a preset first display object information sequence as target first display object information, wherein the display object size information corresponding to the first display object information sequence is arranged in a descending order;

according to the target first display object information, the following first dynamic training steps are executed:

Generating a preset number of first display objects according to the target first display object information, wherein the generated first display objects have random direction information;

Determining a first current error number and a first total error number according to the direction selection information and the direction information of the preset number of first display objects correspondingly displayed by the target user;

In response to determining that the first total number of errors does not meet a preset number of errors condition, and the target first display object information and the first current number of errors do not meet a preset end condition, updating the target first display object information according to the first current number of errors and the preset number, and executing the first dynamic training step again according to the updated target first display object information;

And generating the dynamic training accuracy according to the direction selection information corresponding to the target user and the direction information of each displayed object.

5. The method of claim 4, wherein the performing a first dynamic training step further comprises:

In response to determining that the first total error frequency meets the preset error frequency condition, determining first second display object information in a preset second display object information sequence as target second display object information, wherein all display object size information corresponding to the second display object information sequence is arranged in descending order, and a display object size range corresponding to the second display object information sequence comprises a display object size range corresponding to the first display object information sequence;

According to the target second display object information, the following second dynamic training steps are executed:

Generating a second display object according to the target second display object information, wherein the generated second display object has random direction information;

Determining a second current error number and a second total error number according to the direction selection information of the second display object and the direction information of the second display object correspondingly displayed by the target user;

and in response to determining that the second total number of errors does not meet the preset number of errors condition and the target second display object information does not meet the preset end condition, updating the target second display object information according to the second current number of errors, and executing the second dynamic training step again according to the updated target second display object information.

6. The method of claim 5, wherein the performing a second dynamic training step further comprises:

Determining first third display object information in a preset third display object information sequence as target third display object information in response to determining that the second total error frequency meets a preset error frequency condition, wherein the third display object information sequence corresponds to a first preset display path, and a display object size range corresponding to the third display object information sequence comprises a display object size range corresponding to the first display object information sequence;

According to the target third display object information, the following third dynamic training step is executed:

generating a third display object according to the target third display object information, wherein the direction information and the size information of the generated third display object are random;

Determining a third total error number according to the direction selection information of the third display object and the direction information of the third display object correspondingly displayed by the target user;

And in response to determining that the third total number of errors does not meet the preset number of errors condition and the target third display object information does not meet the preset end condition, taking next third display object information of the target third display object information in the third display object information sequence as target third display object information, and executing the third dynamic training step again according to the updated target third display object information.

7. The method of claim 6, wherein the performing a third dynamic training step further comprises:

in response to determining that the third total error frequency meets a preset error frequency condition, determining first fourth display object information in a preset fourth display object information sequence as target fourth display object information, wherein the fourth display object information sequence corresponds to a second preset display path, the second preset display path is opposite to the first preset display path in path sequence, and a display object size range corresponding to the fourth display object information sequence comprises a display object size range corresponding to the first display object information sequence;

According to the target fourth display object information, the following fourth dynamic training step is executed:

Generating a fourth display object according to the target fourth display object information, wherein the direction information and the size information of the generated fourth display object are random;

determining a fourth total error number according to the direction selection information of the fourth display object and the direction information of the fourth display object correspondingly displayed by the target user;

And in response to determining that the fourth total number of errors does not meet the preset number of errors condition and the target fourth display object information does not meet the preset end condition, taking next fourth display object information of the target fourth display object information in the fourth display object information sequence as target fourth display object information, and executing the fourth dynamic training step again according to the updated target fourth display object information.

8. The method of claim 7, wherein the performing the fourth dynamic training step further comprises:

in response to determining that the fourth total number of errors satisfies the preset number of errors condition, performing the following fifth dynamic training step:

generating a fifth display object within a preset display object size range, wherein the generated position information, direction information and size information of the fifth display object are random;

Determining a fifth total error number according to the direction selection information of the fifth display object and the direction information of the fifth display object correspondingly displayed by the target user;

And in response to determining that the fifth total number of errors does not meet the preset number of errors condition and the number of generated fifth display objects is less than the preset number, performing the fifth dynamic training step again.

9. The method of claim 8, wherein the performing the following fifth dynamic training step further comprises:

and playing video content in the head-mounted display device in response to determining that the fifth total number of errors satisfies a preset number of errors condition or that the fifth dynamic training step ends.

10. A head mounted display device comprising:

one or more processors;

An optical display system comprising at least one display screen and optical elements for imaging in front of the eyes of a user;

A diopter adjustment mechanism for adjusting the corresponding user diopter formed in each display screen;

a storage device having one or more programs stored thereon,

When executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-9.

11. The head mounted display device of claim 10, wherein the head mounted display device comprises a head mounted display device body and a smart terminal communicatively connected to the head mounted display device body.

12. A computer readable medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the method of any of claims 1-9.