Method for visual acuity test, head-mounted display device, and computer-readable medium
Through the diopter adjustment and vision test of the head-mounted display device, combined with eye dynamic training, the problem of users' vision loss and training effects after wearing the device is solved, and the effect visibility and fatigue relief of vision training are achieved.
Patent Information
- Application Number
- PCT/CN2025/074784
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-02-04
- Filing Date
- 2025-01-24
- Publication Date
- 2025-08-07
AI Technical Summary
After wearing a head-mounted display device for a long time, users have reduced their vision and cannot know the real training effect. The existing vision training methods have led to worsening eye fatigue.
Diopter adjustment is performed through a head-mounted display device, vision tests and eye dynamic training are performed, diopter adjustments are adjusted according to the test results and training accuracy is displayed.
It relieves vision loss during vision training, provides real training effects, avoids aggravation of eye fatigue, and improves the visibility of training effects.
Smart Images

Figure CN2025074784_07082025_PF_FP_ABST
Abstract
Description
Vision detection method, head-mounted display device, and computer-readable medium
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on February 4, 2024, with application number 202410154217.1, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present disclosure relates to the technical field of head-mounted display devices, and in particular to a vision detection method, a head-mounted display device, and a computer-readable medium. Background Art
[0004] With the development and widespread adoption of numerous head-mounted display devices, eye fatigue and vision loss have become commonplace. Compared to smartphones, head-mounted display devices are increasingly preferred due to their superior visual experience. However, prolonged use of head-mounted display devices can still cause eye fatigue and vision loss, necessitating vision training for users wearing head-mounted display devices. Currently, vision training typically involves playing videos designed to train eye muscles to alleviate eye fatigue.
[0005] However, when the above method is adopted, the following technical problems often occur: after the user watches the content displayed on the head-mounted display device for a long time, the user is already in a blurred viewing state. If the user continues to watch the video content, it will further aggravate eye fatigue, thereby causing further deterioration of vision. Moreover, when the user follows the video content for vision training, it is impossible to know the user's actual training effect.
[0006] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the Invention
[0007] The content of this disclosure is used to briefly introduce concepts that will be described in detail in the detailed description section below. The content of this disclosure is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.
[0008] Some embodiments of the present disclosure propose a vision detection method based on a head-mounted display device, a head-mounted display device, and a computer-readable medium to solve one or more of the technical problems mentioned in the above background technology section.
[0009] In a first aspect, some embodiments of the present disclosure provide a vision detection method based on a head-mounted display device, the method comprising: providing a diopter adjustment prompt based on a target diopter and the diopter of the head-mounted display device; in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, performing a vision test operation corresponding to a target user, and obtaining a vision test result as a first vision test result, wherein the target user is a user wearing the head-mounted display device; providing a diopter adjustment prompt to the target user based on the first vision test result, so that the target user adjusts the head according to the first vision test result. the refractive power of the wearable display device; in response to determining that the refractive power adjustment corresponding to the above-mentioned first vision test result is completed, executing the eye dynamic training operation corresponding to the above-mentioned target user to obtain the dynamic training accuracy; in response to determining that the above-mentioned eye dynamic training operation is completed, providing a refractive power adjustment prompt according to the above-mentioned target refractive power; in response to determining that the refractive power of the above-mentioned head-mounted display device corresponds to the above-mentioned target refractive power, executing the vision test operation corresponding to the target user to obtain the vision test result as the second vision test result; displaying the above-mentioned first vision test result, the above-mentioned second vision test result and the above-mentioned dynamic training accuracy on the above-mentioned head-mounted display device.
[0010] In some optional embodiments, the head-mounted display device includes two display screens corresponding to the left eye and right eye of the user; and the vision test operation corresponding to the target user is performed to obtain the vision test result, including: for each display screen in the head-mounted display device, according to a pre-set vision test information set, a vision test operation corresponding to the target eye of the target user is performed to obtain a monocular vision test result corresponding to the target eye, wherein the vision test information in the vision test information set is used to be displayed in the display screen, and the target eye corresponds to the display screen; the two obtained monocular vision test results are determined as the vision test result.
[0011] In some optional embodiments, the head-mounted display device includes two display screens corresponding to the left eye and right eye of the user; and the vision test operation corresponding to the target user is performed, including: using the camera of the head-mounted display device to scan and model the current space to obtain a three-dimensional space model; determining the target point in the three-dimensional space model as an anchor point; placing a pre-set vision test information set at the position of the anchor point in the three-dimensional space model; and generating a vision test result based on the target user's interactive operation information on the vision test information set.
[0012] In some optional embodiments, the performing of the eye dynamic training operation corresponding to the target user to obtain the dynamic training accuracy includes: determining first first display object information in a preset first display object information sequence as target first display object information, wherein the size information of each display object corresponding to the first display object information sequence is arranged in descending order; performing the following first dynamic training step based on the target first display object information: generating a preset number of first display objects based on the target first display object information, wherein each direction information of each generated first display object is random; determining a first current error count and a first total error count based on the direction selection information of the preset number of first display objects displayed by the target user and the each direction information; in response to determining that the first total error count does not meet a preset error count condition and the target first display object information and the first current error count do not meet a preset end condition, updating the target first display object information based on the first current error count and the preset number, and performing the first dynamic training step again based on the updated target first display object information; and generating the dynamic training accuracy based on the each direction selection information corresponding to the target user and the each direction information of each displayed display object.
[0013] In some optional embodiments, the above-mentioned execution of the following first dynamic training step further includes: in response to determining that the above-mentioned first total error number meets the above-mentioned preset error number condition, determining the first second display object information in the preset second display object information sequence as the target second display object information, wherein the display object size information corresponding to the above-mentioned second display object information sequence is arranged in descending order, and the display object size range corresponding to the above-mentioned second display object information sequence includes the display object size range corresponding to the above-mentioned first display object information sequence; performing the following second dynamic training step according to the target second display object information: generating a second display object according to the target second display object information, wherein the direction information of the generated second display object is random; determining a second current error number and a second total error number according to the direction selection information of the above-mentioned second display object displayed for the above-mentioned target user and the direction information of the above-mentioned second display object; in response to determining that the second total error number does not meet the preset error number condition and the target second display object information does not meet the preset end condition, updating the target second display object information according to the second current error number, and performing the above-mentioned second dynamic training step again according to the updated target second display object information.
[0014] In some optional embodiments, the performing of the following second dynamic training step further includes: in response to determining that the second total number of errors satisfies a preset error number condition, determining a first third display object information in a preset third display object information sequence as target third display object information, wherein the third display object information sequence corresponds to a first preset display path, and the display object size range corresponding to the third display object information sequence includes the display object size range corresponding to the first display object information sequence; performing the following third dynamic training step based on the target third display object information: generating a third display object based on the target third display object information, wherein direction information and size information of the generated third display object are random; determining a third total number of errors based on direction selection information of the third display object displayed for the target user and the direction information of the third display object; in response to determining that the third total number of errors does not satisfy the preset error number condition and the target third display object information does not satisfy a preset end condition, determining the third display object information next to the target third display object information in the third display object information sequence as the target third display object information, and performing the above-mentioned third dynamic training step again based on the updated target third display object information.
[0015] In some optional embodiments, the performing of the following third dynamic training step further includes: in response to determining that the third total number of errors satisfies a preset error number condition, determining first fourth display object information in a preset fourth display object information sequence as target fourth display object information, wherein the fourth display object information sequence corresponds to a second preset display path, the second preset display path is in the opposite order of the first preset display path, and the display object size range corresponding to the fourth display object information sequence includes the display object size range corresponding to the first display object information sequence; performing the following fourth dynamic training step based on the target fourth display object information: generating a fourth display object based on the target fourth display object information, wherein direction information and size information of the generated fourth display object are random; determining a fourth total number of errors based on direction selection information of the fourth display object displayed for the target user and the direction information of the fourth display object; in response to determining that the fourth total number of errors does not satisfy the preset error number condition and the target fourth display object information does not satisfy a preset end condition, determining the fourth display object information next to the target fourth display object information in the fourth display object information sequence as the target fourth display object information, and performing the fourth dynamic training step again based on the updated target fourth display object information.
[0016] In some optional embodiments, the above-mentioned execution of the following fourth dynamic training step also includes: in response to determining that the fourth total error number meets the preset error number condition, executing the following fifth dynamic training step: generating a fifth display object within a preset display object size range, wherein the position information, direction information and size information of the generated fifth display object are random; determining the fifth total error number based on the direction selection information of the fifth display object displayed corresponding to the above-mentioned target user and the direction information of the above-mentioned fifth display object; in response to determining that the fifth total error number does not meet the preset error number condition and the number of generated fifth display objects is less than the preset number, executing the above-mentioned fifth dynamic training step again.
[0017] In some optional embodiments, the above-mentioned execution of the following fifth dynamic training step also includes: in response to determining that the fifth total number of errors meets the preset error number condition or the fifth dynamic training step is completed, playing the video content in the above-mentioned head-mounted display device.
[0018] In a second aspect, some embodiments of the present disclosure provide a head-mounted display device, comprising: one or more processors; at least one display screen for forming an image in front of the eyes of a user; a refractive index adjustment mechanism for adjusting the user's refractive index corresponding to the image formed in each display screen; and a storage device storing one or more programs, wherein when the one or more programs are executed by one or more processors, the one or more processors implement the method described in any implementation of the first aspect above.
[0019] In a third aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation of the first aspect is implemented.
[0020] The various embodiments of the present disclosure have the following beneficial effects: Through the vision testing methods based on head-mounted display devices in some embodiments of the present disclosure, vision loss caused by blurred vision during vision training is alleviated, and the user's actual training results can be determined through vision training. Specifically, the further vision loss and the inability to determine the user's actual training results are caused by the fact that after viewing content displayed on the head-mounted display device for a long time, the user already experiences blurred vision. Further viewing of video content further aggravates eye fatigue, leading to further vision loss. Furthermore, when the user performs vision training following the video content, the user's actual training results cannot be determined. Based on this, the vision testing methods based on head-mounted display devices in some embodiments of the present disclosure first provide a diopter adjustment prompt based on a target diopter and the diopter of the head-mounted display device. This prompts the user to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, a vision test operation is performed for the target user, and a vision test result is obtained as a first vision test result. The target user is the user wearing the head-mounted display device. In this manner, after the diopter of the head-mounted display device is adjusted to a target diopter, the user's vision test result at the target diopter can be detected. Then, based on the first vision test result, a diopter adjustment prompt is provided to the target user, prompting the target user to adjust the diopter of the head-mounted display device based on the first vision test result. This prompts the user to adjust the diopter of the head-mounted display device to the diopter corresponding to the first vision test result. Next, in response to determining that the diopter adjustment corresponding to the first vision test result is complete, a dynamic eye training operation is triggered to obtain a dynamic training accuracy rate. Thus, after the user adjusts the diopter of the head-mounted display device to the diopter corresponding to the first vision test result, dynamic eye training can be performed on the user, and the accuracy rate of the dynamic eye training can be obtained. Then, in response to determining that the dynamic eye training operation is complete, a diopter adjustment prompt is provided based on the target diopter. This prompts the user again to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, a vision test operation is performed on the corresponding target user, and a vision test result is obtained as a second vision test result. Thus, after the refractive power of the head-mounted display device is adjusted to the target refractive power, the user's vision test result at the target refractive power can be retested. Finally, the first vision test result, the second vision test result, and the dynamic training accuracy rate are displayed on the head-mounted display device. In this way, the user can obtain the vision test results before and after the dynamic eye training, as well as the accuracy rate of the dynamic eye training.Also, because during dynamic eye training, the refractive power of the head-mounted display device is adjusted according to the first vision test result of this detection, the user can clearly view the display content in the head-mounted display device after adjusting the refractive power according to the first vision test result, and will not further aggravate eye fatigue, thereby alleviating the vision loss caused by blurred viewing during vision training, and the user's actual training effect can be known through the dynamic training accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.
[0022] FIG1 is a flowchart of some embodiments of a vision detection method based on a head-mounted display device according to the present disclosure;
[0023] FIG2 is a schematic diagram of an interface of a display space of a vision detection method based on a head-mounted display device according to some embodiments of the present disclosure;
[0024] FIG3 is a schematic diagram of a detection result interface of a vision detection method based on a head-mounted display device according to some embodiments of the present disclosure;
[0025] FIG4 is a flowchart of other embodiments of a vision detection method based on a head-mounted display device according to the present disclosure;
[0026] FIG5 is a schematic diagram of a first preset display path of a vision detection method based on a head-mounted display device according to some embodiments of the present disclosure;
[0027] FIG6 is a schematic diagram of a second preset display path of a vision detection method based on a head-mounted display device according to some embodiments of the present disclosure;
[0028] FIG7 is a schematic structural diagram of a head-mounted display device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION
[0029] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.
[0030] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other.
[0031] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0032] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".
[0033] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0034] With regard to the collection, storage, and use of user personal information (such as vision test results and dynamic training accuracy) involved in this disclosure, before performing the corresponding operations, the relevant organizations or individuals shall fulfill their obligations, including conducting personal information security impact assessments, fulfilling the obligation to inform the personal information subject, and obtaining the authorization and consent of the personal information subject in advance.
[0035] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.
[0036] FIG1 shows a process 100 of some embodiments of a vision detection method based on a head-mounted display device according to the present disclosure. The vision detection method based on a head-mounted display device includes the following steps:
[0037] Step 101: Prompt for diopter adjustment based on the target diopter and the diopter of the head-mounted display device.
[0038] In some embodiments, the execution entity of the vision testing method based on a head-mounted display device (e.g., the head-mounted display device) may provide a diopter adjustment prompt based on the target diopter and the diopter of the head-mounted display device. The target diopter may be the diopter to which the head-mounted display device needs to be adjusted when testing naked-eye vision. The target diopter may be 0 degrees. The head-mounted display device may be a display device for a user to wear and view image content. The head-mounted display device may be, but is not limited to, one of the following: AR glasses, MR glasses, or VR glasses. In a specific implementation, the execution entity may, in response to determining that the diopter of the head-mounted display device is the target diopter, display a vision test operation prompt on the head-mounted display device. For example, the vision test operation prompt may be "Current diopter is 0, please press any key to enter the vision test." The execution entity may also, in response to determining that the current diopter of the head-mounted display device is not the target diopter, display a diopter adjustment prompt corresponding to the target diopter on the head-mounted display device. The above-mentioned diopter adjustment prompt information can be used to prompt the user to adjust the diopter. The above-mentioned diopter adjustment prompt information may include prompt text and prompt image. For example, the above-mentioned prompt text may be "Please adjust the vision adjustment knob to 0." The prompt image may be a picture used to prompt the user how to adjust the diopter. For example, the prompt image may display a diagram of the knob for adjusting the diopter of the head-mounted display device and an explanation of the adjustment direction. Optionally, the above-mentioned execution entity may also display vision test operation prompt information in the above-mentioned head-mounted display device. For example, the above-mentioned vision test operation prompt information may be "Please press any key to enter the vision test."
[0039] In some optional embodiments, before step 101, the execution entity may further, in response to determining that the head-mounted display device is in eye protection mode, perform an eye protection mode explanation operation. In a specific implementation, after a user selects an eye protection application identifier in the display space of the head-mounted display device, the head-mounted display device may enter eye protection mode. The execution entity may display a welcome message and / or eye protection mode explanation information in the display space. Optionally, the execution entity may also play corresponding audio while displaying the welcome message and / or eye protection mode explanation information. Thus, the welcome message and / or eye protection mode explanation information may be presented in a user interface (UI) and voice explanation format. For example, the welcome message may read "Hello." The eye protection mode explanation information may read "The eye protection system helps relieve eye fatigue. Give your eyes a rest for 8 minutes." Optionally, the execution entity may display the eye protection mode explanation information after displaying the welcome message for a preset duration. Optionally, the execution entity may automatically proceed to subsequent operations, i.e., execute step 101, after the audio corresponding to the eye protection mode explanation information ends.
[0040] Step 102 : In response to determining that the diopter of the head mounted display device corresponds to the target diopter, a vision test operation corresponding to the target user is performed to obtain a vision test result as a first vision test result.
[0041] In some embodiments, the execution entity may, in response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, perform a vision test operation for a target user, and obtain a vision test result as a first vision test result. The target user is a user wearing the head-mounted display device. In a specific implementation, the execution entity may, in response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, determine that the refractive power of the head-mounted display device corresponds to the target refractive power. The execution entity may also, in response to detecting a key operation after displaying the vision test operation prompt information and / or the diopter adjustment prompt information, determine that the refractive power of the head-mounted display device corresponds to the target refractive power. The key operation may be a key operation performed on a communication-connected device. Here, the device may be a smart device, which may be configured with a key. It is understood that the user interaction operation method with the head-mounted display device may include, but is not limited to, at least one of the following: voice interaction, gesture interaction, head-controlled interaction, touch interaction, and key interaction.
[0042] In a specific implementation, the execution entity may, in response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, execute a vision test task corresponding to the target user, and obtain a vision test result as the first vision test result. The vision test task may be a pre-set task for testing the user's vision. For example, the vision test task may be a vision test task based on an eye chart, and the user's vision may be determined based on the user's direction selection information for each indicator element in the eye chart.
[0043] In some optional embodiments, the head-mounted display device includes two display screens corresponding to the left eye and right eye of the user.
[0044] In some optional implementations of some embodiments, the execution entity may perform a vision test operation corresponding to the target user through the following steps to obtain a vision test result:
[0045] In the first step, for each display screen in the head-mounted display device, a vision test operation corresponding to the target eye of the target user is performed according to a preset vision test information set to obtain a monocular vision test result corresponding to the target eye. The vision test information set may be a vision chart for display in the head-mounted display device. Each vision test information may be a vision test element in the vision chart. For example, the vision test element may be "E". The vision test information in the vision test information set is used to be displayed in the display screen. The target eye corresponds to the display screen. Thus, the vision test information can be displayed in one display screen to test the vision of a single eye.
[0046] The second step is to determine the two obtained monocular vision test results as the vision test results, thereby obtaining the user's binocular vision test results.
[0047] In some optional implementations of some embodiments, the execution entity may perform the vision test operation corresponding to the target user through the following steps:
[0048] The first step is to use the camera of the head-mounted display device to scan and model the current space to obtain a three-dimensional space model. In specific implementation, the execution entity can use SLAM technology to build the three-dimensional space model.
[0049] In the second step, the target point in the three-dimensional space model is determined as the anchor point. The target point can correspond to a point on the wall in the current space. For example, the point on the wall can be a point used to locate the upper left corner of the eye chart. The point is in the upper left corner of the wall, so that the eye chart can be completely placed on the wall according to the point without exceeding the wall boundary. Here, there is no specific limitation on the specific setting of the anchor point. It is understandable that the target point can also be a placement position selected by the target user himself or selected according to the recommended plane. For example, the user can select a target point at any position in the three-dimensional space model, so that the information to be projected there (such as the eye chart) can be displayed with the real world as the background. For another example, the execution entity can display at least one recommended plane in the three-dimensional space model for the user to select a target point in the plane. Specifically, when the user selects a target point in the plane, he can follow the displayed guidance information to walk near the plane, and after clicking to confirm the placement, the information to be projected can be displayed in the three-dimensional space model.
[0050] The third step is to project a preset vision test information set at the position of the anchor point in the three-dimensional space model. The preset vision test information set may be a vision chart for displaying in a head-mounted display device.
[0051] The fourth step is to generate a vision test result based on the target user's interactive operation information with respect to the aforementioned vision test information set. This interactive operation information may include the user's selected direction information for the displayed vision test information. In a specific implementation, the aforementioned execution entity may generate a vision test result based on the respective direction information selected by the user and the corresponding correct direction information for each vision test information. This allows the user's vision to be tested directly in the three-dimensional space of the head-mounted display device, eliminating the need for physical objects for testing and simplifying the vision test operation.
[0052] Step 103: Prompt the target user to adjust the diopter according to the first vision test result, so that the target user adjusts the diopter of the head-mounted display device according to the first vision test result.
[0053] In some embodiments, the execution entity may provide the target user with a diopter adjustment prompt based on the first vision test result, so that the target user adjusts the diopter of the head-mounted display device based on the first vision test result. In a specific implementation, the execution entity may display a diopter adjustment prompt message corresponding to the first vision test result in the head-mounted display device to prompt the target user to adjust the diopter of the head-mounted display device based on the first vision test result. The diopter adjustment prompt message corresponding to the first vision test result may include the first vision test result. For example, the diopter adjustment prompt message corresponding to the first vision test result may be "Please adjust the left eye vision adjustment knob to 425° and the right eye vision adjustment knob to 400°".
[0054] In some optional implementations of some embodiments, the execution entity may provide the target user with a diopter adjustment prompt based on the first vision test result:
[0055] In the first step, the monocular vision test result corresponding to the left eye included in the first vision test result is displayed on the left side of the display space of the head-mounted display device.
[0056] In the second step, the monocular vision test result corresponding to the right eye included in the first vision test result is displayed on the right side of the display space of the head-mounted display device.
[0057] The third step is to display the real-time diopter corresponding to the diopter adjustment operation in the display space in response to the detection of the target user's diopter adjustment operation. The real-time diopter is displayed on the side of the eye corresponding to the diopter adjustment operation in the display space. In a specific implementation, the execution subject can display the real-time diopter of the display screen corresponding to the left eye on the left side of the display control in response to the detection of the target user's diopter adjustment operation on the display screen corresponding to the left eye. The execution subject can display the real-time diopter of the display screen corresponding to the left eye on the right side of the display control in response to the detection of the target user's diopter adjustment operation on the display screen corresponding to the right eye. Thus, the user can view the currently adjusted diopter and the required adjusted diopter through the monocular vision test results and real-time diopter displayed on each side.
[0058] Optionally, the execution entity may further display a preset vision test chart and reference adjustment prompt information corresponding to the preset vision test chart in the display space. The preset vision test chart may be a partial vision test chart extracted from a complete vision chart for the user to refer to for clarity. For example, the preset vision test chart may include the second to fourth to last lines of the complete vision chart. The reference adjustment prompt information may be information prompting the user to use the preset vision test chart as a reference when adjusting the diopter. For example, the reference adjustment prompt information may be "Adjust the knob so that both eyes can clearly see E." Optionally, the execution entity may further display dynamic eye training operation prompt information in the display space, which may be used to prompt the user on how to enter the dynamic eye training operation. For example, the dynamic eye training operation prompt information may be "After the diopter adjustment is complete, press the confirm key to enter the dynamic eye training." As an example, the interface display content of the display space may refer to Figure 2. Figure 2 shows the monocular vision test result 201 corresponding to the left eye, the monocular vision test result 202 corresponding to the right eye, the real-time refractive power 203 corresponding to the left eye, the real-time refractive power 204 corresponding to the right eye, a preset vision test chart 205, reference adjustment prompt information 206, eye dynamic training operation prompt information 207 and a refractive power adjustment prompt diagram 208.
[0059] Therefore, the preset vision test chart and reference adjustment prompt information can be displayed to enable the user to adjust the refractive power of the head-mounted display device according to the first vision test result and the clarity of the vision test elements in the preset vision test chart, thereby ensuring that the display content in the head-mounted display device can be clearly viewed before entering the dynamic eye training operation.
[0060] Optionally, before step 104, the execution subject may also determine that the diopter adjustment corresponding to the first vision test result is completed in response to detecting a selection operation of a target button on the smart terminal. The target button may be any button or a confirmation button. It is understandable that the execution subject may also determine that the diopter adjustment corresponding to the first vision test result is completed through other interaction methods. Other interaction methods may include but are not limited to at least one of the following: voice interaction, gesture interaction, head control interaction, and touch interaction. Thus, user interaction operations can be coordinated through the communication-connected smart terminal.
[0061] Step 104 , in response to determining that the diopter adjustment corresponding to the first vision test result is completed, performing a dynamic eye training operation corresponding to the target user to obtain a dynamic training accuracy rate.
[0062] In some embodiments, the execution subject may, in response to determining that the diopter adjustment corresponding to the first vision test result is completed, execute the eye dynamic training operation corresponding to the target user to obtain the dynamic training accuracy. In a specific implementation, the execution subject may, in response to detecting that the diopter adjustment of the head-mounted display device is the first vision test result, determine that the diopter adjustment corresponding to the first vision test result is completed. The execution subject may also, in response to detecting a confirmation operation after prompting the target user to adjust the diopter according to the first vision test result, determine that the diopter adjustment corresponding to the first vision test result is completed. The confirmation operation may be a key operation acting on a confirmation button. For example, the confirmation operation may be a key operation acting on a confirmation button on a communication-connected smart device.
[0063] In a specific implementation, the execution entity may sequentially display each vision training information in a pre-set vision training information sequence on a head-mounted display device and receive feedback from the target user regarding each vision training information. Each vision training information may be an image with different styles. Here, the styles may include, but are not limited to, at least one of the following: size, orientation, and position. The feedback information may be the orientation of the vision training information selected by the user. The execution entity may then determine the accuracy of the user-selected vision training information as the dynamic training accuracy rate. The accuracy rate of the training information is calculated as the ratio of the number of vision training information with correct orientations in the target user's feedback to the total number of vision training information for which the user provided feedback. For example, if the target user provides feedback on M vision training information, and N of the feedback is correct, the accuracy rate of the vision training information is N / M. For example, the vision training information may be logos of different sizes and orientations, such as the letter "E" in different sizes and orientations. Optionally, the execution entity may also display video content on the head-mounted display device. The video content may be a video designed to relieve visual fatigue. For example, the eye training video may be a 3D video. It is understood that the eye dynamic training operation may be an interactive eye dynamic training, or may include an interactive eye dynamic training and a video viewing eye dynamic training.
[0064] Step 105 : In response to determining that the eye dynamic training operation is completed, a diopter adjustment prompt is provided according to the target diopter.
[0065] In some embodiments, the execution subject may, in response to determining that the dynamic eye training operation is complete, provide a diopter adjustment prompt based on the target diopter. In specific implementations, the specific implementation of providing a diopter adjustment prompt based on the target diopter can be found in step 101 and will not be further described here.
[0066] Step 106 : In response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, performing a vision test operation corresponding to the target user, and obtaining a vision test result as a second vision test result.
[0067] In some embodiments, the execution entity may, in response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, perform a vision test operation on the target user, and obtain a vision test result as the second vision test result. The specific implementation of the vision test operation on the target user can be found in step 102 and will not be further described here.
[0068] Step 107: Display the first vision test result, the second vision test result, and the dynamic training accuracy rate on the head-mounted display device.
[0069] In some embodiments, the above-mentioned execution entity may display the above-mentioned first vision test result, the above-mentioned second vision test result and the above-mentioned dynamic training accuracy rate in the above-mentioned head-mounted display device. In specific implementation, the above-mentioned execution entity may display the above-mentioned first vision test result, the above-mentioned second vision test result and the above-mentioned dynamic training accuracy rate in the display space of the above-mentioned head-mounted display device in sequence. Optionally, the above-mentioned execution entity may also display a prompt message for returning to the home page in the above-mentioned display space. For example, the above-mentioned prompt message for returning to the home page may be "Press any key to return to the home page". It should be noted that the operation method for returning to the home page may include but is not limited to at least one of the following: voice interaction, gesture interaction, head control interaction, touch interaction, and button interaction. As an example, the detection result interface of the display space displaying the first vision test result 301, the second vision test result 302 and the dynamic training accuracy rate 303 can refer to Figure 3.
[0070] The various embodiments of the present disclosure have the following beneficial effects: Through the vision testing methods based on head-mounted display devices in some embodiments of the present disclosure, vision loss caused by blurred vision during vision training is alleviated, and the user's actual training results can be determined through vision training. Specifically, the further vision loss and the inability to determine the user's actual training results are caused by the fact that after viewing content displayed on the head-mounted display device for a long time, the user already experiences blurred vision. Continuing to watch the video content further aggravates eye fatigue, leading to further vision loss. Furthermore, when the user performs vision training following the video content, the user's actual training results cannot be determined. Based on this, the vision testing methods based on head-mounted display devices in some embodiments of the present disclosure first provide a diopter adjustment prompt based on a target diopter and the diopter of the head-mounted display device. This prompts the user to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the diopter of the head-mounted display device corresponds to the target diopter, a vision test operation is performed for the target user, and a vision test result is obtained as a first vision test result. The target user is the user wearing the head-mounted display device. In this manner, after the diopter of the head-mounted display device is adjusted to a target diopter, the user's vision test result at the target diopter can be detected. Then, based on the first vision test result, a diopter adjustment prompt is provided to the target user, prompting the target user to adjust the diopter of the head-mounted display device based on the first vision test result. This prompts the user to adjust the diopter of the head-mounted display device to the diopter corresponding to the first vision test result. Next, in response to determining that the diopter adjustment corresponding to the first vision test result is complete, a dynamic eye training operation is triggered to obtain a dynamic training accuracy rate. Thus, after the user adjusts the diopter of the head-mounted display device to the diopter corresponding to the first vision test result, dynamic eye training can be performed on the user, and the accuracy rate of the dynamic eye training can be obtained. Then, in response to determining that the dynamic eye training operation is complete, a diopter adjustment prompt is provided based on the target diopter. This prompts the user again to adjust the diopter of the head-mounted display device to the target diopter. Then, in response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, a vision test operation is performed on the corresponding target user, and a vision test result is obtained as a second vision test result. Thus, after the refractive power of the head-mounted display device is adjusted to the target refractive power, the user's vision test result at the target refractive power can be retested. Finally, the first vision test result, the second vision test result, and the dynamic training accuracy rate are displayed on the head-mounted display device. In this way, the user can obtain the vision test results before and after the dynamic eye training, as well as the accuracy rate of the dynamic eye training.Also, because during dynamic eye training, the refractive power of the head-mounted display device is adjusted according to the first vision test result of this detection, the user can clearly view the display content in the head-mounted display device after adjusting the refractive power according to the first vision test result, and will not further aggravate eye fatigue, thereby alleviating the vision loss caused by blurred viewing during vision training, and the user's actual training effect can be known through the dynamic training accuracy.
[0071] Further referring to FIG4 , which shows a process 400 of another embodiment of a vision detection method based on a head-mounted display device. The process 400 of the vision detection method based on a head-mounted display device includes the following steps:
[0072] Step 401: Prompt for diopter adjustment based on the target diopter and the diopter of the head-mounted display device.
[0073] Step 402: In response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, a vision test operation corresponding to the target user is performed to obtain a vision test result as a first vision test result.
[0074] Step 403: Prompt the target user to adjust the diopter according to the first vision test result, so that the target user adjusts the diopter of the head-mounted display device according to the first vision test result.
[0075] In some embodiments, the specific implementation methods and technical effects of steps 401-403 can refer to steps 101-103 in the embodiments corresponding to Figure 1, and will not be repeated here.
[0076] Step 404 : In response to determining that the diopter adjustment corresponding to the first vision test result is completed, determining the first first display object information in the preset first display object information sequence as the target first display object information.
[0077] In some embodiments, the execution entity of the vision detection method based on a head-mounted display device (e.g., a head-mounted display device) can, in response to determining that the diopter adjustment corresponding to the above-mentioned first vision test result is completed, determine the first first display object information in a pre-set first display object information sequence as the target first display object information. The above-mentioned first display object information sequence can be various attribute information used to generate a display object. The first display object information can include, but is not limited to: display object size information. The display object size information can represent the size of the display object. The display object size information can be directly expressed as a size or as a corresponding vision value. For example, the vision value can be a decimal vision value or a value on a 5-point scale. The display object can be an object for the user to identify the direction. For example, the display object can be an "E" with a random direction. The display object size information corresponding to the above-mentioned first display object information sequence is arranged in descending order. For example, the first display object information sequence can include 5 first display object information.
[0078] Step 405: Execute the following first dynamic training steps according to the target first display object information:
[0079] Step 4051: Generate a preset number of first display objects according to target first display object information.
[0080] In some embodiments, the execution entity may generate a preset number of first display objects based on the target first display object information. The generated first display objects may have random directional information. The directional information may be the orientation of the display object. For example, the directional information may be, but is not limited to, one of the following: left, right, up, or down. In specific implementations, the execution entity may generate a preset number of first display objects with random directional information based on the display object size information corresponding to the target first display object information.
[0081] Step 4052 : Determine a first current error number and a first total error number according to the direction selection information and each direction information corresponding to the preset number of first display objects displayed by the target user.
[0082] In some embodiments, the execution entity may determine the first current error count and the first total error count based on the direction selection information of the preset number of first display objects displayed by the target user and the above-mentioned respective direction information. The direction selection information may be the orientation of the displayed display object fed back by the target user after the interactive operation. Only one display object may be displayed at a time. In a specific implementation, for each first display object in the preset number of first display objects, the execution entity may determine that the direction selection information corresponding to the first display object is different from the direction information corresponding to the first display object, and increment the first current error count by 1 and the first total error count by 1. The initial value of the first current error count may be 0, and the information of each target first display object is cleared to zero. The initial value of the first total error count may be 0, and it is incremented continuously without being cleared to zero.
[0083] Optionally, before step 4052, the execution entity may further perform the following steps:
[0084] For each of the preset number of first display objects, perform the following steps:
[0085] The first step is to display the first display object in a first preset display mode at a central position in the display space of the head-mounted display device. The central position may be a visual center position. The first preset display mode may be a direct display mode. In a specific implementation, the execution entity may display the first display object in the first preset display mode at a central position in a pre-constructed three-dimensional space model.
[0086] The second step is to receive direction selection information fed back by the target user with respect to the first display object.
[0087] Optionally, the head-mounted display device includes a head-mounted display device body and a smart terminal. The head-mounted display device body can be a head-mounted device. The smart terminal can be, but is not limited to, at least one of the following: a mobile phone, a tablet computer, a touchpad, and a mobile host. The connection between the head-mounted display device body and the smart terminal can be a wired connection or a wireless connection. It should be noted that the above-mentioned wireless connection method can include, but is not limited to, 3G / 4G connection, wireless communication technology (WiFi) connection, Bluetooth connection, WiMAX connection, Zigbee connection, ultra wideband (UWB) connection, and other wireless connection methods currently known or to be developed in the future.
[0088] In some optional implementations of some embodiments, the execution entity may receive the direction selection information fed back by the target user for the first display object through the following steps: in response to detecting a selection operation on a direction button on the smart terminal, determining the direction identifier corresponding to the selected direction button as the direction selection information corresponding to the first display object. The direction button may be a button with a direction indication. The direction button may include but is not limited to: a left button, a right button, an up button, and a down button. The smart terminal is communicatively connected to the head-mounted display device body. It is understandable that the user's direction selection operation may also be through, but is not limited to, the following interaction methods: voice interaction, gesture interaction, head-controlled interaction, and touch interaction.
[0089] Step 4053, in response to determining that the first total error number does not meet the preset error number condition, and the target first display object information and the first current error number do not meet the preset end condition, update the target first display object information according to the first current error number and the preset number, and execute the first dynamic training step again according to the updated target first display object information.
[0090] In some embodiments, the execution subject may, in response to determining that the first total number of errors does not satisfy the preset error number condition, and the target first display object information and the first current error number do not satisfy the preset end condition, update the target first display object information according to the first current error number and the preset number, and execute the first dynamic training step again according to the updated target first display object information. The preset error number condition may be greater than or equal to a preset value. For example, the preset value may be 5. The preset end condition may be that the target first display object information is not the last one in the first display object information sequence, and the first current error number is not 0. In specific implementation, the execution subject may update the target first display object information according to the first current error number and the preset number through the following steps:
[0091] In the first step, in response to determining that the first current number of errors is equal to the preset number and that this is not the first time the first dynamic training step is being performed, the adjacent first display object information preceding the target first display object information in the first display object information sequence is determined as the updated target first display object information. This allows for displaying a slightly larger first display object the next time the user incorrectly selects the orientation of the preset number of first display objects.
[0092] In a second step, in response to determining that the first current number of errors is equal to the preset number and the first dynamic training step is being performed for the first time, the target first display object information is retained unchanged. Thus, if the user incorrectly selects the preset number of first display object orientations for the first time, the first display object of the same size is displayed next time, facilitating user adaptation to dynamic training.
[0093] In a third step, in response to determining that the first current error count is equal to a preset minimum value, the first display object information subsequent to the target first display object information in the first display object information sequence is determined as the updated target first display object information. The preset minimum value may be 0. Thus, when the user correctly selects a certain number of first display object orientations, a slightly smaller first display object may be displayed next time.
[0094] In a fourth step, in response to determining that the first current error count is greater than the preset minimum value and less than the preset number, the target first display object information is retained unchanged. Optionally, the execution entity may further retain the target first display object information unchanged in response to determining that the first current error count is greater than or equal to half of the preset number. Thus, when both the correct and incorrect orientations are selected, the first display object of the same size is displayed next time, allowing the displayed first display object to adapt to the user's vision.
[0095] Optionally, the first dynamic training step may further include the following steps:
[0096] In the first step, in response to determining that the first total number of errors satisfies the preset error number condition, the first second display object information in a pre-set second display object information sequence is determined as the target second display object information. The second display object information sequence may be various attribute information used to generate a display object. The second display object information may include, but is not limited to, display object size information. For example, the second display object information sequence may include 10 pieces of second display object information. The display object size information corresponding to the second display object information sequence is arranged in descending order. The display object size range corresponding to the second display object information sequence includes the display object size range corresponding to the first display object information sequence. The display object size range may be a visual acuity value range corresponding to the display object. For example, the visual acuity value range corresponding to the first display object information sequence may be [0.1, 0.4]. The visual acuity value range corresponding to the second display object information sequence may be [0.1, 1.2].
[0097] In the second step, according to the target second display object information, the following second dynamic training steps are performed:
[0098] The first sub-step is to generate a second display object based on the target second display object information. The generated second display object has random orientation information. In a specific implementation, the execution entity may generate the second display object with a random orientation based on the display object size information corresponding to the target second display object information.
[0099] The second sub-step is to determine the second current error count and the second total error count based on the direction selection information of the second display object displayed corresponding to the target user and the direction information of the second display object. In a specific implementation, the execution entity may determine the second current error count to be 1 and increment the second total error count by 1 in response to determining that the direction selection information of the second display object and the direction information of the second display object are different. The execution entity may determine the second current error count to be 0 in response to determining that the direction selection information of the second display object and the direction information of the second display object are the same. The initial value of the second total error count may be 0, and the value may be incremented without being cleared.
[0100] Optionally, before the second sub-step, the execution entity may further display the second display object in a second preset display mode at a central position in the display space of the head-mounted display device. The central position may be the visual center. The second preset display mode may be a display mode that gradually changes from blur to clarity. In a specific implementation, the execution entity may display the second display object in a second preset display mode at a central position in a pre-constructed three-dimensional space model. Direction selection information regarding the second display object may then be received from the target user.
[0101] In a third sub-step, in response to determining that the second total number of errors does not meet the preset error number condition and the target second display object information does not meet the preset termination condition, the target second display object information is updated based on the second current error number, and the second dynamic training step is performed again based on the updated target second display object information. The preset termination condition may be that the target second display object information is not the last one in the second display object information sequence. In specific implementations, the execution entity may update the target second display object information based on the second current error number by the following steps:
[0102] First, in response to determining that the second current error count is 1 and this is not the first time the second dynamic training step is being performed, the adjacent second display object information preceding the target second display object information in the second display object information sequence is determined as the updated target second display object information. This allows for a slightly larger second display object to be displayed next time the user incorrectly selects the orientation of the second display object.
[0103] Second, in response to determining that the second current error count is 1 and the second dynamic training step is being performed for the first time, the target second display object information is retained unchanged. Thus, if the user incorrectly selects the orientation of the second display object for the first time, the second display object of the same size is displayed next time, facilitating user adaptation to dynamic training.
[0104] Third, in response to determining that the second current error count is equal to 0, the second display object information subsequent to the target second display object information in the second display object information sequence is determined as the updated target second display object information. This allows the second display object to be displayed slightly smaller next time when the user selects the correct orientation for the second display object.
[0105] Optionally, the second dynamic training step may further include the following steps:
[0106] In the first step, in response to determining that the second total number of errors satisfies a preset error number condition, the first piece of third display object information in a preset third display object information sequence is determined as the target third display object information. The third display object information sequence may include various attribute information used to generate a display object. The third display object information may include, but is not limited to, display position information. Display position information may represent the position of the display object in the display space. The third display object information sequence corresponds to a first preset display path. It can be understood that each piece of third display object information in the third display object information sequence is arranged in the path order of the first preset display path. For example, the third display object information sequence may include 13 pieces of third display object information arranged in the path order. The first preset display path corresponding to the third display object information sequence can be seen in FIG5 . The display object size range corresponding to the third display object information sequence includes the display object size range corresponding to the first display object information sequence. For example, the visual acuity value range corresponding to the third display object information sequence may be [0.1, 0.8].
[0107] The second step is to perform the following third dynamic training steps according to the target third display object information:
[0108] In a first sub-step, a third display object is generated based on the target third display object information. The generated third display object has random orientation and size information. In a specific implementation, the execution entity may generate a third display object with random orientation and size based on the display position information corresponding to the target third display object information. The display position of the third display object corresponds to the display position information.
[0109] In a second sub-step, a third total error count is determined based on the direction selection information of the third display object displayed for the target user and the direction information of the third display object. In a specific implementation, the execution entity may increment the third total error count by 1 in response to determining that the direction selection information of the third display object and the direction information of the third display object are different. The third total error count may be initially set to 0 and continuously incremented without being reset to zero.
[0110] Optionally, before the second sub-step, the execution entity may further display the third display object in a first preset display mode within the display space of the head-mounted display device. In a specific implementation, the execution entity may display the third display object in the first preset display mode within a pre-constructed three-dimensional space model. Direction selection information regarding the third display object may then be received from the target user.
[0111] In a third sub-step, in response to determining that the third total number of errors does not meet a preset error number condition and the target third display object information does not meet a preset termination condition, the third display object information following the target third display object information in the third display object information sequence is used as the target third display object information, and the third dynamic training step is repeated based on the updated target third display object information. The preset termination condition may be that the target third display object information is not the last one in the third display object information sequence. In this manner, each display object can be displayed sequentially for the user to select a direction, in a mode where the correctness of the current direction selection does not affect the position of the display object that appears next time.
[0112] Optionally, the third dynamic training step may further include the following steps:
[0113] In the first step, in response to determining that the third total number of errors satisfies a preset error number condition, the first fourth display object information in a preset fourth display object information sequence is determined as the target fourth display object information. The fourth display object information sequence may include various attribute information used to generate a display object. The fourth display object information may include, but is not limited to, display position information. The fourth display object information sequence corresponds to a second preset display path, which is in the opposite order of the first preset display path. It can be understood that the fourth display object information in the fourth display object information sequence is arranged in the path order of the second preset display path, which is opposite to the first preset display path. For example, the fourth display object information sequence may include 13 fourth display object information arranged in the path order of the second preset display path. The second preset display path corresponding to the fourth display object information sequence can be seen in FIG6 . The display object size range corresponding to the fourth display object information sequence includes the display object size range corresponding to the first display object information sequence. For example, the visual acuity value range corresponding to the fourth display object information sequence may be [0.1, 0.8].
[0114] The second step is to perform the following fourth dynamic training steps according to the target fourth display object information:
[0115] The first sub-step involves generating a fourth display object based on the target fourth display object information. The generated fourth display object has random orientation and size information. In a specific implementation, the execution entity may generate a fourth display object with random orientation and size based on the display position information corresponding to the target fourth display object information. The display position of the fourth display object corresponds to the display position information.
[0116] A second sub-step is determining a fourth total error count based on the direction selection information of the fourth display object displayed by the target user and the direction information of the fourth display object. In a specific implementation, the execution entity may increment the fourth total error count by 1 in response to determining that the direction selection information of the fourth display object and the direction information of the fourth display object are different. The fourth total error count may be initially set to 0 and continuously incremented without being reset to zero.
[0117] Optionally, before the second sub-step, the execution entity may further display the fourth display object in a second preset display mode within the display space of the head-mounted display device. In a specific implementation, the execution entity may display the fourth display object in the second preset display mode within a pre-constructed three-dimensional space model. Direction selection information regarding the fourth display object may then be received from the target user.
[0118] In a third sub-step, in response to determining that the fourth total number of errors does not meet a preset error number condition and the target fourth display object information does not meet a preset termination condition, the fourth display object information following the target fourth display object information in the fourth display object information sequence is used as the target fourth display object information, and the fourth dynamic training step is executed again based on the updated target fourth display object information. The preset termination condition may be that the target fourth display object information is not the last one in the fourth display object information sequence. Thus, the user's eye dynamic training can be performed again in the reverse order.
[0119] Optionally, the fourth dynamic training step may further include the following steps:
[0120] In response to determining that the fourth total error number meets the preset error number condition, performing the following fifth dynamic training step:
[0121] The first step is to generate a fifth display object within a preset display object size range. The preset display object size range can be expressed as a visual acuity range. For example, the preset display object size range can be [0.1, 0.8]. The generated fifth display object has random position, orientation, and size information. In a specific implementation, the execution entity can generate a fifth display object with random position, orientation, and size within the preset display object size range.
[0122] The second step is to determine a fifth total error count based on the direction selection information of the fifth display object displayed by the target user and the direction information of the fifth display object. In a specific implementation, the execution entity may increment the fifth total error count by 1 in response to determining that the direction selection information of the fifth display object and the direction information of the fifth display object are different. The fifth total error count may be initially set to 0 and continuously incremented without being reset to zero.
[0123] Optionally, before the second step, the execution entity may further display the fifth display object in a third preset display mode within the display space of the head-mounted display device. The third preset display mode may be a display mode that changes from blur to clarity or directly appears randomly. In a specific implementation, the execution entity may display the fifth display object in the third preset display mode within a pre-constructed three-dimensional space model. Direction selection information regarding the fifth display object may then be received from the target user.
[0124] It should be noted that there is no limitation on the specific settings of the first preset display mode, the second preset display mode and the third preset display mode.
[0125] In step three, in response to determining that the fifth total number of errors does not meet the preset error number condition and the number of generated fifth display objects is less than a preset number, the fifth dynamic training step is performed again. For example, the preset number may be 20. In this way, the user's eye dynamic training can be performed in a random pattern of direction, position, and size.
[0126] Optionally, the fifth dynamic training step may further include the following steps:
[0127] In response to determining that the fifth total number of errors meets a preset error number condition or the fifth dynamic training step has concluded, video content is played on the head-mounted display device. The video content may be a video designed to train the user's eye muscles to alleviate visual fatigue. The video may be a 3D video. Preferably, the 3D video may include one or more objects moving in 3D space to guide the movement of the user's ciliary muscles. This allows for the relatively relaxing video-based dynamic training to proceed after the interactive dynamic training is completed. Because interactive eye dynamic training and video viewing eye dynamic training involve identifying and tracking targets, they can help improve eye coordination and the ability to quickly adapt to moving targets. These two types of eye dynamic training can expand the range of eye movement and reduce excessive eye muscle tension, thereby increasing comfort and improving vision. Therefore, the eye dynamic training operation in this embodiment, when including interactive eye dynamic training and playing videos designed to alleviate visual fatigue, can promote eye-brain coordination and overall enhance the effectiveness of alleviating visual fatigue.
[0128] Step 406 : Generate a dynamic training accuracy rate based on the direction selection information of the corresponding target user and the direction information of each displayed object.
[0129] In some embodiments, the execution entity may generate a dynamic training accuracy rate based on the direction selection information corresponding to the target user and the direction information of each displayed display object. In a specific implementation, the execution entity may determine that the dynamic eye training operation has ended in response to determining that the first total number of errors does not meet a preset error number condition, and that the target first display object information and the first current number of errors meet a preset termination condition, and generate a dynamic training accuracy rate based on the direction selection information corresponding to the target user and the direction information of each displayed display object. In a specific implementation, for each display object, the execution entity may compare the direction selection information and direction information corresponding to the display object. Then, the number of display objects with the same direction selection information and direction information may be determined as the correct number. Thereafter, the number of displayed display objects may be determined as the total number. Finally, the ratio of the correct number to the total number may be determined as the dynamic training accuracy rate. The dynamic training accuracy rate may be expressed as a percentage.
[0130] Optionally, the execution entity may further determine that the eye dynamic training operation is terminated in response to determining that the second total error number does not meet a preset error number condition and the target second display object information meets a preset termination condition. The execution entity may further determine that the eye dynamic training operation is terminated in response to determining that the third total error number does not meet a preset error number condition and the target third display object information meets a preset termination condition. The execution entity may further determine that the eye dynamic training operation is terminated in response to determining that the fourth total error number does not meet a preset error number condition and the target fourth display object information meets a preset termination condition. The execution entity may further determine that the eye dynamic training operation is terminated in response to determining that the fifth total error number does not meet a preset error number condition and the target fifth display object information meets a preset termination condition.
[0131] Optionally, the execution entity may also play video content in the head-mounted display device in response to determining that the eye dynamic training operation is completed.
[0132] Optionally, the execution entity may further determine the number of direction selection information items selected by the target user as a total. Compared to determining the number of displayed objects as a total, determining the number of direction selection information items selected by the target user as a total eliminates the impact of the user not selecting a direction when determining the dynamic training accuracy rate, thereby improving the accuracy of the determined dynamic training accuracy rate.
[0133] Step 407 : In response to determining that the eye dynamic training operation is completed, a diopter adjustment prompt is provided according to the target diopter.
[0134] Step 408 : In response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, a vision test operation corresponding to the target user is performed to obtain a vision test result as a second vision test result.
[0135] Step 409: Display the first vision test result, the second vision test result, and the dynamic training accuracy rate on the head-mounted display device.
[0136] In some embodiments, the specific implementation methods and technical effects of steps 407-409 can refer to steps 105-107 in the corresponding embodiments of Figure 1, and will not be repeated here.
[0137] As can be seen from FIG4 , compared to the description of some embodiments corresponding to FIG1 , process 400 of the vision detection method based on a head-mounted display device in some embodiments corresponding to FIG4 embodies steps that expand the dynamic eye training operation. Thus, the solutions described in these embodiments can adapt different dynamic eye training modes to users based on their feedback. This can not only enhance the personalized experience of dynamic eye training, but also enable users to better exercise their eye muscles under different dynamic eye training modes, thereby achieving the effect of improving vision.
[0138] 7, which shows a schematic diagram of a head-mounted display device 700 suitable for implementing some embodiments of the present disclosure. The head-mounted display device shown in FIG7 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.
[0139] As shown in FIG7 , the head-mounted display device 700 may include a processing device 701 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. Various programs and data required for the operation of the head-mounted display device 700 are also stored in the RAM 703. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.
[0140] Typically, the following devices can be connected to the I / O interface 705: input devices 706 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; and communication devices 709. The communication devices 709 can allow the head-mounted display device 700 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 7 shows a head-mounted display device 700 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively. Each box shown in FIG. 7 may represent one device, or may represent multiple devices as needed.
[0141] The head-mounted display device may further include at least one display screen for forming an image in front of the user's eyes with the support of optical elements. The head-mounted display device may further include a diopter adjustment mechanism for adjusting the user's diopter corresponding to the image formed on each display screen.
[0142] Optionally, the head-mounted display device may include a head-mounted display device body and a smart terminal, and the smart terminal is communicatively connected to the head-mounted display device body.
[0143] In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program comprising program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from a network via the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of some embodiments of the present disclosure are performed.
[0144] It should be noted that the computer-readable medium described in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, RAM, ROM, erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or device. In some embodiments of the present disclosure, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0145] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.
[0146] The above-mentioned computer-readable medium may be included in the above-mentioned head-mounted display device; or it may exist independently and not be assembled into the head-mounted display device. The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the head-mounted display device, the head-mounted display device: performs a diopter adjustment prompt according to the target refractive power and the refractive power of the head-mounted display device; in response to determining that the refractive power of the above-mentioned head-mounted display device corresponds to the above-mentioned target refractive power, performs a vision test operation corresponding to the target user, and obtains a vision test result as a first vision test result, wherein the above-mentioned target user is a user wearing the above-mentioned head-mounted display device; based on the above-mentioned first vision test result, performs a diopter adjustment prompt for the above-mentioned target user, so that the above-mentioned target user adjusts the vision according to the above-mentioned first vision test result. The refractive power of the head-mounted display device is adjusted according to the vision test result; in response to determining that the refractive power adjustment corresponding to the first vision test result is completed, triggering the execution of the eye dynamic training operation to obtain the dynamic training accuracy rate; in response to determining that the execution of the eye dynamic training operation is completed, providing a refractive power adjustment prompt according to the target refractive power; in response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, executing the vision test operation corresponding to the target user to obtain the vision test result as the second vision test result; displaying the first vision test result, the second vision test result and the dynamic training accuracy rate on the head-mounted display device.
[0147] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer over any type of network, including a LAN or WAN, or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0148] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0149] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0150] The above description is only an illustration of some preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.
Claims
1. A vision detection method based on a head-mounted display device, comprising: Prompt for diopter adjustment based on the target diopter and the diopter of the head-mounted display device; In response to determining that the refractive power of the head-mounted display device corresponds to the target refractive power, performing a vision test operation corresponding to a target user to obtain a vision test result as a first vision test result, wherein the target user is a user wearing the head-mounted display device; Prompting the target user to adjust the diopter according to the first vision test result, so that the target user adjusts the diopter of the head-mounted display device according to the first vision test result; In response to determining that the diopter adjustment corresponding to the first vision test result is completed, triggering execution of an eye dynamic training operation to obtain a dynamic training accuracy rate; In response to determining that the eye dynamic training operation is completed, providing a diopter adjustment prompt according to the target diopter; In response to determining that the refractive power of the head mounted display device corresponds to the target refractive power, performing a vision test operation corresponding to the target user to obtain a vision test result as a second vision test result; The first vision test result, the second vision test result, and the dynamic training accuracy are displayed in the head-mounted display device.
2. The method according to claim 1, wherein The head-mounted display device includes two display screens corresponding to the left eye and right eye of the user; as well as The performing of the vision test operation corresponding to the target user to obtain the vision test result includes: For each display screen in the head-mounted display device, performing a vision test operation corresponding to a target eye of the target user according to a preset vision test information set to obtain a monocular vision test result corresponding to the target eye, wherein the vision test information in the vision test information set is used to be displayed on the display screen, and the target eye corresponds to the display screen; The two obtained monocular vision test results are determined as the vision test results.
3. The method according to claim 1, wherein The head-mounted display device includes two display screens corresponding to the left eye and right eye of the user; as well as The performing of the vision test operation corresponding to the target user includes: Scanning and modeling the current space using the camera of the head-mounted display device to obtain a three-dimensional space model; Determine a target point in the three-dimensional space model as an anchor point; placing a preset vision test information set at the position of the anchor point in the three-dimensional space model; Generate a vision test result based on the target user's interactive operation information on the vision test information set.
4. The method according to claim 1, wherein The triggering of the eye dynamic training operation to obtain the dynamic training accuracy includes: determining the first first display object information in a preset first display object information sequence as the target first display object information, wherein the size information of each display object corresponding to the first display object information sequence is arranged in descending order; According to the target first display object information, the following first dynamic training steps are performed: Generate a preset number of first display objects according to the target first display object information, wherein the direction information of each generated first display object is random; determining a first current error number and a first total error number according to the direction selection information of the preset number of first display objects displayed corresponding to the target user and the respective direction information; In response to determining that the first total number of errors does not satisfy a preset error number condition, and the target first display object information and the first current number of errors do not satisfy a preset end condition, updating the target first display object information based on the first current number of errors and the preset number, and performing the first dynamic training step again based on the updated target first display object information; A dynamic training accuracy rate is generated according to the direction selection information corresponding to the target user and the direction information of the displayed objects.
5. The method according to claim 4, wherein The performing of the following first dynamic training step further includes: In response to determining that the first total error count satisfies the preset error count condition, determining the first second display object information in a preset second display object information sequence as the target second display object information, wherein the display object size information corresponding to the second display object information sequence is arranged in descending order, and the display object size range corresponding to the second display object information sequence includes the display object size range corresponding to the first display object information sequence; According to the target second display object information, the following second dynamic training steps are performed: generating a second display object according to the target second display object information, wherein direction information of the generated second display object is random; determining a second current error number and a second total error number according to the direction selection information of the target user corresponding to the second display object and the direction information of the second display object; In response to determining that the second total number of errors does not meet the preset error number condition and the target second display object information does not meet the preset end condition, the target second display object information is updated according to the second current number of errors, and the second dynamic training step is performed again according to the updated target second display object information.
6. The method according to claim 5, wherein: The performing of the following second dynamic training step further includes: In response to determining that the second total error count satisfies a preset error count condition, determining first third display object information in a preset third display object information sequence as target third display object information, wherein the third display object information sequence corresponds to a first preset display path, and the display object size range corresponding to the third display object information sequence includes the display object size range corresponding to the first display object information sequence; According to the target third display object information, perform the following third dynamic training steps: generating a third display object according to the target third display object information, wherein the direction information and size information of the generated third display object are random; determining a third total number of errors according to the direction selection information of the target user corresponding to the third display object and the direction information of the third display object; In response to determining that the third total number of errors does not satisfy a preset error number condition and the target third display object information does not satisfy a preset end condition, the third display object information next to the target third display object information in the third display object information sequence is used as the target third display object information, and the third dynamic training step is performed again based on the updated target third display object information.
7. The method according to claim 6, wherein: The performing of the following third dynamic training step further includes: In response to determining that the third total error count satisfies a preset error count condition, determining first fourth display object information in a preset fourth display object information sequence as target fourth display object information, wherein the fourth display object information sequence corresponds to a second preset display path, the second preset display path is in a reverse order to the first preset display path, and the display object size range corresponding to the fourth display object information sequence includes the display object size range corresponding to the first display object information sequence; According to the target fourth display object information, perform the following fourth dynamic training steps: generating a fourth display object according to the target fourth display object information, wherein the direction information and size information of the generated fourth display object are random; determining a fourth total number of errors according to the direction selection information of the fourth display object displayed corresponding to the target user and the direction information of the fourth display object; In response to determining that the fourth total number of errors does not meet the preset error number condition and the target fourth display object information does not meet the preset end condition, the fourth display object information next to the target fourth display object information in the fourth display object information sequence is used as the target fourth display object information, and the fourth dynamic training step is performed again based on the updated target fourth display object information.
8. The method according to claim 7, wherein: The performing of the following fourth dynamic training step further includes: In response to determining that the fourth total error number meets the preset error number condition, performing the following fifth dynamic training step: generating a fifth display object within a preset display object size range, wherein the position information, direction information and size information of the generated fifth display object are random; determining a fifth total number of errors according to the direction selection information of the fifth display object displayed corresponding to the target user and the direction information of the fifth display object; In response to determining that the fifth total error number does not meet the preset error number condition and the number of generated fifth display objects is less than the preset number, the fifth dynamic training step is performed again.
9. The method according to claim 8, wherein The performing of the following fifth dynamic training step further includes: In response to determining that the fifth total number of errors meets a preset error number condition or the fifth dynamic training step is completed, video content is played in the head-mounted display device.
10. The method according to claim 4, wherein: Before determining a first current error count and a first total error count based on the direction selection information of the preset number of first display objects displayed corresponding to the target user and the respective direction information, the method further includes: For each of the preset number of first display objects, perform the following steps: Displaying the first display object in a first preset display mode at a center position of a display space of the head-mounted display device; Receive direction selection information fed back by the target user with respect to the first display object.
11. The method according to claim 10, wherein: The head-mounted display device includes a head-mounted display device body and a smart terminal; and The receiving direction selection information fed back by the target user with respect to the first display object includes: In response to detecting a selection operation on a direction key on a smart terminal, a direction identifier corresponding to the selected direction key is determined as direction selection information corresponding to the first display object, wherein the smart terminal is communicatively connected to the head-mounted display device body.
12. The method according to claim 2, wherein: Prompting the target user to adjust the diopter according to the first vision test result includes: Displaying the monocular vision test result corresponding to the left eye included in the first vision test result on the left side of the display space of the head-mounted display device; Displaying the monocular vision test result corresponding to the right eye included in the first vision test result on the right side of the display space of the head-mounted display device; In response to detecting a diopter adjustment operation of the target user, a real-time diopter corresponding to the diopter adjustment operation is displayed in the display space, wherein the real-time diopter is displayed on a side of an eye corresponding to the diopter adjustment operation in the display space.
13. The method according to claim 12, wherein: Prompting the target user to adjust the diopter according to the first vision test result further includes: A preset vision test chart and reference adjustment prompt information corresponding to the preset vision test chart are displayed in the display space.
14. The method according to claim 12, wherein: Before triggering the execution of the eye dynamic training operation in response to determining that the diopter adjustment corresponding to the first vision test result is completed and obtaining the dynamic training accuracy, the method further includes: In response to detecting a selection operation on a target key on the smart terminal, it is determined that the diopter adjustment corresponding to the first vision test result is completed.
15. The method according to any one of claims 1 to 14, wherein: Before providing a diopter adjustment prompt based on the target diopter and the diopter of the head-mounted display device, the method further includes: In response to determining that the mode of the head mounted display device is the eye protection mode, an eye protection mode description operation is performed.
16. A head-mounted display device comprising: one or more processors; at least one display screen for forming an image in front of the user's eyes; A diopter adjustment mechanism for adjusting the user's diopter corresponding to the image formed on each display screen; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 15.
17. The head-mounted display device according to claim 16, wherein: The head-mounted display device includes a head-mounted display device body and a smart terminal, and the smart terminal is communicatively connected to the head-mounted display device body.
18. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 15 is implemented.
Citation Information
Patent Citations
Eye movement-based vision training system, intelligent terminal and head-wearing device
CN107028738A
System for exercising eyesight through digital zoom VR glasses
CN107789168A
Training method and device for improving eyesight
CN110721059A
Working method for testing visual training intelligent glasses effect through intelligent visual chart
CN115227195A
AR / VR head-mounted device and method for vision adjustment training
CN116712306A