Eye regulation ability examination method and equipment based on virtual reality

Abstract

The invention relates to a virtual reality-based eye regulation ability examination method and device, and the method comprises the steps: constructing a VR environment containing a virtual target after detecting that a patient wears a VR device; recording eye movement data generated when the patient watches the virtual target in the VR environment; and inputting the eye movement data into a pre-trained eye regulation ability evaluation model, and outputting an eye regulation ability evaluation result. And the VR technology can provide immersive and personalized visual experience, so that the examination process is simplified, and the adaptability of the patient can be improved. By inputting the eye movement data generated when the patient watches the virtual target in the VR environment into the pre-trained eye regulation ability evaluation model, an accurate evaluation result of the eye regulation ability of the patient can be obtained, and the examination precision is improved.

Description

Technical Field

[0001] The present application relates to the technical field of ophthalmic medical equipment, and in particular to a method and equipment for checking eye accommodation ability based on virtual reality. Background Art

[0002] The accommodation test is a test used to evaluate the eye's ability to adjust. The eye's accommodation ability refers to the eye's ability to adjust its focus to ensure that objects are clearly visible according to changes in the distance of the object. This ability is mainly controlled by the eye's ciliary muscle, which can change the shape of the lens to achieve the focus of near and far objects. The accommodation test is often used to diagnose visual problems such as myopia, hyperopia, presbyopia (senile hyperopia), especially in the case of eye fatigue, headache or blurred vision, to help understand whether the eye's accommodation ability is normal.

[0003] Traditional eye accommodation ability testing relies on physical sight marks, glasses and other manual tools, which is not only time-consuming and labor-intensive, but also subject to human error. Summary of the invention

[0004] In order to at least to some extent overcome the problem that the eye accommodation ability examination in the related art relies on physical sight marks, glasses and other manual tools, which is not only time-consuming and labor-intensive but may also be affected by human errors, the present application provides an eye accommodation ability examination method and device based on virtual reality.

[0005] The scheme of this application is as follows:

[0006] According to a first aspect of an embodiment of the present application, a method for checking eye accommodation ability based on virtual reality is provided, comprising:

[0007] After detecting that the patient is wearing the VR device, a VR environment including a virtual target is constructed;

[0008] Recording eye movement data generated by the patient when looking at the virtual target in the VR environment;

[0009] The eye movement data is input into a pre-trained eye accommodation ability assessment model, and an eye accommodation ability assessment result is output.

[0010] Preferably, constructing a VR environment including a virtual target includes:

[0011] VR environments with different virtual target layouts are constructed one by one.

[0012] Preferably, constructing VR environments with different virtual target arrangement modes in sequence includes:

[0013] Constructing a first VR environment, wherein the first VR environment includes a plurality of virtual targets at different distances and arranged from near to far;

[0014] Constructing a second VR environment, wherein the second VR environment includes a virtual target at a fixed distance, and simulating the effect of a negative spherical mirror by adjusting the distance of the virtual target;

[0015] Constructing a third VR environment, wherein the third VR environment includes a virtual target at a fixed distance, and simulating the effect of a positive spherical mirror by adjusting the distance of the virtual target;

[0016] A fourth VR environment is constructed, wherein the fourth VR environment includes a plurality of virtual targets at different distances and flashing in sequence.

[0017] Preferably, the eye accommodation ability assessment model calculates the patient's eye accommodation amplitude ability based on the eye movement data generated when the patient looks at the virtual target in the first VR environment;

[0018] calculating the patient's positive relative accommodation ability according to eye movement data generated when the patient looks at the virtual target in the second VR environment;

[0019] calculating the negative relative accommodation ability of the patient according to the eye movement data generated when the patient looks at the virtual target in the third VR environment;

[0020] calculating the patient's eye accommodation flexibility according to the eye movement data generated when the patient looks at the virtual target in the fourth VR environment;

[0021] The patient's eye accommodation ability is comprehensively evaluated based on the patient's eye accommodation amplitude ability, positive relative accommodation ability, negative relative accommodation ability and eye accommodation flexibility, and the patient's eye accommodation ability evaluation result is output.

[0022] Preferably, the method further comprises:

[0023] Prepare a diagnostic report based on the patient's eye accommodation ability assessment results;

[0024] The diagnostic report includes at least: basic information of the patient, examination process, results of various examinations, results of eye accommodation ability assessment and treatment plan.

[0025] Preferably, before constructing the VR environment including the virtual target, the method further comprises:

[0026] Constructing a calibration environment including calibration points;

[0027] The patient's eye movement trajectory is recorded, and the calibration points are fitted according to the patient's eye movement trajectory.

[0028] Preferably, before inputting the eye movement data into a pre-trained eye accommodation ability assessment model, the method further comprises:

[0029] Performing noise filtering on the eye movement data by using a filtering algorithm;

[0030] The eye movement trajectory of the noise-filtered eye movement data is smoothed using a smoothing algorithm.

[0031] Preferably, the method further comprises:

[0032] Collect patient feedback;

[0033] Adjust and optimize the examination process, VR environment design and eye tracking algorithm based on patient feedback

[0034] According to a second aspect of an embodiment of the present application, a virtual reality-based eye accommodation ability testing device is provided, comprising:

[0035] Processor and memory;

[0036] The processor and the memory are connected via a communication bus:

[0037] Wherein, the processor is used to call and execute the program stored in the memory;

[0038] The memory is used to store a program, and the program is at least used to execute a method for checking eye accommodation ability based on virtual reality as described in any one of the above items.

[0039] The technical solution provided by the present application may include the following beneficial effects: The virtual reality-based eye accommodation ability examination method in the present application includes: after detecting that the patient is wearing a VR device, constructing a VR environment containing a virtual target; recording the eye movement data generated when the patient looks at the virtual target in the VR environment; inputting the eye movement data into a pre-trained eye accommodation ability assessment model, and outputting the eye accommodation ability assessment result. VR technology can provide an immersive and personalized visual experience, which not only simplifies the examination process, but also improves the patient's cooperation. By inputting the eye movement data generated when the patient looks at the virtual target in the VR environment into the pre-trained eye accommodation ability assessment model, an accurate patient eye accommodation ability assessment result can be obtained, which improves the accuracy of the examination.

[0040] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0042] Figure 1It is a flowchart of a method for checking eye accommodation ability based on virtual reality provided by an embodiment of the present application;

[0043] Figure 2 It is a structural schematic diagram of an eye accommodation ability testing device based on virtual reality provided by an embodiment of the present application.

[0044] Reference numerals: processor-21; memory-22. DETAILED DESCRIPTION

[0045] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0046] Embodiment 1

[0047] Figure 1 is a flowchart of a method for checking eye accommodation ability based on virtual reality provided by an embodiment of the present application, with reference to Figure 1 , a method for checking eye accommodation ability based on virtual reality, comprising:

[0048] S11: after detecting that the patient is wearing the VR device, constructing a VR environment including a virtual target;

[0049] In practice, VR equipment equipped with high-resolution displays and built-in high-precision eye tracking sensors is used to ensure the realism of visual effects and the accuracy of eye movement data. High-performance computers are configured to meet the high computing requirements of VR applications and ensure the smoothness of the inspection process. Standardized calibration tools are used to accurately calibrate eye tracking equipment to reduce errors.

[0050] S12: Record the eye movement data generated by the patient when looking at the virtual target in the VR environment;

[0051] Recording eye movement data in a virtual reality (VR) environment usually requires the use of specialized eye tracking technology, such as the Tobii Pro VR eye tracker, Pupil Labs eye tracking solution, and Fove eye tracking helmet.

[0052] S13: Input the eye movement data into a pre-trained eye accommodation ability evaluation model, and output the eye accommodation ability evaluation result.

[0053] In this technical solution, a machine learning algorithm is used to deeply mine eye movement data and train an intelligent model that can automatically identify and evaluate eye accommodation ability, providing doctors with an auxiliary diagnostic tool.

[0054] It should be noted that the adjustment ability check is usually carried out in the following ways:

[0055] Accommodation response test: This test checks the eye's ability to adjust its focus by having the person look at objects at different distances (for example, text up close and an object far away).

[0056] Accommodative range test: Measures the range of eye accommodation from far to near, usually using text or patterns at close range, and records the clear visual range.

[0057] Accommodation speed test: Assess the speed and efficiency of eye adjustment by rapidly switching between near and far objects.

[0058] Based on this, the present technical solution sequentially constructs VR environments with different virtual target layouts.

[0059] Specifically, VR environments with different virtual target layouts are constructed in sequence, including:

[0060] Constructing a first VR environment, wherein the first VR environment includes a plurality of virtual targets at different distances and arranged from near to far;

[0061] Constructing a second VR environment, the second VR environment includes a virtual target at a fixed distance, and simulating the effect of a negative spherical mirror by adjusting the distance of the virtual target;

[0062] Constructing a third VR environment, which includes a virtual target at a fixed distance, and simulating the effect of a positive spherical mirror by adjusting the distance of the virtual target;

[0063] A fourth VR environment is constructed, wherein the fourth VR environment includes a plurality of virtual targets at different distances and flashing in sequence.

[0064] In this technical solution, by constructing different virtual target arrangements (such as different distances, simulated positive and negative lenses, etc.), the patient's eye accommodation ability can be comprehensively evaluated from different angles. Specifically:

[0065] The first VR environment simulates normal near and far adjustment;

[0066] The second VR environment simulates the accommodation response of the negative spherical mirror;

[0067] The third VR environment simulates the adjustment response of a positive spherical mirror;

[0068] The fourth VR environment tests eye accommodation flexibility by flickering targets.

[0069] Furthermore, the eye accommodation ability assessment model calculates the patient's eye accommodation amplitude ability based on the eye movement data generated when the patient looks at the virtual target in the first VR environment;

[0070] Calculate the patient's positive relative accommodation ability based on the patient's eye movement data generated when the patient looks at the virtual target in the second VR environment;

[0071] The negative relative accommodation ability of the patient is calculated based on the eye movement data generated when the patient looks at the virtual target in the third VR environment;

[0072] Calculating the patient's eye adjustment flexibility based on the eye movement data generated when the patient looks at the virtual target in the fourth VR environment;

[0073] The patient's eye accommodation ability is comprehensively evaluated based on the patient's eye accommodation amplitude ability, positive relative accommodation ability, negative relative accommodation ability and eye accommodation flexibility, and the patient's eye accommodation ability evaluation result is output.

[0074] In this technical solution, multiple virtual targets at different distances are created in the first VR environment, arranged from near to far, to simulate the visual distance changes in the real world. The actual distance d of the virtual target is automatically converted into diopter D (D = 1 / d, unit: meter) to achieve the simulation of adding and subtracting spherical mirrors. The eye movement data of the patient when looking at targets at different distances is recorded, and the patient's eye adjustment amplitude ability, that is, the range of diopter changes between targets at different distances, is calculated.

[0075] In the second VR environment, a virtual target with a fixed distance was created, and the effect of the negative spherical lens was simulated by adjusting the distance of the virtual target (D negative = D target + ΔD negative, where ΔD negative is the increased negative spherical lens diopter). The patient's eye movement data at different negative spherical lens diopters were recorded, and the positive relative accommodation ability was calculated.

[0076] In the third VR environment, a virtual target with a fixed distance was created, and the effect of a positive spherical lens was simulated by adjusting the distance of the virtual target (Dpositive = Dtarget - ΔDpositive, where ΔDpositive is the increased positive spherical lens diopter). The eye movement data of the patient at different positive spherical lens diopters were recorded, and the negative relative accommodation ability was calculated.

[0077] In the fourth VR environment, multiple virtual targets with different distances and flashing in sequence were created, and the patients were asked to quickly switch their gaze between these targets to simulate the visual switching in the real world. The actual distance d of the virtual target was automatically converted into diopter D. The eye movement data of the patients when they quickly switched their gaze to targets at different distances were recorded, and specific indicators of accommodation flexibility were calculated, including accommodation speed, accommodation amplitude, and accommodation accuracy.

[0078] In this technical solution, the above data are integrated through the eye accommodation ability evaluation model to obtain the patient's overall eye accommodation ability, avoid evaluation based on a single indicator, and provide a more scientific diagnostic result.

[0079] It should be noted that the method also includes:

[0080] Prepare a diagnostic report based on the patient's eye accommodation ability assessment results;

[0081] The diagnostic report shall at least include: basic information of the patient, examination process, results of various examinations, results of eye accommodation ability assessment and treatment plan.

[0082] This technical solution summarizes the above-mentioned examination results, combines clinical standards and existing research data, and conducts a comprehensive assessment of the patient's eye accommodation ability to determine whether it is within the normal range. Prepare a detailed diagnostic report, including the patient's basic information, examination process, various examination results, eye accommodation ability assessment results and treatment plan. In the report, charts and images are used to intuitively display the eye movement trajectory, the trend of changes in the adjustment amplitude, and the error distribution, which is convenient for doctors to understand and analyze. Based on the evaluation results, the report can comprehensively present the patient's examination process, results and diagnostic recommendations, and enhance communication between doctors and patients. Includes a detailed assessment of eye accommodation ability, as well as targeted treatment plans to ensure the personalization of the treatment plan.

[0083] It should be noted that before constructing the VR environment including the virtual target, the method further includes:

[0084] Constructing a calibration environment including calibration points;

[0085] The patient's eye movement trajectory is recorded, and the calibration points are fitted according to the patient's eye movement trajectory.

[0086] This technical solution requires the VR device to be calibrated before implementation. The patient is required to wear the VR device and look at a series of predefined calibration points. The eye movement trajectory is recorded through the built-in sensor, and the calibration points are fitted using the least squares method to ensure the accuracy of the eye tracking data.

[0087] Before collecting eye movement data, we create a calibration environment and record the eye movement trajectory to fit the correct eye position and movement trajectory, thereby eliminating equipment errors and external interference. The calibrated system can provide more accurate eye movement data in subsequent tests to ensure the accuracy of the evaluation.

[0088] It should be noted that before inputting the eye movement data into the pre-trained eye accommodation ability assessment model, the method further includes:

[0089] Noise filtering of eye movement data is performed through filtering algorithms;

[0090] The eye movement trajectory of the noise-filtered eye movement data is smoothed using a smoothing algorithm.

[0091] In practice, advanced filtering algorithms such as Kalman Filter are used to filter noise from eye movement data to improve data accuracy. Smoothing algorithms such as Moving Average are used to smooth eye movement trajectories.

[0092] Eye movement data may be affected by environmental noise or the device itself during the collection process. The data is filtered using a filtering algorithm, and data fluctuations are eliminated using a smoothing algorithm to obtain a more accurate eye movement trajectory. This can improve the accuracy of subsequent eye adjustment ability assessment.

[0093] It should be noted that the method also includes:

[0094] Collect patient feedback;

[0095] Adjust and optimize the examination process, VR environment design and eye tracking algorithm based on patient feedback.

[0096] The patient's experience during the examination has a potential impact on the evaluation results. By collecting patient feedback, it is possible to identify possible problems in the examination process and make adjustments, such as modifying the VR environment settings, adjusting the eye tracking algorithm, etc., to improve the overall examination quality. This technical solution establishes a patient feedback mechanism to collect patients' opinions and suggestions on the examination process. Based on patient feedback, the examination process, virtual scene design, and eye tracking algorithm are continuously adjusted and optimized to improve patient comfort and satisfaction.

[0097] VR technology can provide an immersive and personalized visual experience, which not only simplifies the examination process, but also improves the patient's cooperation. By inputting the eye movement data generated by the patient's gaze at a virtual target in a VR environment into a pre-trained eye accommodation ability assessment model, accurate patient eye accommodation ability assessment results can be obtained, improving the accuracy of the examination.

[0098] In summary, in this technical solution, the method for checking eye accommodation ability based on virtual reality (VR) simulates visual scenes at different distances by creating targets in a virtual environment. After the patient wears the VR device, he can adjust the focus in the virtual environment to test his eye accommodation ability. Compared with traditional paper myopia charts or optical accommodation devices, VR technology can simulate more diverse scenes, provide a visual experience closer to real life, and avoid the limitations of traditional methods.

[0099] When the patient looks at a virtual target in a VR environment, the eye movement data will be recorded in real time and input into a pre-trained eye accommodation ability assessment model. The automatic collection and processing of eye movement data makes the diagnosis process more scientific and objective. It avoids the influence of human factors and can more accurately assess the eye's accommodation ability, especially when comprehensively evaluating multi-dimensional eye accommodation in a short period of time.

[0100] Traditional eye adjustment examinations are usually evaluated through subjective judgment by ophthalmologists or manual input of data, and are easily interfered with by the outside world. However, eye tracking technology, combined with the VR environment, can accurately record the movement and trajectory of each eye adjustment, input these data into the evaluation model, and quickly obtain the patient's eye adjustment ability evaluation results, thereby improving diagnostic efficiency and reducing human errors.

[0101] Embodiment 2

[0102] Figure 2 is a structural diagram of a virtual reality-based eye accommodation ability testing device provided by an embodiment of the present application, with reference to Figure 2 , a virtual reality-based eye accommodation ability testing device, comprising:

[0103] Processor 21 and memory 22;

[0104] The processor 21 and the memory 22 are connected via a communication bus:

[0105] The processor 21 is used to call and execute the program stored in the memory 22;

[0106] The memory 22 is used to store a program, and the program is used to execute at least one of the eye accommodation ability testing methods based on virtual reality in the above embodiments.

[0107] The device's processor and memory complete the entire eye accommodation ability test process by executing programs. The program can control the generation of the VR environment, the collection and processing of eye movement data according to preset rules, and automatically output results based on the evaluation model. Such an automated process reduces manual intervention and improves diagnostic efficiency and data consistency.

[0108] It can be understood that the same or similar parts of the above embodiments can be referenced to each other, and the contents not described in detail in some embodiments can refer to the same or similar contents in other embodiments.

[0109] It should be noted that, in the description of this application, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of this application, unless otherwise specified, the meaning of "plurality" refers to at least two.

[0110] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0111] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0112] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0113] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0114] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0115] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0116] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for testing eye accommodation ability based on virtual reality, characterized in that: include: After detecting that the patient is wearing the VR device, a VR environment including a virtual target is constructed; Recording eye movement data generated by the patient when looking at the virtual target in the VR environment; The eye movement data is input into a pre-trained eye accommodation ability assessment model, and an eye accommodation ability assessment result is output.

2. The method according to claim 1, characterized in that Build a VR environment containing virtual targets, including: VR environments with different virtual target layouts are constructed one by one.

3. The method according to claim 2, characterized in that Construct VR environments with different virtual target layouts in turn, including: Constructing a first VR environment, wherein the first VR environment includes a plurality of virtual targets at different distances and arranged from near to far; Constructing a second VR environment, wherein the second VR environment includes a virtual target at a fixed distance, and simulating the effect of a negative spherical mirror by adjusting the distance of the virtual target; Constructing a third VR environment, wherein the third VR environment includes a virtual target at a fixed distance, and simulating the effect of a positive spherical mirror by adjusting the distance of the virtual target; A fourth VR environment is constructed, wherein the fourth VR environment includes a plurality of virtual targets at different distances and flashing in sequence.

4. The method according to claim 3, characterized in that The eye accommodation ability evaluation model calculates the patient's eye accommodation amplitude ability according to the eye movement data generated when the patient looks at the virtual target in the first VR environment; calculating the patient's positive relative accommodation ability according to eye movement data generated when the patient looks at the virtual target in the second VR environment; calculating the negative relative accommodation ability of the patient according to the eye movement data generated when the patient looks at the virtual target in the third VR environment; calculating the patient's eye accommodation flexibility according to the eye movement data generated when the patient looks at the virtual target in the fourth VR environment; The patient's eye accommodation ability is comprehensively evaluated based on the patient's eye accommodation amplitude ability, positive relative accommodation ability, negative relative accommodation ability and eye accommodation flexibility, and the patient's eye accommodation ability evaluation result is output.

5. The method according to claim 1, characterized in that The method further comprises: Prepare a diagnostic report based on the patient's eye accommodation ability assessment results; The diagnostic report includes at least: basic information of the patient, examination process, results of various examinations, results of eye accommodation ability assessment and treatment plan.

6. The method according to claim 1, characterized in that Before constructing the VR environment including the virtual target, the method further includes: Constructing a calibration environment including calibration points; The patient's eye movement trajectory is recorded, and the calibration points are fitted according to the patient's eye movement trajectory.

7. The method according to claim 1, characterized in that Before inputting the eye movement data into a pre-trained eye accommodation ability assessment model, the method further includes: Performing noise filtering on the eye movement data by using a filtering algorithm; The eye movement trajectory of the noise-filtered eye movement data is smoothed using a smoothing algorithm.

8. The method according to claim 1, characterized in that The method further comprises: Collect patient feedback; Adjust and optimize the examination process, VR environment design and eye tracking algorithm based on patient feedback.

9. A virtual reality-based eye accommodation ability testing device, characterized in that: include: Processor and memory; The processor and the memory are connected via a communication bus: Wherein, the processor is used to call and execute the program stored in the memory; The memory is used to store a program, and the program is at least used to execute the method for checking eye accommodation ability based on virtual reality as described in any one of claims 1-8.

Images