Virtual reality intelligent strabismus screening device with automatic covering

Abstract

The application provides a virtual reality intelligent strabismus screening device with automatic covering, and belongs to the technical field of medical detection equipment. The strabismus screening device comprises a host and a VR device with a shield, the VR device with a shield comprises a head-mounted VR frame, an eye movement tracking module and a shielding module, and the head-mounted VR frame is provided with a display screen; a control module of the host is used for executing a specific detection process, the specific detection process comprises a calibration program, an alternating covering method, a covering-uncovering method and a nine eye position test method; the control module is in communication connection with the display screen and is used for controlling the target transformation; the control module is in communication connection with the eye movement tracking module and is used for collecting eye movement data in the test process; and the control module is in communication connection with the shielding module and is used for controlling the shielding piece to not shield or completely shield the display screen according to the specific process. The strabismus screening device is provided with the shielding module, can better shield the human eye, and is used in cooperation with the execution of the specific detection process, so as to be beneficial to guaranteeing the diagnosis precision.

Description

Technical Field

[0001] The present application relates to the technical field of medical detection equipment, and in particular to a virtual reality intelligent strabismus screening device with automatic masking. Background Art

[0002] Strabismus is a common eye condition with a prevalence of 4%. It can cause the patient's eyes to be unable to accurately focus on the same object simultaneously, resulting in visual disharmony, blurred vision, double vision, and other problems, seriously impacting patients' daily lives, work, and studies. Therefore, timely and effective strabismus diagnosis is crucial for its prevention and treatment.

[0003] Currently, traditional strabismus diagnosis is basically performed by doctors with the assistance of tools such as synoptophores, latent strabismometers, and prisms. This method has low efficiency and automation, and a large workload. It occupies a large amount of medical resources, and the accuracy of the examination is highly dependent on the doctor's long-term experience accumulation, resulting in the diagnosis of strabismus being often subjective.

[0004] With the continuous development of VR technology, its unique advantages and potential in the field of strabismus screening are gradually being demonstrated. By simulating a virtual environment and creating an immersive experience, VR allows patients to independently complete strabismus diagnosis without visiting a hospital, improving portability while saving significant medical resources. Furthermore, VR significantly increases patient engagement and enables timely recording and analysis of diagnostic data, providing a more reliable basis for strabismus screening results.

[0005] However, relying solely on VR cannot meet all the needs of strabismus screening. For example, when performing the alternating cover method, it is not possible to effectively block the human eye, and light leakage and light transmission often occur, interfering with strabismus screening. Summary of the Invention

[0006] The purpose of this application is to provide a virtual reality intelligent strabismus screening device with automatic masking. The VR device with masking can better achieve the masking of human eyes, and at the same time cooperate with the execution of specific detection processes, which is conducive to ensuring diagnostic accuracy.

[0007] The embodiment of the present application is implemented as follows:

[0008] The embodiment of the application provides a virtual reality intelligent strabismus screening device with automatic covering, which comprises a host and a VR device with covering; the VR device with covering comprises a head-mounted VR frame, an eye movement tracking module and a covering module; the head-mounted VR frame is provided with display screens corresponding to left and right eyes respectively; the eye movement tracking module corresponds to the display screens; the covering module corresponds to the display screens one by one, and the covering module comprises a fixed component, a movable component, a covering piece and a driving component; the fixed component is fixed to the head-mounted VR frame, the movable component is movably connected to the fixed component, and the covering piece is connected between the fixed component and the movable component; the driving component is in transmission connection with the movable component and is used for driving the movable component to reciprocate, so that the covering piece is switched between the states of not covering the display screens and completely covering the display screens; the control module of the host is used for executing a specific detection process, and the specific detection process comprises: sequentially executing a calibration program, an alternating covering method detection, a covering-uncovering method detection and a nine eye position test method detection; the control module is in communication connection with the display screens and is used for controlling the display screens to perform target transformation when the specific detection process is executed; the control module is in communication connection with the eye movement tracking module and is used for collecting eye movement data in a test process when the specific detection process is executed; and the control module is in communication connection with the covering module and is used for controlling the covering piece to not cover or completely cover the display screens according to the specific process when the specific detection process is executed.

[0009] In some embodiments, the covering piece is a fan surface, the movable component is rotatably connected to the fixed component, and the driving component drives the movable component to swing back and forth.

[0010] In some embodiments, the fixed component comprises a support frame and a support; the support frame is fixed to the head-mounted VR frame and is located above the far-nose side of the display screens; the support is connected with the support frame, the support is longitudinally arranged and extends from above the far-nose side of the display screens to below the far-nose side; the movable component comprises an arm matched with the support, one end of the arm is rotatably connected with the upper end of the support; the covering piece is connected between the support and the arm; the driving component comprises a micro motor and a control circuit board, the micro motor and the control circuit board are both fixed to the support, the micro motor and the control circuit board are electrically connected, and the micro motor and the arm are in transmission connection.

[0011] In some embodiments, the movable component further comprises a first magnetic piece, the first magnetic piece is fixed to the free end of the arm away from the support; the head-mounted VR frame is provided with a second magnetic piece located above the near-nose side of the display screens; the first magnetic piece and the second magnetic piece are matched, so that when the arm swings to above the display screens in the direction away from the support, the first magnetic piece and the second magnetic piece are magnetically fixed.

[0012] In some embodiments, at least one of the following conditions (a) to (d) is met: (a) in the corneal light reflection method, the sight mark is located at the center of the VR visual field, simulating a distance of 5 meters from the test subject; (b) in the cover-uncover method, the sight mark is located at the center of the VR visual field, simulating a distance of 5 meters from the test subject; (c) in the alternating cover method, the sight mark is located at the center of the VR visual field, simulating a distance of 5 meters from the test subject; (d) in the nine-eye position test method, the sight mark moves in the order of the nine eye positions, staying in each position for 2 seconds, disappearing for 1 second, and then arriving at the next position.

[0013] In some embodiments, the nine eye positions are in the order of upper left visual field, upper middle visual field, upper right visual field, middle right visual field, center visual field, middle left visual field, lower left visual field, lower middle visual field, and lower right visual field.

[0014] In some embodiments, the specific detection process also includes: after completing the nine-eye position test, switching to the myopia mode, and repeatedly performing the corneal reflection method test, the cover-uncover method test, the alternating cover method test and the nine-eye position test test in sequence.

[0015] In some embodiments, the control module is also used to execute a specific data processing process, which includes: obtaining the two-dimensional coordinates of both eyes from the Unity scene; outputting the two-dimensional coordinates to Excel for analysis; taking the average of the first 20 groups of data as the reference point; calculating the distance between each subsequent coordinate point and the reference point; creating a dynamic image with time as the horizontal axis and distance as the vertical axis to visually reflect the eye movement situation; and outputting a strabismus diagnosis opinion.

[0016] The virtual reality intelligent strabismus screening device with automatic masking provided in the embodiments of the present application has at least the following beneficial effects:

[0017] By configuring an automatically controllable shielding module corresponding to the display screen, it is possible to better switch between the states of unblocked display screen and blocked display screen, and better achieve shielding of the human eye. The VR device with shielding adopts a combination of VR device and covering accessories, which can improve the interactive friendliness and portability of screening while ensuring diagnostic accuracy.

[0018] When the blocking module is used as the main auxiliary inspection accessory, a specific inspection process is adopted, with the alternating blocking method as the main basis, supplemented by other inspection methods such as the nine eye positions, and the blocking module is controlled to cover with the guiding sight mark, which can perform strabismus screening in an all-round and accurate manner.

[0019] Based on a specific detection process, further, by adjusting the VR scene, the patient's eyes can switch between far and near vision, overcoming the physiological characteristics of the eyes' near perception when seeing near, taking into account the testing of far and near vision, and conducting strabismus screening more comprehensively and accurately.

[0020] Based on a specific detection process, further, through the relevant algorithms of a specific data processing process, various physiological parameters of the eye can be output in real time and calculated and analyzed to achieve automated strabismus diagnosis. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without creative work.

[0022] Figure 1 A schematic structural diagram of a VR device with occlusion provided in an embodiment of the present application;

[0023] Figure 2 A schematic diagram of the structure of a head-mounted VR framework provided in an embodiment of the present application;

[0024] Figure 3 A schematic diagram of the structure of an active assembly provided in an embodiment of the present application and a schematic diagram of the exploded structure of each component thereof;

[0025] Figure 4 This is a schematic diagram of a VR device with occlusion provided in an embodiment of the present application in an unoccluded state;

[0026] Figure 5 A schematic diagram of a VR device with occlusion provided in an embodiment of the present application switching from an unoccluded state to an occluded state;

[0027] Figure 6 This is a schematic diagram of a VR device with occlusion in an occlusion state provided in an embodiment of the present application;

[0028] Figure 7 A flowchart of a specific detection process executed by a control module of a host in a virtual reality intelligent strabismus screening device with automatic masking provided in an embodiment of the present application;

[0029] Figure 8 This is a workflow diagram for controlling data collection in some embodiments of the present application;

[0030] Figure 9 This is a workflow diagram for controlling occlusion in some embodiments of the present application;

[0031] Figure 10 This is a flowchart of the program execution of the single chip microcomputer in some embodiments of the present application;

[0032] Figure 11This is a workflow diagram of corneal photoretinography detection in some embodiments of the present application;

[0033] Figure 12 This is a workflow diagram of the alternating cover method detection in some embodiments of the present application;

[0034] Figure 13 This is a workflow diagram of the cover-uncover method detection in some embodiments of the present application;

[0035] Figure 14 This is a workflow diagram of the nine-eye position test method in some embodiments of the present application;

[0036] Figure 15 Schematic diagram of the sequence of nine eye positions detected by the nine eye position test method in some embodiments of the present application;

[0037] Figure 16 This is a flowchart of a specific data processing process executed by the control module of the host in some embodiments of the present application.

[0038] icon:

[0039] 100- VR device with occlusion;

[0040] 110 - head-mounted VR frame; 111 - frame body; 1111 - display screen; 1112 - assembly slot; 1113 - second magnetic member; 112 - headband;

[0041] 120-infrared camera;

[0042] 130-infrared emitting tube;

[0043] 140-shielding module; 141-fixing assembly; 1411-support frame; 1412-bracket; 1412a-boss; 1412b-motor baffle; 1412c-motor mounting slot; 142-movable assembly; 1421-rotating arm; 1422-first magnetic member; 143-shielding member; 144-driving assembly; 1441-micro motor; 1442-control circuit board. DETAILED DESCRIPTION

[0044] To make the objectives, technical solutions, and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Generally, the components of the embodiments of the present application described and shown in the drawings herein can be arranged and designed in various different configurations.

[0045] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for protection, but merely represents selected embodiments of the present application. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in the present application without creative work are within the scope of protection of the present application.

[0046] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings.

[0047] In the description of this application, it should be noted that the terms "center", "up", "down", "vertical", "horizontal", "inside", "outside", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, or are the orientations or positional relationships in which the product of the application is usually placed when in use. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, they should not be understood as limitations on this application.

[0048] Furthermore, the terms “first,” “second,” “third,” etc., are merely used for distinguishing descriptions and are not to be understood as indicating or implying relative importance.

[0049] Furthermore, the terms “vertical”, “parallel”, etc. do not mean that the components are required to be absolutely vertical or parallel, but may be slightly tilted.

[0050] It should also be noted that, in the description of this application, unless otherwise expressly specified or limited, the terms "disposed," "installed," "connected," and "connected" should be understood broadly. For example, they can refer to fixed connections, detachable connections, or integral connections; they can refer to direct connections, indirect connections through an intermediate medium, or internal connections between two components. Those skilled in the art will understand the specific meanings of the above terms in this application based on the specific circumstances.

[0051] Covering method is a simple and convenient method for strabismus qualitative examination, and is the most commonly used method in clinical examination of strabismus. Covering method is usually divided into alternating covering method and covering and uncovering method. In alternating covering examination, the doctor covers one eye of the patient with a shield, and asks the patient to fixate on the target with the other eye. After 3 seconds, the shield is quickly moved to the other eye, and the movement of the eye that was just covered is observed when the covering is removed. Whether there is movement, the direction, amplitude and speed of movement are observed to check whether the patient has a strabismus. In covering-uncovering examination, the doctor covers one eye of the patient with a shield, and asks the patient to fixate on the target with the other eye. At the same time, the movement of the uncovered eye is observed. After covering for more than 3 seconds, the shield is quickly removed from the eye, and the movement of the covered eye is observed when the covering is removed. The same method is used to change the covered eye, and the movement of the two eyes is observed. In the process of strabismus screening, alternating covering and covering-uncovering methods are usually used continuously. Alternating covering should be done first, and the movement of the covered eye when the covering is removed is observed to determine whether there is strabismus and its type, and then covering-uncovering examination is performed. When covering, the movement of the uncovered eye is observed; when uncovering, the movement of the covered eye is observed to distinguish between hidden strabismus and manifest strabismus.

[0052] In addition to using a simple shield for strabismus screening, there are other instruments that can be used for strabismus screening.

[0053] Synoptophore is a device used for strabismus screening. Its principle is to detect the binocular visual function of the patient by having the patient view two different images presented in front of the two eyes simultaneously. In the implementation process, the patient views the images through the synoptophore, and the doctor can observe the eye movement of the patient, as well as the coordination and visual function of the two eyes, to preliminarily determine whether the patient has strabismus and the type and degree of strabismus.

[0054] Phoropter is also an instrument for strabismus screening, and its principle is based on binocular observation. Normally, both eyes should align with the same target to form a single visual perception. However, when there is strabismus, the eyes cannot accurately align with the same target, resulting in inconsistent images seen by the two eyes, causing visual differences. In the process of strabismus screening using phoropter, the patient observes two different images at different positions through the phoropter, and the phoropter records the eye movement, including the deflection angle of the eye and the coordination of the eye. According to the eye movement and the results of binocular observation, the phoropter can determine whether there is strabismus, as well as the type and degree of strabismus. The phoropter can also analyze and record the detected data to help doctors diagnose and develop treatment plans.

[0055] Unlike the previous two strabismus screening devices, Volk Eye Check's portability and ease of use make it a convenient and quick strabismus screening tool, particularly suitable for children and patients who require frequent screening. Its principle is based on the reflexes of the eyeball. When using Volk Eye Check for strabismus screening, the patient observes a series of images or videos through the device. At the same time, Volk Eye Check uses a built-in camera to capture the patient's eye reflections, particularly the position of the pupil and the movement trajectory of the eyeball. By analyzing the eyeball's reflection data, Volk Eye Check can determine whether the eyeball's movement trajectory is normal and whether strabismus is present. Based on the analysis results, doctors can assess the type and degree of strabismus and develop an appropriate treatment plan.

[0056] In addition to using specialized instruments to screen for strabismus, there is a more convenient and quicker method. The Terry Eye Clinic App uses the camera and screen of a mobile device to screen for strabismus by displaying specific images and guiding the user to perform eye movements. Users follow the instructions in the App to move their eyes, and the system uses the camera to monitor the user's eye movement trajectory and alignment in real time. By analyzing the coordination and stability of the eye movements, the system evaluates the user's binocular vision function and makes a preliminary judgment on whether there is a strabismus problem. This process allows users to conveniently perform self-screening for strabismus at home or elsewhere, helping to detect eye problems early and seek professional medical help.

[0057] Among the conventional detection methods mentioned above, the cover method is the most common method for strabismus screening. It requires a professionally trained doctor to correctly use the occluder to ensure the accuracy and consistency of the operation, and manual operation is more likely to cause errors in the measurement results. Since it requires the cooperation of the patient, this method is not suitable for all age groups, especially younger patients. In addition, compared with other strabismus screening methods, the use of the occluder may require more time for preparation and operation, which increases the time cost of screening.

[0058] While synoptometers and phoroptometers offer high accuracy, they lack automation, integration, and portability. Furthermore, the equipment is very expensive. The Volk Eye Check, while highly portable, suffers from low patient engagement and low accuracy. While the Terry Eye Clinic app offers a convenient method for strabismus screening, its limited patient engagement and accuracy due to testing methods and equipment requirements make it difficult to meet the precision requirements of medical strabismus screening.

[0059] To this end, this application adopts a method of combining VR equipment with covering accessories, and at the same time cooperates with the execution of specific detection processes to further improve the use of VR in the field of strabismus screening, so as to ensure diagnostic accuracy while improving its interactive friendliness and portability.

[0060] The technical solution of this application will be exemplarily described below through some embodiments.

[0061] See also Figures 1 to 3 , an embodiment of the present application provides a virtual reality intelligent strabismus screening device with automatic masking, including a host and a VR device 100 with masking.

[0062] In an embodiment of the present application, a VR device with occlusion 100 includes a head-mounted VR frame 110, an eye tracking module, and an occlusion module 140. Exemplarily, the eye tracking module includes an infrared camera 120 and an infrared emission tube 130.

[0063] The head-mounted VR frame 110 serves as the main component of the entire VR device 100 with a hood, connecting the other components. Exemplarily, the head-mounted VR frame 110 includes a frame body 111 and a headband 112. The frame body 111 is a rectangular parallelepiped structure, and the headband 112 is connected to the rear of the frame body 111. The headband 112 is adjustable to ensure that the device fits securely on the head.

[0064] The head-mounted VR frame 110 is provided with display screens 1111 corresponding to the left and right eyes respectively; wherein, the display screen 1111 is opened in the frame body 111, and the display screen 1111 can be configured with a display and other structures in a general manner of VR equipment, and the two display screens 1111 are spaced apart in the left and right directions of the head-mounted VR frame 110.

[0065] For example, the frame body 111 is provided with an assembly groove 1112 at the rear, and the assembly groove 1112 corresponds to the display screen 1111 and is used to install and fix the infrared camera 120, the infrared emitting tube 130, the shielding module 140 and other parts.

[0066] The eye tracking module corresponds to the display screen 1111. For example, the infrared camera 120, display screen 1111, and infrared emitting tube 130 are arranged in this order; that is, a corresponding infrared camera 120 and infrared emitting tube 130 are distributed on both sides of each display screen 1111. The infrared camera 120 and infrared emitting tube 130 are both provided in the head-mounted VR frame 110, and are illustratively mounted on the wall of the assembly slot 1112.

[0067] The infrared emitting tube 130 is illustratively a small and elongated cylinder; the infrared emitting tube 130 can emit infrared light and enable the infrared camera 120 to receive the reflected infrared light.

[0068] The infrared camera 120 is illustratively in the shape of a cylinder with a diameter of only a few centimeters. The infrared camera 120 can receive infrared light emitted by the infrared emitting tube 130 and transmit it to the computer to analyze eye movements.

[0069] The shielding module 140 corresponds one-to-one with the display screen 1111 and includes a fixed component 141, a movable component 142, a shielding member 143, and a driving component 144. The fixed component 141 is fixed to the head-mounted VR frame 110, illustratively fixed to the slot wall of the assembly slot 1112. The movable component 142 is movably connected to the fixed component 141, and the shielding member 143 is connected between the fixed component 141 and the movable component 142. The driving component 144 is in transmission connection with the movable component 142 and is used to drive the movable component 142 to reciprocate, so that the shielding member 143 switches between a state of not blocking the display screen 1111 and a state of completely blocking the display screen 1111.

[0070] See also Figures 4 to 6 , under the driving action of the driving assembly 144, the movable assembly 142 reciprocates between the first position and the second position. Figure 4 , when the movable assembly 142 is in the first position, the shielding member 143 does not block the corresponding display screen 1111, that is, the corresponding shielding member 143 does not block the display screen 1111; see Figure 5 When the shielding member 143 switches from the unshielded state to the shielded state, the movable assembly 142 is located between the first position and the second position, and the shielding member 143 partially shields the corresponding display screen 1111; see Figure 6 When the movable component 142 is located at the second position, the shielding member 143 completely shields the corresponding display screen 1111 .

[0071] The VR device 100 with occlusion provided in the embodiment of the present application can better switch between the states of unobstructed display screen 1111 and obstructed display screen 1111 by configuring an automatically controllable occlusion module 140 corresponding to the display screen 1111. The VR device 100 with occlusion adopts a combination of VR device and covering accessories, which can improve the interactive friendliness and portability of screening while ensuring diagnostic accuracy.

[0072] It should be noted that, in the embodiment of the present application, the method of driving the shielding member 143 is not limited, and it can be rotational drive or linear drive.

[0073] See also Figure 3 In some embodiments, the shielding member 143 is a fan, the movable component 142 is rotatably connected to the fixed component 141, and the driving component 144 drives the movable component 142 to swing back and forth.

[0074] As an example, the fixed component 141 includes a support frame 1411 and a bracket 1412; the support frame 1411 is fixed to the head-mounted VR frame 110 and is located above the distal nose side of the display screen 1111; the bracket 1412 is connected to the support frame 1411, the bracket 1412 is arranged longitudinally, and extends from above the distal nose side of the display screen 1111 to below the distal nose side; the movable component 142 includes a rotating arm 1421 matching the bracket 1412, and one end of the rotating arm 1421 is rotatably connected to the upper end of the bracket 1412; the shielding member 143 is connected between the bracket 1412 and the rotating arm 1421; the driving component 144 includes a micro motor 1441 and a control circuit board 1442, the micro motor 1441 and the control circuit board 1442 are both fixed to the bracket 1412, the micro motor 1441 and the control circuit board 1442 are electrically connected, and the micro motor 1441 and the rotating arm 1421 are transmission connected.

[0075] Support frame 1411 serves as a reference for connecting the head-mounted VR frame 110 and bracket 1412, and also supports the shielding module 140. Optionally, support frame 1411 is generally composed of simple geometric rectangular structures, with multiple screw holes for connecting to bracket 1412 via screws. Support frame 1411 is illustratively fixed to the groove wall of assembly groove 1112, and the connection is achieved by, for example, but not limited to, welding, screw connection, etc.

[0076] It should be noted that, taking the right eye as an example, support frame 1411 is located above the distal nose side of display screen 1111. That is, support frame 1411 is located to the right of display screen 1111 for the right eye and is higher than the display screen 1111 for the right eye in the vertical direction. In the embodiments of this application, other descriptions of "above the distal nose side" and "below the distal nose side" are to be understood with reference to the logic explained herein.

[0077] Bracket 1412 is generally composed of multiple rectangular parallelepipeds. Optionally, bracket 1412 is drilled with multiple screw holes for screw connection to support frame 1411. Exemplarily, bracket 1412 is provided with a boss 1412a and a motor stop 1412b on a side away from support frame 1411. Boss 1412a is exemplarily a cylindrical platform with a motor mounting slot 1412c for accommodating micromotor 1441. Motor stop 1412b seals the opening of motor mounting slot 1412c to prevent micromotor 1441 from detaching. For example, motor stop 1412b is provided with multiple screw holes for screw connection to boss 1412a.

[0078] The rotating arm 1421 is illustratively a slender rectangular parallelepiped structure with an elongated groove for holding the shielding member 143 and a hole at the top for mounting the rotating shaft. The rotating arm 1421 is connected to both the micromotor 1441 and the shielding member 143. The rotation of the micromotor 1441 drives the movement of the shielding member 143, thereby blocking and unblocking the display screen 1111.

[0079] The shielding member 143 may be a shielding member 143 or a blocking cloth, etc. For example, the shielding member 143 is a foldable, opaque, fan-shaped black paper sheet clamped between the rotating arm 1421 and the bracket 1412, and opens and closes with the driving.

[0080] The micro motor 1441 is illustratively a cylinder with an output shaft at the bottom, which is connected to the rotating arm 1421 to rotate the rotating arm 1421.

[0081] The control circuit board 1442 is illustratively a rectangular parallelepiped structure, mainly including a single-chip microcomputer minimum system and a motor drive circuit, and is connected to the micro motor 1441 to control the rotation of the micro motor 1441.

[0082] See also Figure 2 and Figure 3 In some embodiments, the movable component 142 further includes a first magnetic member 1422, which is fixed to the side of the free end of the rotating arm 1421 away from the bracket 1412; as an example, a small hole is opened at the free end of the rotating arm 1421, and the first magnetic member 1422 is a micro magnet and is embedded in the small hole at the free end of the arm.

[0083] The head-mounted VR frame 110 is provided with a second magnetic member 1113 positioned above the nose side of the display screen 1111. This second magnetic member 1113 is illustratively fixed to the wall of the mounting slot 1112. As an example, the second magnetic member 1113 is a magnet holder, which is a small rectangular block with six cylindrical holes with a diameter of 1 mm and a depth of 1 mm. Micro magnets are placed in the holes.

[0084] The first magnetic member 1422 matches the second magnetic member 1113 so that when the rotating arm 1421 swings away from the bracket 1412 and reaches above the display screen 1111, the first magnetic member 1422 and the second magnetic member 1113 are magnetically fixed. Figure 6 When the rotating arm 1421 rotates to the maximum angle and completely blocks the display screen 1111, the mutual adsorption of the first magnetic member 1422 and the second magnetic member 1113 prevents the rotating arm 1421 from falling due to gravity. The method of fixing the rotating arm 1421 is simple and effective.

[0085] In some exemplary embodiments of the present application, the assembly process of the VR device 100 with occlusion is as follows:

[0086] Step 1A: Connect the micro motor 1441 to the bracket 1412 .

[0087] Step 2A: Connect the rotating arm 1421 to the output shaft of the micro motor 1441 .

[0088] Step 3A: Connect the motor baffle 1412b to the bracket 1412.

[0089] Step 4A: Connect the control circuit board 1442 to the bracket 1412 .

[0090] Step 5A: Connect the support frame 1411 and the bracket 1412.

[0091] Step 6A: Connect the support frame 1411 to the head-mounted VR frame 110.

[0092] See also Figure 7 In an embodiment of the present application, the control module of the host is used to execute a specific detection process, which includes: executing a calibration procedure, an alternating cover method detection, a cover-uncover method detection and a nine-eye position test method detection in sequence.

[0093] The control module is in communication with the display screen 1111 and is configured to control the display screen to change visual targets when executing a specific test process. The control module is in communication with the eye tracking module and is configured to collect eye movement data during the test process when executing a specific test process. The control module is in communication with the blocking module 140 and is configured to control the blocking member to not block or completely block the display screen according to the specific process when executing a specific test process.

[0094] In some exemplary embodiments of the present application, when the eye tracking module realizes the eye movement data collection, its workflow is exemplified as follows: Figure 8 shown.

[0095] Specifically, taking the covering-uncovering method and the alternating covering method as examples, the following steps are included:

[0096] Step 1B: Power the head-mounted VR frame 110 and the shielding module 140 and initialize the system.

[0097] Step 2B: The patient wears the VR device 100 with occlusion, and enters the diagnosis virtual scene after debugging and calibration.

[0098] Step 3B: The patient looks at the guiding sight mark in front of the virtual scene.

[0099] Step 4B: Cover the left eye for about 3 seconds and then remove it. The infrared camera 120 records the movement of the left eye.

[0100] Step 5B: After covering the right eye for about 3 seconds, remove the cover and the infrared camera 120 records the right eye movement.

[0101] Step 6B: Cover the left eye for about 3 seconds, and the infrared camera 120 records the movement of the right eye.

[0102] Step 7B: The left eye is unblocked while the right eye is blocked for about 3 seconds. The infrared camera 120 records the movement of the left eye, and the system collects the position data of the eye in each frame.

[0103] Step 8B: Unblock the right eye.

[0104] Step 9B: Repeat steps 4 to 8 2-3 times.

[0105] Step 10B: The host analyzes the data and obtains a diagnosis result.

[0106] In some exemplary embodiments of the present application, the specific steps of the shading module 140 to implement shading and unshading are as follows:

[0107] Step 1C: Initially, the rotating arm 1421 is vertically downward and unobstructed. The position of the rotating arm 1421 is as follows: Figure 4 shown.

[0108] Step 2C: After the microcontroller is powered on, the GPIO, TIM and other peripheral clocks are turned on to enable the peripherals to work.

[0109] Step 3C: When blocking, change the level state of the two GPIO pins of the microcontroller that control the positive and negative terminal levels of the motor, one pin is set to high level, and the other pin is set to low level, to control the motor to rotate forward, and then control the arm 1421 to rotate upward, driving the shielding member 143 to switch the blocking state. During the process, the position of the arm 1421 is as follows: Figure 5 shown.

[0110] Step 4C: When the arm 1421 rotates upward to a horizontal position and is attracted by the magnet, both GPIO pins are set to a low level to stop the motor. The position of the arm 1421 is as follows: Figure 6 shown.

[0111] Step 5C: When removing the obstruction, change the level state of the two GPIO pins of the microcontroller that control the positive and negative terminal levels of the motor, set one to a low level and the other to a high level, control the motor to reverse, and then control the rotating arm 1421 to rotate downward, driving the blocking member 143 to achieve unblocking.

[0112] The workflow of the occlusion module 140 for implementing occlusion and deocclusion is exemplified as follows: Figure 9 shown.

[0113] Exemplarily, the control method of the shielding module 140 is as follows:

[0114] The single-chip microcomputer realizes shielding by controlling the motor, so the control of the shielding module 140 is mainly the control of the motor. The single-chip microcomputer can use the STM32F1 series, and the main peripherals used include one timing counter TIM4 and four GPIO ports, and the available pins are PB12, PB13, PB14 and PB15. Among them, PB12 and PB13 are connected with the motor of the left shielding module 140, and PB14 and PB15 are connected with the motor of the right shielding module 140. When PB12 is high and PB13 is low, the motor rotates counterclockwise to realize left eye shielding; when PB12 is low and PB13 is high, the motor rotates clockwise to realize left eye unshielding; the right eye is the same: when PB14 is high and PB15 is low, the motor rotates counterclockwise to realize right eye unshielding; when PB14 is low and PB15 is high, the motor rotates clockwise to realize right eye shielding;

[0115] The single-chip microcomputer program execution flow chart is shown in Figure 10 , mainly including the main program and the interrupt program.

[0116] The main program flow is as follows:

[0117] Step one D: power on. Power the single-chip microcomputer minimum system board, motor and motor drive circuit.

[0118] Step two D: initialization. First, initialize GPIOB GPIO_PIN_12, GPIO_PIN_13, GPIO_PIN_14 and GPIO_PIN_15 (corresponding to PB12, PB13, PB14 and PB15), set to push-pull output mode. Then configure the TIM4 peripheral, set the clock source to 72MHz, the prescaler PSC to 7200, and the automatic reload value ARR to 30000, so that TIM4 generates an interrupt every 3 seconds, and then configure the nested interrupt vector controller NVIC, open the TIM4 interrupt signal channel and set the priority. Finally, define a global variable Count, assign it a value of 0, which is used to record the number of times the interrupt is entered. Each time the interrupt is entered, the value of Count is incremented by 1.

[0119] Step three D: enable TIM4. Make TIM4 work.

[0120] Step four D: TIM4 timing 3 seconds. After TIM4 works for 3 seconds, end this round of timing and re-enter the next round of timing.

[0121] Step five D: generate interrupt. At the same time as ending the timing, set the TIM4 interrupt flag to 1 and generate an interrupt signal.

[0122] Step 5D: Enter the interrupt program. The CPU executes the interrupt program after receiving the interrupt signal request from TIM4.

[0123] The interrupt program flow is as follows:

[0124] Step 1E: Count plus 1. This indicates the countth time the interrupt routine has been entered.

[0125] Step 2E: Determine whether Count%2 is equal to 1. Count%2 is the remainder when Count is divided by 2. If the remainder is 1, it indicates an odd number of interrupts. The left eye must be blocked and the right eye must be unblocked. The process then continues with step 3. If the remainder is not 1, it indicates an even number of interrupts. The right eye must be blocked and the left eye must be unblocked. The process then continues with step 4.

[0126] Step 3E: The left motor rotates counterclockwise, and the right motor rotates counterclockwise. When the left eye is blocked and the right eye is unblocked, according to the above principle, set PB12 to high level, PB13 to low level, PB14 to high level, and PB15 to low level. Then delay for about 20 milliseconds to control the motor to rotate to the target position. Then, set these four pins to the same level to stop the motor.

[0127] Step 4E: The left motor rotates clockwise, and the right motor rotates clockwise. When the right eye is blocked and the left eye is unblocked, similarly set PB12 to low, PB13 to high, PB14 to low, and PB15 to high. Similarly, delay about 20 milliseconds to control the motors to rotate to the target position. Then, set all four pins to a level to stop the motors.

[0128] Step 5E: Determine whether Count is equal to 6. If Count is equal to 6, it means that the interruption has occurred 6 times, and the left and right eyes have been occluded 3 times each. Sufficient data has been collected, so it is necessary to stop and proceed to Step 6. If Count is not equal to 6, it means that the measurement number requirement has not been met and it is necessary to continue and proceed to Step 8.

[0129] Step 6E: The left motor rotates clockwise and the right motor rotates counterclockwise. When both the left and right eyes are unblocked, set PB12 to low, PB13 to high, PB14 to high, and PB15 to low. Similarly, delay for approximately 20 milliseconds to control the motors to rotate to the target position. Then, set all four pins to a level to stop the motors.

[0130] Step 7E: Turn off TIM4. This stops TIM4 from working and does not require entering the interrupt routine.

[0131] Step 8E: Clear the interrupt flag to prevent the program from falling into the interrupt routine.

[0132] Step 9E: End. End the execution of the interrupt program.

[0133] An exemplary illustration of the individual steps in the specific detection procedure performed by the control module of the host is shown in Figures 11 to 14 .

[0134] With regard to the calibration procedure, an exemplary includes a corneal light reflex detection. The workflow of the corneal light reflex detection is exemplary shown in Figure 11 .

[0135] As an example, the corneal light reflex detection includes the following steps:

[0136] Step one F: The patient wears the VR headset and performs the eye movement calibration procedure.

[0137] Step two F: The VR target guides the eyes to look straight ahead.

[0138] Step three F: The infrared LED is working and presents a light reflex point on the cornea.

[0139] Step four F: The camera takes a picture to capture the light reflex point position and calculates the strabismus angle based on the average eye diameter dataset.

[0140] With regard to the alternate cover test, the workflow is exemplary shown in Figure 12 .

[0141] As an example, the alternate cover test includes the following steps:

[0142] Step one I: The left barrier is lowered for 3 s while the camera records the movement of the right eye.

[0143] Step two I: The left barrier is raised while the right barrier is lowered for 3 s while the camera records the movement of the left eye.

[0144] With regard to the cover-uncover test, the workflow is exemplary shown in Figure 13 .

[0145] As an example, the cover-uncover test includes the following steps:

[0146] Left eye:

[0147] Step one G: The VR target guides both eyes to look straight ahead.

[0148] Step two G: The left cover barrier is lowered and maintained for 3 s.

[0149] Step three G: The left cover barrier is raised while the camera records the left eye movement (image analysis method).

[0150] Right eye:

[0151] Step one H: The VR target guides both eyes to look straight ahead.

[0152] Step 2H: Lower the right cover and hold it down for 3 seconds.

[0153] Step 3H: The right cover is raised, and the camera records the movement of the right eye.

[0154] Regarding the nine-eye position test method, its workflow is exemplarily as follows: Figure 14 shown.

[0155] As an example, the nine-eye position test includes the following steps:

[0156] Step 1J: Lower the cover to cover the right eye, and the VR screen continues to provide visual stimulation to the left eye.

[0157] Step 2J: The VR screen sight mark changes according to the nine eye positions to guide the movement of the eye's gaze point. At the same time, the camera records the eye movement in real time.

[0158] In an embodiment of the present application, with the shielding module 140 as the main auxiliary inspection accessory, a specific detection process is adopted, integrating the advantages of multiple inspection methods and inspection instruments, with the alternating covering method as the main basis, supplemented by other inspection methods such as the nine eye positions, and at the same time controlling the shielding module 140 to cooperate with the guide sight mark for covering, strabismus screening can be performed in an all-round and accurate manner.

[0159] Furthermore, the specific detection process also includes: after completing the nine-eye position test, switching to the myopia mode, and repeatedly performing the corneal reflection method test, the cover-uncover method test, the alternating cover method test and the nine-eye position test test in sequence.

[0160] In the above implementation scheme, by adjusting the VR scene, the patient's eyes can switch between far vision and near vision, overcoming the physiological characteristics of the eyes' near perception when seeing near, and performing strabismus screening more comprehensively and accurately.

[0161] Optionally, when performing a specific testing process, the sight marks of each testing method may refer to the following standards to facilitate more accurate strabismus screening.

[0162] As an example, in the corneal reflection method test, the sight mark is located at the center of the VR field of view, simulating a distance of 5 meters from the tester.

[0163] As an example, in the cover-uncover method test, the sight mark is located at the center of the VR field of view, simulating a distance of 5 meters from the tester.

[0164] As an example, in the alternating cover method test, the sight mark is located at the center of the VR field of view, simulating a distance of 5 meters from the tester.

[0165] As an example, in the nine-eye position test, the sight mark moves in the order of the nine eye positions, staying in each position for 2 seconds, disappearing for 1 second, and then moving to the next position.

[0166] Among them, reference Figure 15 For example, the order of the nine eye positions is upper left field of view, upper middle field of view, upper right field of view, middle right field of view, center field of view, middle left field of view, lower left field of view, lower middle field of view and lower right field of view.

[0167] It should be noted that in the above-mentioned sight mark selection, the position of the sight mark and the distance from the simulated distance tester are allowed to have appropriate error fluctuations. For example, the center of the visual field should be a small circular area rather than a point. The simulated distance from the tester is, for example, 5m±0.1m, 5m±0.2m, etc.

[0168] In addition, in an embodiment in which the specific detection process further includes switching to a myopia mode, illustratively, the selection criteria of the above-mentioned sight mark are the criteria before switching to the myopia mode.

[0169] See also Figure 16 In some implementation schemes, the control module is also used to execute a specific data processing process, which includes: obtaining the two-dimensional coordinates of both eyes from the Unity scene; outputting the two-dimensional coordinates to Excel for analysis; taking the average of the first 20 groups of data as the reference point; calculating the distance between each subsequent coordinate point and the reference point; creating a dynamic image with time as the horizontal axis and distance as the vertical axis to visually reflect the eye movement situation; and outputting a strabismus diagnosis opinion.

[0170] In the above implementation scheme, the relevant algorithms of the specific data processing flow can output various physiological parameters of the eye in real time and perform calculation and analysis on them, thereby realizing automated strabismus diagnosis.

[0171] In summary, in some exemplary embodiments of the present application, a VR device is combined with a covering accessory using a covered VR structure to ensure diagnostic accuracy while improving its interactive friendliness and portability, which can better serve simple and fast automated strabismus screening. Among them, a specific detection process and data processing process are adopted. Specifically, the alternating covering method is used as the main basis, supplemented by other inspection methods such as the nine eye positions, and a specific sight mark standard is designed to perform strabismus screening in a more comprehensive and accurate manner; Unity3D software is used to perform virtual modeling of the VR device to guide the movement trajectory of the sight mark in the strabismus screening scene to simulate strabismus screening in a real scene. Various physiological parameters of the eyeball can be output in real time and calculated and analyzed to achieve automated strabismus diagnosis. Furthermore, by adjusting the VR scene, the patient's eyes can switch between far and near vision, overcoming the physiological characteristics of the eye's near perception when looking near, taking into account the testing of far and near vision, and performing strabismus screening in a more comprehensive and accurate manner.

[0172] The above description is merely a preferred embodiment of the present application and is not intended to limit the present application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present application shall be included within the scope of protection of the present application.

Claims

1. A virtual reality intelligent strabismus screening device with automatic masking, characterized in that: The screening device includes a host and a VR device with a shield; The VR device with occlusion includes a head-mounted VR frame, an eye tracking module, and an occlusion module; the head-mounted VR frame is provided with display screens corresponding to the left and right eyes respectively; the eye tracking module corresponds to the display screens; the occlusion module corresponds one-to-one with the display screens, the occlusion module includes a fixed component, a movable component, a occlusion member, and a driving component, the fixed component is fixed to the head-mounted VR frame, the movable component is movably connected to the fixed component, and the occlusion member is connected between the fixed component and the movable component; the driving component is in transmission connection with the movable component, and is used to drive the movable component to reciprocate, so that the occlusion member switches between a state of not blocking the display screen and a state of completely blocking the display screen; The control module of the host is used to execute a detection process, which includes: sequentially executing a calibration procedure, an alternating cover method detection, a cover-uncover method detection, and a nine-eye position test method detection; The control module is in communication with the display screen and is used to control the display screen to perform sight mark transformation when executing the detection process; The control module is in communication with the eye tracking module and is configured to collect eye movement data during the test when executing the detection process; The control module is in communication with the shielding module and is configured to control the shielding member to not shield or completely shield the display screen according to the process when executing the detection process.

2. The virtual reality intelligent strabismus screening device with automatic masking according to claim 1, characterized in that: The shielding member is a fan-shaped member, the movable component is rotatably connected to the fixed component, and the driving component drives the movable component to swing back and forth.

3. The virtual reality intelligent strabismus screening device with automatic masking according to claim 2, characterized in that: The fixing assembly includes a support frame and a bracket; the support frame is fixed to the head-mounted VR frame and is located above the distal nose side of the display screen; the bracket is connected to the support frame, and the bracket is arranged longitudinally and extends from above the distal nose side of the display screen to below the distal nose side; The movable assembly includes a rotating arm matched with the bracket, and one end of the rotating arm is rotatably connected to the upper end of the bracket; The shielding member is connected between the bracket and the rotating arm; The driving assembly includes a micro motor and a control circuit board. The micro motor and the control circuit board are both fixed to the bracket. The micro motor and the control circuit board are electrically connected. The micro motor and the rotating arm are transmission-connected.

4. The virtual reality intelligent strabismus screening device with automatic masking according to claim 3, characterized in that: The movable component also includes a first magnetic component, which is fixed to the side of the free end of the rotating arm away from the bracket; the head-mounted VR frame is provided with a second magnetic component located above the nose side of the display screen; the first magnetic component is matched with the second magnetic component so that when the rotating arm is swung in a direction away from the bracket to above the display screen, the first magnetic component and the second magnetic component are magnetically fixed.

5. The virtual reality intelligent strabismus screening device with automatic masking according to claim 1, characterized in that: Satisfy at least one of the following conditions (a) to (d): (a) The calibration procedure includes a corneal photometry test, wherein the sight mark is located at the center of the VR visual field, simulating a distance of 5 meters from the test subject; (b) In the cover-uncover test, the sight mark is located at the center of the VR field of view, simulating a distance of 5 meters from the test subject; (c) In the alternating cover test, the sight mark is located at the center of the VR visual field, simulating a distance of 5 meters from the test subject; (d) In the nine-eye position test, the sight mark moves in the order of the nine eye positions, staying in each position for 2 seconds, disappearing for 1 second, and then moving to the next position.

6. The virtual reality intelligent strabismus screening device with automatic masking according to claim 5, characterized in that: The nine eye positions are in the order of upper left field of view, upper middle field of view, upper right field of view, middle right field of view, center field of view, middle left field of view, lower left field of view, lower middle field of view and lower right field of view.

7. The virtual reality intelligent strabismus screening device with automatic masking according to claim 5 or 6, characterized in that: The detection process also includes: after completing the nine-eye position test method, switching to the myopia mode, and repeatedly performing the corneal reflection method test, the cover-uncover method test, the alternating cover method test and the nine-eye position test method test in sequence.

8. The virtual reality intelligent strabismus screening device with automatic masking according to claim 1, characterized in that: The control module is also used to execute a data processing process, which includes: obtaining the two-dimensional coordinates of both eyes from the Unity scene; outputting the two-dimensional coordinates to Excel for storage and analysis; taking the average of the first 20 groups of data as the reference point; calculating the distance between each subsequent coordinate point and the reference point; creating a dynamic image with time as the horizontal axis and distance as the vertical axis to visually reflect the eye movement situation; and outputting a strabismus diagnosis opinion.

Images