Method for treating children amblyopia through combination of virtual reality and visual evoked potential

Through the combination of virtual reality headset module and EEG cap module, eye tracking and visual evoked potentials, the problems of binocular splitting training and real-time adjustment in existing amblyopia treatment equipment are solved, achieving efficient amblyopia treatment effect and user experience .

CN118902815APending Publication Date: 2024-11-08SHENYANG GUOKE BRIGHT MEDICAL TECH CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411235271.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-04
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The existing amblyopia treatment equipment lacks the binocular splitting training function, the training method is single, it cannot mobilize the enthusiasm of patients, lacks eye tracking function, and cannot adjust the treatment effect in real time. The use of EEG signal collection equipment is cumbersome and is not suitable for the head type of children, and most of them are The device only has a single function of detection or treatment, and the effect is not good.

Method used

The virtual reality headset module is combined with the EEG cap module, and the eyeball position is tracked in real time through eye movement tracking technology, combined with visual evoked potential, and the EEG signal is used for real-time detection and adjustment of treatment plans. The flexible EEG cap and dedicated EEG signal are used. Acquisition chips provide binocular splitting training and real-time treatment.

Benefits of technology

The effectiveness of binocular splitting training is achieved, the treatment effect and user experience is improved, the treatment plan can be adjusted in real time, and the head shape of different children is adapted to enhance the targetedness and effectiveness of the treatment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118902815A_ABST
    Figure CN118902815A_ABST
Patent Text Reader

Abstract

The invention discloses a method for treating children amblyopia by combining virtual reality and visual evoked potential, which comprises the following steps: starting a virtual reality head-mounted display module and an electroencephalogram cap module, and detecting whether the communication between the virtual reality head-mounted display module and the electroencephalogram cap module is normal or not; after detection is completed, the patient selects diseased eyes to be treated according to needs, selects favorite games or videos by himself / herself after the diseased eyes are selected, and watches the videos or plays the games by operating the handle module after treatment is started; the eye movement condition is tracked in real time through the virtual reality head-mounted display module, the video of the normal eye at the tracking position is fuzzified according to the eyeball position, the video of the diseased eye is normally played, and the diseased eye is trained; during training, electroencephalogram detection is carried out in real time, an instruction for starting to collect electroencephalogram data is sent through the virtual reality head display module, and the electroencephalogram cap module starts to collect according to the sent instruction. The treatment scheme is adjusted in real time, the whole process is easy and convenient to operate, and the user actual experience effect is good.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of amblyopia detection and treatment instruments, and in particular to a method for treating children's amblyopia by combining virtual reality with visual evoked potential. Background Art

[0002] There are many virtual reality devices and EEG caps on the market, but there is a lack of devices that combine virtual reality devices and EEG caps to treat children's amblyopia. Currently, digital treatments for children's amblyopia are mostly software-based, which cannot achieve a good binocular dichoptic treatment effect. In addition, the existing amblyopia detection and treatment devices have the following disadvantages:

[0003] 1. The existing amblyopia treatment equipment is relatively traditional, with limited training methods, which cannot mobilize the enthusiasm of patients and fail to achieve the expected treatment effect;

[0004] 2. During the training process, the eye tracking function is lacking, which affects the expected treatment;

[0005] 3. It is not possible to objectively evaluate the treatment effect, and therefore it is not possible to adjust the training screen in real time according to the treatment effect;

[0006] 4. Most EEG signal acquisition devices on the market use wet electrodes to collect EEG signals, which need to be used with electrode paste. The process is cumbersome and the user experience is poor;

[0007] 5. Most amblyopia-related devices on the market only have a single function of detection or treatment, and the operation and wearing process is cumbersome and the effect is poor;

[0008] 6. Most EEG caps or head frame structures on the market are designed based on the head shape of Europeans and Americans, which makes it difficult to adjust the size according to usage needs;

[0009] 7. The dry electrodes used on the market are all ordinary rigid fixed-frame EEG caps, which have poor adaptability to different brain types and greatly affect the quality of the final collected EEG signals.

[0010] Therefore, in order to solve the above problems, a method combining virtual reality with visual evoked potential to treat amblyopia in children is proposed. Summary of the invention

[0011] The purpose of the present invention is to provide a method for treating amblyopia in children by combining virtual reality with visual evoked potentials. The method uses eye tracking technology to track the position of eye gaze in real time, and treats amblyopia according to the gaze position. During treatment, a virtual reality head display module, an electroencephalogram cap module and an algorithm are used to realize real-time detection of amblyopia in children, and amblyopia treatment methods are adjusted in real time and synchronously according to the detection results. The specific method steps for detecting and treating amblyopia in children include:

[0012] Step 1: Start the virtual reality head display module and the EEG cap module to check whether the communication between the virtual reality head display module and the EEG cap module is normal;

[0013] Step 2: After the test is completed, the patient selects the diseased eye to be treated according to the needs. After selecting the diseased eye, the patient selects the game or video he likes and watches the video or plays the game by operating the handle module after starting the treatment;

[0014] Step 3: Use the virtual reality head-mounted display module to track eye movements in real time, blur the video of the normal eye at the tracked position according to the eyeball position, and play the video of the diseased eye normally to train the diseased eye;

[0015] Step 4: During training, EEG detection is performed in real time, and the instruction to start collecting EEG data is sent through the virtual reality headset module. At the same time, a 7.5 Hz stimulation signal is inserted into the left eye and a 12 Hz stimulation signal is inserted into the right eye while watching the video. The EEG cap module starts collecting data according to the sent instructions and returns the collected EEG signals to the processor of the virtual reality headset module. The processor processes the EEG signals, objectively analyzes the treatment effect, and adjusts the appropriate treatment plan in real time according to the treatment effect.

[0016] Preferably, the step three is specifically:

[0017] Use the Render Feature in the programmable rendering pipeline (URP) to achieve a Gaussian blur post-processing effect, set BlurSize to control the pixel position of the sample and LerpValue to control the blending ratio. The larger the two parameters are, the blurrier the image will be. The BlurSize parameter is determined by the analysis result of the processor in the virtual display head display module (1);

[0018] Use the Unity shader graph pipeline rendering tool, add the eye index tag to determine the left and right eye images, and perform different renderings for the left and right eyes respectively, generate the materials required for viewpoint processing, and let the user input the position of the healthy eye. Add the viewpoint model in the healthy eye area, use the above processed materials, use eye tracking technology to obtain the coordinates of the center points of the two eyes and the line of sight vector, and use the Physics SphereCast function provided by Unity to calculate the coordinates of the viewpoint in real time to achieve the restriction of the healthy eye.

[0019] Preferably, the step 4 specifically includes:

[0020] The instruction to start collecting EEG data is sent through the virtual reality head display module 1. The EEG signal is collected through all channels and 50 Hz is selected as the frequency of the notch filter to remove the 50 Hz power frequency interference;

[0021] Since the frequency range of EEG signals is within 1-30Hz, bandpass filtering is selected to retain the frequency components within 30Hz. In order to enhance the real-time performance of the acquisition algorithm, the linear phase shift of the filtering algorithm needs to be considered, so IIR filters are used for high-pass filtering and low-pass filtering to ensure the linearity of the phase shift;

[0022] Since the virtual reality headset provides a good binocular dichoptic platform, a 7.5Hz stimulation signal is inserted into the left eye and a 12Hz stimulation signal is inserted into the right eye. After a period of stimulation, the collected signal is Fourier transformed into the frequency domain to observe the amplitude value at this frequency. The contrast formula is:

[0023] Contrast = Lmag / Rmag;

[0024] Where Lmag is the amplitude after Fourier transform of the left eye, and Rmag is the amplitude after Fourier transform of the right eye;

[0025] Assuming that the right eye is amblyopic, the closer the contrast is to 1, the more the visual functions of both eyes are balanced. If it is not 1, that is, the greater the difference between Rmag and Lmag, the more serious the amblyopic eye is.

[0026] The collected EEG signal is returned to the processor of the virtual reality head display module 1, and the processor adjusts the contrast of the picture according to the difference value and the blur parameter to stimulate the diseased eye nerve to achieve the treatment effect.

[0027] Preferably, the main body of the virtual reality head display module includes a head display front mask, a head display main shell, face-sticking foam, a strap, and a battery cavity; a processor is arranged inside the head display main shell; a head display front mask is arranged at the front end of the head display main shell; a color perspective camera is arranged in the middle of the head display front mask; face-sticking foam is arranged at the rear end edge of the head display main shell; rotating arms are arranged on both sides of the head display main shell, a speaker is arranged on the inner side of the rotating arm, a strap is arranged on the side of the rotating arm away from the head display main shell, a headrest foam is arranged at the rear end of the strap, a battery cavity is arranged at the rear end of the headrest foam, optical lens eye socket assemblies are arranged on both sides of the head display main shell, an eye tracking camera is arranged on the outer side below the optical lens eye socket assemblies, an infrared distance sensor is arranged above the two optical lens eye socket assemblies, a nose pad foam is arranged below the two optical lens eye socket assemblies, and a facial tracking camera is arranged in the middle of the nose pad foam.

[0028] Preferably, environment tracking cameras are respectively arranged at the upper and lower ends of both sides of the front end of the head display main shell, a status display light and a power button are respectively arranged at the upper left side of the head display main shell, and a USB-C interface is arranged at the upper right side of the head display main shell.

[0029] Preferably, a strap knob is provided at the rear of the battery cavity.

[0030] Preferably, the handle module includes two handle shells, a joystick is arranged at the center position of the front end of the handle shell, a menu key, a HOME key and a screenshot key are arranged circumferentially at the rear end of the joystick, grip keys are arranged on the inner sides of the two handle shells, the front and rear ends of the two handle shells are respectively connected to the two ends of the tracking halo, an infrared LED light circuit is arranged inside the tracking halo, a trigger key is arranged at the front end of the back of the two handle shells, and a battery box is arranged at the rear end of the back of the two handle shells.

[0031] Preferably, the EEG cap module comprises a flexible frame, an electrode module, and an EEG information acquisition module, wherein the electrode module is arranged on the flexible frame, and the EEG information acquisition module is arranged above the rear end of the flexible frame;

[0032] The flexible frame is formed into a helmet shape by a plurality of transverse flexible belts, and the two ends of each transverse flexible belt are respectively connected to the transverse length adjustment fixing nodes arranged at the corresponding positions on the two ear limiting belts, and the middle positions of the plurality of transverse flexible belts are fixedly connected to the vertical flexible belt through a fixed head module, and the lower parts of the two ear limiting belts are respectively connected to the two ends of the mandibular elastic adjustment belt through the mandibular elastic adjustment fixing nodes;

[0033] The electrode module comprises an electrode head and a dry electrode, and the electrode head and the dry electrode are fixed on a transverse flexible belt by threaded connection;

[0034] The EEG information acquisition module includes two fixed arms, a bracket, and a biological signal EEG information acquisition board. The two fixed arms are respectively installed in holes opened at the upper and lower ends of both sides of the bracket. The biological signal EEG information acquisition board is fixedly installed on the bracket. The EEG information acquisition module is fixed to the fixed anchor point opened at the rear end of the vertical flexible belt through the two fixed arms.

[0035] Preferably, a plurality of the fixed head modules are provided, each of which comprises a fixed head and a fixed head assembly, and each of the fixed head and the fixed head assembly is respectively threadedly connected at the connection between each transverse flexible belt and the vertical flexible belt.

[0036] Preferably, the device used in the method also includes a hardware part, which includes an EEG acquisition chip, a single-chip microcomputer and a Bluetooth module. The EEG acquisition chip is electrically connected to the EEG information acquisition module, the EEG acquisition chip is electrically connected to the single-chip microcomputer, the single-chip microcomputer is electrically connected to the Bluetooth module, and the Bluetooth module is electrically connected to the virtual reality head display module.

[0037] Compared with the prior art, the present invention has the following beneficial effects:

[0038] 1. The present invention combines a virtual display head-mounted display module with an EEG cap module, performs binocular vision training through images output by the virtual reality head-mounted display module, and directly trains the diseased eye. During this training process, the EEG information acquisition board in the EEG cap module collects EEG signals from the occipital lobe visual area, and transmits the collected EEG signals to the processor of the virtual reality head-mounted display module for analysis. The treatment plan is adjusted in real time according to the analysis results. The whole process is easy to operate, and the user actually experiences good results and good treatment effects.

[0039] 2. The present invention adopts eye tracking technology and uses an eye tracking camera to capture the eyeball and line of sight in real time and accurately. During the treatment process, everything the patient sees will be captured in real time by the eye tracking camera, which is convenient for subsequent training of the diseased eye alone. In addition, the virtual reality head display module is also equipped with an environmental tracking camera, which can achieve spatial tracking and positioning effects. It has many interesting games and animated movies built in. While watching, the handle module can be manipulated to interact with them in real time, giving patients a full range of immersive entertainment experience.

[0040] 3. The present invention adopts steady-state visual evoked potential, which can compare and evaluate the normal eye and the amblyopic eye and is not easily interfered by human factors such as blinking, eye movement, and myoelectric noise.

[0041] 4. The present invention adopts a dedicated EEG signal acquisition chip ADS1299 to collect full-band EEG signals, and can collect multiple channels in real time; adopts IIR software filtering, and the filter design ensures linear phase without changing the relationship between the various components of the signal; adopts C# to collect EEG signals in real time and Fourier transform, compares the amplitude values ​​of both eyes at a fixed stimulation frequency, and dynamically adjusts the treatment plan according to the proportional relationship of the amplitude value feedback of both eyes.

[0042] 5. The present invention adopts a flexible EEG cap. The fabric used to fix the dry electrodes is a flexible elastic cloth belt. The dry electrode seat is embedded in these elastic cloth belts. When the flexible belts are tightened, the flexible belts will automatically adapt to wrap the head according to the child's head shape. The electrodes will be tightly attached to the scalp, and the fit will be better than that of ordinary rigid fixed frame EEG caps. The flexible frame is equipped with adjustment holes, and the length of the horizontal flexible belt can be adjusted arbitrarily, which can better adapt to the brain shapes of different children.

[0043] 6. The flexible fixing belt of the present invention is provided with circular hole anchor points for installing the electrode holder every 2 cm. Users can configure the positions of different electrode layouts according to their own needs and collect EEG information from different parts for later analysis and research. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 It is a schematic diagram of the overall structure of the present invention;

[0045] Figure 2 It is a structural schematic diagram of a virtual reality head display module of the present invention;

[0046] Figure 3 is a side view of a virtual reality head display module of the present invention;

[0047] Figure 4 It is a schematic diagram of the internal structure of the virtual reality head display module of the present invention;

[0048] Figure 5 is a structural schematic diagram of a handle module of the present invention;

[0049] Figure 6 is a side view of the handle module of the present invention;

[0050] Figure 7 It is a structural schematic diagram of the EEG cap module of the present invention;

[0051] Figure 8 is a side view of the EEG cap module of the present invention;

[0052] Fig. 9 is a top view of the EEG cap module of the present invention;

[0053] Fig.10 It is an exploded view of the flexible belt and the fixed head module of the EEG cap module of the present invention;

[0054] Fig.11 It is a partial enlarged view of the ear limiting belt of the present invention;

[0055] Fig.12 It is a partial enlarged view of the mandibular elastic adjustment band of the present invention;

[0056] Fig.13 It is a partial enlarged view of the mandibular tightness adjustment fixing section of the present invention;

[0057] Fig.14 is an exploded view of the electrode module of the present invention;

[0058] Fig.15 It is a schematic diagram of the connection structure of the EEG information acquisition module of the present invention;

[0059] Fig.16 It is a structural schematic diagram of the EEG information acquisition module of the present invention;

[0060] Fig.17 This is a schematic diagram of the structure of the acquisition control system of the present invention. Figure 1 ;

[0061] Fig.18 This is a schematic diagram of the structure of the acquisition control system of the present invention. Figure 2 ;

[0062] Fig.19 It is the overall workflow diagram of the present invention;

[0063] Fig. 20 It is a flow chart of EEG data processing of the present invention.

[0064] The reference numerals and names in the figures are as follows:

[0065] 1. Virtual reality head display module; 101. Status indicator light; 102. Power button; 103. Color perspective camera; 104. Head display front mask; 105. Head display main shell; 106. Face-fitting foam; 107. Strap; 108. Strap knob; 109. Battery cavity; 110. Headrest foam; 111. Rotating arm; 112. USB-C interface; 113. Environment tracking camera; 114. Eye tracking camera; 115. Speaker; 116. Optical lens eye socket assembly; 117. Infrared distance sensor; 118. Facial tracking camera; 119. Nose pad foam;

[0066] 2. Handle module; 201. Joystick; 202. Menu key; 203. HOME key; 204. Handle housing; 205. Grip key; 206. Screen capture key; 207. Trigger key; 208. Battery box; 209. Tracking halo;

[0067] 3. EEG cap module; 301. Flexible frame; 3011. Horizontal flexible belt; 3012. Fixed head module; 30121. Fixed head; 30122. Fixed head assembly; 3013. Vertical flexible belt; 3014. Horizontal length adjustment fixing section; 3015. Ear limiting belt; 3016. Mandibular tightness adjustment fixing section; 3017. Mandibular tightness adjustment belt; 302. Electrode module; 3021. Electrode head; 3022. Dry electrode; 303. EEG information acquisition module; 3031. Fixed arm; 3032. Bracket; 3033. Bio-signal EEG information acquisition board. DETAILED DESCRIPTION

[0068] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0069] As attached Figure 1As shown, a method for treating amblyopia in children by combining virtual reality and visual evoked potential provided by the present invention comprises a virtual reality head display module 1, a handle module 2, and an electroencephalogram cap module 3. The training of binocular dichoptic coordination and contrast balance is realized through the virtual reality head display module 1. The virtual reality head display module 1 dichoptically displays the training of the amblyopic eye through games or videos to improve the amblyopia effect. The operator controls the handle module 2 to operate the movies, games and other programs displayed on the virtual reality head display module 1.

[0070] As attached Figure 2-4 As shown, the main body of the virtual reality head display module 1 includes a head display front mask 104, a head display main shell 105, a face-sticking foam 106, a strap 107, and a battery cavity 109. A processor is arranged inside the head display main shell 105. The front end of the head display main shell 105 is provided with a head display front mask 104, and the rear end edge of the head display main shell 105 is provided with a face-sticking foam 106. Rotating arms 111 are respectively arranged on both sides of the head display main shell 105. The rotating arms 111 support up and down rotation for easy wearing. The rotating arms 111 are arranged on the side away from the head display main shell 105. The strap 107 A headrest foam 110 is provided at the rear end of the belt 107 for fitting behind the operator's head for stable wearing. A battery cavity 109 is provided at the rear end of the headrest foam 110. Environment tracking cameras 113 are provided at the upper and lower ends of both sides of the front end of the head display main shell 105. A status display light 101 and a power button 102 are provided at the upper left side of the head display main shell 105. A USB-C interface 112 is provided at the upper right side of the head display main shell 105. By connecting the data cable of the PC computer to the USB-C interface 112, wired streaming is realized, so that the virtual reality head display module 1 can stream with wireless Wifi.

[0071] Optical lens eye socket components 116 are respectively arranged on both sides of the head display main shell 105. The observer watches the image presented inside the virtual reality head display module 1 through the optical lens eye socket components 116. An eye tracking camera 114 is arranged on the lower and outer sides of the optical lens eye socket components 116. An infrared distance sensor 117 is arranged above the two optical lens eye socket components 116. The infrared distance sensor 117 is used to detect the wearing status. The system automatically wakes up when worn. If it is detected that it has not been worn for a period of time, the system will automatically sleep to avoid power consumption when not in use. A nose pad foam 119 is arranged below the two optical lens eye socket components 116. The face foam 106 and the nose pad foam 119 are made of materials that are easy to clean, soft and breathable, and can be replaced by magnetic suction, and fit the face comfortably. A facial tracking camera 118 is arranged in the middle of the nose pad foam 119. The eye tracking camera 114 and the facial tracking camera 118 can map facial expressions in real time.

[0072] The infrared light emitted by the infrared distance sensor 117 and the eye tracking camera 114 are aimed at the operator's eyes. The eye tracking camera 114 collects the image of the infrared light reflected on the operator's pupil, and combines it with the internal line of sight tracking algorithm analysis to infer the direction of the operator's eye gaze. The eye tracking camera 114 records the entire process of interaction, achieves accurate and sensitive line of sight tracking capabilities, and realizes functions such as eye-controlled interaction, gaze point rendering, and eye movement analysis. The color perspective camera 103 improves the accuracy of stereoscopic environment perception through AI spatial depth calculation and multi-perspective fusion algorithm. With the infrared distance sensor 117 and the environment tracking camera 113, combined with the internal algorithm, it can detect the changes in the field of view angle caused by the rotation of the head, and can also detect the changes in the up, down, front, back, left, and right displacements caused by body movement, to achieve spatial tracking and positioning effects.

[0073] As attached Figure 5 , 6 As shown, the handle module 2 includes two handle shells 204, a joystick 201 is arranged at the center position of the front end of the front side of the handle shell 204, a menu key 202, a HOME key 203, and a screenshot key 206 are arranged circumferentially on the rear end of the joystick 201, a grip key 205 is arranged on the inner side of the two handle shells 204, and a trigger key 207 is arranged on the front end of the back side of the two handle shells 204. Human-computer interaction is achieved by operating the joystick 201, the menu key 202, the HOME key 203, the grip key 205, the screenshot key 206, and the trigger key 207. The front and rear ends of the front sides of the two handle shells 204 are respectively connected to the two ends of the tracking halo 209. The infrared LED light circuit arranged inside the tracking halo 209 is used for the spatial positioning function. A battery box 208 is arranged at the rear ends of the two handle shells 204. A gyroscope and an infrared tracking solution are arranged inside the handle module 2. In conjunction with the virtual reality head display module 1, high-precision positioning and tracking speed can be achieved. It is equipped with a broadband linear motor to truly restore various tactile feedback in the physical world.

[0074] As attached Figure 7-13 As shown, the EEG cap module 3 includes a flexible frame 301, an electrode module 302, and an EEG information acquisition module 303. The electrode module 302 is arranged on the flexible frame 301, and the EEG information acquisition module 303 is arranged above the rear end of the flexible frame 301;

[0075] The flexible frame 301 is formed into a helmet shape by a plurality of transverse flexible bands 3011, and the two ends of each transverse flexible band 3011 are respectively connected to the transverse length adjustment fixing nodes 3014 set at the corresponding positions on the two ear limiting bands 3015, and the middle positions of the plurality of transverse flexible bands 3011 are fixedly connected to the vertical flexible band 3013 through the fixed head module 3012, wherein the transverse flexible bands 3011 and the vertical flexible bands 3013 have circular opening anchor points for electrode seat installation every 2 cm, so that the operator can configure different EEG electrode layouts by himself, and the lower parts of the two ear limiting bands 3015 are respectively connected to the two ends of the mandibular elastic adjustment band 3017 through the mandibular elastic adjustment fixing nodes 3016, and the ear limiting bands 3015 are put on the ears to fix the overall flexible frame 301;

[0076] As attached Fig.14 As shown, the electrode module 302 includes an electrode head 3021 and a dry electrode 3022 , and the electrode head 3021 and the dry electrode 3022 are fixed on the transverse flexible belt 3011 by threaded connection.

[0077] As attached Fig.15 , 16 As shown, the EEG information acquisition module 303 includes two fixed arms 3031, a bracket 3032, and a bio-signal EEG information acquisition board 3033. The two fixed arms 3031 are respectively installed in the holes opened at the upper and lower ends of both sides of the bracket 3032. The bio-signal EEG information acquisition board 3033 is fixedly installed on the bracket 3032. The EEG information acquisition module 303 is fixed to the fixed anchor point opened at the rear end of the vertical flexible belt 3013 through the two fixed arms 3031.

[0078] In view of the different head sizes of different operators, a transverse length adjustment fixing section 3014 is designed. The transverse length adjustment fixing section 3014 corresponds to different hole positions opened on the transverse flexible band 3011 to adjust the length of each transverse flexible band of the cap body to fit different head shapes. Similarly, the mandibular tightness adjustment fixing section 3016 and the mandibular tightness adjustment band 3017 are used to adjust the tightness of the mandible and cheeks.

[0079] Specifically, a color perspective camera 103 is arranged in the middle of the front mask of the head display.

[0080] Specifically, a strap knob 108 is disposed at the rear of the battery cavity 109 , and a lithium battery and a circuit board are disposed inside the battery cavity 109 . The strap extension size is adjusted by rotating the strap knob 108 to adapt the operator's head to wear it comfortably and stably.

[0081] Specifically, a speaker 115 is disposed inside the rotating arm 111 for outputting sound to achieve an immersive usage experience.

[0082] Specifically, there are multiple fixed head modules 3012, each of which includes a fixed head 30121 and a fixed head assembly 30122. Each of the fixed head 30121 and the fixed head assembly 30122 is respectively threadedly connected to the connection between each transverse flexible belt 3011 and the vertical flexible belt 3013.

[0083] As attached Fig.17 , 18 As shown, it also includes a hardware part, which includes an EEG acquisition chip, a single-chip microcomputer and a Bluetooth module. The EEG acquisition chip is electrically connected to the EEG information acquisition module 303, the EEG acquisition chip is electrically connected to the single-chip microcomputer, the single-chip microcomputer is electrically connected to the Bluetooth module, and the Bluetooth module is electrically connected to the virtual reality head display module 1.

[0084] Specifically, the EEG acquisition chip is an eight-channel EEG acquisition dedicated chip ADS1299.

[0085] Specifically, the single-chip microcomputer control circuit adopts an STM32 single-chip microcomputer.

[0086] Specifically, the EEG information acquisition module 303 includes an EEG acquisition sensor, which is a silver chloride dry electrode, does not require conductive paste, can be used in a variety of occasions, and mainly collects the occipital visual area, namely POz, PO 3 ,PO 4 , Oz, O 1 , O 2 , the reference electrode is the midpoint of the frontal pole Fpz, and the ground electrode is the earlobe.

[0087] Specifically, the Bluetooth module sends the collected EEG data to the virtual reality head display device, and the processor set inside the virtual reality head display module 1 performs filtering and algorithm writing.

[0088] Working principle: as attached Fig.19 , 20 As shown, the treatment steps of the amblyopia detection and treatment instrument are:

[0089] Step 1: Start the virtual reality head display module 1 and the EEG cap module 3 to detect whether the communication between the virtual reality head display module 1 and the EEG cap module 3 is normal;

[0090] Step 2: After the test is completed, the patient selects the diseased eye to be treated according to the needs. After selecting the diseased eye, the patient selects the game or video he likes and starts watching the video or game after the treatment starts;

[0091] Step 3: The eye movement is tracked in real time by the eye tracking camera 114 in the virtual reality head display module 1, and the video of the normal eye at the tracked position is blurred according to the eyeball position, and the video of the diseased eye is played normally, so as to train the diseased eye;

[0092] In order to make the virtual reality headset achieve better audio-visual effects, cooperate with a wide range of movies and TV programs, provide a simple, interesting and effective treatment plan for amblyopic children, improve compliance and treatment effect, use the Render Feature in the programmable rendering pipeline URP to achieve the Gaussian blur post-processing effect, set BlurSize to control the sampled pixel position and LerpValue to control the mixing ratio. The larger the two parameters are, the blurrier the picture is. The BlurSize parameter is determined by the analysis result of the processor in the virtual display headset module 1;

[0093] Use the Unity shader graph pipeline rendering tool, add the eye index tag to determine the left and right eye images, and perform different renderings for the left and right eyes respectively to generate the materials required for viewpoint processing. The user inputs the position of the healthy eye, adds the viewpoint model to the healthy eye area, uses the above processed materials, uses eye tracking technology to obtain the coordinates of the center points of the two eyes and the line of sight vector, and uses the Physics SphereCast function provided by Unity to calculate the coordinates of the viewpoint in real time to achieve the restriction of the healthy eye;

[0094] Step 4: During training, real-time EEG detection is performed using SSVEP, or steady-state visual evoked potential, to induce physiological responses in the brain to stimuli that flicker at a certain frequency or change in brightness. These potentials will reflect the brain's processing of visual stimuli of a specific frequency. The visual evoked potentials of amblyopic patients are abnormal and often low, because the optic nerve does not receive sufficient visual stimulation during the critical period of visual development. Fixed stimuli are inserted into the video at regular intervals, and the EEG signals generated by both eyes in response to the stimulation are collected to judge the therapeutic effect of amblyopia.

[0095] The instruction to start collecting EEG data is sent through the virtual reality head display module 1. The EEG signal is collected through all channels and 50 Hz is selected as the frequency of the notch filter to remove the 50 Hz power frequency interference;

[0096] Since the frequency range of EEG signals is within the range of 1-30Hz, bandpass filtering is selected to retain the frequency components within 30Hz. In order to enhance the real-time performance of the acquisition algorithm, the linear phase shift of the filtering algorithm needs to be considered at the same time, so IIR software filtering is used for high-pass filtering and low-pass filtering to ensure the linearity of the phase shift. The filter cutoff frequencies are 1Hz and 30Hz.

[0097] Since the virtual reality headset provides an excellent binocular dichoptic platform, a 7.5 Hz stimulation signal is inserted into the left eye and a 12 Hz stimulation signal is inserted into the right eye. After a period of stimulation, the collected signals are Fourier transformed into the frequency domain.

[0098] Fourier transform can be divided into two types according to the signal object: continuous-time Fourier transform and discrete-time Fourier transform. Assuming there is a continuous-time signal x(t), its Fourier transform is:

[0099] F(w)=∫x(t)e -jwt dt

[0100] In the formula, the integration interval of the continuous time signal x(t) is -∞ to +∞; t represents time, w represents the angular frequency of the signal. Assuming there is a discrete time series x(1), x(2), ..., x(N), its Fourier transform is:

[0101]

[0102] In the field of signal spectrum analysis, FFT is a fast algorithm of DFT, where FFT is fast Fourier transform and DFT is discrete Fourier transform. It divides a long sequence into several subsequences of smaller lengths and performs operations in sequence, thereby improving the calculation speed. The amount of calculation of FFT is much smaller than that of DFT, making FFT more common and practical when processing a large number of signal samples.

[0103] After stimulation for a period of time, the collected signal is Fourier transformed into the frequency domain. Here, FFT is used to transform the EEG data into the frequency domain, and the amplitude values ​​at 7.5Hz and 12Hz are observed. The contrast formula is:

[0104] Contrast = Lmag / Rmag;

[0105] Where Lmag is the amplitude corresponding to 7.5Hz after Fourier transform of the left eye, and Rmag is the amplitude corresponding to 12Hz after Fourier transform of the right eye;

[0106] Assuming that the right eye is an amblyopic eye, the closer the contrast is to 1, the more balanced the visual functions of both eyes are. If it is not 1, that is, the greater the difference between Rmag and Lmag, the more serious the amblyopia is. The collected EEG signal is returned to the processor of the virtual reality headset module 1. The processor adjusts the contrast, blur and other parameters of the picture according to the size of the difference to stimulate the nerves of the diseased eye to achieve a therapeutic effect. Compared with a single parameter picture, real-time adjustment of the picture can better suit the treatment of the diseased eye, improve treatment efficiency and enhance treatment effect.

[0107] Utilizing the technical solution described in the present invention, or those skilled in the art designing a similar technical solution inspired by the technical solution of the present invention to achieve the above-mentioned technical effects, all fall within the protection scope of the present invention.

Claims

1. A method for treating amblyopia in children by combining virtual reality with visual evoked potential, characterized in that: The method uses eye tracking technology to track the gaze position of the eyeball in real time, and performs amblyopia treatment according to the gaze position. During treatment, a virtual reality head display module (1) and an electroencephalogram cap module (3) cooperate with an algorithm to achieve real-time detection of amblyopia in children, and amblyopia treatment methods are adjusted in real time and synchronously according to the detection results. The specific method steps for detecting and treating amblyopia in children include: Step 1: Start the virtual reality head display module (1) and the EEG cap module (3) to detect whether the virtual reality head display module (1) and the EEG cap module (3) communicate normally; Step 2: After the test is completed, the patient selects the diseased eye to be treated according to the needs. After selecting the diseased eye, the patient selects a favorite game or video, and after starting the treatment, the patient watches the video or plays the game by operating the handle module (2); Step 3: Track eye movements in real time through the virtual reality head display module (1), blur the video of the normal eye at the tracked position according to the eyeball position, play the video of the diseased eye normally, and train the diseased eye; Step 4: During training, EEG detection is performed in real time, and an instruction to start collecting EEG data is sent through the virtual reality head display module (1). At the same time, a 7.5 Hz stimulation signal is inserted into the left eye and a 12 Hz stimulation signal is inserted into the right eye while watching the video. The EEG cap module (3) starts collecting data according to the sent instructions and returns the collected EEG signals to the processor of the virtual reality head display module (1). The processor processes the EEG signals, objectively analyzes the treatment effect, and adjusts the appropriate treatment plan in real time according to the treatment effect.

2. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 1, characterized in that: The step three is specifically as follows: Use the Render Feature in the programmable rendering pipeline (URP) to achieve a Gaussian blur post-processing effect, set BlurSize to control the pixel position of the sample and LerpValue to control the blending ratio. The larger the two parameters are, the blurrier the image will be. The BlurSize parameter is determined by the analysis result of the processor in the virtual display head display module (1); Use the Unity shader graph pipeline rendering tool, add the eye index tag to determine the left and right eye images, and perform different renderings for the left and right eyes respectively, generate the materials required for viewpoint processing, and let the user input the position of the healthy eye. Add the viewpoint model in the healthy eye area, use the above processed materials, use eye tracking technology to obtain the coordinates of the center points of the two eyes and the line of sight vector, and use the Physics SphereCast function provided by Unity to calculate the coordinates of the viewpoint in real time to achieve the restriction of the healthy eye.

3. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 1, characterized in that: The step 4 specifically includes: The instruction to start collecting EEG data is sent through the virtual reality head display module 1. The EEG signal is collected through all channels and 50 Hz is selected as the frequency of the notch filter to remove the 50 Hz power frequency interference; Since the frequency range of EEG signals is within 1-30Hz, bandpass filtering is selected to retain the frequency components within 30Hz. In order to enhance the real-time performance of the acquisition algorithm, the linear phase shift of the filtering algorithm needs to be considered, so IIR filters are used for high-pass filtering and low-pass filtering to ensure the linearity of the phase shift; Since the virtual reality headset provides a good binocular dichoptic platform, a 7.5Hz stimulation signal is inserted into the left eye and a 12Hz stimulation signal is inserted into the right eye. After a period of stimulation, the collected signal is Fourier transformed into the frequency domain to observe the amplitude value at this frequency. The contrast formula is: Contrast = Lmag / Rmag; Where Lmag is the amplitude after Fourier transform of the left eye, and Rmag is the amplitude after Fourier transform of the right eye; Assuming that the right eye is amblyopic, the closer the contrast is to 1, the more the visual functions of both eyes are balanced. If it is not 1, that is, the greater the difference between Rmag and Lmag, the more serious the amblyopic eye is. The collected EEG signal is returned to the processor of the virtual reality head display module 1, and the processor adjusts the contrast of the picture according to the difference value and the blur parameter to stimulate the diseased eye nerve to achieve the treatment effect.

4. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 1, characterized in that: The main body of the virtual reality head display module (1) comprises a head display front mask (104), a head display main shell (105), a face-contacting foam (106), a strap (107), and a battery cavity (109); a processor is arranged inside the head display main shell (105); a head display front mask (104) is arranged at the front end of the head display main shell (105); a color perspective camera (103) is arranged in the middle of the head display front mask (104); a face-contacting foam (106) is arranged at the rear end edge of the head display main shell (105); rotating arms (111) are arranged on both sides of the head display main shell (105); a speaker (115) is arranged inside the rotating arm (111); and the rotating arm (111) is away from the head display. A strap (107) is provided on one side of the display main shell (105), a headrest foam (110) is provided at the rear end of the strap (107), a battery cavity (109) is provided at the rear end of the headrest foam (110), optical lens eye socket components (116) are provided on both sides of the interior of the head display main shell (105), an eye tracking camera (114) is provided on the lower outer side of the optical lens eye socket component (116), an infrared distance sensor (117) is provided above the two optical lens eye socket components (116), a nose pad foam (119) is provided below the two optical lens eye socket components (116), and a facial tracking camera (118) is provided in the middle of the nose pad foam (119).

5. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 4, characterized in that: Environmental tracking cameras (113) are respectively arranged at the upper and lower ends of both sides of the front end of the head display main shell (105), a status display light (101) and a power button (102) are respectively arranged at the upper left side of the head display main shell (105), and a USB-C interface (112) is arranged at the upper right side of the head display main shell (105).

6. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 4, characterized in that: A strap knob (108) is provided at the rear of the battery cavity (109).

7. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 1, characterized in that: The handle module (2) comprises two handle shells (204), a joystick (201) is arranged at the center of the front end of the handle shell (204), a menu key (202), a HOME key (203), and a screenshot key (206) are arranged around the rear end of the joystick (201), a grip key (205) is arranged inside the two handle shells (204), the front and rear ends of the two handle shells (204) are respectively connected to the two ends of the tracking light ring (209), an infrared LED light circuit is arranged inside the tracking light ring (209), a trigger key (207) is arranged at the front end of the back of the two handle shells (204), and a battery box (208) is arranged at the rear end of the back of the two handle shells (204).

8. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 1, characterized in that: The EEG cap module (3) comprises a flexible frame (301), an electrode module (302), and an EEG information acquisition module (303); the electrode module (302) is arranged on the flexible frame (301), and the EEG information acquisition module (303) is arranged above the rear end of the flexible frame (301); The flexible frame (301) is formed into a helmet shape by a plurality of transverse flexible bands (3011), the two ends of each transverse flexible band (3011) are respectively connected to the transverse length adjustment fixing nodes (3014) arranged at corresponding positions on the two ear limiting bands (3015), the middle positions of the plurality of transverse flexible bands (3011) are fixedly connected to the vertical flexible band (3013) via a fixed head module (3012), and the lower parts of the two ear limiting bands (3015) are respectively connected to the two ends of the mandibular elastic adjustment band (3017) via mandibular elastic adjustment fixing nodes (3016); The electrode module (302) comprises an electrode head (3021) and a dry electrode (3022), wherein the electrode head (3021) and the dry electrode (3022) are fixed on the transverse flexible belt (3011) by threaded connection; The EEG information acquisition module (303) comprises two fixed arms (3031), a bracket (3032), and a bio-signal EEG information acquisition board (3033); the two fixed arms (3031) are respectively installed in holes opened at the upper and lower ends of both sides of the bracket (3032); the bio-signal EEG information acquisition board (3033) is fixedly installed on the bracket (3032); and the EEG information acquisition module (303) is fixed to a fixed anchor point opened at the rear end of the vertical flexible belt (3013) through the two fixed arms (3031).

9. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 8, characterized in that: There are multiple fixed head modules (3012), each of which comprises a fixed head (30121) and a fixed head assembly (30122). Each of the fixed head (30121) and the fixed head assembly (30122) is respectively threadedly connected to the connection between each transverse flexible belt (3011) and the vertical flexible belt (3013).

10. The method for treating amblyopia in children by combining virtual reality with visual evoked potential according to claim 1, characterized in that: The device used in the method also includes a hardware part, which includes an EEG acquisition chip, a single-chip microcomputer and a Bluetooth module. The EEG acquisition chip is electrically connected to the EEG information acquisition module (303), the EEG acquisition chip is electrically connected to the single-chip microcomputer, the single-chip microcomputer is electrically connected to the Bluetooth module, and the Bluetooth module is electrically connected to the virtual reality head display module (1).