A multimodal vestibular function assessment system based on infrared signals and electromyographic signals

Abstract

The multimodal vestibular function evaluation system based on infrared signals and electromyographic signals of the present invention comprises a head-mounted spectacle frame and a control host, wherein one end of a left lens frame of the head-mounted spectacle frame is fixed with a left dichroic mirror which forms a first acute angle with the left lens frame, and the other end is fixed with a left infrared camera which faces the left dichroic mirror through a left mounting bracket, one end of a right lens frame of the head-mounted spectacle frame is fixed with a right dichroic mirror which forms a first acute angle with the right lens frame, and the other end is fixed with a right infrared camera which faces the right dichroic mirror through a right mounting bracket, and an electromyographic acquisition module is also fixed on the head-mounted spectacle frame, and a control module of the control host collects the left eye movement angle W according to the time sequence. 左 , the right eye movement angle W according to the time sequence 右 , vertical nystagmus angle W according to the time sequence 垂直 and the horizontal nystagmus angle W according to the time sequence 水平 The data are input into a trained neural network model for multi-dimensional analysis and evaluation to output the assessed vestibular function status.

Description

Technical Field

[0001] The present invention relates to the field of medical rehabilitation technology, and in particular to a multimodal vestibular function assessment system based on the combination of eye tracking technology, electronystagmography technology, surface electromyography technology, and posture dynamic acquisition technology. Background Art

[0002] Vestibular function testing is crucial for the diagnosis and treatment of vestibular dysfunction. Traditional testing methods often rely on a single technical means, such as video nystagmus (VNG), electronystagmus (ENG), etc. These methods have certain limitations in evaluating vestibular function. For example, VNG mainly detects nystagmus activity, and cannot detect the movement of the eyeballs when the eyes are closed during the examination of the vertigo patient. ENG mainly detects nystagmus activity, and blink artifact interference is caused when the eyes blink during the test. In order to more comprehensively evaluate vestibular function, a system that can integrate multiple detection methods is needed. The present invention integrates VNG and ENG, which can complement the advantages of different methods, so that multi-dimensional data can be combined for joint analysis, which can improve the precision and accuracy of vestibular function test evaluation. Summary of the invention

[0003] In view of the problems and shortcomings of the prior art, the present invention provides a multimodal vestibular function assessment system based on infrared signals and electromyographic signals, which realizes a comprehensive assessment of vestibular function by integrating multiple detection methods such as video nystagmus view VNG and electronystagmus ENG.

[0004] The present invention solves the above technical problems through the following technical solutions:

[0005] The present invention provides a multimodal vestibular function assessment system based on infrared signals and electromyographic signals, which is characterized in that it comprises a head-mounted spectacle frame and a control host, wherein a left dichroic mirror which forms a first acute angle with the left lens frame is fixed at one end of a left lens frame of the head-mounted spectacle frame, a left infrared camera is fixed at the other end through a left mounting bracket, and the left infrared camera faces the left dichroic mirror, a right dichroic mirror which forms the first acute angle with the right lens frame is fixed at one end of a right lens frame of the head-mounted spectacle frame, a right infrared camera is fixed at the other end through a right mounting bracket, and the right infrared camera faces the right dichroic mirror, the left dichroic mirror and the right dichroic mirror are symmetrically arranged, a myoelectric acquisition module is also fixed on the head-mounted spectacle frame, and the control host comprises a control module;

[0006] The control module is used to control the left infrared camera to continuously capture the left eye moving image formed by the infrared light reflected by the left cornea on the left dichroic mirror during the process of giving the target evaluator an external stimulus, and based on the change value Y of the coordinates of the infrared light spots in each of the two adjacent left eye moving images in a time sequence 左The change value X of the infrared light spot coordinates in the left eye movement image when the left eye movement angle of the target evaluator is 1 degree 左 Analyze the left eye movement angle W of the target evaluator in time sequence 左 =Y 左 / X 左 At the same time, the right infrared camera is controlled to continuously capture the right eye moving image formed by the infrared light reflected by the right cornea on the right dichroic mirror, based on the change value Y of the infrared light spot coordinates in each adjacent right eye moving image in time sequence 右 The change value X of the infrared light spot coordinates in the right eye movement image when the right eye movement angle of the target evaluator is 1 degree 右 Analyze the target evaluator's right eye movement angle W in time sequence 右 =Y 右 / X 右 At the same time, the myoelectric acquisition module is controlled to continuously collect the vertical nystagmus electric signal in the vertical direction and the horizontal nystagmus electric signal in the horizontal direction. Based on the change value Y of the potential difference between the cornea and the retina of each adjacent two vertical nystagmus electric signals in the time sequence, 垂直 The change value X of the potential difference between the cornea and the retina in the vertical nystagmus signal when the vertical nystagmus angle with the target assessor is 1 degree 垂直 Analyze the vertical nystagmus angle W of the target assessor in time sequence 垂直 =Y 垂直 / X 垂直 , based on the change value Y of the potential difference between the cornea and the retina of each adjacent horizontal nystagmus signal in time sequence 水平 The change value X between the cornea and retina of the eye in the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree 水平 Analyze the target evaluator's horizontal nystagmus angle W in time sequence 水平 =Y 水平 / X 水平 ;

[0007] The control module is also used to convert the left eye movement angle W according to the time sequence 左 , the right eye movement angle W according to the time sequence 右 , vertical nystagmus angle W according to the time sequence 垂直 and the horizontal nystagmus angle W according to the time sequence 水平 The data are input into a trained neural network model for multi-dimensional analysis and evaluation to output the assessed vestibular function status.

[0008] The positive and progressive effects of the present invention are:

[0009] The present invention effectively brings into play the advantages of the two technologies by integrating the video nystagmus view VNG and the electronystagmus ENG detection technology, and at the same time introduces electromyography detection and posture detection. It can evaluate the vestibular function in multiple dimensions by combining the evaluator's posture state and muscle physiological state, and can effectively improve the accuracy and precision of the diagnostic evaluation. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 The figure is a schematic structural diagram of a head-mounted spectacle frame and its upper components according to a preferred embodiment of the present invention.

[0011] Figure 2 4 is a control relationship diagram of a multimodal vestibular function assessment system according to a preferred embodiment of the present invention.

[0012] Figure 3 The figure is a schematic diagram of the structure of the nystagmus electrical signal collection position in a preferred embodiment of the present invention.

[0013] Figure 4 This is a schematic structural diagram of the surface electromyographic signal collection position of the sternocleidomastoid muscle in a preferred embodiment of the present invention.

[0014] Figure 5 FIG. 4 is a schematic diagram of the structure of a first differential amplifier circuit according to a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0015] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0016] like Figure 1-5As shown, this embodiment provides a multimodal vestibular function assessment system based on infrared signals and electromyographic signals, which includes a head-mounted spectacle frame 100 and a control host 200. The right end of the left lens frame 101 of the head-mounted spectacle frame 100 is fixed with a left dichroic mirror 102 which is at a first acute angle (such as 45 degrees) with the left lens frame 101, and the left end is fixed with a left infrared camera 103 through a left mounting bracket, and the left infrared camera 103 faces the left dichroic mirror 102; the left end of the right lens frame 104 of the head-mounted spectacle frame 100 is fixed with a right dichroic camera 102 which is at the first acute angle with the right lens frame 104. The right end of the dichroic mirror 105 is fixed with a right infrared camera 106 through a right mounting bracket, and the right infrared camera 106 faces the right dichroic mirror 105. The left dichroic mirror 102 and the right dichroic mirror 105 are symmetrically arranged; a lamp bead assembly 107 is fixed on the head-mounted mirror frame 100 and located between the left lens frame 101 and the right lens frame 104. The lamp bead assembly 107 includes a central lamp bead and a left-positioned projection lamp bead, and the angle between the central lamp bead and the left-positioned projection lamp bead is a second acute angle (such as 30 degrees); an eye mask pad 108 is fixed on the inner side of the head-mounted mirror frame 100 and around the left and right lens frames.

[0017] The head-mounted spectacle frame 100 is also fixed with an electromyography acquisition module 109 and a posture sensing module 110 .

[0018] The left dichroic mirror 102 and the right dichroic mirror 105 are placed at an angle of 45 degrees, which can reflect infrared rays so that the infrared rays reflected by the cornea can be captured by the corresponding infrared cameras without affecting the view of the subject.

[0019] The image acquisition frame rate of the left infrared camera 103 and the right infrared camera 106 is ≥120FPS, the wavelength of the infrared light source is 940nm, and the radiation intensity is 7mW / sr.

[0020] The attitude sensing module 110 can adopt a 6-axis or 9-axis high-precision attitude sensor, support BLE5.0 Bluetooth communication and serial port communication, and can realize the monitoring of three-axis acceleration, three-dimensional position, motion recognition, angle, angular acceleration, etc.

[0021] See Figure 3 The myoelectric acquisition module 109 includes an R1+ myoelectric electrode, an R1- myoelectric electrode, an R2+ myoelectric electrode, an R2- myoelectric electrode, a GND myoelectric electrode, a first differential amplifier circuit, and a second differential amplifier circuit. The R1+ myoelectric electrode is fixed to the inner top position of the eye mask pad 108 and is located directly above the right eye, the R1- myoelectric electrode is fixed to the inner bottom position of the eye mask pad 108 and is located directly below the right eye, the R2+ myoelectric electrode is fixed to the left side of the eye mask pad 108 and is located on the left side of the left eye, the R2- myoelectric electrode is fixed to the right side of the eye mask pad 108 and is located on the right side of the right eye, and the GND myoelectric electrode is fixed to the inner top position of the eye mask pad 108 and is located between the left eye and the right eye.

[0022] See Figure 4 The myoelectric acquisition module 109 includes an R3+ myoelectric electrode, an R3- myoelectric electrode, an R4+ myoelectric electrode, an R4- myoelectric electrode, a third differential amplifier circuit, and a fourth differential amplifier circuit. The R3+ myoelectric electrode is fixed at the right sternocleidomastoid muscle of the target assessor, the R3- myoelectric electrode is fixed at the end of the clavicle, the R4+ myoelectric electrode is fixed at the left sternocleidomastoid muscle of the target assessor, and the R4- myoelectric electrode and the R3+ myoelectric electrode share one myoelectric electrode.

[0023] The circuits of the first differential amplifier circuit, the second differential amplifier circuit, the third differential amplifier circuit and the fourth differential amplifier circuit are the same. Figure 5 The first differential amplifier circuit includes: the positive input terminal of the first differential amplifier is connected to the R1+electromyographic electrode through the resistor R1, the negative input terminal is electrically connected to the output terminal of the first differential amplifier through the resistor R3, the control terminal 1 of the first differential amplifier is connected to the pull-up voltage and is also grounded through the capacitor C1, the control terminal 2 is connected to the pull-up voltage and is also grounded through the capacitor C2, the negative input terminal of the second differential amplifier is connected to the R1-electromyographic electrode through the resistor R2, the positive input terminal is electrically connected to the output terminal of the first differential amplifier through the resistor R7, the control terminal 1 of the second differential amplifier is connected to the pull-up voltage and is also grounded through the capacitor C3, the control terminal 2 is connected to the pull-up voltage and is also grounded through the capacitor C 4 is grounded, the positive input terminal of the second differential amplifier is electrically connected to the negative input terminal of the first differential amplifier through a resistor R6, the positive input terminal of the third differential amplifier is electrically connected to the output terminal of the first differential amplifier through a resistor R4, and is also electrically connected to the output terminal of the third differential amplifier through a resistor R5, the negative input terminal of the third differential amplifier is electrically connected to the output terminal of the second differential amplifier through a resistor R8, and is also grounded through a resistor R9, the control terminal 1 of the third differential amplifier is connected to the pull-up voltage and is also grounded through a capacitor C6, the control terminal 2 is connected to the pull-up voltage and is also grounded through a capacitor C7, and the output terminal of the third differential amplifier outputs Vout to the control module 203.

[0024] The control host 200 includes an information management module 201 , an angle calibration module 202 , a control module 203 and a report generation module 204 .

[0025] The information management module 201 is used to manage the information of each evaluator, including inputting each evaluator's information, modifying each evaluator's information, querying each evaluator's information, and reviewing each evaluator's evaluation information.

[0026] The angle calibration module 202 is used to call the left infrared camera 103 to continuously capture the left eye movement image formed by the infrared light reflected by the left cornea on the left dichroic mirror when the target evaluator moves his eyes from the center lamp bead to the projection lamp bead according to the voice prompt, extract the left eye movement image at the starting point and the left eye movement image at the end point, calculate the change value of the infrared light spot coordinates in the left eye movement image at the starting point and the infrared light spot coordinates in the left eye movement image at the end point, and then calculate the change value X of the infrared light spot coordinates in the left eye movement image when the left eye movement angle of the target evaluator is 1 degree. 左 =(the change value of the infrared light spot coordinates in the left eye moving image at the starting point and the infrared light spot coordinates in the left eye moving image at the end point) / the second acute angle; at the same time, the right infrared camera 106 is called to continuously shoot the right eye moving image formed by the infrared light reflected by the right cornea on the right dichroic mirror, the right eye moving image at the starting point and the right eye moving image at the end point are extracted, the change value of the infrared light spot coordinates in the right eye moving image at the starting point and the infrared light spot coordinates in the right eye moving image at the end point is calculated, and then the change value X of the infrared light spot coordinates in the right eye moving image when the right eye moving angle of the target evaluator is 1 degree is calculated. 右 =(the change in the infrared light spot coordinates in the right eye moving image at the starting point and the infrared light spot coordinates in the right eye moving image at the end point) / the second acute angle.

[0027] The angle calibration module 202 is used to call the first differential amplifier circuit to collect the vertical nystagmus electric signal formed by the R1+ electromyographic electrode and the R1- electromyographic electrode in the vertical direction when the target evaluator moves his eyes from the center lamp bead to the projection lamp bead according to the voice prompt, output the potential difference between the cornea and the retina of the eyeball in the vertical nystagmus electric signal after differential amplification, extract the potential difference at the starting point and the potential difference at the end point, calculate the change value of the potential difference at the starting point and the potential difference at the end point, and then calculate the change value X of the potential difference between the cornea and the retina of the eyeball in the vertical nystagmus electric signal when the vertical nystagmus angle of the target evaluator is 1 degree. 垂直 = the change value of the vertical potential difference / the second acute angle; at the same time, the second differential amplifier circuit is called to collect the horizontal nystagmus electric signal in the horizontal direction formed by the R2+ electromyographic electrode and the R2- electromyographic electrode, and the potential difference between the cornea and the retina of the eyeball in the horizontal nystagmus electric signal is output after differential amplification, and the potential difference at the starting point and the potential difference at the end point are extracted, and the change value of the potential difference at the starting point and the potential difference at the end point is calculated, and then the change value X of the potential difference between the cornea and the retina in the horizontal nystagmus electric signal when the horizontal nystagmus angle of the target assessor is 1 degree is calculated. 水平 =Change in horizontal potential difference / second acute angle.

[0028] The control module 203 is used to control the left infrared camera 103 to continuously capture the left eye motion image formed by the infrared light reflected by the left cornea on the left dichroic mirror during the process of giving the target evaluator an external stimulus (such as an image movement stimulus), and to calculate the change value Y of the infrared light spot coordinates in each of the two adjacent left eye motion images in a time sequence. 左 The change value X of the infrared light spot coordinates in the left eye movement image when the left eye movement angle of the target evaluator is 1 degree 左 Analyze the left eye movement angle W of the target evaluator in time sequence 左 =Y 左 / X 左 , and at the same time, the right infrared camera 106 is controlled to continuously capture the right eye moving image formed by the infrared light reflected by the right cornea on the right dichroic mirror, based on the change value Y of the infrared light spot coordinates in each adjacent right eye moving image in time sequence 右 The change value X of the infrared light spot coordinates in the right eye movement image when the right eye movement angle of the target evaluator is 1 degree 右 Analyze the target evaluator's right eye movement angle W in time sequence 右 =Y 右 / X 右 , and at the same time, the first differential amplifier circuit is controlled to continuously collect the vertical nystagmus electric signal formed by the R1+ electromyographic electrode and the R1- electromyographic electrode, and the second differential amplifier circuit is controlled to collect the horizontal nystagmus electric signal formed by the R2+ electromyographic electrode and the R2- electromyographic electrode, based on the change value Y of the potential difference between the cornea and the retina of each adjacent two vertical nystagmus electric signals in the time sequence. 垂直 The change value X of the potential difference between the cornea and the retina in the vertical nystagmus signal when the vertical nystagmus angle with the target assessor is 1 degree 垂直 Analyze the vertical nystagmus angle W of the target assessor in time sequence 垂直 =Y 垂直 / X 垂直 , based on the change value Y of the potential difference between the cornea and the retina of each adjacent horizontal nystagmus signal in time sequence 水平 The change value X between the cornea and retina of the eye in the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree 水平 Analyze the target evaluator's horizontal nystagmus angle W in time sequence 水平 =Y 水平 / X 水平 .

[0029] The control module 203 is used to collect the surface electromyographic signal of the right sternocleidomastoid muscle formed by the R3+ electromyographic electrode and the R3- electromyographic electrode using the third differential amplifier circuit during the process of giving external stimulation to the target evaluator, and perform time domain feature extraction and frequency domain feature extraction on the surface electromyographic signal of the right sternocleidomastoid muscle to obtain the time domain feature and frequency domain feature of the surface electromyographic signal of the right sternocleidomastoid muscle. At the same time, the surface electromyographic signal of the left sternocleidomastoid muscle formed by the R4+ electromyographic electrode and the R4- electromyographic electrode is collected using the fourth differential amplifier circuit, and time domain feature extraction and frequency domain feature extraction are performed on the surface electromyographic signal of the left sternocleidomastoid muscle to obtain the time domain feature and frequency domain feature of the surface electromyographic signal of the left sternocleidomastoid muscle.

[0030] The control module 203 is used to control the posture sensing module 110 to continuously detect the head movement angle of the target evaluator in the process of giving the target evaluator external stimulation, so as to obtain the head movement angle in a time sequence.

[0031] The control module 203 is also used to convert the left eye movement angle W according to the time sequence 左 , the right eye movement angle W according to the time sequence 右 , vertical nystagmus angle W according to the time sequence 垂直 , according to the time sequence of horizontal nystagmus angle W 水平 , the time domain characteristics and frequency domain characteristics of the surface electromyographic signal of the right sternocleidomastoid muscle, the time domain characteristics and frequency domain characteristics of the surface electromyographic signal of the left sternocleidomastoid muscle, and the head movement angle in time sequence are input into the trained neural network model for multi-dimensional analysis and evaluation to output the evaluated vestibular function status.

[0032] The report generation module 204 is used to generate a vestibular function status assessment report based on the target assessor's information, analysis data and the assessed vestibular function status.

[0033] Example 2

[0034] Further on the basis of Example 1, the lamp bead assembly includes a central lamp bead and projection lamp beads in four directions of up, down, left and right, and the angle between the central lamp bead and each projection lamp bead is a second acute angle (such as 30 degrees).

[0035] The angle calibration module 202 is used to analyze the change value X of the infrared light spot coordinates in the left eye movement image when the target evaluator's left eye movement angle is 1 degree during the process of the target evaluator's eye movement from the center lamp bead to the left lamp bead. 左左 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右左 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直左At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平左 .

[0036] In the process of the target evaluator's eye movement from the center lamp bead to the right, the change value X of the infrared light spot coordinate in the left eye movement image when the target evaluator's left eye movement angle is 1 degree is analyzed. 左右 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右右 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直右 At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平右 .

[0037] In the process of the target evaluator projecting the lamp bead upward from the center lamp bead, the change value X of the infrared light spot coordinate in the left eye movement image when the target evaluator's left eye movement angle is 1 degree is analyzed. 左上 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右上 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直上 At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平上 .

[0038] In the process of the target evaluator projecting the lamp bead downward from the center lamp bead, the change value X of the infrared light spot coordinate in the left eye movement image when the target evaluator's left eye movement angle is 1 degree is analyzed. 左下 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右下 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直下 At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平下 .

[0039] Then the change value X of the infrared light spot coordinates in the left eye movement image when the target evaluator's left eye movement angle is 1 degree 左 =(X 左左 +X 左右 +X左上 +X 左下 ) / 4, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree 右 =(X 右左 +X 右右 +X 右上 +X 右下 ) / 4, the change value of the potential difference between the cornea and the retina in the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree X 垂直 =(X 垂直左 +X 垂直右 +X 垂直上 +X 垂直下 ) / 4, the change value of the potential difference between the cornea and the retina in the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree X 水平 =(X 水平左 +X 水平右 +X 水平上 +X 水平下 ) / 4.

[0040] Although the specific embodiments of the present invention are described above, those skilled in the art should understand that these are only examples, and the protection scope of the present invention is defined by the appended claims. Those skilled in the art may make various changes or modifications to these embodiments without departing from the principles and essence of the present invention, but these changes and modifications all fall within the protection scope of the present invention.

Claims

1. A multimodal vestibular function assessment system based on infrared signals and electromyographic signals, characterized in that: It comprises a head-mounted spectacle frame and a control host, wherein a left dichroic mirror which forms a first acute angle with the left lens frame is fixed at one end of the left lens frame of the head-mounted spectacle frame, a left infrared camera is fixed at the other end through a left mounting bracket, and the left infrared camera faces the left dichroic mirror, a right dichroic mirror which forms the first acute angle with the right lens frame is fixed at one end of the right lens frame of the head-mounted spectacle frame, a right infrared camera is fixed at the other end through a right mounting bracket, and the right infrared camera faces the right dichroic mirror, the left dichroic mirror and the right dichroic mirror are symmetrically arranged, a myoelectric acquisition module is also fixed on the head-mounted spectacle frame, and the control host comprises a control module; The control module is used to control the left infrared camera to continuously capture the left eye moving image formed by the infrared light reflected by the left cornea on the left dichroic mirror during the process of giving the target evaluator an external stimulus, and based on the change value Y of the infrared light spot coordinates in each of two adjacent left eye moving images in a time sequence 左 The change value X of the infrared light spot coordinates in the left eye movement image when the left eye movement angle of the target evaluator is 1 degree 左 Analyze the left eye movement angle W of the target evaluator in time sequence 左 =Y 左 / X 左 At the same time, the right infrared camera is controlled to continuously capture the right eye moving image formed by the infrared light reflected by the right cornea on the right dichroic mirror, based on the change value Y of the infrared light spot coordinates in each adjacent right eye moving image in time sequence 右 The change value X of the infrared light spot coordinates in the right eye movement image when the right eye movement angle of the target evaluator is 1 degree 右 Analyze the target evaluator's right eye movement angle W in time sequence 右 =Y 右 / X 右 At the same time, the myoelectric acquisition module is controlled to continuously collect the vertical nystagmus electric signal in the vertical direction and the horizontal nystagmus electric signal in the horizontal direction. Based on the change value Y of the potential difference between the cornea and the retina of each adjacent two vertical nystagmus electric signals in the time sequence, 垂直 The change value X of the potential difference between the cornea and the retina in the vertical nystagmus signal when the vertical nystagmus angle with the target assessor is 1 degree 垂直 Analyze the vertical nystagmus angle W of the target assessor in time sequence 垂直 =Y 垂直 / X 垂直 , based on the change value Y of the potential difference between the cornea and the retina of each adjacent horizontal nystagmus signal in time sequence 水平 The change value X between the cornea and retina of the eye in the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree 水平 Analyze the target evaluator's horizontal nystagmus angle W in time sequence 水平 =Y 水平 / X 水平 ; The control module is also used to convert the left eye movement angle W according to the time sequence 左 , the right eye movement angle W according to the time sequence 右 , vertical nystagmus angle W according to the time sequence 垂直 and the horizontal nystagmus angle W according to the time sequence 水平 The data are input into a trained neural network model for multi-dimensional analysis and evaluation to output the assessed vestibular function status.

2. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 1, characterized in that: A lamp bead assembly is fixed on the head-mounted spectacle frame and between the left lens frame and the right lens frame, the lamp bead assembly includes a central lamp bead and at least one projection lamp bead in one direction, and the angle between the central lamp bead and the projection lamp bead is a second acute angle; The control host also includes an angle calibration module, which is used to call the left infrared camera to continuously capture the left eye movement image formed by the infrared light reflected by the left cornea on the left dichroic mirror during the process of the target evaluator's eye movement from the center lamp bead to the projection lamp bead, and analyze the change value X of the infrared light spot coordinates in the left eye movement image when the target evaluator's left eye movement angle is 1 degree based on the infrared light spot coordinates in the left eye movement image and the second acute angle. 左 At the same time, the right infrared camera is called to continuously shoot the right eye movement image formed by the infrared light reflected by the right cornea on the right dichroic mirror. Based on the infrared light spot coordinates in the right eye movement image and the second acute angle, the change value X of the infrared light spot coordinates in the right eye movement image when the right eye movement angle of the target evaluator is 1 degree is analyzed. 右 At the same time, the electromyography acquisition module is called to collect the vertical nystagmus electric signal in the vertical direction and the horizontal nystagmus electric signal in the horizontal direction. Based on the potential difference between the cornea and the retina in the vertical nystagmus electric signal and the second acute angle, the change value X of the potential difference between the cornea and the retina in the vertical nystagmus electric signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直 Based on the potential difference between the cornea and retina in the horizontal nystagmus signal and the second acute angle, the change value X of the potential difference between the cornea and retina in the horizontal nystagmus signal of the target evaluator when the horizontal nystagmus angle is 1 degree is analyzed. 水平 .

3. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 2, characterized in that: The angle calibration module is used to call the left infrared camera to continuously shoot the left eye movement image formed by the infrared light reflected by the left cornea on the left dichroic mirror during the process of the target evaluator's eye movement from the center lamp bead to the projection lamp bead according to the voice prompt, extract the left eye movement image of the starting point and the left eye movement image of the end point, calculate the change value of the infrared light spot coordinates in the left eye movement image of the starting point and the infrared light spot coordinates in the left eye movement image of the end point, and then calculate the change value X of the infrared light spot coordinates in the left eye movement image when the left eye movement angle of the target evaluator is 1 degree. 左 =(the change value of the infrared light spot coordinates in the left eye movement image at the starting point and the infrared light spot coordinates in the left eye movement image at the end point) / the second acute angle; at the same time, the right infrared camera is called to continuously shoot the right eye movement image formed by the infrared light reflected by the right cornea on the right dichroic mirror, the right eye movement image at the starting point and the right eye movement image at the end point are extracted, the change value of the infrared light spot coordinates in the right eye movement image at the starting point and the infrared light spot coordinates in the right eye movement image at the end point is calculated, and then the change value X of the infrared light spot coordinates in the right eye movement image when the right eye movement angle of the target evaluator is 1 degree is calculated. 右 =(the change in the infrared light spot coordinates in the right eye moving image at the starting point and the infrared light spot coordinates in the right eye moving image at the end point) / the second acute angle.

4. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 2, characterized in that: An eye mask pad is fixed on the inner side of the head-mounted mirror frame and around the left and right lens frames, and the electromyographic acquisition module includes an R1+ electromyographic electrode, an R1- electromyographic electrode, an R2+ electromyographic electrode, an R2- electromyographic electrode, a GND electromyographic electrode, a first differential amplifier circuit and a second differential amplifier circuit; The R1+ myoelectric electrode is fixed at the inner top position of the eye mask pad and is located directly above the left eye or the right eye, the R1- myoelectric electrode is fixed at the inner bottom position of the eye mask pad and is located directly below the left eye or the right eye, the R2+ myoelectric electrode is fixed at the left side of the eye mask pad and is located on the left side of the left eye, the R2- myoelectric electrode is fixed at the right side of the eye mask pad and is located on the right side of the right eye, and the GND myoelectric electrode is fixed at the inner top position of the eye mask pad and is located between the left eye and the right eye; The angle calibration module is used to call the first differential amplifier circuit to collect the vertical nystagmus electric signal in the vertical direction formed by the R1+ electromyographic electrode and the R1- electromyographic electrode during the process of the target evaluator's eye movement from the central lamp bead to the projection lamp bead according to the voice prompt, output the potential difference between the cornea and the retina of the eyeball in the vertical nystagmus electric signal after differential amplification, extract the potential difference at the starting point and the potential difference at the end point, calculate the change value of the potential difference at the starting point and the potential difference at the end point, and then calculate the change value X of the potential difference between the cornea and the retina in the vertical nystagmus electric signal when the vertical nystagmus angle of the target evaluator is 1 degree. 垂直 = the change value of the vertical potential difference / the second acute angle; at the same time, the second differential amplifier circuit is called to collect the horizontal nystagmus electric signal in the horizontal direction formed by the R2+ electromyographic electrode and the R2- electromyographic electrode, and the potential difference between the cornea and the retina of the eyeball in the horizontal nystagmus electric signal is output after differential amplification, and the potential difference at the starting point and the potential difference at the end point are extracted, and the change value of the potential difference at the starting point and the potential difference at the end point is calculated, and then the change value X of the potential difference between the cornea and the retina in the horizontal nystagmus electric signal when the horizontal nystagmus angle of the target assessor is 1 degree is calculated. 水平 =Change in horizontal potential difference / second acute angle.

5. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 4, characterized in that: The circuits of the first differential amplifier circuit and the second differential amplifier circuit are the same, and the first differential amplifier circuit includes: the positive input terminal of the first differential amplifier is connected to R1+electromyographic electrode through resistor R1, and the negative input terminal is electrically connected to the output terminal of the first differential amplifier through resistor R3, the control terminal 1 of the first differential amplifier is connected to the pull-up voltage and is also grounded through capacitor C1, and the control terminal 2 is connected to the pull-up voltage and is also grounded through capacitor C2, the negative input terminal of the second differential amplifier is connected to R1-electromyographic electrode through resistor R2, and the positive input terminal is electrically connected to the output terminal of the first differential amplifier through resistor R7, the control terminal 1 of the second differential amplifier is connected to the pull-up voltage and is also grounded through capacitor C3, and the control terminal 2 is connected to the pull-up voltage and is also grounded through capacitor C2. Terminal 2 is connected to the pull-up voltage and is also grounded through capacitor C4, the positive input terminal of the second differential amplifier is electrically connected to the negative input terminal of the first differential amplifier through resistor R6, the positive input terminal of the third differential amplifier is electrically connected to the output terminal of the first differential amplifier through resistor R4, and is also electrically connected to the output terminal of the third differential amplifier through resistor R5, the negative input terminal of the third differential amplifier is electrically connected to the output terminal of the second differential amplifier through resistor R8, and is also grounded through resistor R9, the control terminal 1 of the third differential amplifier is connected to the pull-up voltage and is also grounded through capacitor C6, the control terminal 2 is connected to the pull-up voltage and is also grounded through capacitor C7, and the output terminal of the third differential amplifier outputs Vout to the control module.

6. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 2, characterized in that: The lamp bead assembly includes a central lamp bead and projection lamp beads in four directions, the central lamp bead and each projection lamp bead form a second acute angle; The angle calibration module is used to analyze the change value X of the infrared light spot coordinates in the left eye movement image when the target evaluator's left eye movement angle is 1 degree during the target evaluator's eye movement from the center lamp bead to the left. 左左 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右左 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直左 At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平左 ; In the process of the target evaluator's eye movement from the center lamp bead to the right, the change value X of the infrared light spot coordinate in the left eye movement image when the target evaluator's left eye movement angle is 1 degree is analyzed. 左右 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右右 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直右 At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平右 ; In the process of the target evaluator projecting the lamp bead upward from the center lamp bead, the change value X of the infrared light spot coordinate in the left eye movement image when the target evaluator's left eye movement angle is 1 degree is analyzed. 左上 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右上 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直上 At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平上 ; In the process of the target evaluator projecting the lamp bead downward from the center lamp bead, the change value X of the infrared light spot coordinate in the left eye movement image when the target evaluator's left eye movement angle is 1 degree is analyzed. 左下 At the same time, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree is analyzed 右下 At the same time, the change value X between the cornea and retina of the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree is analyzed. 垂直下 At the same time, the change value X between the cornea and retina of the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree is analyzed. 水平下 ; Then the change value X of the infrared light spot coordinates in the left eye movement image when the target evaluator's left eye movement angle is 1 degree 左 =(X 左左 +X 左右 +X 左上 +X 左下 ) / 4, the change value X of the infrared light spot coordinates in the right eye movement image when the target evaluator's right eye movement angle is 1 degree 右 =(X 右左 +X 右右 +X 右上 +X 右下 ) / 4, the change value of the potential difference between the cornea and the retina in the vertical nystagmus signal when the vertical nystagmus angle of the target assessor is 1 degree X 垂直 =(X 垂直左 +X 垂直右 +X 垂直上 +X 垂直下 ) / 4, the change value of the potential difference between the cornea and the retina in the horizontal nystagmus signal when the horizontal nystagmus angle of the target assessor is 1 degree X 水平 =(X 水平左 +X 水平右 +X 水平上 +X 水平下 ) / 4.

7. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 4, characterized in that: The electromyographic acquisition module includes R3+ electromyographic electrode, R3- electromyographic electrode, R4+ electromyographic electrode, R4- electromyographic electrode, a third differential amplifier circuit and a fourth differential amplifier circuit; The R3+ electromyographic electrode is fixed at the right sternocleidomastoid muscle of the target assessor, the R3- electromyographic electrode is fixed at the end position of the clavicle, the R4+ electromyographic electrode is fixed at the left sternocleidomastoid muscle of the target assessor, and the R4- electromyographic electrode and the R3+ electromyographic electrode share a single electromyographic electrode; The control module is used for collecting the surface electromyographic signal of the right sternocleidomastoid muscle formed by the R3+ electromyographic electrode and the R3- electromyographic electrode by using the third differential amplifier circuit during the process of giving external stimulation to the target evaluator, performing time domain feature extraction and frequency domain feature extraction on the surface electromyographic signal of the right sternocleidomastoid muscle to obtain the time domain feature and frequency domain feature of the surface electromyographic signal of the right sternocleidomastoid muscle, and collecting the surface electromyographic signal of the left sternocleidomastoid muscle formed by the R4+ electromyographic electrode and the R4- electromyographic electrode by using the fourth differential amplifier circuit, performing time domain feature extraction and frequency domain feature extraction on the surface electromyographic signal of the left sternocleidomastoid muscle to obtain the time domain feature and frequency domain feature of the surface electromyographic signal of the left sternocleidomastoid muscle; The control module is also used to convert the left eye movement angle W according to the time sequence 左 , the right eye movement angle W according to the time sequence 右 , vertical nystagmus angle W according to the time sequence 垂直 , according to the time sequence of horizontal nystagmus angle W 水平 The time domain characteristics and frequency domain characteristics of the surface electromyographic signal of the right sternocleidomastoid muscle, as well as the time domain characteristics and frequency domain characteristics of the surface electromyographic signal of the left sternocleidomastoid muscle are input into the trained neural network model for multi-dimensional analysis and evaluation to output the evaluated vestibular function status.

8. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 7, characterized in that: The head-mounted glasses frame is also fixed with a posture sensing module, and the control module is used to control the posture sensing module to continuously detect the head movement angle of the target evaluator in the process of giving the target evaluator external stimulation, so as to obtain the head movement angle in time sequence; The control module is also used to convert the left eye movement angle W according to the time sequence 左 , the right eye movement angle W according to the time sequence 右 , vertical nystagmus angle W according to the time sequence 垂直 , according to the time sequence of horizontal nystagmus angle W 水平 , the time domain characteristics and frequency domain characteristics of the surface electromyographic signal of the right sternocleidomastoid muscle, the time domain characteristics and frequency domain characteristics of the surface electromyographic signal of the left sternocleidomastoid muscle, and the head movement angle in time sequence are input into the trained neural network model for multi-dimensional analysis and evaluation to output the evaluated vestibular function status.

9. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals as claimed in claim 2, characterized in that: The first acute angle is 45 degrees, and the second acute angle is 30 degrees.

10. The multimodal vestibular function assessment system based on infrared signals and electromyographic signals according to claim 1, characterized in that: The control host also includes an information management module and a report generation module; The information management module is used to manage the information of each evaluator; The report generation module is used to generate a vestibular function status assessment report based on the target assessor's information, analysis data and the assessed vestibular function status.

Images