Stimulation paradigm generation system, brain-computer interface system, detection method and device

Through the stimulation paradigm generation system of the binocular competition principle, the binocular visual competition principle is used to present visual stimulation to the user's left and right eye fields at the same time, solving the inadequate cooperation of the examined subjects and low brain-computer interface detection efficiency in traditional visual field detection methods. The problem has achieved more efficient field of vision detection.

CN115024684BActive Publication Date: 2024-11-22TIANJIN UNIV
View PDF 17 Cites 0 Cited by

Patent Information

Application Number
CN202210564409.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-05-23
Publication Date
2024-11-22
Estimated Expiration
2042-05-23

AI Technical Summary

Technical Problem

Traditional visual field detection methods have high requirements for the subjects, which leads to some subjects such as the elderly and are prone to fatigue and poor cooperation false positive results. The stimulation paradigm encoding of the brain-computer interface is simple, which makes the visual stimulation process take a long time. The detection Inefficient.

Method used

The stimulation paradigm generation system adopts the principle of binocular competition. By flickering the fan ring visual stimulation blocks in two disc rings, the display device and stimulation reflex device simultaneously present visual stimulation to the user's left and right eye field, reducing the Central visual field stimulation, reduce the encoding frequency types, and improve the efficiency of brain signal feature extraction.

Benefits of technology

It shortens the duration of visual stimulation, improves detection efficiency, reduces false positive results, and enhances the accuracy of evaluating the user's surrounding vision.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115024684B_ABST
    Figure CN115024684B_ABST
Patent Text Reader

Abstract

The present application provides a stimulation paradigm generation system, a brain-computer interface system, a detection method and a device, and relates to the field of artificial intelligence technology. The stimulation paradigm generation system includes: a display device for displaying a first sector ring visual stimulation block in a first disk ring, and / or a second sector ring visual stimulation block in a second disk ring; a stimulation reflection device for reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along the target direction, so as to present visual stimulation to the user in at least one first field of view sector ring in the first field of view, and / or at least one second field of view sector ring in the second field of view of the user. The system can present visual stimulation to the left eye field of view and the right eye field of view of the user at the same time by displaying two groups of sector ring visual stimulation blocks in two disk rings through the stimulation reflection device, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology, and in particular to a stimulation paradigm generation system, a brain-computer interface system, a detection method and a device. Background Art

[0002] Traditional methods for testing the integrity of visual field neural pathways include visual field testing and visual contrast sensitivity. Among them, visual field testing is the gold standard for evaluating the degree of visual function impairment and is often used to detect common ophthalmic diseases such as glaucoma, cataracts and macular degeneration. Visual field testing uses a program to give light stimulation at a specified location and measure the differences in light sensitivity (dlsensitivity) at different sites on the retina to calculate the difference (loss) between the threshold of the tested eye and the normal eye. However, as a psychophysical test method, visual field testing requires high cooperation from the subjects, and some subjects (such as the elderly) are prone to false positive results due to fatigue and poor cooperation.

[0003] A brain-computer interface (BCI) is a communication system that does not rely on normal output pathways composed of peripheral nerves and muscles. It can recognize specific brain signal patterns. The stimulation paradigm encoding of the brain-computer interface of related technologies is simple, and the visual stimulation process is time-consuming when used for visual field detection, and the stimulation detection efficiency is low. Summary of the invention

[0004] The embodiments of the present application provide a stimulation paradigm generation system, a brain-computer interface system, a detection method and a device, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

[0005] In a first aspect, an embodiment of the present application provides a stimulation paradigm generation system, comprising:

[0006] A display device is used to display a first sector ring visual stimulation block in the first disk ring and / or a second sector ring visual stimulation block in the second disk ring; the sector ring visual stimulation block is a part of the sector ring unit included in the disk ring, and is formed by flashing according to the coding frequency corresponding to each of the sector ring units;

[0007] A stimulation reflection device is used to reflect the first fan ring stimulation block image and / or the second fan ring stimulation block image along a target direction to present visual stimulation to the user in at least one first field of view fan ring of the first field of view and / or at least one second field of view fan ring of the second field of view of the user; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first field of view fan ring corresponds one-to-one to the fan ring unit position at the first fan ring visual stimulation block; the second field of view fan ring corresponds one-to-one to the fan ring unit position at the second fan ring visual stimulation block.

[0008] The stimulation paradigm generation system provided in the embodiment of the present application can present visual stimulation to the left and right eye fields of the user respectively by displaying two sets of fan-shaped visual stimulation blocks in two circular disk rings through the stimulation reflection device. The stimulation paradigm generation system uses the binocular competition principle to detect the left and right eyes at the same time, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

[0009] In a possible implementation, the first disk ring also includes a first closed inner ring, and the second disk ring also includes a second closed inner ring; the first disk ring and the first closed inner ring have the first center mark as the center, and the second disk ring and the second closed inner ring have the second center mark as the center; the sector ring unit is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings, when the part between the disk ring and the included inner ring is divided into equally divided sectors of a first threshold and concentric rings of a second threshold with the center of the disk ring as the axis.

[0010] In the stimulation paradigm generation system provided in this embodiment, the sector ring unit is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings when the portion between the disk ring and the inner ring contained in the disk ring is divided into equally divided sectors of the first threshold and concentric rings of the second threshold with the center of the disk ring as the axis. In this system, the sector ring unit is a graphic unit outside the first closed inner ring and the second closed inner ring. Therefore, the interior of the first closed inner ring and the interior of the second closed inner ring do not display the sector ring visual stimulation block, thereby suppressing the stimulation of the central area of ​​the visual field, preventing the stimulation of the central area of ​​the visual field from affecting the brain signals of the surrounding visual field area, and further improving the stimulation detection efficiency.

[0011] In a possible implementation, for any circular disk ring, the number of types of the coding frequencies corresponding to the sector ring units included in the circular disk ring is not greater than the first threshold.

[0012] In the stimulation paradigm generation system provided by this embodiment, for any disk ring, the number of types of the coding frequencies corresponding to the sector ring units included in any disk ring is not greater than the first threshold. In the stimulation paradigm generation system, the number of types of coding frequencies corresponding to the sector ring units included in the first disk ring and the number of types of coding frequencies corresponding to the sector ring units included in the second disk ring are both not greater than the first threshold when dividing the sectors into equal parts, thereby using a smaller number of coding frequencies to encode the sector ring units, which can reduce the difficulty of brain signal feature extraction during simultaneous multi-frequency stimulation and can further improve the efficiency of stimulation detection.

[0013] In a possible implementation, in any disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; in any disk ring, the sector ring units contained in the same equally divided sector are configured with the same coding frequency.

[0014] In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equally divided sectors in each disk ring are configured with different coding frequencies, and the sector ring units contained in the same equally divided sector are configured with the same coding frequency. In the stimulation paradigm generation system, in the same disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies, and the sector ring units contained in the same equally divided sector are configured with the same coding frequency, thereby encoding the sector ring units with a smaller number of coding frequencies, while strengthening the difference in coding frequencies of the sector ring units in different equally divided sectors in the same disk ring, which can reduce the difficulty of brain signal feature extraction during simultaneous multi-frequency stimulation and can further improve the efficiency of stimulation detection.

[0015] In one possible implementation, in any circular disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; the coding frequency of any sector ring unit contained in the first circular disk ring is different from the coding frequency of any sector ring unit contained in the second circular disk ring.

[0016] In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equally divided sectors in each disk ring are configured with different coding frequencies, and the coding frequency of any sector ring unit contained in the first disk ring is different from the coding frequency of any sector ring unit contained in the second disk ring. In this stimulation paradigm generation system, in the same disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies, and the coding frequencies configured for the sector ring units contained in the equally divided sectors in different disk rings are different, thereby encoding the sector ring units with a smaller number of coding frequencies, while strengthening the differences between the coding frequencies of the sector ring units in different disk rings, which can reduce the difficulty of extracting brain signal features during simultaneous multi-frequency stimulation and can further improve the efficiency of stimulation detection.

[0017] In a second aspect, an embodiment of the present application provides a brain-computer interface system, comprising the stimulation paradigm generation system according to any one of the first aspects; the brain-computer interface system further comprises:

[0018] A data acquisition device, used for acquiring brain signals generated by a subject; the brain signals are generated by the left and right eyes of the subject based on the visual stimulation of the stimulation paradigm generation system according to any one of the first aspects; the brain signals include multifocal steady-state visual evoked potentials (mfSSVEP);

[0019] The data processing device is used to acquire the brain signal, analyze the brain signal, and generate an evaluation result of the user's peripheral vision.

[0020] The brain-computer interface system provided in the embodiment of the present application includes a stimulation paradigm generation system, which can present visual stimulation to the left and right eye fields of the user respectively by displaying two sets of fan-ring visual stimulation blocks in two disk rings through a stimulation reflection device, thereby simultaneously collecting brain signals generated by the left and right eyes of the subject based on the visual stimulation, analyzing the brain signals, and generating an evaluation result of the user's peripheral visual field. The brain-computer interface system, the stimulation paradigm generation system uses the principle of binocular rivalry to simultaneously detect the left and right eyes and analyze brain signals, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

[0021] In a possible implementation, the brain signal is one of the following: an electroencephalogram (EEG) signal, a magnetoencephalogram (MEG) signal, and a functional near infrared spectroscopy (fNIRS) signal.

[0022] In a possible implementation manner, the data processing device is specifically configured to:

[0023] Extracting features from the brain signal to obtain feature signal information;

[0024] Perform variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result of the user's peripheral vision.

[0025] In the brain-computer interface system provided by this embodiment, the data processing device extracts features from the brain signal to obtain feature signal information; performs variable correlation analysis on the feature signal information to obtain correlation coefficient result information; and the correlation coefficient result information is used to generate the evaluation result of the user's peripheral visual field. The brain-computer interface system provides a mechanism for extracting features from brain signals and performing variable correlation analysis to obtain correlation coefficient result information, which is used to generate the evaluation result of the user's peripheral visual field, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

[0026] In a possible implementation, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulation is not applied; the second brain signal is a brain signal in a state where the visual stimulation is applied;

[0027] The data processing device is specifically used for:

[0028] Performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein the first characteristic signal information is obtained by extracting features from the first brain signal; and the second characteristic signal information is obtained by extracting features from the second brain signal;

[0029] The correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

[0030] The brain-computer interface system provided in this embodiment performs variable correlation analysis on the first brain signal in the state where the visual stimulation is not applied and the second brain signal in the state where the visual stimulation is applied, respectively, to obtain the first correlation coefficient result information and the second correlation coefficient result information, and combines the first correlation coefficient result information and the second correlation coefficient result information to obtain the correlation coefficient result information. The brain-computer interface system can simultaneously combine the correlation coefficient result information corresponding to the brain signal in the state where the visual stimulation is not applied and the brain signal in the state where the visual stimulation is applied, respectively, to obtain more stable correlation coefficient result information, which is used to generate the evaluation result of the user's peripheral visual field, which can shorten the duration of the visual stimulation, improve the stimulation detection efficiency, and improve the accuracy of the evaluation result of the user's peripheral visual field.

[0031] In a possible implementation, the evaluation result of the user's peripheral visual field is information about the presence of a visual field sector ring with impaired visual function in the user's peripheral visual field.

[0032] In a third aspect, an embodiment of the present application provides a stimulation paradigm detection method, the method comprising:

[0033] Visual stimulation is presented to the user in at least one first visual field sector ring of the user's first visual field, and / or at least one second visual field sector ring of the user's second visual field; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disk ring, and / or a second sector ring visual stimulation block in a second disk ring, and reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along a target direction; the sector ring visual stimulation block is a part of a sector ring unit included in a disk ring, and is formed by flashing according to a coding frequency corresponding to each of the sector ring units; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first visual field sector ring corresponds one-to-one to the position of the sector ring unit at the first sector ring visual stimulation block; the second visual field sector ring corresponds one-to-one to the position of the sector ring unit at the second sector ring visual stimulation block;

[0034] Collecting brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potentials (mfSSVEP);

[0035] The brain signal is acquired, analyzed, and an evaluation result of the user's peripheral vision is generated.

[0036] This stimulation paradigm detection method provides a mechanism for extracting features from brain signals and performing variable correlation analysis to obtain correlation coefficient result information, which is used to generate the evaluation result of the user's peripheral visual field, thereby shortening the duration of visual stimulation and improving stimulation detection efficiency.

[0037] In a possible implementation, presenting visual stimulation to the user in at least one first field of view sector ring of the user's first field of view and / or at least one second field of view sector ring of the user's second field of view includes:

[0038] In response to receiving the first-stage detection instruction, presenting visual stimulation to the user in at least one first visual field sector ring of the user's first visual field and at least one second visual field sector ring of the user's second visual field, so as to detect each first visual field sector ring of the user's first visual field and each second visual field sector ring of the user's second visual field;

[0039] If a second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view fan ring to detect the user's target field of view fan ring; the target field of view fan ring is a first field of view fan ring selected in the first field of view, or a second field of view fan ring selected in the second field of view.

[0040] The stimulation paradigm detection method provides a distributed detection mechanism, which can detect each first field of view fan ring of the first field of view of the user and each second field of view fan ring of the second field of view of the user in response to receiving a first-stage detection instruction, and can locate the target field of view fan ring whose evaluation result meets the preset conditions in the first field of view and the second field of view, and present visual stimulation to the user in the target field of view fan ring of the user according to the second-stage detection instruction to detect the target field of view fan ring of the user, so as to evaluate the user's field of view more accurately.

[0041] In a fourth aspect, an embodiment of the present application provides a stimulation paradigm detection device, the device comprising:

[0042] A stimulation paradigm generation module, used for presenting visual stimulation to the user in at least one first visual field sector ring of the user's first visual field, and / or at least one second visual field sector ring of the user's second visual field; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disk ring, and / or a second sector ring visual stimulation block in a second disk ring, and reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along a target direction; the sector ring visual stimulation block is a part of a sector ring unit included in a disk ring, and is formed by flashing according to a coding frequency corresponding to each of the sector ring units; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first visual field sector ring corresponds one-to-one to the position of the sector ring unit at the first sector ring visual stimulation block; the second visual field sector ring corresponds one-to-one to the position of the sector ring unit at the second sector ring visual stimulation block;

[0043] A signal acquisition module, used for acquiring brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potentials (mfSSVEP);

[0044] The data processing module is used to acquire the brain signal, analyze the brain signal, and generate an evaluation result of the user's peripheral vision.

[0045] In a possible implementation, the data processing module is specifically used to:

[0046] Extracting features from the brain signal to obtain feature signal information;

[0047] Perform variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result of the user's peripheral vision.

[0048] In a possible implementation, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulation is not applied; the second brain signal is a brain signal in a state where the visual stimulation is applied;

[0049] The data processing module is specifically used for:

[0050] Performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein the first characteristic signal information is obtained by extracting features from the first brain signal; and the second characteristic signal information is obtained by extracting features from the second brain signal;

[0051] The correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

[0052] In a possible implementation, the stimulation paradigm generation module is specifically used to:

[0053] In response to receiving the first-stage detection instruction, presenting visual stimulation to the user in at least one first visual field sector ring of the user's first visual field and at least one second visual field sector ring of the user's second visual field, so as to detect each first visual field sector ring of the user's first visual field and each second visual field sector ring of the user's second visual field;

[0054] If a second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view fan ring to detect the user's target field of view fan ring; the target field of view fan ring is a first field of view fan ring selected in the first field of view, or a second field of view fan ring selected in the second field of view.

[0055] In a fifth aspect, an embodiment of the present application provides a server, comprising a memory and a processor, wherein the memory stores a computer program executable on the processor, and when the computer program is executed by the processor, the method described in any one of the third aspects is implemented.

[0056] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of the third aspects is implemented.

[0057] The technical effects brought about by any implementation method of the fourth to sixth aspects can refer to the technical effects brought about by the implementation methods of the first to third aspects, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0059] Figure 1 A structural block diagram of a stimulation paradigm generation system provided in an embodiment of the present application;

[0060] Figure 2 A schematic diagram of a presentation layout of a display fan ring visual stimulus block of a stimulation paradigm generation system provided in an embodiment of the present application;

[0061] Figure 3 A schematic diagram of a stimulation paradigm of a stimulation paradigm generation system provided in an embodiment of the present application;

[0062] Figure 4 A structural block diagram of a brain-computer interface system provided in an embodiment of the present application;

[0063] Figure 5 A schematic diagram of a flow chart of a stimulation paradigm detection method provided in an embodiment of the present application;

[0064] Figure 6 A structural block diagram of a stimulation paradigm detection device provided in an embodiment of the present application;

[0065] Figure 7 A structural block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0067] Traditional methods for testing the integrity of visual field neural pathways include visual field testing and visual contrast sensitivity. Among them, visual field testing is the gold standard for evaluating the degree of visual function impairment and is often used to detect common ophthalmic diseases such as glaucoma, cataracts and macular degeneration. Visual field testing uses a program to give light stimulation at a specified location and measure the differences in light sensitivity (dlsensitivity) at different sites on the retina to calculate the difference (loss) between the threshold of the tested eye and the normal eye. However, as a psychophysical test method, visual field testing requires high cooperation from the subjects, and some subjects (such as the elderly) are prone to false positive results due to fatigue and poor cooperation.

[0068] Brain-computer interface (BCI) is a communication system that does not rely on normal output pathways composed of peripheral nerves and muscles. It can recognize specific brain signal patterns. The stimulation paradigm encoding of the brain-computer interface in related technologies is simple, the visual stimulation process is time-consuming when used for visual field detection, and the stimulation detection efficiency is low, which limits the promotion and application of brain-computer interface in visual field detection.

[0069] Based on this, the embodiments of the present application provide a stimulation paradigm generation system, a brain-computer interface system, a detection method and a device. The stimulation paradigm generation system comprises: a display device for displaying a first sector ring visual stimulation block in a first disk ring and / or a second sector ring visual stimulation block in a second disk ring; the sector ring visual stimulation block is a part of a sector ring unit included in the disk ring, and is formed by flashing according to a coding frequency corresponding to each sector ring unit; a stimulation reflection device for reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along a target direction, so as to present visual stimulation to a user in at least one first visual field sector ring in a first visual field corresponding to the first sector ring stimulation block image, and / or in at least one second visual field sector ring in a second visual field corresponding to the second sector ring stimulation block image; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first visual field sector ring corresponds one-to-one to the position of the sector ring unit at the first sector ring visual stimulation block; the second visual field sector ring corresponds one-to-one to the position of the sector ring unit at the second sector ring visual stimulation block. This stimulation paradigm generation system uses the principle of binocular rivalry to detect the left and right eyes simultaneously, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

[0070] In order to make the invention purpose, technical scheme and advantages of the embodiments of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0071] Figure 1 A structural block diagram of a stimulation paradigm generation system according to an embodiment of the present application is shown, which comprises Figure 1 As can be seen from the structural block diagram, the stimulation paradigm generation system 100 includes a display device 101 and a stimulation reflex device 102 .

[0072] The display device 101 is used to display the first sector ring visual stimulation block in the first disk ring 1011 and / or the second sector ring visual stimulation block in the second disk ring 1012; the sector ring visual stimulation block is a part of the sector ring unit included in the disk ring, and is formed by flashing according to the coding frequency corresponding to each sector ring unit;

[0073] The stimulation reflection device 102 is used to reflect the first fan ring stimulation block image and / or the second fan ring stimulation block image along the target direction to present visual stimulation to the user in at least one first field of view fan ring of the first field of view and / or at least one second field of view fan ring of the second field of view of the user; the target direction is the direction in which the stimulation reflection device 102 reflects the first center mark 1013 or the second center mark 1014 when the stimulation reflection device makes the first center mark 1013 of the first disk ring 1011 visually coincide with the second center mark 1014 of the second disk ring 1012; the first field of view fan ring corresponds one-to-one to the fan ring unit position at the first fan ring visual stimulation block; the second field of view fan ring corresponds one-to-one to the fan ring unit position at the second fan ring visual stimulation block.

[0074] In some embodiments of the present application, the first fan-ring visual stimulation block may be a left eye stimulation, and the second fan-ring visual stimulation block may be a right eye stimulation, and correspondingly, the first field of view is a left eye field of view, and the second field of view is a right eye field of view. In some other embodiments of the present application, the first fan-ring visual stimulation block may be a right eye stimulation, and the second fan-ring visual stimulation block may be a left eye stimulation, and correspondingly, the first field of view is a right eye field of view, and the second field of view is a left eye field of view. The present application does not make specific limitations on this.

[0075] Figure 1 In the stimulation paradigm generation system 100, the display device 101 is used to present left eye stimulation and right eye stimulation to the subject; the stimulation reflection device 102 is used to merge the left eye stimulation and right eye stimulation presented by the display device 101.

[0076] In some embodiments of the stimulation paradigm generation system 100, the first disk ring also includes a first closed inner ring, and the second disk ring also includes a second closed inner ring; the first disk ring and the first closed inner ring have the first center mark as the center, and the second disk ring and the second closed inner ring have the second center mark as the center; the sector ring unit is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings, when the center of the disk ring is taken as the axis and the part between the disk ring and the included inner ring is divided into equally divided sectors of the first threshold and concentric rings of the second threshold.

[0077] Figure 2 A schematic diagram showing the presentation layout of a display fan ring visual stimulation block of a stimulation paradigm generation system provided in an embodiment of the present application is shown, see Figure 2As shown, in the embodiment of the present application, the first disk ring 1011 also includes a first closed inner ring 1015, and the second disk ring 1012 also includes a second closed inner ring 1016; the first disk ring 1011 and the first closed inner ring 1015 take the first center mark 1013 as the center, and the second disk ring 1012 and the second closed inner ring 1016 take the second center mark 1014 as the center; the sector ring unit is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings, with the center of the disk ring as the axis, when the part between the disk ring and the included inner ring is divided into equally divided sectors of the first threshold and concentric rings of the second threshold. For example, taking the sector ring unit 1017 in the first disk ring 1011 as an example, the sector ring unit 1017 is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings when the first disk ring 1011 and the first closed inner ring 1015 included in the first disk ring 1011 are divided into equally divided sectors of the first threshold value and concentric rings of the second threshold value, with the first center mark 1013 in the first disk ring 1011 where the sector ring unit 1017 is located as the axis, wherein Figure 2 The value of the first threshold corresponding to the middle sector ring unit 1017 is 8, and the value of the second threshold is 2.

[0078] Figure 3 A schematic diagram of a stimulation paradigm of a stimulation paradigm generation system provided in an embodiment of the present application. Figure 3 As shown, the visual stimulation area corresponding to the human visual field is abstracted as a circle, for example Figure 3 The first disk ring 1011 in the left eye field corresponds to the first closed inner ring 1015; the central field of vision within the first closed inner ring 1015 is not designed with visual stimulation, assuming that this area corresponds to the central field of vision α 0 ; Divide the rest of the visual stimulus area, minus the central visual field, into m sectors (seg 1 ,seg 2 ,...,seg m ), the m sectors (seg 1 ,seg 2 ,...,seg m ) correspond to m polar angles (θ 1 ,θ 2 ,...,θ m ); using f k The frequency signal encodes m sectors; the remaining part after removing the central field of view is divided into n rings. 1 ,ring 2 ,...,ring n ), the n rings 1 ,ring 2 ,...,ring n) respectively correspond to n visual field degrees (α 1 ,α 2 ,...,α n ); merge the above equally divided sectors and rings to form m×n areas (area 1 ,area 2 ,...,area m×n ), that is, m×n sector ring units.

[0079] In some implementations of the stimulation paradigm generation system 100, for any disk ring, the number of types of encoding frequencies corresponding to the sector ring units included in any disk ring is not greater than a first threshold.

[0080] In specific implementation, using f k The frequencies encode and stimulate m different sectors of the disk, where f k ≤m. When conducting experiments on the stimulus paradigm generation system 100, the time taken to generate the stimulus pattern using f k,on The corresponding brain signal is obtained by stimulation of frequencies, where f k,on ≤f k .

[0081] In some embodiments of the stimulation paradigm generation system 100, in any disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; in any disk ring, the sector ring units contained in the same equally divided sector are configured with the same coding frequency.

[0082] In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equally divided sectors in each disk ring are configured with different coding frequencies, and the sector ring units contained in the same equally divided sector are configured with the same coding frequency. In this stimulation paradigm generation system, in the same disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies, and the sector ring units contained in the same equally divided sector are configured with the same coding frequency, thereby encoding the sector ring units with a smaller number of coding frequencies, while strengthening the difference in coding frequencies of the sector ring units in different equally divided sectors in the same disk ring, which can reduce the difficulty of brain signal feature extraction during simultaneous multi-frequency stimulation and can further improve the efficiency of stimulation detection.

[0083] In some embodiments of the stimulation paradigm generation system 100, in any disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; the coding frequency of any sector ring unit contained in the first disk ring is different from the coding frequency of any sector ring unit contained in the second disk ring.

[0084] In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equally divided sectors in each disk ring are configured with different coding frequencies, and the coding frequency of any sector ring unit contained in the first disk ring is different from the coding frequency of any sector ring unit contained in the second disk ring. In this stimulation paradigm generation system, in the same disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies, and the sector ring units contained in the equally divided sectors in different disk rings are configured with different coding frequencies, thereby encoding the sector ring units with a smaller number of coding frequencies, and at the same time strengthening the differences between the coding frequencies of the sector ring units in different disk rings, which can reduce the difficulty of extracting brain signal features during simultaneous multi-frequency stimulation and can further improve the efficiency of stimulation detection.

[0085] In some embodiments of the stimulation paradigm generating system 100, the encoding frequency of the sector ring units included in the first disk ring is the same as the encoding frequency of the sector ring units included in the second disk ring.

[0086] For example, the first disk ring and the second disk ring both utilize f k The m different sectors of the disk are coded and stimulated by frequencies respectively, and the coding frequencies used by the first disk ring and the second disk ring are also the same.

[0087] It is understandable that in some embodiments of the stimulation paradigm generation system 100, the first disk ring and the second disk ring can also use exactly the same coding frequency configuration. Specifically, for the first disk ring and the second disk ring, the division of their sector ring units is exactly the same, the number of frequencies is the same, the coding frequency is the same, and the configuration relationship between the coding frequency and the sector ring unit is also the same. Exemplarily, the configuration relationship between the coding frequency and the sector ring unit is also the same, which can be, assuming that the same coding rules are adopted for the sector ring units in the first disk ring and the second disk ring, for any sector ring unit area' of the first disk ring i , any sector ring unit area of ​​the second disk ring r If the numbers of the two are the same, that is, i=r, then it is a sector ring unit area' i and fan ring unit area" r The configured encoding frequencies are the same.

[0088] The stimulation paradigm generation system of the present application can be used to detect the function of peripheral visual field neural pathways, such as glaucoma, cataracts, macular degeneration, optic neuritis, papilledema, etc.; it can also be used to detect the extent of degenerative diseases, such as Parkinson's disease, Alzheimer's disease, amyotrophic lateral sclerosis, head trauma or other cognitive disorders (such as aphasia, the subject confuses the order of each word in the vocabulary or even the order of the entire sentence, which can also be manifested as an obvious loss of neural parsing packages); it can also be used for the diagnosis of multiple sclerosis, wherein multiple sclerosis affects neurons and its effects are intermittent, but at least in the early stages of the disease, there is a tendency for cells to recover, therefore, it can be expected that the confirmed visual field loss area will move in the peripheral visual field over time, or temporarily recover; when the disease progresses to the point where there are many areas of visual field loss on the retina, the missing areas will always exist and cannot be recovered.

[0089] An embodiment of the present application also provides a brain-computer interface system, including a stimulation paradigm generation system of any one of the above embodiments. The stimulation paradigm generation system of the brain-computer interface system utilizes the principle of binocular rivalry to simultaneously detect the left and right eyes and analyze brain signals, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

[0090] Figure 4 FIG. 2 shows a structural block diagram of a brain-computer interface system provided by an embodiment of the present application. Figure 4 As shown, the brain-computer interface system 400 includes the stimulation paradigm generation system 100 of any one of the above embodiments; and further includes:

[0091] The data acquisition device 401 is used to collect brain signals generated by the subject; the brain signals are generated by the left and right eyes of the subject based on the visual stimulation of the stimulation paradigm generation system 100; the brain signals include multifocal steady-state visual evoked potential mfSSVEP;

[0092] The data processing device 402 is used to obtain brain signals, analyze the brain signals, and generate an evaluation result of the user's peripheral vision.

[0093] According to the multifocal steady-state visual evoked potential response mechanism, a normal eye with a healthy visual pathway can produce a stable and strong response to stimulation in any divided area; while an abnormal eye with visual impairment does not produce a response at the defect location or produces a weaker response than other areas.

[0094] In some embodiments of the present application, the evaluation result of the user's peripheral visual field is specifically information indicating whether there is a visual field sector ring indicating impaired visual function in the user's peripheral visual field.

[0095] Traditional visual brain-computer interfaces mostly use time division multiple access or frequency division multiple access coding strategies. Time division multiple access allows multiple users to share the same communication channel by dividing the signal into different time slots, which is most common in brain-computer interfaces based on event-related potentials (such as P300 potential, mVEP potential); frequency division multiple access divides the entire frequency band into multiple independent frequency bands, each for different users, and the brain-computer interface based on SSVEP is a typical frequency division multiple access system.

[0096] The multifocal steady-state visual evoked potential paradigm of the brain-computer interface system of the embodiment of the present application takes into account both frequency division multiple access and space division multiple access, significantly improving the coding efficiency of instructions. Among them, space division multiple access divides the geographical space into smaller spaces of multiple targets. The mfSSVEP paradigm designed in the present application is based on SSVEP, and frequency division multiple access is achieved by encoding signals of multiple frequencies; at the same time, the mfSSVEP paradigm designed by the present invention achieves space division multiple access by encoding multiple frequency signals at different positions of the same stimulation instruction; using binocular rivalry equipment, the paradigm designed by the present invention can stimulate the left and right eyes at different frequencies and different positions at the same time, and also achieves space division multiple access. The brain-computer interface system of the embodiment of the present application uses the mfSSVEP paradigm and binocular rivalry equipment to realize the feasibility of integrating frequency division multiple access and space division multiple access of the brain-computer interface, which is of great significance to improving the performance of the brain-computer interface.

[0097] In some embodiments of the brain-computer interface system 400 , the brain signal is one of: an electroencephalogram (EEG) signal, a magnetoencephalogram (MEG) signal, and a functional near infrared spectroscopy (fNIRS) signal.

[0098] The brain-computer interface system of the present application may use brain signal acquisition methods including but not limited to electroencephalogram (EEG), magnetoencephalography (MEG) and functional near-infrared spectroscopy (fNIRS).

[0099] In some embodiments of the brain-computer interface system 400, the data processing device 402 is specifically configured to:

[0100] Extract features of brain signals to obtain feature signal information;

[0101] The characteristic signal information is subjected to variable correlation analysis to obtain correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's peripheral vision.

[0102] In specific implementation, the brain-computer interface system 400 presents visual stimulation through a display device. The visual stimulation is encoded using the multi-focal steady-state visual evoked paradigm designed by the present invention, including a first fan-ring visual stimulation block and a second fan-ring visual stimulation block presented on the left and right of the screen respectively; through a stimulus reflection device, the first fan-ring visual stimulation block and the second fan-ring visual stimulation block presented in the display device are reflected to the subject by a mirror; the subject adjusts the mirror of the stimulus reflection device to achieve a binocular rivalry effect so that the two visual stimuli overlap in the eyes; the brain signal generated by the user's operation intention is collected by a data acquisition device 401, and analog signal processing such as denoising and amplification and A / D conversion are completed; through a data processing device 402, a brain signal decoding method is used to perform feature processing and pattern recognition of brain signals. Specifically, feature extraction is performed on brain signals to obtain feature signal information; variable correlation analysis is performed on the feature signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's peripheral visual field.

[0103] In some embodiments of the present application, the variable correlation analysis is specifically to identify the multifocal steady-state visual evoked potential mfSSVEP using filter bank canonical correlation analysis (FBCCA). Canonical correlation analysis (CCA) is a method for studying the correlation between two groups of variables, which finds the projection matrix of two groups of high-dimensional vectors and uses it to reduce the dimension of the high-dimensional vectors so that the correlation between the two vectors after the dimension reduction is maximized.

[0104] The following embodiments of the present application are described by taking the brain signal as an EEG signal as an example. is the sine and cosine reference signal, where N c is the number of leads, N p is the number of sampling points, N h is the number of harmonics. The sine-cosine reference signal Y includes both the fundamental wave and the harmonics.

[0105] The expression of Y is as follows:

[0106]

[0107] in,

[0108] f is the stimulation frequency;

[0109] s is the sampling rate;

[0110] t is the time point.

[0111] The canonical correlation analysis CCA process is shown in the following formula:

[0112]

[0113] in,

[0114] x is the signal after spatial filtering of X,

[0115] y is the signal of Y after spatial filtering,

[0116] W X A projection matrix representing the dimension reduction of the EEG signal X;

[0117] W Y A projection matrix representing the dimension reduction of the sine and cosine reference signals Y;

[0118] E[·] represents the operation of taking the expected value;

[0119] T represents the matrix transpose operation.

[0120] The FBCCA adopted in the embodiment of the present application is an improvement on CCA. On the basis of CCA, the fundamental frequency, second harmonic, third harmonic, and fifth harmonic of the stimulation frequency are filtered out in sequence by using the design of different frequency bands of the filter, and finally a discriminant analysis is performed. The correlation coefficient matrix obtained by the FBCCA algorithm is subjected to coefficient fusion according to the following formula.

[0121]

[0122] Where, N = 6, is the total number of filter banks;

[0123] j is the index of the sub-filter;

[0124] k is the index number of the stimulation frequency f;

[0125] ρ k is the correlation coefficient matrix obtained by FBCCA algorithm in different frequency bands;

[0126] a and b are two preset constants.

[0127] Through the filter band typical correlation analysis FBCCA, a series of correlation coefficient values ​​are finally obtained Select the largest value as the output result.

[0128] In some embodiments of the brain-computer interface system 400, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where no visual stimulation is applied; the second brain signal is a brain signal in a state where visual stimulation is applied;

[0129] The data processing device 402 is specifically configured to:

[0130] Performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein the first characteristic signal information is obtained by extracting features from the first brain signal; and the second characteristic signal information is obtained by extracting features from the second brain signal;

[0131] Correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

[0132] In the specific implementation, the data of the EEG signal in the task state and the data of the brain signal in the resting state can be processed separately. Among them, the task state is the state of applying visual stimulation; the resting state is the state of not applying visual stimulation. The processing process of the data of the EEG signal in the task state is specifically, firstly filtering the data of the original EEG signal through the filter bank Filter Bank to form multiple groups of signal data of different frequency bands after filtering, and then calculating the CCA coefficients of the signal data of different frequency bands through the CCA algorithm, and using the above formula to fuse the coefficients to obtain the coefficients in the task state. The processing process of the data of the EEG signal in the resting state is the same as the processing process of the EEG signal data in the task state, and is filtered and calculated by the filter bank Filter Bank in turn, and the coefficients are fused to obtain the coefficients in the resting state. Finally, according to the coefficients in the task state and the coefficients in the resting state, the correlation coefficient result information is obtained.

[0133] In some embodiments of the present application, the correlation coefficient result information is obtained based on the coefficient in the task state and the coefficient in the resting state, specifically, the coefficient in the task state is subtracted from the coefficient in the resting state to obtain the final correlation coefficient result information.

[0134] The brain-computer interface system of the above-mentioned embodiment uses the above-mentioned decoding algorithm to analyze the brain signal data in the stimulated task state and the unstimulated resting state respectively, obtains the output results of the coefficients in the task state and the coefficients in the resting state, and combines the decoding results of the brain signal data in the two states to obtain more stable feature analysis data values, which can shorten the duration of visual stimulation, improve the efficiency of stimulation detection, and improve the accuracy of the evaluation results of the user's peripheral visual field.

[0135] The brain-computer interface system provided in the embodiment of the present application can be used to monitor the function of peripheral visual field neural pathways. The brain-computer interface system can improve the accuracy of determining the health level of the subject's visual pathway and the degree of visual function impairment.

[0136] Based on the same inventive concept as the brain-computer interface system provided in the above embodiment, the present application embodiment further provides a stimulation paradigm detection method. Figure 5 Figure 2 is a flow chart of the method. Figure 5 As shown, the stimulation paradigm detection method comprises:

[0137] Step S501 : presenting visual stimulation to a user in at least one first field of view sector ring of a first field of view of the user, and / or at least one second field of view sector ring of a second field of view of the user.

[0138] Wherein, the visual stimulation is presented by displaying the first sector-ring visual stimulation block in the first disk ring, and / or the second sector-ring visual stimulation block in the second disk ring, and reflecting the first sector-ring stimulation block image and / or the second sector-ring stimulation block image along the target direction; the sector-ring visual stimulation block is a part of the sector-ring unit included in the disk ring, and is formed by flashing according to the coding frequency corresponding to each sector-ring unit; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first field of view sector ring corresponds one-to-one to the position of the sector ring unit at the first sector ring visual stimulation block; the second field of view sector ring corresponds one-to-one to the position of the sector ring unit at the second sector ring visual stimulation block.

[0139] In a specific implementation, the fan ring visual stimulation block can be formed by selecting a part of the fan ring units included in the disk ring as the target fan ring units, so that the target fan ring units are flashed according to the coding frequency corresponding to each fan ring unit in the target fan ring units.

[0140] For the fan-ring unit in the fan-ring visual stimulation block, the flickering waveform must be periodic, and the frequency should usually be above 7Hz. The flickering waveform can be in the shape of a sine wave, square wave, triangle wave, sawtooth wave, etc. In the RGB space, any two colors can be selected, and the value range is between [0,0,0] and [255,255,255], corresponding to the troughs and peaks in the waveform diagram. The two colors gradually change frame by frame and appear alternately at a certain period, presenting a stable flickering stimulus.

[0141] In the embodiment of the present application, the stimulus reflex device is a binocular rivalry device. During the stimulus paradigm detection process, the subject adjusts the reflection angle of the lens of the binocular rivalry device so that the left and right stimuli presented in the display device overlap in the eyes. In order to achieve binocular rivalry, the embodiment of the present application can use a variety of devices, such as red and blue glasses, binocular prisms, etc. The embodiment of the present application does not limit the specific form of the stimulus reflex device used to achieve binocular rivalry.

[0142] Step S502, collecting brain signals.

[0143] Among them, the brain signals are generated by the user's left and right eyes based on visual stimulation; the brain signals include multifocal steady-state visual evoked potentials mfSSVEP.

[0144] Step S503: acquiring brain signals, analyzing the brain signals, and generating an evaluation result of the user's peripheral vision.

[0145] In some embodiments of the present application, during the stimulation paradigm detection process, the subject's brain signals can be collected through electrodes, amplified by an amplifier, and filtered to form data information, which is then analyzed to generate an evaluation result of the user's peripheral vision.

[0146] This stimulation paradigm detection method provides a mechanism for extracting features from brain signals and performing variable correlation analysis to obtain correlation coefficient result information, which is used to generate an evaluation result of the user's peripheral visual field, which can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

[0147] In an optional embodiment, presenting visual stimulation to the user in at least one first field of view sector ring of the user's first field of view and / or at least one second field of view sector ring of the user's second field of view includes:

[0148] In response to receiving the first stage detection instruction, presenting visual stimulation to the user in at least one first visual field sector ring of the user's first visual field and at least one second visual field sector ring of the user's second visual field, so as to detect each first visual field sector ring of the user's first visual field and each second visual field sector ring of the user's second visual field;

[0149] If a second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view sector ring to detect the user's target field of view sector ring; the target field of view sector ring is a first field of view sector ring selected in the first field of view, or a second field of view sector ring selected in the second field of view.

[0150] For example, assume that the non-stimulated central visual field portion of the disk ring corresponds to a visual field of 3° (α 0 =1.5°), the first threshold m is 4, the second threshold n is 2, then the remaining part of the central field of view is divided into 4 equal sectors (θ 1 =0°~90°,θ 2 =90°~180°,θ 3 =-180°~-90°,θ 4 =-90°~0°), 2 rings (α 1 =3.5°,α 2 =7.5°), and configure sinusoidal stimulation with different encoding frequencies for each equally divided sector, for example, it can be θ1 The area where the equally divided sectors are located is 13Hz, θ 2 The area where the equally divided sectors are located is 15Hz, θ 3 The area where the equally divided sectors are located is 17Hz, θ 4 The area where the equally divided sectors are located is 19Hz. That is, different sector ring areas of the same sector use the same frequency information encoding, thereby dividing the area outside the central visual field without stimulation on any disk ring into 8 sector ring areas. At this time, the number of types of encoding frequencies corresponding to the sector ring units included in any disk ring is f k is 4, the first threshold m is 4, and the number of types satisfying the coding frequency is not greater than the first threshold. Assume that the two disk rings are disk ring A and disk ring B, and disk ring A and disk ring B correspond to the left eye field of view and the right eye field of view respectively.

[0151] During the experiment, the first detection stage was used to locate the area of ​​visual impairment, and the second detection stage was used to further accurately locate the area of ​​visual impairment, so as to more accurately assess the degree of visual impairment. Specifically, in the first detection stage, different positions of both eyes were detected at the same time, and four frequency stimulations (f k,on =4), and simultaneously record the brain signal response of multifocal steady-state visual evoked potential, traversing all positions (8 sector ring areas) flashing. According to the decoding algorithm of the present invention, assuming that the upper left part of the disk ring A (θ 1 =0°~90°,α 1 =3.5°, α 2 =7.5°) sector ring area induced a weak response. 1 =0°~90°,α 1 =3.5°, α 2 =7.5°) sector ring area, which is divided into equally divided sectors (θ 1 =0°~90°), ring (α 1 =3.5°) and annulus (α 2 =7.5°) determined by the fan ring area.

[0152] In the second detection stage, according to the position determined in the first detection stage, that is, the upper left part of the disk ring A (θ 1 =0°~90°,α 1 =3.5°, α 2 =7.5°) sector ring area, single frequency stimulation is performed to exclude the influence of other factors other than visual field defect on the decoding result of detection stage 1. Assuming that the brain signal recorded by the stimulation of detection stage 2 is analyzed by the decoding algorithm of the present invention, the amplitude of the position response is still weak, and the upper left part of the disc ring A is determined to be (θ 1 =0°~90°,α 1 =3.5°, α 2=7.5°,) the visual field sector ring area position corresponds to the loss of visual function.

[0153] In some embodiments of the present application, the brain-computer interface system 400 can further accurately locate the degree of visual function impairment. Specifically, by reducing the stimulus size, for example, constructing a fan-shaped ring visual stimulus block (θ n_1 =0°~45°, α 1 =3.5°, α 2 =7.5°;θ n_2 =45°~90°, α 1 =3.5°, α 2 =7.5°), continue the experiment. Use the decoding strategy of the present invention for analysis. If (θ n_1 , α 1 , α 2 )The position response of the fan ring area is weak, (θ n_2 , α 1 , α 2 )The fan ring area position response is strong, then it is determined that (θ n_1 , α 1 , α 2 )The visual field sector corresponding to the sector area is the location of visual function loss; conversely, if (θ n_1 , α 1 , α 2 )The fan ring area has a strong position response, (θ n_2 , α 1 , α 2 )The position response of the sector ring area is weak, then it is determined that (θ n_2 , α 1 , α 2 )The visual field sector ring corresponding to the sector ring area position is the visual function defect position; if (θ n_1 , α 1 , α 2 ) sector ring area position and (θ n_2 , α 1 , α 2 )The position response of the sector ring area is weak, then it is determined that (θ 1 =0°~90°,α 1 =3.5°, α 2 =7.5°) The visual field sector ring corresponding to the sector ring area position is the location of visual function loss.

[0154] The stimulation paradigm detection method provides a distributed detection mechanism, which can detect each first field of view fan ring of the user's first field of view and each second field of view fan ring of the user's second field of view in response to receiving a first-stage detection instruction, and can locate the target field of view fan ring whose evaluation result meets the preset conditions in the first field of view and the second field of view, and present visual stimulation to the user in the user's target field of view fan ring according to the second-stage detection instruction to detect the user's target field of view fan ring, so as to evaluate the user's field of view more accurately.

[0155] and Figure 5 The stimulation paradigm detection method shown is based on the same inventive concept. In the embodiment of the present application, a stimulation paradigm detection device is also provided, which is arranged in a brain-computer interface system, for example Figure 4 The brain-computer interface system 400. Since the device is a device corresponding to the stimulation paradigm detection method of the present application, and the principle of solving the problem by the device is similar to that of the method, the implementation of the device can refer to the implementation of the above method, and the repeated parts will not be repeated.

[0156] Figure 6 FIG. 1 shows a schematic diagram of a stimulation paradigm detection device provided in an embodiment of the present application. The stimulation paradigm detection device is arranged in a brain-computer interface system, such as Figure 6 As shown, it includes a stimulation paradigm generating module 601 , a signal collecting module 602 and a data processing module 603 .

[0157] The stimulation paradigm generation module 601 is used to present visual stimulation to the user in at least one first visual field sector ring of the user's first visual field, and / or at least one second visual field sector ring of the user's second visual field; the visual stimulation is presented by displaying a first sector ring visual stimulation block in the first disk ring, and / or a second sector ring visual stimulation block in the second disk ring, and reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along the target direction; the sector ring visual stimulation block is a part of the sector ring unit included in the disk ring, and is formed by flashing according to the coding frequency corresponding to each sector ring unit; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first visual field sector ring corresponds to the sector ring unit position at the first sector ring visual stimulation block one by one; the second visual field sector ring corresponds to the sector ring unit position at the second sector ring visual stimulation block one by one;

[0158] The signal acquisition module 602 is used to collect brain signals; the brain signals are generated by the left and right eyes of the user based on visual stimulation; the brain signals include multifocal steady-state visual evoked potentials mfSSVEP;

[0159] The data processing module 603 is used to obtain brain signals, analyze the brain signals, and generate an evaluation result of the user's peripheral vision.

[0160] In an optional embodiment, the data processing module 603 is specifically configured to:

[0161] Extract features of brain signals to obtain feature signal information;

[0162] The characteristic signal information is subjected to variable correlation analysis to obtain correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's peripheral vision.

[0163] In an optional embodiment, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where no visual stimulation is applied; the second brain signal is a brain signal in a state where visual stimulation is applied;

[0164] The data processing module 603 is specifically used for:

[0165] Performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein the first characteristic signal information is obtained by extracting features from the first brain signal; and the second characteristic signal information is obtained by extracting features from the second brain signal;

[0166] Correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

[0167] In an optional embodiment, the stimulation paradigm generation module 601 is specifically used for:

[0168] In response to receiving the first stage detection instruction, presenting visual stimulation to the user in at least one first visual field sector ring of the user's first visual field and at least one second visual field sector ring of the user's second visual field, so as to detect each first visual field sector ring of the user's first visual field and each second visual field sector ring of the user's second visual field;

[0169] If a second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view sector ring to detect the user's target field of view sector ring; the target field of view sector ring is a first field of view sector ring selected in the first field of view, or a second field of view sector ring selected in the second field of view.

[0170] Based on the same inventive concept as the above method embodiment, an electronic device is also provided in the embodiment of the present application. The electronic device can be used for stimulation paradigm detection. In one embodiment, the electronic device can be a server or other electronic device. In this embodiment, the structure of the electronic device can be as follows: Figure 7 As shown, it includes a memory 701 , a communication module 703 and one or more processors 702 .

[0171] The memory 701 is used to store computer programs executed by the processor 702. The memory 701 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and programs required for running the instant messaging function, etc.; the data storage area may store various instant messaging information and operation instruction sets, etc.

[0172] The memory 701 may be a volatile memory, such as a random-access memory (RAM); the memory 701 may also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), or the memory 701 may be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 701 may be a combination of the above memories.

[0173] The processor 702 may include one or more central processing units (CPU) or a digital processing unit, etc. The processor 702 is used to implement the above-mentioned stimulation paradigm detection method when calling the computer program stored in the memory 701 .

[0174] The communication module 703 is used to communicate with terminal devices or other servers.

[0175] The specific connection medium between the memory 701, the communication module 703 and the processor 702 is not limited in the embodiment of the present application. Figure 7 In the embodiment, the memory 701 and the processor 702 are connected via a bus 704. The bus 704 is connected to the processor 702 via a bus 704. Figure 7 The connections between other components are shown in bold lines, which are only for illustration and are not intended to be limiting. Bus 704 can be divided into address bus, data bus, control bus, etc. For ease of illustration, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0176] An embodiment of the present application further provides a computer storage medium, in which computer executable instructions are stored. The computer executable instructions are used to implement the stimulation paradigm detection method of any embodiment of the present application.

[0177] According to one aspect of the present application, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions so that the computer device performs the stimulation paradigm detection method in the above-mentioned embodiment. The program product can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0178] The above description is only a specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. A stimulation paradigm generation system, characterized in that: The system comprises: A display device is used to display a first sector ring visual stimulation block in the first disk ring and / or a second sector ring visual stimulation block in the second disk ring; the sector ring visual stimulation block is a part of the sector ring unit included in the disk ring, and is formed by flashing according to the coding frequency corresponding to each of the sector ring units; A stimulation reflection device, used for reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along a target direction, so as to present visual stimulation to the user in at least one first field of view sector ring of the first field of view, and / or at least one second field of view sector ring of the second field of view of the user correspondingly; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first field of view sector ring corresponds to the sector ring unit position at the first sector ring visual stimulation block in one-to-one correspondence; the second field of view sector ring corresponds to the sector ring unit position at the second sector ring visual stimulation block in one-to-one correspondence; the first disk ring also includes a first closed inner ring, the first inner ring includes a second inner ring, and the second inner ring includes a first inner ring. The two disk rings also include a second closed inner ring; the first disk ring and the first closed inner ring have the first center mark as the center, and the second disk ring and the second closed inner ring have the second center mark as the center; the fan ring unit is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings, when the part between the disk ring and the included inner ring is divided into equally divided sectors of the first threshold and concentric rings of the second threshold with the center of the disk ring as the axis; the interior of the first closed inner ring and the interior of the second closed inner ring do not display fan ring visual stimulation blocks; in any disk ring, the fan ring units contained in different equally divided sectors are configured with different coding frequencies; in any disk ring, the fan ring units contained in the same equally divided sector are configured with the same coding frequency.

2. The system according to claim 1, characterized in that For any circular disk ring, the number of types of the coding frequencies corresponding to the sector ring units included in the circular disk ring is not greater than the first threshold.

3. The system according to claim 2, characterized in that In any circular disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; the coding frequency of any sector ring unit contained in the first circular disk ring is different from the coding frequency of any sector ring unit contained in the second circular disk ring.

4. A brain-computer interface system, characterized in that: The stimulation paradigm generation system comprising any one of claims 1 to 3 above; the brain-computer interface system further comprising: A data acquisition device, for acquiring brain signals generated by a subject; the brain signals are generated by the left and right eyes of the subject based on the visual stimulation of the stimulation paradigm generation system described in any one of claims 1 to 3; the brain signals include multifocal steady-state visual evoked potentials (mfSSVEP); The data processing device is used to acquire the brain signal, analyze the brain signal, and generate an evaluation result of the user's peripheral vision.

5. The system according to claim 4, characterized in that The brain signal is one of the following: an electroencephalogram (EEG) signal, a magnetoencephalogram (MEG) signal, and a functional near infrared spectroscopy (fNIRS) signal.

6. The system according to claim 4, characterized in that The data processing device is specifically used for: Extracting features from the brain signal to obtain feature signal information; Perform variable correlation analysis on the characteristic signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result of the user's peripheral vision.

7. The system according to claim 6, characterized in that The brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulation is not applied; the second brain signal is a brain signal in a state where the visual stimulation is applied; The data processing device is specifically used for: Performing variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and performing variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein the first characteristic signal information is obtained by extracting features from the first brain signal; and the second characteristic signal information is obtained by extracting features from the second brain signal; The correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

8. A stimulation paradigm detection method, characterized in that: The method comprises: Visual stimulation is presented to the user in at least one first visual field sector ring of the user's first visual field, and / or at least one second visual field sector ring of the user's second visual field; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disk ring, and / or a second sector ring visual stimulation block in a second disk ring, and reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along a target direction; the sector ring visual stimulation block is a part of a sector ring unit included in a disk ring, and is formed by flashing according to a coding frequency corresponding to each of the sector ring units; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first visual field sector ring corresponds one-to-one to the position of the sector ring unit at the first sector ring visual stimulation block; the second visual field sector ring corresponds one-to-one to the position of the sector ring unit at the first sector ring visual stimulation block The positions of the fan ring units at the visual stimulation blocks of the fan ring and the second fan ring correspond one to one; the first disk ring also includes a first closed inner ring, and the second disk ring also includes a second closed inner ring; the first disk ring and the first closed inner ring use the first center mark as the center, and the second disk ring and the second closed inner ring use the second center mark as the center; the fan ring unit is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings when the part between the disk ring and the included inner ring is divided into equally divided sectors of the first threshold and concentric rings of the second threshold with the center of the disk ring as the axis; the interior of the first closed inner ring and the interior of the second closed inner ring do not display the fan ring visual stimulation blocks; in any disk ring, the fan ring units contained in different equally divided sectors are configured with different coding frequencies; in any disk ring, the fan ring units contained in the same equally divided sector are configured with the same coding frequency; Collecting brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potentials (mfSSVEP); The brain signal is acquired, analyzed, and an evaluation result of the user's peripheral vision is generated.

9. The method according to claim 8, characterized in that Presenting visual stimulation to the user in at least one first field of view sector ring of the user's first field of view, and / or at least one second field of view sector ring of the user's second field of view, comprises: In response to receiving the first-stage detection instruction, presenting visual stimulation to the user in at least one first visual field sector ring of the user's first visual field and at least one second visual field sector ring of the user's second visual field, so as to detect each first visual field sector ring of the user's first visual field and each second visual field sector ring of the user's second visual field; If a second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view fan ring to detect the user's target field of view fan ring; the target field of view fan ring is a first field of view fan ring selected in the first field of view, or a second field of view fan ring selected in the second field of view.

10. A stimulation paradigm detection device, characterized in that: The device comprises: A stimulation paradigm generation module, used for presenting visual stimulation to the user in at least one first visual field sector ring of the user's first visual field, and / or at least one second visual field sector ring of the user's second visual field; the visual stimulation is presented by displaying a first sector ring visual stimulation block in a first disk ring, and / or a second sector ring visual stimulation block in a second disk ring, and reflecting the first sector ring stimulation block image and / or the second sector ring stimulation block image along a target direction; the sector ring visual stimulation block is a part of a sector ring unit included in a disk ring, and is formed by flashing according to a coding frequency corresponding to each sector ring unit; the target direction is the direction in which the stimulation reflection device reflects the first center mark or the second center mark when the stimulation reflection device makes the first center mark of the first disk ring visually coincide with the second center mark of the second disk ring; the first visual field sector ring corresponds to the sector ring unit position at the first sector ring visual stimulation block one by one; The second visual field sector ring corresponds to the sector ring unit position at the second sector ring visual stimulation block in a one-to-one manner; the first disk ring also includes a first closed inner ring, and the second disk ring also includes a second closed inner ring; the first disk ring and the first closed inner ring use the first center mark as the center, and the second disk ring and the second closed inner ring use the second center mark as the center; the sector ring unit is a graphic unit formed by the intersection of the equally divided sectors and the concentric rings when the part between the disk ring and the included inner ring is divided into equally divided sectors of the first threshold and concentric rings of the second threshold with the center of the disk ring as the axis; the interior of the first closed inner ring and the interior of the second closed inner ring do not display the sector ring visual stimulation block; in any disk ring, the sector ring units contained in different equally divided sectors are configured with different coding frequencies; in any disk ring, the sector ring units contained in the same equally divided sector are configured with the same coding frequency; A signal acquisition module, used for acquiring brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potentials (mfSSVEP); The data processing module is used to acquire the brain signal, analyze the brain signal, and generate an evaluation result of the user's peripheral vision.

11. A server, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program executable on the processor, and when the computer program is executed by the processor, the method described in claim 8 or 9 is implemented.

12. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, characterized in that: When the computer program is executed by a processor, the method according to claim 8 or 9 is implemented.

Citation Information

Patent Citations

  • Method and device for evaluating projection content in enclosed environment, and storage medium

    CA3142060A1

  • Portable brian activity sensing platform for assessment of visual field deficits

    CN106455968A

  • Systems, methods, and devices for measuring eye movement and pupil response

    CN106793942A

  • P300-SSVEP-based brain-computer interface method of large instruction set

    CN107656612A

  • Systems and methods for visual field analysis

    CN111587086A