Near-infrared brain imaging system and method based on human intelligence and edge device

Abstract

The invention discloses a human factor intelligence-based near-infrared brain imaging system and method and edge device.The human factor intelligence-based near-infrared brain imaging system comprises a plurality of near-infrared brain imaging devices, each near-infrared brain imaging device comprises a head wearing device, a light source and a detector, the light source and the detector are arranged on the head wearing device, and the head wearing device is connected with the near-infrared brain imaging devices; under the condition that a testee wears the head wearing device and receives stimulation of brain region stimulation information, the light source provides an input signal of a brain region, and the detector receives an output signal of the brain region and determines brain blood oxygen concentration change data based on the output signal; the plurality of host devices are synchronized through a time synchronization mechanism, the plurality of host devices are in one-to-one correspondence with the plurality of near-infrared brain imaging devices, and each host device is in communication connection with the corresponding near-infrared brain imaging device; each host device is configured to output brain region stimulation information, obtain brain blood oxygen concentration change data and perform data processing.

Description

Technical Field

[0001] The present invention relates to the technical field of brain imaging, and in particular to a near-infrared brain imaging system, method and edge device based on human intelligence. Background Art

[0002] With the advancement of artificial intelligence technology, near-infrared functional brain imaging (fNIRS) technology has also been developed. By measuring the difference in the near-infrared light absorption rate of oxygenated hemoglobin and deoxygenated hemoglobin in brain tissue, information related to brain function can be obtained, providing researchers with an opportunity to gain a deeper understanding of brain function.

[0003] The related technical solutions have problems in data acquisition quality, flexibility and real-time performance of the near-infrared brain imaging system, which cannot realize simultaneous detection of multiple people. In addition, the experimental design, data processing and analysis process of the brain imaging system is relatively complex, and its efficiency needs to be improved. Summary of the invention

[0004] The embodiments of the present invention are intended to solve at least one of the technical problems in the related art to a certain extent. To this end, one object of the present invention is to propose a near-infrared brain imaging system, method, edge device and storage medium based on human intelligence that can improve efficiency and support data synchronization.

[0005] The embodiment of this specification provides a near-infrared brain imaging system based on human factors intelligence, and the near-infrared brain imaging system includes: multiple near-infrared brain imaging devices, each of which includes a head-mounted device, a light source and a detector, and the light source and the detector are arranged on the head-mounted device. When the subject wears the head-mounted device and receives stimulation of brain area stimulation information, the light source provides an input signal to the brain area, and the detector receives an output signal from the brain area and determines brain blood oxygen concentration change data based on the output signal; multiple host devices, the multiple host devices are synchronized through a time synchronization mechanism, the multiple host devices correspond to the multiple near-infrared brain imaging devices one by one, each host device is communicatively connected with the corresponding near-infrared brain imaging device, and each host device is configured to output brain area stimulation information and obtain brain blood oxygen concentration change data and perform data processing.

[0006] Exemplarily, the near-infrared brain imaging device also includes: a signal amplifier, electrically connected to the light source and the detector, the signal amplifier is used to perform analog-to-digital conversion and signal amplification, the signal amplifier is configured to send a light source control signal to the light source so that the light source generates an input signal based on the light source control signal, and the signal amplifier is also configured to send brain blood oxygen concentration change data from the detector to a signal receiver; a signal receiver, connected to the signal amplifier and a host device, and configured to send brain blood oxygen concentration change data from the signal amplifier to the host device.

[0007] Exemplarily, after the output time of brain region stimulation information is set in one of multiple host devices, the output time of the brain region stimulation information is synchronized to other host devices among the multiple host devices through a time synchronization mechanism, so as to perform brain region stimulation on multiple subjects at the same time.

[0008] Exemplarily, the near-infrared brain imaging system also includes: a data acquisition module, configured to perform at least one of data sampling rate configuration, channel configuration, light source power configuration and brain region configuration, the data acquisition module can adjust the light source power according to the ambient light, the light source and the detector form at least one channel, the channel corresponds to the brain region, and the brain blood oxygen concentration change data of the corresponding brain region is collected by configuring the channel; the data acquisition module is also configured to correct the optical path length of the output signal based on the local path length factor, so as to obtain the brain blood oxygen concentration change data based on the corrected output signal.

[0009] Exemplarily, the near-infrared brain imaging system also includes at least one of the following: a real-time processing and analysis module, configured to perform data processing based on the brain blood oxygen concentration change data to obtain blood oxygen concentration change information of each brain region; an AI chip, including a cognitive processing model, the AI ​​chip is configured to input the brain blood oxygen concentration change data into the cognitive processing model, and output the cognitive analysis results through the cognitive processing model.

[0010] Exemplarily, different cognitive tasks correspond to different brain area stimulation information, and the near-infrared brain imaging system also includes: a post-analysis module, which is configured to display the dynamic changes of cerebral blood oxygen concentration during the execution of cognitive tasks, configure the attributes of cognitive events to obtain corresponding collected data and analyze them, output cerebral blood oxygen concentration change indicators and / or event-related superposition analysis indicators, and select at least one of the collected data corresponding to the channel for analysis.

[0011] Exemplarily, the near-infrared brain imaging system also includes: a three-dimensional spatial positioning module, which is configured to perform spatial modeling based on the head-mounted device, the light source and the detector to obtain a three-dimensional model, the three-dimensional model including the coordinates of the light source and the coordinates of the detector, the coordinates of the light source and the coordinates of the detector correspond to the brain area, after obtaining the cerebral blood oxygen concentration change data, determine the coordinates of the light source and the coordinates of the detector corresponding to the cerebral blood oxygen concentration change data, and locate the active brain area based on the coordinates of the light source and the coordinates of the detector.

[0012] Exemplarily, the host device is configured to output brain region stimulation information according to a cognitive task, and the cognitive task includes at least one of the following: a brain function localization task, wherein the host device is configured to output the same type of brain region stimulation information within a time window according to the brain function localization task, and determine the activated brain region by collecting and analyzing the cerebral blood oxygen concentration change data of the entire brain region; a brain cognitive processing task, wherein the host device is configured to output different types of brain region stimulation information within multiple time periods according to the brain cognitive processing task, and obtain the activation state of the specific brain region by collecting and analyzing the cerebral blood oxygen concentration change data of the specific brain region; a brain activity analysis task, wherein the brain activity analysis task combines the brain function localization task and the brain cognitive processing task.

[0013] The embodiments of this specification provide a near-infrared brain imaging method based on human intelligence, and the near-infrared brain imaging method is implemented by any of the above-mentioned near-infrared brain imaging systems.

[0014] An embodiment of the present specification provides an edge device, the edge device is used to perform edge computing, the edge device is integrated with the above-mentioned near-infrared brain imaging system, or the edge device is capable of the above-mentioned near-infrared brain imaging method.

[0015] The embodiments of the present specification provide a computer-readable storage medium having a computer program stored thereon, and the computer program implements the above-mentioned near-infrared brain imaging method when executed by a processor.

[0016] In the above-mentioned embodiment of the specification, the near-infrared brain imaging system includes: a plurality of near-infrared brain imaging devices, each of which includes a head-mounted device, a light source and a detector, the light source and the detector are arranged on the head-mounted device, when the subject wears the head-mounted device and receives stimulation of brain area stimulation information, the light source provides an input signal to the brain area, the detector receives an output signal from the brain area and determines the cerebral blood oxygen concentration change data based on the output signal; a plurality of host devices, the plurality of host devices are synchronized through a time synchronization mechanism, the plurality of host devices correspond to a plurality of near-infrared brain imaging devices one by one, each host device is connected to the corresponding near-infrared brain imaging device for communication, and each host device is configured to output brain area stimulation information and obtain cerebral blood oxygen concentration change data and perform data processing. The above-mentioned head-mounted device can adapt to various experimental scenarios and personnel operation needs, improve the flexibility and convenience of research, and use a synchronization mechanism to achieve simultaneous detection of multiple people, which is convenient for comparative analysis.

[0017] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1A schematic diagram of the structure of a near-infrared brain imaging system provided in an embodiment of this specification;

[0019] Figure 2 A schematic diagram of the structure of a near-infrared brain imaging device provided in an embodiment of this specification;

[0020] Figure 3 A schematic diagram of locating brain activation areas by a three-dimensional spatial positioning module provided in an embodiment of this specification;

[0021] Figure 4 A schematic diagram of obtaining three-dimensional coordinates of a point by a three-dimensional space positioning module provided in an embodiment of this specification;

[0022] Figure 5 A schematic diagram of a location file of a three-dimensional model provided for an embodiment of this specification;

[0023] Figure 6 An example diagram of analyzing location file information provided in an embodiment of this specification. DETAILED DESCRIPTION

[0024] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0025] With the advancement of artificial intelligence technology, near-infrared functional brain imaging (fNIRS) technology has also been developed. By measuring the difference in the near-infrared light absorption rate of oxygenated hemoglobin and deoxygenated hemoglobin in brain tissue, information related to brain function can be obtained, providing researchers with an opportunity to gain a deeper understanding of brain function.

[0026] Related technical solutions There are problems with the data acquisition quality, flexibility and real-time performance of near-infrared brain imaging systems, which cannot realize simultaneous detection of multiple people. In addition, the experimental design, data processing and analysis processes of brain imaging systems are relatively complex, and the efficiency needs to be improved. To this end, this specification provides a near-infrared brain imaging system that realizes simultaneous detection of multiple people through a clock synchronization mechanism; the head-worn device design enables the equipment to adapt to various experimental scenarios and personnel operation needs, improving the flexibility and convenience of research; supports multi-channel detection methods and completely offline data acquisition; uses AI algorithms to realize real-time analysis of data; and meets two-dimensional and three-dimensional positioning analysis, expanding the scope of application, and can meet the research needs of different fields.

[0027] The near-infrared brain imaging system based on human factors intelligence includes: multiple near-infrared brain imaging devices, each of which includes a head-mounted device, a light source and a detector, the light source and the detector are arranged on the head-mounted device, when the subject wears the head-mounted device and receives stimulation of brain area stimulation information, the light source provides an input signal to the brain area, the detector receives an output signal of the brain area and determines the brain blood oxygen concentration change data based on the output signal; multiple host devices, the multiple host devices are synchronized through a time synchronization mechanism, the multiple host devices correspond to the multiple near-infrared brain imaging devices one by one, each host device is communicatively connected with the corresponding near-infrared brain imaging device, and each host device is configured to output the brain area stimulation information and obtain the brain blood oxygen concentration change data and perform data processing.

[0028] Exemplarily, the near-infrared brain imaging system is composed of a plurality of near-infrared brain imaging devices and a plurality of host devices. The near-infrared brain imaging device includes a head-mounted device, a built-in light source and a detector. When the host device generates or displays stimulation information, the light source provides an input signal, the detector receives the output signal and processes the signal and transmits it to the host device for data analysis, so that the activity state of the brain can be determined based on the brain blood oxygen concentration information. For example, the host device generates or displays stimulation information, the subject wears the head-mounted device, the subject stimulates the brain by watching the stimulation information, the light source inputs a signal to the brain, and the detector receives the output signal returned by the brain, and the brain blood oxygen concentration information can be obtained by processing the output signal.

[0029] In the above embodiment, the near-infrared brain imaging system is composed of multiple near-infrared brain imaging devices and multiple host devices. The near-infrared brain imaging device includes a head-mounted device, a light source and a detector. Due to the stimulation, the concentration of cerebral blood oxygen in the brain area is different, which makes the absorption rate of the light source different to reflect the activity of the brain area. This method simplifies the experimental process and has high reliability and accuracy. The head-mounted device is a wearable design, which enables the equipment to adapt to various experimental scenarios and personnel operation needs, and improves the flexibility and convenience of research. And the use of a synchronization mechanism increases the synchronization of data, reduces experimental errors, and can meet the needs of multiple people for simultaneous detection.

[0030] Figure 1 This is a schematic diagram of the structure of a near-infrared brain imaging system provided in an embodiment of this specification.

[0031] like Figure 1As shown in the figure, fNIRS1, fNIRS2, and fNIRS3 represent three near-infrared functional imaging devices, respectively. Computer 1, Computer 2, and Computer 3 are three host devices that can display stimulus materials and analyze data. MiniSyncBox (including MiniSyncBox1, MiniSyncBox2, and MiniSyncBox3) is the time synchronization mechanism used by the near-infrared brain imaging system. ErgoLAB is a human-computer ring synchronization cloud platform that is integrated into the host device and can be synchronized with other indicators (physiology, EEG). TTL is a data protocol, serial is a universal serial bus (USB) interface used to connect computer devices, and DB15 is a video output interface (Video Graphics Array, VGA) used to output video signals. The connection between the devices is as follows: Figure 1 As shown, connect one end of the DB15 plug to the out interface of MiniSyncBox1, connect the other end of DB15 to the in interface of MiniSyncBox1 of the master computer 1, connect the second end of DB15 to the in interface of MiniSyncBox2, connect the USB interface of MiniSyncBox2 to the slave computer 2, connect the third end of DB15 to the in interface of MiniSyncBox3, and connect the USB interface of MiniSyncBox3 to the slave computer 3.

[0032] The near-infrared brain imaging device also includes: a signal amplifier, which is electrically connected to the light source and the detector, and is used to perform analog-to-digital conversion and signal amplification on the signal. The signal amplifier is configured to send a light source control signal to the light source so that the light source generates an input signal based on the light source control signal. The signal amplifier is also configured to send brain blood oxygen concentration change data from the detector to a signal receiver; a signal receiver, which is connected to the signal amplifier and a host device, and is configured to send brain blood oxygen concentration change data from the signal amplifier to the host device.

[0033] In the above embodiment, the near-infrared brain imaging device also uses a signal amplifier, which can perform analog-to-digital conversion and signal amplification, and can enhance the signal strength during the transmission process, reduce noise, improve signal quality, expand the coverage of the signal, and increase the accuracy of the system.

[0034] Figure 2 This is a schematic diagram of the structure of a near-infrared brain imaging device provided in an embodiment of this specification.

[0035] like Figure 2As shown, the near-infrared brain imaging device includes a head-mounted device, a backpack, a cable, a USB data cable, and a signal receiver. The head-mounted device has a head cap, a light source, and a detector. The signal amplifier is arranged on the backpack. The signal amplifier is connected to the detector through a detector cable and to the light source through a light source cable, thereby realizing the connection between the signal amplifier and the head-mounted device. The functions of each part are described as follows.

[0036] Head cap: worn on the head, fixes the light source and detector, and comes in a variety of sizes, such as three sizes, to meet different head circumferences;

[0037] Light source: Two wavelength light sources are used, 735nm and 850nm, to provide input signals. The input signals can be red light data and infrared data. Each channel corresponds to two light sources.

[0038] Detector: Receives light output from the brain and determines changes in brain blood oxygen concentration based on the light intensity between the input signal and the output signal;

[0039] Light source cable: inputs electrical signals about light, which can be a command to turn the light source on or off. One end is connected to the light source and the other end is connected to the amplifier.

[0040] Detector cable: inputs electrical signals about light and connects the amplifier and detector;

[0041] Signal amplifier: used for analog-to-digital conversion and signal amplification;

[0042] Signal receiver: Built-in high-sensitivity photodiode, can receive Bluetooth signals, connect to the amplifier, and send the amplifier's signal to the computer;

[0043] USB data cable: offline storage data export, wired transmission cable, amplifier charging cable.

[0044] The connection between the amplifier and the computer can be via wired transmission or wireless transmission (such as via Bluetooth connection), and data can also be stored offline and exported for analysis later.

[0045] After the output time of the brain stimulation information is set in one of the multiple host devices, the output time of the brain stimulation information is synchronized to other host devices in the multiple host devices through a time synchronization mechanism, so as to perform brain stimulation on multiple subjects at the same time.

[0046] For example, Figure 1 As shown, after setting the output time of the stimulation information, Computer 1 is synchronized to Computer 2 and Computer 3 by MiniSyncBox so that the three can be tested at the same time. Different subjects can be tested synchronously by watching the stimulation information output by different computers.

[0047] In the above embodiment, the system time between multiple host devices is usually not synchronized, so it is difficult for multiple host devices to output stimulation information at the same time. This embodiment can synchronize the stimulation information of the brain area to other host devices through a synchronization mechanism. This method can meet the needs of simultaneous detection by multiple people, enhance the synchronization of data, increase the experimental scenarios that the system can support, and is more flexible in actual use.

[0048] Exemplarily, different cognitive tasks can be used to stimulate different brain regions. For example, thinking-related cognitive tasks can stimulate the person's frontal cognitive processing brain region, and motor-related cognitive tasks can be used to stimulate the person's parietal motor brain region. Since different cognitive tasks correspond to different brain region stimulation information, the host device is configured to output brain region stimulation information according to the cognitive tasks. The cognitive tasks include: brain function localization tasks, wherein the host device is configured to output the same type of brain region stimulation information within a time window according to the brain function localization tasks, and the activated brain region is determined by collecting and analyzing the cerebral blood oxygen concentration change data of the entire brain region.

[0049] For example, a block experiment design is used for the brain function localization task, by continuously presenting homogeneous (such as the same type) stimulation information within a certain time window. The stimulation information causes the blood oxygen concentration in the brain area to change, and then the activity changes in the brain area can be analyzed.

[0050] Cognitive tasks also include: brain cognitive processing tasks, in which the host device is configured to output different types of brain area stimulation information in multiple time periods according to the brain cognitive processing tasks, and obtain the activation state of the specific brain area by collecting and analyzing the brain blood oxygen concentration change data of the specific brain area.

[0051] Exemplarily, the event experimental design is used for cognitive processing tasks of the brain. The event experimental design usually involves dividing the experimental time into several time periods, and each time period presents different types of stimuli or tasks (pictures, web pages and other stimulus materials, some stimulus information is for the subjects to watch, and some stimulus information requires the subjects to perform operations) to study the brain's response to specific events. Compared with the block experimental design, the event experimental design focuses more on analyzing the changes in brain activity caused by a single event or stimulus. Through this stimulation, the blood oxygen concentration in the brain area changes, and then the activity changes in the brain area can be analyzed.

[0052] Cognitive tasks also include: brain activity analysis tasks, wherein the brain activity analysis tasks are combined with brain function localization tasks and brain cognitive processing tasks.

[0053] For example, the brain activity analysis task uses a mixed experimental design, which is an experimental design method that combines the characteristics of a block experimental design and an event experimental design. Usually, two or more different events are mixed in a block experimental design, so that the individual signals of a single event and the cumulative signals of the events can be observed simultaneously.

[0054] The flexible and fast experimental design module can meet different experimental needs, such as setting the number of stimulus repetitions, duration, reverse order or chaotic presentation, etc.

[0055] For the above cognitive tasks, the experimental module of the ErgoLAB platform needs to have the following functions: support the embedding of various stimulus materials such as pictures, web pages, text, videos, etc., support docking with various experimental environments, and meet different research needs, including desktop, WEB / APP / HMI, VR virtual reality, real site, subjective observation and evaluation, etc.; support the needs of inducing and maintaining special states with a variety of stimulus materials, support custom markers for the start and end of stimulation, and automatically generate stimulus information fragments to meet different types of experimental designs; support the creation of groups containing multiple stimulus information, and set parameters such as the number of group repetitions, stimulus randomization methods, and the number of stimulus material samples taken within the group to achieve randomization of stimulus presentation.

[0056] In the above embodiments, the near-infrared brain imaging system can realize multiple cognitive tasks such as brain function positioning, brain cognitive processing, and brain activity analysis, and meet the experimental design in different fields: it supports multiple experimental designs such as Block, Event, and Mixed, so that researchers can flexibly choose experimental methods according to different research purposes and needs.

[0057] The near-infrared brain imaging system also includes a data acquisition module, which is configured to perform at least one of data sampling rate configuration, channel configuration, light source power configuration and brain area configuration. The data acquisition module can adjust the light source power according to the ambient light. The light source and the detector form at least one channel, and the channel corresponds to the brain area. The brain blood oxygen concentration change data of the corresponding brain area is collected by configuring the channel.

[0058] Exemplarily, the near-infrared acquisition equipment includes sampling rate configuration, channel configuration, light source power configuration, and brain region configuration. Sampling rate configuration: meets different sampling requirements and affects the light source switching rate; channel configuration: meets different acquisition brain region requirements, channels correspond to brain regions, and supports flexible configurations such as single channel, 16 channels, 24 channels, 40 channels, and 56 channels; brain region configuration: front brain region, midbrain region, and back brain region; light source power configuration: adjust according to ambient light. When the ambient light is too strong, the light source power can be appropriately weakened to increase the light intensity change. For example, there can be four levels of power, L0-L3.

[0059] In the above embodiment, the near-infrared acquisition device can be configured with sampling rate, channel, light source power and brain region, which can meet different sampling requirements and brain region acquisition requirements, achieve full brain region coverage, support detection of brain regions such as the parietal lobe, occipital lobe, frontal lobe, temporal lobe, etc., support single brain region detection and simultaneous detection of multiple brain regions, can meet the left and right brain region comparison experiment, and can adjust the light source power according to environmental conditions, making the system highly adaptable.

[0060] The data acquisition module is also configured to correct the optical path length of the output signal based on the local path length factor, so as to obtain cerebral blood oxygen concentration change data based on the corrected output signal.

[0061] For example, in order to solve the impact of individual differences on measurement results in functional near-infrared spectroscopy (fNIRS) technology, in fNIRS, near-infrared light will be scattered and absorbed when passing through brain tissue, and the local path length factor (DPF) refers to the ratio of the actual path length of light propagating in the tissue to the straight-line distance from the epidermis to the epidermis. Since each person's brain structure and tissue composition are different, these differences will affect the propagation path of light, thereby affecting the accuracy of the measurement. The partial path length factor (PPF) can correct the optical path length caused by scattering and absorption when light propagates in tissues. Since the optical path length affects the brain blood oxygen concentration, the optical path length can be corrected based on the PPF factor to make the obtained brain blood oxygen concentration change data more accurate.

[0062] For example, ErgoLAB has built-in multiple PPF calculation methods for flexible selection. Taking three PPF calculation methods as an example, one is a custom PPF value, and the PPF value corresponding to the dual wavelengths of red light and infrared light is generally set to 0.1. Another is a PPF value based on the SCHOLKMANN2013 standard, which is related to the age of the subject. The third is a PPF value based on the DUNCAN1996 standard, which is related to the age of the subject.

[0063] In the above embodiment, the local path length factor is used to correct the optical path length, so that the output signal is more accurate and the reliability of the system is increased. Moreover, this method is simple to operate and has strong practicality.

[0064] The near-infrared brain imaging system also includes: a real-time processing and analysis module, which is configured to process data based on the brain blood oxygen concentration change data to obtain blood oxygen concentration change information of each brain region.

[0065] Exemplarily, the output data received by the signal receiver is processed and analyzed in real time, and the changes are analyzed based on the concentration change data of each channel of oxygenated hemoglobin (O2Hb) and deoxygenated hemoglobin (HHb) in the data. At the same time, the concentration change data of each channel corresponds to different brain regions.

[0066] The near-infrared brain imaging system also includes: an AI chip, including a cognitive processing model, the AI ​​chip is configured to input brain blood oxygen concentration change data into the cognitive processing model, and output cognitive analysis results through the cognitive processing model.

[0067] Exemplarily, the AI ​​chip is set on the amplifier, combined with the edge computing equipment of the AI ​​algorithm, and the cognitive processing model is imported for real-time analysis. The input of the AI ​​algorithm includes the maximum concentration of HbO2, the average concentration of HbO2, the latent period of HbO2, the minimum concentration of Hb, the average concentration of Hb, and the latent period of Hb, and the above input data are analyzed to obtain the analysis results.

[0068] In the above embodiment, the real-time processing and analysis module is combined with the AI ​​chip and the edge computing equipment using the AI ​​algorithm can quickly process the received cerebral blood oxygen concentration information, realize the real-time analysis and interpretation of fNIRS data, and improve the research efficiency and the real-time application capability of the data.

[0069] The near-infrared brain imaging system also includes: a post-analysis module, which is configured to display the dynamic changes of cerebral blood oxygen concentration during the execution of cognitive tasks (in order to understand the impact of different tasks on brain area activation), configure the attributes of cognitive events to obtain corresponding collected data and analyze them, output cerebral blood oxygen concentration change indicators and / or event-related superposition analysis indicators, and select at least one of the collected data corresponding to the channel for analysis.

[0070] Exemplarily, the post-analysis module can display the temporal dynamic changes of the concentrations of oxyhemoglobin and deoxyhemoglobin under specific tasks or stimuli; it has the functions of selecting events, fragments and automatic superposition averaging, supports modifying event-related windows, baselines and concentration measurement windows, and can automatically draw time-trial diagrams (Time-trials), event-related concentrations and brain topography maps; it can output statistical indicators such as HbO2 maximum concentration, HbO2 average concentration, HbO2 latency, Hb minimum concentration, Hb average concentration, Hb latency, etc.; single-channel analysis, multi-channel analysis, full-channel analysis and other modes can be selected, and single / multi-selection of any channel is supported; it supports full offline acquisition: the device has an offline storage function, which can be turned on by double-clicking the button to complete full offline data acquisition, and the collected data supports post-export for analysis.

[0071] In the above embodiment, the post-analysis module can timely display the dynamic changes of brain blood oxygen concentration, allowing users to observe the state of the brain more intuitively; supports configuring event attributes and performing analysis, realizing comprehensive analysis of data; supports channel selection, making the near-infrared brain imaging system more flexible and convenient.

[0072] Figure 3 Schematic diagram of locating brain activation areas by a three-dimensional spatial positioning module provided in an embodiment of this specification.

[0073] The near-infrared brain imaging system also includes: a three-dimensional spatial positioning module, which is configured to perform spatial modeling based on the head-mounted device, the light source and the detector to obtain a three-dimensional model, wherein the three-dimensional model includes the coordinates of the light source and the coordinates of the detector, and the coordinates of the light source and the coordinates of the detector correspond to the brain area. After obtaining the brain blood oxygen concentration change data, the coordinates of the light source and the coordinates of the detector corresponding to the brain blood oxygen concentration change data are determined, and the active brain area is located based on the coordinates of the light source and the coordinates of the detector.

[0074] Through three-dimensional spatial modeling, fNIRS data can be registered to a standard brain space (such as MNI space), which can make data between different researchers and different experiments more comparable. At the same time, the functional connections between different brain regions can be studied, which is crucial for understanding the organization and dynamic characteristics of brain networks.

[0075] Exemplarily, the three-dimensional spatial positioning module uses a spatial modeling method to model the head cap model and the corresponding near-infrared points (light source and detector). The coordinates of the light source and the detector can be used to calibrate the corresponding brain areas. By analyzing the coordinates of the light source and the detector corresponding to the cerebral blood oxygen concentration, the active brain areas can be located. The module meets the requirements of two-dimensional and three-dimensional analysis: the data has built-in two-dimensional point coordinates and three-dimensional point coordinates, and supports brain activity analysis and three-dimensional spatial positioning analysis.

[0076] In the above embodiment, the three-dimensional spatial positioning module can model the structure of the brain, so that the user can observe the state of the brain more intuitively, and by analyzing the coordinates of the light source and the detector corresponding to the brain blood oxygen concentration, the active brain area can be located. This method is easy to operate and improves the efficiency of the system.

[0077] For example, Figure 3 It is a three-dimensional model built based on the head-mounted device, detector, and light source. In the model, red represents the light source, blue represents the detector, and green represents the channel. By analyzing the coordinates corresponding to the cerebral blood oxygen concentration, the brain area with brain activity can be located. Figure 4 A schematic diagram of obtaining three-dimensional coordinates of a point by a three-dimensional space positioning module provided in the implementation mode of this specification, Figure 4Taking the acquisition of the point coordinates of a point on the 3D model as an example, the point coordinate information is displayed in the right box. It can be seen from the figure that the acquired point coordinates are (-95.4441, 241.979, 10.1501).

[0078] Figure 5 This is a schematic diagram of the location file of the three-dimensional model provided in the implementation mode of this specification. Figure 5 As shown, the coordinate data of each point such as the light source and the detector in the three-dimensional model can be obtained, and the coordinate data of each point can be compiled as follows Figure 5 The position file (digpts.txt file) shown in the figure is imported into the project. Using the AtlasViewer plug-in of MATLAB, select the tool<register atlas to dig point><register probe to surface> , we can get Figure 6 The configuration analysis page shown can configure the information in the page and perform three-dimensional brain activation analysis, spatial positioning, brain functional connectivity, etc.

[0079] In the above embodiment, data information can be imported into MATLAB, so that the state of the brain can be observed more intuitively, and the page information can be flexibly changed, which is convenient to operate and more practical.

[0080] The embodiments of the present specification provide a near-infrared brain imaging method, which is implemented by any of the above-mentioned near-infrared brain imaging systems.

[0081] The embodiments of this specification provide an edge device for performing edge computing, the edge device integrates the above near-infrared brain imaging system, or the edge device can perform a near-infrared brain imaging method. Through edge computing, there is no need to send data to a remote data center or cloud for processing, which can reduce data transmission time and network delay caused by data transmission, and can also improve data security.

[0082] The embodiments of the present specification provide a computer-readable storage medium having a computer program stored thereon, and the computer program implements the above-mentioned near-infrared brain imaging method when executed by a processor.

[0083] In the above embodiments, the technical problems of existing brain imaging technology in terms of real-time, portability, multimodal data fusion, high ecological validity, real-time data processing and analysis, compatibility with multiple experimental designs, three-dimensional positioning of brain function and cognitive processing analysis are effectively solved. By adopting high-sensitivity photodiodes, wireless data transmission, wearable design, AI algorithms and edge computing technology, supporting experimental design modules and advanced analysis modules for various experiments such as Block, Event and Mixed, the present invention not only improves the data acquisition quality, flexibility and real-time performance of the brain imaging system, but also integrates with the ErgoLAB human-machine-environment synchronization cloud platform, synchronizes with other indicators (physiology, EEG) in the computer, simplifies the experimental design, data processing and analysis process, and provides an efficient, accurate and real-time brain activity monitoring and analysis tool for multiple fields such as cognitive neuroscience, motor control, developmental research, military industry, traffic driving and medical research.

[0084] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0085] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0086] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0087] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0088] In addition, the terms "first", "second", etc. used in the embodiments of the present invention are only used for descriptive purposes and should not be understood as indicating or implying relative importance, or implicitly indicating the number of technical features indicated in the present embodiment. Therefore, the features defined by the terms "first", "second", etc. in the embodiments of the present invention can explicitly or implicitly indicate that the embodiment includes at least one of the features. In the description of the present invention, the word "multiple" means at least two or two or more, such as two, three, four, etc., unless otherwise clearly and specifically defined in the embodiments.

[0089] In the present invention, unless otherwise clearly specified or limited in the embodiments, the terms "installed", "connected", "connected" and "fixed" etc. in the embodiments should be understood in a broad sense. For example, the connection can be a fixed connection, a detachable connection, or an integrated connection. It can be understood that it can also be a mechanical connection, an electrical connection, etc.; of course, it can also be a direct connection, or an indirect connection through an intermediate medium, or it can be the internal connection of two elements, or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to the specific implementation situation.

[0090] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0091] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A near-infrared brain imaging system based on human intelligence, characterized in that: The system comprises: A plurality of near-infrared brain imaging devices, each of which includes a head-mounted device, a light source and a detector, wherein the light source and the detector are arranged on the head-mounted device, and when the subject wears the head-mounted device and receives stimulation of brain region stimulation information, the light source provides an input signal of the brain region, and the detector receives an output signal of the brain region and determines brain blood oxygen concentration change data based on the output signal; Multiple host devices are synchronized through a time synchronization mechanism, the multiple host devices correspond one-to-one to the multiple near-infrared brain imaging devices, each host device is communicatively connected with the corresponding near-infrared brain imaging device, and each host device is configured to output the brain area stimulation information and obtain the brain blood oxygen concentration change data and perform data processing.

2. The system according to claim 1, characterized in that The near-infrared brain imaging device also includes: a signal amplifier, electrically connected to the light source and the detector, the signal amplifier being used to perform analog-to-digital conversion and signal amplification on the signal, the signal amplifier being configured to send a light source control signal to the light source so that the light source generates the input signal based on the light source control signal, and the signal amplifier being further configured to send the cerebral blood oxygen concentration change data from the detector to a signal receiver; The signal receiver is connected to the signal amplifier and the host device, and is configured to send the cerebral blood oxygen concentration change data from the signal amplifier to the host device.

3. The system according to claim 1 or 2, characterized in that: After the output time of the brain region stimulation information is set in one of the multiple host devices, the output time of the brain region stimulation information is synchronized to other host devices in the multiple host devices through the time synchronization mechanism, so as to perform brain stimulation on multiple subjects at the same time.

4. The system according to claim 1, characterized in that The system further comprises: A data acquisition module is configured to perform at least one of data sampling rate configuration, channel configuration, light source power configuration and brain region configuration, wherein the data acquisition module can adjust the light source power according to the ambient light, the light source and the detector form at least one channel, the channel corresponds to the brain region, and the brain blood oxygen concentration change data of the corresponding brain region is collected by configuring the channel; The data acquisition module is also configured to correct the optical path length of the output signal based on a local path length factor, so as to obtain the cerebral blood oxygen concentration change data based on the corrected output signal.

5. The system according to claim 1 or 4, characterized in that: The system further comprises at least one of the following: A real-time processing and analysis module is configured to process the cerebral blood oxygen concentration change data to obtain blood oxygen concentration change information of each brain region; The AI ​​chip includes a cognitive processing model, and the AI ​​chip is configured to input the brain blood oxygen concentration change data into the cognitive processing model and output cognitive analysis results through the cognitive processing model.

6. The system according to claim 1 or 4, characterized in that: Different cognitive tasks correspond to different brain region stimulation information. The system also includes: The post-analysis module is configured to display the dynamic changes of the cerebral blood oxygen concentration during the execution of cognitive tasks, configure the attributes of cognitive events to obtain corresponding collected data and analyze them, output cerebral blood oxygen concentration change indicators and / or event-related superposition analysis indicators, and select the collected data corresponding to the channel for analysis.

7. The system according to claim 1, 2 or 4, characterized in that: The system further comprises: The three-dimensional spatial positioning module is configured to perform spatial modeling based on the head-mounted device, the light source and the detector to obtain a three-dimensional model, wherein the three-dimensional model includes the coordinates of the light source and the coordinates of the detector, and the coordinates of the light source and the coordinates of the detector correspond to the brain area. After obtaining the cerebral blood oxygen concentration change data, the coordinates of the light source and the coordinates of the detector corresponding to the cerebral blood oxygen concentration change data are determined, and the active brain area is located based on the coordinates of the light source and the coordinates of the detector.

8. The system according to claim 1, 2 or 4, characterized in that: The host device is configured to output the brain region stimulation information according to a cognitive task, wherein the cognitive task includes at least one of the following: A brain function localization task, wherein the host device is configured to output the same type of brain region stimulation information within a time window according to the brain function localization task, and determine the activated brain region by collecting and analyzing the cerebral blood oxygen concentration change data of the whole brain region; Brain cognitive processing tasks, wherein the host device is configured to output different types of brain region stimulation information in multiple time periods according to the brain cognitive processing tasks, and obtain the activation state of the specific brain region by collecting and analyzing the brain blood oxygen concentration change data of the specific brain region; A brain activity analysis task, wherein the brain activity analysis task is combined with the brain function localization task and the brain cognitive processing task.

9. A near-infrared brain imaging method based on human intelligence, characterized in that: The near-infrared brain imaging method based on human intelligence is implemented by a near-infrared brain imaging system according to any one of claims 1-8.

10. An edge device, characterized in that: The edge device is used to perform edge computing, and the edge device is integrated with the near-infrared brain imaging system according to any one of claims 1 to 8, or the edge device is capable of executing the near-infrared brain imaging method according to claim 9.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the near-infrared brain imaging method of claim 9 is implemented.

Images