Space auditory attention dynamic coupling analysis method and system based on multilayer network
By building a multi-layer network and a cross-time-frequency coupled hyperconnection network, analyzing the dynamic coupling mode of the brain in spatial auditory attention tasks, the problem of difficulty in analyzing dynamic coupling of brain functions across time and across frequency in the existing technology is solved, and an in-depth understanding of the brain network interaction mechanism is achieved.
Patent Information
- Application Number
- CN202510696111.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-28
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2045-05-28
AI Technical Summary
The prior art is difficult to fully characterize the dynamic coupling mode of different brain regions when the brain performs spatial auditory attention tasks, and it is difficult to analyze dynamic coupling of brain functions across time and across frequency.
Using a multi-layer network-based method, by collecting EEG signals in complex acoustic environments, preprocessing and frequency band decomposition, a multi-layer rhythmic network and a multi-layer time-varying network are constructed, and a cross-time-frequency coupled hyperconnection network is further constructed to analyze the network attributes of the core network layer.
The detailed portrayal of the dynamic connection modes of different brain regions in the brain's spatial auditory attention task is realized, revealing the brain network interaction mechanism, and improving the development of auditory brain-computer interface technology.
Smart Images

Figure CN120216935A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of auditory brain-computer interfaces, and particularly to a method and system for dynamic coupling analysis of spatial auditory attention based on a multi-layer network. Background Art
[0002] Spatial auditory attention refers to the ability of an individual to selectively focus on auditory information at a specific spatial location in a complex auditory environment, while suppressing other irrelevant noises or interfering sound sources. This ability is crucial for humans to perform cognitive tasks such as target sound source recognition, speech understanding, and sound source localization in a multi-source environment, especially in noisy environments. For example, in the "cocktail party effect", an individual can focus their attention on the voice of the target interlocutor through spatial auditory attention while ignoring the surrounding background noise and other conversations. For hearing-impaired patients (such as cochlear implant users), the lack of spatial auditory attention ability will greatly reduce their speech perception ability in complex environments. Therefore, in-depth research on its neural mechanism is of great significance for improving the performance of auditory rehabilitation and assistive devices.
[0003] In recent years, numerous studies have used various technical means to deeply explore the neural basis of spatial auditory attention in complex acoustic environments. Functional magnetic resonance imaging studies have found that the activities of brain regions such as the bilateral posterior superior temporal gyrus, anterior insula, supplementary motor area, and anterior parietal network are significantly enhanced in individuals in complex environments. Voxel lesion behavior mapping studies have shown that the right planum temporale and the left inferior frontal gyrus play key roles in the process of spatial auditory selective attention. Magnetoencephalography studies have shown that specific activation patterns occur in the left precentral gyrus during the execution of spatial auditory attention. Electroencephalography has the advantages of being non-invasive and having high temporal resolution. Related electroencephalography studies have found that there is a correlation between spatial attention allocation and specific event-related potentials (such as mismatch negativity, P3a, and P3b components) in an environment with multiple interfering sources. Although these studies have revealed the complexity and temporality of the brain nerve activities involved in spatial auditory attention in complex environments, however, the dynamic connection patterns between different brain regions have not been deeply elucidated.
[0004] Spatial auditory attention is a complex cognitive process that involves the interaction and coordination of multiple brain regions, including traditional auditory processing regions (such as the primary auditory cortex and auditory association area), as well as brain regions such as the prefrontal lobe and parietal lobe related to attention, memory, and executive function. However, existing methods mostly use static brain network analysis or single-time / frequency dimension analysis, which are difficult to comprehensively characterize the dynamic coupling patterns of different brain regions when the brain performs spatial auditory attention tasks. Therefore, there is an urgent need to develop a method that can analyze the dynamic coupling of spatial auditory attention brain functions across time and frequency to reveal the interaction mechanism of the spatial auditory attention network in the brain and provide innovative solutions for the development of auditory brain-computer interface technology. Summary of the Invention
[0005] The object of the present invention is to provide a method and system for dynamic coupling analysis of spatial auditory attention based on a multi-layer network in view of the technical defects existing in the prior art.
[0006] The technical solution adopted to achieve the object of the present invention is as follows: A method for dynamic coupling analysis of spatial auditory attention based on a multi-layer network, comprising the following steps: Step 1, collecting electroencephalogram (EEG) signals of multiple brain regions induced by spatial auditory attention tasks in a complex acoustic environment, and performing EEG data preprocessing; Step 2, based on the preprocessed EEG data obtained in Step 1, extracting EEG signals of different frequency bands, quantitatively analyzing the mutual coupling effects of EEG signals of different frequency bands and the same frequency band based on connectivity indexes, and then constructing a multi-layer rhythm network; Step 3, based on the preprocessed EEG data obtained in Step 1, constructing a microstate spatio-temporal sequence, using the microstate spatio-temporal sequence as a microstate frame, quantitatively analyzing the mutual coupling effects of EEG signals of different microstate frames and the same microstate frame based on connectivity indexes, and then constructing a multi-layer time-varying network; Step 4, constructing a cross-time-frequency coupling hyperconnection network based on the multi-layer rhythm network obtained in Step 2 and the multi-layer time-varying network obtained in Step 3, and determining the core network layer of the cross-time-frequency coupling hyperconnection network by using inter-layer correlation and inter-layer conditional probability; quantitatively analyzing the network attributes of the core network layer to obtain the connection mode and collaborative working mode between each responsible brain region.
[0007] In the above technical solution, in Step 1, a complex acoustic environment containing multiple sound sources is created through a circular speaker array, one of which is a target sound source and the others are interference sound sources. Background noise is introduced into both the target sound source and the interference sound sources. When the participant performs a spatial auditory attention task, the direction of the target sound source is judged.
[0008] In the above technical solution, in Step 1, 64 electrode channels of a non-invasive EEG device are used to collect EEG signals of different brain regions, and each electrode channel serves as a network node.
[0009] In the above technical solution, in Step 1, the EEG data preprocessing steps include filtering, artifact removal, segmentation, baseline correction, and re-referencing to obtain EEG data with a fixed-length time window.
[0010] In the above technical solution, in step 2, the EEG data of each fixed-length time window obtained in step 1 is subjected to frequency decomposition to extract EEG data in different frequency bands, and the frequency bands include delta wave, theta wave, alpha wave, beta wave and gamma wave. The connectivity index is phase synchronization, generalized synchronization or partial directed coherence. The coupling strength between the EEG signals of all network nodes in the same frequency band is calculated by using the connectivity index, and the coupling strength between the EEG signals of each network node between different frequency bands is calculated in turn, so as to construct a multi-layer rhythm network.
[0011] In the above technical solution, in step 3, based on the Cartool software, the optimal microstate template is extracted from the EEG data of all fixed-length time windows obtained in step 1 by using the spatial clustering algorithm, and then the optimal microstate template is applied to locate the EEG data of the fixed-length time window at different angles. Similar EEG activity patterns are identified by the template matching method, so as to construct a microstate spatio-temporal sequence. The microstate spatio-temporal sequence is composed of multiple microstate frames. The connectivity index is phase synchronization, generalized synchronization or partial directed coherence. The coupling strength between the EEG signals of all network nodes in the same microstate frame is calculated by using the connectivity index, and the coupling strength between the EEG signals of each network node between different microstate frames is calculated in turn, so as to construct a multi-layer time-varying network.
[0012] In the above technical solution, in step 4, the cross-time-frequency coupling hyperconnection network is a four-dimensional hyperconnection network. The first dimension is used to represent different microstate frames, reflecting different stages of brain nerve activity in the time process; the second dimension represents different frequency bands, reflecting the activity characteristics of the brain at different frequency levels; the third dimension and the fourth dimension are respectively used to describe the connection strength within the same layer and between different layers, and accurately quantify the interaction relationship between each network node in the brain network.
[0013] In the above technical solution, in step 4, the graph theory analysis method is used to quantitatively analyze the network properties of the core network layer, and the network properties are clustering coefficient, global efficiency, node degree or minimum characteristic path length.
[0014] In the above technical solution, in step 4, the inter-layer correlation is calculated by the Pearson correlation coefficient: ; where is the Pearson correlation coefficient between two network layers and are the network matrices of the m-th and n-th layers respectively, and are the averages of the network matrices of the m-th and n-th layers, i, j=1, 2, ……, M are all the numbers of the network layers.
[0015] In the above technical solution, in step 4, the inter-layer conditional probability is calculated by the following formula: ; where is the inter-layer conditional probability, and are the network matrices of the m-th and n-th layers respectively, i, j= 1, 2, ……, M are all the numbers of the network layers.
[0016] On the other hand, the present invention further includes a system based on the above-mentioned spatial auditory attention dynamic coupling analysis method based on a multi-layer network, including an experimental design module, an electroencephalogram signal acquisition and preprocessing module, a multi-layer network construction and analysis module, a hyper-connection network construction module, and a visualization and report generation module, wherein: The experimental design module automatically generates and adjusts the experimental paradigm, and the experimental design module includes an acoustic scene design unit and an experimental stimulus and process generation unit; The electroencephalogram signal acquisition and preprocessing module includes an electroencephalogram data acquisition unit and a data preprocessing unit; The multi-layer network construction and analysis module includes a hyper-connection network generation unit for generating the cross-time-frequency coupling hyper-connection network, a correlation and conditional probability analysis unit for quantitatively analyzing the cross-time-frequency coupling hyper-connection network, and a core network layer screening unit for screening the core network layer; The visualization and report generation module is used to visualize the analysis results of the multi-layer network construction and analysis module.
[0017] Compared with the prior art, the beneficial effects of the present invention are: (1) Highly simulate a complex acoustic environment: The present invention uses a loudspeaker array to construct a multi-source space, combines sentences with high semantic complexity, music segments, etc. as stimulus materials, and simultaneously introduces real background noises such as street noise and multi-person conversation sounds to enhance the authenticity and ecological validity of the experimental environment, making the experimental results closer to the actual auditory scene; (2) Comprehensively capture the time-frequency-space characteristics of electroencephalogram signals: The present invention uses methods such as wavelet transform and short-time Fourier transform for multi-band decomposition to accurately extract rhythm signals such as delta and theta; at the same time, by constructing a spatio-temporal sequence through microstate analysis, it can capture the characteristics of electroencephalogram signals from both time and space dimensions, making the dynamic changes of brain activities clearer and measurable; (3)Constructing multi-layer networks and hyper-connected networks: The present invention constructs multi-layer rhythm networks and multi-layer time-varying networks to quantify the coupling effect of EEG signals across rhythms and time scales. By constructing a four-dimensional hyper-connected network, frequency and time information are integrated to accurately quantify the connection strength of each network node. At the same time, the core network layer is determined and its network properties are analyzed, revealing the complex interaction mechanism between the responsible brain regions in the brain during spatial auditory attention at different frequencies and time periods, providing a new perspective and a more in-depth research method for understanding the spatial auditory attention function of the brain; (4)Constructing an efficient automated analysis system: The dynamic analysis system for spatial auditory attention coupling based on multi-layer networks constructed in the present invention integrates modules such as experimental design, EEG data acquisition and preprocessing, network construction, hyper-connection matrix analysis, visualization and report generation, realizing full-process automated analysis. The system has adjustable parameters and high-efficient data processing capabilities, supports flexible adjustment of different noise environments, stimulus materials, frequency bands and time windows, significantly improves research efficiency, reduces manual operation errors, and provides a convenient and efficient tool for auditory cognitive research and clinical evaluation. Description of the Drawings
[0018] Figure 1 It is a flow chart of the dynamic coupling analysis method for spatial auditory attention based on multi-layer networks.
[0019] Figure 2 It is a diagram of the experimental paradigm for spatial auditory attention in a complex acoustic environment, where (a) is a schematic diagram of the experiment and (b) is a flow chart of the experiment.
[0020] Figure 3 It is a schematic diagram of constructing a multi-layer rhythm network.
[0021] Figure 4 It is a schematic diagram of constructing a microstate spatio-temporal sequence.
[0022] Figure 5 It is a schematic diagram of constructing a multi-layer time-varying network.
[0023] Figure 6 It is a schematic diagram of the core network layer of the hyper-connection matrix.
[0024] Figure 7 It is a schematic diagram of the dynamic coupling analysis system for spatial auditory attention based on multi-layer networks. Detailed Embodiments
[0025] The present invention will be further described in detail below with reference to specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0026] Embodiment 1
[0027] As Figure 1As shown, a method for dynamic coupling analysis of spatial auditory attention based on a multi-layer network includes the following steps: Step 1: Collect the electroencephalogram (EEG) signals induced in multiple brain regions during a spatial auditory attention task in a complex acoustic environment, and perform preprocessing on the EEG data; Step 2: Based on the preprocessed EEG data obtained in Step 1, extract the EEG signals in different frequency bands, and quantitatively analyze the mutual coupling effects of the EEG signals in different frequency bands and the same frequency band based on connectivity metrics, and then construct a multi-layer rhythm network; Step 3: Based on the preprocessed EEG data obtained in Step 1, construct a microstate spatio-temporal sequence. The microstate spatio-temporal sequence is used as a microstate frame, and quantitatively analyze the mutual coupling effects of the EEG signals in different microstate frames and the same microstate frame based on connectivity metrics, and construct a multi-layer time-varying network; Step 4: Based on the multi-layer rhythm network obtained in Step 2 and the multi-layer time-varying network obtained in Step 3, construct a cross-time-frequency coupling hyperconnection network, and determine the core network layer of the cross-time-frequency coupling hyperconnection network using inter-layer correlation and inter-layer conditional probability; quantitatively analyze the network attributes of the core network layer to obtain the connection pattern and collaborative working mode between each responsible brain region.
[0028] Example 2
[0029] This example is further elaborated on the basis of Example 1.
[0030] A method for dynamic coupling analysis of spatial auditory attention based on a multi-layer network includes the following steps.
[0031] Step 1: Design a spatial auditory attention experimental paradigm in a complex acoustic environment based on a loudspeaker array, which includes: Step 1.1: Build a complex multi-source environment. Create an acoustic environment containing multiple sound sources through a circular loudspeaker array to simulate a complex auditory scene. Taking the setting of four sound sources as an example, arrange the four loudspeakers at the 90° and 30° positions on both sides of the midplane of the subject, and the specific layout is as Figure 2 shown in (a) below. In addition, select sentences, music segments, etc. with semantic complexity and emotional color as stimulus materials, and designate one as the target sound source, and the remaining sound sources as interfering sound sources. This design aims to enhance the ecological validity of the experiment and effectively induce the brain response of the subject in the spatial auditory attention task; Step 1.2, construct the background noise environment. Based on the selected stimulus material in Step 1.1, introduce background noise to enhance the simulation of real-life scenarios in the experiment. The background noise includes, but is not limited to, street noise, indoor conversations among multiple people, etc. Use audio processing software (such as Adobe Audition) to mix the background noise with the original stimulus material to form noise environments with different signal-to-noise ratios, such as 0 dB and 10 dB signal-to-noise ratio conditions. In addition, use audio processing software to normalize all stimulus materials to ensure that their root mean square amplitudes and durations are consistent; Step 1.3, design the experimental procedure. Use MATLAB and Psychtoolbox software to generate an experimental stimulus sequence, and a specific sequence is shown as Figure 2 shown in (b) therein. The experiment consists of a total of 200 groups of stimuli and is divided into two modules. During the experiment, four sound sources (one target sound source and three interfering sound sources) are played synchronously and randomly from the speakers. The subject needs to judge the direction of the target sound source by pressing a key within 2000 ms after each group of stimuli ends. To reduce the influence of the previous stimulus on subsequent judgments, a 1000 ms silent interval is set between each stimulus. The experiment is carried out according to the above procedure until all 200 groups of stimuli are played, and the experiment ends.
[0032] Step 2: Collect electroencephalogram signals based on a non-invasive electroencephalogram device and perform data preprocessing Step 2.1, electroencephalogram data collection. The subject performs a spatial auditory attention task according to the experimental procedure designed in Step 1.3. At the same time, use professional electroencephalogram devices such as 64-channel NeuroScan SynAmps2 to record the electroencephalogram data induced by the subject during the task. To ensure the accuracy and reliability of the collected data, strictly control the experimental conditions during the recording process so that the impedance of all electrodes always remains below 10 kΩ, and set the sampling rate to 1000 Hz. At the same time, apply a 0.1 - 150 Hz band-pass filter and a 50 Hz notch filter to preliminarily process the collected data to reduce noise interference; Step 2.2, Preprocessing of EEG data. Use EEGLAB plugins to preprocess the EEG data. Specifically, filter the EEG data using a 0.1 - 48 Hz band - pass filter and downsample the data to 250 Hz. Then, use independent component analysis to remove the artifacts caused by eye movements or blinks. Further, divide the data into 1200 - ms time windows (epochs), each epoch including 200 ms before the stimulus and 1000 ms after the stimulus, and use the data of the first 200 ms for baseline correction. In addition, eliminate the epochs with the maximum - minimum amplitude difference exceeding 100 μV to ensure data quality. Finally, re - reference all the remaining epoch data to the mean of all electrodes to unify the data reference standard and ensure the consistency and comparability of the data.
[0033] Step 3: Construct a multi - layer rhythm network based on connectivity metrics, which includes: Step 3.1, Extract EEG signals in different frequency bands. Use signal processing techniques such as wavelet transform or short - time Fourier transform to perform frequency decomposition on the epoch data obtained in Step 2.2, and extract EEG signals in different frequency bands, including but not limited to delta waves, theta waves, alpha waves, beta waves, and gamma waves. This step aims to separate different frequency components for subsequent construction of the multi - layer rhythm network; Step 3.2, Construct a multi - layer rhythm network. Use connectivity metrics such as phase synchronization, generalized synchronization, and partial directed coherence to quantitatively analyze the mutual coupling effects of EEG signals in different frequency bands (cross - frequency bands) and their respective frequency bands (same - frequency bands) obtained in Step 3.1, and then construct a multi - layer rhythm network, as Figure 3 shown. Specifically, calculate the coupling strength within each frequency band. For example, use the above - mentioned metrics to calculate the coupling strength between all network nodes (such as 64 electrode channels) in the theta frequency band; for the network coupling strength between different frequency bands, use the above - mentioned metrics to calculate the coupling strength between cross - frequency bands in turn (such as the coupling strength between the first channel in theta and the second channel in the alpha frequency band); Step 3.3, Forms of expression of the multi - layer rhythm network. The construction principle of the M - layer rhythm brain network can be shown by the following formulas (1) - (3): (1); (2); (3); In the above formula system, represents the diagonal matrix , matrix, t = 1, 2, 3, ……, M , Mis the number of decomposed frequency bands, represents the coupling strength of different network nodes within their respective frequency bands. represents the coupling strength of different network nodes across frequency bands. The matrix is a matrix with all elements equal to 1, that is, it means that any network node in each layer can be connected to any network node in another layer. represents the interaction matrix between layers, M is the number of decomposed frequency bands, N is the number of network nodes. In this visual representation, the matrix on the diagonal represents the coupling within the same frequency band, such as the coupling between network nodes within the theta frequency band. This kind of connection shows the coupling relationship between different brain regions under the same frequency band; while the matrix off the diagonal represents the coupling across frequency bands, such as the coupling between network nodes in the theta frequency band and the gamma frequency band. The cross-frequency band connection reflects the synergistic effect between different frequency band EEG activities, which helps to reveal the mechanism of multi-frequency band information integration in the brain during the spatial auditory attention task.
[0034] Step 4: Construct a multi-layer time-varying network based on the connectivity index, including: Step 4.1, construct the microstate spatio-temporal sequence. Based on the epoch data processed in Step 2.2, use the microstate analysis method to construct the microstate spatio-temporal sequence. This process is mainly implemented in the Cartool software. The specific steps are as follows: Based on all the epoch data, use the spatial clustering algorithm to extract the optimal microstate template. This template represents the characteristic distribution of EEG data in the spatial dimension and reflects the neural electrical activity pattern of the brain in a specific cognitive task. Subsequently, apply the obtained optimal microstate template to the epoch data at different orientation angles (30°, -30°, 90°, -90°), and identify similar EEG activity patterns through the template matching method, thereby constructing four microstate spatio-temporal sequences (all four microstate spatio-temporal sequences include W1 to W6, and the difference lies in the microstate frames of W1 to W6). Finally, the obtained microstate spatio-temporal sequence serves as the microstate frame of the multi-layer network, providing a basis for the subsequent construction of the multi-layer time-varying network, as specifically shown in Figure 4 shown; Step 4.2, construction of the multi-layer time-varying network. Based on the microstate frames (W1 to W6) obtained in Step 4.1, and combined with the method of constructing the multi-layer rhythm network in Step 3.2, construct the multi-layer time-varying network. The specific method is as follows: Use connectivity indices such as phase synchronization, generalized synchronization, and partial directed coherence to quantitatively analyze the mutual coupling effects of each network node (such as 64 electrode channels) from cross-time and same-time scales, and then construct the multi-layer time-varying network, as shown in Figure 5As shown, across time scales, the coupling relationships between network nodes in different microstate frames (such as W1 and W6 microstate frames) are analyzed to capture the dynamic changes of neural activities over time; within the same time scale, the coupling relationships between network nodes in the same microstate frame (such as W1 and W1 microstate frames) are analyzed to characterize the functional connectivity of that time window. The constructed multi-layer time-varying network can comprehensively and dynamically present the time-varying functional connectivity characteristics between different brain regions during the spatial auditory attention task; Step 4.3, Multi-layer network representation form. Based on the multi-layer time-varying network constructed in Step 4.2, the principle and method of visualization in Step 3.3 are used to visualize the multi-layer time-varying network. Multi-layer network representation form. The construction principle of the P-layer time-varying brain network can be shown by the following formulas (4)-(6): (4); (5); (6); In the above formula system, represents a diagonal matrix, and the matrix , t = 1, 2, 3,..., P , P is the number of microstate frames, and the matrix represents the coupling strength between different network nodes within their respective microstate frames. represents the coupling strength between different network nodes across microstate frames, and the matrix is a matrix with all elements equal to 1, that is, it means that any network node in each layer can be connected to any network node in another layer, represents the interaction matrix between layers, P is the number of microstate frames, N is the number of network nodes. In this visualization expression, the matrices on the diagonal represent the coupling within the same time scale, such as the coupling between W1 and W1. This kind of connection reflects the interaction relationship between different network nodes in the same microstate frame, which helps to observe the functional connectivity state of the brain at a certain instant. While the matrices off the diagonal represent the coupling across time scales, such as the coupling between W1 and W6. Such couplings show the dynamic connections between network nodes in different microstate frames, and can intuitively present the evolution law of brain neural activities on the time axis, providing an intuitive basis for deeply understanding the dynamic functional mechanism of the brain during the spatial auditory attention process.
[0035] Step 5: Construct a cross-time-frequency coupling hyperconnection matrix based on the multi-layer rhythm and time-varying network, which includes: Step 5.1, Construct a hyperconnection matrix. In this step, based on the characteristics of cross-frequency bands and cross-time scales, a coupling operation is performed on the multi-layer rhythm network constructed in Step 3 and the multi-layer time-varying network constructed in Step 4, thereby constructing a four-dimensional hyperconnection matrix. Each dimension of this four-dimensional hyperconnection matrix has clear and important meanings: The first dimension is used to represent different microstate frames, and these time periods are determined by the microstate sequence constructed in Step 4.1, reflecting different stages of brain neural activity in the time process; the second dimension represents different frequency bands, covering various electroencephalogram rhythms such as delta waves and theta waves, reflecting the activity characteristics of the brain at different frequency levels; the third and fourth dimensions are respectively used to describe the connection strengths within the same layer and between different layers, precisely quantifying the interaction relationships between network nodes in the multi-layer network. By constructing such a four-dimensional matrix, the dynamic connection information of the brain in the time and frequency dimensions is comprehensively integrated, providing a powerful analysis method for in-depth analysis of the dynamic coupling of the spatial auditory attention brain network; Step 5.2, Quantitative analysis of the hyperconnection matrix.
[0036] Use quantitative analysis such as inter-layer correlation and inter-layer conditional probability to analyze the cross-time-frequency coupling hyperconnection network.
[0037] The inter-layer correlation is defined as the Pearson correlation coefficient between two network layers, as shown in Equation (7): (7); where, is the Pearson correlation coefficient between two network layers and are the network matrices of the m-th and n-th layers respectively, and are the averages of the network matrices of the m-th and n-th layers, i, j= 1, 2, ……, M are all the numbers of network layers.
[0038] The inter-layer conditional probability is defined as the conditional probability that the connection edges in the m-th layer still exist in the n-th layer, as shown in Equation (8): (8); where, is the inter-layer conditional probability, and are the network matrices of the m-th and n-th layers respectively, i, j= 1, 2, ……, M are all the numbers of network layers.
[0039] Through the above correlation analysis, for example, when it is found that the 200 - 300 ms connectivity matrix (W2 - W3) has a high correlation with the theta and alpha connectivity matrices (band2 - band3), it can be speculated that within this time window, the coupled oscillation between theta and alpha plays an important role in the spatial auditory attention task, which helps to further reveal the cooperative mechanism of different frequency EEG activities in this task.
[0040] Step 5.3, determine the core network layer. According to the results of correlation and conditional probability analysis, screen out the coupled layer with the highest correlation as the core network layer. This core network layer plays a key role in the realization of brain functions in the spatial auditory attention task, and it centrally reflects the key neural activity patterns and functional connectivity relationships of the brain in this task. To more intuitively explore the characteristics of the core network layer, use the BrainNetViewer toolbox to visualize the topological structure of the core network layer. The specific visualization effect is as Figure 6 shown. Through visual analysis, the connection patterns and collaborative working methods between each responsible brain region can be intuitively observed (such as the connection line schematic in Figure 6 ), so as to deeply understand the functional coordination mechanism of the brain in the process of spatial auditory attention, and provide an intuitive basis for studying the spatial auditory cognitive process of the brain. At the same time, use graph theory analysis methods to quantitatively study the network properties of the core network layer. The network properties involved include but are not limited to clustering coefficient, global efficiency, node degree, and minimum characteristic path, etc.
[0041] Example 3
[0042] This example constructs a dynamic coupling analysis system for spatial auditory attention based on a multi - layer network according to the analysis steps in Example 1 or Example 2. This system can realize the full - process automatic processing from the design of the experimental paradigm of the spatial auditory attention task in a complex acoustic environment, to the acquisition and pre - processing of EEG signals, network analysis, and visualization, and improve the analysis efficiency. As Figure 7 shown, this system specifically includes the following component modules: (1) Experimental design module: This module can automatically generate and adjust the experimental paradigm, including the following units: ① Acoustic scene design unit: By precisely controlling the arrangement of the speaker array and the configuration of background noise, simulate a complex acoustic environment. The acoustic scene design unit includes a speaker array controller, a noise generator, and a background noise adjustment module, which can realize the environmental setting under different signal - to - noise ratio conditions. ② Experimental stimulus and process generation unit: Can automatically generate and schedule the experimental stimulus sequence. The system supports adjusting the stimulus types, presentation order, and experimental duration according to user needs, and has functions such as stimulus signal normalization processing and dynamic signal - to - noise ratio adjustment; (2) EEG signal acquisition and preprocessing module. This module mainly realizes the acquisition, preprocessing and preliminary analysis of EEG data. It includes: ① EEG data acquisition unit: compatible with EEG devices such as NeuroScan SynAmps2, to achieve high-precision EEG signal acquisition when the subject performs spatial auditory tasks. ② Data preprocessing unit: performs band-pass filtering, notch filtering and artifact removal operations in real time to ensure signal quality, and at the same time performs preprocessing steps such as downsampling and time window division; (3) Multilayer network construction and analysis module. This module supports multilayer network analysis based on different rhythms and time windows to dynamically reveal the characteristics of brain functional connectivity, including: ① Multilayer rhythm construction module: uses a variety of signal processing techniques to extract EEG signals in different frequency bands, and calculates the EEG coupling strength within and across frequency bands using connectivity indicators, so as to construct a multilayer rhythm network. ③ Multilayer time-varying network construction module: based on the microstate spatio-temporal sequence, uses the connectivity analysis method to calculate the EEG coupling strength across time scales to construct a multilayer time-varying network; (4) Hyperconnection network construction module. This module is responsible for coupling the multilayer rhythm and multilayer time-varying networks, generating a cross-time-frequency coupling hyperconnection network, and performing quantitative analysis, including: ① Hyperconnection network generation unit: combines the two dimensions of time and frequency, and generates a cross-time-frequency coupling hyperconnection network (four-dimensional hyperconnection network) through cross-frequency band and cross-time scale coupling operations to comprehensively integrate the neural activity patterns of the brain in spatial auditory tasks. ② Correlation and conditional probability analysis unit: selects methods such as Pearson correlation and conditional probability to analyze the hyperconnection network to reveal the synergistic mechanism between different frequency bands and time windows. ③ Core network layer screening module: automatically screens the functionally important core network layer based on the correlation analysis results; (5) Visualization and report generation module. This module is used for the visual display of the results of multilayer network analysis and automatically generates an experimental analysis report, including: ① Network visualization unit: displays the topological structures of the multilayer rhythm network and the multilayer time-varying network, and supports the visualization of the brain region connection patterns at different frequency bands and time scales. ② Dynamic connection diagram visualization unit: real-time draws the dynamic diagram of the functional connection of the brain network changing with time to intuitively present the brain functional activities in spatial auditory attention tasks. ③ Automatic report generation unit: automatically generates an experimental report according to the analysis results, and the report includes but is not limited to key research information such as graph theory analysis and dynamic functional connection results.
[0043] The above is only the preferred embodiment of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of the present invention.
Claims
1. A method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network, characterized in that It includes the following steps: Step 1: Collect the electroencephalogram (EEG) signals of multiple brain regions induced by spatial auditory attention tasks in a complex acoustic environment, and perform preprocessing on the EEG data; Step 2: Based on the preprocessed EEG data obtained in Step 1, extract the EEG signals of different frequency bands, quantitatively analyze the mutual coupling effects of the EEG signals in different frequency bands and the same frequency band based on connectivity metrics, and then construct a multi-layer rhythm network; Step 3: Based on the preprocessed EEG data obtained in Step 1, construct a microstate spatio-temporal sequence, use the microstate spatio-temporal sequence as a microstate frame, quantitatively analyze the mutual coupling effects of the EEG signals in different microstate frames and the same microstate frame based on connectivity metrics, and then construct a multi-layer time-varying network; Step 4: Construct a cross-time-frequency coupling hyperconnection network based on the multi-layer rhythm network obtained in Step 2 and the multi-layer time-varying network obtained in Step 3, and determine the core network layer of the cross-time-frequency coupling hyperconnection network by using inter-layer correlation and inter-layer conditional probability; Quantitatively analyze the network attributes of the core network layer to obtain the connection patterns and collaborative working methods between the responsible brain regions.
2. The method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network according to claim 1, wherein In Step 1, a complex acoustic environment containing multiple sound sources is created through a circular loudspeaker array, where one is the target sound source and the others are interfering sound sources. Background noise is introduced into both the target sound source and the interfering sound sources. When the participant performs the spatial auditory attention task, they judge the direction of the target sound source.
3. The method for dynamically coupling and analyzing spatial auditory attention based on a multi-layer network according to claim 1, wherein In Step 1, 64 electrode channels of a non-invasive EEG device are used to collect the EEG signals of different brain regions, and each electrode channel serves as a network node.
4. The method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network according to claim 1, wherein In Step 1, the EEG data preprocessing steps include filtering, artifact removal, segmentation, baseline correction, and re-referencing to obtain EEG data with a fixed-length time window.
5. The method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network according to claim 1, characterized in that In Step 2, the EEG data of each fixed-length time window obtained in Step 1 is decomposed in frequency to extract the EEG data of different frequency bands, where the frequency bands include delta wave, theta wave, alpha wave, beta wave, and gamma wave. The connectivity metric is phase synchronization, generalized synchronization, or partial directed coherence. The coupling strength between the EEG signals of all network nodes within the same frequency band is calculated using the connectivity metric, and the coupling strength between the EEG signals of each network node between different frequency bands is calculated in turn, and then a multi-layer rhythm network is constructed.
6. The method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network according to claim 1, wherein In step 3, based on the Cartool software, the optimal microstate templates are extracted from the EEG data of all fixed-length time windows obtained in step 1 using a spatial clustering algorithm, and then the optimal microstate templates are applied to locate the EEG data of fixed-length time windows at different angles. Similar EEG activity patterns are identified through a template matching method, thereby constructing a microstate spatio-temporal sequence. The microstate spatio-temporal sequence is composed of multiple microstate frames. The connectivity index is phase synchronization, generalized synchronization, or partial directed coherence. The coupling strength between the EEG signals of all network nodes within the same microstate frame is calculated using the connectivity index, and the coupling strength between the EEG signals of each network node between different microstate frames is calculated in turn, thereby constructing a multi-layer time-varying network.
7. The method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network according to claim 1, characterized in that In step 4, a graph theory analysis method is used to quantitatively analyze the network properties of the core network layer. The network properties are clustering coefficient, global efficiency, node degree, or minimum characteristic path length.
8. The method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network according to claim 1, characterized in that In step 4, the inter-layer correlation is calculated through the Pearson correlation coefficient: ; Among them, is the Pearson correlation coefficient between two network layers and are the network matrices of the m-th and n-th layers respectively, and are the averages of the network matrices of the m-th and n-th layers, i, j = 1, 2, ……, M are all the numbers of network layers.
9. The method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network according to claim 1, wherein In step 4, the inter-layer conditional probability is calculated by the following formula: ; Among them, is the inter-layer conditional probability, and are the network matrices of the m-th and n-th layers respectively, i, j = 1, 2, ……, M are all the number of network layers.
10. A system based on the method for dynamically coupling analysis of spatial auditory attention based on a multi-layer network as claimed in claim 1, characterized in that It includes an experimental design module, an EEG signal acquisition and preprocessing module, a multi-layer network construction and analysis module, a hyper-connected network construction module, and a visualization and report generation module, where: The experimental design module automatically generates and adjusts the experimental paradigm. The experimental design module includes an acoustic scene design unit and an experimental stimulus and process generation unit; The EEG signal acquisition and preprocessing module includes an EEG data acquisition unit and a data preprocessing unit; The multi-layer network construction and analysis module includes a hyper-connected network generation unit for generating the cross-time-frequency coupling hyper-connected network, a correlation and conditional probability analysis unit for quantitatively analyzing the cross-time-frequency coupling hyper-connected network, and a core network layer screening unit for screening the core network layer; The visualization and report generation module is used to visualize the analysis results of the multi-layer network construction and analysis module.
Citation Information
Patent Citations
Awareness assessment method of awareness disorder brain function network based on auditory stimulation
CN113598790A
Electroencephalogram signal coupling analysis method, device and system
CN116035597A
Brain fatigue assessment method based on time-frequency-space multi-dimensional brain network features
CN117679045A
Mental state detection method and system based on combination of frequency domain and time domain
CN118948278A
Epilepsy detection method based on multi-scale space-time diagram attention fusion network
CN119745399A
Cited By
Fatigue auditory target topology extraction method and system based on multi-order microscopic network
CN121188511A
A Method and System for Topology Extraction of Fatigue Auditory Targets Based on Multi-Order Micronetworks
CN121188511B