Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

52 results about "Auditory attention" patented technology

Auditory Attention. Auditory attention is the ability to attend to auditory stimuli. It is the most foundational component of auditory processing, which pertains to how our central nervous system takes in information. When there is a deficit in auditory processing, an individual can hear sounds, but a breakdown occurs in his/her ability...

Auditory attention decoding method and device based on multi-sound-source scene, equipment and medium

The embodiment of the invention provides an auditory attention decoding method and device based on a multi-sound-source scene, equipment and a medium, and belongs to the technical field of electroencephalogram signals. The method comprises the steps of obtaining an initial electroencephalogram signal responded by an initial user under first sound stimulation, a multi-sound-source voice signal of the first sound stimulation and a sound source label of the multi-sound-source voice signal; preprocessing the initial electroencephalogram signal and the multi-sound-source voice signal to obtain a to-be-processed electroencephalogram signal of the initial electroencephalogram signal and a to-be-processed voice signal of the multi-sound-source voice signal; training the initial auditory attention decoding model according to the to-be-processed electroencephalogram signal, the to-be-processed voice signal and the sound source label to obtain a target auditory attention decoding model; obtaining a target electroencephalogram signal responded by the target user under the second sound stimulation and a target voice signal of the second sound stimulation; and performing auditory attention decoding on the target electroencephalogram signal and the target voice signal by using a target auditory attention decoding model to obtain an attention target.
Owner:XIAOZHOU TECH CO LTD

EEG auditory attention classification method and system based on time-frequency attention mechanism

The invention discloses an electroencephalogram auditory attention classification method and system based on a time-frequency attention mechanism, and belongs to the field of pattern recognition and biomedical signal processing. Specifically, firstly, multi-band filtering, re-reference, multi-band electroencephalogram splicing and windowing slicing preprocessing are carried out on original electroencephalogram signals. Then different weights are distributed to different frequency bands in the multi-band electroencephalogram signals, the multi-band electroencephalogram signals are fused into two-dimensional electroencephalogram signals, frequency domain features of the electroencephalogram signals are extracted, and time sequence features of the electroencephalogram signals are extracted; and finally, extracting deep auditory attention features in the electroencephalogram signals from which the frequency domain features and the time domain features are extracted by using a lightweight residual neural network, and carrying out auditory attention classification. Experimental results show that the method can extract more discriminative features from the original electroencephalogram signals, in the execution of auditory attention classification, the average classification accuracy of 96.5% and 76.3% is obtained in a subject and a cross-subject experiment under a one-second decision window, and compared with other methods, the classification effect is obviously improved.
Owner:TIANJIN UNIV

Cross-scene auditory attention decoding model generation method and device and electronic equipment

ActiveCN119055253AMinimize data differencesReduce field shiftInternal combustion piston enginesBiological modelsElectric signalDomain adaptation
The invention relates to a cross-scene auditory attention decoding model generation method and device and electronic device.The generation method comprises the steps that source domain electroencephalogram signals and target domain electroencephalogram signals are obtained, and the source domain electroencephalogram signals and the target domain electroencephalogram signals are electroencephalogram signals generated by a subject in different scenes; pre-training the auditory attention decoding model through the source domain electroencephalogram signal, and performing domain adaptation training on the pre-trained auditory attention decoding model through the target domain electroencephalogram signal. According to the cross-scene auditory attention decoding model generation method provided by the invention, the regularization loss (SRL) is adopted as the domain adaptation loss, and the data difference between different scenes can be minimized, so that the domain offset is reduced, the auditory attention decoding model adaptive to different scenes can be generated, and the problem of the traditional auditory attention decoding model generation method is solved. And auditory attention decoding models adaptive to different scenes cannot be generated.
Owner:ANHUI UNIV

Auditory attention detection method based on pulse inspiration

The invention relates to the field of brain-computer interfaces in the interdiscipline of computers and neuroscience, and provides an auditory attention detection method based on pulse inspiration. A threshold value calculation module in the method provides a threshold value for a pulse layer, and an electroencephalogram branch and an audio branch are used for processing time-synchronized electroencephalogram signals and voice envelopes respectively. The electroencephalogram branch extracts time features by using a pulse layer and encodes the time features, wherein a channel attention module for electroencephalogram is arranged; according to the audio branch, two input audios are subjected to feature extraction by using a pulse layer and are coded. A feature fusion module is used for extracting fusion features of the electroencephalogram and the two audios; and finally, obtaining an auditory attention detection result by using a classifier. Experiments show that the method realizes high accuracy under low delay and short decision window, has better generalization, and has stable detection results on different subjects.
Owner:DALIAN UNIV OF TECH

Attitude data generation method, image acquisition equipment and storage medium

The invention discloses an attitude data generation method, an image acquisition device and a storage medium, relates to the technical field of attitude detection, and discloses an attitude data generation method comprising the following steps: obtaining a dual-channel image, a dual-channel audio and dual-channel inertial sensing data collected by an earphone unit; extracting heterogeneous visual features based on the dual-channel image; extracting a spatial auditory attention mask based on the dual-channel audio; determining action characteristics based on the dual-channel inertial sensing data; fusing the heterogeneous visual features, the spatial auditory attention mask and the action features to obtain attitude description features; and according to the attitude description features, determining attitude evaluation indexes corresponding to the detection target. Through three-mode data fusion processing of visual, auditory and inertial sensing data, a semantic correspondence relationship is established among different modes, and a more stable and context-aware behavior recognition capability is provided, so that the accuracy of attitude anomaly detection is improved.
Owner:GEER TECH CO LTD

Space auditory attention dynamic coupling analysis method and system based on multilayer network

The invention discloses a spatial auditory attention dynamic coupling analysis method and system based on a multilayer network, and the method comprises the following steps: collecting electroencephalogram signals of a plurality of brain regions induced by a spatial auditory attention task in a complex acoustic environment, and carrying out the electroencephalogram data preprocessing; constructing a multi-layer rhythm network and a multi-layer time-varying network; constructing a cross-time-frequency coupling super-connection network based on the multi-layer rhythm network and the multi-layer time-varying network brain configuration, and determining a core network layer of the cross-time-frequency coupling super-connection network by using interlayer correlation and interlayer conditional probability; and carrying out quantitative analysis on the network attributes of the core network layer to obtain a connection mode and a cooperative working mode between the responsible brain regions. According to the method, the four-dimensional hyperconnection network is constructed, frequency and time information is integrated, and a complex interaction mechanism of spatial auditory attention is accurately and quantitatively analyzed.
Owner:BRAIN-COMPUTER INTERACTION & HUMAN-COMPUTER INTEGRATION HAIHE LAB

Auditory attention decoding method and system based on multi-scale frequency-space attention network

The invention discloses an auditory attention decoding method and system based on a multi-scale frequency-space attention network, and the method comprises the following steps: obtaining electroencephalogram data when a user focuses on listening to voices in different directions, dividing the electroencephalogram data through a sliding window, generating a series of decision windows, and enabling each decision window to comprise an electroencephalogram signal; a multi-scale time domain convolution module processes the input electroencephalogram signals and extracts time domain features of different frequency ranges, the frequency-space attention module converts the time domain features into a frequency-space feature map, and the frequency-space feature map is used as a frequency-space feature map; further capturing a global dependency relationship among different brain regions, and extracting frequency spectrum space information related to auditory attention; and the full connection layer classification module outputs the probability that the predicted voice direction is the left side direction or the right side direction based on the spectrum space information. According to the method, the auditory attention decoding accuracy is remarkably improved.
Owner:BRAIN-COMPUTER INTERACTION & HUMAN-COMPUTER INTEGRATION HAIHE LAB

Brain-controlled speech enhancement method and system based on electroencephalogram signal neural decoding

The invention discloses a brain-controlled speech enhancement method and system based on electroencephalogram signal neural decoding. The method comprises the following steps: synchronously acquiring multi-channel speech signals and EEG signals; compact features related to auditory attention are extracted from the EEG signals through the EEG coding network and serve as auditory cognitive state representation, and an auditory consensus field continuously evolved on the slow time scale is constructed; performing time-frequency modeling on the multi-channel voice signals based on deep learning, and constructing a deep voice time-frequency analysis network; and performing voice time-frequency spectrum gain modulation and neural beam forming weight gain modulation on the signal by using an auditory consensus field, converting the signal back to a time domain, and outputting a finally enhanced target voice signal. According to the invention, by constructing an auditory consensus field driven by the EEG, neural modulation of a frequency spectrum characteristic flow of a deep speech time-frequency analysis network and a space beam forming weight of a neural network beam forming module is realized, so that speech enhancement in a complex acoustic environment and robustness and stability of a system are improved.
Owner:HUIZHOU UNIV

Chinese continuous language text reconstruction method based on electroencephalogram signals

The invention relates to the technical field of natural language processing, and particularly discloses a Chinese continuous language text reconstruction method based on electroencephalogram signals, which comprises the following steps of: selecting a diversified Chinese corpus and preprocessing the Chinese corpus as an audio stimulation material; based on the audio stimulation material, collecting electroencephalogram data of an auditory attention experiment of the subject, and preprocessing the data; providing a time scale driven word level-EEG synchronization method, and extracting word level text features and a word level EEG sequence; extracting space-time-frequency fusion EEG features by using the space-time-frequency fusion EEG-text self-supervised learning coding model, and predicting word-level text features of the space-time-frequency fusion EEG features; and based on a cluster search Chinese continuous language dynamic decoding model guided by a pre-training model, combining the predicted word-level text features to realize Chinese continuous language text reconstruction. According to the method, the relation between the electroencephalogram signals and the text features is fully revealed, so that more natural and smoother text information is generated, and finally the accuracy of Chinese continuous language reconstruction is improved.
Owner:南昌理工学院 +1

Multi-modal speech enhancement method and device based on deep learning model

PendingCN121963735AImplement adaptive bindingAchieve natural bindingSpeech recognitionSound source locationSound sources
The invention discloses a multi-modal speech enhancement method and device based on a deep learning model, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining the head posture data, binaural audio signals and visual context information of a user in a virtual reality environment, coding the binaural audio signals into three-dimensional space acoustic features, and carrying out the coding of the three-dimensional space acoustic features; and extracting virtual sound source position features and lip motion features from the visual context information, inputting the features into an immersive fusion enhancement network, selectively enhancing or inhibiting acoustic features from different spatial directions, generating an enhanced audio stream, and outputting the enhanced audio stream through a binaural rendering engine. According to the method, the technical problems that in the prior art, due to the fact that multi-modal prior information cannot be effectively fused, voice enhancement lacks spatial selectivity, and an interference sound source irrelevant to vision is difficult to restrain are solved, and head posture dynamic attention and lip motion cross-modal constraint are fused; the technical effects of natural binding of auditory attention and a visual focus and effective suppression of an interference sound source are achieved.
Owner:SHUTIAN (HANGZHOU) ARTIFICIAL INTELLIGENCE TECHNOLOGY CO LTD

Auditory attention decoding method and device based on EEG signal and medium

The invention discloses an auditory attention decoding method and device based on EEG signals and a medium, and relates to the technical field of electroencephalogram signal processing. The method comprises the following steps: acquiring an EEG signal, and applying a sliding window to the EEG signal to obtain a sample pair; inputting the sample pair into a multi-scale time feature extraction module, and obtaining a time-varying feature map through multi-layer time convolution; inputting the time-varying feature map into a spatial-temporal feature interaction device, processing the time-varying feature map through a multi-view spatial selection mechanism and an adaptive attention module to obtain a first feature map and a second feature map, and fusing the first feature map and the second feature map to obtain a spatial-temporal feature map; a multi-scale time feature extraction module and a spatial-temporal feature interaction device are combined to form an auditory attention decoding model, and the auditory attention decoding model is trained based on a twinborn contrast learning strategy to realize extraction of selection deviation features. According to the invention, lightweight and high-performance auditory attention decoding can be realized.
Owner:CHENGDU UNIV OF INFORMATION TECH

Auditory attention decoding method, device, equipment and medium based on multi-sound source scene

The embodiment of the present invention provides an auditory attention decoding method, device, equipment and medium based on a multi-sound source scenario, which belongs to the field of EEG signal technology. The method includes: obtaining an initial EEG signal to which an initial user responds under a first sound stimulus, a multi-sound source speech signal of the first sound stimulus and a sound source label of the multi-sound source speech signal; preprocessing the initial EEG signal and the multi-sound source speech signal to obtain an EEG signal to be processed of the initial EEG signal and a speech signal to be processed of the multi-sound source speech signal; training an initial auditory attention decoding model according to the EEG signal to be processed, the speech signal to be processed and the sound source label to obtain a target auditory attention decoding model; obtaining a target EEG signal to which a target user responds under a second sound stimulus and a target speech signal of the second sound stimulus; using the target auditory attention decoding model to perform auditory attention decoding on the target EEG signal and the target speech signal to obtain an attention target.
Owner:XIAOZHOU TECH CO LTD

Communication robot, communication robot control method, and program

A communication robot includes an auditory information processing portion configured to recognize a volume of voice collected by a sound collection portion and generate an auditory attention map by projecting a sound position in a three-dimensional space onto a two-dimensional attention map in which the robot is located at a center, a visual information processing portion configured to generate a visual attention map using a face detection result obtained by detecting a face of a person from an image captured by an imaging portion and a motion detection result obtained by detecting a motion of the person, an attention map generation portion configured to generate an attention map by integrating the auditory attention map and the visual attention map, and a motion processing portion configured to control eyeball movements and motions of the communication robot using the attention map.
Owner:HONDA MOTOR CO LTD

Audio scene modification

A method and apparatus comprising measuring neural activity of a user during output and / or capture of an audio scene before identifying, based on the measured neural activity, at least one target audio source of the audio scene which has the auditory attention of the user. The output and / or capture of at least part of the audio scene is then modified based on the identification. Preferably, the modifying comprises, during output of the audio scene, emphasizing output of audio associated with the at least one target audio source relative to audio associated with one or more other audio sources of the audio scene. Preferably, the emphasising comprises amplifying or attenuating the audio associated with the at least one target audio source relative to the audio associated with the one or more other audio sources of the audio scene. Preferably, the audio scene comprises a plurality of audio sources and wherein audio associated with the plurality of audio sources is output such that the audio sources will be perceived at different respective positions with respect to the user.
Owner:NOKIA TECHNOLOGIES OY

Auditory attention detection method and device, computer equipment and readable storage medium

The invention relates to an auditory attention detection method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring an electroencephalogram signal without voice stimulation; converting the electroencephalogram signals into weighted pulse electroencephalogram features in an attention model; performing feature extraction on a sequence formed by the weighted pulse electroencephalogram features through a long-short term memory network model to obtain an electroencephalogram hiding state; classifying according to the electroencephalogram hiding state to obtain auditory attention information; the auditory attention information represents the sound source position of the voice felt by the object to which the electroencephalogram signal without voice stimulation belongs. By adopting the method, the calculation cost can be reduced on the basis of ensuring the accuracy.
Owner:THE CHINESE UNIV OF HONG KONG (SHENZHEN)

Or relating to earpieces

An apparatus for detecting ear structure movements or changes, or changes in pressure in the ear-canal of a user, in order to control or affect the function of an associated device. The apparatus includes a sensor apparatus capable of being worn by the user to be located in or adjacent an ear-canal of the user. The sensor apparatus includes at least one sensor being located and configured to detect and capture sensor data relating to middle ear, ear-drum complex, ear-drum margin, and / or other ear structure movements or changes of characteristics, or changes in pressure in the ear-canal of the user. A device is provided for processing and analysing sensor data from the sensor apparatus. The device analyses sensor data concerning: eye movement or directional auditory attention or focus data, and / or voluntary control data.
Owner:EARSWITCH LTD

Auditory attention decoding method and system based on blink sequence

The invention discloses an auditory attention decoding method and system based on a blink sequence, and belongs to the technical field of brain-computer interfaces. In order to solve the problems of low accuracy, large delay and high calculation amount in auditory attention decoding, recognition of audience attention voice streams is realized by preprocessing electroencephalogram and electro-oculogram signals, extracting voice envelopes, constructing a blink sequence and inputting the blink sequence into a multi-modal deep convolutional neural network. According to the method, high-precision and robust auditory attention decoding can be realized under a low-delay condition, and the method is suitable for hearing-aid equipment and a brain-computer interface system.
Owner:PEKING UNIV

Lightweight auditory attention detection method and system based on spatial-temporal feature enhancement

The invention discloses a lightweight auditory attention detection method and system based on spatial-temporal feature enhancement, and relates to the technical field of auditory attention detection processing. According to the method, multiple sections of aligned electroencephalogram data are obtained through preprocessing, and a lightweight auditory attention detection model is designed to process the aligned electroencephalogram data so as to obtain an auditory attention detection result. A lightweight auditory attention detection model used in the method comprises a space-time dependent coding part, a multi-scale time feature enhancement part, a space-time cross attention part and a classification prediction part. According to the method, finer auditory attention spatio-temporal characteristics with better discrimination in the electroencephalogram signals can be captured, and the performance with better precision than that of an existing algorithm is obtained; and the model realizes light weight, the calculation cost is reduced, and the method is more suitable for practical application.
Owner:ANHUI UNIV

Estimation device, estimation method, program, and estimation system

PCT designated stageWO2025215698A1Eye diagnosticsPupil diameterMedicine
Provided are an estimation device and the like that make it possible to highly accurately estimate the auditory attention of a subject in real time, even when biological information for a neutral state cannot be acquired. An estimation device according to the present invention includes a storage unit that stores biological information that is time-series information for pupil diameter acquired while a subject is presented with an image that has different luminances, a region information acquisition unit that acquires region information that is index values for the brightness of regions of the image presented to the subject, an analysis unit that calculates a statistical trend for the time-series change in the pupil diameter from the biological information for the subject, and an estimation unit that uses the region information and the statistical trend for the time-series change in the pupil diameter to estimate the direction in which the attention of the subject is directed.
Owner:NT T INC

Electroencephalogram auditory attention recognition incremental learning method and device, equipment and medium

The invention discloses an electroencephalogram auditory attention recognition incremental learning method, device and equipment and a medium, and the method comprises the steps: carrying out the preprocessing and time-frequency feature extraction of a multi-channel electroencephalogram signal, and obtaining a global time sequence context feature through a convolutional attention network; a dynamic self-organizing incremental neural network module is constructed, and similarity matching and topology management are carried out through a prototype node set; wasserstein distance is introduced to measure data distribution difference, and when a threshold value is exceeded, an adaptive expansion mechanism is triggered; key parameters are restrained by combining an elastic weight solidification mechanism, and catastrophic forgetting is prevented. According to the method, continuous online learning in a non-stationary electroencephalogram signal environment is realized, self-adaptive distribution drifting can be realized without retraining the whole network, the accuracy, robustness and long-term stability of auditory attention recognition are remarkably improved, and the method can be widely applied to the fields of brain-computer interfaces, intelligent hearing-aid equipment, neural rehabilitation and the like.
Owner:SHENZHEN CHILDRENS HOSPITAL

Brain-computer interface equipment for auditory attention detection and rehabilitation

The utility model provides a brain-computer interface device for auditory attention detection and rehabilitation, which comprises an audio sensor, the audio sensor is connected with a sound processor chip, the sound processor chip is connected with an electroencephalogram signal acquisition electrode through a wire, the electroencephalogram signal acquisition electrode is provided with an acquisition electrode connector, and the acquisition electrode connector is connected with the sound processor chip through a wire. A data transmission wire is arranged at the end of the collecting electrode connector and connected with a signal amplifier, the signal amplifier is in circuit connection with a filter, the filter is connected with an analog-to-digital converter, sound signals are collected through an audio sensor, electroencephalogram signals are analyzed after a series of processing, and the electroencephalogram signals are transmitted to the analog-to-digital converter. And the auditory attention condition of the individual can be accurately detected. Meanwhile, targeted training and rehabilitation are carried out through components such as a feedback signal generator, an auditory stimulation induction wafer and a tactile feedback device, and the auditory attention level of the patient can be improved.
Owner:GANSU MATERNAL & CHILD HEALTH HOSPITAL (GANSU PROVINCIAL CENTRAL HOSPITAL) +1

Auditory attention decoding method, auditory enhancement method, hearing aid and sound system

The invention discloses an auditory attention decoding method, an auditory enhancement method, a hearing aid and a sound system, and the decoding method comprises the steps: extracting a differential entropy feature tensor in an electroencephalogram signal, inputting the differential entropy feature tensor into a frequency domain branch of a dual-path time-frequency fusion neural network model, and inputting the electroencephalogram signal subjected to CSP processing into a time domain branch of the model; the model outputs an auditory attention decoding result; the frequency domain branch is configured with a two-dimensional convolution layer, a maximum pooling layer, a three-dimensional convolution residual module, an average pooling layer and a feature paving layer so as to finally output a first output feature; the time domain branch is configured with a feature embedding layer, a first attention decoding module, a second attention decoding module, a splicing module and a linear layer so as to finally output a second output feature; and finally, fusing the first output feature and the second output feature, and comprehensively capturing multi-scale time sequence features and space-spectrum coupling information, thereby realizing accurate auditory attention recognition in a short time window.
Owner:SHANGHAI XINLIJI SEMICON CO LTD

Brain electricity auditory attention decoding method based on confrontation contrast learning and corresponding product

The invention relates to the field of machine learning, and provides an electroencephalogram auditory attention decoding method based on confrontation contrast learning and a corresponding product. The method comprises the following steps: training an electroencephalogram feature encoder and a classifier by using source domain electroencephalogram data with labels; extracting features of the target domain electroencephalogram data by using a target domain electroencephalogram feature encoder, generating a pseudo tag based on a pre-trained classifier, and realizing preliminary alignment of source domain feature distribution and target domain feature distribution through supervised comparative learning; a source domain electroencephalogram feature encoder and a target domain electroencephalogram feature encoder are respectively used for extracting source domain features and target domain features, and fine distribution alignment of the target domain features and the source domain features is realized through adversarial learning of a feature alignment network and a domain discriminator in combination with a multi-objective function; and inputting to-be-decoded target domain electroencephalogram data into the optimized electroencephalogram feature encoder and classifier to perform auditory attention state decoding. According to the technical scheme, the generalization ability and stability of cross-subject electroencephalogram decoding are remarkably improved.
Owner:HUIZHOU UNIV

Method and system for dynamic coupling analysis of spatial auditory attention based on a multi-layer network

The present invention discloses a method and system for dynamically coupling and analyzing spatial auditory attention based on a multi-layer network. The method includes the following steps: collecting electroencephalogram (EEG) signals of multiple brain regions induced by spatial auditory attention tasks in a complex acoustic environment and performing preprocessing on the EEG data; constructing a multi-layer rhythm network and a multi-layer time-varying network; constructing a cross-time-frequency coupling hyperconnection network based on the multi-layer rhythm network and the multi-layer time-varying network, and determining the core network layer of the cross-time-frequency coupling hyperconnection network by using inter-layer correlation and inter-layer conditional probability; quantitatively analyzing the network attributes of the core network layer to obtain the connection pattern and collaborative working mode among the responsible brain regions. The present invention integrates frequency and time information by constructing a four-dimensional hyperconnection network, and accurately quantitatively analyzes the complex interaction mechanism of spatial auditory attention.
Owner:BRAIN-COMPUTER INTERACTION & HUMAN-COMPUTER INTEGRATION HAIHE LAB

Ultrahigh frequency sensor denoising method based on auditory bionic model

The invention provides an ultrahigh frequency sensor denoising method based on an auditory bionic model, and belongs to the technical field of partial discharge verification. Aiming at the problems that S parameter ultrahigh frequency signal (300MHz-1.5 GHz) processing is limited by frequency spectrum resolution and non-linear frequency perception of a biological auditory model is insufficient in a traditional method, the invention provides a verification method fusing a down-conversion technology and bionic signal enhancement. Comprising the following steps: down-converting a high-frequency signal to a baseband through digital frequency conversion; a 128-channel Gammatone filter bank is used for carrying out nonlinear frequency band division, the distribution characteristic of the basement membrane frequency is simulated, and frequency band coverage with dense low frequency and sparse high frequency is achieved; extracting a channel signal envelope through Hilbert transform; a phase-amplitude coupling mechanism is simulated in combination with a nerve distribution rate model, and dynamic gain is applied to a partial discharge characteristic frequency band (300MHz-1.5 GHz) based on an auditory attention mechanism to suppress irrelevant noise. According to the invention, through adaptive gain control of the frequency band importance weight function and the signal-to-noise ratio, suppression of irrelevant noise is realized, the key frequency band precision and the anti-interference capability are improved, and ultrahigh frequency sensor fault diagnosis and partial discharge verification can be efficiently realized.
Owner:CHINA UNIV OF MINING & TECH

Electroencephalogram auditory attention classification method and system based on time-frequency attention mechanism

The application discloses an electroencephalogram auditory attention classification method and system based on a time-frequency attention mechanism, and belongs to the field of pattern recognition and biomedical signal processing. Specifically, first, the original electroencephalogram signal is subjected to multi-band filtering, re-referencing, multi-band electroencephalogram splicing and windowed slicing preprocessing. Then, different weights are assigned to different frequency bands in the multi-band electroencephalogram signal, the multi-band electroencephalogram is fused into a two-dimensional electroencephalogram signal, the frequency domain features of the electroencephalogram signal are extracted, and the time sequence features of the electroencephalogram signal are extracted. Finally, the electroencephalogram signal with the extracted frequency domain features and time domain features is used to extract deep auditory attention features in the electroencephalogram signal by using a lightweight residual neural network, and auditory attention classification is performed. Experimental results show that the method can extract more discriminative features from the original electroencephalogram signal, and in the execution of auditory attention classification, 96.5% and 76.3% average classification accuracies are achieved in the within-subject and cross-subject experiments under a one-second decision window, and the classification effect is obviously improved compared with other methods.
Owner:TIANJIN UNIV

Brain-inspired hearing aid method and apparatus, hearing aid device, computer device, and storage medium

A brain-inspired hearing aid method is provided. The method includes: acquiring a noisy voice signal from a complex acoustic environment where a hearing aid wearer is located, and an electroencephalogram signal and an eye movement signal of the hearing aid wearer; performing decoding of the electroencephalogram signal to obtain a feature representation of a voice signal of an auditory attention target; performing decoding of the eye movement signal to obtain an auditory attention orientation; extracting the voice signal of the auditory attention target from the noisy voice signal in a complex acoustic environment based on the feature representation; extracting a voice signal of the auditory attention orientation from the noisy voice signal in a complex acoustic environment based on the auditory attention orientation; and fusing the voice signal of the auditory attention target with the voice signal of the auditory attention orientation to obtain to-be-outputted auditory attention voice signal.
Owner:CHINESE UNIVERSITY OF HONG KONG (SHENZHEN) THE +1

A Chinese continuous language text reconstruction method based on EEG signals

The present invention relates to the field of natural language processing technology, and specifically discloses a method for reconstructing Chinese continuous language text based on electroencephalogram (EEG) signals, comprising the following steps: selecting a diverse Chinese corpus and preprocessing it as audio stimulation material; based on the audio stimulation material, collecting EEG data of a subject performing an auditory attention experiment and performing data preprocessing; proposing a time-scale-driven word-level EEG synchronization method to extract word-level text features and word-level EEG sequences; utilizing a spatiotemporal-frequency fusion EEG-text self-supervised learning encoding model to extract spatiotemporal-frequency fusion EEG features and predict their word-level text features; and realizing Chinese continuous language text reconstruction based on a beam search Chinese continuous language dynamic decoding model guided by a pre-trained model and combining the predicted word-level text features. The method of the present invention fully reveals the connection between EEG signals and text features, thereby generating more natural and fluent text information, and ultimately improving the accuracy of Chinese continuous language reconstruction.
Owner:南昌理工学院 +1

Auditory attention detection method and device based on multi-scale mixed attention network

The invention discloses an auditory attention detection method and device based on a multi-scale mixed attention network, and relates to the technical field of auditory attention detection processing. According to the method, the original electroencephalogram data is subjected to window-sliding segmentation processing to obtain the multi-section window electroencephalogram data, the multi-scale mixed attention network is designed to process the window electroencephalogram data to obtain the auditory attention detection result, and the result accuracy is obviously improved compared with an existing model; and the whole network realizes light weight, the calculation cost is reduced, and the method is more suitable for practical application. According to the multi-scale mixed attention network designed by the invention, multi-scale space-time dependence in electroencephalogram signals is captured through multi-scale time attention, channel self-attention and multi-scale global attention, and refined space-time features are further integrated and refined in a time dimension and a space dimension through a space-time convolution part; and the accuracy of subsequent classification prediction is ensured and improved.
Owner:ANHUI UNIV

Electroencephalogram analysis method based on audio-visual combination natural corpus experiment normal form

The invention discloses an electroencephalogram analysis method based on an audio-visual combination natural corpus experiment normal form. The method comprises the following steps: step 1, making an audio-visual material; step 2, designing an experiment normal form: the experiment normal form comprises a pure listening experiment stage and an audiovisual experiment stage, each experiment is stimulated according to four test groups of pure audio, audio and video, pure audio and audio and video, videos in the experiment groups are videos of broadcasting personnel, and videos in the control group are fixed pictures; 3, electroencephalogram data of the testee under the stimulation condition in the step 2 are collected, the testee answers the semantic understanding selection questions in the step 2, and behavioral answering data of the testee are recorded; and 4, comparing and analyzing the auditory single-mode electroencephalogram data and the audiovisual dual-mode electroencephalogram data. According to the invention, data required by audiovisual integration and auditory attention related electroencephalogram research can be conveniently obtained.
Owner:TIANJIN UNIV