Multimodal cognitive screening method and apparatus based on brain-computer interface and expression recognition

By combining brain-computer interface and facial expression recognition technology, a multimodal cognitive screening device and method were constructed, which solved the problems of low accuracy and cumbersome operation of existing cognitive screening methods, and realized a comprehensive assessment and accurate detection of cognitive state.

CN119559684BActive Publication Date: 2026-04-21SHAANXI GAOFENG INTELLIGENT TECHNOLOGY CO LTD +1
3 Cites 0 Cited by

Patent Information

Application Number
CN202411723249.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-11-28
Publication Date
2026-04-21
Estimated Expiration
2044-11-28

AI Technical Summary

Technical Problem

Existing cognitive screening methods rely on patients' subjective cooperation and expressive abilities, resulting in low accuracy and cumbersome operation, and lack the organic integration of brain-computer interface and computer vision technology.

Method used

By combining brain-computer interface and facial expression recognition technology, feature extraction and fusion evaluation are performed by collecting EEG signals and facial expression images to construct a multimodal cognitive screening device and method. The signal feature extraction module and cognitive evaluation module are used for data cleaning, normalization, differential feature extraction and feature calculation to achieve fusion evaluation of EEG feature sequences and facial expression category sequences.

Benefits of technology

It improves the accuracy and comprehensiveness of cognitive screening, ensures the accuracy of cognitive impairment assessment, and adopts a non-invasive testing method that is easy for users to accept and use.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

This invention discloses a multimodal cognitive screening method and apparatus based on brain-computer interface and facial expression recognition. The apparatus includes: a brain-computer interface module, an image acquisition module, a signal feature extraction module, and a cognitive assessment module. The brain-computer interface module is used to acquire the electroencephalogram (EEG) signal sequence of a user during a cognitive test. The image acquisition module is used to acquire a set of facial expression images of the user during the cognitive test. The signal feature extraction module is used to perform feature recognition and extraction processing on the acquired EEG signal sequence and facial expression image set to obtain an EEG feature sequence and an expression category sequence. The cognitive assessment module is used to perform fusion assessment processing on the EEG feature sequence, expression category sequence, facial expression image set, and EEG signal sequence to obtain a cognitive impairment assessment result.
Need to check novelty before this filing date? Find Prior Art