Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

2685results about "Psychotechnic devices" patented technology

Lower limb weight-bearing gait rehabilitation training system

The invention relates to the technical field of medical rehabilitation, and discloses a lower limb weight-bearing gait rehabilitation training system which comprises a data acquisition module, a data processing and analysis module, a patient individualized modeling module, an intelligent decision and control module, a rehabilitation execution module and a man-machine interaction and medical information interface module which are in communication connection through a network. The data acquisition module is used for acquiring multi-modal data of a patient in real time, and the multi-modal data comprises static sign data, dynamic physiological parameters, kinematics and dynamics parameters and non-motion physiological and psychological state data; and the data processing and analysis module is used for carrying out preprocessing, feature extraction and deep analysis on the original data, and outputting a structured patient individualized feature vector and an evaluation result. According to the invention, a patient three-dimensional skeletal muscle digital twinborn model is constructed through the patient individualized modeling module, and in combination with a continuous learning intelligent model library, body sign differences of different patients can be accurately adapted.
Owner:SHANGHAI TIANYOU HOSPITAL CO LTD

Emotion recognition and intervention system based on facial micro-expression and physiological signal fusion

The invention belongs to the technical field of artificial intelligence and health monitoring, and particularly relates to an emotion recognition and intervention system based on facial micro-expression and physiological signal fusion. The emotion recognition precision is improved through space-time alignment analysis of facial micro-expressions and physiological signals, adaptive feedback is achieved in combination with cognitive load correlation modeling and a wearable multi-channel regulation and control terminal, cross-period emotion evolution prediction and group situation awareness are supported, a'awareness-decision-intervention 'complete closed loop is constructed, and the emotion recognition efficiency is improved. And the accuracy and initiative of emotion management in a complex environment are enhanced.
Owner:JIANGSU ZHUODUN INFORMATION TECH CO LTD

Driving fatigue monitoring auxiliary system based on Beidou satellite positioning and multi-modal data fusion technology

The invention provides a driving fatigue monitoring auxiliary system based on Beidou satellite positioning and a multi-modal data fusion technology, which relates to the field of electric digital data processing and comprises a multi-modal information sensing and acquisition module, a data preprocessing and quality assurance module, a fatigue state recognition and evaluation module and an intelligent early warning and adaptive optimization module. The multi-modal information perception and acquisition module is responsible for acquiring driver states, driving behaviors and environment information in real time, and the data preprocessing and quality assurance module is responsible for performing space-time alignment, quality evaluation and feature standardization on multi-source data. The fatigue state recognition and evaluation module is responsible for fusing multi-dimensional features and judging fatigue levels and risk trends, and the intelligent early warning and self-adaptive optimization module is responsible for implementing hierarchical intervention and continuously optimizing system performance; according to the system, the accurate space-time reference provided by Beidou satellite positioning is utilized, effective fusion of multi-source heterogeneous data is realized, and the accuracy, the real-time performance and the individuation level of fatigue monitoring are remarkably improved.
Owner:HUNAN AUTOMOTIVE ENG VOCATIONAL COLLEGE +1

Vestibular function and cognitive function rehabilitation training system and method based on virtual reality

The invention relates to the technical field of medical rehabilitation, and discloses a vestibular function and cognitive function rehabilitation training system and method based on virtual reality, and the rehabilitation training system comprises a hardware platform, a software platform and a server. The hardware platform comprises VR interaction equipment, a head motion tracking sensor and calculation and display equipment; the software platform is integrated with a user management module, a visual stimulation module, a vestibular rehabilitation training module, a cognitive evaluation and training module, a dynamic visual acuity evaluation module and a data management and analysis module. By combining black and white chess grid visual stimulation, standardized vestibular rehabilitation tasks, spatial cognitive testing and DVA objective monitoring, synchronous evaluation and personalized collaborative intervention of vestibular functions and cognitive functions of dizzy patients are realized. According to the method, the problems of boring traditional rehabilitation means, subjective evaluation and lack of quantitative feedback are solved, and the scientificity, interestingness and curative effect testability of rehabilitation training are remarkably improved.
Owner:GENERAL HOSPITAL OF NUCLEAR IND

Epilepsy prediction method based on adaptive sparse attention and hierarchical graph convolutional network

The invention relates to an epilepsy prediction method based on adaptive sparse attention and a hierarchical graph convolution network, and the method comprises the steps: carrying out the time domain convolution, spectrum transformation and Haar wavelet down-sampling of an electroencephalogram signal, respectively generating time domain, spectral domain and fidelity down-sampling features, and fusing the features into a low-level feature set; on the basis of a sparse attention mechanism, constructing and applying a multi-level sparse mask to adaptively screen and weight-aggregate key discriminative features in the feature set to obtain screened features; on the basis of the feature, by constructing a local channel graph and a global frequency band graph and respectively executing graph convolution, capturing local spatial correlation of each channel in a single frequency band and global cross-frequency-band spatial dependence among different frequency bands, and fusing the local spatial correlation and the global cross-frequency-band spatial dependence into an embedded feature; and inputting the embedded features into a classifier to obtain a state probability, and triggering an alarm based on the state probability. Therefore, the problems of key information loss, insufficient time-space spectrum dependent modeling and feature redundancy are solved, and the accuracy, stability and real-time performance of epilepsy prediction are improved.
Owner:NINGXIA UNIVERSITY

Intelligent dynamic assessment method for psychological states of teenagers based on multi-modal data

The invention relates to the technical field of intelligent assessment of psychological states, and discloses an intelligent dynamic assessment method for psychological states of teenagers based on multi-modal data. The method comprises the steps that multi-modal psychological data of a target assessment object is acquired, the multi-modal psychological data comprises voice emotion information and expression behavior relations, and dynamic features are extracted from the multi-modal psychological data; performing feature fusion processing on the psychological data by adopting a trained machine learning model to generate a multi-modal feature set containing a mapping relation between modal type identifiers and time sequence codes; based on the multi-modal feature set, performing time sequence correlation analysis on the dynamic features through a state analysis network to obtain a fusion result containing emotion dimension features and cognitive mode features; and inputting a fusion result into an evaluation model for dynamic state deduction processing, and outputting psychological state evaluation elements. According to the invention, comprehensive and dynamic assessment of the psychological state can be realized.
Owner:LUDONG UNIVERSITY +1

Multi-modal psychological state quantitative evaluation method and device and medium

The invention relates to the field of physiological parameter detection and medical diagnosis measurement, in particular to a multi-mode psychological state quantitative evaluation method and device and a medium thereof. The method comprises the following steps: acquiring multi-source physiological and behavior signals and situation metadata, performing clock synchronization and equipment identifier mapping processing, performing quality feature extraction, artifact detection and slice completion processing, and generating a quality passing fragment set; de-noising normalization, time windowing and feature stack construction, modal gating and attention weighting processing are executed, and unified time sequence embedding is generated; through domain alignment parameter estimation, double-domain drift correction and multi-task inference, a psychological state quantitative index and uncertainty thereof are output; and finally, generating a structured evaluation report and updating parameters through consistency comparison, online self-distillation updating and individual baseline refreshing. According to the method, the anti-interference performance, the individual suitability and the result credibility of psychological state assessment in a natural scene are effectively improved.
Owner:HUAIHUA UNIV

Intelligent virtuality and reality combined mental health service device based on digital elements

The invention provides an intelligent virtuality and reality combined psychological health service device based on digital elements, and aims to improve the accuracy and individuation level of psychological health management. The device firstly obtains the physiological indexes, behavior data, environmental factor data and social economic data of an individual, and carries out multi-modal fusion to form comprehensive feature data. Based on this, a psychological health environment factor model is constructed to quantify the influence of the external environment on the individual psychological state, and the calculation weight and prediction logic of the negative emotion large model are optimized. And the optimized negative emotion large model is used for identifying an individual emotion state, analyzing factors such as social environment, economic pressure and life events in combination with the mental health environment factor model, and generating an individual mental health assessment result. And according to an evaluation result, the virtual digital doctor provides intelligent pre-inquiry and other services. Through data-driven intelligent analysis and virtual-real combined intervention means, the accessibility, accuracy and intervention effect of psychological health services are improved.
Owner:SHANGHAI MENTAL HEALTH CENT (SHANGHAI PSYCHOLOGICAL COUNSELLING TRAINING CENT)

Hand-eye coordination and attention evaluation method based on mobile phone

The invention discloses a hand-eye coordination and attention evaluation method based on a mobile phone, and relates to the technical field of man-machine interaction and user behavior evaluation, and the method comprises the following steps: S1, in the process that a user executes a symbol matching test task of a mobile phone terminal, obtaining a heart rate variability sequence and an operation sequence interruption frequency, filtering and segmenting the pupil diameter change and the brain wave rhythm to obtain an original feature set; according to the hand-eye coordination and attention evaluation method based on the mobile phone, the continuity, reliability and objectivity of an evaluation conclusion are improved, the method is suitable for cognitive evaluation, man-machine interaction analysis and related intelligent application scenes, and the scientificity and practical value of hand-eye coordination and attention evaluation based on the mobile phone are improved.
Owner:FEIYOU TECH CO LTD

Systems and methods to measure, predict and optimize brain function

Methods and apparatus for changing a brain state of a person from an initial brain state to a target brain state are described. The method includes receiving information characterizing the initial brain state, the information including a structural composition and a functional architecture of the brain, estimating based, at least in part, on the received information, a potential for the brain to change from the initial brain state to the target brain state, determining based, at least in part, on the received information and the estimated potential for the brain to change from the initial brain state to the target brain state, a non-invasive brain stimulation protocol, and controlling at least one non-invasive brain stimulation device to stimulate the brain according to the non-invasive brain stimulation protocol. The method also includes using brain information to inform the design of computational general artificial intelligence agents.
Owner:HORIZON NEUROSCIENCES LLC

Intelligent evaluation system and intervention method for mental health of teenagers

The invention discloses an intelligent evaluation system and intervention method for mental health of teenagers, and the method comprises the following steps: collecting multi-mode psychological signal data of the teenagers, and carrying out the preprocessing; establishing a cognitive energy field, and generating a cognitive energy time sequence curve; performing spectrum resonance analysis, and combining the spectrum resonance analysis with a cognitive energy time sequence curve; constructing a psychological topological graph, and calculating a topological complexity index; when the topology complexity index is continuously abnormal or the cognitive energy disturbance amplitude exceeds a set threshold value, a psychological risk early warning result is generated; after the psychological unstable state is detected, a cognitive energy feedback parameter set is generated, and cognitive energy balance intervention is executed; and after the intervention is finished, calculating an energy balance improvement rate, and when the energy balance improvement rate exceeds an energy balance threshold, judging that the intervention is finished. According to the method, multi-mode psychological signals and cognitive energy field modeling are fused, intelligent evaluation and dynamic intervention of the psychological state of the teenagers are achieved, and the method has the advantages of being high in accuracy, high in interpretability and closed in intervention loop.
Owner:JIANGDU VOCATIONAL SECONDARY SCHOOL OF JIANGSU PROVINCE

Psychological state assessment method and device

The invention discloses a psychological state assessment method and device. The method comprises the steps that firstly, based on a sensor group and a camera module, electrocardio information, face information, gait information and plantar pressure information of a target are obtained; then constructing an input feature vector based on the electrocardio information, the face information, the gait information and the plantar pressure information; and finally, inputting the input feature vector into a preset model to obtain an evaluation result. According to the embodiment of the invention, the multi-dimensional feature data can be processed, so that the psychological state is evaluated by using the multi-dimensional feature data to obtain the evaluation score, and the evaluation accuracy can be improved.
Owner:SHANXI YIKANG XINYUE MEDICAL INSTR CO LTD

Children autism adaptive brain-computer fusion intervention system based on large model

The invention discloses a child autism adaptive brain-computer fusion intervention system based on a large model, and the system comprises a multi-modal data collection module which is used for collecting the neural data, behavior data and clinical scale data of a user; the feature extraction and user portrait construction module is used for performing feature extraction and subtype recognition on the multi-modal data to generate a personalized portrait; the multi-defect intervention normal form generation module is used for dynamically generating a personalized intervention task on the basis of a large language model in combination with the personalized portrait and the historical state of the task; the self-adaptive regulation and control module is used for dynamically adjusting an intervention strategy and task difficulty according to the feedback of the real-time neural data and the dynamic change of the behavior data; the user interaction interface module is used for providing a multi-modal human-computer interaction interface; and the effect evaluation and long-term tracking module is used for generating an individual and group intervention effect report. By utilizing the system and the method, accurate, personalized, multi-dimensional and long-term intervention on the autism children can be realized.
Owner:ZHEJIANG UNIV

Multi-modal emotion recognition fusion method based on multi-head attention mechanism

The invention provides a multi-modal emotion recognition fusion method based on a multi-head attention mechanism, and the method comprises the steps: carrying out the feature extraction and fusion of various data, capturing the internal relation of a modal through the multi-head attention mechanism, achieving the information complementation between modals through cross-modal interaction, and dynamically adjusting the weight according to the quality of the modals. And a self-built database containing a large amount of Chinese data is constructed, and a culture adaptation optimization strategy is combined, so that the generalization performance and culture adaptability of the model in Chinese user groups are improved. The system is deployed on a cloud server, optimized hardware and software configuration is adopted, efficient model reasoning and multi-user concurrent processing are achieved, and the large-scale real-time application requirement is met. The emotion of the user can be monitored in real time and early warning can be provided in scenes such as psychological counseling and group emotion monitoring, professionals are assisted in better understanding the emotion state of the user, and the service effect is improved.
Owner:SHENZHEN SERUN HEALTH TECHNOLOGY CO LTD

Intelligent scheme pushing and task adaptive management method based on cognitive behavior therapy

The invention relates to the technical field of cognitive behavior therapy, in particular to a scheme intelligent pushing and task self-adaptive management method based on cognitive behavior therapy, which comprises the following steps: S1, acquiring physiological signals, behavior logs and environment interaction data of a user through a multi-modal data acquisition module; s2, constructing a dynamic psychological assessment model based on a cognitive behavior theory, and fusing multi-source data by adopting a Bayesian network to generate a user cognitive state map; s3, generating a personalized intervention scheme through a reinforcement learning algorithm according to the cognitive state map and a preset CBT intervention rule base; according to the method, through multi-modal data acquisition, dynamic psychological assessment, reinforcement learning scheme generation, task decomposition optimization, difficulty adaptive adjustment and digital twinborn simulation, full-process closed-loop management from data acquisition to intervention optimization is constructed, and efficient, safe and personalized cognitive behavior treatment scheme intelligent pushing and task adaptive management are realized.
Owner:CHENGDU FOURTH PEOPLES HOSPITAL

Non-contact pressure and fatigue state identification method based on double-indication joint reasoning

The invention provides a non-contact pressure and fatigue state identification method based on double-indication joint reasoning, and relates to the field of psychological and physiological analysis, and the method comprises the steps: collecting a face visible light video and a first EDA signal; extracting an rPPG signal and a first facial behavior indication sequence; processing the signal amplitudes of the first EDA signal and the first facial behavior indication sequence to obtain a target EDA signal and a target behavior indication sequence; inputting the rPPG signal and the target behavior indication sequence into a fatigue detection model to obtain fatigue information; inputting the rPPG signal and the target EDA signal into a psychological stress detection model to obtain psychological stress information; and synchronously outputting and displaying the fatigue information and the psychological pressure information based on a preset signal waveform comparison display area. The psychological stress state and the fatigue state are analyzed at the same time, double indications are used for comprehensive consideration, cross-scene state fluctuation is identified, and the precision and efficiency of psychological stress state and fatigue state analysis can be effectively improved.
Owner:HEFEI UNIV OF TECH

Emotional state evaluation method based on multi-modal data

The invention relates to the technical field of artificial intelligence and emotion calculation, and discloses an emotion state evaluation method based on multi-modal data, and the method comprises the steps: obtaining and decoupling an implicit signal, an explicit signal and situation data of an evaluated object; and respectively generating implicit features, explicit features and context vectors through double-flow decoupling coding and context knowledge graph coding. And the core engine determines the internal emotional state and the extrinsic emotional representation in parallel, and dynamically regulates and controls a bridging conversion process from the internal state to the predicted extrinsic representation by utilizing the situation vector. Finally, the emotion regulation intensity is calculated by comparing actual and predicted extrinsic representations, and the emotion regulation intensity, the internal state and the extrinsic representations are jointly used as a multi-dimensional evaluation result to be output. According to the method, the dynamic relationship and the adjustment strategy between the internal feeling and the external expression can be disclosed, a deeper and more three-dimensional analysis view angle is provided for the fields of mental health, human-computer interaction and the like, and the method has remarkable application value.
Owner:周洁

Emotion recognition method based on attention mechanism and capsule network

The invention discloses an emotion recognition method based on an attention mechanism and a capsule network. The emotion recognition method specifically comprises the following steps: inputting multi-channel original EEG signals; performing data truncation, data filling and data standardization on the original EEG signal, unifying the format, and generating a preprocessed EEG signal; extracting space-time joint features from the preprocessed EEG signals by using a three-dimensional convolutional neural network; the construction of the graph structure comprises modeling a complex relationship between channels; introducing a graph attention mechanism to strengthen information expression of important channels and relationships; and high-dimensional vector modeling and final classification of the features are carried out through a capsule network, and capture of deeper space structure information is completed.
Owner:XIAMEN UNIV

Self-adaptive virtual reality cognitive training method and system

The invention relates to the field of virtual reality, in particular to an adaptive virtual reality cognitive training method and system. The method comprises the steps of obtaining a user individual information set and a real-time multi-modal physiological data stream, performing real environment three-dimensional reconstruction and relative and friend face modeling based on the user individual information set, and generating an individual virtual training scene; based on the real-time multi-modal physiological data flow and the individualized virtual training scene, nerve-behavior feature extraction and digital twinning dynamic modeling are carried out, and a user cognitive state evaluation information set is generated; based on the user cognitive state evaluation information set, training task parameter real-time optimization and virtual scene element dynamic adjustment are carried out through an adaptive strategy, and a cognitive enhancement intervention instruction set is generated; and based on the cognitive enhancement intervention instruction set, performing neural regulation intervention and training data closed-loop feedback, and generating and outputting an individualized cognitive training report. According to the method and the device, accurate self-adaptive intervention is realized in a virtual reality cognitive training process.
Owner:SHANXI MEDICAL UNIV

Cross-subject electroencephalogram emotion recognition method and system based on space-time adaptive graph coding learning

The invention belongs to the field of deep learning, and provides a cross-subject brain electrical emotion recognition method and system for space-time adaptive graph coding learning, and the method comprises the steps: extracting features from different frequency bands through a sliding window technology, and constructing a feature matrix covering channels and time dimensions; fusing space-time hybrid embedding, time embedding and space embedding, and converting the feature matrix into a high-dimensional semantic vector; calculating channel characteristic difference and time trend change, and generating a dynamic topology matrix adaptive to cross-tested individual difference; combining the dynamic topological matrix to calculate spatial cross-channel and time stride length attention in parallel, and fusing and strengthening key spatial-temporal features; and the decoder maps the coding features by means of a domain adversarial decoding module, reduces the distribution difference between a source domain and a target domain through cross-domain adversarial training, and outputs an emotion classification result. Through the method, the cross-subject generalization ability and the recognition accuracy of electroencephalogram emotion recognition are improved.
Owner:ANHUI AGRICULTURAL UNIVERSITY

Intelligent early warning method and system for physiological fatigue of construction equipment operator

The invention provides an intelligent early warning method and system for physiological fatigue of a construction equipment operator, and the method comprises the steps: synchronously collecting the limb movement and equipment trajectory data of the operator through an inertial sensor and a construction equipment control terminal, carrying out the parallel prediction of an operation sequence through a two-channel time convolution network TCN, and recognizing a redundant and fatigue movement mode; dynamic structure features of the construction equipment track are extracted in combination with an improved ConvNeXt network, and the abnormal level of the track is judged based on a graph neural network classifier; a soft behavior-reviewer algorithm is introduced, the physiological fatigue index, the trajectory deviation rate and the trajectory control fluctuation degree are used as state input, and optimization operation suggestions are dynamically output; a diagnosis result is transmitted to an operator in real time through a voice and tactile feedback mechanism, and a sustainable closed-loop regulation and control system is formed. According to the invention, the fatigue identification accuracy and the intelligent intervention capability of the operator in the construction process are obviously improved, and the construction safety and the operation efficiency are improved.
Owner:SOUTHEAST UNIV

Children language cognition rehabilitation assisting system and method based on self-adaptive co-creation mechanism

The invention discloses a children language cognition rehabilitation assisting system and method based on a self-adaptive co-creation mechanism, and belongs to the field of medical artificial intelligence and psychological rehabilitation engineering. The system comprises five core modules, the modules are connected in a closed-loop mode in a data flow mode to form a sustainable and optimized interaction system, a semantic vector, an emotion vector and a task vector of child voice are fused, a fusion state vector is constructed through a dynamic weight generation network and a cross-modal attention mechanism, and the fusion state vector and the task vector are integrated. And generating a co-creation control instruction by adopting an attention-enhanced gating circulation unit and a strategy network, and further synthesizing an interactive voice signal with emotional expressive force. Synchronous fusion and linkage feedback of semantic understanding and emotion recognition can be achieved, the interaction strategy is dynamically adjusted according to the real-time state of children, strategy network parameters are optimized through online self-learning, and the naturalness, coherence and individual adaptability of rehabilitation interaction are improved.
Owner:ZHEJIANG UNIV

Domain-adaptive cross-subject electroencephalogram signal emotion recognition method

The invention relates to the technical field of electroencephalogram analysis, in particular to a domain-adaptive cross-subject electroencephalogram signal emotion recognition method, which comprises the following steps: acquiring an electroencephalogram signal, and preprocessing the electroencephalogram signal; inputting the preprocessed electroencephalogram signals into a trained electroencephalogram signal emotion recognition model to obtain an emotion classification result; the electroencephalogram emotion recognition model comprises a graph convolution feature extraction module, an attention module, a domain confrontation module and a classifier module. According to the method, the confrontation module formed by combining the gradient inversion layer and the domain discriminator is designed, and the change rule of the electroencephalogram of a person in positive, neutral and negative states is focused instead of the intensity of the reaction, so that the extracted emotional features have domain invariance, and the extraction accuracy is improved. And identification deviation caused by difference of different individuals in cross-subject emotion identification is eliminated.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Electroencephalogram emotion recognition method and system based on multi-task self-supervision and dynamic graph fusion network

The invention belongs to the technical field of artificial intelligence and physiological signal processing, and discloses an electroencephalogram emotion recognition method and system based on a multi-task self-supervision and dynamic graph fusion network, and the method comprises the steps: obtaining and preprocessing electroencephalogram and other physiological signals, and extracting multi-band energy features; constructing a dynamic graph structure, taking electrodes as nodes, taking frequency band energy as characteristics, and fusing spatial distance and functional connectivity to generate a dynamic adjacency matrix; designing multi-task self-supervised pre-training, including spatial jigsaw, frequency jigsaw and cross-modal contrast learning tasks, to learn general characterization; a dynamic graph fusion network is adopted to carry out end-to-end training, and a shared feature extraction module of the dynamic graph fusion network realizes adaptive fusion of multi-modal features by utilizing Chebyshev graph convolution and embedding a cross-modal attention mechanism; the classification module sets an independent classification head for each task, and optimization is carried out through a joint loss function. According to the method, the accuracy and generalization ability of electroencephalogram emotion recognition are remarkably improved.
Owner:NORTHWESTERN POLYTECHNICAL UNIV

Device for detecting cognitive and developmental conditions of children with hyperactivity

PendingCN121421533APsychotechnic devicesSensorsNeuropsychological testSimulation
The invention relates to the technical field of attention deficit hyperactivity disorder detection, and discloses a device for detecting cognitive and developmental conditions of children with hyperactivity disorder, which comprises a handle, a head-mounted device, a bracelet, a hierarchical adaptive algorithm module, a multi-dimensional execution module and a data fusion and analysis module, a multi-mode sensing module is arranged in each of the handle, the head-mounted device and the bracelet; a motion capture unit, a high-sensitivity key array, a tactile feedback module and a wireless transmission module are integrated in the handle, and a wireless electroencephalogram acquisition module, a miniature near infrared spectrum module and an eye movement tracking module are integrated in the head-mounted device. According to the invention, through deep fusion of a multi-dimensional cognitive evaluation system and gamepad hardware, the device not only breaks through the limitation of the traditional neuropsychological test in methodology, but also realizes refined capture of ADHD heterogeneity characteristics in the technical level, and provides a hardware basis for establishing an objective and quantitative diagnostic tool with high ecological efficiency.
Owner:BEIJING NORMAL UNIVERSITY

Self-supervised emotion recognition method based on heart-brain joint codebook and related equipment

The embodiment of the invention provides a self-supervised emotion recognition method based on a heart and brain combined codebook and related equipment, and belongs to the technical field of physiological signal processing and artificial intelligence. The method comprises the following steps: respectively defining heart beats of electrocardiosignals and electroencephalogram signal segments with equal lengths as words, and constructing sentences; a shared heart and brain joint codebook is created and trained, and electrocardio and electroencephalogram words are mapped to a unified discrete semantic space through vector quantization so as to learn cross-subject general characterization; then, discretizing a signal sentence by using the codebook, and combining space and position embedding and inputting a Transform encoder to carry out mask pre-training so as to learn context semantics of the signal; and finally, finely tuning the pre-training model for an emotion recognition task. According to the method, deep semantic fusion of heart and brain signals is realized through signal structuring and codebook sharing, dependence on labeled data is effectively overcome, and emotion recognition accuracy and cross-subject generalization ability are remarkably improved.
Owner:SOUTH CHINA UNIV OF TECH

Cognitive disorder risk intelligent matching intervention system based on multi-modal data

The invention discloses a cognitive impairment risk intelligent matching intervention system based on multi-modal data, and belongs to the technical field of cognitive impairment, and the cognitive impairment risk intelligent matching intervention system specifically comprises the following steps: collecting a tactile interaction sequence and a face video data stream when a user executes a cognitive intervention task, and constructing an original multi-modal data set; extracting tactile operation track features and reconstructing a heart rate variability sequence, and generating a synchronous multi-mode feature set; identifying a difference interval of state fluctuation and extracting behavior and physiological features in the interval to form an instant physical and mental load parameter set; in combination with an interaction efficiency index in the task execution record, generating a joint state feature vector, and outputting a personalized adaptation instruction through a pre-trained sub-state-parameter association model; and constructing an adaptive strategy model by using the multi-modal features and an adaptive instruction to realize millisecond-level dynamic adjustment from the real-time multi-modal features to task parameters. According to the method, real-time perception and accurate matching of the cognitive emotion load of the user are realized, and the individuation degree and instantaneity of intervention are improved.
Owner:FUJIAN MEDICAL UNIV

Fatigue driving real-time detection method and system based on monitoring camera

The invention relates to the technical field of automobile safety detection, and discloses a fatigue driving real-time detection method and system based on a monitoring camera. The method comprises the following steps: acquiring a multi-source sensing data stream in a face area of a driver, and performing time sequence alignment processing to generate a synchronized physiological signal set; multi-modal feature extraction is carried out on the face muscle activity intensity image to obtain an eye movement track feature vector, a head posture change sequence and a face muscle activity intensity map; respectively generating an eye movement fatigue index and a head behavior anomaly score, and obtaining a comprehensive fatigue grade index in combination with a weighted decision algorithm; generating a graded early warning trigger strategy according to the comprehensive fatigue grade index and the real-time driving environment parameter, and calling a corresponding alarm instruction to generate a multi-stage warning signal output stream; and monitoring the change trend of the physiological state of the driver in real time, carrying out dynamic priority adjustment on a warning signal output flow, updating an alarm instruction set, and completing fatigue driving intervention closed-loop control.
Owner:NINGBO JINSHENGXIN IMAGE TECH CO LTD

Psychological state recognition method and system based on physiological signals

The invention discloses a psychological state recognition method and system based on physiological signals, and relates to the technical field of intelligent preoperative evaluation and planning of thoracic surgery, and the method comprises the steps: S1, collecting multi-modal physiological signals, and forming an original signal set; s2, performing parallel preprocessing on the original signal set to generate a denoised time sequence signal; s3, dynamically generating a modal weight coefficient based on the quality parameters, and performing weighted fusion on the multi-modal time sequence signals by using the weight coefficient; and S4, inputting the fused feature vector into a personalized recognition model, and outputting psychological state probability distribution through an adaptive feature mapping layer in the model. And S5, according to the user feedback signal or the distribution offset of the continuous monitoring data, triggering online parameter updating of the personalized recognition model, and generating a recognition model after incremental optimization. According to the psychological state recognition method and system based on the physiological signals, the problem that psychological state recognition is inaccurate due to large individual difference, strong environmental interference and weak dynamic adaptability can be solved.
Owner:CHENGDU WEIFU TIKE TECHNOLOGY CO LTD