一种基于时频空多维特征挖掘和跨模态注意力融合的数据处理方法

By employing a Transformer-based temporal-frequency-spatial multidimensional feature mining and cross-modal attention fusion method, this study addresses the shortcomings in high-order feature modeling and cross-modal feature interaction in existing depression detection technologies. This approach enables highly accurate depression detection in complex scenarios and is suitable for remote diagnosis and treatment as well as smart wearables.

CN121971093BActive Publication Date: 2026-07-17CHINA CRIMINAL POLICE UNIV
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
CHINA CRIMINAL POLICE UNIV
Filing Date
2026-04-03
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies struggle to effectively model high-order nonlinear features related to depression, and fail to capture sufficient interactions between cross-modal features, resulting in limited generalization performance and poor robustness in complex real-world scenarios.

Method used

We employ a Transformer-based spatiotemporal multidimensional feature mining method, combined with cross-attention modules and cross-modal attention mechanisms, to construct a hierarchical spatiotemporal graph network that integrates video, speech, and text features to improve detection performance.

Benefits of technology

It improves the accuracy and interpretability of depression detection, can effectively identify depressive states in complex scenarios, and is suitable for remote diagnosis and treatment, smart wearables, and psychological assessment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121971093B_ABST
    Figure CN121971093B_ABST
Patent Text Reader

Abstract

本发明属于智能情感监测领域,具体说是一种基于时频空多维特征挖掘和跨模态注意力融合的数据处理方法‌。引入Transformer捕捉视频中的时序和空间信息,改进加入交叉注意力模块的ResNet18模型挖掘音频特征信息。构建了基于三分支的网络结构模型,旨在充分提取并融合视频、语音和文本的特征。本发明能够准确快速地量化受试者的心理异常情况,适用于校园心理健康监测、临床诊断辅助。
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Multi-modal fusion depression screening method, device and equipment based on end-to-end

    CN117854727A