Multi-mode fusion AI accompanying intelligent system applied to single-chip microcomputer

The multimodal fusion AI companion intelligent system solves the problem of limited computing resources on the microcontroller platform, realizes real-time processing of multimodal data and recognition of emotional state, improves the system's real-time performance and personalized interaction capabilities, and is suitable for rehabilitation training of stroke patients.

CN121501145APending Publication Date: 2026-02-10SHENZHEN EASYQUICK TECH CO LTD
0 Cites 0 Cited by

Patent Information

Application Number
CN202511673741.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-11-14
Publication Date
2026-02-10

AI Technical Summary

Technical Problem

Existing intelligent rehabilitation training equipment has excessively high computational resource requirements on microcontroller platforms, making it difficult to balance real-time performance and accuracy. It also lacks personalized emotion modeling capabilities and cannot meet the needs of stroke patients for real-time processing of multimodal data and recognition of emotional states.

Method used

The system employs a multimodal fusion AI companionship system, which includes a data acquisition unit, a parallel quantization unit, an adaptive fusion unit, an emotion state recognition unit, and an interaction strategy generation unit. It achieves synchronous acquisition of multimodal data through DMA channels and hardware timers, parallel processing through a three-level pipeline architecture, emotion state recognition through a lightweight neural network, parallel interaction instruction generation, and multi-channel DMA controller output, thereby achieving ultra-low latency multimodal fusion processing.

Benefits of technology

It enables real-time processing of multimodal data and recognition of emotional states on a microcontroller platform, reducing computational complexity and power consumption, improving the system's real-time performance and personalized interaction capabilities, and meeting the rehabilitation training needs of stroke patients.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the technical field of artificial intelligence and embedding, and discloses a multi-modal fusion AI accompanying intelligent system applied to a single-chip microcomputer, and the system comprises a data collection unit which is used for carrying out the synchronous collection of an asynchronous original signal according to a DMA channel and a hardware timer; the parallel quantization unit is used for carrying out parallel processing on the multi-modal data flow by adopting a three-stage pipeline architecture; the self-adaptive fusion unit is used for adopting a self-adaptive fusion method for the real-time quantitative feature flow; the emotional state recognition unit inputs the low-delay fusion features into a lightweight neural network to recognize the current emotional state of the user; the interaction strategy generation unit is used for performing multi-thread parallel processing on the emotional state recognition result to generate a personalized interaction strategy; the output control unit adopts a multi-channel DMA controller and a priority scheduling algorithm to realize concurrent operation of output equipment for the parallelization interaction instruction; according to the invention, by adopting a hardware-level data synchronization technology, accurate acquisition and processing of multi-modal data are realized.
Need to check novelty before this filing date? Find Prior Art