Multi-modal dynamic weight adaptive fusion acquisition method and system for body-equipped robot

By real-time evaluation of multimodal factors and incremental dynamic weight generation, combined with inverse reinforcement learning and factor graph feedback, the problems of single dimensionality of weight evaluation and unbalanced response in existing technologies are solved, enabling embodied robots to perform tasks with high precision and safety in complex environments.

CN122401431APending Publication Date: 2026-07-17YIBO INTELLIGENT TECH (GUANGZHOU) CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
YIBO INTELLIGENT TECH (GUANGZHOU) CO LTD
Filing Date
2026-06-10
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing multimodal fusion technologies cannot comprehensively reflect a robot's motion operation capabilities, the degree of environmental change, and the urgency of the task. Furthermore, the weighting evaluation dimensions are singular, making it impossible to make optimal decisions in complex environments, and they lack the ability to balance historical information and instantaneous response.

Method used

An adaptive fusion method with multimodal dynamic weights for embodied robots is adopted. By evaluating the operational margin factor, environmental roughness factor, and task urgency factor in real time, and combining an incremental dynamic weight function and an experience-guided inverse reinforcement learning algorithm, adaptive fusion weights are generated, and the planning information is optimized by using a factor graph feedback mechanism.

Benefits of technology

It achieves smooth response of fusion weights and coordination of planning information, improves the robot's task safety and fusion accuracy in complex environments, enables agile response to environmental changes or sudden disturbances, and ensures the stability and rationality of weight adjustment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122401431A_ABST
    Figure CN122401431A_ABST
Patent Text Reader

Abstract

本发明提供了具身机器人多模态动态权重自适应融合采集方法及系统,属于机器人智能感知与控制技术领域。该方法包括:采集多模态环境感知数据;在融合前实时评估生成操作裕度因子、环境粗糙度因子和任务紧迫度因子,并对三个因子进行交叉修正输出修正因子;基于修正因子采用动态权重生成策略计算各模态融合权重;依据融合权重对多模态数据进行加权融合输出融合感知信息;基于因子图对融合感知信息进行实时规划,并将规划过程中提取的运动约束信息反向注入操作裕度因子的计算模型。本发明通过融合前多维度实时评估与交叉修正、增量式动态权重与强化学习偏移量叠加、以及融合与规划的双向信息反馈,提升了复杂动态环境下多模态融合的精度、鲁棒性。
Need to check novelty before this filing date? Find Prior Art