一种基于智能体架构的多模态机器人操控方法、系统及主控盒子

By employing a multimodal robot manipulation method based on an intelligent agent architecture, and utilizing local and cloud-based collaborative processing and multi-track streaming control, the bottlenecks in the interaction and control of robot systems in complex environments are resolved, achieving efficient and flexible hardware adaptation and cross-scenario generalization capabilities.

CN122401460APending Publication Date: 2026-07-17SHENZHEN YUEWA INNOVATION TECHNOLOGY CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
SHENZHEN YUEWA INNOVATION TECHNOLOGY CO LTD
Filing Date
2026-06-18
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing robot systems lack environmental adaptability in complex environments, struggle to achieve multimodal interaction and efficient control, face difficulties in hardware adaptation, have high development barriers, and exhibit poor task generalization capabilities.

Method used

Employing an intelligent agent architecture, it achieves millisecond-level cross-device collaboration through dynamic load distribution between local and cloud environments, processing low-latency tasks locally and streaming high-complexity tasks back to the cloud. Combined with a multi-track streaming control architecture and a timestamp synchronizer, it dynamically adjusts computing load and device control by utilizing a multimodal environment cognition base and capability abstraction protocol layer.

Benefits of technology

Significantly reduces end-to-end response latency, simplifies the integration of new hardware, enables continuous robot optimization and cross-scenario capability generalization, provides a highly robust intelligent base, and lowers the development threshold.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122401460A_ABST
    Figure CN122401460A_ABST
Patent Text Reader

Abstract

本发明涉及多模态人机交互的技术领域,公开了一种基于智能体架构的多模态机器人操控方法、系统及主控盒子;所述多模态机器人操控方法,应用于集成电子设备,具体包括以下步骤:S101:通过集成摄像头、阵列麦克风及传感器的本地硬件模块实时采集环境视觉、音频及物理数据,行执行目标检测、语音识别初级处理,生成结构化感知摘要,并根据任务复杂度动态分配计算负载上传云端大模型。本发明通过本地与云端动态负载分配,低延迟任务本地处理,高复杂度任务云端流式返回,显著降低端到端响应延迟,同时利用多轨流式控制架构,即运动 / 语音 / 屏显三轨并发+时间戳同步器实现毫秒级跨设备协同,突破传统机器人系统多模态协作瓶颈。
Need to check novelty before this filing date? Find Prior Art