Human-machine collaborative navigation system and method based on visual-tactile-linguistic-action model

Abstract

This invention relates to the field of embodied intelligence in robots and human-computer interaction technology, specifically to a human-computer cooperative navigation system and method based on a visual-tactile-language-action model. The system is a human-computer cooperative motion closed-loop control system for guide robots. The human-computer cooperative navigation system includes: a multimodal perception alignment module configured to provide human-computer interaction intent input for robot motion control; a heterogeneous volume perception inference module configured to provide obstacle avoidance decision-making basis for robot motion control; a dual-stream parallel output module configured with action command output and semantic feedback output; and a hierarchical asynchronous control module, the core motion control execution module of the system, configured to maintain human-machine dynamic synchronization based on high-level planning units and low-level cooperative motion units. This invention enables human-computer cooperative closed-loop motion control for guide robots.

Images