Telepresence Robot Cognitive Navigation With Voice-Guided Indoor Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing telepresence robotic systems lack integrated cognitive navigation strategies and human-robot interaction capabilities, making it difficult for robots to navigate and interact effectively in indoor environments, especially in remote operation scenarios where manual navigation is tedious and inefficient.
Innovation Solution
A telepresence robotic system with cognitive capabilities utilizing WebRTC for audio signal processing, CNN-based binary classification, automated speech recognition, and FF-planner navigation, integrated with an Edge-centric architecture for real-time communication and computation, enabling the robot to interpret voice commands and generate execution plans for navigating to specific points, areas, or objects within indoor spaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual navigation control is used for telepresence robots, then the robot can navigate in indoor environments, but the operation becomes tedious and inefficient
Solution Approach 1:
The robot performs self-navigation by autonomously processing speech commands, interpreting spatial references, and executing movement decisions without continuous manual control, enabling the system to serve itself in navigation tasks
Solution Approach 2:
The patent replaces manual mechanical control operations with automated speech recognition and natural language processing systems, substituting the mechanical control interface with cognitive processing capabilities that interpret spoken instructions and translate them into navigation actions
2Adaptability or versatility
If speech-based HRI is implemented for robot control, then interaction capability improves, but system complexity increases
Solution Approach 1:
The speech-based HRI system serves multiple functions including command recognition, spatial understanding, task interpretation, and natural interaction, allowing a single interface to handle diverse communication needs without requiring separate specialized systems
Solution Approach 2:
The patent introduces speech recognition and natural language processing as intermediary layers between the user and the robot's control system, mediating the interaction by translating spoken language into executable commands while managing the complexity within the processing layer rather than the interface layer
3Productivity
If cognitive navigation strategies are integrated into telepresence robots, then navigation efficiency improves, but computational requirements increase
Solution Approach 1:
The system performs preliminary processing of speech commands and spatial references before execution, pre-parsing the intent and extracting navigation parameters in advance, which reduces the computational burden during actual navigation execution and optimizes energy usage
Data Source
AI summary
The embodiments of present disclosure herein address unresolved problem of cognitive navigation strategies for a telepresence robotic system. This includes giving instruction remotely over network to go to a point in an indoor space, to go an area, to go to an object. Also, human robot interaction to give and understand interaction is not integrated in a common telepresence framework. The embodiments herein provide a telepresence robotic system empowered with a smart navigation which is based on in situ intelligent visual semantic mapping of the live scene captured by a robot. It further presents an edge-centric software architecture of a teledrive comprising a speech recognition based HRI, a navigation module and a real-time WebRTC based communication framework that holds the entire telepresence robotic system together. Additionally, the disclosure provides a robot independent API calls via device driver ROS, making the offering hardware independent and capable of running in any robot.