Autonomous Robot Interface Combining Voice Commands and Handwritten Paths
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing autonomous traveling robot operation systems require complex input methods, as handwritten operations overlap with voice commands, complicating the operation process.
Innovation Solution
An autonomous traveling robot operation system that integrates a voice input interface for voice recognition and a handwritten input interface for object estimation, allowing users to provide instructions and trajectories through both methods, enhancing ease of operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If handwritten input and text chat are used to operate the end effector, then the robot can be controlled, but the operation becomes complicated because the handwritten input and end effector operation overlap each other
Solution Approach 1:
The patent segments the control interface into distinct functional areas: a voice input region for command input and a handwritten input region for trajectory drawing. This spatial segmentation prevents the overlap between different input modes, allowing users to provide voice commands and draw trajectories simultaneously without interference, thereby resolving the contradiction between operational ease and system complexity
Solution Approach 2:
The patent introduces a processor as an intermediary that receives and integrates multiple types of input (voice commands and handwritten trajectories) separately before executing them. The processor acts as a mediator that coordinates the different input streams, preventing conflicts between handwritten input and end effector operation while maintaining simple user interaction
2Ease of operation
If multiple input methods (handwritten and voice) are integrated, then the ease of operation improves, but the device complexity increases
Solution Approach 1:
The patent implements a universal control system where a single interface accepts multiple types of input (voice commands and handwritten trajectories) and processes them through integrated functionality. The processor universally handles both input modalities, converting them into coordinated robot actions, which improves operational ease while managing system complexity through unified processing logic
Solution Approach 2:
The patent adds a temporal dimension to the control interface by enabling simultaneous voice input and handwritten input on the display screen. Users can speak commands while drawing trajectories at the same time, utilizing the time dimension to accommodate multiple input methods without increasing spatial complexity or operational difficulty
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An autonomous traveling robot operation system that improves the ease with which an autonomous traveling robot (100) is operated by using a voice input and a handwritten input is provided. An autonomous traveling robot operation system including: an autonomous traveling robot (100) configured to shoot an environment near the autonomous traveling robot (100) and operates an object to be operated; a handwritten input interface (360) configured to display an image shot by the autonomous traveling robot (100) and receive a handwritten input to the displayed image; and a voice input interface (360) configured to receive a voice input to the object to be operated, in which the autonomous traveling robot operation system operates the autonomous traveling robot (100) in such a way that the autonomous traveling robot (100) operates the object to be operated in accordance with instructions of the handwritten input and the voice input is provided.