Human-Robot Interface Apparatus for Object Recognition and Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users without robotic programming training face challenges in controlling robots due to the need for complex trajectory patterns and manual intervention, especially in tasks requiring object recognition and manipulation.
Innovation Solution
A human-robot interface apparatus with two-way wireless communication, featuring a display interface showing a two-dimensional image from stereo video cameras, an object recognition support tool library, and an action support tool library, allowing users to select and recognize objects and instruct robots to perform manipulations without extensive programming knowledge.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users manually control the robot with complex trajectory patterns, then the robot can perform precise tasks, but the operation becomes very tedious and requires extensive programming training
Solution Approach 1:
The patent introduces an intermediary system consisting of video cameras, object recognition software, and automated planning algorithms that mediate between the user's simple object selection and the robot's complex manipulation tasks. This intermediary automatically handles trajectory generation and task planning, eliminating the need for users to manually program complex motion patterns while maintaining precise task execution.
Solution Approach 2:
The robot system performs self-service through automated object recognition, automatic trajectory generation, and autonomous task planning. Once the user selects a target object, the system independently completes the entire task sequence including navigation, grasping, and manipulation without requiring user intervention or programming knowledge, thereby simplifying operation while maintaining precision.
2Reliability
If the system requires extensive robotic programming training for control, then precise task execution is achieved, but accessibility for non-trained users is reduced
Solution Approach 1:
The patent replaces the mechanical system of manual trajectory programming with an intelligent system based on computer vision and automated planning. Object recognition software automatically identifies target objects, and algorithms automatically generate appropriate manipulation sequences, eliminating the need for users to learn complex programming while ensuring reliable task execution through sophisticated automated decision-making.
Solution Approach 2:
The system achieves universality by designing a single interface that can handle diverse tasks across different object types and manipulation scenarios. The object recognition system identifies various objects, and the automated planning system adapts to generate appropriate task sequences for each object, making the system accessible to all users regardless of programming training while maintaining reliable performance across multiple task types.
3Ease of operation
If manual control is used for all robot actions, then full user control is maintained, but the control process becomes extremely time-consuming
Solution Approach 1:
The system performs preliminary actions by pre-processing visual data through object recognition and pre-planning task sequences based on identified objects and desired goals. This preliminary automated processing eliminates the need for users to manually plan each movement step, significantly reducing control time while maintaining user capability to oversee and correct actions if needed.
Solution Approach 2:
The system maintains continuity of useful action by automatically executing sequences of manipulation steps without requiring user intervention between steps. Once the user initiates a task, the system continuously performs navigation, approach, grasping, and manipulation operations in an unbroken sequence, dramatically reducing the time users would otherwise spend continuously controlling each individual action.
Data Source
AI summary
A method of controlling a robot using a human-robot interface apparatus in two-way wireless communication with the robot includes displaying on a display interface a two-dimensional image, an object recognition support tool library, and an action support tool library. The method further includes receiving a selected object image representing a target object, comparing the selected object image with a plurality of registered object shape patterns, and automatically recognizing a registered object shape pattern associated with the target object if the target object is registered with the human-robot interface. The registered object shape pattern may be displayed on the display interface, and a selected object manipulation pattern selected from the action support tool library may be received. Control signals may be transmitted to the robot from the human-robot interface. Embodiments may also include human-robot apparatuses (HRI) programmed to remotely control a robot.