Robot Grasp Remote Control Using Handwritten Image Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control systems for robots lack intuitive operation methods, relying on inputting predetermined instruction figures by handwriting, which is not user-friendly for complex grasping motions.
Innovation Solution
A remote control system that includes an imaging unit to capture the environment, a recognition unit to identify graspable objects, and an operation terminal for receiving handwritten input information, with an estimation unit to determine the object to be grasped and the grasping motion based on recognized objects and input information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If predetermined instruction figures are input by handwriting, then the robot can perform grasping motions, but the operation method is not intuitive and lacks user-friendliness
Solution Approach 1:
The system captures the user's actual handwriting on the shot image and uses this handwriting image directly as input for estimation, rather than requiring selection from predetermined symbols. The handwriting recognition unit processes the captured handwriting image to extract input information, making the operation more intuitive by copying the user's natural writing behavior.
2Productivity
If predetermined instruction figures are used for remote control, then the system structure is simple, but the operational efficiency and user experience deteriorate
Solution Approach 1:
The system replaces the mechanical selection process of predetermined symbols with an automated handwriting recognition and estimation system. The estimation unit automatically interprets the handwriting image to determine grasping motions, substituting the manual mechanical process with an intelligent system that enhances both efficiency and user-friendliness.
3Measurement precision
If handwritten input information is directly processed without recognition, then the system is simpler, but the accuracy of estimating grasping motions decreases
Solution Approach 1:
The handwriting recognition unit serves as an intermediary between the captured handwriting image and the estimation unit. It processes the handwriting image to extract meaningful input information, acting as a mediator that enhances accuracy while managing system complexity through modular design.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A remote control system (10) includes: an imaging unit (131) that shoots an environment in which a device to be operated (100) including an end effector (124) is located; a recognition unit (151) that recognizes objects that can be grasped by the end effector (124) based on a shot image of the environment shot by the imaging unit (131); an operation terminal (300) that displays the shot image and receive handwritten input information input to the displayed shot image; and an estimation unit (152) that, based on the objects that can be grasped and the handwritten input information input to the shot image, estimates an object to be grasped which has been requested to be grasped by the end effector (124) from among the objects that can be grasped and estimates a way of performing a grasping motion by the end effector (124), the grasping motion having been requested to be performed with regard to the object to be grasped.