Remote Grasp Control via Handwritten Image Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote control systems for devices with end effectors, such as robots, face challenges in user convenience when inputting handwritten instructions, particularly if the designated area is not visible or has low visibility on the screen.
Innovation Solution
A remote control system that includes an imaging unit, recognition unit, operation terminal, image adjustment unit, and estimation unit, which allows users to input handwritten instructions on a shot image displayed on the operation terminal. The system adjusts the image to ensure high visibility of the designated area, enabling intuitive operation without requiring users to recall specific instruction figures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the shot image displays a wide area to enable handwriting input in various locations, then the input range is improved, but the visibility of peripheral areas deteriorates
Solution Approach 1:
The shot image is dynamically adjusted based on the position where handwriting input is detected. When handwriting is input in a peripheral area, the system automatically shifts or zooms the shot image to bring that area into better visibility, making the input area visible while maintaining the ability to accept input across different locations.
2Illumination intensity
If the shot image displays a focused area to maintain high visibility, then the visibility is improved, but the input range deteriorates
Solution Approach 1:
The system dynamically adjusts the shot image scope based on handwriting position. When handwriting is detected in peripheral areas, the shot image automatically adjusts its display scope to include those areas, thereby expanding the input range while maintaining visibility of the active input region.
3Measurement precision
If the system requires users to recall predetermined instruction figures, then the control precision is improved, but the ease of operation deteriorates
Solution Approach 1:
The system allows users to directly draw their intended motion paths using handwriting on the shot image without needing to recall or select from predetermined instruction figures. The system automatically interprets the drawn paths as motion commands, enabling intuitive operation while maintaining control precision through direct user expression of intent.
Data Source
AI summary
A remote control system includes: a recognition unit configured to recognize, based on a shot image objects that can be grasped; an image adjustment unit configured to cause an imaging unit to shoot, when a part of an area of a shot image designated by handwritten information is a predetermined outer peripheral area of the shot image, an image of a second predetermined area including the part of the area of the shot image designated by the handwritten information and an area adjacent to the first predetermined area, and cause the operation terminal to display the shot image of the second predetermined area; and an estimation unit configured to estimate an object to be grasped which has been requested to be grasped and estimate a content of a motion with regard to the object to be grasped which is requested to be performed by the device to be operated.