Vision-Guided Robot Placement With Touchscreen Recommendation Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current robot systems lack intuitive and efficient methods for operating robots, particularly in tasks involving object picking and placement, as they often require complex manual adjustments and struggle with distinguishing overlapping objects or targets, leading to potential errors and increased operation time.
Innovation Solution
A robot system equipped with a vision sensor and a touch screen interface that allows users to input commands for object selection and placement, displaying recommendation regions based on physical properties like inclination, friction coefficient, and area, and generating operation signals to guide the robot's end effector for precise object transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If complex manual adjustments are required for robot operation, then the robot can perform precise tasks, but the ease of operation deteriorates
Solution Approach 1:
The system enables the robot to automatically identify objects and determine placement positions through the vision sensor and controller, eliminating the need for complex manual adjustments. The robot serves itself by autonomously completing tasks that previously required detailed operator intervention, thereby improving ease of operation while maintaining precision through automated vision-guided positioning.
Solution Approach 2:
The patent replaces manual mechanical adjustment operations with an automated vision-based control system. The vision sensor captures images, the controller processes them to identify objects and determine placement positions, and the robot executes movements automatically. This substitution of manual mechanical operations with automated sensing and control improves ease of operation while maintaining placement precision.
2Measurement precision
If the robot struggles to distinguish overlapping objects, then the measurement precision deteriorates, but the device complexity increases to solve it
Solution Approach 1:
The controller acts as an intermediary that processes images from the vision sensor and distinguishes overlapping objects by analyzing spatial relationships and positions. Rather than complicating the vision sensor itself, the patent uses the controller's image processing capabilities to resolve overlapping object identification, achieving accurate distinction without excessive device complexity.
3Reliability
If manual operation methods are used, then the operation time increases, but the reliability of object transfer deteriorates due to potential errors
Solution Approach 1:
The vision sensor provides real-time visual feedback to the controller, which monitors the robot's movements and the positions of objects and targets. This feedback loop enables the system to automatically adjust and verify placement accuracy, improving reliability by reducing human error while maintaining efficient operation speeds through automated real-time monitoring and correction.
Solution Approach 2:
The system performs preliminary identification of objects and determination of placement positions before the actual transfer operation. The vision sensor and controller prepare the operation plan in advance, identifying target positions and planning movement paths, which streamlines the execution phase and reduces overall operation time while ensuring reliable, error-free transfers through pre-verified positioning.
4Ease of operation
If the touch screen displays all regions equally, then the information presentation is simple, but the ease of operation deteriorates due to lack of guidance
Solution Approach 1:
The touch screen displays the recommendation region with distinct visual characteristics (such as highlighting or different coloring) to differentiate it from other regions. This local quality enhancement provides intuitive guidance to operators, making it immediately clear which region is the optimal placement position, thereby improving ease of operation without significantly increasing overall interface complexity.
Data Source
AI summary
A robot system includes: a robot including an end effector connected to an arm thereof; a vision sensor mounted to the robot; and a controller configured to output an operation signal that enables the robot to operate when an input is generated through a touch screen. Each of an object and a target to which the object is placed is inputted through the touch screen. The touch screen displays a recommendation region of the target in a distinguished manner.


