Vision-Guided Robot Arm Feedback for Reliable Object Grasping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vision-guided robotic arms often require users with mobility or motricity limitations to teleoperate them blindly, as they cannot always see the final movement of the robotic arm when grasping objects, posing challenges for users with handicaps.
Innovation Solution
A vision-guided robot arm system equipped with an image sensor, display, and controller that receives an initial image of an area, determines and identifies objects of interest, determines potential actions, receives user confirmation, and automatically positions the end effector relative to the object, allowing for predefined actions to be executed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the robotic arm is fully teleoperated by the user, then the user has control over all movements, but users with mobility or motricity limitations cannot always see what is happening during operation
Solution Approach 1:
The system provides continuous visual feedback by displaying images captured by the image sensor on a display device, allowing users to see the robotic arm's movements and the objects being manipulated in real-time, thus resolving the information loss during teleoperation
Solution Approach 2:
The image sensor and display device act as intermediaries between the user and the robotic arm, transmitting visual information about the arm's position and the objects being handled, enabling users with limitations to observe operations they cannot physically see
2Ease of operation
If the clamp's final movement to grasp an object is performed blindly, then the system is simpler to operate, but the user cannot verify the grasping action
Solution Approach 1:
The image sensor continuously captures images of the workspace and displays them on the display device, providing real-time visual feedback that allows users to verify the robotic arm's position and the grasping action, thereby improving reliability without complicating operation
3Ease of operation
If the system provides automatic positioning of the end effector, then the ease of operation improves for users with limitations, but the device complexity increases
Solution Approach 1:
The robotic arm system performs automatic positioning of the end effector relative to identified objects, allowing the system to serve itself by autonomously navigating to target positions based on image processing, which reduces the operational burden on users despite increasing device complexity
Data Source
AI summary
A method for operating a vision guided robot arm system comprising a robot arm provided with an end effector at a distal end thereof, a display, an image sensor and a controller, the method comprising: receiving from the sensor image an initial image of an area comprising at least one object and displaying the initial image on the display; determining an object of interest amongst the at least one object and identifying the object of interest within the initial image; determining a potential action related to the object of interest and providing a user with an identification of the potential action; receiving a confirmation of the object of interest and the potential action from the user; and automatically moving the robot arm so as to position the end effector of the robot arm at a predefined position relative to the object of interest.