Visual-Tactile Robotic Gripper Layout for Free Finger Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing robotic grippers face challenges with slippage detection, contact force estimation, and grasp control, particularly in unstructured environments, due to limitations in proprioceptive and exteroceptive sensing, and the integration of vision-based sensors often leads to safety and performance issues.
Innovation Solution
A robotic finger design incorporating a neuromorphic event-based camera sensor within a soft compliant finger, providing proprioceptive and exteroceptive information, and a customizable optical path for tactile sensing, enabling robust grasping and precise manipulation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a camera is placed within the gripper's fingers to capture tactile activity, then visual sensing capability is improved, but the camera wiring and structure restrict the movement of the gripper
Solution Approach 1:
The camera is extracted from the interior of the gripper fingers and relocated to an external position on the robotic arm. This allows the gripper to move freely without camera wiring restrictions while the camera continues to capture tactile activity at the fingertips through its external vantage point
Solution Approach 2:
A dedicated camera mounting structure serves as an intermediary between the robotic arm and the camera sensor. This intermediary provides stable camera positioning and protects the camera from direct exposure to harsh environments and mechanical stresses experienced by the gripper
2Productivity
If the gripper operates with high speed and force, then productivity is improved, but the camera can be damaged by the gripper's movement
Solution Approach 1:
The camera is extracted from the gripper assembly and positioned externally on the robotic arm, physically separating the fragile camera from the high-force gripper operations. This spatial separation eliminates the risk of camera damage during high-speed gripper movements
Solution Approach 2:
The camera mounting structure incorporates protective elements that cushion the camera against potential impacts or vibrations transmitted from the gripper operations, providing beforehand protection against mechanical stresses
3Device complexity
If vibration from the gripper is transmitted to the camera, then structural simplicity is maintained, but camera performance is affected
Solution Approach 1:
A specialized camera mounting structure acts as an intermediary with vibration-damping properties, positioned between the gripper and the camera. This intermediary absorbs and isolates vibrations from high-speed gripper operations, preventing them from reaching the camera and degrading image quality
Solution Approach 2:
The system replaces direct mechanical coupling between gripper and camera with an optimized mounting structure that uses material damping and structural isolation to eliminate vibration transmission, substituting a vibration-prone mechanical connection with a vibration-resilient interface
4Strength
If rigid gripper structure is used, then structural strength is improved, but the gripper cannot handle delicate and fragile objects
Solution Approach 1:
The gripper employs a hybrid structure where the main body remains rigid for structural strength, while the fingertips are made soft and compliant using elastomeric materials. This local differentiation allows the gripper to maintain overall strength while the soft fingertips adapt to and safely handle delicate and fragile objects of various shapes and sizes
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances tactile sensitivity and range, allowing safe and adaptive handling of a wide variety of objects with reduced workspace constraints and lower power consumption, improving grasping and manipulation capabilities.
Implementation Method 1
event-based cameras detect transient changes in dynamic scenes in terms of brightness intensity
Implementation Method 2
soft grippers utilize flexible and compliant materials, making them a better candidate in unstructured environments and in handling delicate and fragile objects
Data Source
AI summary
A robotic manipulator includes a sensing device with a tactile interface featuring visual markers and a camera for capturing images of these markers. The system includes one or more processors and memories storing instructions which, when executed, direct the tactile interface to contact a target surface, deforming the visual markers. The camera captures visual feedback of this deformation, which is input into a machine learning algorithm. Based on the algorithm's output, the system controls the operation of a manipulator device. This configuration enables adaptive manipulation by interpreting tactile and visual data through machine learning.