Robotic Gripper Palm Sensing for Reliable Grasp Evaluation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Robotic grippers with underactuated digits face challenges in determining grasp success and quality due to limited control inputs and the reliance on force-based sensors, which can be unreliable, especially when interacting with varied objects like paper or plastic cups.

Innovation Solution

Incorporating a combination of non-contact sensors, such as a time-of-flight sensor and an infrared camera on the palm of the gripper, to generate multiple sensing modalities like distance and reflectance data, and grayscale image data, which are used by an object-in-hand classifier to assess grasp success and quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If force-based sensors are used to determine grasp success, then grasp evaluation can be performed, but the sensors become unreliable when interacting with varied objects like paper or plastic cups

Engineering Contradiction:
Improvegrasp evaluation reliabilityVSAvoidobject interaction adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent replaces force-based mechanical sensors with optical sensing systems (time-of-flight sensors and infrared cameras) that use light instead of mechanical contact to detect object presence and grasp status. This substitution eliminates the reliability issues of force sensors with delicate objects while maintaining grasp evaluation capability through optical reflection and distance measurements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces light as an intermediary medium between the sensor and the object. Instead of direct mechanical contact through force sensors, the system uses light reflection and time-of-flight measurements as intermediaries to indirectly detect grasp success, thereby protecting delicate objects while still obtaining reliable detection data.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If non-contact sensors are added to the gripper, then grasp evaluation accuracy improves, but device complexity increases

Engineering Contradiction:
Improvegrasp detection precisionVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing functions (distance measurement and image capture) into a single integrated sensor module mounted on the gripper. The time-of-flight sensor and infrared camera work together as a unified system, sharing mounting structure and processing resources, which reduces overall complexity compared to separate sensor systems while maintaining high measurement precision through multimodal data fusion.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides more accurate and reliable grasp evaluation, especially for underactuated grippers, by leveraging multimodal sensor data to distinguish between grasped and ungrasped states, improving the robotic system's ability to handle diverse objects effectively.

Implementation Method 1

a time-of-flight sensor arranged on the palm such that the time-of-flight sensor is configured to generate time-of-flight distance data in a direction between the plurality of digits

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

an infrared camera, comprising an infrared illumination source, where the infrared camera is arranged on the palm such that the infrared camera is configured to generate grayscale image data in the direction between the plurality of digits

Methodology Applied
Scientific EffectInfrared radiation detection: Infrared Radiation

Data Source

PatentUS11975446B2Sensorized robotic gripping device
Publication Date: 2024.05.07 GDM HOLDING LLC
  • US11975446B2 patent drawing
  • US11975446B2 patent drawing
  • US11975446B2 patent drawing

AI summary

A robotic gripping device is provided. The robotic gripping device includes a palm and a plurality of digits coupled to the palm. The robotic gripping device also includes a time-of-flight sensor arranged on the palm such that the time-of-flight sensor is configured to generate time-of-flight distance data in a direction between the plurality of digits. The robotic gripping device additionally includes an infrared camera, including an infrared illumination source, where the infrared camera is arranged on the palm such that the infrared camera is configured to generate grayscale image data in the direction between the plurality of digits.