Robotic Grasp Assessment for 3D Deformable Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current approaches for robotic grasping of 3D deformable objects are complex and computationally expensive, and simulating grasping strategies is challenging due to the need for complex analytical equations and potentially hazardous real-world experiments.

Innovation Solution

The use of a focused set of robotic grasp features and GPU-based Finite Element Method (FEM) simulations to efficiently quantify grasp performance metrics such as stress, deformation, and stability, allowing for accurate simulation and prediction of grasp outcomes on diverse object categories.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If complex analytical equations are used to determine grasping strategies on 3D deformable objects, then measurement precision of grasp performance is improved, but device complexity and computational cost increase

Engineering Contradiction:
Improvegrasp performance metricsVSAvoidanalytical equations
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates virtual copies of deformable objects through 3D modeling and scanning techniques. These digital models replicate the physical properties and geometry of real objects, allowing simulation and analysis without requiring complex analytical equations for actual grasping scenarios. The copy enables repeated testing and optimization in silico before physical implementation.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces complex mechanical analysis and analytical equations with data-driven machine learning models. These models learn grasp performance patterns from simulation data and directly predict optimal grasping strategies, substituting traditional mechanics-based computational approaches with more efficient statistical and neural network-based methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If real-world experiments are conducted to validate grasping strategies, then reliability of grasp assessment is improved, but loss of time and experimental risk increase

Engineering Contradiction:
Improvegrasp assessmentVSAvoidexperiment duration
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary validation of grasping strategies through extensive simulation experiments before conducting real-world physical tests. The simulation framework pre-assesses multiple grasp configurations, identifies promising candidates, and optimizes parameters in advance, reducing the number and duration of required physical experiments while maintaining reliability through subsequent empirical validation.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If extensive simulation is performed to assess grasp quality, then measurement precision of deformation and stress is improved, but use of energy and computational resources increase

Engineering Contradiction:
Improvedeformation and stress metricsVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the simulation process into distinct phases: coarse-grained screening of grasp configurations using simplified models, followed by fine-grained detailed analysis only for promising candidates. This hierarchical segmentation reduces overall computational energy consumption by avoiding exhaustive high-fidelity simulation of all possible grasps, while maintaining measurement precision for the final selected grasp strategies.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This method enables efficient simulation and prediction of grasp outcomes, reducing computational costs and experimental risks while providing accurate metrics for grasp performance, facilitating improved robotic grasping of 3D deformable objects.

Implementation Method 1

GPU-based Finite Element Method (FEM) simulations to efficiently quantify grasp performance metrics such as stress, deformation, and stability

Methodology Applied
Scientific EffectFinite Element Method:

Implementation Method 2

simulating the grasping of such objects has proven to be challenging

Methodology Applied
Scientific EffectDeformation: Deformation

Data Source

PatentUS11745347B2Method for assessing the quality of a robotic grasp on 3D deformable objects
Publication Date: 2023.09.05 NVIDIA CORP
  • US11745347B2 patent drawing
  • US11745347B2 patent drawing
  • US11745347B2 patent drawing

AI summary

Candidate grasping models of a deformable object are applied to generate a simulation of a response of the deformable object to the grasping model. From the simulation, grasp performance metrics for stress, deformation controllability, and instability of the response to the grasping model are obtained, and the grasp performance metrics are correlated with robotic grasp features.