Robot Grasping End Effector Positioning via CNN-Based Grasp Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic systems lack efficient methods for determining optimal grasping parameters for various objects, leading to difficulties in accurately positioning end effectors for grasping and manipulating objects in diverse environments.

Innovation Solution

A convolutional neural network (CNN) is trained to generate grasping parameters based on image data, enabling robots to determine the precise positioning and orientation of end effectors for grasping objects by analyzing depth and color channels in images, and providing confidence measures for multiple grasping options.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional methods are used to determine grasping parameters, then the system is simpler to implement, but the positioning accuracy of end effectors deteriorates

Engineering Contradiction:
Improvegrasping parameter detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical and geometric reasoning systems with a convolutional neural network that processes image data to directly output grasping parameters. The CNN learns optimal grasping strategies through training on labeled examples, substituting complex mechanical positioning calculations with data-driven pattern recognition that achieves superior accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an image processing intermediary layer between the robot's visual system and its grasping control system. The CNN processes depth and color image data to extract meaningful features and generate grasping parameters, serving as an intelligent mediator that translates raw visual information into actionable control commands for the end effector.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple grasping options are provided, then the adaptability of the system improves, but the processing time increases

Engineering Contradiction:
Improvegrasping option diversityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs preliminary action by pre-training the convolutional neural network on extensive labeled datasets containing multiple valid grasping examples for various objects. This pre-training enables the network to rapidly infer multiple plausible grasping options during actual operation without requiring extensive real-time computation, thus providing adaptability with minimal processing delay.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamics by allowing the system to adaptively select from multiple grasping options based on the specific object characteristics and task requirements. The CNN dynamically generates different grasping parameters (position, orientation, quaternion) tailored to each situation, enabling flexible adaptation while maintaining efficient processing through the learned model.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11341406B1Determining grasping parameters for grasping of an object by a robot grasping end effector
Publication Date: 2022.05.24 GDM HOLDING LLC
  • US11341406B1 patent drawing
  • US11341406B1 patent drawing
  • US11341406B1 patent drawing

AI summary

Methods and apparatus related to training and/or utilizing a convolutional neural network to generate grasping parameters for an object. The grasping parameters can be used by a robot control system to enable the robot control system to position a robot grasping end effector to grasp the object. The trained convolutional neural network provides a direct regression from image data to grasping parameters. For example, the convolutional neural network may be trained to enable generation of grasping parameters in a single regression through the convolutional neural network. In some implementations, the grasping parameters may define at least: a “reference point” for positioning the grasping end effector for the grasp; and an orientation of the grasping end effector for the grasp.