Neural Implicit Value Functions for Real-Time Robot Grasping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional robot grasping techniques are computationally complex and inefficient for grasping moving objects, such as those on a conveyor belt or production line, as they require separate steps for object detection and motion planning, which cannot be recomputed quickly enough to react to object movements.

Innovation Solution

A method using machine learning models to predict path lengths and collisions, allowing robots to grasp moving objects by generating and optimizing trajectories through model predictive control, combining path length and collision models to efficiently control robot movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional two-step approach (object detection + motion planning) is used, then robot can grasp static objects, but computational complexity increases and processing time increases, making it unable to grasp moving objects

Engineering Contradiction:
Improvegrasping capabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent combines object detection and motion planning into a unified neural network model that processes sensor data and directly outputs robot joint trajectories. This integration eliminates the sequential two-step approach, allowing simultaneous processing of detection and planning functions, thereby reducing processing time while maintaining grasping reliability for both static and moving objects.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces the traditional mechanical control system (separate detection algorithms and motion planning algorithms) with a neural network-based system. The neural network learns optimal trajectories from training data, substituting complex computational mechanics with learned patterns that can be rapidly evaluated during operation, enabling real-time response to moving objects.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If conventional two-step approach is used, then motion path can be determined, but computational complexity prevents real-time reaction to moving objects

Engineering Contradiction:
Improvereaction to moving objectsVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary training of the neural network offline using extensive simulation data that covers various object positions, orientations, and motion patterns. This pre-computed knowledge is stored in the network weights, allowing the robot to rapidly adapt to moving objects during operation without performing complex real-time computations, thus increasing adaptability while reducing operational computational complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses simulation environments to create virtual copies of physical scenarios for training the neural network. By learning from these simulated copies of real-world interactions, the network acquires generalized knowledge that transfers to physical robot operation, enabling adaptive response to moving objects without requiring complex real-time sensing and computation for each new situation.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20250289123A1Techniques for robot control using neural implicit value functions
Publication Date: 2025.09.18 NVIDIA CORP
  • US20250289123A1 patent drawing
  • US20250289123A1 patent drawing
  • US20250289123A1 patent drawing

AI summary

One embodiment of a method for controlling a robot includes receiving sensor data associated with an environment that includes an object; applying a machine learning model to a portion of the sensor data associated with the object and one or more trajectories of motion of the robot to determine one or more path lengths of the one or more trajectories; generating a new trajectory of motion of the robot based on the one or more trajectories and the one or more path lengths; and causing the robot to perform one or more movements based on the new trajectory.