Robot Task Learning With Neural Networks and Verifiable Plans

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional robotic programming methods are time-consuming and costly, making it financially prohibitive for many users, and limit the ability to add new tasks, requiring significant downtime and programming effort.

Innovation Solution

A system utilizing neural networks for perception, plan generation, and execution enables robots to learn tasks through human demonstrations, generating human-readable plans that can be verified and executed, allowing non-experts to quickly train robots with minimal delay and cost.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional programming methods are used to train robots, then the robot can perform tasks with high accuracy, but the training time and cost increase significantly

Engineering Contradiction:
Improvetask execution accuracyVSAvoidprogramming and testing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces conventional mechanical programming approaches with neural network-based learning systems. The robot learns tasks through neural networks that process sensory inputs and generate motor outputs, substituting traditional rule-based programming with adaptive, data-driven models that can generalize from demonstrations without explicit coding.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses demonstration copying where human operators perform tasks that the robot observes and replicates. The neural networks capture the essence of demonstrated behaviors and enable the robot to reproduce tasks without requiring programmers to explicitly code each action, significantly reducing programming time while maintaining task accuracy.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If conventional programming methods are used, then the robot can perform predefined tasks, but adding new tasks requires significant programming effort and downtime

Engineering Contradiction:
Improveability to add new tasksVSAvoidprogramming complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic task adaptation through neural networks that can continuously learn and update their parameters. The system transitions from static, pre-programmed task execution to dynamic, adaptive learning where the robot can acquire new tasks on-the-fly through demonstrations, with the neural networks adjusting their internal representations to accommodate new behaviors without requiring system reconfiguration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The robot performs self-learning by observing demonstrations and autonomously generating the necessary motor commands through its neural networks. The system serves itself by internally processing task information and adapting its behavior without external programming intervention, enabling easy addition of new tasks through simple demonstrations rather than complex programming.

Inventive Principle:
Principle #25Self-service

3Productivity

If neural networks are used for task learning, then training time and cost are reduced, but the system complexity increases

Engineering Contradiction:
Improvetraining efficiencyVSAvoidneural network system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the neural network system into distinct functional modules: perception networks for processing sensory inputs, policy networks for decision-making, and value networks for task evaluation. This modular segmentation allows each component to be trained independently on specific aspects of tasks, reducing overall training complexity and enabling parallel training processes that improve productivity while managing system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements universal neural network architectures that can handle multiple task types and sensory modalities through a common framework. The same core network structures process diverse inputs (visual, tactile, proprioceptive) and generate appropriate outputs for various robotic actions, reducing the need for task-specific customizations and simplifying the overall system despite the advanced learning capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12430702B2Learning robotic tasks using one or more neural networks
Publication Date: 2025.09.30 NVIDIA CORP
  • US12430702B2 patent drawing
  • US12430702B2 patent drawing
  • US12430702B2 patent drawing

AI summary

Various embodiments enable a robot, or other autonomous or semi-autonomous device or system, to receive data involving the performance of a task in the physical world. The data can be provided as input to a perception network to infer a set of percepts about the task, which can correspond to relationships between objects observed during the performance. The percepts can be provided as input to a plan generation network, which can infer a set of actions as part of a plan. Each action can correspond to one of the observed relationships. The plan can be reviewed and any corrections made, either manually or through another demonstration of the task. Once the plan is verified as correct, the plan (and any related data) can be provided as input to an execution network that can infer instructions to cause the robot, and/or another robot, to perform the task.