Robot Learning Evaluation Using Shared Embeddings and Local Caching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robot systems face challenges in efficiently learning and sharing new information, as updating machine learning models is time-consuming and computationally intensive, making it difficult for robots to adapt quickly to new objects or situations without delayed recognition capabilities.

Innovation Solution

Implementing a method where robots can store new information in a local cache for immediate use and share learned embeddings among each other, allowing for rapid dissemination of new information without requiring extensive retraining of machine learning models, while a central server updates models periodically based on aggregated learning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If robots update machine learning models frequently to learn new information, then learning accuracy is improved, but computational time and energy consumption increase significantly

Engineering Contradiction:
Improvelearning accuracyVSAvoidcomputational time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the learning process into two distinct parts: (1) robots immediately store and use learned information locally without updating models, and (2) the central server periodically aggregates and updates models in batches. This segmentation allows robots to achieve fast local adaptation while the server handles computationally intensive model updates, resolving the contradiction between learning speed and computational time.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a central server as an intermediary between robots and the model update process. The server aggregates learned information from multiple robots, performs batch model updates, and distributes updated models back to robots. This intermediary approach eliminates the need for each robot to perform expensive model updates individually, significantly reducing computational time and energy consumption while maintaining learning accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If robots perform extensive model retraining to adapt to new objects, then recognition capability is improved, but productivity decreases due to time loss

Engineering Contradiction:
Improverecognition capabilityVSAvoidadaptation speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent implements preliminary action by having robots immediately store learned information in their local databases upon encountering new objects, allowing them to adapt and recognize new objects right away without waiting for model retraining. The computationally intensive model updates are performed preliminarily and periodically by the central server, ensuring robots always have access to improved models while maintaining high adaptation speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by distributing updated machine learning models from the central server to multiple robots. Instead of each robot performing independent retraining, the server creates updated model copies and distributes them fleet-wide. This copying approach maintains consistent recognition capability across all robots while dramatically improving adaptation speed and productivity.

Inventive Principle:
Principle #26Copying

3Speed

If each robot learns independently without sharing, then individual learning speed is maintained, but fleet-wide learning efficiency decreases

Engineering Contradiction:
Improveindividual learning speedVSAvoidfleet-wide learning efficiency
Core Design Contradiction:
SpeedVSProductivity

Solution Approach 1:

The patent merges the learning processes of multiple robots by having them contribute their learned information to a central server. The server aggregates embeddings and learned objects from all robots, performs unified model updates, and distributes improvements fleet-wide. This merging approach maintains individual learning speed through local caching while dramatically improving fleet-wide learning efficiency through shared knowledge.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements universality by creating a centralized model that serves all robots in the fleet. The central server develops universal machine learning models that incorporate knowledge from all robots and distribute them fleet-wide. This universal approach allows each robot to benefit from the collective learning of the entire fleet, maximizing learning efficiency while preserving individual adaptation capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12165021B2Evaluating robot learning
Publication Date: 2024.12.10 GDM HOLDING LLC
  • US12165021B2 patent drawing
  • US12165021B2 patent drawing
  • US12165021B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on computer storage media for evaluating robot learning. In some implementations, a system receives classification examples from a plurality of remote devices over a communication network. The classification examples can include (i) a data representation generated by a remote device based on sensor data captured by the remote device and (ii) a classification corresponding to the data representation. The system assigns quality scores to the classification examples based on a level of similarity of the data representations with other data representations. The system selects a subset of the classification examples based on the quality scores assigned to the classification examples. The system trains a machine learning model using the selected subset of the classification examples.