Object Relationship Graph Learning for Autonomous Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional approaches for learning causal relationships between objects in complex environments are rigid, inflexible, non-scalable, and often inaccurate, making it difficult to improve safety and effectiveness in autonomous navigation systems.

Innovation Solution

The method involves accessing a set of object detections, generating a graph representation with nodes corresponding to objects and edges representing their relationships, processing this graph using a trained message passing network to generate output features, and then using a machine learning model to predict object relationship graphs, which are updated based on subsequent environmental data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If hand-crafted rules or heuristics are used to learn relationships between objects, then domain expertise can be incorporated, but the system becomes rigid and inflexible

Engineering Contradiction:
Improveaccuracy of relationship learningVSAvoidflexibility of the system
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent replaces hand-crafted rules and heuristics (mechanical systems based on domain expertise) with a neural network-based machine learning system. This substitution allows the system to automatically learn complex relationships between objects from data without being constrained by pre-defined rules, thereby improving both accuracy and flexibility simultaneously.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Extent of automation

If conventional reward-based learning systems are used to learn abstract relationships, then learning can be automated, but the approach becomes non-scalable and inaccurate

Engineering Contradiction:
Improveautomation of relationship learningVSAvoidaccuracy of relationship learning
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The patent segments the relationship learning problem into distinct components: object detection, relationship prediction, and causal effect prediction. Each component is handled by specialized neural network modules that process specific aspects of the data independently, then integrate their results. This segmentation improves both automation capability and accuracy by allowing each module to specialize in its specific function.

Inventive Principle:
Principle #1Segmentation

3Ease of manufacture

If conventional approaches are used to learn relationships between objects, then implementation is straightforward, but the system becomes non-scalable

Engineering Contradiction:
Improveease of implementationVSAvoidscalability of the system
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent creates a universal machine learning framework that can handle multiple types of relationships and object interactions through a single integrated system. The neural network architecture is designed to be multi-functional, capable of learning various relationship types (spatial, temporal, causal) and applying them across different scenarios, thereby achieving scalability without sacrificing ease of implementation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250065907A1Perceiving and associating static and dynamic objects using graph machine learning models
Publication Date: 2025.02.27 QUALCOMM INC
  • US20250065907A1 patent drawing
  • US20250065907A1 patent drawing
  • US20250065907A1 patent drawing

AI summary

Certain aspects of the present disclosure provide techniques and apparatus for improved machine learning. A set of object detections, each respective object detection in the set of object detections corresponding to a respective object detected in an environment, is accessed. Based on the set of object detections, a graph representation comprising a plurality of nodes is generated, where each respective node in the plurality of nodes corresponds to a respective object detection in the set of object detections. A set of output features is generated based on processing the graph representation using a trained message passing network. A predicted object relationship graph is generated based on processing the set of output features using a layer of a trained machine learning model.