Remote Object Classification for Autonomous Vehicle Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles may encounter complex or unexpected situations that interfere with their navigation, leading to temporary immobilization due to difficulties in classifying or identifying objects, especially when multiple sensor systems provide conflicting or low-confidence classifications.

Innovation Solution

The vehicle requests remote assistance from a human or computer operator through a graphical user interface, providing sensor data and multiple classifications for the operator to select the correct classification, which is then transmitted back to the vehicle for navigation strategy adjustment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If autonomous vehicles use multiple sensor systems for object classification, then measurement precision is improved, but device complexity increases and reliability decreases when sensors provide conflicting classifications

Engineering Contradiction:
Improveobject classification accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the object classification task by assigning different sensor systems (cameras, LIDAR, radar) to detect and classify objects independently, then combines their results through sensor fusion algorithms to achieve more accurate and reliable classifications than any single sensor could provide alone

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a universal object classification system that processes data from multiple types of sensors (optical, electromagnetic, mechanical) through a common processing architecture, enabling the system to handle various object types and environmental conditions with a single integrated approach

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If autonomous vehicles rely solely on automated sensor processing, then ease of operation is improved, but reliability decreases when sensors encounter complex or unexpected situations

Engineering Contradiction:
Improveautonomous navigationVSAvoidnavigation reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces a remote assistance system as an intermediary between the autonomous vehicle and human operators. When the automated sensor processing encounters complex or unexpected situations, the system automatically requests remote assistance, allowing human operators to provide expert classification for difficult-to-detect objects while maintaining autonomous operation for routine situations

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements feedback loops where the autonomous vehicle continuously monitors sensor data quality and classification confidence levels, automatically requesting remote assistance when confidence thresholds are not met, and using the outcomes of remote assistance requests to improve future automated decision-making

Inventive Principle:
Principle #23Feedback

3Reliability

If remote assistance is requested frequently for object classification, then reliability is improved, but loss of time increases due to communication delays

Engineering Contradiction:
Improveclassification reliabilityVSAvoidnavigation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies partial action by requesting remote assistance only for a subset of objects that meet specific criteria (low confidence classifications, ambiguous sensor data, or objects in critical locations) rather than requesting assistance for all detected objects, thereby maintaining high reliability for critical decisions while minimizing communication overhead and time loss

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20260065688A1Systems, Methods, and Apparatus for using Remote Assistance to Classify Objects in an Environment
Publication Date: 2026.03.05 WAYMO LLC
  • US20260065688A1 patent drawing
  • US20260065688A1 patent drawing
  • US20260065688A1 patent drawing

AI summary

Example embodiments relate to techniques for enabling one or more systems of a vehicle (e.g., an autonomous vehicle) to request remote assistance to help the vehicle navigate in an environment. A computing device may be configured to receive a request for assistance from a vehicle to classify an object and to initiate display of a graphical user interface at a display device. The graphical user interface may be configured to visually represent the object and may comprise one or more graphical user interface elements to enable input to be provided for classifying the object. The computing device may also be configured to generate a response that includes a classification of the object based on detecting a selection of at least one of the one or more graphical user interface elements. Further, the computing device may be configured to transmit the response to the vehicle.