Remote Assistance Trajectory UI for Autonomous Vehicle Obstacles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous and semi-autonomous vehicles may encounter obstacles such as construction sites, poorly marked roadways, or stranded vehicles, which can limit their navigation capabilities, and existing systems lack effective remote assistance mechanisms to guide them through such situations.

Innovation Solution

A computing device positioned remotely from the vehicle receives sensor data to display a representation of the vehicle's forward path, augments it with proposed trajectories relative to road boundaries, and provides navigation instructions based on selected trajectories, allowing human operators to assist the vehicle in overcoming obstacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous vehicles navigate independently without remote assistance, then automation level is improved, but ability to handle complex obstacles and dynamic environments deteriorates

Engineering Contradiction:
Improveautonomous navigation capabilityVSAvoidability to handle complex obstacles
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

A remote computing device acts as an intermediary between the autonomous vehicle and human operators. The device receives sensor data from the vehicle, processes it to identify obstacles and generate proposed trajectories, then presents these options to a human operator who selects the best course of action. This intermediary system enables the vehicle to handle complex situations that exceed its autonomous capabilities while maintaining high-level automation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If remote assistance is implemented with full manual control, then adaptability to complex situations is improved, but response time and latency increase

Engineering Contradiction:
Improveability to overcome obstaclesVSAvoidremote assistance latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The remote computing device performs preliminary actions by continuously monitoring sensor data, pre-identifying potential obstacles, and generating multiple proposed trajectories in advance before a human operator needs to make a decision. This preparation work reduces the time required for human intervention when actual obstacles are encountered.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by continuously providing the human operator with visual representations of the vehicle's forward path, detected obstacles, and multiple proposed trajectories with their respective advantages. This informative feedback enables the operator to make informed decisions quickly without requiring extensive analysis or clarification.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If multiple proposed trajectories are presented to the operator, then navigation flexibility is improved, but information processing complexity increases

Engineering Contradiction:
Improvetrajectory selection flexibilityVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The complex navigation decision is segmented into multiple discrete trajectory options, each clearly labeled and described with its specific advantages. Instead of presenting a continuous range of possibilities, the system divides the solution space into distinct, manageable choices that the human operator can evaluate and select from.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each proposed trajectory is enhanced with localized, specific information about its advantages and characteristics. Rather than providing generic trajectory data, the system adds quality details such as 'avoids construction zone,' 'shortest path,' or 'safest route' to help the operator understand the specific benefits of each option in the current context.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12128922B2User interface techniques for recommending remote assistance actions
Publication Date: 2024.10.29 WAYMO LLC
  • US12128922B2 patent drawing
  • US12128922B2 patent drawing
  • US12128922B2 patent drawing

AI summary

Example embodiments relate to user interface techniques for recommending remote assistance actions. A remote computing device may display a representation of the forward path for an autonomous vehicle based on sensor data received from the vehicle. The computing device may augment the representation of the forward path to further depict one or more proposed trajectories available for the autonomous vehicle to perform. Each proposed trajectory conveys one or more maneuvers positioned relative to road boundaries in the forward path. The computing device may receive a selection of a proposed trajectory from the one or more proposed trajectories available for the autonomous vehicle to perform and provide navigation instructions to the vehicle based on the proposed trajectory.