Image-Space Trajectory Planning for Uncertain Depth Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in navigating through environments with uncertain depth estimates, such as those with complex shapes like trees with intermittent foliage, which can lead to unreliable depth measurements and increased collision risks.

Innovation Solution

The implementation of image space motion planning techniques that identify regions with low confidence depth estimates and associate them with higher collision risks, optimizing the vehicle's trajectory to avoid these areas by projecting the planned path into the image space and adjusting it based on cost functions to minimize risk.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the autonomous vehicle navigates through areas with complex shapes (e.g., trees with intermittent foliage), then the vehicle can explore more environments, but the depth estimates become unreliable and collision risk increases

Engineering Contradiction:
Improveenvironmental exploration capabilityVSAvoiddepth estimation reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The image space is segmented into multiple regions based on depth estimation confidence levels. High-confidence regions are identified where depth estimates are reliable, while low-confidence regions (such as areas with intermittent foliage) are marked as uncertain. This segmentation allows the motion planning system to selectively navigate through reliable areas while avoiding uncertain regions, thus maintaining both environmental exploration capability and navigation safety.

Inventive Principle:
Principle #1Segmentation

2Reliability

If the vehicle prioritizes areas with high confidence depth estimates, then collision risk is reduced, but the navigation path may be restricted to limited areas

Engineering Contradiction:
Improvecollision avoidance reliabilityVSAvoidnavigation path flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The motion planning system dynamically adjusts the vehicle's trajectory by continuously evaluating the confidence levels of different regions in the image space. As the vehicle moves and new depth information becomes available, the high-confidence regions are updated and expanded. This dynamic adaptation allows the vehicle to progressively explore new areas while maintaining safety by always having viable high-confidence paths available, thus balancing collision avoidance with navigation flexibility.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11347244B2Image space motion planning of an autonomous vehicle
Publication Date: 2022.05.31 SKYDIO INC
  • US11347244B2 patent drawing
  • US11347244B2 patent drawing
  • US11347244B2 patent drawing

AI summary

An autonomous vehicle that is equipped with image capture devices can use information gathered from the image capture devices to plan a future three-dimensional (3D) trajectory through a physical environment. To this end, a technique is described for image-space based motion planning. In an embodiment, a planned 3D trajectory is projected into an image-space of an image captured by the autonomous vehicle. The planned 3D trajectory is then optimized according to a cost function derived from information (e.g., depth estimates) in the captured image. The cost function associates higher cost values with identified regions of the captured image that are associated with areas of the physical environment into which travel is risky or otherwise undesirable. The autonomous vehicle is thereby encouraged to avoid these areas while satisfying other motion planning objectives.