Autonomous Driving Handover Localization Failure Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in transitioning from autonomous driving mode to manual driving mode, particularly due to localization failures, which can result in inadequate notice to the driver, as current systems struggle to detect impending handovers early enough.

Innovation Solution

The system employs sensors, processors, and memory modules for feature detection, simulation, and localization simulation to identify potential localization-failure positions, allowing for earlier initiation of a transition from autonomous to manual driving mode by analyzing data from cameras and LIDAR sensors across defined detection regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the system waits until localization failure occurs to initiate handover, then the transition responds to actual failures, but the driver receives inadequate notice and safety is compromised

Engineering Contradiction:
Improvehandover reliabilityVSAvoidnotice time to driver
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary localization simulation at hypothetical future positions along the planned route to predict where localization failures will occur before the vehicle actually reaches those positions. This allows the system to initiate handover with sufficient advance notice to the driver, resolving the contradiction between reliable handover and adequate notice time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system takes preliminary anti-action by predicting and preventing the harmful effect of sudden localization failure through advance handover initiation. By simulating future localization conditions and detecting potential failure positions beforehand, the system counteracts the problem of inadequate driver notice before it occurs.

Inventive Principle:
Principle #9Preliminary anti-action

2Loss of time

If the system simulates localization at multiple hypothetical positions to detect potential failures early, then the driver receives sufficient notice for handover, but the computational complexity and processing time increase

Engineering Contradiction:
Improvenotice time to driverVSAvoidsimulation system complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system segments the future route into multiple discrete hypothetical positions along the planned path. At each segmented position, localization simulation is performed independently using detected features and map data. This segmentation allows comprehensive safety checking while managing computational complexity through structured, modular processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates virtual copies of the localization process at hypothetical future positions without requiring physical sensors to be present at those locations. By copying the feature detection and localization algorithms to simulate future states, the system achieves comprehensive prediction with manageable computational resources.

Inventive Principle:
Principle #26Copying

3Productivity

If the system uses only current sensor data for localization, then the processing is simple and fast, but the system cannot predict future localization failures

Engineering Contradiction:
Improvelocalization speedVSAvoidlocalization accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary localization simulations at hypothetical future positions using current sensor data combined with map information and planned route data. This allows the system to maintain fast processing based on current data while simultaneously predicting future localization accuracy, resolving the contradiction between speed and reliability.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10852726B2Systems and methods for transitioning a vehicle from an autonomous driving mode to a manual driving mode
Publication Date: 2020.12.01 TOYOTA JIDOSHA KK
  • US10852726B2 patent drawing
  • US10852726B2 patent drawing
  • US10852726B2 patent drawing

AI summary

System, methods, and other embodiments described herein relate to transitioning a vehicle from an autonomous to a manual driving mode. One embodiment analyzes data from one or more vehicle sensors to detect, at a current vehicle position, features in a first detection region and a second detection region ahead of the vehicle; determines, for each of one or more hypothetical vehicle positions, which features detected at the current position, if any, lie within the first detection region at that hypothetical position; identifies, among the one or more hypothetical positions, at least one localization-failure position at which localization of the vehicle will fail due to insufficient features being detected within the first detection region at the at least one localization-failure position; and initiates a transition from the autonomous driving mode to the manual driving mode based, at least in part, on the at least one localization-failure position.