AR Driver Assistance With Predicted Vehicle Path Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Advanced Driver Assistance Systems (ADAS) provide non-intuitive feedback to drivers in risky scenarios, often failing to show the consequences of their actions and only reacting after the risk is detected, leading to delayed driver responses.

Innovation Solution

The implementation of an augmented reality (AR) system that displays a virtual vehicle representing the future state of the actual vehicle, integrated with a risk prediction system using 3D maps and vehicle dynamics, to provide real-time feedback on potential risks and their consequences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If existing ADAS provides feedback in the form of arrows, icons or numbers, then the system complexity is reduced, but the intuitiveness and ease of understanding for the driver deteriorates

Engineering Contradiction:
Improvefeedback presentation complexityVSAvoiddriver comprehension ease
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent creates a virtual vehicle that is a visual copy of the real vehicle, displaying it on the HUD to represent future predicted states. This copy provides intuitive feedback by showing the driver exactly where the vehicle will be positioned, eliminating the need to interpret abstract icons or numbers while maintaining system simplicity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from 2D abstract representations (icons, arrows, numbers) to a more immersive visualization by projecting the virtual vehicle onto the windshield in a way that overlays it with the real-world view. This dimensional enhancement provides spatial context and improves intuitiveness without significantly increasing system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Speed

If existing ADAS provides feedback only when the risky event is detected, then the system responsiveness is improved, but the driver reaction time deteriorates

Engineering Contradiction:
Improvesystem responsivenessVSAvoiddriver reaction time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent implements a prediction mechanism that calculates and displays the virtual vehicle's future position before the risky event actually occurs. By showing the driver where the vehicle will be in the near future based on current trajectory and environmental factors, the system provides advance warning, allowing the driver to react proactively rather than reactively.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a closed-loop feedback system where the virtual vehicle's position is continuously updated based on real-time vehicle state and environmental data. This predictive feedback loop allows the driver to see the consequences of current driving actions before they materialize, enabling timely corrective maneuvers.

Inventive Principle:
Principle #23Feedback

3Loss of information

If existing ADAS highlights environmental elements without showing consequences, then the information processing load is reduced, but the driver's ability to appreciate future risk deteriorates

Engineering Contradiction:
Improveinformation processing loadVSAvoidrisk appreciation accuracy
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent uses a virtual vehicle copy to demonstrate the consequences of current driving actions. Instead of merely highlighting environmental elements like other vehicles or obstacles, the system shows the driver where their own vehicle will be positioned relative to these elements, making the potential collision or risky situation tangible and comprehensible.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary risk assessment by predicting the virtual vehicle's future position and comparing it with environmental obstacles. This advance calculation allows the system to present concrete risk scenarios to the driver before the actual risky event occurs, improving risk appreciation without overwhelming the driver with raw data.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11794766B2Systems and methods for prediction-based driver assistance
Publication Date: 2023.10.24 HUAWEI TECH CO LTD
  • US11794766B2 patent drawing
  • US11794766B2 patent drawing
  • US11794766B2 patent drawing

AI summary

The present disclosure describes systems and methods for providing driver assistance. A current vehicle state of a vehicle at a current timestep and an environment map representing an environment of the vehicle at least at the current timestep are obtained. Augmented reality feedback is generated including a virtual vehicle representing a predicted future vehicle state, where the predicted future vehicle state is predicted for a given future timestep based on at least one of the current vehicle state or the current environment. The generated augmented reality feedback including the virtual vehicle is outputted to be displayed by a display device.