AR Overlay Control for Driver Distraction in Self-Driving Modes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automated vehicles face challenges in minimizing driver distractions, particularly in manual driving modes, where augmented reality overlays can increase the risk of accidents due to the driver's attention being diverted from the road.

Innovation Solution

A computer-implemented method and system that identifies the driver and determines the vehicle's driving mode, calculates focus and distraction scores, and adjusts augmented reality displays to ensure that the combined scores remain below a safety threshold, either by obscuring distractions or altering the vehicle's automation level to reduce the driver's attention requirement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If augmented reality overlays are displayed to the driver, then information accessibility is improved, but driver distraction increases

Engineering Contradiction:
Improveinformation accessibilityVSAvoiddriver distraction
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system dynamically adjusts the AR overlay display based on real-time assessment of driver focus and distraction levels. The display manager modifies or obscures AR overlays adaptively, transforming the static display into a dynamic system that responds to driver state, thereby maintaining information accessibility while reducing distraction harm.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters of AR overlays based on calculated focus and distraction scores. When distraction thresholds are exceeded, the system modifies overlay opacity, content, or positioning parameters to reduce driver distraction while preserving essential information delivery.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If AR overlays are used in manual driving mode, then information delivery is enhanced, but safety risk increases

Engineering Contradiction:
Improveinformation deliveryVSAvoidsafety risk
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system implements continuous feedback loops by monitoring driver behavior, calculating focus and distraction scores, and using this feedback to control AR overlay display. This closed-loop system ensures information delivery is enhanced only when safe, automatically reducing or obscuring overlays when safety risks are detected.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system takes preliminary anti-action by proactively identifying and mitigating safety risks before they manifest as accidents. The display manager predicts potential distraction hazards and preemptively adjusts AR overlay display to prevent safety incidents, rather than reacting after problems occur.

Inventive Principle:
Principle #9Preliminary anti-action

3Ease of operation

If the vehicle operates in fully automated mode, then driver attention requirement is reduced, but driver engagement decreases

Engineering Contradiction:
Improvedriver attention requirementVSAvoiddriver engagement
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system applies partial action by providing AR information overlays to the driver even in automated modes, but only to the extent necessary for situational awareness without requiring full attention. This partial engagement maintains driver connection to the driving environment while preserving the benefits of automated operation.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11878707B2Augmented reality overlay based on self-driving mode
Publication Date: 2024.01.23 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11878707B2 patent drawing
  • US11878707B2 patent drawing
  • US11878707B2 patent drawing

AI summary

A computer-implemented method displays a media file below a distraction threshold. The method includes identifying a driver of a vehicle, where the vehicle includes an augmented reality system, and the vehicle is at least partially automated. The method also includes determining, a driving mode for the vehicle and calculating a focus score. The method includes requesting, from a media repository, a media file, where the media repository contains a plurality of media files, and each media file has an associated distractions score. The method includes receiving from the media repository, a first media file to display, where a first distraction score of the first media file combined with the focus score is below a safety threshold. The method also includes displaying the first media file by the AR system. Further aspects of the present disclosure are directed to computer program products containing functionality consistent with the method described above.