Mobile Device Visual Information Display for Automated Driving

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In vehicles with at least partially automated driving, there is a need to enhance the usability of mobile devices and effectively communicate visual information to occupants about the traffic situation and required actions, ensuring they can quickly focus on driving when necessary.

Innovation Solution

A method and device that utilize a mobile user device to output visual information, such as image sequences, representing the detected traffic situation and required actions, with parameters like degree of automation and limiting values, facilitating rapid understanding and attention redirection to the vehicle surroundings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If visual information is continuously displayed on the mobile device during automated driving, then the occupant can stay informed about the traffic situation, but the occupant may become distracted and fail to notice when driver attention is required

Engineering Contradiction:
Improveinformation about traffic situationVSAvoidoccupant attention availability
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The display content and characteristics are dynamically adjusted based on the automated driving system's state. When the system requires driver attention, the display automatically changes to alert the occupant. When automated driving is stable, normal visual information can be displayed. This dynamic adaptation resolves the contradiction by making the display behavior contingent on system needs rather than static.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback loops where the automated driving system communicates its attention requirements to the mobile device display. The display receives feedback about system state and adjusts its behavior accordingly. This feedback mechanism ensures that information display does not compromise safety by prioritizing driver attention when needed.

Inventive Principle:
Principle #23Feedback

2Loss of information

If the mobile device provides detailed visual information about traffic situations, then the occupant can understand the environment better, but the information may be too complex to process quickly when driver intervention is needed

Engineering Contradiction:
Improvetraffic situation understandingVSAvoidreaction time for driver intervention
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

Visual information is segmented into hierarchical levels of detail and priority. Critical safety-related information is separated from general contextual information. When driver attention is required, only the most essential segmented information is displayed prominently, allowing rapid comprehension without cognitive overload from unnecessary details.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions or aspects of the displayed information have different qualities and priorities. Critical information elements are highlighted with enhanced visual properties (brightness, size, position) while less critical information is dimmed or minimized. This local quality differentiation enables selective attention to essential elements during time-critical situations.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11062598B2Method, mobile user device, and computer program for producing visual information for at least one occupant of a vehicle
Publication Date: 2021.07.13 BAYERISCHE MOTOREN WERKE AG
  • US11062598B2 patent drawing
  • US11062598B2 patent drawing
  • US11062598B2 patent drawing

AI summary

A method produces visual information, by way of a mobile user device, for at least one occupant of the vehicle in connection with at least partially automated driving, in which method visual information, in particular an image sequence, is displayed on a display of the mobile user device. The image sequence represents a traffic situation detected by the vehicle and/or a need for action of an occupant which is requested or recommended in this context.