Vehicle Display Control for Multi-Object Alerting Without Gaze Shift

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Advanced Driver Assistance Systems (ADAS) face challenges in effectively alerting drivers to multiple objects in their surroundings without requiring the driver to shift their gaze, leading to increased burden and oversight due to the movement of attention focuses.

Innovation Solution

A method and apparatus that use a recognition unit to determine the presence of multiple moving bodies in the foreground and control a display source to generate virtual lines directed at each object, allowing drivers to recognize multiple attention-worthy objects without shifting their sight line.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If information about multiple objects is overlapped and displayed on the foreground of the drivers, then the drivers can be alerted to objects they do not pay attention to, but the drivers experience increased burden due to sight line shifts caused by movement of attention focuses

Engineering Contradiction:
Improvedriver alertness to objectsVSAvoiddriver burden
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The display information is segmented into multiple attention focus indicators, each corresponding to a specific detected object. Instead of presenting all information at once, the system divides the attention guidance into discrete focal points that can be processed sequentially, reducing the cognitive burden on the driver while maintaining comprehensive object awareness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by pre-positioning attention focus indicators at locations corresponding to detected objects before the driver needs to attend to them. The saliency map is generated in advance based on sensor data, and attention focuses are strategically placed to guide the driver's gaze to relevant objects in the optimal sequence, preventing the need for reactive sight line shifts.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the focuses of attention are moved to areas where objects appear, then the drivers can be directed to objects they do not pay attention to, but the drivers experience oversight due to paying attention to moved focuses

Engineering Contradiction:
Improveobject detection awarenessVSAvoidoversight of objects
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system implements periodic action by sequentially updating and refreshing the attention focus indicators at different object locations. Rather than maintaining static or continuously moving focuses, the system periodically redirects attention to different objects in a structured sequence, ensuring that each object receives adequate attention while preventing driver oversight through rhythmic, predictable information presentation.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system maintains continuity of useful action by ensuring that attention focus indicators continuously guide the driver through all detected objects without interruption. The saliency map is continuously updated based on real-time sensor data, and attention focuses are maintained or adjusted to ensure uninterrupted coverage of all relevant objects, preventing oversight while the driver processes information.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP2860971B1Display control apparatus, method, recording medium, and vehicle
Publication Date: 2021.01.06 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • EP2860971B1 patent drawingFigure 1
  • EP2860971B1 patent drawingFigure 2
  • EP2860971B1 patent drawingFigure 3

AI summary

A method capable of causing a driver to recognize multiple objects to which attention should be paid without requiring sight line shift of the driver is for a video system including a recognition unit that recognizes a moving body existing in a foreground of a user and a display source that displays a certain image generated on the basis of a result of the recognition by the recognition unit on a display medium. The method includes determining whether two or more moving bodies exist in the foreground of the user on the basis of an input data from the recognition unit; and controlling the display source, if two or more moving bodies exist, so as to generate the certain image representing a virtual line directed to each of the moving bodies from a certain position or a certain axis and display the certain image on the display medium.