Lane-Change Virtual Viewpoint Display for Driver Direction Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle control systems during lane change assist control do not effectively inform occupants about the situation in the vehicle's movement direction, as the displayed surroundings image does not accurately represent the area ahead and to the side of the vehicle.

Innovation Solution

A vehicle control device that generates a virtual viewpoint image based on camera data, positioning it further ahead and to the side of the occupant, and displays it on a screen positioned in front of the occupant, allowing for better awareness of the lane change direction and positional relationships with other vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a virtual viewpoint image is generated based on a virtual viewpoint positioned at the vehicle width direction center, then the surroundings image can be displayed, but the occupant cannot correctly understand the situation in the area positioned in the movement direction during lane change

Engineering Contradiction:
Improveoccupant awareness of movement direction situationVSAvoidvirtual viewpoint positioning complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The virtual viewpoint position is dynamically changed based on the lane change direction. When lane change to the right, the virtual viewpoint is positioned to the left of the vehicle center; when lane change to the left, the virtual viewpoint is positioned to the right of the vehicle center. This dynamic adjustment allows the surroundings image to correctly represent the area in the movement direction, improving occupant awareness without requiring multiple fixed camera systems.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The position parameters of the virtual viewpoint are changed according to the lane change direction. The virtual viewpoint coordinates are adjusted to be offset from the vehicle width direction center toward the opposite side of the lane change direction. This parameter change enables the generated surroundings image to display the area positioned further in front and further toward the lane change direction, resolving the information loss problem.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If the display area is used to show general vehicle information, then comprehensive information is provided, but the situation in the lane change direction is not prominently displayed

Engineering Contradiction:
Improvelane change direction situation visibilityVSAvoidinformation display effectiveness
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The display area is divided into different regions with different functions. The virtual viewpoint image representing the lane change direction area is displayed in a specific region of the display area, while other regions can show general vehicle information. This local differentiation ensures that the lane change direction situation is prominently and effectively displayed without sacrificing comprehensive information provision.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The display information is segmented into multiple components: the virtual viewpoint image showing the lane change direction area is separated from other general vehicle information. This segmentation allows the lane change direction situation to be highlighted in a dedicated display region, improving visibility and effectiveness while maintaining comprehensive information display capabilities.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240187545A1Vehicle control device, vehicle control method, and non-transitory storage medium
Publication Date: 2024.06.06 TOYOTA JIDOSHA KK
  • US20240187545A1 patent drawing
  • US20240187545A1 patent drawing
  • US20240187545A1 patent drawing

AI summary

A vehicle control device including a processor. When a vehicle is executing driving assistance control to change lanes toward one side of either the left or the right, the processor generates a virtual viewpoint image representing an area positioned further in front of and at the other side than an occupant of the vehicle based on image data acquired by cameras mounted to the vehicle and based on a virtual viewpoint positioned further to another side of either the left or the right than a vehicle width direction center of the vehicle, and causes display of the virtual viewpoint image on a display device provided to the vehicle.