Bird's-Eye-View Image Correction for Vehicle Irradiation Light Expansion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In history image combining techniques for vehicle displays, the expansion of vehicle irradiation light, such as headlamp or taillamp light, is not effectively prevented, leading to unwanted illumination in the displayed image as the vehicle moves.

Innovation Solution

A display control device and method that acquires images from in-vehicle cameras, generates corrected bird's-eye-view images by removing vehicle irradiation light, calculates vehicle movement, and combines these images to create a corrected history image, preventing the expansion of irradiation light in the display image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If history image combining is performed using captured bird's-eye-view images, then the image display range in the vehicle periphery is widened, but irradiation light from the vehicle expands in the display image along with vehicle movement

Engineering Contradiction:
Improveimage display rangeVSAvoidirradiation light expansion
Core Design Contradiction:
Area of stationary objectVSObject-generated harmful factors

Solution Approach 1:

The patent extracts and removes the harmful irradiation light components from the bird's-eye-view images before combining them into the history image. The image processing unit identifies and eliminates light regions corresponding to headlamp and taillamp irradiation, preventing their expansion in the final display while preserving the useful image data for widening the display range.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent converts the harmful effect of irradiation light into a beneficial process by using the light regions as identification markers. The system detects these light regions, determines their expansion trajectories based on vehicle movement, and proactively masks them in the history image combination process, thereby transforming a harmful phenomenon into an opportunity for improved image quality.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

2Loss of information

If captured images are combined to create history images, then the visual representation of vehicle surroundings is enhanced, but shadows and irradiation light expand in the displayed image

Engineering Contradiction:
Improvevisual representation qualityVSAvoidshadow and light expansion
Core Design Contradiction:
Loss of informationVSObject-generated harmful factors

Solution Approach 1:

The patent segments the bird's-eye-view image into distinct regions: effective image regions containing useful surrounding information, and light regions containing harmful irradiation. By separating these regions and processing them differently, the system preserves valuable visual information while eliminating expanding shadows and light artifacts from the history image combination.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If bird's-eye-view images are generated from captured images and combined, then the display shows a comprehensive view, but vehicle irradiation light appears and expands in the combined image

Engineering Contradiction:
Improvedisplay view comprehensivenessVSAvoidirradiation light appearance
Core Design Contradiction:
Adaptability or versatilityVSObject-generated harmful factors

Solution Approach 1:

The patent performs preliminary processing to identify and mask irradiation light regions in the bird's-eye-view images before they are combined into the history image. The image processing unit proactively removes these harmful elements in advance, preventing their appearance and expansion in the final comprehensive display view.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10887529B2Display control device and display control method
Publication Date: 2021.01.05 DENSO CORP
  • US10887529B2 patent drawing
  • US10887529B2 patent drawing
  • US10887529B2 patent drawing

AI summary

An image processing unit generates a corrected bird's-eye-view image that is a captured bird's-eye-view image and that is a bird's-eye-view image from which irradiation light present in the captured image has been removed. The corrected bird's-eye-view image is generated as a bird's-eye-view image representing a difference between the captured bird's-eye-view image and a difference image that is an image representing a change in a pixel value of the captured bird's-eye-view image. The image processing unit generates a corrected history image that is a bird's-eye-view image obtained by combining the corrected bird's-eye-view images while shifting positions of the corrected bird's-eye-view images on the basis of a movement amount of the own vehicle. The image processing unit generates a corrected display image that is a bird's-eye-view image obtained by combining the corrected history image and the latest captured bird's-eye-view image, and makes a display unit display the corrected display image.