Electronic Mirror Image Synthesis for Blind Region Transparency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic mirror systems, blind regions exist where the field of view of one camera overlaps with the obstruction of another, leading to incomplete rearview images, which can obstruct the driver's visibility and awareness of the vehicle's surroundings.

Innovation Solution

An image synthesis device that uses multiple cameras and an image processing system to convert obstruction images into translucent images, combining them with complementary images through projective transformation and luminance averaging, creating a cohesive and complete rearview image by superimposing a border between the original and complementary images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are used to capture the view behind the vehicle, then the coverage area is improved, but blind regions remain where one camera's field of view overlaps with another camera's obstruction

Engineering Contradiction:
Improvecoverage areaVSAvoidblind region
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent combines images from multiple cameras (first camera and second camera) to create a synthesized rearview image. The image synthesis device merges the effective region from one camera with complementary regions from another camera, eliminating blind spots by integrating multiple viewpoint data into a single comprehensive image.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces a third camera positioned to capture the blind region that exists between the first and second cameras. This third camera acts as an intermediary to fill the gap where the other two cameras cannot provide adequate coverage, ensuring complete rearward visibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If cameras are positioned at different locations to maximize field of view, then coverage is improved, but effective regions and blind regions differ among cameras

Engineering Contradiction:
Improvefield of view coverageVSAvoidimage completeness
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent divides the rearview scene into distinct regions: effective regions captured by each camera and blind regions where obstructions occur. By segmenting the overall view into these functional zones, the system can selectively combine appropriate regions from different cameras to create a complete synthesized image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing strategies to different regions of the image. Effective regions from cameras with clear views are used directly, while blind regions are filled using data from other cameras or the third camera. This localized approach ensures optimal image quality in each specific area of the synthesized view.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12041375B2Image synthesis device for electronic mirror and method thereof
Publication Date: 2024.07.16 KK TOSHIBA
  • US12041375B2 patent drawing
  • US12041375B2 patent drawing
  • US12041375B2 patent drawing

AI summary

According to one embodiment, an image synthesis device for an electronic mirror includes a rear camera which obtains a first image from a first position, and a side camera which obtains a second image of the same direction with a view of the rear camera from a second position. The second image includes a view obstruction. When a part of the first image is connected as a complementary image to the view obstruction of the second image, an image processing device converts an image of the view obstruction into a translucent image, superimposes the complementary image on the translucent image, and obtains a third image which remains an outline of the complementary image.