Electronic Mirror Image Synthesis for Blind Region Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic mirror systems, blind regions exist where the field of view of one camera overlaps with the obstruction of another, leading to incomplete rearview images, which can obstruct the driver's visibility and awareness of the vehicle's surroundings.

Innovation Solution

An image synthesis device that uses multiple cameras and an image processing system to convert obstructive images into translucent ones, combining them with complementary images through projective transformation and luminance averaging to create a cohesive and complete rearview image, even in blind regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple cameras are used to capture the view behind the vehicle, then the coverage area is improved, but blind regions appear where one camera's field of view overlaps with another's obstruction

Engineering Contradiction:
Improvecoverage areaVSAvoidblind region
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent combines images from multiple cameras (rear camera and side cameras) by superimposing them to create a comprehensive rearview image. The image synthesis device merges the effective regions from different cameras while handling overlapping areas through translucency processing, ensuring complete coverage without information loss.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies luminance adjustment and translucency changes to image regions. Specifically, it makes overlapping image regions translucent and adjusts luminance to seamlessly combine images from different cameras, eliminating blind regions while maintaining visual coherence.

Inventive Principle:
Principle #32Color changes

2Loss of information

If cameras are positioned at different locations to eliminate blind regions, then coverage is improved, but image alignment and synthesis complexity increases

Engineering Contradiction:
Improveblind region eliminationVSAvoidimage synthesis complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical image alignment systems with computational image processing. The image synthesis device uses projective transformation and luminance adjustment algorithms to automatically align and combine images from cameras at different positions, simplifying the overall system while eliminating blind regions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transforms images by changing parameters such as luminance, transparency, and geometric transformation. The image synthesis device adjusts these parameters to seamlessly integrate images from multiple cameras, reducing synthesis complexity while maintaining complete coverage.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If overlapping image regions are displayed with full opacity, then image quality is maintained, but blind regions and obstructions remain visible

Engineering Contradiction:
Improveimage qualityVSAvoidobstruction visibility
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent applies different quality characteristics to different regions of the synthesized image. Specifically, it makes overlapping regions translucent while maintaining full opacity in non-overlapping regions, allowing the display to adapt locally to the content requirements and eliminate obstructions without compromising overall image quality.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11800045B2Image synthesis device for electronic mirror and method thereof
Publication Date: 2023.10.24 KK TOSHIBA
  • US11800045B2 patent drawing
  • US11800045B2 patent drawing
  • US11800045B2 patent drawing

AI summary

According to one embodiment, an image synthesis device for an electronic mirror includes a rear camera which obtains a first image from a first position, and a side camera which obtains a second image of the same direction with a view of the rear camera from a second position. The second image includes a view obstruction. When a part of the first image is connected as a complementary image to the view obstruction of the second image, an image processing device converts an image of the view obstruction into a translucent image, superimposes the complementary image on the translucent image, and obtains a third image which remains an outline of the complementary image.