Camera Monitor System Image Integration with Depth-Based Alert Marking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In a camera monitor system (CMS), vehicles traveling behind may be obscured by vehicles in front, making it difficult for drivers to recognize approaching vehicles due to the combination of rear and side camera views, leading to potential late detection of second vehicles.

Innovation Solution

An image generating device and method that integrates rear and side camera views and superimposes an alert mark on the integrated image when an object in the side view is positioned farther back than in the rear view, ensuring the driver's attention is quickly drawn to potentially obscured vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple camera views are integrated to provide comprehensive rear visibility, then the coverage area is improved, but objects on the farther side may be hidden by closer objects, reducing detection reliability

Engineering Contradiction:
Improvecoverage areaVSAvoiddetection reliability
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent segments the integrated image into multiple depth layers based on distance information from detection devices. Objects are classified into different depth zones (first depth, second depth, third depth), and alert marks are selectively applied to objects in farther depths that may be obscured by closer objects. This segmentation allows the system to maintain comprehensive coverage while highlighting potentially hidden objects to improve detection reliability.

Inventive Principle:
Principle #1Segmentation

2Illumination intensity

If the integrated image displays all visible objects without additional indicators, then the image clarity is maintained, but the driver may not quickly notice obscured vehicles, reducing response time

Engineering Contradiction:
Improveimage clarityVSAvoidresponse time
Core Design Contradiction:
Illumination intensityVSLoss of time

Solution Approach 1:

The patent uses alert marks with distinct colors (such as yellow or red) superimposed on objects in farther depth layers that may be obscured. These color changes create visual contrast against the background and closer objects, immediately drawing the driver's attention to potentially hidden vehicles without degrading the overall image clarity. This enables rapid detection and response to obscured objects.

Inventive Principle:
Principle #32Color changes

3Reliability

If alert marks are added to highlight obscured objects, then the detection reliability is improved, but the device complexity increases due to additional processing requirements

Engineering Contradiction:
Improvedetection reliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs depth classification and alert mark determination in advance during the image processing stage, before displaying the final integrated image to the driver. The processing unit calculates depth information from multiple detection devices, classifies objects into depth layers, and determines which objects require alert marks. This preliminary action ensures that when the integrated image is displayed, obscured objects are already marked, improving detection reliability without adding complex real-time processing requirements during driver interaction.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10857942B2Image generating device, image generating method, and program
Publication Date: 2020.12.08 SONY GROUP CORP
  • US10857942B2 patent drawing
  • US10857942B2 patent drawing
  • US10857942B2 patent drawing

AI summary

The present technology relates to an image generating device, an image generating method, and a program which are capable of calling attention of a user quickly. An integrating unit integrates a first image and a second image and generates an integrated image. A superimposition executing unit causes an alert mark to be superimposed on the integrated image and generates a superimposed image in a case in which an object shown in the second image is positioned on a farther side than an object shown in the first image. The present technology can be applied to, for example, a Camera Monitor System (CMS) which provides, for example, an image corresponding to an image observed by a side mirror or a rearview mirror or the like.