Rearview Display Device Abnormality Detection via Video Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing rearview display systems for vehicles face challenges in maintaining driver safety by failing to effectively distinguish between actual and mirror images, leading to potential misrecognition of critical information like following vehicles, due to gradation display methods that degrade viewability and disturb the field of view.

Innovation Solution

A rearview display device with a dimming mirror and an image processing unit that generates a conversion video with an identical angle of view to the mirror image, allowing it to be superimposed or separately displayed, ensuring the driver can confirm video abnormalities without disturbing their field of view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If gradation display is performed by changing color density of the mirror image from peripheral portion to central portion step by step, then abnormality detection is enabled, but viewability of the mirror image is degraded and viewing angles are narrowed

Engineering Contradiction:
Improveabnormality detection capabilityVSAvoidviewability of mirror image
Core Design Contradiction:
ReliabilityVSIllumination intensity

Solution Approach 1:

The display area is segmented into two distinct regions: a mirror image display area showing the reflected image, and a video display area showing the captured video. This segmentation allows the video to be displayed separately rather than through gradation overlay, thus maintaining the viewability and viewing angles of the mirror image while still enabling abnormality detection through the separate video feed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The solution transitions from a single-dimension gradation overlay approach to a two-dimension spatial separation approach. By arranging the mirror image and video in different spatial regions (side-by-side or stacked layouts), the system enables abnormality detection without compromising the visual quality and viewing characteristics of the mirror image.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If a mark image indicating normal operation is added to the captured image, then abnormality recognition is simplified, but field of view of the driver is disturbed

Engineering Contradiction:
Improveabnormality recognitionVSAvoidfield of view
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The video signal is extracted and displayed in a dedicated video display area separate from the mirror image display area. This extraction eliminates the need to add mark images to the captured video, as the entire video feed is presented in its own region. The driver can recognize abnormalities by comparing the video content with the mirror image without any mark images obstructing the field of view.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The video display area acts as an intermediary that presents the captured video in a separate region, allowing the driver to monitor for abnormalities without directly adding markers to the video feed. This intermediary approach enables abnormality detection while preserving the integrity and full field of view of both the mirror image and video content.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If conversion video is superimposed on mirror image, then abnormality detection is enabled without disturbing field of view, but device complexity increases

Engineering Contradiction:
Improveabnormality detectionVSAvoiddisplay structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The display device is segmented into distinct functional regions: a mirror image display area and a video display area. This segmentation simplifies the overall structure compared to complex overlay systems, as each region handles a single function independently. The abnormality detection capability is achieved through this straightforward spatial separation rather than through complex image processing and superimposition mechanisms.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables the driver to clearly recognize video abnormalities without interfering with their field of view, enhancing safety by preventing misrecognition of critical information.

Implementation Method 1

a dimming mirror that is disposed so as to be overlapped with a display surface of the display unit, and reflects, as a mirror image, a periphery of a vehicle

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS11077793B2Rearview display device, rearview display method, and program
Publication Date: 2021.08.03 SHARP KK
  • US11077793B2 patent drawing
  • US11077793B2 patent drawing
  • US11077793B2 patent drawing

AI summary

A video processing unit generates a conversion video having the same angle of view as an angle of view of a mirror image by converting a camera video. The video processing unit causes the generated conversion video to be displayed in a display region such that the conversion video is superimposed on the mirror image.