Vehicle Electronic Mirror Anomaly Detection and Image Substitution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle electronic mirror systems can distract drivers when mist or dirt affects the on-board camera, leading to inaccurate image capture and poor perception of vehicle surroundings.

Innovation Solution

An electronic mirror system with rear and side-rear imaging devices, a display device, anomaly treatment devices, and a processor that detects anomalies, generates substitute images, and gradually switches between composite and substitute images to minimize driver distraction and ensure accurate surroundings perception.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the on-board camera is used to capture surroundings images, then the driver can perceive conditions in the surroundings of the vehicle in detail, but the driver may be unnecessarily distracted when mist or dirt adheres to the camera and inaccurate images are displayed

Engineering Contradiction:
Improveimage capture accuracyVSAvoiddriver perception reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary anomaly detection on captured images before displaying them to the driver. The anomaly detection device checks for mist or dirt adherence to the camera lens, and only displays images that pass the anomaly check, preventing distorted images from reaching the driver.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The anomaly detection device acts as an intermediary between the on-board camera and the display device. It filters out abnormal images caused by mist or dirt on the camera, allowing only normal images to be displayed to the driver.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Duration of action of stationary object

If the on-board camera captures images when mist or dirt adheres to it, then continuous monitoring is maintained, but the displayed image becomes inaccurate and distracts the driver

Engineering Contradiction:
Improvecontinuous monitoringVSAvoidmist and dirt interference
Core Design Contradiction:
Duration of action of stationary objectVSObject-affected harmful factors

Solution Approach 1:

The system converts the harmful effect of mist or dirt on the camera into a detectable anomaly. By identifying the presence of mist or dirt through anomaly detection, the system can flag and exclude these problematic images from display, turning a potential distraction into a filterable condition.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The anomaly detection device serves as an intermediary that identifies and isolates images affected by mist or dirt, preventing them from being displayed while allowing continuous monitoring to proceed without interruption.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If multiple imaging devices are used to provide backup and substitute images, then driver perception reliability is improved, but device complexity increases

Engineering Contradiction:
Improvedriver perception reliabilityVSAvoidsystem structure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses the on-board camera itself to create substitute images by capturing images at different timing when an anomaly is detected. Instead of requiring separate backup cameras, the same camera takes multiple images at different moments, and one of these images is used as a substitute when another is found to be abnormal.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

When an anomaly is detected in a captured image, the system discards that specific abnormal image but recovers by selecting and displaying a different image (either from alternative timing or alternative camera) to maintain continuous reliable monitoring without permanent loss of function.

Inventive Principle:
Principle #34Discarding and recovering

Data Source

PatentUS11390216B2Electronic mirror system for a vehicle
Publication Date: 2022.07.19 TOYOTA JIDOSHA KK
  • US11390216B2 patent drawing
  • US11390216B2 patent drawing
  • US11390216B2 patent drawing

AI summary

An electronic mirror system for a vehicle includes a rear imaging device, a left and right pair of side-rear imaging devices, a display device, an anomaly treatment device, memory, and a processor coupled to the memory. The processor causes a composite image in which a rear image and side-rear images are composited to be displayed, and detects an anomaly occurring at any one of the imaging devices. In a case in which an anomaly is detected, the processor generates a substitute image based on a captured image captured by another of the imaging devices, and causes the substitute image to be displayed. And, in a case in which the one of the imaging devices at which the anomaly is detected, is restored to the normal state by the anomaly treatment device, the processor causes the composite image to be displayed instead of the substitute image.