Vehicle Electronic Mirror Anomaly Detection and Image Substitution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle electronic mirror systems can distract drivers when mist or dirt affects the on-board camera, leading to inaccurate image capture and poor perception of vehicle surroundings.
Innovation Solution
An electronic mirror system with rear and side-rear imaging devices, a display device, anomaly treatment devices, and a processor that detects anomalies, generates substitute images, and gradually switches between composite and substitute images to minimize driver distraction and ensure accurate surroundings perception.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the on-board camera is used to capture surroundings images, then the driver can perceive conditions in the surroundings of the vehicle in detail, but the driver may be unnecessarily distracted when mist or dirt adheres to the camera and inaccurate images are displayed
Solution Approach 1:
The system performs preliminary anomaly detection on captured images before displaying them to the driver. The anomaly detection device checks for mist or dirt adherence to the camera lens, and only displays images that pass the anomaly check, preventing distorted images from reaching the driver.
Solution Approach 2:
The anomaly detection device acts as an intermediary between the on-board camera and the display device. It filters out abnormal images caused by mist or dirt on the camera, allowing only normal images to be displayed to the driver.
2Duration of action of stationary object
If the on-board camera captures images when mist or dirt adheres to it, then continuous monitoring is maintained, but the displayed image becomes inaccurate and distracts the driver
Solution Approach 1:
The system converts the harmful effect of mist or dirt on the camera into a detectable anomaly. By identifying the presence of mist or dirt through anomaly detection, the system can flag and exclude these problematic images from display, turning a potential distraction into a filterable condition.
Solution Approach 2:
The anomaly detection device serves as an intermediary that identifies and isolates images affected by mist or dirt, preventing them from being displayed while allowing continuous monitoring to proceed without interruption.
3Reliability
If multiple imaging devices are used to provide backup and substitute images, then driver perception reliability is improved, but device complexity increases
Solution Approach 1:
The system uses the on-board camera itself to create substitute images by capturing images at different timing when an anomaly is detected. Instead of requiring separate backup cameras, the same camera takes multiple images at different moments, and one of these images is used as a substitute when another is found to be abnormal.
Solution Approach 2:
When an anomaly is detected in a captured image, the system discards that specific abnormal image but recovers by selecting and displaying a different image (either from alternative timing or alternative camera) to maintain continuous reliable monitoring without permanent loss of function.
Data Source
AI summary
An electronic mirror system for a vehicle includes a rear imaging device, a left and right pair of side-rear imaging devices, a display device, an anomaly treatment device, memory, and a processor coupled to the memory. The processor causes a composite image in which a rear image and side-rear images are composited to be displayed, and detects an anomaly occurring at any one of the imaging devices. In a case in which an anomaly is detected, the processor generates a substitute image based on a captured image captured by another of the imaging devices, and causes the substitute image to be displayed. And, in a case in which the one of the imaging devices at which the anomaly is detected, is restored to the normal state by the anomaly treatment device, the processor causes the composite image to be displayed instead of the substitute image.


