Vehicle Abnormality Detection Using Optical Sensor and Camera Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques fail to detect abnormalities in both optical sensors and cameras used for object detection around vehicles, assuming the camera is functioning properly and thus cannot identify issues within the camera itself.

Innovation Solution

An abnormality detection device that calculates correlation values between reflection intensity images from an optical sensor and captured images from a camera, determining abnormalities based on predefined ranges, and adjusts resolution to accurately identify and address issues in either the optical sensor or camera.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the camera is assumed to be functioning properly for abnormality detection, then the detection process is simplified, but the camera itself cannot be detected for abnormalities

Engineering Contradiction:
Improveabnormality detection processVSAvoidcamera abnormality detection capability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent inverts the traditional assumption by not treating the camera as a perfect reference. Instead, it uses the optical sensor as an additional reference and compares multiple images (first brightness image from optical sensor, second brightness image from camera, and third brightness image from optical sensor) to detect abnormalities in either device. This mutual verification approach allows detection of camera abnormalities while maintaining reasonable process complexity.

Inventive Principle:
Principle #13The other way round (Inversion)

2Measurement precision

If resolution is increased to improve abnormality detection accuracy, then detection precision improves, but processing load increases

Engineering Contradiction:
Improveabnormality detection accuracyVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent applies local quality by selectively increasing resolution only in regions where abnormalities are detected. The abnormality detection unit identifies specific regions with discrepancies between images, and the image generation unit then generates high-resolution images only for those specific regions rather than processing the entire image at high resolution. This reduces overall processing load while maintaining detection accuracy where needed.

Inventive Principle:
Principle #3Local quality

3Reliability

If multiple images are processed to detect abnormalities in both optical sensor and camera, then detection comprehensiveness improves, but processing time increases

Engineering Contradiction:
Improvedetection comprehensivenessVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent uses partial action by processing multiple images (first brightness image, second brightness image, and third brightness image) but only performing detailed comparison and high-resolution processing on specific regions where abnormalities are suspected. The abnormality detection unit identifies regions of interest first, then focuses processing resources on those areas rather than uniformly processing all image data, thus reducing overall processing time while maintaining comprehensive detection capability.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11908119B2Abnormality detection device for vehicle
Publication Date: 2024.02.20 DENSO CORP
  • US11908119B2 patent drawing
  • US11908119B2 patent drawing
  • US11908119B2 patent drawing

AI summary

In an abnormality detection device for detecting whether there is an abnormality in either of an optical sensor and a camera that are used to detect objects around a vehicle, a correlation value calculation unit calculates a correlation value between at least one of a reflection intensity image that is detected by the optical sensor emitting light toward surroundings of the vehicle and then receiving reflected light of emitted light and a background light image that is detected by the optical sensor receiving light from the surroundings of the vehicle while the optical sensor is emitting no light, and a captured image of the surroundings from the camera. An abnormality determination unit is configured to, in response to the correlation value calculated by the correlation value calculation unit being out of a predefined range, determine that there is an abnormality in either of the optical sensor and the camera.