Vehicle Camera Luminance Cross-Check for Fault Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for monitoring the functionality of on-board vehicle image capturing devices, such as cameras, rely on voltage and clock monitoring using specialized IC components, which adds complexity and cost, and may not effectively detect improper functioning that could lead to non-compliance with safety requirements like ASIL B levels.

Innovation Solution

A luminance assessment system that uses two or more image capturing devices with overlapping fields of view to compare luminance values across overlapping regions, determining a luminance deviation based on these comparisons, and identifying device failure when the deviation exceeds a predetermined threshold, thereby eliminating the need for voltage and clock monitoring.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If voltage and clock monitoring is performed using specialized IC components, then detection of abnormal voltages causing abnormal luminance is enabled, but device complexity and overall system cost increase

Engineering Contradiction:
Improvedetection of abnormal luminanceVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The image capturing device performs self-diagnosis by comparing its own captured images with reference images. The device captures images, compares them with reference images stored in memory, and autonomously determines whether the captured images are normal or abnormal, eliminating the need for external specialized monitoring IC components.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses reference images (copies of normal images) stored in memory to compare against newly captured images. By creating and storing reference images under various lighting conditions, the system enables comparison-based detection without requiring complex hardware monitoring components.

Inventive Principle:
Principle #26Copying

2Reliability

If voltage and clock monitoring is performed using specialized IC components, then detection of abnormal voltages causing abnormal luminance is enabled, but overall system cost increases

Engineering Contradiction:
Improvedetection of abnormal luminanceVSAvoidsystem cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The image capturing device performs self-diagnosis by comparing its own captured images with reference images. The device captures images, compares them with reference images stored in memory, and autonomously determines whether the captured images are normal or abnormal, eliminating the need for external specialized monitoring IC components.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses reference images (copies of normal images) stored in memory to compare against newly captured images. By creating and storing reference images under various lighting conditions, the system enables comparison-based detection without requiring complex hardware monitoring components.

Inventive Principle:
Principle #26Copying

3Device complexity

If image comparison method is used to detect abnormal luminance, then specialized IC components are eliminated, but ability to detect improper functioning must be maintained

Engineering Contradiction:
Improvesystem complexityVSAvoiddetection accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system stores multiple reference images corresponding to different lighting conditions (daytime, nighttime, tunnel, overpass) in memory. By selecting and comparing against the appropriate reference image based on current lighting conditions, the system maintains high detection accuracy while using simple image comparison methodology.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The detection process is segmented into distinct steps: capturing images, selecting appropriate reference images based on lighting conditions, comparing captured images with reference images, and determining normality based on comparison results. This segmentation allows the system to maintain reliability through systematic processing.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3971828B1Monitoring of on-board vehicle image capturing device functionality compliance
Publication Date: 2025.04.09 ZENUITY AB
  • EP3971828B1 patent drawingFigure 1
  • EP3971828B1 patent drawingFigure 2a
  • EP3971828B1 patent drawingFigure 2b

AI summary

The present disclosure relates to a method performed by a luminance assessment system (1) of a vehicle (2) for monitoring of on-board vehicle image capturing device functionality compliance with a predeterminable requirement level. The vehicle comprises two or more image capturing devices (3) adapted to capture surroundings of the vehicle, wherein a first image capturing device (31) has a first field of view (41) and a second image capturing device (32) has a second field of view (42) with a primary region (421) thereof at least partly overlapping the first field of view. The luminance assessment system obtains at respective one or more time instants (t1, t2, t3), a respective first image with support from the first image capturing device and a respective second image with support from the second image capturing device, wherein a first section of the respective first images and a second section of the respective second images respectively covers the primary region. The luminance assessment system further measures for respective first image a respective first luminance value of the first section, and for respective second image a respective second luminance value of the second section. Moreover, the luminance assessment system determines (1005) a luminance deviation based on comparing at least one of the respective first luminance values to at least one of the respective second luminance values. The luminance assessment system furthermore determines, when the luminance deviation exceeds a deviation threshold, that the first image capturing device or the second image capturing device fails to function according to the requirement level. The disclosure also relates to a corresponding computer program product and non-volatile computer readable storage medium.