Camera Lens Contamination Detection with Grid-Based Model Updates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera lens contamination detection methods fail to accurately identify and address contamination issues in real-time, particularly in autonomous driving systems, leading to potential accidents due to incorrect image processing.

Innovation Solution

An electronic device equipped with a contamination detection model trained using a grid system, which detects contaminated lens portions and determines operational hindrance, with the ability to supplement using overlapping areas from other images and update models based on reference images, and a server that communicates to refine and distribute improved models across devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a contamination detection model is used to detect lens contamination, then detection accuracy is improved, but the system complexity increases due to model training and updating requirements

Engineering Contradiction:
Improvecontamination detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The contamination detection model is trained and updated automatically using images captured by the camera system itself. The system collects real images, generates synthetic contaminated images through image processing, trains the model with these datasets, and updates the model weights without requiring external intervention or separate training hardware, thereby improving detection accuracy while minimizing system complexity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by pre-processing images to generate synthetic contamination samples before actual contamination detection is needed. By creating training datasets in advance through image processing techniques and pre-training the model with these prepared datasets, the system achieves high detection accuracy when actual contamination occurs without adding real-time processing complexity

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the contamination detection model is updated continuously with reference images, then detection reliability is improved, but processing time increases

Engineering Contradiction:
Improvedetection reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The model updates are performed periodically rather than continuously in real-time. The system collects reference images over time, processes them batch-wise to generate training datasets, and updates the model weights at scheduled intervals. This periodic update approach maintains high detection reliability through continuous learning while avoiding the time penalty of real-time processing for each update

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary processing of reference images to create training datasets before model updates are needed. By pre-processing images, generating synthetic contaminated versions, and preparing training data in advance, the system can quickly update model weights when updates are required, thereby improving reliability without significant time loss during actual detection operations

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240144452A1Apparatus and method with contamination detection of camera lens
Publication Date: 2024.05.02 SAMSUNG ELECTRONICS CO LTD
  • US20240144452A1 patent drawing
  • US20240144452A1 patent drawing
  • US20240144452A1 patent drawing

AI summary

An electronic device and method for detecting contamination of a camera lens, where the electronic device includes at least one camera configured to capture an image, a memory configured to store the image, and a contamination detection model configured to detect a contaminated portion of a lens of the at least one camera, in response to the image being input, and a processor configured to determine whether an operation of the electronic device is hindered by the contaminated portion, in response to the contamination detection model detecting the contaminated portion in the lens of the at least one camera.