Vehicle Window Defect Sensing for Corrected Scene Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Windows in autonomous vehicles interfere with environmental sensing, causing image altering effects such as shadowing, scattering, and distortion, which hinder accurate image representation of the scene.

Innovation Solution

A system comprising sensor devices, lighting modules, and processors that detect window defects by illuminating them, allowing for image processing to correct scene images by deconvolving data affected by these defects, using edge and graze lighting modules to facilitate defect detection and adaptive focus functionality for accurate imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a window is used in autonomous vehicles, then the vehicle structure is protected and environmental sensing is enabled, but image altering effects such as shadowing, scattering, and distortion occur that hinder accurate scene representation

Engineering Contradiction:
Improveenvironmental sensing capabilityVSAvoidimage accuracy
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system performs preliminary defect detection on the window before capturing scene images. By identifying defects such as dirt, cracks, or imperfections in advance, the system can pre-calculate compensation parameters to correct image alterations caused by these defects, thereby maintaining image accuracy while using the window for environmental sensing

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the parameters of the imaging process by adjusting focus settings, illumination conditions, or sensor parameters based on detected window defects. This allows the system to optimize image capture conditions to minimize the impact of defects on image quality while maintaining the protective and sensing functions of the window

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If lighting modules are used to illuminate the window for defect detection, then defect visibility is improved, but system complexity and energy consumption increase

Engineering Contradiction:
Improvedefect detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The lighting modules are designed to serve multiple functions: they illuminate the window for defect detection, provide ambient lighting for the vehicle interior, and assist with night-time scene imaging. This multi-functionality reduces the need for separate dedicated lighting systems, thereby limiting the increase in system complexity while maintaining high defect detection accuracy

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the vehicle's existing lighting infrastructure and sensor array to perform window defect detection, rather than requiring completely separate dedicated systems. The sensors already present for scene imaging are also used to capture window defect images, and existing lighting elements are repurposed for illumination, allowing the system to serve itself and reducing overall complexity

Inventive Principle:
Principle #25Self-service

3Measurement precision

If multiple sensor devices are used to image both the window and the scene, then defect detection and scene imaging accuracy are improved, but device complexity increases

Engineering Contradiction:
Improveimaging accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The sensor devices are designed with adaptive focus functionality that allows them to switch between imaging the window and imaging the scene. By using the same sensor array for both purposes rather than separate dedicated sensors, the system maintains high imaging accuracy for both functions while minimizing the increase in device complexity through multi-functional utilization of each sensor component

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system produces accurate and clear images of the scene by compensating for image altering effects induced by window defects, enhancing the navigation and operation capabilities of autonomous vehicles.

Implementation Method 1

illumination of the window by the lighting module(s) may cause the defects to glow or otherwise act as secondary light sources, thereby making the defects easier to detect by a sensor device

Methodology Applied
Scientific EffectSecondary light source emission: Fluorescence

Implementation Method 2

A first sensor device may be configured to image at least a portion of the window... A second sensor device may be configured to image at least a portion of a scene

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Implementation Method 3

the processor(s) may perform image processing to compensate for the image altering effects induced by the defects and produce a corrected image of the scene

Methodology Applied
Scientific EffectImage deconvolution: Image Processing

Data Source

PatentUS11851030B2Window defect sensing and image processing
Publication Date: 2023.12.26 APPLE INC
  • US11851030B2 patent drawing
  • US11851030B2 patent drawing
  • US11851030B2 patent drawing

AI summary

Various embodiments relate to sensing defects associated with a window. Furthermore, various embodiments relate to performing image processing to produce a corrected image of a scene based at least partly on data corresponding to the detected defects. In some examples, one or more lighting modules may be used to illuminate the window to facilitate detection of the defects by one or more sensor devices.