Time-Varying Color Model for Camera Module Optical Drift

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera modules in electronic devices experience optical changes due to environmental factors like solar radiation, humidity, and temperature over time, leading to deviations in color calibration, resulting in less photorealistic images.

Innovation Solution

A software-based time-varying color correction method that models and adjusts color calibration values for optical components, using a processor and memory to apply compensation based on environmental factors, with options for machine learning models and predetermined maximum values to maintain color accuracy within a tolerable threshold.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If factory calibration values are used without time-varying compensation, then device complexity is reduced, but color accuracy deteriorates over time due to optical changes in components

Engineering Contradiction:
Improvecolor accuracyVSAvoidcomplexity of color correction system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing time-varying color correction values that compensate for anticipated optical changes in camera components. Instead of reacting to color drift after it occurs, the system proactively applies corrections based on predicted degradation patterns from environmental exposure (humidity, temperature, solar radiation), thereby maintaining color accuracy without requiring complex real-time sensing or adjustment mechanisms.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements parameter changes by dynamically adjusting color calibration parameters over time based on environmental conditions and component aging models. The system modifies key color parameters (such as white balance points and color matrix values) according to predicted optical transmission changes in lenses, filters, and sensors, allowing the camera to adapt its color characteristics without hardware modifications.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If time-varying color correction is applied, then color accuracy is maintained over time, but computational requirements and processing time increase

Engineering Contradiction:
Improvecolor accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs color correction calculations in advance and stores pre-computed correction values for different time intervals and environmental conditions. When an image is captured, the system simply retrieves the appropriate pre-calculated correction values based on device age and environmental history, avoiding the need for time-consuming real-time computations while maintaining accurate color correction.

Inventive Principle:
Principle #10Preliminary action

3Stability of the object's composition

If optical components are protected from environmental factors, then optical stability is improved, but adaptability to real-world usage conditions deteriorates

Engineering Contradiction:
Improveoptical stabilityVSAvoidadaptability to environmental conditions
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent replaces physical protection mechanisms (such as sealed housings or environmental controls) with a software-based compensation system. Instead of mechanically protecting optical components from environmental factors like humidity and temperature variations, the system uses computational color correction to counteract the optical effects of these factors, allowing the camera to operate in diverse real-world conditions while maintaining color accuracy through software rather than hardware protection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11816866B2Compensating for optical change in image capture device components over time
Publication Date: 2023.11.14 APPLE INC
  • US11816866B2 patent drawing
  • US11816866B2 patent drawing
  • US11816866B2 patent drawing

AI summary

Devices, methods, and non-transitory program storage devices (NPSDs) are disclosed to compensate for the predicted color changes experienced by camera modules after certain amounts of time of real world use. Such color changes may be caused by prolonged exposure of optical components of the camera module to one or more of: solar radiation, high temperature conditions, or high humidity conditions, each of which may, over time, induce deviation in the color response of optical components of the camera module. The techniques disclosed herein may first characterize such predicted optical change to components over time based on particular environmental conditions, and then implement one or more time-varying color models to compensate for predicted changes to the camera module's color calibration values due to the characterized optical change. In some embodiments, optical changes in other types of components, e.g., display devices, caused by prolonged environmental stresses may also be modeled and compensated.