Under-Display Camera Color Correction via Sensor Light Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cameras positioned underneath displays of computing devices often capture content with color distortions due to ambient light being modified as it passes through degrading transparent layers, which affects the user experience.

Innovation Solution

A correction module uses a sensor positioned underneath the display to detect ambient and composite light, comparing them to determine a color correction that can be applied to reduce these distortions in captured content, employing a color matrix to modify RGB attributes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a camera is positioned underneath the display to increase display size, then the display area is improved, but color distortions occur in captured content due to ambient light modification through the display

Engineering Contradiction:
Improvedisplay areaVSAvoidcolor accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system dynamically adjusts color correction parameters based on detected ambient light conditions and display operational states. The correction module modifies RGB channel gains and applies color transformation matrices to compensate for display-induced color distortions, transforming the optical parameters of captured light to restore accurate color representation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

A sensor positioned underneath the display serves as an intermediary to detect ambient light and composite light (ambient light plus display light). This sensor provides measurement data to the correction module, which uses the information to calculate appropriate color correction factors, acting as a mediator between the display system and the camera capture process.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If ambient light is detected through the display to enable color correction, then color accuracy is improved, but the sensor must be repeatedly signaled over time increasing system complexity

Engineering Contradiction:
Improvecolor accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The sensor positioned underneath the display serves multiple functions: it detects ambient light for color correction, monitors display light emission states, and provides data for both still image and video capture correction. This multi-functionality reduces the need for separate sensing systems and simplifies the overall device architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system implements a feedback loop where the sensor continuously monitors ambient and composite light conditions, and the correction module adjusts color correction parameters in real-time based on this feedback. The correction is applied dynamically to captured content, creating a closed-loop system that adapts to changing lighting conditions and display states.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If the sensor detects both ambient light and composite light to determine color correction, then color distortion reduction is improved, but the detection time and processing duration increase

Engineering Contradiction:
Improvecolor distortion reductionVSAvoiddetection time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The sensor is signaled repeatedly at periodic intervals to detect ambient light and composite light conditions. This periodic sampling approach allows the system to capture light information at discrete moments without requiring continuous sensing, balancing measurement accuracy with time efficiency. The correction module processes these periodic measurements to maintain accurate color correction.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary detection of ambient light conditions and display operational states before actual content capture. By pre-characterizing the light environment and display behavior, the correction module can prepare appropriate correction parameters in advance, reducing processing time during actual capture operations.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively reduces color distortions in captured content by applying a color correction that enhances the user experience by improving the accuracy of images and videos captured by the camera.

Implementation Method 1

The sensor may detect ambient light periodically over time that is modified as it travels through the display, producing color distortions

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Implementation Method 2

The display light emits light from the display when activated and refrains from emitting light when deactivated

Methodology Applied
Scientific EffectLight emission: Light Emitting Diode

Implementation Method 3

The composite light includes the ambient light and at least a portion of the display light

Methodology Applied
Scientific EffectLight superposition:

Data Source

PatentUS11184595B2Color correction using a sensor to reduce color distortions of a camera under a display
Publication Date: 2021.11.23 GOOGLE LLC
  • US11184595B2 patent drawing
  • US11184595B2 patent drawing
  • US11184595B2 patent drawing

AI summary

This document describes techniques for color correction using a sensor to reduce color distortions of a camera under a display of a computing device. A correction module of the computing device may determine a color correction used to improve content captured by a camera utilizing, in part, a sensor (e.g., a camera, ambient light sensor, and so forth) positioned underneath the display. The sensor may detect ambient light over time that is modified as it travels through the display, producing color distortions. The sensor may also detect a composite light over time that includes calibration light emitted by the display and ambient light. The correction module may compare the ambient light and composite light to determine the color correction usable to improve both the content captured by the camera and a user experience.