Camera Under Display Pixel Control for Image Quality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Camera-under-display technologies face challenges in maintaining image quality due to light emission from pixels in the camera area, leading to undesirable situations like hidden operation buttons or text boxes, which can cause user errors.

Innovation Solution

An information processing apparatus with a processor that controls light emission of pixels based on display data, performing a display stop process to stop light emission in the camera area when the camera is active and restoring display when the user's operation position is within that area, allowing the camera area to be displayed with reduced light or in a pop-up screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If the camera is placed near the rear face of the display to capture light passing through the screen area, then the device size can be reduced, but the image quality deteriorates due to light emission interference from pixels in the camera area

Engineering Contradiction:
Improvedevice sizeVSAvoidimage quality
Core Design Contradiction:
Volume of moving objectVSMeasurement precision

Solution Approach 1:

The display area is segmented into a camera area (first area) and a non-camera area. The processor selectively controls light emission only in the camera area corresponding to the camera's angle of view, while maintaining normal display functionality in other areas. This segmentation allows the camera to capture images through the display without interference from pixel light emission in the camera area.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different display modes are applied to different regions of the display. In the camera area, pixels are controlled to be non-displayed (black state) when the camera is active, while in non-camera areas, pixels continue to emit light for normal display purposes. This local quality differentiation resolves the conflict between camera functionality and display visibility.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If pixels in the camera area are controlled to be non-displayed to improve image quality, then light emission interference is reduced, but user operation becomes difficult because operation buttons or text boxes in the camera area are hidden

Engineering Contradiction:
Improveimage qualityVSAvoiduser operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The display mode of the camera area is dynamically adjusted based on user interaction. When the processor detects that the user is operating within the camera area (through touch input or cursor position), it automatically switches the camera area from non-display mode to display mode, allowing users to see and operate on visible targets. This dynamic switching resolves the contradiction between image quality and ease of operation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms to detect user operation positions (through touch sensors or cursor tracking). Based on this feedback, the processor determines whether to activate or deactivate display in the camera area. This feedback loop ensures that the display adapts to user needs, providing visibility when users need to operate and maintaining image quality when users are not interacting.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the camera area is displayed with reduced light emission, then image quality is improved while maintaining some visibility, but the brightness and visibility are compromised compared to full display mode

Engineering Contradiction:
Improveimage qualityVSAvoiddisplay brightness
Core Design Contradiction:
Measurement precisionVSIllumination intensity

Solution Approach 1:

The processor controls the light emission parameter of pixels in the camera area to be in a black state (minimal or zero light emission) when the camera is active. This parameter change ensures that the camera can capture images through the display without interference from pixel light emission, while the display can still function in other areas with normal brightness.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution improves image quality by preventing light emission interference with the camera and ensures users can operate on visible targets, reducing the likelihood of errors by appropriately controlling the display based on the camera's state and user interaction.

Implementation Method 1

a camera near the rear face of the display to capture an image based on light incident through the display

Methodology Applied
Scientific EffectLight transmission: Light

Implementation Method 2

a display having a screen area with an array of a plurality of pixels; a processor that controls light emission of a plurality of pixels of the display

Methodology Applied
Scientific EffectLight emission from pixels: Light Emitting Diode

Data Source

PatentUS11948490B2Information processing apparatus and control method
Publication Date: 2024.04.02 LENOVO SWITZERLAND INTERNATIONAL GMBH
  • US11948490B2 patent drawing
  • US11948490B2 patent drawing
  • US11948490B2 patent drawing

AI summary

The information processing apparatus includes a display having a screen area with an array of a plurality of pixels and a camera near the rear face of the display to capture an image based on light incident through the display. The information processing apparatus stops emission of light from pixels in a first area corresponding to a position in the screen area of the display where the camera is placed and control the pixels to be non-displayed, and when the operation position within the screen area of the display is within the first area, displays an image based on the display data corresponding to the first area in any part of the screen area of the display.