Image Processing for Reducing Diffraction Brightness in Under-Display Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Full-screen designs in mobile terminals often suffer from image quality loss due to metallic circuits under the display screen causing light transmittance reduction, scattering, and diffraction, which affects camera performance, especially when capturing high-brightness objects.

Innovation Solution

A method for image processing that identifies high-brightness regions and diffraction areas caused by metallic circuits, reducing the brightness of these regions to compensate for diffraction effects, thereby enhancing image quality without the need for multiple frame fusion or exposure adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a camera module is placed underneath a display screen with metallic circuits, then full-screen design is achieved, but image quality deteriorates due to light transmittance reduction, scattering, and diffraction

Engineering Contradiction:
Improvedisplay screen areaVSAvoidimage quality
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent identifies diffraction regions caused by metallic circuits and converts this harmful effect into a manageable parameter by detecting and reducing brightness in specific diffraction patterns, thereby maintaining full-screen design while improving image quality

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The patent applies local quality by selectively processing only the diffraction regions rather than the entire image. It identifies specific areas affected by metallic circuit diffraction and applies brightness reduction only to those regions, preserving overall image quality while addressing local problems

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If multiple frames are fused to compensate for diffraction, then image quality improves, but power consumption increases and ghosting issues occur

Engineering Contradiction:
Improveimage qualityVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent extracts and processes only the diffraction region from the image rather than processing multiple complete frames. By isolating and treating only the affected area in a single frame, it eliminates the need for multi-frame fusion, reducing power consumption and avoiding ghosting artifacts

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by selectively reducing brightness only in the diffraction region rather than processing the entire image or using multiple frames. This targeted approach achieves the necessary image quality improvement with minimal computational overhead and power consumption

Inventive Principle:
Principle #16Partial or excessive action

3Use of energy by moving object

If brightness of diffraction region is reduced in a single frame, then power consumption decreases, but image processing complexity increases

Engineering Contradiction:
Improvepower consumptionVSAvoidimage processing complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by first detecting and identifying the diffraction region based on characteristic patterns (such as high-order diffraction patterns from metallic circuits) before applying brightness reduction. This pre-identification simplifies the subsequent processing by limiting operations to only the necessary regions

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach stabilizes image processing by reducing diffraction-related overlap and power consumption, while avoiding ghosting issues associated with multi-frame fusion, resulting in improved image clarity and reduced power usage in mobile devices.

Implementation Method 1

a metallic circuit is distributed on the display screen, light transmittance may be reduced in the region of the metallic circuit, and scattering and diffraction may exist in part of a light transmitting region of the metallic circuit

Methodology Applied
Scientific EffectDiffraction: Diffraction

Data Source

PatentEP3945491B1Image processing for reducing brightness of a diffraction region
Publication Date: 2024.08.07 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • EP3945491B1 patent drawingFigure 1~2A
  • EP3945491B1 patent drawingFigure 2B~3
  • EP3945491B1 patent drawingFigure 4~5B

AI summary

Provided are a method and device for image processing, a terminal device and a storage medium. The method includes: a high-brightness region is determined based on brightness of pixels in a first image, the brightness of the pixels in the high-brightness region being higher than the brightness of the pixels around the high-brightness region; a diffraction region in the first image is determined based on the high-brightness region, the diffraction region being an image region around the high-brightness region; and brightness of the diffraction region is reduced to obtain a second image. Through the method, after the brightness of the diffraction region is reduced, an overlap image formed by diffraction is alleviated, and the image is more real.