Under-Display Imaging With Abnormality Detection for Clear Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic apparatuses face challenges in capturing images effectively due to abnormalities on the display surface, such as fingerprints, hand oil, scratches, or bubbles between the display and protective films, which can result in foreign substances being in focus or affecting image quality.

Innovation Solution

An electronic apparatus is designed with a display unit, an imaging unit on the opposite side of the display surface, an abnormality detection unit to identify issues on the display surface, and a display control unit that highlights the abnormality and may display information urging its removal.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If a camera module is disposed immediately below the display unit to capture images through the display surface, then the device can achieve a compact form factor with reduced bezel width, but image quality deteriorates due to abnormalities on the display surface such as fingerprints, hand oil, scratches, or bubbles

Engineering Contradiction:
Improvedevice sizeVSAvoidimage quality
Core Design Contradiction:
Volume of moving objectVSReliability

Solution Approach 1:

The abnormality detection unit performs detection before image capture to identify abnormalities on the display surface. The system proactively detects issues such as fingerprints, hand oil, scratches, or bubbles before they affect the image quality, allowing for preventive measures or corrections to be taken.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements a feedback mechanism where the abnormality detection unit continuously monitors the display surface condition and provides information to the image capture process. When abnormalities are detected, the system can adjust capture parameters, notify the user, or retake the image to maintain image quality.

Inventive Principle:
Principle #23Feedback

2Ease of manufacture

If the display surface is used as the imaging surface, then the device structure is simplified and manufacturing is easier, but measurement precision of image quality deteriorates due to foreign substances on the display surface

Engineering Contradiction:
Improvedevice structureVSAvoidimage quality
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The abnormality detection unit performs detection before image capture to identify abnormalities on the display surface. The system proactively detects issues such as fingerprints, hand oil, scratches, or bubbles before they affect the image quality, allowing for preventive measures or corrections to be taken.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The abnormality detection unit acts as an intermediary between the display surface and the image capture process. It monitors the condition of the display surface and provides information that helps the system decide whether to proceed with image capture, adjust parameters, or notify the user to clean the surface.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP4096212B1Electronic device
Publication Date: 2025.04.16 SONY SEMICON SOLUTIONS CORP
  • EP4096212B1 patent drawingFigure 1A~1B
  • EP4096212B1 patent drawingFigure 2(a)~3
  • EP4096212B1 patent drawingFigure 4A

AI summary

The present disclosure provides an electronic apparatus capable of capturing an image without being affected by an abnormality on a display surface. The electronic apparatus includes: a display unit; an imaging unit that is disposed on an opposite side to a display surface of the display unit; an abnormality detection unit that detects an abnormality on the display surface; and a display control unit that highlights a position where the abnormality detected by the abnormality detection unit occurs on the display unit.