Under-Display Optical Sensing With Diffusive Light Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional front-facing cameras in user devices suffer from increased footprint and reduced light capture due to circuitry components, leading to incomplete, inaccurate, and low-quality images, which are unsuitable for identification and authentication applications, and cannot be positioned behind display screens without compromising the device's form factor.
Innovation Solution
An optical device with diffusive optical elements on the display screen that diffuses and distributes light across an array of sensor elements, allowing light to pass through transmissive components while blocking other light, enabling processors to determine high-quality images using algorithms and machine learning models, without modifying the display screen's circuitry architecture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If conventional front-facing cameras are positioned behind display screens, then the device footprint is reduced, but light capture is blocked by circuitry components resulting in low-quality images
Solution Approach 1:
The display screen is segmented into transmissive components (pixels, window components, gaps) that allow light passage and blocking components (circuitry components) that block light. The optical sensor is segmented to identify and process only sensor data from light that passes through transmissive components, effectively separating useful light signals from blocked areas.
Solution Approach 2:
Different regions of the display screen are assigned different optical properties: transmissive components allow light to pass through while blocking components prevent light passage. The system processes sensor data locally, identifying which sensor data corresponds to light passing through transmissive versus blocking components, and selectively uses only the valid data for image reconstruction.
2Shape
If conventional front-facing cameras are positioned behind display screens, then the device form factor is improved, but the camera cannot capture accurate light information due to circuitry interference
Solution Approach 1:
The system performs preliminary identification of transmissive and blocking components in the display screen before image capture. Calibration information about the circuitry architecture is obtained in advance, and algorithms are optimized beforehand to distinguish between light that has passed through transmissive components versus blocking components, enabling accurate image reconstruction despite the obstructed optical path.
Solution Approach 2:
The transmissive components of the display screen act as intermediaries that selectively allow light to pass through to the optical sensor. The system uses these intermediaries to their advantage by identifying and processing only the sensor data that corresponds to light passing through these designated pathways, effectively using the display structure itself as part of the optical system.
3Device complexity
If all sensor data is processed to create an image, then processing is simplified, but image accuracy deteriorates due to inclusion of data from blocked light areas
Solution Approach 1:
The sensor data is segmented into two distinct sets: first set corresponding to light that passed through transmissive components and second set corresponding to light blocked by blocking components. This segmentation enables selective processing where only the first set is used for image determination, automatically filtering out corrupted data without requiring complex post-processing validation.
Solution Approach 2:
The system performs preliminary identification and separation of valid sensor data from invalid sensor data before image reconstruction. By using calibration information and optimized algorithms to identify which sensor data corresponds to transmissive components in advance, the system prepares the correct data subset beforehand, simplifying the subsequent image processing while ensuring accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables high-quality image capture for identification and authentication, reduces design complexity, and allows a thinner form factor suitable for devices with small form factors by utilizing light diffused through the display screen, improving image accuracy and resource efficiency.
Implementation Method 1
one or more diffusive optical elements disposed on a surface of the display screen and configured to diffuse and to distribute a first portion of light associated with a subject across an array of sensor elements of the optical sensor
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
An optical device includes an optical sensor, one or more diffusive optical elements disposed on a surface of a display screen and configured to diffuse and to distribute a first portion of light associated with a subject across an array of sensor elements of the optical sensor, and one or more processors. The display screen includes one or more transmissive components that allow the first portion of light to pass through the display screen via the surface of the display screen, and one or more blocking components that prevent a second portion of light associated with the subject from passing through the display screen. The one or more processors are configured to obtain, from the optical sensor, sensor data associated with the first portion of light, process the sensor data to determine an image of the subject, and perform one or more actions based on the image of the subject.