Lensless Under-Display Camera for Eye Contact and Thin Screens
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing front-facing cameras in devices with display screens require space that could otherwise be occupied by the screen, limiting the screen-to-body ratio and hindering eye contact during video communication, while lens-based cameras under the screen suffer from low-light transmission, diffraction effects, and increased device thickness.
Innovation Solution
A lensless camera system with an image sensor and mask positioned behind the display screen, utilizing a machine learning model to reconstruct images based on light passing through the display and mask, allowing for a high-quality image capture without reducing the screen size.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a front-facing camera is installed on the front side of the device, then video communication functionality is provided, but the screen-to-body ratio is reduced due to bezel or notch requirements
Solution Approach 1:
The camera system is nested within the display structure by positioning the image sensor and mask behind the display screen, allowing the camera to be integrated into the existing device footprint without requiring additional front-facing space
Solution Approach 2:
The camera is moved from the traditional front-facing plane to a rearward position behind the display, utilizing the depth dimension of the device to resolve the spatial conflict between camera placement and screen area
2Area of stationary object
If a front-facing camera is positioned away from the area of focus, then screen space is maximized, but eye contact during video communication is hindered
Solution Approach 1:
By positioning the camera behind the display screen rather than at the edges or corners, the camera optically aligns with the center of the screen area, maintaining eye contact quality while preserving maximum screen space
3Ease of operation
If a lens-based camera is placed under the screen, then video communication with eye contact is improved, but light transmission quality deteriorates due to low-light and diffraction effects
Solution Approach 1:
The lens component is extracted from the camera system and replaced with a simple mask pattern, eliminating the optical elements that cause diffraction and light transmission issues while maintaining the ability to capture images through the display
Solution Approach 2:
The traditional lens-based optical system is replaced with a computational imaging approach using a mask and machine learning model, substituting physical optics with computational processing to achieve superior image quality
4Adaptability or versatility
If a lens-based camera is placed under the screen, then front-facing functionality is achieved, but device thickness increases due to required distance between lens and sensor
Solution Approach 1:
The lens is extracted from the camera system and replaced with a thin mask pattern, eliminating the need for substantial distance between the display and sensor, thereby reducing device thickness
Solution Approach 2:
The lens-based optical system requiring significant depth is replaced with a planar mask and computational imaging approach, allowing the camera to function with minimal distance from the display screen
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system enables an increased screen-to-body ratio and improved video communication by maintaining eye contact, while minimizing device thickness and image quality issues.
Implementation Method 1
the image sensor captures an image based on the light that travels through the display layer and the mask
Implementation Method 2
a mask that are positioned behind a display layer of a device. The image sensor captures an image based on the light that travels through the display layer and the mask
Data Source
AI summary
Systems and methods are described for enabling a lensless camera having an image sensor and a mask to be positioned behind a display screen of a device, which allows for the device to have an increased screen-to-body ratio. The image sensor captures an image based on the light that travels through the display screen and the mask. The display screen may include portions between pixel elements that allow light to pass through. The mask may include a pattern, such as an opaque material with portions that allow light to pass through from the portions of the display layer to the image sensor. The image captured by the image sensor may be indiscernible to humans. The system may utilize a trained machine learning model to reconstruct the image, using data about the pattern of the mask, so humans may visually recognize features in the image.