Structured Light Depth Camera Behind Display Screen
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile devices with integrated depth cameras face challenges in accurately calculating depth images due to differences in image sensor placement and data reading methods, leading to incorrect depth calculations.
Innovation Solution
A structured light assembly is integrated into the mobile device, comprising a structured light projector and camera, which emits and receives structured light to acquire depth information, allowing for accurate depth image calculation without the need for openings in the display screen, thereby maintaining a high screen-to-body ratio.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a depth camera is integrated into the mobile device with the image sensor placed behind the display screen, then the screen-to-body ratio is improved, but the depth image calculation accuracy deteriorates due to differences in image sensor placement and data reading methods
Solution Approach 1:
Instead of rotating the captured speckle image to match the reference image, the patent inverts the approach by rotating the reference image to match the speckle image orientation. This inversion resolves the coordinate system mismatch caused by the image sensor being placed behind the display screen, enabling accurate depth calculation while maintaining the high screen-to-body ratio design
Solution Approach 2:
The patent changes the parameter of image orientation by rotating the reference image based on the display screen's pixel arrangement (e.g., 90 degrees for vertical arrangement, 180 degrees for horizontal arrangement). This parameter adjustment aligns the reference image with the speckle image coordinate system, resolving the accuracy issue while preserving the integrated camera design
2Reliability
If an opening is formed on the display screen for the depth camera, then the depth camera can be properly positioned, but the screen-to-body ratio deteriorates
Solution Approach 1:
The patent moves the depth camera from the front display area to the back of the display screen, utilizing the z-dimension (depth) rather than compromising the x-y plane of the display. This dimensional transition allows the camera to be properly positioned for depth sensing while maintaining an uninterrupted display surface and high screen-to-body ratio
Solution Approach 2:
The depth camera is nested within the display screen structure, with the image sensor positioned behind the display panels. This nesting approach integrates the depth camera into the existing device architecture without requiring separate openings or additional space, simultaneously achieving proper camera positioning and maximizing the screen-to-body ratio
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables accurate depth image acquisition and calculation, improving the functionality of mobile devices by eliminating the need for screen openings and enhancing the screen-to-body ratio while maintaining precise depth measurement capabilities.
Implementation Method 1
The structured light projector is arranged under the display screen, and the structured light is configured to pass through the display area; the structured light camera is aligned with a through slot of the display screen, and the structured light camera is configured to receive the modulated structured light
Data Source
Figure 1
Figure 2~4
Figure 5~7
AI summary
An image acquisition method, an image acquisition apparatus (400), a structured light assembly (20), and an electronic apparatus (1000). The image acquisition method comprises: controlling a structured light camera (22) to receive structured light diffracted by a display area (1) of a display screen (10) and reflected by a target object during light emitting and then diffracted by the display area (11) again during light incidence to obtain a speckle image; filtering out a second measurement spot and a third measurement spot to obtain a first measurement spot; and obtaining a depth image according to the first measurement spot and a reference spot in a reference image.