Display Panel Depth Sensing via Rear Image Sensors and Liquid Crystal Lenses
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display devices face challenges in integrating depth cameras due to the large size of image sensors, which limits miniaturization and integration with display screens, and also struggles with accurate spatial positioning and interactive occlusion in 3D display applications.
Innovation Solution
The display device incorporates a plurality of small-sized image sensors arranged on the back of the display panel, coupled with liquid crystal lenses that allow light to be transmitted to the image sensors, enabling the acquisition of entire depth image information and overcoming the limitations of large image sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a depth camera with a large image sensor is used to obtain depth information, then the measurement precision is improved, but the device size increases and integration with display screens becomes difficult
Solution Approach 1:
The patent divides the single large image sensor into multiple small image sensors arranged in an array on the back of the display panel. Each small image sensor captures depth information from a specific spatial region, and the combined data forms the complete depth image. This segmentation enables miniaturization while maintaining measurement precision through the collective capability of multiple sensors.
Solution Approach 2:
The patent positions image sensors on the back side of the display panel, utilizing the third dimension (depth/thickness) to accommodate the sensor array without increasing the front-facing footprint. This dimensional rearrangement allows the depth camera functionality to be integrated within the display structure, solving the conflict between sensor size and display integration.
2Volume of moving object
If multiple small image sensors are used to reduce size, then the device is more suitable for integration with display screens, but the complexity of the system increases
Solution Approach 1:
The patent merges the display panel and depth camera into a single integrated device. The display panel serves dual purposes: as the display output and as the mounting substrate for the image sensor array. The liquid crystal lenses are integrated with the display pixel structure, allowing the same physical space to serve both display and depth capture functions, thereby reducing overall system complexity despite using multiple sensors.
Solution Approach 2:
The display panel is designed to perform multiple functions simultaneously: visual display and depth image capture. The liquid crystal lenses serve both as display modulation elements and as focusing elements for the image sensors. This multi-functionality eliminates the need for separate dedicated depth camera components, reducing integration complexity.
3Volume of moving object
If image sensors are arranged on the back of the display panel, then integration with display screens is improved, but accurate spatial positioning and handling of interactive occlusion become more difficult
Solution Approach 1:
The patent replaces traditional mechanical lens assemblies with liquid crystal lenses that utilize electro-optic effects. The liquid crystal lenses can dynamically adjust their focal length and optical properties through voltage control, enabling precise control over light paths from multiple angles. This substitution allows accurate spatial positioning and occlusion handling without complex mechanical adjustment mechanisms.
Solution Approach 2:
The liquid crystal lenses provide dynamic optical adjustment capability, allowing the system to adapt to different spatial positions and occlusion scenarios in real-time. By changing the voltage applied to the liquid crystal lenses, the system can dynamically refocus and adjust the optical path to accurately capture depth information even when objects are partially occluded or at varying distances, maintaining measurement precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution allows for the accurate acquisition of depth image information, reduces the issue of interactive occlusion, and enables the integration of depth cameras with display screens, enhancing the capabilities of display devices in 3D applications.
Implementation Method 1
a liquid crystal panel, wherein the liquid crystal panel comprises the plurality of liquid crystal lenses and is stacked with the display panel, the liquid crystal panel is on the back side of the display panel
Implementation Method 2
the plurality of liquid crystal lenses are configured to allow light from outside the display side of the display panel to be transmitted to the plurality of image sensors after passing through the plurality of liquid crystal lenses, respectively
Implementation Method 3
the display device further comprises at least one detection light source arranged in the non-display region of the display panel, and the detection light source is configured to emit detection light to the display side of the display panel
Implementation Method 4
the plurality of image sensors are configured to obtain entire depth image information of a target to be detected on the display side of the display panel
Implementation Method 5
the plurality of image sensors are configured to obtain entire depth image information of a target to be detected
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
A display device, an electronic device, and a method for driving a display device are provided. The display device (10) includes a display panel (100) and a plurality of image sensors (120). The display panel (100) has a display side and a back side opposite to the display side, the plurality of image sensors (120) are independent at a plurality of independent positions on the back side of the display panel (100), and the plurality of image sensors (120) are configured to integrally obtain depth image information of a target to be detected on the display side of the display panel (100).