Multispectral LCD Backlight for 3D Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current three-dimensional imaging technologies face challenges such as low accuracy, complex systems, high costs, and errors in 3D reconstruction due to lack of texture and features in objects.
Innovation Solution
A display device with an LCD screen featuring a backlight source divided into zones with visible and infrared light sources, where each zone has different infrared bands and directions. This setup is accompanied by a combination of cameras, including color and multispectral infrared cameras, which perform image acquisition and calculate normal vectors using photometric stereo or shadow recovery algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If TOF vision method is used for three-dimensional information acquisition, then the system is simple and cost-effective, but the measurement accuracy is low
Solution Approach 1:
The patent combines multiple imaging modalities (visible light imaging, infrared imaging, and depth imaging) into a unified multi-spectral imaging system. This integration allows the system to leverage the advantages of each modality while overcoming their individual limitations, achieving both high accuracy and reasonable system complexity
Solution Approach 2:
The patent uses composite optical sensing that captures multiple spectral bands (visible and infrared) simultaneously. This composite approach is analogous to using composite materials, where different spectral information channels are combined to create a more accurate and robust three-dimensional representation of the object
2Measurement precision
If structured light vision method is used for three-dimensional information acquisition, then the measurement accuracy is high, but the system becomes complex and costly
Solution Approach 1:
The patent extracts and utilizes the natural spectral characteristics of objects across different wavelength bands (visible and infrared) rather than introducing complex external structured light patterns. This extraction approach achieves high measurement accuracy by leveraging inherent object properties rather than adding system complexity
Solution Approach 2:
The patent replaces mechanical structured light projection systems with a multi-spectral optical sensing approach. Instead of using complex mechanical devices to project patterns and capture reflections, the system uses multiple spectral cameras to capture natural light reflections, significantly reducing system complexity while maintaining high measurement precision
3Device complexity
If binocular vision method is used for three-dimensional information acquisition, then the system is relatively simple, but errors occur in places lacking texture and features
Solution Approach 1:
The patent adds spectral dimensionality to the traditional spatial stereo vision approach. By incorporating multiple spectral bands (visible and infrared), the system creates additional information dimensions that provide unique depth cues and surface characteristics, enabling reliable three-dimensional reconstruction even in textureless regions where traditional binocular vision fails
Solution Approach 2:
The patent utilizes spectral variations (analogous to color changes) across different wavelength bands to encode three-dimensional information. The infrared and visible light reflections provide different spectral signatures that reveal surface properties and depth information, allowing the system to reconstruct three-dimensional geometry reliably without relying solely on texture features
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables accurate three-dimensional reconstruction of objects by utilizing the multispectral imaging capabilities and photometric stereo methods, overcoming the limitations of existing technologies in terms of accuracy and cost.
Implementation Method 1
At least one zone is provided with infrared light sources
Implementation Method 2
Each zone is provided with visible light sources
Implementation Method 3
the acquired image includes at least one frame of color image acquired by each camera
Implementation Method 4
calculating the normal vector using a photometric stereo algorithm based on the extracted image channel information
Implementation Method 5
calculating the normal vector using a shadow recovery algorithm based on the extracted image channel information
Data Source
AI summary
The present disclosure relates to a display device, an image processing method and device, an electronic device, and a storage medium. The method includes: identifying a viewpoint area on a LCD screen of a user, where a backlight source of the LCD screen is arranged with infrared light sources in at least one zone; calling a combination of cameras corresponding to the viewpoint area to acquire images, where the combination of camera includes a color camera and/or a multispectral infrared camera, and the acquired images include at least one frame of color image acquired by each camera; calling a respective method according to the number of directions of the infrared light sources to reconstruct a normal vector, so as to perform a three-dimensional reconstruction of an object according to the normal vector. This solution can achieve a high-precision three-dimensional reconstruction of an object.