Light-Field Display Using Virtual Cameras for Accurate Depth Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D display technologies, including those for augmented reality, struggle to accurately replicate natural depth perception when overlaying virtual objects onto real-world environments, leading to a less immersive user experience.
Innovation Solution
An electronic device equipped with a display, camera, and controller that converts augmented reality image data into multi-view images, which are then composed with real images to generate multi-view composition images, allowing for accurate depth perception and natural integration of virtual objects into the real world through a light-field display using a micro-lens array and virtual cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional 3D display technology is used to overlay virtual objects onto real-world environments, then the display functionality is achieved, but the depth perception accuracy deteriorates
Solution Approach 1:
The patent segments the display into multiple virtual cameras arranged in a grid pattern, with each virtual camera capturing a specific viewpoint. This segmentation allows the system to render multiple views of virtual objects from different angles, which are then combined to create accurate depth perception and parallax effects that match the real-world environment.
Solution Approach 2:
The patent transitions from conventional 2D display to light-field display by adding angular dimension information. The light-field display technology renders images with both spatial and angular information, enabling viewers to perceive depth and parallax effects as if viewing the actual 3D scene, thereby resolving the depth perception accuracy issue.
2Measurement precision
If multi-view image generation is implemented to improve depth perception, then the rendering quality improves, but the processing complexity increases
Solution Approach 1:
The patent pre-calculates and stores rendering parameters for multiple virtual cameras in advance, including viewpoint positions, projection matrices, and occlusion information. This preliminary action allows the system to quickly retrieve and composite pre-rendered views during real-time operation, significantly reducing processing complexity while maintaining high rendering quality.
Solution Approach 2:
The patent uses virtual cameras to generate multiple copied views of the same scene from different viewpoints. Instead of rendering each view independently in real-time, the system creates copies of the base scene with adjusted projection parameters, which are then composited together. This copying approach maintains rendering quality while reducing computational complexity.
3Reliability
If light-field display technology is used to achieve natural depth perception, then the user immersion improves, but the device complexity increases
Solution Approach 1:
The patent implements a multi-functional display system that can operate in both conventional 2D mode and light-field 3D mode. The same display hardware and processing pipeline support multiple rendering modes, allowing the system to provide natural depth perception when needed while maintaining compatibility with standard applications. This universality reduces overall device complexity by avoiding dedicated hardware for specialized functions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables the display of augmented reality images with natural depth perception, enhancing user immersion by accurately overlaying virtual objects onto real-world environments, thereby improving the overall user experience.
Implementation Method 1
a micro-lens array on the display panel and including a plurality of micro-lenses
Data Source
AI summary
An electronic device includes a display configured to display a three-dimensional image, a camera configured to photograph a real image, and a controller configured to generate an image signal based on the real image and augmented reality (AR) image data and to provide the image signal to the display, the controller including a multi-view image generator configured to convert the AR image data into multi-view AR images, a graphics processor configured to compose each of the multi-view AR images with the real image to generate multi-view composition images, and a processor configured to control a multi-view virtual camera and the graphics processor, to convert the multi-view composition images into the image signal, and to provide the image signal to the display.