Multifocal 3D Display Image Blending to Eliminate Focal Plane Gaps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multifocal Display (MFD) devices experience gaps and stripes due to parallax artifacts at the transition between focal planes, affecting the viewing experience in Near Eye Display (NED) and Head Mounted Display (HMD) applications.
Innovation Solution
An image processing device that generates enhanced partial images by blurring and blending initial images to conceal black stripes between focal planes, using a blurring filter or crossfading based on estimated maximum displacement between focal planes, reducing perceived artifacts and eliminating gaps and stripes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a focus tunable lens is used to rapidly switch between focal planes in an MFD device, then the ability to create a multifocal 3D display is improved, but gaps and black stripes appear between focal layers when the observer's eyes are not centered in the eye-box
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing multiple cropped versions of each focal plane image corresponding to different eye positions within the eye-box. Before the observer actually moves their eyes, the system has already prepared the appropriate image variations needed to compensate for the upcoming lateral displacement, thereby preventing gaps and black stripes from appearing.
Solution Approach 2:
The patent implements dynamics by dynamically selecting and switching between different cropped versions of focal plane images based on the detected or estimated position of the observer's eyes within the eye-box. This dynamic adaptation allows the display to continuously adjust the displayed image content to match the observer's current viewing position, eliminating the static limitation that causes gaps and black stripes.
2Ease of operation
If the observer's eyes move laterally away from the center of the eye-box, then viewing freedom is improved, but parallax artifacts cause gaps and stripes to become visible between focal planes
Solution Approach 1:
The system pre-calculates and stores multiple cropped versions of each focal plane image corresponding to different eye positions within the eye-box. Before the observer actually moves their eyes, the appropriate image variations are already prepared to compensate for lateral displacement, preventing parallax artifacts from appearing.
Solution Approach 2:
The patent employs feedback by detecting the observer's eye position within the eye-box and using this information to select the appropriate cropped version of each focal plane image for display. This closed-loop approach continuously adjusts the displayed content based on actual viewing conditions, eliminating parallax artifacts caused by lateral eye movement.
3Adaptability or versatility
If a focus tunable lens is used to modulate focal length, then the multifocal display function is improved, but the complexity of the device increases due to the need for high-speed focal modulation
Solution Approach 1:
The patent applies segmentation by dividing each focal plane image into multiple cropped versions corresponding to different eye positions within the eye-box. Instead of using a single complex high-speed focal modulation system, the display is segmented into multiple static image variations that can be switched electronically, reducing mechanical complexity while maintaining multifocal functionality.
Solution Approach 2:
The patent uses copying by creating multiple cropped copies of each focal plane image for different eye positions. These copied and cropped image versions are stored in memory and switched electronically based on eye position detection, replacing the need for complex high-speed focal modulation hardware and simplifying the overall device architecture.
Data Source
AI summary
The present disclosure provides a an image processing device for providing a plurality of enhanced partial images which together represent an enhanced three-dimensional, 3D, image, wherein each enhanced partial image is a two-dimensional, 2D, image associated with one of a plurality of focal planes. The image processing device includes processing circuitry configured to receive or generate a plurality of initial partial images, which together form an initial 3D image, wherein each initial partial image is a 2D image associated with one of the plurality of focal planes; and to generate, from each of the initial partial images, an enhanced partial image by generating a blurred version of the initial partial image; and blending the initial partial image with the blurred version of the initial partial image.