3D HUD Image Correction Using Gaze-Based Dewarping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D head-up displays (HUDs) face issues with image warping and unequal brightness perception due to the design of cylindrical lens arrays, leading to vertigo and large overall volume.
Innovation Solution
An image correction method that dewarps and corrects brightness of left and right eye images based on gazing positions using an eye tracking camera and polynomial equations, followed by 3D rendering to create stereoscopic images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of stationary object
If a cylindrical lens array is used in a 3D HUD to reduce overall volume, then the volume of the projection lens base is reduced, but image warping and brightness imbalance occur causing vertigo
Solution Approach 1:
The system performs preliminary dewarping correction on the left and right eye images before they are displayed through the cylindrical lens array. By pre-processing the images to compensate for expected warping effects, the system maintains image accuracy while using the compact cylindrical lens design.
Solution Approach 2:
The system dynamically adjusts image parameters (coordinates and brightness) based on real-time gazing position detection. By changing the display parameters of the left and right eye images according to detected eye positions, the system compensates for brightness imbalances and warping caused by the cylindrical lens array.
2Volume of stationary object
If the distance between stereoscopic images is adjusted to scale magnifications in a 3D HUD, then the overall volume is reduced, but image warping occurs
Solution Approach 1:
The system applies preliminary dewarping transformations to the stereoscopic images before they are displayed at reduced distances. This pre-correction ensures that when the images are projected through the compact HUD system, the warping effects are compensated, maintaining shape accuracy despite the reduced display distance.
Solution Approach 2:
The system uses an eye tracking camera to detect gazing positions and provides feedback to the computing unit, which then adjusts the dewarping parameters in real-time. This closed-loop feedback mechanism ensures that image shape accuracy is maintained even when display distance and magnification are adjusted.
3Adaptability or versatility
If a 3D HUD is designed with separate left and right eye images, then magnification scaling is achieved, but brightness perception differs between eyes causing vertigo
Solution Approach 1:
The system applies different brightness correction parameters to the left and right eye images based on their respective gazing positions. By tailoring the brightness adjustment locally for each eye's image according to its specific viewing angle and position, the system achieves uniform brightness perception across both eyes.
Solution Approach 2:
The system dynamically changes the brightness parameters of the left and right eye images based on real-time gazing position detection. By adjusting these parameters individually for each eye, the system compensates for the brightness imbalances that would otherwise cause vertigo.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The method effectively reduces image warping and brightness imbalances, providing a more comfortable viewing experience by ensuring synchronized brightness and depth perception.
Implementation Method 1
The display module has a cylindrical lens array configured to separate the stereoscopic left eye image from the stereoscopic right eye image
Data Source
AI summary
An image correction method include providing a left eye image and a right eye image; providing a left eye gazing position and a right eye gazing position; dewarping the left eye image according to the left eye gazing position and dewarping the right eye image according to the right eye gazing position to acquire a dewarped left eye image and a dewarped right eye image; correcting a brightness of the dewarped left eye image according to the left eye gazing position and correcting a brightness of the dewarped right eye image according to the right eye gazing position; and 3D rendering the dewarped left eye image and the dewarped right eye image to acquire a stereoscopic left eye image and a stereoscopic right eye image.