Virtual and Augmented Reality Rendering with Dynamic Exposure
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual and augmented reality systems struggle to accurately represent photometrically diverse scenes on displays with limited dynamic ranges, leading to unnatural representations due to the loss of relative exposure information.
Innovation Solution
A method is developed to simulate photometrically diverse virtual and augmented reality scenes by determining device orientation, calculating a 3D projection, computing ray directions, and adjusting virtual photometric parameters based on user visual states and intrinsic photographic inputs, using techniques such as image lookup and optimization to enhance image detail and immersion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a static function is used to remap photometric parameters to a narrower dynamic range, then the display can be adapted to the limited photometric range, but relative exposure information is lost and the result looks unnatural
Solution Approach 1:
The patent applies dynamics by transitioning from a static remapping function to a dynamic adaptive process. The system continuously adjusts photometric parameter mapping based on the user's visual state (detected via eye tracking and other sensors) and the specific scene content being viewed. This dynamic adaptation allows the display to preserve exposure information while adapting to the limited photometric range of the display device.
Solution Approach 2:
The patent changes multiple photometric parameters simultaneously (exposure, gamma, white point, chromatic adaptation) rather than using a simple static remap. By adjusting these parameters dynamically based on scene characteristics and user visual state, the system maintains natural appearance and preserves relative exposure information while adapting to the display's limited range.
2Reliability
If the diverse range of photometric content in VAR scenes is represented, then the scene realism is improved, but the display cannot represent all parameters simultaneously due to limited photometric range
Solution Approach 1:
The patent segments the wide photometric range of the VAR scene into multiple discrete exposure levels or brackets. Instead of attempting to display the entire dynamic range simultaneously, the system divides the scene into segments corresponding to different exposure levels and selectively displays appropriate segments based on the user's visual state and the current view direction, thereby maintaining scene realism within display limitations.
Solution Approach 2:
The patent adds the time dimension to the photometric representation by dynamically switching between different exposure levels as the user moves their eyes through the scene. This temporal dimension allows the display to represent photometric content that exceeds its instantaneous photometric range, as different parts of the full dynamic range are displayed at different times based on user viewing behavior.
3Measurement precision
If eye tracking and visual state detection are implemented, then natural perception simulation is improved, but device complexity and computational requirements increase
Solution Approach 1:
The patent implements self-service by using the display device's own sensors (camera, accelerometer, gyroscope) to detect the user's visual state and eye movements. Rather than requiring external specialized tracking equipment, the system leverages existing device capabilities to gather visual state information, thereby reducing overall system complexity while maintaining measurement precision.
Solution Approach 2:
The patent makes existing device components multi-functional by using the camera and motion sensors not only for their primary functions (photographing, navigation) but also for eye tracking and visual state detection. This universal use of components reduces device complexity by eliminating the need for separate specialized sensors while achieving precise visual state measurement.
Data Source
AI summary
A preferred method for dynamically displaying virtual and augmented reality scenes can include determining input parameters, calculating virtual photometric parameters, and rendering a VAR scene with a set of simulated photometric parameters.