Dynamic Rendering Frequency Control for Virtual Image Flicker Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Prior art in VR and AR technologies fails to adequately consider sensing results from real spaces, leading to suboptimal rendering and display quality of virtual images, often resulting in flicker due to inaccuracies in position and attitude estimation and changes in sensor outputs.
Innovation Solution
An information processing apparatus and method that control rendering frequencies by implementing 2D correction and 3D rendering based on sensing data, using a 2D correction threshold to reduce flicker, particularly by adjusting rendering frequencies and frame rates according to the distance between the user and the virtual image, sensor accuracy, and environmental factors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If rendering frequency is increased to improve virtual image quality, then display quality improves, but power consumption and processing load increase
Solution Approach 1:
The patent dynamically adjusts rendering frequency based on user movement state. When the user is stationary or moving slowly, rendering frequency is reduced to save power. When the user moves quickly or changes direction, rendering frequency is increased to maintain image quality and reduce flicker. This dynamic adaptation resolves the contradiction between maintaining high rendering quality and reducing power consumption.
Solution Approach 2:
The system changes the rendering frequency parameter according to sensed user movement parameters. By monitoring acceleration, velocity, and direction changes, the system adjusts the rendering frequency parameter in real-time to match user activity levels, thereby optimizing the balance between display quality and power consumption.
2Use of energy by moving object
If rendering frequency is decreased to reduce power consumption, then power consumption decreases, but flicker increases due to position and attitude estimation inaccuracies
Solution Approach 1:
The system uses sensor feedback from accelerometers, gyroscopes, and other motion sensors to continuously monitor user movement. This feedback loop allows the system to detect when movement exceeds thresholds that would cause noticeable flicker, and automatically increases rendering frequency to compensate. This feedback mechanism maintains image stability while allowing rendering frequency to be reduced during stable periods.
Solution Approach 2:
The system performs preliminary sensing of user movement before rendering adjustments are made. By detecting movement patterns in advance and predicting when flicker might occur, the system can proactively adjust rendering frequency to prevent flicker rather than reacting after it occurs, thereby maintaining reliability while managing power consumption.
3Reliability
If 2D correction threshold is lowered to reduce flicker, then image stability improves, but processing complexity increases
Solution Approach 1:
The patent segments the correction process into two distinct stages: 2D correction for handling position adjustments and 3D rendering for handling attitude and perspective changes. By separating these correction types and applying different thresholds and processing methods to each, the system reduces overall processing complexity while maintaining image stability. The 2D correction threshold can be optimized independently from 3D rendering parameters.
4Use of energy by moving object
If frame rate is adjusted dynamically to optimize power consumption, then power efficiency improves, but rendering quality may deteriorate
Solution Approach 1:
The system dynamically adjusts frame rate based on real-time sensing of user movement characteristics. During periods of minimal movement, frame rate is reduced to improve power efficiency. When movement exceeds thresholds indicating potential flicker or quality degradation, frame rate is increased to maintain rendering quality. This dynamic adjustment resolves the contradiction between power efficiency and rendering quality.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
To improve the quality of rendering or display of a virtual image based on a sensing result relating to a real space. Provided is an information processing apparatus including a rendering control unit configured to switch a rendering frequency of a virtual image between a first rendering frequency and a second rendering frequency higher than the first rendering frequency on the basis of a sensing result relating to a real space, and a display control unit configured to cause a display device to display the virtual image on the basis of the sensing result and either the first rendering frequency or the second rendering frequency.