Extended Reality Rendering Optimization During Eye Blinking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended reality (XR) applications, particularly in split-rendering scenarios, the frequent eye blinking of users results in the waste of computing resources due to the continuous rendering and transmission of video frames that are not visible during blinking, leading to inefficiencies in energy consumption and resource utilization.
Innovation Solution
A method and apparatus that utilize eye-blinking parameters to apply rendering optimization operations, such as skipping frame rendering, reducing quality, or adjusting encoding and transmission, during the eye-blinking period to conserve resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If continuous rendering and transmission of video frames is performed during eye blinking, then visual quality and frame rate are maintained, but computing resources and energy consumption are wasted
Solution Approach 1:
The system implements periodic rendering by detecting eye-blinking events and adjusting the rendering frame rate accordingly. During eye-blinking periods, the rendering frequency is reduced or paused, while maintaining the original frame rate during normal viewing. This periodic adjustment of rendering activity based on user state resolves the contradiction by maintaining visual quality when needed while conserving energy during periods when the user cannot perceive the display.
Solution Approach 2:
The system uses eye-tracking technology to detect eye-blinking status and provides feedback to the rendering system. This feedback loop allows the system to dynamically adjust rendering parameters based on real-time detection of user eye state, enabling intelligent resource allocation that maintains visual quality while avoiding unnecessary rendering during blinks.
2Speed
If video frames are rendered at high frame rate during eye blinking, then frame rate is maintained, but computing resources are wasted
Solution Approach 1:
The system dynamically adjusts the rendering frame rate based on detected eye-blinking events. Instead of maintaining a fixed high frame rate, the system varies the rendering speed according to user state, reducing or pausing rendering during eye blinks while maintaining original frame rates during normal viewing. This dynamic adjustment resolves the contradiction by optimizing resource efficiency without permanently compromising frame rate capability.
3Use of energy by stationary object
If rendering optimization operations are applied during eye blinking, then energy consumption is reduced, but system complexity increases
Solution Approach 1:
The system uses the viewing apparatus's own eye-tracking capabilities to detect eye-blinking events and automatically triggers rendering optimization operations. The system serves itself by utilizing existing sensor data and processing capabilities to identify when optimization is needed, reducing energy consumption without requiring external control systems or complex additional hardware.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method, comprising: receiving parameters from a viewing apparatus for rendering one or more two-dimensional (2D) viewports from three-dimensional (3D) media content; receiving, in or along said parameters, one or more eye-blinking parameters from the viewing apparatus, wherein said one or more eye-blinking parameters of the viewing apparatus comprise at least one parameter indicating an eye-blinking status of an eye of a user of the viewing apparatus; determining, in response to said at least one parameter indicating the eye-blinking status having a value referring to a detected eye-blinking, at least one rendering optimization operation to be applied to the media content during the eye-blinking; and delivering the media content corresponding to said one or more 2D viewports to the viewing apparatus as rendered by said at least one rendering optimization operation and/or along an indication to the viewing apparatus to perform said at least one rendering optimization operation.