MR Display Rendering Based on User Pose and Gaze Focus
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
MR devices waste computing resources by equally rendering all regions of an MR image, despite users often focusing on specific parts, leading to inefficient resource utilization.
Innovation Solution
An electronic device dynamically adjusts computing resources by enhancing the visual effect of either the real-scene or virtual-scene image based on user pose information, such as gaze point, head rotation, and movement, to save resources and meet user preferences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If identical computing resources are used to render all regions in an MR image, then the rendering quality is uniformly maintained, but computing resources are wasted in regions that users ignore
Solution Approach 1:
The patent applies local quality by differentiating rendering strategies for different regions of the MR image. Regions where users focus their attention receive high-quality rendering with full computing resources, while peripheral or ignored regions use reduced rendering quality with fewer computing resources. This is achieved by detecting user gaze points and dynamically adjusting rendering parameters for different spatial zones, thereby maintaining visual quality where needed while reducing overall computational load.
Solution Approach 2:
The patent implements dynamics by making rendering resource allocation adaptive and time-varying based on real-time user behavior. The system continuously monitors user gaze, head movement, and attention patterns, then dynamically adjusts the computing resources allocated to different regions of the MR image. This dynamic adaptation allows the system to optimize rendering quality and resource consumption in real-time, switching between high and low rendering modes based on actual user needs rather than using a static uniform approach.
2Reliability
If high computing resources are allocated to all regions, then the visual experience is consistently high quality, but the system efficiency decreases
Solution Approach 1:
The patent applies local quality by differentiating rendering strategies for different regions of the MR image. Regions where users focus their attention receive high-quality rendering with full computing resources, while peripheral or ignored regions use reduced rendering quality with fewer computing resources. This is achieved by detecting user gaze points and dynamically adjusting rendering parameters for different spatial zones, thereby maintaining visual quality where needed while reducing overall computational load.
Solution Approach 2:
The patent applies partial action by providing high rendering quality only to the extent necessary for user experience. Instead of uniformly applying high computing resources to the entire MR image, the system identifies and prioritizes only the specific regions where users actually look and interact. This partial rendering approach maintains acceptable visual experience quality in critical areas while significantly reducing total computing resource consumption, thereby improving system efficiency without compromising essential user experience.
3Device complexity
If the system renders all regions with equal quality, then resource allocation is simple, but it fails to meet user differentiation requirements
Solution Approach 1:
The patent applies feedback by implementing a closed-loop system that continuously monitors user behavior (gaze direction, head movement, attention patterns) and uses this information to adjust rendering resource allocation. The system detects user focus points and feeds this information back to the rendering engine, which then dynamically modifies rendering parameters for different regions. This feedback mechanism enables the system to adapt to user preferences in real-time, providing differentiated rendering quality that matches actual user needs while maintaining relatively simple resource management through automated control.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
This application provides a display method and an electronic device, relating to the field of terminal technologies. After displaying a first view including a real-scene image and a virtual-scene image, the electronic device may obtain pose information of a user, and display a second view based on the pose information of the user. The second view is obtained based on an adjustment to the first view. Image quality of the virtual-scene image in the first view is better than image quality of a virtual-scene image in the second view, or image quality of the real-scene image in the first view is better than image quality of a real-scene image in the second view. The electronic device can reduce computing resources allocated to the real-scene image or the virtual-scene image included in the first view by lowering the image quality of the real-scene image or the virtual-scene image in the first view, to save computing resources of the electronic device.