Remote Rendering for Head-Worn Displays With Pose-Time Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR, MR, and AR wearable devices face challenges in providing user-friendly interfaces with limited power and difficulty in rendering accurate graphics due to limited render time matching presentation time, especially when the user's view changes rapidly.
Innovation Solution
Implementing a system that continuously determines the user's pose and location to adjust and send graphical images to a remote rendering module, selecting rendered graphics closest to the presentation time, and using a faster wireless link for timely display on the head-wearable apparatus.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the wearable device performs local rendering to provide user-friendly interfaces and run graphics applications, then the device functionality and user experience are improved, but the battery power is depleted faster due to limited processing power and energy constraints
Solution Approach 1:
The patent extracts the rendering workload from the wearable device and relocates it to a remote server. The wearable device retains only the essential functions of pose tracking, application execution, and display output, while the computationally intensive graphics rendering is performed remotely and the rendered frames are transmitted back to the wearable device for display.
Solution Approach 2:
The patent introduces a remote server as an intermediary between the wearable device and the graphics rendering process. The server acts as a mediation point that receives rendering requests from the wearable device, performs the computationally intensive rendering operations, and returns the rendered frames to the wearable device, thereby offloading the energy-consuming rendering tasks from the wearable device's limited processor.
2Use of energy by moving object
If the wearable device uses a slower wireless link for rendering, then power consumption is reduced, but the render time cannot match the presentation time when the user's view changes rapidly
Solution Approach 1:
The patent implements preliminary action by continuously rendering frames in advance and maintaining a buffer of pre-rendered frames on the remote server. When the wearable device requests rendering, the server can immediately provide pre-computed frames or quickly generate new ones from cached data, significantly reducing the latency between user view changes and frame delivery without requiring high-power continuous transmission.
3Ease of operation
If the wearable device has more interface controls and additional functions, then user-friendliness is improved, but the limited processing power and battery life are exceeded
Solution Approach 1:
The patent extracts the computationally intensive rendering function from the wearable device's limited processor and relocates it to a remote server with abundant processing power. This allows the wearable device to allocate its limited processing resources to interface control and user interaction functions, thereby improving ease of operation without exceeding power constraints.
Data Source
AI summary
Systems, methods, and computer readable media for continuous rendering are disclosed. Example methods include a head-wearable apparatus that is configured to continuously determine a position or pose of a user and then request graphics to be rendered from a remote rendering module based on the position or pose. If a current time is within a threshold of a presentation time, then the head-wearable apparatus selects rendered graphics received from the remote rendering module that are associated with a position or pose of the user that is closest in time to the presentation time. The selected rendered graphics are then adjusted to account for a difference between the render time and the presentation time. The adjusted rendered graphics are then presented to the user on a display of the head-wearable apparatus.