Mask-Layer Scene Rendering for Low-Power XR Object Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
XR systems face power and bandwidth challenges due to high computational demands for tracking six degrees of freedom, leading to non-portable or uncomfortably heavy devices with short battery life.
Innovation Solution
Implementing a system that generates and transmits mask layers and images to a display, adjusting images based on independent object movement using pose information to reduce power and bandwidth requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If powerful processors are used to perform feature analysis and complex functions quickly, then image quality and processing speed are improved, but power consumption increases
Solution Approach 1:
The patent segments the image processing task by separating static scene rendering from dynamic object processing. Mask layers identify and isolate moving objects, allowing the system to process only relevant portions of the image at high resolution while maintaining lower processing requirements for static areas, thereby reducing overall power consumption while preserving image quality.
Solution Approach 2:
The system applies full processing power selectively only to regions containing moving objects rather than processing the entire image at maximum quality. This partial action approach maintains image quality where needed while significantly reducing computational load and power consumption in static regions.
2Productivity
If large quantities of data are sent to a powerful processor, then processing capability is improved, but bandwidth requirements increase
Solution Approach 1:
The patent extracts moving object information from the full image and transmits only this extracted data along with mask layers to the processor. This selective data transmission reduces the overall data volume while maintaining processing capability, as the processor receives precisely the information needed rather than complete image data.
Solution Approach 2:
Data transmission is segmented into mask layers identifying moving objects and corresponding image data only for those regions. This segmentation reduces total data transmission volume while ensuring the processor receives sufficient information to maintain high processing capability for dynamic content.
3Use of energy by moving object
If batteries are made large to provide sufficient power, then power supply capacity is improved, but device weight increases making it uncomfortable for users
Solution Approach 1:
The system uses partial processing action only where needed (moving objects) rather than processing entire images at full quality. This reduces average power consumption, allowing smaller battery capacity and consequently lower device weight while maintaining adequate power supply for the reduced computational load.
4Weight of moving object
If processing power is reduced to decrease weight and power consumption, then portability is improved, but image quality and processing speed deteriorate
Solution Approach 1:
The patent segments processing requirements by identifying moving objects through mask layers and applying high-quality processing only to those specific regions. This allows the use of lower overall processing power and reduced device weight while maintaining image processing quality for dynamically important areas.
Solution Approach 2:
The system applies different processing qualities to different regions of the image based on their importance. Moving objects receive high-quality processing while static background areas use lower processing requirements. This local quality differentiation maintains overall image quality perception while reducing total processing demands and device weight.
Data Source
AI summary
Techniques and systems are provided for image generation. For instance, a process can include rendering an image of a scene, the scene including a first virtual object associated with a first physical object that moves independently of the scene, identifying a first set of pixels associated with the first virtual object in the image of the scene, generating a mask layer based on the first set of pixels, the mask layer indicating locations of the first set of pixels in the image, and transmitting the mask layer and the image to a display.