Extended Reality Image Processing with Invisible Region Skipping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended reality (XR) devices, processing all image signals uniformly to composite real and virtual images leads to inefficient power consumption due to unnecessary processing on obscured portions, which is not addressed by existing technologies.
Innovation Solution
The XR device employs a method and system that identifies and processes only non-obscured portions of real images by generating invisible portion information, allowing processors to skip unnecessary image signal processing on obscured areas, thereby optimizing power usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If uniform processing is performed on all image signals to ensure complete real image preparation, then image processing completeness is improved, but power consumption increases due to unnecessary processing on obscured portions
Solution Approach 1:
The patent segments the image processing task by dividing the image into visible and invisible portions based on graphic object overlay information. The image signal processor then processes only the visible portions uniformly while skipping invisible portions, resolving the contradiction between complete processing and power consumption efficiency.
Solution Approach 2:
The patent applies different processing quality to different regions of the image. Visible portions receive full image signal processing to ensure quality, while invisible portions are skipped entirely. This local differentiation resolves the contradiction by applying processing only where necessary.
2Manufacturing precision
If all image signals are processed uniformly to maintain real image integrity, then image quality is improved, but processing efficiency deteriorates due to wasted computation on obscured areas
Solution Approach 1:
The patent segments the image processing workload by identifying invisible portions through graphic object image analysis. Only visible portions are processed, which maintains image quality for displayed areas while significantly improving processing efficiency by eliminating wasted computation on obscured regions.
Solution Approach 2:
The patent applies partial action by processing only the necessary visible portions of the image rather than all portions. This partial processing approach maintains sufficient image quality for the visible display area while dramatically improving processing efficiency.
3Reliability
If complete image processing is performed to ensure no real image portions are missed, then processing thoroughness is improved, but power consumption increases due to unnecessary processing on graphic object covered areas
Solution Approach 1:
The patent performs preliminary action by determining invisible portion information before actual image signal processing. The graphic object image is processed first to identify which real image portions will be obscured, allowing the image signal processor to skip those portions entirely, thus preventing wasted energy on unnecessary processing while maintaining processing thoroughness for visible areas.
Data Source
AI summary
A method of operating an extended reality (XR) device includes generating a first display picture in a first frame duration, and generating a second display picture in a second frame duration. Generating the first display picture includes generating first invisible portion information by determining a first invisible portion of a first real image based on a first graphic object image, performing first image signal processing on first sensing data of a first image signal based on the first invisible portion information, and generating the first display picture based on the processed first sensing data and the first graphic object image.