VR Attention Map Differential Resource Allocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality (VR) and augmented reality (AR) systems face challenges in maintaining low latency and high-quality rendering due to limited computational resources, leading to user discomfort from screen jitters and dizziness when latency exceeds 20 milliseconds.

Innovation Solution

An electronic apparatus with sensors and a control circuit generates an attention map to prioritize computational resource allocation based on user attention factors, differentially computing scene segments to optimize resource distribution and maintain low latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If computational resources are uniformly allocated to all scene segments, then rendering quality is maintained, but latency increases and user comfort deteriorates

Engineering Contradiction:
Improveuser comfortVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies local quality by allocating different computational resource levels to different scene segments based on their priority rankings. High-priority segments (those likely to be in the user's foveal vision) receive full computational resources for high-quality rendering, while low-priority segments (peripheral areas) receive reduced computational resources. This differential allocation maintains user comfort in critical areas while reducing overall latency through selective quality adjustment.

Inventive Principle:
Principle #3Local quality

2Speed

If computational resources are reduced to decrease latency, then rendering speed improves, but rendering quality deteriorates

Engineering Contradiction:
Improverendering speedVSAvoidrendering quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The system applies local quality by spatially varying rendering quality across different scene segments. High-priority segments maintain high rendering quality with sufficient computational resources, while low-priority segments use reduced quality settings. This allows the system to achieve faster overall rendering speeds while preserving visual quality in regions most important to user experience.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying full computational resources only to necessary portions of the scene (high-priority segments) rather than uniformly to the entire scene. This selective approach achieves the minimum necessary rendering quality for user comfort while significantly reducing total computational requirements and increasing rendering speed.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If computational resources are uniformly distributed, then all scene segments are processed equally, but resource efficiency decreases and latency increases

Engineering Contradiction:
Improveresource efficiencyVSAvoidlatency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system changes the parameter of computational resource allocation from a uniform distribution to a differential distribution based on priority rankings. By dynamically adjusting resource allocation parameters according to predicted user attention and scene importance, the system achieves higher resource efficiency and reduced latency without compromising user experience in critical areas.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10366540B2Electronic apparatus and method for virtual reality or augmented reality system
Publication Date: 2019.07.30 HTC CORP
  • US10366540B2 patent drawing
  • US10366540B2 patent drawing
  • US10366540B2 patent drawing

AI summary

An electronic apparatus includes a displayer, a graphic processing circuit, sensors and a control circuit. The displayer is configured for displaying a virtual reality scene or an augmented reality scene. The graphic processing circuit is coupled to the displayer. The graphic processing circuit is configured for computing a plurality of scene segments in the virtual reality scene or the augmented reality scene. The sensors are configured for collecting attention factors. The control circuit is coupled to the sensors and the graphic processing circuit. The control circuit is adapted to generate an attention map according to the attention factors. The attention map indicates priority rankings of the scene segments. The control circuit is further adapted to allocate a distribution of computational resources of the graphic processing circuit between the scene segments according to the priority rankings. The scene segments are computed differentially according to the distribution of computational resources.