HMD Resolution Adjustment via Content Saliency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR technologies face challenges in efficiently displaying high-resolution, high-frame-rate content in Head-Mounted Displays (HMDs) due to high computational demands and hardware requirements, leading to increased costs and potential delays or discontinuities in the visual experience.

Innovation Solution

A method for adjusting the resolution of HMD content based on saliency information, which determines the importance of each display element and adjusts resolution accordingly, allowing for adaptive rendering and reduced computational load by utilizing cloud servers and adaptive visual modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If higher resolution and higher frame rate are used for VR display, then display quality is improved, but computational load and hardware requirements increase

Engineering Contradiction:
Improvedisplay qualityVSAvoidcomputational load
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality by adjusting resolution dynamically based on the importance of different display contents. High-resolution rendering is applied only to important contents (such as foveal regions or semantically significant objects), while less important areas use lower resolution. This selective approach maintains high display quality where needed while reducing overall computational load and hardware requirements.

Inventive Principle:
Principle #3Local quality

2Reliability

If higher resolution and higher frame rate are used for VR display, then visual experience is improved, but hardware cost increases

Engineering Contradiction:
Improvevisual experienceVSAvoidhardware cost
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent changes the parameter of resolution dynamically based on content importance. Instead of maintaining uniformly high resolution across all display contents, the system adjusts resolution parameters adaptively - using high resolution for important contents and lower resolution for less important ones. This parameter change strategy maintains high visual experience quality while significantly reducing hardware cost and computational requirements.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If computation amount is increased for VR display, then display quality is improved, but processing time increases

Engineering Contradiction:
Improvedisplay qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies partial action by rendering only the necessary portions of the virtual scene at high resolution. Instead of computing and rendering all display contents at maximum quality, the system identifies important contents (using saliency detection, semantic analysis, or foveal tracking) and applies high-resolution rendering only to those regions. This partial approach maintains display quality for critical elements while dramatically reducing overall processing time and computational effort.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11416964B2Method and device for adjusting resolution of HMD apparatus
Publication Date: 2022.08.16 SAMSUNG ELECTRONICS CO LTD
  • US11416964B2 patent drawing
  • US11416964B2 patent drawing
  • US11416964B2 patent drawing

AI summary

The present invention provides a method and device for adjusting resolution of a Head-Mounted Display (HMD) apparatus. Wherein, the method comprises the steps of: determining saliency information of display contents in multimedia information; adjusting, according to the saliency information, resolution corresponding to each display content in the multimedia information; and, displaying the resolution-adjusted multimedia information. In the present invention, by determining saliency information of display contents in multimedia information, the resolution corresponding to the display contents is adjusted, which enable the resolution of the display contents to be matched with the saliency of the display contents, and accordingly, the resolution-adjusted multimedia information is displayed without the need of displaying the complete multimedia information in a higher resolution and a higher frame rate. In this way, computation amount for a device is greatly reduced, so that requirement for device hardware is reduced and device cost is reduced, and displaying efficiency is improved whilst at the same time ensuring good displaying effect.