Wearable Display Content Segmentation for Power Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing wearable devices with extended reality (XR) glasses face challenges in efficiently managing compute power and battery life due to the need to render high-quality content and transfer data over limited communication interfaces, especially as the field of view (FoV) increases, leading to resource constraints.

Innovation Solution

A method and device that offloads low-quality content to external display devices when they are within the user's FoV, allowing the wearable device to focus on rendering high-quality content near the user's gaze direction, thereby reducing compute and display power usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the field of view (FoV) for XR glasses is increased, then the display coverage and user experience are improved, but the compute power and battery power usage increase significantly

Engineering Contradiction:
Improvefield of view areaVSAvoidbattery power usage
Core Design Contradiction:
Area of stationary objectVSUse of energy by moving object

Solution Approach 1:

The display content is segmented into two quality levels: high-quality content for the foveal vision region and low-quality content for the peripheral vision region. This segmentation allows the system to render only the necessary high-quality content in the limited FoV while offloading low-quality peripheral content to external displays, thereby reducing the compute and power requirements for the XR glasses.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The low-quality content rendering task is extracted from the XR glasses and transferred to external display devices. The XR glasses determine which content should be displayed on external devices based on the user's gaze direction and FoV, then offload the rendering of low-quality content to these external devices, significantly reducing the power consumption of the wearable device.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If high-quality content is rendered for the entire field of view, then the visual quality is improved, but the processing load and data transfer requirements increase

Engineering Contradiction:
Improvecontent qualityVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Different quality levels are applied to different spatial regions of the display content. High-quality rendering is applied only to the region corresponding to the user's foveal vision (central gaze area), while low-quality rendering is applied to the peripheral regions. This local quality differentiation maintains visual perception quality while dramatically reducing processing load and data transfer requirements.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If all content is transmitted over the communication interface, then the content availability is improved, but the shared resources are consumed and latency increases

Engineering Contradiction:
Improvecontent availabilityVSAvoiddata transfer time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

Instead of transmitting all content data over the communication interface, the system transmits only the necessary high-quality content data for the foveal region. The low-quality peripheral content is generated locally by external devices based on the user's gaze information, reducing the volume of data transmitted and minimizing communication latency.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11960091B2Method and device for controlling display of content
Publication Date: 2024.04.16 TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
  • US11960091B2 patent drawing
  • US11960091B2 patent drawing
  • US11960091B2 patent drawing

AI summary

Embodiments of the present disclosure provide a method, a computer program product, and a wearable device for controlling display of content. The method is performed in a wearable device (10) comprising a head mounted display having a display region (12). The method comprises causing (S12) to display a first visual content (32) on a first portion (14) of the display region, corresponding to an eye gaze direction (22) of the user (20). The method comprises determining (S13) to transmit a second visual content (34) to one or more external display devices (40a-40n) based on presence of the one or more external display devices (40a-40n) in a field of view, FoV, of the wearable device (10). Further, the method comprises sending (S14) a request to at least one of the one or more external display devices (40a-40n) to display the second visual content (34). The method further comprises causing (S15) to display the second visual content (34), at least outside the first portion (14) of the display region (12). The resolution of the first visual content (32) is higher than the resolution of the second visual content (34).