Near-Eye Display Focal-Region Data Prioritization for Faster Updates

Solution Overview

Problem

Near-eye display devices for augmented and virtual reality experiences face challenges in providing a satisfying user experience due to delayed image data updates, poor image quality, and limited battery life, which are exacerbated by considerations of space, weight, power, and cost (SWaP-C) constraints.

Innovation Solution

A method is implemented to reduce display update time by identifying a distance vector in the display field of view and determining whether image data qualifies as lossless priority or allowed loss data based on this vector, using communication techniques that allow for lossy transmission of non-critical data while ensuring lossless transmission of critical data, thereby optimizing data transmission and reducing power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image data is transmitted using lossless transmission techniques, then image quality is improved, but transmission time and power consumption increase

Engineering Contradiction:

Improveimage qualityVSAvoidtransmission time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies local quality by differentiating transmission requirements for different regions of the display field of view. Image data within the user focal region is transmitted using lossless techniques to maintain high quality where the user is looking, while image data outside the focal region uses lossy transmission techniques, allowing quality reduction in areas the user is not currently observing.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The system dynamically changes transmission parameters based on the distance vector from the point of focus. By calculating the distance of each image data element from the focal point and comparing it against perception criteria, the system adjusts the transmission quality parameter (lossless vs. lossy) to optimize the balance between image quality and transmission efficiency.

Inventive Principle:

Principle #35Parameter changes

2Manufacturing precision

If image data is transmitted using lossless transmission techniques, then image quality is improved, but power consumption increases

Engineering Contradiction:

Improveimage qualityVSAvoidpower consumption

Core Design Contradiction:

Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by differentiating transmission requirements for different regions of the display field of view. Image data within the user focal region is transmitted using lossless techniques to maintain high quality where the user is looking, while image data outside the focal region uses lossy transmission techniques, allowing quality reduction in areas the user is not currently observing.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The system dynamically changes transmission parameters based on the distance vector from the point of focus. By calculating the distance of each image data element from the focal point and comparing it against perception criteria, the system adjusts the transmission quality parameter (lossless vs. lossy) to optimize the balance between image quality and transmission efficiency.

Inventive Principle:

Principle #35Parameter changes

3Speed

If display update frequency is increased, then user experience is improved, but power consumption and processing requirements increase

Engineering Contradiction:

Improvedisplay update frequencyVSAvoidpower consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by differentiating transmission requirements for different regions of the display field of view. Image data within the user focal region is transmitted using lossless techniques to maintain high quality where the user is looking, while image data outside the focal region uses lossy transmission techniques, allowing quality reduction in areas the user is not currently observing.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The system applies partial action by transmitting only the necessary portion of image data at full quality (within the focal region), while using reduced quality transmission for peripheral regions. This partial approach to full-quality transmission reduces overall power consumption while maintaining acceptable user experience.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS10514541B2Display update time reduction for a near-eye display

Publication Date: 2019.12.24 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Technology is described for reducing display update time for a near-eye display (NED) device. A point of focus in the NED field of view is identified, often based on natural user input data. A communication module of a computer system communicatively coupled to the NED device transmits lossless priority data, an example of which is user focal region image data, using one or more communication techniques for satisfying lossless transmission criteria. Allowed loss image data is identified based at least in part on its distance vector from a point of focus in the display field of view. An example of allowed loss image data is image data to be displayed outside the user focal region. The allowed loss image data is transmitted and extracted from received image data allowing for lossy transmission.