Adaptive Pose Locking for XR Display Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional extended-reality (XR) devices face challenges in providing high spatial resolutions due to user head movement, leading to image shifting and overlapping, which makes it difficult for users to clearly see fine details in XR environments.

Innovation Solution

A display apparatus incorporating adaptive pose locking, which uses pose-tracking means, an image renderer per eye, and a liquid-crystal device to determine the user's head pose and switch between lock mode and non-lock mode based on movement thresholds, controlling light shifting to enhance apparent resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If pixel-shifting technology is used to provide high spatial resolution, then apparent resolution is improved, but image stability deteriorates due to head movement causing pixel shifting and overlapping

Engineering Contradiction:
Improvespatial resolutionVSAvoidimage stability
Core Design Contradiction:
Manufacturing precisionVSStability of the object's composition

Solution Approach 1:

The system dynamically adjusts between lock mode and non-lock mode based on detected head movement. In lock mode, the image renderer maintains a fixed mapping relationship with the display panel to ensure stability. When head movement is detected, the system switches to non-lock mode to update the mapping relationship, thus adapting to changing conditions while maintaining both resolution and stability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameter of the image renderer between locked and unlocked states. By monitoring head pose changes and switching modes accordingly, the system optimizes the balance between image stability (lock mode) and adaptability to head movement (non-lock mode), preventing pixel overlapping while maintaining high spatial resolution.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If full resolution image data is generated for each image to accommodate head movement, then resolution is improved, but processing complexity and time increase

Engineering Contradiction:
Improveimage resolutionVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

Instead of always generating full resolution image data for all pixels, the system uses partial action by generating complete image data only when necessary (in non-lock mode). During lock mode, the system relies on the existing fixed mapping relationship, reducing processing requirements. This partial approach maintains high resolution when needed while minimizing processing complexity during stable periods.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary action by establishing a fixed mapping relationship between the image renderer and display panel in lock mode before head movement occurs. This pre-established mapping allows the system to maintain high resolution display without continuous processing, reducing real-time processing complexity while preserving image quality.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If re-projection is performed to match latest head pose, then image accuracy is improved, but latency increases causing rapid pixel shifting

Engineering Contradiction:
Improveimage accuracyVSAvoidlatency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system dynamically switches between lock mode and non-lock mode based on head movement detection. During lock mode, the fixed mapping relationship eliminates the need for continuous re-projection, reducing latency. When head movement is detected, the system transitions to non-lock mode to perform re-projection only when necessary, thus maintaining image accuracy while minimizing time loss.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Instead of continuous re-projection, the system uses periodic action by switching modes based on detected head movement thresholds. The system maintains a stable fixed mapping for extended periods (lock mode) and only performs re-projection when head movement exceeds the threshold, reducing the frequency of re-projection operations while maintaining image accuracy when needed.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables clear presentation of high-quality visual scenes with enhanced resolution by reducing re-projection burden and ensuring users can see fine details even with minor head movements, while optimizing processing and image rendering.

Implementation Method 1

controlling the liquid-crystal structure, via the control circuit, to shift light emanating from a given pixel of the image renderer to a plurality of positions in a sequential and repeated manner

Methodology Applied
Scientific EffectLiquid crystal light shifting: Liquid Crystals

Data Source

PatentUS11307410B2Display apparatus and method incorporating adaptive pose locking
Publication Date: 2022.04.19 VARJO TECH OY
  • US11307410B2 patent drawing
  • US11307410B2 patent drawing
  • US11307410B2 patent drawing

AI summary

A display apparatus including pose-tracking means; image renderer per eye; liquid-crystal device including liquid-crystal structure and control circuit; and processor. Processor is configured to: process pose-tracking data to determine user's head pose; detect if rate at which head pose is changing is below predefined threshold rate; if yes, switch on lock mode, select head pose for session of lock mode, and generate output image frames according to head pose during session; if no, generate output image frames according to corresponding head poses of user using pose-tracking data; and display output image frames, whilst shifting light emanating to from pixels of image renderer to multiple positions (P1-P9) in sequential and repeated manner, said shifting causes resolution of output image frames to appear higher than display resolution of image renderer.