Pass-Through View Rendering for MR Tracker Accuracy or Visual Smoothness

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing head-mounted displays (HMDs) for mixed reality (MR) services lack flexibility in providing pass-through views, limiting developers to a single mode that either maintains tracker accuracy or visual smoothness, leading to user confusion or unsatisfactory experiences.

Innovation Solution

A method and host system that allows developers to select between a first mode for tracker accuracy and a second mode for visual smoothness, using depth maps and camera parameters to render pass-through views, ensuring accurate tracker positioning or minimal distortion based on user interaction needs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a single mode of pass-through view is used, then the system is simple to implement, but the adaptability for different MR service requirements is limited

Engineering Contradiction:

Improveadaptability for different MR service requirementsVSAvoidsystem implementation complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically switches between first mode (control accurateness) and second mode (visual smoothness) based on developer selection and operational context. The rendering pipeline adapts its behavior by selecting different depth map processing strategies and projection methods according to the chosen mode, enabling flexible adaptation to different MR service requirements without fixed constraints

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes key rendering parameters including depth map generation methods, projection matrix calculations, and coordinate system transformations based on the selected mode. In first mode, parameters are optimized for tracker positioning accuracy while in second mode, parameters are adjusted for visual smoothness, allowing the same hardware to serve different functional requirements through parameter variation

Inventive Principle:

Principle #35Parameter changes

2Measurement precision

If the first mode is selected for control accurateness, then tracker positioning accuracy is improved, but visual smoothness deteriorates

Engineering Contradiction:

Improvetracker positioning accuracyVSAvoidvisual smoothness

Core Design Contradiction:

Measurement precisionVSReliability

Solution Approach 1:

The system applies different quality characteristics to different aspects of the pass-through view based on the selected mode. In first mode, local quality is optimized for tracker region accuracy with precise positioning while other regions may have reduced visual fidelity. In second mode, overall visual smoothness is prioritized across the entire view. This localized optimization allows improvement in one area without completely sacrificing the other

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The rendering system dynamically adjusts its processing based on the selected mode, switching between accuracy-optimized pipelines and smoothness-optimized pipelines. The system can transition between these states depending on developer selection and operational requirements, making the trade-off manageable and controllable rather than fixed

Inventive Principle:

Principle #15Dynamics

3Reliability

If the second mode is selected for visual smoothness, then visual quality is improved, but tracker positioning accuracy deteriorates

Engineering Contradiction:

Improvevisual smoothnessVSAvoidtracker positioning accuracy

Core Design Contradiction:

ReliabilityVSMeasurement precision

Solution Approach 1:

In second mode, the system prioritizes visual smoothness across the overall pass-through view while accepting reduced precision in tracker positioning regions. This local quality differentiation allows the visual experience to be optimized without completely compromising tracker functionality, as the reduced precision is localized to specific interaction regions

Inventive Principle:

Principle #3Local quality

4Adaptability or versatility

If only one pass-through view mode is provided, then the system is easier to implement, but the versatility for different user interaction needs is limited

Engineering Contradiction:

Improveversatility for different user interaction needsVSAvoidsystem implementation ease

Core Design Contradiction:

Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The system implements multi-functionality by providing both first mode and second mode within a single pass-through view rendering framework. The same hardware and basic software infrastructure support multiple operational modes, making the system universally applicable to different user interaction needs and MR service types without requiring separate dedicated systems for each function

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12469232B2Method for generating pass-through view in response to selected mode and host

Publication Date: 2025.11.11 HTC CORP

AI summary

The embodiments of the disclosure provide a method for generating a pass-through view in response to a selected mode and a host. The method includes: determining, by the host, the selected mode among a first mode and a second mode, wherein the first mode aims to achieve a control accurateness, and the second mode aims to achieve a visual smoothness; determining, by the host, a target depth map according to the selected mode; and rendering, by the host, the pass-through view based on an image associated with a field of view (FOV) of the host, a camera parameter, and the target depth map.