Pass-Through View Rendering With Tracker-Based Depth Map Alignment

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Inaccurate depth maps used for rendering in head-mounted displays (HMDs) lead to misalignment of virtual objects with real-world trackers, causing confusion and unsatisfactory user experiences in mixed reality services.

Innovation Solution

A method for generating a pass-through view with improved scale and accuracy by obtaining a first depth map, updating it based on tracker information, and rendering the view using a target depth map, involving a host with a storage circuit and processor to manage the process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a depth map is used for rendering the pass-through view, then the rendering process can be completed, but the scale and position of the tracker may be misaligned with the virtual object

Engineering Contradiction:

Improvealignment precisionVSAvoiddepth map accuracy

Core Design Contradiction:

Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The system uses tracker information (position, orientation, scale) as feedback to update and refine the depth map. The host continuously adjusts the depth map based on the tracker's actual pose, creating a closed-loop system that improves alignment precision between virtual objects and real-world trackers in the pass-through view.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system changes the parameters of the depth map by updating it with tracker information. Specifically, the host modifies the depth values and spatial parameters of the depth map based on the tracker's position, orientation, and scale data, thereby adjusting the rendering parameters to achieve accurate alignment.

Inventive Principle:

Principle #35Parameter changes

2Manufacturing precision

If the depth map is updated based on tracker information, then the alignment between tracker and virtual object improves, but the computational complexity increases

Engineering Contradiction:

Improvealignment precisionVSAvoidprocessing complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by obtaining tracker information (position, orientation, scale) before updating the depth map. This preparation step allows the host to efficiently compute the necessary depth map adjustments without increasing real-time processing complexity during the actual rendering phase.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The tracker information serves as an intermediary that bridges the real-world tracker and the virtual object rendering. By using this intermediate data to update the depth map, the system avoids direct complex computations between the tracker and virtual object, simplifying the overall processing while maintaining alignment precision.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12511843B2Method for generating pass-through view with better scale and host

Publication Date: 2025.12.30 HTC CORP

AI summary

The embodiments of the disclosure provide a method for generating a pass-through view with better scale and to a host. The method includes: obtaining, by the host, a first depth map associated with a field of view (FOV) of the host; determining, by the host, tracker information associated with a tracker; generating, by the host, a target depth map by updating the first depth map based on the tracker information; and rendering, by the host, the pass-through view based on an image associated with the FOV of the host, a camera parameter, and the target depth map.