Mixed Reality Pass-Through View Tracker Distortion Removal

The patent extracts the tracker from the pass-through view by determining its position and depth, then excludes it from the rendering process. The host device identifies the tracker in the captured image, calculates its spatial location using depth information, and removes it from the final rendered view, preventing distortion while maintaining the rest of the real-world scene.

The patent changes the depth parameter of the tracker to exclude it from the pass-through view. By modifying the depth value associated with the tracker's position, the system effectively moves the tracker outside the visible range or adjusts its rendering priority, thereby eliminating the distortion effect without affecting other scene elements.

The patent segments the pass-through view into multiple regions: the tracker region (excluded from rendering to prevent distortion) and the background scene region (rendered normally). By dividing the view in this manner, the system can selectively process different areas with different requirements, maintaining visual quality while preserving spatial awareness through the overall scene composition.

The patent uses depth map information as an intermediary to mediate between the tracker's physical presence and its visual representation. The depth data serves as a bridge that allows the system to accurately determine tracker position and apply appropriate rendering decisions, ensuring both distortion reduction and spatial awareness without direct conflict.