Imperceptible Calibration Frames for AR Display Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality and augmented reality systems face issues with display calibration due to deformations or misalignments in display components, leading to distorted virtual content and potential physiological strain on users.

Innovation Solution

A piecewise progressive continuous calibration method with context coherence is employed, where a calibration frame is generated by convolving a test pattern with virtual content, and inserted imperceptibly among regular frames to calibrate the display only where and when virtual content is displayed, reducing computational burden and reliance on eye tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional calibration methods are used, then calibration accuracy is improved, but computational burden and user discomfort increase

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcomputational burden
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The calibration process is segmented into multiple discrete calibration frames that are inserted at specific intervals within the video stream. Each calibration frame is a separate entity that can be processed independently, allowing the system to perform calibration without requiring continuous computational resources or disrupting the overall video playback flow.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Calibration frames are inserted periodically at predetermined intervals between regular video frames. This periodic insertion allows the display system to perform calibration at regular intervals without requiring continuous calibration computation, thereby reducing computational burden while maintaining calibration accuracy over time.

Inventive Principle:
Principle #19Periodic action

2Measurement precision

If calibration frames are displayed frequently, then calibration accuracy is improved, but user comfort and perceptibility are worsened

Engineering Contradiction:
Improvecalibration accuracyVSAvoiduser discomfort
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

Instead of displaying calibration frames continuously or at every interval, the system uses partial action by inserting calibration frames only at predetermined intervals between regular video frames. This selective insertion provides sufficient calibration accuracy while minimizing the total time calibration frames are visible, thereby reducing user discomfort and maintaining natural viewing experience.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system skips the display of calibration frames during regular video playback by inserting them only at specific intervals. This skipping approach allows calibration to occur without continuously interrupting the video stream, making the calibration process less noticeable to users while still achieving the necessary calibration accuracy over time.

Inventive Principle:
Principle #21Skipping (Rushing through)

3Measurement precision

If calibration is performed continuously, then calibration accuracy is improved, but display quality and contextual coherence are worsened

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcontextual coherence
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The calibration process is segmented into discrete calibration frames that are inserted at specific intervals rather than displayed continuously. This segmentation allows the system to maintain contextual coherence by preserving the continuous video stream while still performing calibration through these discrete, spaced-out frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Calibration frames serve as intermediary elements that are inserted between regular video frames. These intermediary frames carry calibration information while being visually blended with the surrounding video content, allowing calibration to occur without significantly disrupting the contextual coherence or visual continuity of the displayed video.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12046034B2Piecewise progressive and continuous calibration with coherent context
Publication Date: 2024.07.23 MAGIC LEAP INC
  • US12046034B2 patent drawing
  • US12046034B2 patent drawing
  • US12046034B2 patent drawing

AI summary

A piecewise progressive continuous calibration method with context coherence is utilized to improve display of virtual content. When a set of frames are rendered to depict a virtual image, the VAR system may identify a location of the virtual content in the frames. The system may convolve a test pattern at the location of the virtual content to generate a calibration frame. The calibration frame is inserted within the set of frames in a manner that is imperceptible to the user.