Virtual Magnifier Depth-Adaptive Stabilization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mixed reality (MR) devices face issues with virtual content magnification, such as distortion and double vision, due to display updates and substantial size changes, which can lead to vergence problems and over-magnification.

Innovation Solution

The implementation of a virtual magnifier system that adjusts virtual content based on relative virtual depths between objects, stabilizes magnified content by tracking device position changes or gaze, and limits magnification to prevent vergence issues through techniques like blurring or converting 3D objects to 2D when necessary.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of moving object

If virtual content is substantially magnified to increase visibility, then the image size is increased, but distortion and double vision occur due to display updates

Engineering Contradiction:
Improveimage sizeVSAvoidimage stability
Core Design Contradiction:
Area of moving objectVSReliability

Solution Approach 1:

The system dynamically adjusts the magnification level based on the relative virtual depths between objects. As virtual objects move or are repositioned at different depths, the magnification is continuously updated to maintain image stability while preserving visibility. This dynamic adaptation prevents distortion and double vision by ensuring that magnified content remains consistent with the display's refresh rate and the user's gaze position.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the magnification parameter adaptively rather than using a fixed substantial magnification. By adjusting the magnification level based on virtual depth relationships and gaze tracking data, the system maintains image quality and stability while still providing enhanced visibility when needed. This parameter change approach resolves the contradiction by making magnification conditional and context-dependent.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If magnification is increased to improve visibility of virtual objects, then detail perception is enhanced, but vergence problems and double vision occur

Engineering Contradiction:
Improvedetail perceptionVSAvoidvergence problems
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system uses gaze tracking feedback to determine when and how much magnification to apply. By monitoring the user's gaze position and virtual depth information, the system applies magnification only to objects that are currently being viewed, maintaining appropriate vergence relationships. This feedback mechanism prevents double vision by ensuring magnified content aligns with the user's focal point while preserving depth cues for other objects.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Instead of uniformly magnifying all virtual content, the system applies magnification locally to specific objects based on their relative virtual depths and the user's gaze position. This localized magnification approach enhances detail perception for the focal object while maintaining proper vergence relationships for the overall scene, thereby preventing double vision and vergence conflicts.

Inventive Principle:
Principle #3Local quality

3Speed

If display refresh rate is maintained for smooth updates, then fluidity is preserved, but magnified content becomes distorted during transitions

Engineering Contradiction:
Improvedisplay refresh rateVSAvoidmagnified content shape
Core Design Contradiction:
SpeedVSShape

Solution Approach 1:

The system performs preliminary calculations of the required magnification adjustments based on predicted virtual object positions and relative depths before display updates occur. By pre-computing magnification parameters that account for upcoming transitions, the system maintains both the display's fluid refresh rate and the geometric integrity of magnified content, preventing distortion during transitions.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240406362A1Adaptive virtual content magnification
Publication Date: 2024.12.05 APPLE INC
  • US20240406362A1 patent drawing
  • US20240406362A1 patent drawing
  • US20240406362A1 patent drawing

AI summary

Electronic devices such as mixed reality devices may present virtual objects at a display and provide a virtual magnifier to alter (e.g., magnify) the virtual objects. In one or more implementations, the virtual magnifier magnifies a first virtual object and subsequently magnifies a second virtual object. The electronic device may provide one or more effects, such as initially maintaining the current size of the second virtual object and subsequently adjusting the size of the second virtual object based on the first virtual object, including the relative depth between the first virtual object and the second virtual object. In one or more implementations, a process for stabilization of a magnified object is applied in circumstances when the change in position of the electronic device or change in user's gaze location is at or above a threshold.