AR Text Streaming with Eye-Tracked Pause for Compact 3D Labels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual and augmented reality systems face challenges in efficiently displaying text adjacent objects due to resolution limitations, requiring large areas for coarse print, which can clutter the three-dimensional scene.

Innovation Solution

The augmented reality system spatially associates text regions with actual or virtual objects, generates textual messages within these regions, and streams them efficiently, allowing for compact display and reduced clutter by using high-resolution laser light projection and eye-tracking technology to determine the object of interest and control message streaming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional display technology is used to show text adjacent to objects in AR/VR systems, then the text can be displayed, but the resolution is limited and fine print cannot be resolved, requiring large areas that clutter the three-dimensional scene

Engineering Contradiction:
Improvetext resolutionVSAvoiddisplay area
Core Design Contradiction:
Manufacturing precisionVSArea of stationary object

Solution Approach 1:

The patent changes the physical state of light from conventional display methods to laser light projection. This parameter change enables high-resolution text display by utilizing the coherence and directionality of laser light to project fine text details onto transparent surfaces, resolving the contradiction between achieving high text resolution and minimizing display area.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces traditional mechanical display systems (such as LCDs or projectors that require physical screens) with a laser projection system that uses optical fields directly. This substitution eliminates the need for large physical display areas while achieving high resolution through the precision control of laser light paths and projection geometry.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If text is displayed adjacent to objects to provide descriptive information, then user decision-making is facilitated, but the three-dimensional scene becomes cluttered

Engineering Contradiction:
Improveinformation completenessVSAvoidvisual clutter
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by projecting text information precisely at specific locations adjacent to objects in the three-dimensional space. The laser projection system places text only where needed, using local optical projection to provide descriptive information about particular objects without unnecessarily populating other areas of the scene, thus reducing overall visual clutter.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent utilizes the third dimension (depth) by projecting text onto transparent surfaces at different spatial positions relative to objects. This dimensional approach allows text to be displayed in the depth space adjacent to objects rather than overlaying them directly, maintaining the three-dimensional scene structure while providing complete information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If head-worn displays are used to present virtual representations, then immersion is enhanced, but the complexity of the system increases

Engineering Contradiction:
Improveimmersion levelVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the laser projection system universal by enabling it to function with both transparent and opaque display surfaces. This multi-functionality allows the same laser projection mechanism to work in various AR/VR configurations, reducing system complexity by eliminating the need for separate projection systems for different display types while maintaining high immersion levels.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces transparent surfaces as intermediaries between the laser projection system and the user's eye. These transparent surfaces serve as mediators that carry the projected text information while allowing the user to see through them, thereby achieving high immersion without requiring complex opaque display systems. The transparent surface acts as a simple yet effective intermediary that simplifies the overall system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables clear, compact, and interactive display of textual messages adjacent objects, enhancing user experience by reducing visual clutter and improving readability in immersive environments.

Implementation Method 1

using high-resolution laser light projection

Methodology Applied
Scientific EffectLaser: Laser

Implementation Method 2

eye-tracking technology to determine the object of interest and control message streaming

Methodology Applied
Scientific EffectEye-tracking:

Data Source

PatentEP4068147B1Technique for more efficiently displaying text in virtual image generation system
Publication Date: 2026.01.21 MAGIC LEAP INC
  • EP4068147B1 patent drawingFigure 1
  • EP4068147B1 patent drawingFigure 2
  • EP4068147B1 patent drawingFigure 3

AI summary

A virtual image generation system (100) and method of operating same is provided. An end user is allowed to visualize the object of interest (20, 22) in a three-dimensional scene. A text region (202) is spatially associated with the object of interest (20, 22). A textual message that identifies at least one characteristic of the object of interest is generated. A textual message is streamed within the text region and pauses when the user closes his eyes.