AR Eyepiece Predictive Gesture Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality eyepieces lack effective integration of interactive controls and adaptive display technologies, limiting user interaction with virtual content and environmental awareness.

Innovation Solution

An interactive head-mounted eyepiece with a nano-projector, LCoS display, freeform waveguide lens, and a wedge-shaped optic, enabling field sequential color projection, total internal reflections, and adaptive display characteristics, along with integrated processors and cameras for gesture recognition and environmental correction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If a nano-projector with LCoS display and waveguide lens is integrated into the eyepiece, then the display quality and field of view are improved, but the device complexity and manufacturing difficulty increase

Engineering Contradiction:
Improvedisplay qualityVSAvoiddevice complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent integrates multiple optical components (LCoS display, waveguide lens, coupling lens, wedge-shaped optic) into a compact nested structure where smaller components are positioned within or alongside larger ones. The nano-projector is embedded in the eyepiece housing, with the LCoS display positioned adjacent to the waveguide lens, and the coupling lens optically coupled between them, creating a space-efficient nested arrangement that maintains high display quality while managing device complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent combines multiple functional elements into integrated assemblies. The waveguide lens and correction lens are optically coupled to work together as a unified optical system. The coupling lens merges the light paths from the LCoS display into the waveguide lens. The wedge-shaped optic is integrated with the correction lens to provide both waveguide coupling and optical correction functions simultaneously, reducing the number of separate components needed.

Inventive Principle:
Principle #5Merging (Combining)

2Use of energy by moving object

If field sequential color projection with RGB LED module is implemented, then the color accuracy and energy efficiency are improved, but the device complexity increases

Engineering Contradiction:
Improveenergy efficiencyVSAvoiddevice complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The patent implements field sequential color projection by rapidly switching between red, green, and blue LED light sources in periodic succession. Each LED emits light for a brief interval (typically milliseconds), and the LCoS display modulates the light for each color field. The human eye integrates these sequential color fields into a full-color image, achieving energy-efficient color projection without requiring all three LEDs to operate simultaneously, thus improving energy efficiency while managing device complexity.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent replaces traditional color wheel or filter-based color separation mechanisms with an electronic field sequential approach. Instead of mechanically rotating a color wheel or using physical filters to separate colors, the system uses electronic control to switch between LED light sources and corresponding LCoS display segments, substituting mechanical color separation with electronic timing and modulation control, thereby improving energy efficiency and reducing mechanical complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If gesture recognition and interactive control elements are integrated, then the ease of operation is improved, but the measurement precision and detection difficulty increase

Engineering Contradiction:
Improveease of operationVSAvoidgesture detection precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent incorporates feedback mechanisms where the system detects user gestures through cameras or sensors, processes the gesture data to determine user intent, and provides visual feedback through the augmented reality display to confirm recognition. The system monitors gesture progression in real-time and provides intermediate feedback (such as highlighting selectable elements or showing predicted actions) to help users understand whether their gestures are being correctly interpreted, thereby improving gesture detection precision while maintaining ease of operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements preliminary gesture recognition where the system begins processing and interpreting gestures before they are fully completed. As the user performs a gesture, the system predicts the intended action based on the gesture's current state and provides preliminary feedback or pre-selection of expected outcomes. This allows the system to prepare for the intended action in advance, improving response time and gesture detection accuracy while making the interaction feel more natural and easier to operate.

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If a wedge-shaped optic and correction lens are added to enable proper viewing, then the adaptability to different viewing conditions is improved, but the device complexity and volume increase

Engineering Contradiction:
Improveviewing adaptabilityVSAvoiddevice volume
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent applies local quality by using a wedge-shaped optic with varying thickness and refractive properties across its surface. Different regions of the wedge-shaped optic provide different optical corrections tailored to specific viewing angles and distances. The correction lens is positioned to provide localized optical compensation for specific areas of the field of view, allowing the system to adapt to different viewing conditions without requiring a complete redesign of the entire optical system, thereby managing device volume while improving viewing adaptability.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user interaction with virtual content through gesture recognition and adaptive display, while maintaining environmental awareness, providing an immersive and interactive augmented reality experience.

Implementation Method 1

a (two surface) freeform wave guide lens enabling TIR bounces

Methodology Applied
Scientific EffectTotal internal reflection: Total Internal Reflection

Implementation Method 2

a wedge-shaped optic (translucent correction lens) adhered to the waveguide lens that enables proper viewing through the lens

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 3

The RGB LED module may emit field sequential color, wherein the different colored LEDs are turned on in rapid succession to form a color image that is reflected off the LCoS display

Methodology Applied
Scientific EffectField sequential color:

Data Source

PatentUS11275482B2Ar glasses with predictive control of external device based on event input
Publication Date: 2022.03.15 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11275482B2 patent drawing
  • US11275482B2 patent drawing
  • US11275482B2 patent drawing

AI summary

This disclosure concerns an interactive head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content, wherein the eyepiece includes predictive control of external device based on an event input.