AR Pass-Through Imaging With IR Gesture Recognition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing devices fail to integrate virtual information into a real-time image stream reflecting the wearer's environment, lacking the capability to provide near real-time pass-through of imaging information and gesture recognition.

Innovation Solution

A motion sensory and imaging device with RGB and IR sensors captures stereoscopic imaging information, separates and processes light sources to recognize gestures, and integrates virtual objects with real-world views, enabling near real-time pass-through and gesture recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual reality display is provided to the user, then immersive experience is improved, but integration with real-time image stream of the surrounding environment is lost

Engineering Contradiction:

Improveimmersive experienceVSAvoidintegration with real environment

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system segments the imaging sensors into two distinct types: RGB sensors for capturing visible light and generating pass-through video, and IR sensors for detecting infrared radiation and recognizing gestures. This segmentation allows each sensor type to specialize in its optimal function while working together within the same device, resolving the contradiction between immersive VR experience and real-environment integration.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent merges virtual reality display capabilities with augmented reality pass-through functionality into a single wearable device. The display system can dynamically switch between or combine VR content with real-world video feed, allowing the device to provide both immersive experiences and environmental awareness simultaneously.

Inventive Principle:

Principle #5Merging (Combining)

2Adaptability or versatility

If gesture recognition is implemented, then interaction capability is improved, but processing time and system complexity increase

Engineering Contradiction:

Improveinteraction capabilityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system replaces complex mechanical or computational gesture recognition mechanisms with infrared sensor-based detection. IR sensors naturally detect the thermal radiation from human hands and gestures without requiring complex image processing algorithms, thereby improving interaction capability while minimizing increases in system complexity.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary processing layer that separates gesture recognition processing from the main video processing pipeline. The IR sensor data is processed independently to detect gestures, while the RGB sensor data continues to generate the pass-through video stream, allowing both functions to operate simultaneously without interfering with each other or increasing overall system complexity.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Speed

If near real-time pass-through is provided, then responsiveness is improved, but processing speed requirements increase

Engineering Contradiction:

ImproveresponsivenessVSAvoidprocessing speed

Core Design Contradiction:

SpeedVSProductivity

Solution Approach 1:

The imaging system is segmented into parallel processing pipelines: one for RGB pass-through video and another for IR gesture recognition. This segmentation allows each pipeline to process its data independently at optimized speeds, with the RGB pipeline focused on maintaining real-time video flow and the IR pipeline focused on rapid gesture detection, thereby improving overall responsiveness without overwhelming a single processing channel.

Inventive Principle:

Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables improved user experience and functionality by providing near real-time imaging and gesture recognition, allowing intuitive interaction with virtual objects and enhanced interfacing with wearable devices.

Implementation Method 1

a plurality of imaging sensors arranged to provide stereoscopic imaging information for a scene being viewed

Methodology Applied

Scientific EffectLight detection: Reflection

Implementation Method 2

separate information received from pixels sensitive to IR light from information received from pixels sensitive to visible light

Methodology Applied

Scientific EffectInfrared radiation detection: Infrared Radiation

Data Source

PatentUS12556674B2Augmented reality with motion sensing

Publication Date: 2026.02.17 SIM IP HXR LLC

AI summary

A motion sensory and imaging device capable of acquiring imaging information of the scene and providing at least a near real time pass-through of imaging information to a user. The sensory and imaging device can be used stand-alone or coupled to a wearable or portable device to create a wearable sensory system capable of presenting to the wearer the imaging information augmented with virtualized or created presentations of information.