AR Glasses Invisible Light Coregistration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality glasses fail to effectively coregister invisible light information, such as near-infrared rays, directly onto a real space during medical procedures, leading to inconvenience and safety concerns due to reliance on external cameras and potential vergence-accommodation conflicts, which limit their usability and field of view.

Innovation Solution

Augmented reality glasses with an integrated invisible light emission unit, input unit, information processing unit, and image output unit that convert invisible light into visible light for direct recognition, along with focus adjustment and eyeball tracking to ensure precise coregistration and wide field of view, addressing safety and usability issues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If near-infrared rays are converted into visible light and displayed on a monitor, then near-infrared information becomes recognizable, but the clinician must turn gaze to the monitor continuously, reducing operational efficiency and safety

Engineering Contradiction:
Improvenear-infrared information recognitionVSAvoidclinician operational efficiency
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces an augmented reality glass system as an intermediary device that captures near-infrared light and superimposes it onto the real surgical field view. The waveguide acts as an optical intermediary, guiding the converted visible light image information directly into the clinician's eye while maintaining alignment with the real space, eliminating the need to shift gaze to a separate monitor.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent merges the near-infrared diagnostic information with the visible real-space view by superimposing the converted image onto the actual surgical field. This combination allows the clinician to simultaneously observe both the real surgical area and the near-infrared diagnostic information in a single unified view through the augmented reality glass.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If existing augmented reality glasses are used to display near-infrared information, then information visualization is achieved, but precise coregistration on invisible light information to real space is not performed

Engineering Contradiction:
Improvenear-infrared information visualizationVSAvoidcoregistration precision
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent employs eye-tracking technology that continuously monitors the clinician's gaze position and provides feedback to the system. This feedback enables real-time adjustment of the augmented reality image position and focus, ensuring precise coregistration of the near-infrared information with the actual surgical field as the user's head and eyes move.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts the augmented reality display parameters including image position, focus distance, and brightness based on real-time eye-tracking data and user movement. This dynamic adaptation ensures continuous precise coregistration between the invisible light information and the real surgical space regardless of user position changes.

Inventive Principle:
Principle #15Dynamics

3Loss of information

If virtual reality glasses use multiple cameras to recognize real space, then real space recognition is achieved, but reliance on cameras without direct recognition causes safety concerns in medical settings

Engineering Contradiction:
Improvereal space recognitionVSAvoidmedical site safety acceptance
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The waveguide serves as an optical intermediary that directly guides light from the surgical field into the user's eye without requiring camera capture and digital reconstruction. This direct optical path preserves the authenticity and reliability of the real-space view while still enabling augmented reality information overlay, addressing safety concerns about camera-based systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Instead of using cameras to create digital copies of the real space, the system uses optical waveguides to physically guide and superimpose additional information onto the direct view of the real surgical field. This approach maintains the authenticity of the original optical scene while adding diagnostic information, reducing safety concerns associated with camera-based virtual reality systems.

Inventive Principle:
Principle #26Copying

4Loss of information

If augmented reality glasses superimpose digital image on real workspace within arm's length, then information overlay is achieved, but vergence-accommodation conflict occurs causing dizziness and limiting long-term use

Engineering Contradiction:
Improveinformation overlay capabilityVSAvoidlong-term usability
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system dynamically adjusts the focus distance of the augmented reality image to match the user's actual gaze distance on the surgical field. By continuously adapting the focal plane based on eye-tracking data, the system maintains vergence-accommodation alignment, preventing dizziness and enabling comfortable long-term use while preserving information overlay capability.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables direct and precise coregistration of invisible light information onto a real space, reducing the need for external monitoring and minimizing vergence-accommodation conflicts, thereby enhancing surgical efficiency and safety by providing a stable and wide field of view.

Implementation Method 1

an invisible light emission unit (100) installed on one side of the glasses body and configured to emit invisible light (20) toward a target object (10)

Methodology Applied
Scientific EffectNear-infrared light emission: Infrared Radiation

Implementation Method 2

The indocyanine green easily absorbs light of a near-infrared light source ranging from 600 nm to 900 nm and emits fluorescent near-infrared light ranging from 750 nm to 950 nm

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 3

an input unit (200) installed on a front surface of the glasses body and configured to input the invisible light (20) emitted from the target object (10) together with visible light (30) to a waveguide (300)

Methodology Applied
Scientific EffectOptical waveguide transmission: Waveguide (optics)

Implementation Method 4

an information processing unit (400) installed on one side of the glasses body and configured to convert invisible light image information received from the input unit (200) into visible light image information (40) which is recognizable by a person

Methodology Applied
Scientific EffectPhotoconversion: Photoelectric Effect

Implementation Method 5

an image output unit (500) installed on a rear surface of the glasses body and configured to receive the visible light image information (40) processed in the information processing unit (400) and output an image toward two eyeballs (50) of the user through the waveguide (300)

Methodology Applied
Scientific EffectOptical transmission through waveguide: Waveguide (optics)

Implementation Method 6

a focus adjustment unit (600) installed on one side of the glasses body and configured to adjust a point at which gazes of the two eyeballs (50) converge to exactly match a focus of real and augmented reality image information (31, 40) output from the image output unit (500)

Methodology Applied
Scientific EffectFocus adjustment: Focusing

Data Source

PatentUS11609425B2Augmented reality glasses with auto coregistration of invisible field on visible reality
Publication Date: 2023.03.21 PUKYONG NAT UNIV IND ACADEMIC COOPERATION FOUND
  • US11609425B2 patent drawing
  • US11609425B2 patent drawing
  • US11609425B2 patent drawing

AI summary

Augmented reality glasses with auto coregistration of an invisible field on visible reality which allows eyes to recognize a real space and precisely performs coregistration on only diagnosis and treatment information of invisible light, which is emitted from a specific area, to the real space.