Dual Pass-Through Imaging System for Extended Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video see-through display apparatuses face issues with image quality due to infrared light interference, requiring additional depth cameras that increase bulkiness and cost, while also needing accurate depth information and gesture recognition.

Innovation Solution

An imaging system with a wide-angle image-sensor chip and a narrow-angle image-sensor chip, along with a semi-transparent reflective element and infrared filters, captures high-resolution images and depth information using infrared light, eliminating the need for additional depth cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If infrared filters are used to block infrared light transmission towards visible-light cameras, then image quality is improved, but additional depth cameras are required to capture depth information, increasing device complexity and cost

Engineering Contradiction:
Improveimage qualityVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent combines depth information capture and visible light imaging into a single camera by integrating an infrared filter with a transparent region. This allows the same imaging unit to capture both high-quality visible light images (with infrared blocked) and depth information (through the transparent region), eliminating the need for separate depth cameras and reducing device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The imaging unit is designed to perform multiple functions: capturing visible light images with high quality by blocking infrared light, and simultaneously capturing depth information through the transparent region of the infrared filter. This multi-functional design replaces what would traditionally require separate cameras for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If additional depth cameras are employed to capture depth information and enable gesture recognition, then measurement precision is improved, but the display apparatus becomes bulky and cost increases

Engineering Contradiction:
Improvedepth information accuracyVSAvoiddisplay apparatus size
Core Design Contradiction:
Measurement precisionVSVolume of moving object

Solution Approach 1:

The patent merges the depth sensing function with the visible light camera by using a single imaging unit equipped with a specialized infrared filter. The transparent region of the filter allows infrared light to pass through for depth capture, while the opaque region blocks infrared light for high-quality visible imaging. This integration eliminates additional depth cameras and reduces the overall device volume.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If visible-light cameras are used to capture real-world environment images, then ease of operation is improved, but infrared light interference degrades image quality

Engineering Contradiction:
Improveoperation simplicityVSAvoidimage quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent extracts the harmful infrared light component from the light spectrum reaching the camera sensor by using an infrared filter with a transparent region. This filter selectively blocks infrared wavelengths while allowing visible light to pass through, thereby removing the source of interference and enabling high-quality visible light imaging without compromising operational simplicity.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances image quality by blocking infrared light interference and provides accurate depth information for extended-reality applications without the need for additional depth cameras, reducing bulkiness and cost.

Implementation Method 1

a first infrared filter arranged, on an optical path between the semi-transparent reflective element and the first image-sensor chip, to block transmission of infrared light towards the first image-sensor chip

Methodology Applied
Scientific EffectInfrared filtering: Filter (optical)

Implementation Method 2

means for transmitting infrared light received from the overlapping field of view towards the second image-sensor chip, whilst blocking transmission of infrared light received from the non-overlapping field of view towards the second image-sensor chip

Methodology Applied
Scientific EffectInfrared filtering with selective transmission: Filter (optical)

Implementation Method 3

a semi-transparent reflective element arranged to reflect a portion of light received from a real-world environment towards the first image-sensor chip, whilst transmitting another portion of the light towards the second image-sensor chip

Methodology Applied
Scientific EffectPartial reflection and transmission: Reflection

Data Source

PatentUS10798332B1Dual pass-through imaging system and method
Publication Date: 2020.10.06 VARJO TECH OY
  • US10798332B1 patent drawing
  • US10798332B1 patent drawing
  • US10798332B1 patent drawing

AI summary

An imaging system including infrared light source, imaging unit and processor. Imaging unit includes first and second image-sensor chips, semi-transparent reflective element, infrared filter arranged to block transmission of infrared light towards first image-sensor chip, and means for transmitting infrared light received from overlapping field of view towards second image-sensor chip, whilst blocking transmission of infrared light received from non-overlapping field of view towards second image-sensor chip. First and second image-sensor chips are controlled to capture first and second images of real-world environment, wherein portion of second image-sensor chip that receives infrared light from overlapping field of view captures depth information pertaining to overlapping field of view. Extended-reality image is generated from first and second images, based on depth information.