Image Display Apparatus Gesture Recognition Modulator

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted image display apparatuses are bulky and expensive due to the use of TOF sensors, structured light sensors, or stereo cameras for gesture recognition, which increases the size and load on the user.

Innovation Solution

An image display apparatus with a modulator having a pattern that modulates light intensity, a gesture detecting unit to restore images, and a gesture recognizing unit to specify user gestures, integrated with an image display unit, reducing the need for bulky sensors and optimizing the design for a smaller form factor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If TOF sensor, structured light sensor, or stereo camera is used for gesture recognition, then gesture recognition capability is improved, but apparatus size and weight increase

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidapparatus weight
Core Design Contradiction:
Adaptability or versatilityVSWeight of moving object

Solution Approach 1:

The patent combines the light source function and distance measurement function into a single integrated structure. The light source unit emits light that passes through the modulator to the image sensor, merging what would traditionally be separate TOF sensor components into one compact unit, thereby reducing overall apparatus size while maintaining gesture recognition capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The image sensor serves multiple functions: it acts as both the light receiving element for capturing images and as the distance measurement sensor for gesture recognition. By using the same image sensor for both imaging and depth measurement, the patent eliminates the need for separate bulky sensors, thus reducing apparatus weight while preserving gesture recognition functionality

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If TOF sensor, structured light sensor, or stereo camera is used for gesture recognition, then gesture recognition capability is improved, but apparatus size increases

Engineering Contradiction:
Improvegesture recognition capabilityVSAvoidapparatus volume
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The light source unit and modulator are integrated into a single compact assembly that works in conjunction with the image sensor. This merging of components eliminates the need for separate distance measurement sensor units, significantly reducing the volume occupied by gesture recognition subsystems while maintaining full functionality

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses a patterned modulator that creates virtual depth information through light modulation rather than requiring physical three-dimensional sensor arrays. The pattern information is encoded in the light itself, allowing depth measurement without bulky hardware, thus reducing apparatus volume

Inventive Principle:
Principle #26Copying

3Area of stationary object

If wide angle lens or fisheye lens is used to optimize visual field area, then visual field coverage is improved, but apparatus size increases

Engineering Contradiction:
Improvevisual field areaVSAvoidapparatus volume
Core Design Contradiction:
Area of stationary objectVSVolume of moving object

Solution Approach 1:

The patent achieves wide field of view by changing the optical parameters through software processing rather than using specialized wide-angle or fisheye lenses. By processing the captured image data to expand the perceived visual field, the system achieves wide coverage without the bulk associated with specialized optical lenses

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution reduces the load on the user by minimizing the size and weight of the apparatus while maintaining effective gesture recognition and image display functionality.

Implementation Method 1

a modulator provided on a light receiving surface of the image sensor, the modulator having a first pattern that includes a plurality of patterns different from each other, the modulator being configured to modulate intensity of light

Methodology Applied
Scientific EffectLight modulation:

Implementation Method 2

an image sensor configured to convert an optical image into an image signal and output the converted image signal

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS11662831B2Image display apparatus and image display method
Publication Date: 2023.05.30 MAXELL LTD
  • US11662831B2 patent drawing
  • US11662831B2 patent drawing
  • US11662831B2 patent drawing

AI summary

A modulator of a distance measuring sensor unit 102 has a photographing pattern that includes a plurality of patterns different from each other, and modulates intensity of light. A gesture detecting unit divides image data obtained by receiving light transmitted through the modulator by the image sensor; restores an image by calculation based on a developing pattern corresponding to the photographing pattern in a divided unit; and obtains an image for detecting gesture of a user. This makes it possible to obtain an image of an object in an outside world without using a lens for forming an image. Therefore, it is possible to reduce a load on a user when the user wears the apparatus.