Gaze-Adaptive Display Using Micro-Prism Arrays and Optical Shutter

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional display apparatuses for virtual, augmented, and mixed reality environments face challenges such as complex optical element arrangements, high power consumption due to moving components, and bulkiness, leading to increased latency and cumbersome designs.

Innovation Solution

A display apparatus that detects gaze direction to generate and render images with spatially-variable angular resolution using micro-prisms, an optical combiner, and an optical shutter, allowing for dynamic image adjustment without physical movement of optical components, thus simplifying the arrangement, reducing power consumption, and enhancing compactness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If actuators are employed to physically move optical elements for gaze direction adjustment, then the device can dynamically adapt to user gaze, but power consumption increases and latency is introduced

Engineering Contradiction:
Improvegaze direction adaptationVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent replaces the mechanical actuator system with an optical modulation system. Instead of physically moving optical elements, the invention uses spatial light modulators and micro-prism arrays that can be controlled electronically to achieve the same gaze-direction-dependent optical effect, thereby eliminating the need for high-power actuators and reducing latency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the control parameter from physical position (mechanical movement) to optical properties (light modulation). By using spatial light modulators and micro-prism arrays that can be dynamically adjusted through electrical signals, the system achieves gaze adaptation without the power consumption and latency associated with mechanical actuation.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If actuators are employed to physically move optical elements, then dynamic gaze adjustment is achieved, but latency increases due to slow physical movement

Engineering Contradiction:
Improvegaze direction adjustmentVSAvoidlatency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent eliminates mechanical movement by replacing actuators with electronically controlled optical modulators. The spatial light modulators and micro-prism arrays can respond to gaze changes instantaneously through electrical signal control, removing the inherent latency of mechanical systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements a dynamic optical system that responds to gaze changes in real-time through electrical control rather than mechanical movement. The spatial light modulators and micro-prism arrays can be rapidly reconfigured by changing electrical parameters, enabling instantaneous adaptation to gaze direction changes.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If space is provided for movement of optical elements, then dynamic adjustment is possible, but device size increases and design becomes bulky

Engineering Contradiction:
Improveoptical element adjustmentVSAvoiddevice size
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent replaces the need for mechanical movement space with compact electronic control components. The spatial light modulators and micro-prism arrays can be integrated into a compact form factor, eliminating the need for large mechanical adjustment mechanisms and reducing overall device volume.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent integrates multiple optical functions into a compact nested arrangement. The micro-prism arrays are positioned in proximity to the image rendering surface of the second image renderer, with optical elements and shutters arranged in a space-efficient configuration that minimizes device size while maintaining full functionality.

Inventive Principle:
Principle #7Nested doll (Nesting)

4Adaptability or versatility

If complex arrangements of optical elements are used, then advanced optical functionality is achieved, but device complexity increases

Engineering Contradiction:
Improveoptical functionalityVSAvoidarrangement complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the optical system into distinct functional modules: first image renderer, second image renderer, micro-prism arrays, spatial light modulators, and optical shutters. Each module performs a specific function and can be independently optimized, simplifying the overall design and manufacturing process while maintaining advanced optical functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses multi-functional components that perform multiple roles. For example, the spatial light modulators serve both as beam directors and as intensity modulators, while the micro-prism arrays simultaneously achieve light splitting and directional control. This reduces the total number of components needed and simplifies the overall system architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables the production of output images with spatially-variable angular resolutions, reducing latency and power consumption while maintaining a compact design, thereby improving user experience in immersive environments.

Implementation Method 1

the micro-prisms of the first array split light emanating from pixels of the second image renderer into a plurality of directions to produce a plurality of projections of the second image

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

an optical element arranged on an optical path between the first array of micro-prisms and the optical combiner, the optical element being employed to direct the plurality of projections of the second image towards the optical combiner

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 3

an optical shutter arranged on said optical path, between the optical element and the optical combiner, wherein the optical shutter selectively allows a given portion of the plurality of projections of the second image to pass through towards the optical combiner, whilst blocking a remaining portion

Methodology Applied
Scientific EffectAbsorption: Absorption (EM radiation)

Implementation Method 4

the optical combiner optically combines a projection of the first image with the given portion of the plurality of projections of the second image, to produce on the image plane an output image having a spatially-variable angular resolution

Methodology Applied
Scientific EffectSuperposition: Interference

Data Source

PatentUS10764567B2Display apparatus and method of displaying
Publication Date: 2020.09.01 VARJO TECH OY
  • US10764567B2 patent drawing
  • US10764567B2 patent drawing
  • US10764567B2 patent drawing

AI summary

A display apparatus includes means for detecting gaze direction of user; processor configured to process input image based upon gaze direction to generate first and second images; first and second image renderers to render first and second images; optical combiner; first array of micro-prisms to split light emanating from second image renderer into multiple directions to produce multiple projections of second image; optical element to direct said multiple projections towards optical combiner; and optical shutter arranged between optical element and optical combiner, wherein optical shutter allows given portion of said multiple projections to pass, whilst blocking remaining portion of said multiple projections. The optical combiner optically combines projection of first image with given portion of said multiple projections, to produce on image plane output image having spatially-variable angular resolution. The processor controls optical shutter based upon detected gaze direction, whilst first and second images are being rendered.