Multifactor Eye Position Identification in Display Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for simulating the parallax effect in computer-generated images, such as using collimated displays, are expensive and unsuitable for smaller simulators, and simpler projection-based methods result in jittery and unrealistic images.

Innovation Solution

A display system that determines a viewer's sightline by defining three factors: lateral position between the chin and waistline, depth position, and eye-level height, using various tracking methods like image recognition and infrared reflectors, to generate fluid and realistic stereoscopic images without tracking frequent head movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If collimated displays are used to simulate the parallax effect, then the parallax effect is accurately replicated, but the system becomes expensive and requires large mirrors making it unsuitable for smaller simulators

Engineering Contradiction:
Improveparallax effect accuracyVSAvoiddisplay system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses image capture devices (cameras) to capture images of the display screen from multiple positions, creating a digital copy of the visual information. These captured images are then processed and displayed on a standard projection screen, replicating the parallax effect without requiring expensive collimated display hardware or large mirrors.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/optical system of collimated displays with an electronic image processing system. Instead of using physical mirrors and collimated light paths, the system uses digital image capture, processing, and display to achieve the same parallax effect, thereby simplifying the mechanical complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If simple projection screens are used to simulate the parallax effect based on eye position, then the system becomes simpler and more affordable, but the resulting image becomes jittery and unrealistic

Engineering Contradiction:
Improvedisplay system simplicityVSAvoidimage realism
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements dynamic tracking of the viewer's eye position using image capture devices and processing algorithms. The displayed image is continuously adjusted based on the real-time eye position, creating a dynamic parallax effect that eliminates jitter and maintains realism as the viewer moves their head or eyes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses image capture devices to continuously monitor the viewer's eye position and feeds this information back to the image generation process. This feedback loop allows the system to adjust the displayed image in real-time, maintaining image stability and realism while using a simple projection screen.

Inventive Principle:
Principle #23Feedback

3Reliability

If frequent head movements are tracked to maintain image accuracy, then the parallax effect remains realistic, but the system complexity and computational requirements increase

Engineering Contradiction:
Improveparallax effect accuracyVSAvoidtracking system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts only the essential information needed for parallax simulation - the viewer's eye position - using image capture devices that detect key facial features. By focusing on specific anatomical landmarks (eyes, nose, mouth) rather than tracking every head movement, the system achieves accurate parallax effects with reduced computational complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses image recognition to detect facial features and estimate eye position without requiring precise tracking of every head movement. This partial action approach - detecting only the necessary visual cues - provides sufficient accuracy for parallax simulation while keeping the system simpler and more computationally efficient.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides a cost-effective and realistic simulation of the parallax effect, improving image fluidity and immersion in computer simulations by accurately calculating the viewer's sightline and generating stereoscopic images based on these factors.

Implementation Method 1

using various tracking methods like image recognition and infrared reflectors

Methodology Applied
Scientific EffectImage recognition:

Implementation Method 2

using various tracking methods like image recognition and infrared reflectors

Methodology Applied
Scientific EffectInfrared reflection: Reflection

Data Source

PatentEP3278321B1Multifactor eye position identification in a display system
Publication Date: 2021.09.08 CAE INC
  • EP3278321B1 patent drawingFigure 1
  • EP3278321B1 patent drawingFigure 2
  • EP3278321B1 patent drawingFigure 3

AI summary

A display system comprising a display screen for displaying a stream of images, a viewer positioning module and an image generator module. The viewer positioning module is for determining a viewer's sightline by defining a first factor of the sightline as a lateral position of a viewer's body part located between the viewer's chin and the viewer's waistline, defining a second factor of the sightline as a depth position of the body part and computing the sightline based at least on the first factor and the second factor. The image generator module is for generating the stream of images considering the determined sightline. A method comprising defining the first factor, defining the second factor, computing the sightline based at least on the first factor and the second factor, generating the stream of images considering the determined sightline and displaying the stream of images on a first display screen.