Eye Tracking for 3D Viewing on Conventional Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional 2D displays such as home televisions lack the capability to provide a 3D viewing experience without the need for special 3D glasses or specialized display technology, which is costly and not well-suited for large screens, limiting the availability of immersive 3D imaging at home.

Innovation Solution

The technology enables 3D viewing on conventional 2D displays by tracking a person's viewpoint, using wide field of view tracking and object placement to create a parallax effect, allowing players to dodge projectiles and game characters to be aware of the player's location, even without special glasses, through head/eye tracking and 3D space modeling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If specialized 3D display devices are used to provide 3D viewing without glasses, then 3D viewing experience is improved, but device cost and complexity increase significantly

Engineering Contradiction:
Improve3D viewing experienceVSAvoiddisplay device complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an eye tracking system as an intermediary between the viewer and the 2D display. The tracker detects eye position and gaze direction, then feeds this information to the image generator, which adjusts the displayed image to create a 3D effect. This mediator approach enables 3D viewing on standard 2D displays without requiring specialized display hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/optical complexity of specialized 3D display devices with an electronic solution using eye tracking and software-based image generation. Instead of using complex display hardware like lenticular displays or holographic screens, the system uses a camera-based or infrared eye tracker combined with image processing to achieve the same 3D effect on a conventional display.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If stereoscopic images are encoded in different colors with 3D glasses, then 3D viewing experience is improved, but usability deteriorates due to requiring special glasses

Engineering Contradiction:
Improve3D viewing experienceVSAvoidviewing flexibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system uses the viewer's own eyes as the tracking target. The eye tracker monitors the viewer's eye position and gaze direction, and the image generator automatically adjusts the displayed image based on this information. This self-service approach eliminates the need for external devices like 3D glasses, allowing the viewer to naturally watch content without additional accessories.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If viewpoint tracking is implemented on conventional 2D displays, then 3D viewing capability is improved, but measurement precision requirements increase

Engineering Contradiction:
Improve3D viewing capabilityVSAvoidviewpoint detection precision
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent changes the parameters of the displayed image based on eye tracking data. The image generator adjusts parameters such as perspective, focal point, and depth mapping according to the detected eye position and gaze direction. This dynamic parameter adjustment creates the 3D effect by rendering images from different viewpoints corresponding to the viewer's actual eye position.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution transforms conventional 2D displays into 3D imaging systems, providing a realistic 3D experience with enhanced game play capabilities, such as collision-related logic and physical presence, using single or multiple point tracking for viewpoint detection, and wearable markers or cameras for accurate user motion tracking.

Implementation Method 1

tracking a user's eye or head position with an eye tracker

Methodology Applied
Scientific EffectEye tracking:

Implementation Method 2

generating a 3D image in response to the detected viewpoint movement... using wide field of view tracking and object placement to create a parallax effect

Methodology Applied
Scientific EffectParallax effect: Parallax

Data Source

PatentUS10372209B2Eye tracking enabling 3D viewing
Publication Date: 2019.08.06 NINTENDO CO LTD
  • US10372209B2 patent drawing
  • US10372209B2 patent drawing
  • US10372209B2 patent drawing

AI summary

The exemplary illustrative non-limiting technology herein enables 3D viewing on conventional 2D displays such as home television sets by tracking a person's viewpoint. Detecting a player's viewpoint movement to change the viewing of the displayed object gives the illusion that the object is physically present in three-dimensional space. Viewpoint movement detection can provide collision-related game logic benefits such as allowing a player to dodge projectiles, giving a game character an ability to “see” the player when not behind line-of-sight obstacles, and other advantages.