Eye Tracking Apparatus for Stable 3D Virtual Object Perception

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current user interfaces, such as mice and touch displays, are limited to two-dimensional interactions, whereas humans interact with three-dimensional spaces naturally, necessitating a method to enable effective interaction with electronic devices in a three-dimensional environment.

Innovation Solution

An apparatus and method utilizing a processor to generate left and right eye image positions based on user eye position data, allowing a virtual object to be perceived at a fixed position independent of user movement, by adjusting left and right eye image data to maintain a stable object perception in three-dimensional space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional two-dimensional pointing devices (mouse, touchpad) are used for interaction, then the device complexity remains low, but the adaptability to three-dimensional interaction is insufficient

Engineering Contradiction:
Improveadaptability to three-dimensional interactionVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces mechanical pointing devices (mouse, touchpad) with an optical-based eye tracking system. The processor detects pupil positions through image data and calculates image positions based on eye position data, substituting mechanical interaction with optical detection and computational processing to enable three-dimensional interaction

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces eye position data as an intermediary between the user and the virtual object. The processor obtains image data, determines pupil positions from this data, and uses the eye position data as a mediator to calculate appropriate left and right eye image positions, enabling natural three-dimensional interaction

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If static left and right eye image positions are used, then the device complexity is low, but the stability of object perception position deteriorates when user moves

Engineering Contradiction:
Improvestability of object perception positionVSAvoiddevice complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent implements dynamic adjustment of left and right eye image positions based on real-time eye position data. Instead of using fixed static positions, the processor continuously calculates and updates image positions according to the user's current eye position, maintaining stable object perception as the user moves their head or eyes

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent establishes a feedback loop where the processor obtains image data, determines pupil positions, and uses this eye position data to adjust the left and right eye image positions. This feedback mechanism ensures that the virtual object remains at a stable perceived position by continuously adapting to the user's eye movements

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10216357B2Apparatus and method for controlling the apparatus
Publication Date: 2019.02.26 SONY GROUP CORP
  • US10216357B2 patent drawing
  • US10216357B2 patent drawing
  • US10216357B2 patent drawing

AI summary

An apparatus including a processor configured to: obtain image data representing an object for being displayed to a user, wherein the object is displayed on the basis of left eye image data and right eye image data obtained on the basis of the image data; obtain user eye position data representing a left pupil position and a right pupil position of the user; and generate a left eye image position for the left eye image data and a right eye image position for the right eye image data on the basis of the user eye position data.