Gaze Point Pickup in 3D Display Spaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current three-dimensional display technologies face challenges in user interaction, particularly in selecting objects within a three-dimensional space, as users often need to move extensively to select objects, leading to inconvenient and inefficient operations, especially in large or densely populated scenes.

Innovation Solution

A pickup device and method that utilize a processor and memory to acquire gaze point information and determine the object picked up by a user based on gaze point location, motion posture, and object distribution within the display space, allowing for convenient and accurate object selection using gaze alone.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user moves their location or body parts to select an object in three-dimensional space, then the user can physically reach and select the object, but the operation becomes inconvenient and inefficient, especially in large scenes requiring extensive movement

Engineering Contradiction:
Improveobject selection convenienceVSAvoidtime for object selection
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces the mechanical system of physical movement (user moving location or body parts) with an optical system (gaze point detection). The eye tracking device detects where the user is looking, and the processor determines the corresponding object in three-dimensional space, eliminating the need for physical displacement while maintaining accurate object selection capability

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary system consisting of the eye tracking device and processor that mediates between the user's visual attention and object selection. Instead of direct physical interaction requiring movement, the user's gaze serves as an intermediary signal that the system translates into object selection, significantly improving ease of operation and reducing time loss

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If the three-dimensional display scene is large or densely populated with objects, then the display capacity and information richness are improved, but the difficulty of selecting a specific object increases

Engineering Contradiction:
Improvenumber of objects in displayVSAvoidobject selection accuracy
Core Design Contradiction:
Quantity of substanceVSDifficulty of detecting and measuring

Solution Approach 1:

The patent replaces imprecise mechanical selection methods (manual navigation through large scenes) with precise optical detection (eye gaze tracking). The eye tracking device can accurately detect the user's line of sight even in densely populated three-dimensional scenes, and the processor calculates the corresponding object coordinates, maintaining high selection accuracy regardless of scene complexity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements a feedback mechanism where the system continuously monitors the user's gaze point and provides real-time object selection based on visual attention. This feedback loop allows the system to adapt to the user's intended selection dynamically, improving both accuracy and efficiency in large or densely populated displays by constantly adjusting to the user's focal point

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9961335B2Pickup of objects in three-dimensional display
Publication Date: 2018.05.01 BEIJING ZHIGU RUI TUO TECH
  • US9961335B2 patent drawing
  • US9961335B2 patent drawing
  • US9961335B2 patent drawing

AI summary

A pickup device and method for an object in three-dimension display are disclosed. The device comprises a gaze point information acquisition module for acquiring a first location information about a gaze point of an eye of a user with respect to the user; and an object determination module for determining an object picked up by the user according to a second location information about the user in a display space, motion posture information about the user, the first location information and distribution information about objects in the display space. A technical solution of the present application determines an object picked up by a user by means of the location of a gaze point of an eye, making it natural and convenient to pick up an object in a three-dimension display space.