Eye Tracking Virtual Tagging for Social Immersive Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current social networking and immersive technologies, such as virtual and augmented reality, lack effective methods to identify and tag objects of interest in real-time based on user attention, leading to inefficiencies in user interaction and information sharing.

Innovation Solution

The system employs an eye-tracking system to determine the orientation and focus of a user's gaze, identifying points of interest and determining their candidacy for tagging through dwell time and contextual factors, followed by a tagging action that facilitates virtual tagging within a social networking environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual tagging methods are used in virtual reality environments, then users can tag objects of interest, but the process is time-consuming and inefficient

Engineering Contradiction:
Improvetagging efficiencyVSAvoidtime required for tagging
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system enables automatic tagging by detecting user gaze through eye-tracking technology and automatically identifying objects of interest without requiring manual user input. The system serves itself by using the user's natural viewing behavior to trigger tagging actions, eliminating the need for manual tagging operations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical tagging actions with an automated optical detection system. Eye-tracking technology detects gaze orientation and combines it with object recognition algorithms to automatically identify and tag objects, substituting the mechanical manual tagging process with an automated sensing and processing system.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Extent of automation

If eye-tracking systems are implemented to detect user gaze, then automatic identification of objects of interest is enabled, but system complexity increases

Engineering Contradiction:
Improveautomatic object identificationVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system integrates multiple functions into a unified platform that combines eye-tracking detection, object recognition, virtual tagging, and social networking capabilities. This multi-functional approach allows the same system to perform gaze detection, automatic tagging, and social sharing without requiring separate dedicated systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary processing layer that combines gaze detection data with object recognition results. This intermediary system processes the raw eye-tracking data and matches it with detected objects in the environment, serving as a mediator between the eye-tracking hardware and the tagging functionality, thereby managing system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If virtual tagging is implemented in social networking environments, then user interaction and information sharing are enhanced, but measurement precision of user attention is required

Engineering Contradiction:
Improveuser attention informationVSAvoidgaze detection accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The system uses feedback from eye-tracking data to continuously monitor and adjust tagging decisions. By analyzing gaze duration, gaze position, and user interactions with tagged objects, the system refines its understanding of user attention and improves the accuracy of automatic tagging over time through iterative feedback loops.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables real-time identification and tagging of objects of interest, enhancing user interaction and information sharing by accurately reflecting user attention and interest within immersive environments.

Implementation Method 1

determining, using an eye-tracking system, an orientation of at least one eye of a user

Methodology Applied
Scientific EffectEye tracking:

Data Source

PatentUS10831267B1Systems and methods for virtually tagging objects viewed by friends and influencers
Publication Date: 2020.11.10 META PLATFORMS TECHNOLOGIES LLC
  • US10831267B1 patent drawing
  • US10831267B1 patent drawing
  • US10831267B1 patent drawing

AI summary

The disclosed computer-implemented method may include (i) determining, using an eye-tracking system, an orientation of at least one eye of a user, (ii) identifying, based at least in part on the orientation of the user's eye, a point of interest within a field of view of the user, (iii) determining that the point of interest is a candidate for tagging, and (iv) performing, in response to determining that the point of interest is the candidate for tagging, a tagging action that facilitates tagging of the point of interest. Various other methods, systems, and computer-readable media are also disclosed.