AR VR Private Chat via Mutual Eye Contact

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) and virtual reality (VR) systems lack intuitive and easy-to-establish communication channels between users, particularly in scenarios where mutual consent and control are essential, such as eye contact-based interactions.

Innovation Solution

Implementing eye tracking technology to detect mutual eye contact between users in AR and VR settings, establishing a private communication channel only when eye contact is maintained, with optional termination via verbal cues or specific eye signals, and allowing access to third users based on shared gaze direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional communication channels are used in AR/VR settings, then communication can be established, but it lacks intuitive control and mutual consent mechanisms

Engineering Contradiction:
Improveintuitiveness of communication channel establishmentVSAvoidcontrol mechanism complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical or manual communication channel initiation (buttons, menus, voice commands) with an optical/biological mechanism: eye tracking. The system detects mutual eye contact between users to automatically establish private communication channels, substituting physical interaction with physiological signal detection. This makes communication more intuitive while maintaining simple system architecture.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If eye tracking is implemented to detect mutual eye contact, then intuitive communication channel establishment is achieved, but system complexity and computational requirements increase

Engineering Contradiction:
Improveease of communication channel establishmentVSAvoideye tracking system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent leverages the existing multi-functional eye tracking hardware already present in AR/VR headsets for its primary purpose of rendering and user interaction. By repurposing this existing component for communication channel establishment, the system avoids adding dedicated hardware while achieving intuitive communication control. The eye tracking system serves multiple functions: rendering feedback, user interaction, and communication initiation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the users' own physiological signals (eye movements and contact) to automatically initiate communication channels without requiring external control inputs. The users' natural eye behavior serves the dual purpose of both indicating communication intent and providing the control mechanism, eliminating the need for separate control interfaces.

Inventive Principle:
Principle #25Self-service

3Reliability

If mutual eye contact is required to establish communication channels, then user control and privacy are improved, but the time to establish communication increases

Engineering Contradiction:
Improveuser control and privacy assuranceVSAvoidtime to establish communication channel
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system employs periodic sampling of eye tracking data at predefined intervals to detect mutual eye contact. Rather than requiring continuous verification, the system checks eye contact status at regular intervals, allowing communication channels to be established quickly once mutual gaze is detected, while still maintaining reliable user control through the periodic verification mechanism.

Inventive Principle:
Principle #19Periodic action

4Ease of operation

If eye tracking technology is used for communication channel establishment, then intuitive and consensual communication is achieved, but energy consumption increases

Engineering Contradiction:
Improveintuitiveness of communication controlVSAvoidenergy consumption of eye tracking system
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The eye tracking system operates continuously in the background before communication is needed, pre-processing visual data and maintaining readiness to detect mutual eye contact. This preliminary action allows the system to instantly establish communication channels when eye contact occurs, avoiding the need for intensive real-time processing only during communication initiation, thereby reducing peak energy consumption.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11287880B2Privacy chat trigger using mutual eye contact
Publication Date: 2022.03.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11287880B2 patent drawing
  • US11287880B2 patent drawing
  • US11287880B2 patent drawing

AI summary

Player-to-player eye contact is used to establish a private chat channel in an augmented reality (AR) or virtual reality (VR) setting. Since maintaining eye contact requires agreement from both parties, it allows both players an equal amount of control when performing the mutual action. Eye tracking may be used for determining whether mutual eye contact has been established. In the case of AR, “inside out” eye tracking can be used, whereas in a VR setting only inside eye tracking need be used. Techniques are described to confirm and establish a channel once eye contact has been held.