Real-Time Communication Interfaces Using Eye Tracking in Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods and interfaces for real-time communication in augmented and mixed reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and inefficient energy usage, particularly in battery-operated devices.
Innovation Solution
Implementing a computer system with improved user interfaces that allow for spatially-constrained and spatially-flexible representations of participants in a three-dimensional environment, enabling intuitive interaction through touch, eye, and hand tracking, and voice inputs, reducing the number and nature of user inputs required.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional real-time communication interfaces are used in augmented reality environments, then basic communication functionality is achieved, but user interaction becomes cumbersome and cognitively burdensome
Solution Approach 1:
The system automatically detects user intent through eye tracking and gaze detection, eliminating the need for manual input selection. The interface serves itself by interpreting gaze direction and duration to determine user intent, reducing cognitive burden and interaction steps while maintaining communication functionality
Solution Approach 2:
The patent replaces traditional mechanical input methods (buttons, switches, manual navigation) with optical detection systems (eye tracking, gaze detection). This substitution enables more natural and efficient interaction by detecting user intent through visual attention rather than requiring physical manipulation of interface elements
2Productivity
If multiple input steps are required to achieve desired outcomes in virtual environments, then precise control is achieved, but interaction time increases and energy consumption rises
Solution Approach 1:
The system performs preliminary detection of user intent through continuous eye tracking and gaze analysis. By detecting where the user is looking and for how long before an interaction is initiated, the system prepares for upcoming actions in advance, reducing the number of discrete input steps required and thereby decreasing both interaction time and energy consumption
Solution Approach 2:
The eye tracking system operates continuously to monitor user gaze and intent, rather than activating only during discrete input events. This continuous detection enables the system to anticipate and prepare for interactions, maintaining a state of readiness that reduces latency and minimizes the energy required for each individual interaction event
Data Source
AI summary
The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for real-time communications.