Gaze-Based Communication Routing in Group Sessions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In electronic communication sessions, it is difficult for users to direct information to specific individuals without interrupting the group or providing cues that indicate attention, as remote users receive similar audio or video transmissions without clear visual cues.
Innovation Solution
Implementing gaze-based controls that detect a user's head and eye movement to determine their gaze direction, allowing for the transmission of audio or video to specific users based on their focus, enabling private communication within a group session by spatially assigning and evaluating the user's gaze direction relative to interface elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If all remote users receive similar audio or video transmissions, then information exchange is maintained across the group, but it becomes difficult to direct communication to specific individuals without interrupting the group flow
Solution Approach 1:
The system automatically determines which remote user should receive the communication by analyzing the user's gaze direction and comparing it with the spatial positions of remote users on the interface. This eliminates the need for manual selection of recipients, allowing users to naturally direct communication through eye movement alone.
Solution Approach 2:
The patent replaces manual mechanical actions (such as clicking, typing, or verbally stating the recipient's name) with gaze-based control. The system detects eye movement and head position to automatically identify the intended recipient, substituting physical interaction with optical detection.
2Ease of operation
If gaze detection is implemented to direct private messages, then natural communication is enabled, but the system complexity increases due to head and eye movement detection requirements
Solution Approach 1:
The system uses the existing camera and display components for multiple purposes: the camera captures both video of remote users and images of the user's eyes, while the display shows both the communication interface and serves as a reference for determining gaze direction. This multi-functionality reduces the need for dedicated gaze detection hardware.
Solution Approach 2:
The display interface acts as an intermediary between the user's gaze and the communication system. By determining the spatial positions of remote users on the display and comparing them with the detected gaze direction, the system creates a mapping that translates natural eye movement into communication routing decisions.
3Measurement precision
If spatial positions are assigned to remote users on the interface, then gaze direction can be evaluated to determine intended recipient, but the system requires complex coordinate mapping and evaluation
Solution Approach 1:
The system creates a simplified copy or representation of the spatial arrangement of remote users on the display interface. By determining relative spatial positions rather than absolute coordinates, the system establishes a mapping that preserves the essential geometric relationships needed for gaze evaluation without requiring complex coordinate transformations.
Data Source
AI summary
In some implementations, audio data or video data associated with a first participant of a communication session is obtained. The communication session may include communication between a first device of the first participant with a second device of a second participant of the communication session. It is determined that biometric information associated with the first participant indicates that the first participant is looking toward the first device. In response determining that the biometric information associated with the first participant indicates that the first participant is looking toward the first device, the audio data or the video data associated with the first participant is transmitted to the second device of the second participant of the communication session.