Gaze-Triggered Audio Boost for AR/VR Social Presence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users in AR/VR environments often feel isolated or disoriented, making social interactions less straightforward due to the lack of effective attention-grabbing mechanisms in virtual social gatherings.

Innovation Solution

The system employs wearable displays with eye-tracking technology and audio communication channels that adjust audio parameters in real-time to make a user more audible when they gaze at another user, facilitating attention and interaction through audio cues and visual notifications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users are placed in AR/VR environments with visual displays and avatars, then immersion and virtual social gathering capabilities are improved, but social interaction effectiveness and attention-grabbing ability deteriorate

Engineering Contradiction:
Improvevirtual social gathering capabilityVSAvoidattention-grabbing effectiveness
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system implements feedback by detecting when another user looks at the current user through eye-tracking technology, and automatically adjusting audio parameters (volume, spatial position) to provide audible feedback. This creates a closed-loop system where visual attention triggers audio response, enabling effective social interaction without requiring manual audio adjustment by users

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs self-service by automatically monitoring gaze directions of all participants and dynamically adjusting each user's audio output parameters based on who is looking at them. This eliminates the need for users to manually manage audio settings or actively seek attention, as the system autonomously optimizes audio communication based on detected social dynamics

Inventive Principle:
Principle #25Self-service

2Ease of operation

If audio parameters are dynamically adjusted based on gaze detection, then social interaction and attention attraction are improved, but system complexity increases

Engineering Contradiction:
Improvesocial interaction effectivenessVSAvoidreal-time parameter adjustment system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The wearable display device performs multiple functions: visual display, eye-tracking detection, gaze analysis, and dynamic audio parameter adjustment. By integrating these diverse functions into a single universal platform, the system avoids the complexity of separate dedicated devices for each function while achieving coordinated social interaction enhancement

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10990171B2Audio indicators of user attention in AR/VR environment
Publication Date: 2021.04.27 META PLATFORMS TECHNOLOGIES LLC
  • US10990171B2 patent drawing
  • US10990171B2 patent drawing
  • US10990171B2 patent drawing

AI summary

A method of notifying a user about attention from another user in an augmented reality/virtual reality (AR/VR) system is provided. The method includes displaying a first image on a first electronic display to a first user of the AR/VR system and, upon detecting a gaze of the first user at a second user of the AR/VR system or the second user's avatar in the first image, notifying the second user about the gaze of the first user by changing a parameter of an audio communication channel from the first user to the second user, so as to make the first user more audible to the second user.