Audio Source Management via Gaze and Orientation Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for managing audio sources in augmented reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, leading to errors and increased energy consumption, particularly in battery-operated devices.

Innovation Solution

The development of improved computer systems with enhanced methods and interfaces that allow for intuitive management of audio sources, including proportional adjustment of audio levels and adaptive audio output based on user interactions and environmental context, using a combination of input devices, display generation components, and output devices such as speakers and tactile generators.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional methods for managing audio sources are used, then audio output can be provided, but user interaction becomes cumbersome and cognitively burdensome

Engineering Contradiction:
Improveuser interactionVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically detects the user's intended audio source based on gaze direction and device orientation, eliminating the need for manual selection. The audio system serves itself by interpreting user intent through sensors rather than requiring explicit user commands, thereby simplifying interaction while managing multiple audio sources effectively

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical interaction (buttons, sliders, menu navigation) with sensor-based detection systems. Eye tracking, gyroscope, and accelerometer data substitute for traditional mechanical controls, allowing the system to determine user intent and adjust audio sources automatically, reducing cognitive burden while maintaining precise control

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Use of energy by moving object

If conventional audio management methods are used, then audio output can be controlled, but energy consumption increases

Engineering Contradiction:
Improveenergy consumptionVSAvoidaudio management efficiency
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The system uses periodic sensor sampling to detect user intent rather than continuous processing. By triggering audio source changes based on detected gaze direction and device orientation events, the system reduces computational load and energy consumption while maintaining responsive audio management capability

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The audio management system operates autonomously by detecting user intent through sensors and automatically adjusting audio sources. This eliminates the need for continuous user input processing and manual interface interactions, reducing energy consumption while improving audio management efficiency through automated decision-making

Inventive Principle:
Principle #25Self-service

3Ease of operation

If manual adjustment of audio levels is implemented, then individual audio sources can be controlled, but user input requirements increase

Engineering Contradiction:
Improveaudio level controlVSAvoiduser input time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically determines which audio source the user wants to adjust based on gaze direction and device orientation, then presents a simplified control interface. This self-service approach eliminates the need for users to manually navigate through multiple audio sources and their individual controls, reducing both input requirements and time while maintaining precise audio level control capability

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240402984A1Devices, methods, and graphical user interfaces for managing audio sources
Publication Date: 2024.12.05 APPLE INC
  • US20240402984A1 patent drawing
  • US20240402984A1 patent drawing
  • US20240402984A1 patent drawing

AI summary

The present disclosure generally relates to managing audio sources. In accordance with some embodiments, one or more methods for managing controls for changing audio output, managing the prominence of audio, managing audio output based on distance, managing a virtual sound stage, outputting audio at one or more locations in accordance with some embodiments, and outputting audio at one or more locations in accordance with some embodiments.