Dynamic Audio Localization for Visual Interface Elements

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In systems with large displays or display arrays, users may struggle to maintain all display areas within their field of vision, leading to visual elements being outside the field of view, and conventional audio effects do not accurately localize to the positions of visual elements, resulting in a less immersive user experience.

Innovation Solution

An apparatus comprising a processor circuit and an audio management module that determines the position of user interface elements, generates audio location information based on their positions, and produces audio playback information to accurately localize audio effects to their corresponding visual elements, using techniques such as spatial audio processing to adjust apparent origins.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional audio effects are generated from a fixed midpoint between speakers, then the audio system is simple to implement, but the audio effects do not accurately localize to the positions of visual elements

Engineering Contradiction:
Improveaudio localization accuracyVSAvoidaudio processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The audio system transitions from a static, fixed midpoint audio source to a dynamic system where audio effects are localized to match the real-time positions of visual elements. The audio management module dynamically calculates audio location information based on user interface element positions, enabling audio effects to move and localize accurately across the audio playback area corresponding to the display area.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of audio origin position from a fixed midpoint to variable positions that correspond to visual element locations. By determining audio location information based on user interface element positions and generating audio playback information with modified origin parameters, the system achieves accurate audio-visual spatial correspondence.

Inventive Principle:
Principle #35Parameter changes

2Area of stationary object

If all display areas are kept within user field of vision, then visual elements are always visible, but the display area must be limited in size

Engineering Contradiction:
Improvedisplay areaVSAvoidvisual elements outside field of view
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

Audio effects serve as an intermediary to convey spatial information about visual elements that may be outside the user's field of view. When a visual element moves to a position outside the display area or user's visual range, the corresponding audio effect localizes to that position, providing the user with spatial awareness and attention guidance without requiring the visual element to be directly visible.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system replaces the mechanical constraint of limiting display area size with an auditory information channel. Instead of physically restricting the display area to maintain visibility, the system uses audio localization to substitute for visual attention, allowing users to perceive the location and importance of visual elements through sound even when they are outside the visible display area.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10402160B2Audio localization techniques for visual effects
Publication Date: 2019.09.03 INTEL CORP
  • US10402160B2 patent drawing
  • US10402160B2 patent drawing
  • US10402160B2 patent drawing

AI summary

Techniques for improved audio localization for visual effects. In one embodiment, for example, an apparatus may comprise a processor circuit and an audio management module, and the audio management module may be operable by the processor circuit to determine a position of a user interface element in a presentation area, determine an audio effect corresponding to the user interface element, determine audio location information for the audio effect based on the position of the user interface element, the audio location information defining an apparent position for the audio effect, and generate audio playback information for the audio effect based on the audio location information.