XR Audio Object Manipulation via Orientation-Based Directivity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current XR technologies fail to accurately control the volume and directivity of audio emitted by virtual objects based on their orientation and position relative to the user, leading to inconsistent audio experiences.

Innovation Solution

A method and system that use processors and non-transitory memory to display XR environments, determine audio volumes and directivity based on object orientation, and allow user input to adjust audio properties through a graphical user interface, enabling dynamic control of audio emission patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio properties are controlled based on object orientation and position in XR environments, then audio realism and immersion are improved, but system complexity increases

Engineering Contradiction:
Improveaudio realismVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system pre-calculates and stores audio propagation characteristics for different object orientations and positions. When an object is placed in the XR environment, the audio properties are determined based on pre-computed data rather than real-time complex calculations, reducing runtime computational complexity while maintaining audio realism.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses parameter-based control where audio properties (volume, directivity) are adjusted based on changes in object orientation parameters and position parameters. This allows the complex audio behavior to be managed through simple parameter mappings rather than complex physical simulations.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If dynamic control of audio emission patterns is implemented, then user interaction capability is improved, but device complexity increases

Engineering Contradiction:
Improveuser interaction capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements dynamic audio emission patterns that automatically adjust based on object orientation and user position. The audio directivity and volume are dynamically controlled through parameter changes rather than requiring complex real-time processing, enabling user interaction while managing device complexity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system provides feedback mechanisms where audio properties are adjusted based on detected user interactions and object states. This allows users to interact with audio properties while the system automatically manages the complexity of the control logic through feedback-based parameter adjustment.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12119018B2Methods and systems for manipulating audio properties of objects
Publication Date: 2024.10.15 APPLE INC
  • US12119018B2 patent drawing
  • US12119018B2 patent drawing
  • US12119018B2 patent drawing

AI summary

In one implementation, a method of changing an audio property of an object is performed at a device including one or more processors coupled to non-transitory memory. The method includes displaying, using a display, a representation of a scene including a representation of an object associated with an audio property. The method includes displaying, using the display, in association with the representation of the object, a manipulator indicating a value of the audio property. The method includes receiving, using one or more input devices, a user input interacting with the manipulator. The method includes, in response to receiving the user input, changing the value of the audio property based on the user input and displaying, using the display, the manipulator indicating the changed value of the audio property.