Audio Object Prioritization in Virtual Reality Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality systems face challenges in efficiently managing and rendering audio objects in immersive environments, particularly in prioritizing audio content based on user position and context, leading to potential distortions or losses in audio quality due to system limitations.

Innovation Solution

An apparatus and method that provide positional data to allocate audio objects into prioritized groups, allowing higher-priority objects to be rendered over lower-priority ones, with dynamic updates based on user position, obstruction, and interest, ensuring that critical audio content is maintained even under system limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio objects are rendered with equal priority in virtual reality systems, then all audio content is processed uniformly, but audio quality deteriorates due to system limitations and resource constraints

Engineering Contradiction:
Improveaudio qualityVSAvoidsystem efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments audio objects into multiple priority groups (first priority, second priority, third priority) based on their importance to the user experience. This segmentation allows the system to process different audio objects differently according to their priority level, ensuring critical audio content maintains quality while managing system resources efficiently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different rendering qualities to different audio objects based on their priority groups. High-priority audio objects receive full rendering quality, while lower-priority objects receive reduced quality, allowing optimized resource allocation throughout the audio scene.

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If the system processes all audio objects simultaneously, then complete audio content is available, but system resources are overloaded and audio rendering fails under constraints

Engineering Contradiction:
Improveaudio content volumeVSAvoidaudio rendering reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent divides the complete audio content into segmented priority groups, allowing the system to process audio objects in stages rather than simultaneously. This segmentation enables the system to maintain reliability by processing only the necessary number of audio objects at any given time based on available resources.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by selectively processing only the necessary portion of audio objects based on priority levels and system capacity. Instead of processing all audio objects simultaneously, the system processes audio objects in priority order, ensuring critical content is rendered while managing resource constraints.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If audio objects are allocated without prioritization, then all audio content is treated equally, but critical audio content may be lost or distorted under system limitations

Engineering Contradiction:
Improveaudio rendering flexibilityVSAvoidcritical audio content integrity
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements dynamic prioritization where audio objects are assigned to different priority groups based on their characteristics and importance. This dynamic allocation allows the system to adapt to varying resource conditions while ensuring critical audio content maintains integrity through priority-based processing.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies local quality by assigning different treatment levels to different audio objects based on their priority groups. Critical audio objects in higher priority groups receive preserved quality treatment, while less critical objects receive reduced quality, ensuring audio content integrity where most needed.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11917392B2Rendering of audio data for a virtual place
Publication Date: 2024.02.27 NOKIA TECHNOLOGIES OY
  • US11917392B2 patent drawing
  • US11917392B2 patent drawing
  • US11917392B2 patent drawing

AI summary

An apparatus is disclosed comprising means for providing first positional data indicative of a first user position in a virtual space which comprises a plurality of audio objects. The means may also be for receiving, based at least partially on the first positional data, data indicative of a first allocation of the audio objects into a prioritized order or into one of a plurality of prioritized groups in which each group has a respective priority order, and receiving audio data associated with at least some of the audio objects. The means may also be for rendering the received audio data for at least some of the audio objects associated with the received audio data, based on the first allocation data, in which audio objects with a higher priority or in a higher priority group are rendered with priority over audio objects allocated with a lower priority or in a lower priority group.