Spatial Audio Rendering with Simplified Sound Object Previews

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current spatial audio technologies do not effectively allow users to comprehend changes in sound scenes without fully rendering the audio content, making it difficult to detect and render new or updated spatial audio content efficiently.

Innovation Solution

An apparatus and method that selects spatial audio content based on a user's position, records consumption data, and provides a user-selectable option to render a simplified sound object representative of the content, enabling detection of new events and rendering of updated audio content through data comparison and preview features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If spatial audio content is fully rendered for user consumption, then the user can comprehend the sound scene, but it becomes difficult to detect and manage changes in the audio content efficiently

Engineering Contradiction:
Improvecomprehension of sound sceneVSAvoiddifficulty in detecting and managing changes
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the spatial audio content into individual sound objects, each with unique identifiers and characteristics. This segmentation allows the system to track and detect changes in specific sound objects independently, making change detection more efficient while maintaining complete comprehension of the overall sound scene through the collection of all sound objects.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements preliminary action by recording consumption data and metadata about spatial audio content before actual rendering occurs. This pre-recording of information enables the system to detect changes and provide summaries without requiring full rendering of the audio content, thus facilitating efficient change detection while preserving the ability to comprehend the sound scene when needed.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If simplified sound objects are rendered as previews, then change detection becomes efficient, but the user experience may be compromised compared to full rendering

Engineering Contradiction:
Improveefficiency of change detectionVSAvoiduser experience quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies partial action by rendering simplified sound objects as previews rather than full audio content. This partial rendering provides sufficient information for change detection and user evaluation in most cases, achieving efficient productivity while maintaining acceptable user experience. The system offers this as an optional preview mode rather than replacing full rendering entirely.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements dynamics by making the rendering approach adaptive - the system can switch between simplified previews and full rendering based on user needs and context. This dynamic approach ensures that when users require detailed evaluation, full rendering is available, while for routine change detection, efficient simplified previews are used, thus balancing productivity and reliability.

Inventive Principle:
Principle #15Dynamics

3Use of energy by moving object

If spatial audio content is selected based on user position, then the rendering is optimized for the user's location, but detecting new events in the audio content becomes more complex

Engineering Contradiction:
Improverendering optimizationVSAvoiddetection of new events
Core Design Contradiction:
Use of energy by moving objectVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies preliminary action by recording consumption data and metadata for all spatial audio content regardless of user position. This pre-recording creates a comprehensive database that facilitates easy detection of new events and changes. The position-based rendering optimization is applied only during the rendering phase, while the detection phase benefits from the pre-recorded data structure.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments spatial audio content into individually trackable sound objects with unique identifiers. This segmentation allows the system to efficiently detect new events by comparing identifiers and metadata of individual sound objects against the recorded database, rather than analyzing entire audio streams. The position-based selection then determines which segmented objects are rendered, maintaining both optimization and detectability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11627427B2Enabling rendering, for consumption by a user, of spatial audio content
Publication Date: 2023.04.11 PIECE FUTURE PTE LTD
  • US11627427B2 patent drawing
  • US11627427B2 patent drawing
  • US11627427B2 patent drawing

AI summary

An apparatus comprising: means for causing selection of spatial audio content in dependence upon a position of a user in a virtual space; • means for causing rendering, for consumption by the user, of the selected spatial audio content including a first spatial audio content; • means for causing, after user consumption of the first spatial audio content, recording of data relating to the first spatial audio content; • means for using, at a later time, the recorded data to detect a new event relating to the first spatial audio content, the new event comprises that the first spatial audio content has been adapted for which a new spatial content is created, for example in the form of a limited preview; and • means for providing a user-selectable option to enable rendering, for consumption by the user, of the first spatial audio content by rendering a simplified sound object representative, which can be a downmix or clustered audio objects.