Smooth Overlapping Audio Object Rendering System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing free-viewpoint audio technologies face challenges in smoothly rendering audio objects when multiple rendering points interact, leading to discontinuities and artefacts due to overlapping renderings, which disrupt the user's experience in spatial audio environments.

Innovation Solution

The smooth overlapping audio object rendering system detects overlaps between waveform renderings, determines differences, and processes them to either interpolate or fuse renderings into a single stable output, preventing discontinuities and ensuring a consistent user experience by selecting the most appropriate rendering modification decision based on location and playback time differences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple waveform renderings are performed simultaneously for different rendering points, then the spatial audio coverage is improved, but discontinuities and artefacts occur due to overlapping renderings

Engineering Contradiction:
Improvespatial audio coverageVSAvoidrendering continuity
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an intermediary processing stage between multiple waveform renderings and the final output. This intermediary detects overlaps between renderings from different rendering points and applies smoothing transitions to eliminate discontinuities and artefacts, thereby maintaining rendering continuity while preserving spatial audio coverage

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically adjusts the transition between overlapping waveform renderings based on real-time detection of overlap conditions. By adaptively modifying the rendering output during overlap periods, the system maintains smooth transitions and prevents artefacts while preserving the benefits of multiple rendering points

Inventive Principle:
Principle #15Dynamics

2Reliability

If waveform renderings are smoothly interpolated or fused, then rendering continuity is improved, but computational complexity increases

Engineering Contradiction:
Improverendering continuityVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary processing operations for handling overlapping renderings. By identifying and processing only the overlapping portions of waveforms rather than entire renderings, the system reduces computational complexity while maintaining rendering continuity in critical areas

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses copying techniques by referencing existing waveform data from different rendering points rather than performing complete independent processing. This allows for efficient smoothing transitions by leveraging pre-computed renderings, thereby reducing overall processing complexity

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11044570B2Overlapping audio-object interactions
Publication Date: 2021.06.22 NOKIA TECHNOLOGIES OY
  • US11044570B2 patent drawing
  • US11044570B2 patent drawing
  • US11044570B2 patent drawing

AI summary

A method including, detecting an overlap between at least two waveform renderings, wherein at least one is related to a first user and another is related to a second user, the at least two waveform renderings comprise an audio object, determining at least one difference between the at least two waveform renderings for the audio object when the overlap is detected, determining a rendering modification decision for the audio object associated with the at least one difference, processing at least one of the at least two waveform renderings dependent on the rendering modification decision so as to introduce an effect related to the determined at least one difference, and performing a modified rendering with the processed at least one of the at least two waveform renderings comprising the effect for the audio object.