Audio Rendering Sound Scene Rotation and Object Editing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current audio rendering technologies do not allow for effective control over the positioning and editing of sound objects within a sound scene, limiting the ability to adapt a recorded sound scene into an alternative rendered sound scene.

Innovation Solution

A method and apparatus that process audio signals to rotate a sound scene so that a user-selected sound object is automatically positioned, enable user editing of audio properties to create a modified sound object, and render the sound scene using the modified object, allowing for dynamic control over the sound scene's layout and properties.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If audio signals are processed to rotate the sound scene for automatic positioning of sound objects, then the ease of operation is improved, but the device complexity increases

Engineering Contradiction:
Improveease of sound object positioningVSAvoidcomplexity of audio processing system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system pre-processes audio signals to establish a rotatable sound scene framework before user interaction. By preparing the spatial audio structure in advance with defined sound objects and their positions, the system enables users to simply select and rotate scenes without dealing with complex positioning calculations, thus improving ease of operation while managing device complexity through pre-computation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary processing layer that sits between the raw audio signals and the user interface. This intermediary system automatically handles the complex task of sound object extraction, positioning, and rotation, translating user-friendly rotation commands into complex audio signal processing operations, thereby shielding users from complexity while enabling sophisticated functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If users are enabled to edit audio properties of sound objects, then the adaptability is improved, but the device complexity increases

Engineering Contradiction:
Improveflexibility in audio property editingVSAvoidcomplexity of editing interface
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the audio scene into discrete, independently editable sound objects, each with specific audio properties. This segmentation allows users to edit individual sound objects without affecting the entire scene, providing granular control and flexibility. The segmentation approach manages complexity by breaking down the editing task into manageable, isolated units rather than requiring global scene modifications.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system enables local quality modification by allowing users to edit specific audio properties of selected sound objects while leaving other properties unchanged. This localized editing approach provides adaptability by permitting precise control over individual elements (such as volume, panning, or effects) without requiring changes to the entire audio scene, thereby managing complexity through focused, property-specific editing interfaces.

Inventive Principle:
Principle #3Local quality

3Productivity

If real-time rotation and modification of sound scenes is enabled, then the productivity is improved, but the use of energy increases

Engineering Contradiction:
Improvespeed of sound scene processingVSAvoidenergy consumption of audio processing
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by updating sound scene rotations and modifications only when triggered by user input or significant parameter changes, rather than continuously processing at maximum rate. This approach maintains productivity by providing responsive real-time interaction while reducing energy consumption by processing audio signals only when necessary, allowing the system to enter lower-power states during intervals between user interactions.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system employs dynamic processing that adjusts computational intensity based on current operational needs. During real-time rotation and modification operations, the system increases processing power to maintain productivity and responsiveness. When operations are complete or in idle states, the system dynamically reduces processing intensity and energy consumption, thereby balancing productivity requirements with energy efficiency through adaptive resource allocation.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3232689B1Control of audio rendering
Publication Date: 2020.05.06 NOKIA TECHNOLOGIES OY
  • EP3232689B1 patent drawingFigure 1~3
  • EP3232689B1 patent drawingFigure 4A~6B
  • EP3232689B1 patent drawingFigure 7~8

AI summary

A method comprising: processing audio signals to rotate a sound scene so that a user selected sound object is automatically at a first position within the rotated sound scene; enabling user editing of audio properties of the selected sound object to create a modified sound object; and causing rendering of the sound scene using the modified sound object.