Hybrid Audio Rendering System for Spatial Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional audio rendering technologies, such as those for spatial audio, often fail to provide optimal rendering of virtual sound scenes, particularly in arrangements where loudspeakers are not adequately positioned to reproduce virtual sound objects at correct distances, leading to suboptimal listening experiences.

Innovation Solution

The solution involves generating two audio signals: one for headphones and one for loudspeakers, where the audio signal for headphones adjusts the virtual position of sound objects to enhance stereo width, while the loudspeaker signal maintains the original position, ensuring both are synchronized and rendered simultaneously to create an enhanced, stereo widened virtual sound scene.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If audio is rendered only on loudspeakers in conventional arrangements, then the system is simple to operate, but the stereo width and spatial accuracy are insufficient when loudspeakers are not optimally positioned

Engineering Contradiction:
Improvespatial accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines loudspeaker rendering and headphone rendering into a single hybrid system. The audio signal is processed to generate both loudspeaker output and headphone output simultaneously, merging the advantages of both reproduction methods to achieve accurate spatial positioning and enhanced stereo width regardless of loudspeaker arrangement.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system is designed to serve multiple functions: it can render audio through loudspeakers for general listening, through headphones for precise spatial positioning, and through both simultaneously for enhanced stereo width. This multi-functional approach allows the same system to adapt to different listening environments and requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If headphones are used to achieve accurate virtual positioning, then spatial accuracy improves, but the listening experience lacks the immersive quality of loudspeaker arrangements

Engineering Contradiction:
Improvevirtual position accuracyVSAvoidlistening experience quality
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent merges the accurate virtual positioning capability of headphone rendering with the immersive listening quality of loudspeaker rendering. By processing the audio signal to generate both outputs simultaneously and combining them, the system achieves both precise spatial accuracy and enhanced listening experience.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If the audio signal is processed to adjust virtual positions for headphones, then stereo width is enhanced, but the processing complexity increases

Engineering Contradiction:
Improvestereo widthVSAvoidsignal processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The audio signal processing is segmented into distinct functional blocks: a rendering configuration data generator that creates positioning information, a renderer that processes the audio signal according to this data, and separate output paths for loudspeakers and headphones. This segmentation makes the complex processing more manageable and implementable.

Inventive Principle:
Principle #1Segmentation

4Ease of manufacture

If conventional loudspeaker arrangements are used, then the setup is simple, but the rendering quality is suboptimal when speakers cannot be positioned correctly

Engineering Contradiction:
Improvesetup simplicityVSAvoidrendering quality
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary processing system that sits between the audio source and the reproduction devices. This intermediary (the rendering system with virtual position data) compensates for suboptimal loudspeaker positioning by calculating and applying appropriate positioning adjustments, enabling high-quality rendering even with simple loudspeaker arrangements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3745745B1Apparatus, method, computer program or system for use in rendering audio
Publication Date: 2024.11.27 NOKIA TECHNOLOGIES OY
  • EP3745745B1 patent drawingFigure 1A~4
  • EP3745745B1 patent drawingFigure 5
  • EP3745745B1 patent drawingFigure 6A~6B

AI summary

Certain examples of the present invention relate to an apparatus, a method, a computer program or a system for use in rendering audio. Certain examples provide an apparatus 1000 comprising means configured for: receiving a first audio signal 1101 representative of a virtual sound scene 601, wherein the first audio signal 1101 is configured for rendering on an arrangement of loudspeakers 602 such that, when rendered on the arrangement of loudspeakers 602, the virtual sound scene 601 is rendered to a user 604; determining a first portion 601a of the virtual sound scene 601 to be rendered on headphones 603 of the user 604; generating a second audio signal 1102 representative of the first portion 601a of the virtual sound scene 601, wherein the second audio signal 1102 is configured for rendering on the headphones 603; determining a second portion 601b of the virtual sound scene 601 to be rendered on the arrangement of loudspeakers 602; generating a third audio signal 1103, representative of the second portion 601b of the virtual sound scene 601, wherein the third audio signal 1103 is configured for rendering on the arrangement of loudspeakers 602; and wherein the second and third audio signals 1102,1103 are generated such that, when rendered on the headphones 603 and the arrangement of loudspeakers 602 respectively, an augmented version of the virtual sound scene 601 is rendered to the user.