Spatial Audio Bitstream Reconstruction for Metaverse Virtual Spaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current metaverse services face significant challenges in efficiently generating and transmitting bitstreams for spatial audio in large virtual spaces, particularly due to frequent changes caused by multiple users, leading to increased network traffic and computational load.

Innovation Solution

A method and apparatus that reconstructs a bitstream by selectively encoding spatial audio-related information within a determined range based on a user's location, using sound source and geometry information to optimize bitstream generation and reduce network traffic.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a bitstream including spatial audio-related information for the entire large virtual space is generated whenever a change occurs in the virtual space, then complete spatial audio coverage is achieved, but network traffic and computational load increase significantly

Engineering Contradiction:
Improvespatial audio coverage completenessVSAvoidbitstream data volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies local quality by transmitting spatial audio information selectively based on the user's location and a reference radius. Only sound source objects within the reference radius from the user's current location are included in the bitstream, rather than transmitting information for the entire virtual space. This resolves the contradiction by maintaining reliable spatial audio coverage for the user's relevant area while significantly reducing the quantity of transmitted data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the virtual space into relevant and irrelevant regions based on the user's location and reference radius. The bitstream is constructed to include only spatial audio information from the relevant segment (within reference radius), excluding information from distant regions. This segmentation approach ensures complete coverage of the user's immediate environment while reducing overall data transmission volume.

Inventive Principle:
Principle #1Segmentation

2Reliability

If spatial audio information for the entire virtual space is transmitted to all users, then comprehensive audio rendering is achieved, but network traffic increases

Engineering Contradiction:
Improveaudio rendering completenessVSAvoidnetwork traffic
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent implements local quality by customizing the bitstream content according to each user's specific location and reference radius. Each user receives spatial audio information only for objects within their personal reference radius, rather than receiving comprehensive information about all objects in the virtual space. This reduces network traffic while maintaining reliable audio rendering for each user's relevant area.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If bitstream reconstruction is performed frequently to accommodate user movement and space changes, then spatial audio accuracy is maintained, but processing time increases

Engineering Contradiction:
Improvespatial audio accuracyVSAvoidbitstream processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-defining the reference radius and establishing the relationship between user location and spatial audio information in advance. When a user moves or space changes occur, the system only needs to reconstruct the bitstream for objects within the predetermined reference radius, rather than processing information for the entire virtual space. This maintains spatial audio accuracy while reducing processing time through the预先 established spatial parameters.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240357306A1Bitstream reconstruction method and apparatus for spatial audio rendering
Publication Date: 2024.10.24 ELECTRONICS & TELECOMM RES INST
  • US20240357306A1 patent drawing
  • US20240357306A1 patent drawing
  • US20240357306A1 patent drawing

AI summary

A bitstream reconstruction method and apparatus are provided. The method includes constructing an initial bitstream by rendering sound source information and geometry information within a reference radius from an initial location of a user accessing a virtual space into spatial audio, collecting location information according to a movement of the user within the virtual space, and reconstructing, based on a relationship between the reference radius and a movement radius identified according to the collected location information, the initial bitstream constructed by corresponding to the initial location of the user.