Remote Venue Audio Replication via Spatialization Engine

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to accurately represent audio in remote venues due to differences in acoustics, leading to varying perceptions of audio across different locations, as they rely on single acoustic samples without accounting for unique environmental factors such as reflectivity and reverberations.

Innovation Solution

A system that creates a virtual representation of a remote venue by using a backend server with a spatialization engine to determine reverberations and reflection points, and local servers to manage audio and video reproduction, ensuring a synchronized and immersive experience by accounting for the unique acoustic characteristics of the remote venue.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single acoustic sample is used to represent a remote venue, then the system complexity is reduced, but the audio representation accuracy deteriorates due to varying acoustics across different locations

Engineering Contradiction:
Improvesystem complexityVSAvoidaudio representation accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent divides the remote venue into multiple zones, each with its own acoustic characteristics. Instead of using a single acoustic sample for the entire venue, the system captures and processes multiple acoustic samples from different locations (front, middle, back sections) to represent the spatial variation in acoustics. This segmentation allows the system to maintain accuracy while managing complexity through structured organization of acoustic data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different acoustic profiles to different spatial regions within the venue. Each zone has its own reverberation characteristics, reflection patterns, and acoustic properties that are independently captured and applied. This ensures that listeners in different parts of the venue experience audio that accurately reflects the local acoustic environment rather than a generic average.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If multiple acoustic samples from different locations are used, then the audio representation accuracy is improved, but the data processing complexity increases

Engineering Contradiction:
Improveaudio representation accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary processing of acoustic samples during the venue characterization phase. Acoustic impulse responses, reverberation times, and reflection patterns are pre-calculated and stored for each zone before actual event streaming occurs. This preliminary action reduces real-time processing complexity by preparing acoustic profiles in advance, allowing the streaming system to simply select and apply pre-computed acoustic characteristics rather than performing complex acoustic simulations during live events.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates simplified acoustic models or copies of the actual venue acoustics that can be efficiently applied during streaming. Instead of processing raw acoustic measurements in real-time, the system generates representative acoustic profiles (such as impulse responses or reverberation parameters) that capture the essential acoustic characteristics in a compressed, easily applicable format. These acoustic copies enable accurate audio representation with minimal real-time computational overhead.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If acoustic characteristics specific to each zone are captured, then the immersive experience is improved, but the measurement and detection difficulty increases

Engineering Contradiction:
Improveimmersive experienceVSAvoidacoustic measurement difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces an intermediary measurement process that simplifies the capture of zone-specific acoustic characteristics. Instead of requiring complex multi-point measurements throughout each zone, the system uses strategically placed measurement microphones at representative locations and employs acoustic modeling techniques to interpolate and extrapolate acoustic properties across the entire zone. This intermediary approach reduces measurement difficulty while maintaining the ability to capture zone-specific acoustic variations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent develops a universal acoustic measurement and processing framework that can handle multiple zones and different venue types with a single integrated system. The same measurement equipment, processing algorithms, and data structures used for one zone can be applied to any other zone, providing multi-functionality. This universal approach reduces the complexity of measuring and detecting acoustic characteristics by using consistent methods across all zones rather than requiring zone-specific custom solutions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a faithful acoustic and visual replication of remote venues in local venues, providing an immersive experience for attendees by accurately simulating the audio and visual aspects of the remote location, regardless of the local venue's dimensions or layout.

Implementation Method 1

determine reverberations and reflection points

Methodology Applied
Scientific EffectReverberation: Reverberation

Implementation Method 2

determine reverberations and reflection points

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS12101623B2Synthesizing audio of a venue
Publication Date: 2024.09.24 SPHERE ENTERTAINMENT GROUP LLC
  • US12101623B2 patent drawing
  • US12101623B2 patent drawing
  • US12101623B2 patent drawing

AI summary

Disclosed herein are system, method, and computer program product embodiments for replicating a remote venue in a local venue. An embodiment operates by receiving original audio. Thereafter, the original stream of audio is modified to produce modified audio based on an audio profile unique to a remote venue smaller than the local venue. The audio profile comprises a virtual representation of the remote venue including (i) a virtual audio source corresponding to the local venue's audio source and configured to produce the original audio and (ii) a virtual reverberation point corresponding to a real-world location in the remote venue and the portion of the local venue. As such, the modified audio is determined based on receipt of the original audio from the reverberation point. Thus, after correlating the modified audio to the local venue's audio source, the modified audio is provided by the audio source to the portion of the local venue.