Signal Processing Device for Real-Space Acoustic Replication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies fail to seamlessly replicate an environment different from a real space in sound reproduction, leading to a sense of separation between the real and content spaces, despite efforts to enhance realism through acoustic characteristics.

Innovation Solution

A signal processing apparatus and method that dynamically adds acoustic characteristics from one space to sound in a real space, using meta-information, image recognition, and sound recognition to replicate environments like caves, concert halls, or underwater settings, allowing listeners to experience the content space acoustically.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If acoustic characteristics are added to sound in content to enhance realism, then the realism of sound reproduction is improved, but a sense of separation between real space and content space is created

Engineering Contradiction:
Improverealism of sound reproductionVSAvoidintegration between real space and content space
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent merges the acoustic characteristics of the content space with the real space by capturing sounds in the real space and processing them with the same acoustic characteristics applied to content sounds. This combining approach eliminates the separation between real and content spaces, making the listener perceive a unified acoustic environment rather than distinct layers.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies the same acoustic characteristic processing to both content sounds and real-space captured sounds, creating a universal treatment that works for all audio sources. This multi-functional approach allows the system to handle different types of sounds (content and environmental) with a unified processing method, enhancing overall realism.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If acoustic characteristics of virtual environments are replicated in real space, then immersion is enhanced, but the complexity of signal processing increases

Engineering Contradiction:
Improveimmersion experienceVSAvoidsignal processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically captures the acoustic characteristics from the content being displayed and applies them to real-space sounds without requiring manual configuration. The device self-determines the appropriate acoustic processing based on the content type, eliminating the need for complex user setup while maintaining high immersion quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent copies the acoustic characteristics directly from the content rendering to the real-space sound processing. By replicating the same reverberation, echo, and spatial effects that are applied to content sounds onto captured environmental sounds, the system achieves consistent virtual environment replication without requiring separate complex processing algorithms.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3361756B1Signal processing device, signal processing method, and computer program
Publication Date: 2024.04.17 SONY GROUP CORP
  • EP3361756B1 patent drawingFigure 1
  • EP3361756B1 patent drawingFigure 2
  • EP3361756B1 patent drawingFigure 3

AI summary

[Object] To provide a signal processing apparatus that can replicate, in a real space, an environment different from the real space by granting an acoustic characteristic different from that of the real space, to a sound released in the real space. [Solution] There is provided a signal processing apparatus including: a control unit configured to decide a predetermined acoustic characteristic for causing a user to hear a collected ambient sound of the user in a space having a different acoustic characteristic, in accordance with content being reproduced, or an action of a user, and to add the decided acoustic characteristic to the ambient sound. The signal processing apparatus