Game Audio Signal Segmentation for Spatial Immersion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional game systems primarily focus on video output and neglect audio processing, failing to provide a rich and immersive experience using distinct sound output devices.

Innovation Solution

A game system with a game apparatus that includes both image and sound generation sections, capable of outputting different audio effects to separate sound output devices, such as a monitor with built-in loudspeakers and a handheld device, allowing for realistic spatial audio by adding effects like reverb to one sound signal while maintaining the original sound on the other.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the same sound signal is output to multiple sound output devices, then audio synchronization is maintained, but spatial audio effect and immersion are reduced

Engineering Contradiction:
Improveaudio synchronizationVSAvoidspatial audio effect
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The sound signal is segmented into different processing paths: one path outputs the original sound signal to the controller's sound output device, while another path applies acoustic effects (reverb, echo) to create spatial audio for the monitor's sound output device. This segmentation allows each device to receive appropriately processed audio signals.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different acoustic qualities are applied to different output devices based on their specific characteristics and intended use. The controller receives clear original sound for direct audio feedback, while the monitor receives enhanced spatial audio for immersive experience. Each device receives locally optimized audio processing.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If acoustic effects are added to sound output from the monitor, then spatial audio effect is enhanced, but audio delay and synchronization issues occur

Engineering Contradiction:
Improvespatial audio effectVSAvoidaudio delay
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The acoustic effects processing is performed in advance on the sound signal before it is output to the monitor. The sound signal is pre-processed with reverb and echo effects, and the timing is synchronized so that the spatial audio effect is achieved without introducing noticeable delays in the overall audio output.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If different sound signals are output to different devices, then immersive experience is improved, but system complexity increases

Engineering Contradiction:
Improveimmersive experienceVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The sound generation section is designed with multi-functionality to handle both original sound output and acoustic effect processing. It can generate the same sound signal for the controller and simultaneously generate enhanced spatial audio for the monitor, reducing the need for separate dedicated processing units.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The sound generation section acts as an intermediary that receives the base sound signal and selectively applies acoustic effects before outputting to different devices. This intermediary processing layer enables differentiated audio output without requiring completely separate sound generation systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9089766B2Game system, game apparatus, non-transitory computer-readable storage medium having game program stored thereon, and game processing control method
Publication Date: 2015.07.28 NINTENDO CO LTD
  • US9089766B2 patent drawing
  • US9089766B2 patent drawing
  • US9089766B2 patent drawing

AI summary

A game apparatus generates, based on the same sound data, a first sound signal to be output to a first sound output section, and a second sound signal to be output to a second sound output section which is physically different from the first sound output section. The generated second sound signal is a sound signal to which a predetermined acoustic effect is not added, and the first sound signal is a sound signal in which an acoustic effect is added to at least a part of sounds included in the second sound signal.