Virtual Camera Audio Filtering for Directional Sound Discrimination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques fail to effectively distinguish between sounds from multiple sound sources located in different directions, leading to confusion in audio processing.

Innovation Solution

An information processing program that calculates the direction of sound sources relative to a virtual camera or character in a virtual space, applies filters based on distance and angle, and adjusts sound frequencies to enhance differentiation between sound sources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional sound processing is used without directional filtering, then the system is simple and easy to operate, but sounds from multiple sound sources in different directions cannot be distinguished

Engineering Contradiction:
Improvesound source direction discriminationVSAvoidsound processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies different filtering characteristics to sounds based on their directional origin. Sounds from the front direction are processed with minimal filtering, while sounds from the rear direction undergo strong low-pass filtering. This local quality differentiation enables the system to distinguish between sound sources from different directions by applying direction-specific processing characteristics.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If strong filtering is applied to all sounds to improve direction discrimination, then sound source differentiation improves, but the overall sound quality and naturalness deteriorate

Engineering Contradiction:
Improvesound source direction discriminationVSAvoidsound quality degradation
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies filtering selectively based on sound source direction rather than uniformly to all sounds. Front-direction sounds experience minimal or no filtering, preserving their natural quality, while only rear-direction sounds undergo strong low-pass filtering. This selective application resolves the contradiction by localizing the filtering effect to where it is most needed for direction discrimination.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If frequency filtering is applied to sounds from the rear direction, then rear sound sources can be distinguished from front sound sources, but the ability to detect high-frequency components from rear sources is reduced

Engineering Contradiction:
Improvefront-rear sound source differentiationVSAvoidhigh-frequency sound information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent converts the harmful effect of high-frequency attenuation into a beneficial directional discrimination mechanism. By deliberately applying strong low-pass filtering to rear-direction sounds, the system creates a distinctive acoustic signature for rear sources. The high-frequency attenuation, which would normally be considered information loss, actually serves as a useful marker that enables the listener to distinguish rear sound sources from front sound sources.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS9724608B2Computer-readable storage medium storing information processing program, information processing device, information processing system, and information processing method
Publication Date: 2017.08.08 NINTENDO CO LTD
  • US9724608B2 patent drawing
  • US9724608B2 patent drawing
  • US9724608B2 patent drawing

AI summary

An example game device corrects a sound of a sound source located behind a virtual camera by applying a frequency filter to the sound. Specifically, an angle between an imaging direction of the virtual camera and a direction from the virtual camera toward the sound source is calculated. If the absolute value of the angle is 90 degrees or more, a filter value is calculated based on the angle. The game device also corrects the filter value based on a distance between the virtual camera and the sound source. The game device applies a low-pass filter corresponding to the filter value to the sound of the sound source.