Virtual Microphone Interpolation for Smooth Audio Positioning

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing sound control technologies cause sharp changes in sound output when the relative positional relationship between a listener and a sound source changes, leading to an unnatural auditory experience for the user.

Innovation Solution

A computer-readable storage medium with an information processing program that controls the position of a virtual microphone and performs volume and balance settings based on relative distance and direction changes, using interpolation to smooth out these changes over a predetermined period, thereby reducing the sharpness of sound output changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the relative positional relationship between listener and sound source changes sharply, then the sound output responds quickly to the position change, but sharp change occurs in sound output making the user feel strange

Engineering Contradiction:

Improveresponse speed of sound output to position changeVSAvoidsharp change in sound output causing unnatural auditory experience

Core Design Contradiction:

SpeedVSObject-affected harmful factors

Solution Approach 1:

The system detects when the virtual microphone moves beyond a predetermined reference distance and preliminarily activates interpolation processing before the sharp change occurs. This preliminary action prepares the smoothing mechanism in advance, transitioning the relative distance and direction values gradually over a predetermined period rather than immediately reflecting the sharp position change, thus preventing the unnatural auditory experience while maintaining responsive sound output

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system applies beforehand cushioning by implementing interpolation processing that gradually transitions sound output parameters when sharp position changes are detected. The interpolation acts as a cushioning mechanism that softens the impact of abrupt position changes on sound output, preventing sharp transitions that would cause unnatural auditory experiences while still responding to the user's movement

Inventive Principle:

Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS11871206B2Computer-readable non-transitory storage medium having information processing program stored therein, information processing apparatus, information processing system, and information processing method

Publication Date: 2024.01.09 NINTENDO CO LTD

AI summary

In a case where a virtual microphone has moved to an extent greater than a predetermined reference in a virtual space, during a predetermined period from the movement of the virtual microphone, first interpolation for changing from a relative distance before the movement to a relative distance after the movement over the predetermined period, and second interpolation for changing from a relative direction before the movement to a relative direction after the movement over the predetermined period, are each performed. Then, the volume and the balance of sounds to be outputted are set on the basis of the relative distance by the first interpolation and the relative direction by the second interpolation.