Multi-Device Voice Input Mixing to Prevent Echo and Muffling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In environments with multiple sound input devices, voice input can become unintended due to timing differences and device characteristics, leading to muffling or echo generation, especially in multiplayer gaming scenarios.

Innovation Solution

An information processing system that controls multiple sound input devices by determining priority and volume settings for each device, using a mixer unit to selectively output sound signals, and implementing mute and interruption processes to prevent echo and muffling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple sound input devices are connected to capture user voice, then the coverage of voice input is improved, but the audio quality deteriorates due to timing differences and device characteristics causing muffling or echo

Engineering Contradiction:
Improvevoice input coverageVSAvoidaudio quality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent divides the sound input system into separate processing channels for each sound input device. Each device's audio signal is processed independently through its own volume control and mixing parameters, allowing selective adjustment of each device's contribution to the final mixed output, thereby preventing audio quality degradation while maintaining multi-device functionality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts mixing parameters (volume levels, pan positions, delay compensation) for each sound input device based on their relative positions and characteristics. By changing these parameters adaptively, the system optimizes audio quality prevention while maintaining comprehensive voice capture coverage

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If voice from multiple players is mixed simply, then the chat function is implemented, but the voice becomes hard-to-hear due to muffling or echo generation

Engineering Contradiction:
Improvechat function implementationVSAvoidvoice clarity
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent introduces a sound input controlling unit as an intermediary between multiple sound input devices and the chat processing system. This intermediary applies echo cancellation algorithms and adaptive mixing before outputting to the chat function, preventing voice clarity loss while maintaining ease of chat operation

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically changes mixing parameters for each player's voice based on their spatial position and device characteristics. By adjusting volume levels and applying position-based compensation, the patent prevents muffling and echo while keeping the chat function simple to operate

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If sound signals from multiple devices are mixed, then comprehensive sound capture is achieved, but control complexity increases due to timing and characteristic differences

Engineering Contradiction:
Improvesound capture coverageVSAvoidmixing control complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary processing of sound signals from each device, including timing synchronization and characteristic normalization, before mixing. This preliminary action reduces the complexity of the mixing control by pre-aligning the signals, while maintaining comprehensive sound capture coverage

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3960259B1Information processing system, information processing device, method for controlling information processing device, and program
Publication Date: 2026.03.25 SONY INTERACTIVE ENTERTAINMENT LLC
  • EP3960259B1 patent drawingFigure 1
  • EP3960259B1 patent drawingFigure 2~3
  • EP3960259B1 patent drawingFigure 4(a)~4(b)

AI summary

An information processing apparatus is connected to peripheral apparatuses that are to be worn or grasped and used by one or more users. At least one of the peripheral apparatuses includes a device that collects sound of surroundings and outputs a sound signal representative of the collected sound. The information processing apparatus accepts a sound signal outputted from the peripheral apparatus that is worn or grasped by the user, selects at least part of such accepted sound signal or signals on the basis of a predetermined rule, and outputs the selected sound signal or signals while cutting off any other sound signal.