Sound Output Control Apparatus Voice Activity Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing number of users participating in voice chat leads to a significant load on both user apparatuses and servers, resulting in decreased service quality and increased operational and communication costs due to elevated communication volumes in sound data transmission.

Innovation Solution

A sound output control system that includes a reception section to receive sound data, a selection section to choose portions of sound data based on voice activity detection and moving averages, and an output section to transmit the selected data, thereby reducing the load and communication volume by selectively outputting and relaying sound data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all pieces of sound data are transmitted to ensure complete voice chat communication, then communication quality is maintained, but communication volume and server load increase significantly

Engineering Contradiction:
Improvevoice chat communication qualityVSAvoidcommunication volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary sound data for voice chat communication by using voice activity detection to identify meaningful speech segments and filtering out unnecessary audio data. This extraction is performed at both the client and relay server levels, where the relay server selectively relays only the extracted relevant sound data between users, thereby reducing overall communication volume while maintaining communication quality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the parameter of data selection by using voice activity detection results and moving averages of sound volumes to determine which sound data pieces should be transmitted. The system dynamically adjusts the selection criteria based on detected voice activity patterns and communication conditions, optimizing the balance between communication quality and data volume reduction.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If voice activity detection and selective sound data transmission are implemented to reduce communication volume, then communication cost decreases, but system complexity increases

Engineering Contradiction:
Improvecommunication volumeVSAvoidsystem structure complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent introduces a relay server as an intermediary component that handles the complex tasks of receiving sound data from multiple users, performing voice activity detection, selecting relevant data pieces, and relaying them to appropriate users. This intermediary approach distributes the system complexity to a dedicated server, allowing client devices to remain relatively simple while still benefiting from reduced communication volumes.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If the number of sound data pieces to be relayed is reduced to lower server load, then operational cost decreases, but voice chat service quality deteriorates

Engineering Contradiction:
Improvenumber of sound data piecesVSAvoidvoice chat service quality
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the relay server monitors voice activity detection results and moving averages of sound volumes in real-time. Based on this feedback, the system dynamically adjusts the number and selection of sound data pieces to relay, ensuring that service quality is maintained while minimizing server load and operational costs.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12033655B2Sound output control apparatus, sound output control system, sound output control method, and program
Publication Date: 2024.07.09 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12033655B2 patent drawing
  • US12033655B2 patent drawing
  • US12033655B2 patent drawing

AI summary

Provided are a sound output control apparatus, a sound output control system, a sound output control method, and a program that can appropriately thin out the output of pieces of sound data. A sound data reception section receives a plurality of pieces of sound data transmitted from transmission apparatuses that are different from each other. A selection section selects a portion of the plurality of pieces of sound data on the basis of at least one of a result of a voice activity detection process performed on each of the pieces of sound data or moving averages of volumes of sounds represented by the pieces of sound data. A sound data transmission section outputs the selected portion of the pieces of sound data.