Game Audio Stream Prioritization for Speech Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-player online gaming, managing and prioritizing audio and video streams from multiple players to ensure clear communication and accurate speech recognition can be challenging, as voices from other players may obscure the intended speaker's audio, leading to recognition errors.
Innovation Solution
A method and system that embeds a communication client within a gaming system, allowing players to initiate and manage voice and video calls, and applies game logic to selectively output audio and video streams based on the game's current state, ensuring that only relevant streams are prioritized and mixed, reducing interference and improving recognition accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all player audio streams are output simultaneously in multi-player online gaming, then complete communication coverage is achieved, but speech recognition accuracy deteriorates due to voice obscuration from multiple speakers
Solution Approach 1:
The patent extracts and prioritizes only the relevant speaker's audio stream for output while temporarily suppressing other players' audio streams. The speech recognition system extracts speech data from the audio mixture, identifies the relevant speaker based on game state, and outputs only that speaker's stream to the speaker, ensuring clear recognition without interference from other players' voices.
Solution Approach 2:
The audio stream output is dynamically adjusted based on the current game state. The system continuously monitors game events, player positions, and interaction contexts to determine which speaker is relevant at any given moment, changing the output audio stream dynamically to match the current game situation rather than maintaining a static all-players-always-visible approach.
2Adaptability or versatility
If multiple audio streams are mixed and output simultaneously, then all players can communicate, but the intended speaker's audio becomes obscured leading to recognition errors
Solution Approach 1:
The system uses feedback from the speech recognition system to identify which player is the intended speaker. The speech recognition system analyzes the audio mixture, detects speech patterns, and provides feedback about which player should be heard, allowing the audio output system to adjust and prioritize the correct speaker's stream while maintaining the ability to handle multiple communication scenarios.
3Measurement precision
If the system prioritizes selective audio stream output based on game state, then speech recognition accuracy improves, but system complexity increases due to additional management logic
Solution Approach 1:
The audio management system is integrated into the existing game state management infrastructure, using the same game state data that the game logic already maintains. The speech recognition system leverages the existing player identification and game event tracking mechanisms, avoiding the need for separate dedicated systems and reducing overall complexity despite the selective prioritization functionality.
Data Source
AI summary
A method and system for outputting data streams in a communication, the method comprising: executing an electronic game application at a user terminal, the game application being programmed to allow two or more users of the communication system to participate in the game; receiving two or more data streams at the user terminal, each data stream being generated by a user of the communications system participating in the game; applying game logic to determine the current state of the game application; and selecting one or more of the received data streams to be output from an output device of the user terminal, wherein the selection depends on the current state of the game application.