Session Speech-to-Text Conversion for Hearing-Impaired Players
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multiplayer game systems cannot accommodate players who are deaf or have hearing impairments, or those in quiet environments, as they cannot effectively participate in voice chat communications, leading to disconnection from the gaming experience.
Innovation Solution
Implementing a speech-to-text conversion feature that allows players to receive voice communications as text messages, distributing the computational load across multiple devices and using a conversion model specific to the game title for efficient conversion, while maintaining the voice chat experience for other players and ensuring participant privacy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If voice chat is used for multiplayer communication, then players can communicate audibly, but players with hearing impairments or in quiet environments cannot participate effectively
Solution Approach 1:
The patent introduces speech-to-text conversion as an intermediary mechanism that translates voice communications into text form. This mediator allows hearing-impaired players to access voice chat content without requiring actual hearing capability, thus resolving the contradiction between maintaining voice chat functionality and achieving accessibility for all players
Solution Approach 2:
The system changes the output parameter of communication from auditory (voice) to visual (text). By converting the communication modality parameter, the system enables players with hearing impairments to participate in voice chat through text-based reception, thereby improving adaptability without sacrificing communication effectiveness
2Adaptability or versatility
If speech-to-text conversion is implemented for all players, then hearing-impaired players can participate, but computational load and latency increase
Solution Approach 1:
The patent applies speech-to-text conversion selectively only to players who need it (hearing-impaired players) rather than all players. This localized application reduces unnecessary computational overhead while still achieving the goal of inclusivity. The system identifies which players require text conversion and applies the processing only for their benefit
Solution Approach 2:
The communication system is segmented into different processing paths: one for hearing players (direct voice transmission) and another for hearing-impaired players (voice-to-text conversion). This segmentation allows the system to maintain efficient voice communication for the majority while providing enhanced text-based access only where needed, reducing overall computational complexity
3Adaptability or versatility
If text messages are displayed in the chat interface, then hearing-impaired players can receive communications, but the chat interface may obstruct primary game content
Solution Approach 1:
The patent positions the chat interface in the vertical dimension (overlaying game content vertically) rather than horizontally blocking it. By utilizing the vertical space above or below the game view, the system provides text communication access without significantly obstructing the primary game content area, thus resolving the spatial conflict between accessibility and gameplay visibility
Data Source
AI summary
Examples described herein provide various devices that enable users to participate in a session. The examples allow a user that is unable to hear, or that is incapable of hearing, to participate in an in-session voice chat by receiving text messages that have been converted from speech to text (e.g., transcribed messages). The user enables a speech-to-text conversion feature on his or her own device. Based on the enabled feature, a notification can be sent to other devices participating in the session. Based on the notification, the other devices are tasked with capturing utterances and sending corresponding speech data to a speech-to-text conversion device so that voice communications can be converted to text messages. Subsequent to conversion, the text messages can be displayed in a chat interface presented as part of the displayed content for the session.